CN113791750B

CN113791750B - Virtual content display method, device and computer readable storage medium

Info

Publication number: CN113791750B
Application number: CN202111123906.9A
Authority: CN
Inventors: 马海刚; 马维宁; 甘泰玮
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-09-24
Filing date: 2021-09-24
Publication date: 2023-12-26
Anticipated expiration: 2041-09-24
Also published as: CN113791750A

Abstract

The embodiment of the invention discloses a virtual content display method, a virtual content display device and a computer readable storage medium, and can be applied to various scenes such as cloud technology, artificial intelligence, intelligent traffic, auxiliary driving and the like. Specifically, the method can receive a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; performing authority verification processing on the authority identification information; when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client such that the augmented reality client displays the virtual content. By the embodiment of the application, the display efficiency of the virtual content can be improved.

Description

Virtual content display method, device and computer readable storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a virtual content display method, device, and computer readable storage medium.

Background

The augmented reality (Augmented Reality, AR) technology is a technology of skillfully fusing virtual information with a real world, and widely uses various technical means such as multimedia, three-dimensional modeling, real-time searching and registering, intelligent interaction, sensing and the like, and applies virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer to the real world after simulation, wherein the two kinds of information are mutually complemented, so that the 'enhancement' of the real world is realized.

In the prior art, virtual content of an AR is often required to be displayed by means of a Marker trigger. For example, the user may scan the identification by the application to trigger the virtual content of the AR to be displayed. In the course of research and practice of the prior art, the applicant of the present application found that often only one virtual content could be bound to one identifier, which would result in waste of resources. In addition, when virtual contents are increased, the identifications are correspondingly increased, which reduces the display efficiency of the virtual contents.

Content of the application

Embodiments of the present application provide a virtual content display method, apparatus, and computer readable storage medium, which can improve the display efficiency of virtual content.

The embodiment of the application provides a virtual content display method, which comprises the following steps:

receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark;

analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of the target identification;

performing authority verification processing on the authority identification information;

when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to a mapping relation between preset link information and preset virtual content;

and sending the target virtual content to the augmented reality client so that the augmented reality client displays the virtual content.

Correspondingly, the embodiment of the application also provides a virtual content display device, which comprises:

the first receiving unit is used for receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark;

the first analysis unit is used for analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of the target identification;

the authority verification unit is used for performing authority verification processing on the authority identification information;

The first acquisition unit is used for acquiring target virtual contents corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual contents when the authority verification is passed;

and the first sending unit is used for sending the target virtual content to the augmented reality client so that the augmented reality client displays the virtual content.

In an embodiment, the acquiring unit includes:

the matching subunit is used for matching the target link information with the preset link information to obtain a matching result;

and the determining subunit is used for determining the target virtual content corresponding to the target link information based on the mapping relation according to the matching result.

In an embodiment, the virtual content display apparatus further includes:

the second receiving unit is used for receiving a virtual content uploading instruction sent by the virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded;

the generation unit is used for generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction;

The binding unit is used for binding the virtual content to be uploaded and the identification mark to obtain a virtual content after binding;

the configuration unit is used for carrying out configuration processing on the at least one virtual content after binding based on the configuration information to obtain at least one virtual content after configuration;

and the storage unit is used for storing the at least one configured virtual content into a target virtual content storage library and sending the identification to the virtual content development end.

In an embodiment, the configuration unit includes:

the first acquisition subunit is used for acquiring the link information of the virtual content after binding, wherein the link information characterizes the identification identifier corresponding to the virtual content after binding;

the authority association subunit is used for carrying out authority association processing on the bound virtual content and the link information based on the authority configuration information to obtain authority-associated virtual content;

the period configuration subunit is used for carrying out period configuration processing on the virtual content after the authority association and the link information based on the period configuration information to obtain virtual content after the period configuration;

and the distribution binding subunit is used for carrying out distribution binding processing on the virtual content after the periodic configuration and the link information based on the distribution configuration information to obtain the virtual content after the configuration.

In an embodiment, the rights association subunit comprises:

the first analysis module is used for analyzing the authority configuration information to obtain at least one authority access condition;

the first construction module is used for constructing the authority mapping relation between the link information and the virtual content to be uploaded based on the authority access condition to obtain the virtual content after the authority association.

In an embodiment, the period configuration subunit includes:

the second analysis module is used for analyzing the period configuration information to obtain a display period;

the adding module is used for adding a release time point for the virtual content after the permission association based on the display period;

the establishing module is used for establishing a release mapping relation between the link information and the virtual content after the permission association based on the release time point to obtain the virtual content after the periodic configuration.

In an embodiment, the distribution binding subunit comprises:

the third analysis module is used for analyzing the distribution configuration information to obtain at least one distribution object identifier and virtual content corresponding to the distribution object identifier;

the binding module is used for binding the at least one distribution object identifier and the link information to obtain bound link information;

And the second construction module is used for constructing a distribution mapping relation between the link information after binding and the virtual content after periodic configuration based on the virtual content corresponding to the distribution object identifier to obtain the virtual content after configuration.

In an embodiment, the generating unit includes:

the detection subunit is used for carrying out identification detection processing on the virtual content to be uploaded;

the identification subunit is used for identifying the virtual content to be uploaded to obtain the content information of the virtual content to be uploaded when the virtual content to be uploaded does not carry the identification mark;

the encryption subunit is used for carrying out encryption processing on the content information to obtain encrypted content information;

and the generation subunit is used for generating the identification mark based on the encrypted content information.

In an embodiment, the identification subunit comprises:

the format identification module is used for carrying out format identification on the virtual content to be uploaded when the virtual content to be uploaded does not carry the identification mark, so as to obtain format information of the virtual content to be uploaded;

the format conversion module is used for carrying out format conversion processing on the virtual content to be uploaded based on the format information of the virtual content to be uploaded to obtain virtual content after format conversion;

And the content identification module is used for carrying out content identification on the virtual content after format conversion to obtain the content information.

In an embodiment, the virtual content display apparatus further includes:

the third receiving unit is used for receiving a binding relation update instruction, wherein the binding relation update instruction carries virtual content to be updated;

the first identification unit is used for identifying the virtual content to be updated to obtain link information corresponding to the updated virtual content;

the screening unit is used for screening out virtual contents corresponding to the link information from the target virtual content storage library;

and the updating unit is used for updating the virtual content corresponding to the link information into the virtual content to be updated to obtain updated virtual content.

In an embodiment, the virtual content display apparatus further includes:

a fourth receiving unit, configured to receive a configuration information update instruction, where the configuration information update instruction carries update configuration information;

the second identification unit is used for identifying the updated configuration information to obtain identification information of the updated configuration information;

the extraction unit is used for extracting the virtual content to be configured and the link information corresponding to the virtual content to be configured based on the identification information;

And the configuration updating unit is used for carrying out configuration updating processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured based on the update configuration information to obtain virtual content after configuration updating.

Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The computer instructions are read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the methods provided in the various alternatives of the above aspect.

Accordingly, the embodiments of the present application further provide a computer readable storage medium, where instructions are stored, where the instructions, when executed by a processor, implement the virtual content display method provided in any one of the embodiments of the present application.

The embodiment of the application can receive the virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; performing authority verification processing on the authority identification information; when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client such that the augmented reality client displays the virtual content. By the embodiment of the application, the display efficiency of the virtual content can be improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic view of a scenario provided by a virtual content display method according to an embodiment of the present application;

fig. 2 is a schematic flow chart provided by a virtual content display method according to an embodiment of the present application;

fig. 3 is a schematic view of a scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 4 is a schematic view of still another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 5 is a schematic view of still another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 6 is a schematic view of still another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 7 is a schematic view of a scenario of an AR cloud platform interface provided in an embodiment of the present application;

FIG. 8 is a schematic view of yet another scenario of an AR cloud platform interface provided by embodiments of the present application;

fig. 9 is a schematic view of a scenario of an AR cloud platform interface provided in an embodiment of the present application;

Fig. 10 is a schematic view of a scenario of an AR cloud platform interface provided in an embodiment of the present application;

fig. 11 is a schematic view of a scenario of an AR cloud platform interface provided in an embodiment of the present application;

fig. 12 is a schematic view of a scenario of an AR cloud platform interface provided in an embodiment of the present application;

FIG. 13 is a schematic view of another process provided by the virtual content display method according to the embodiment of the present application;

fig. 14 is a schematic view of a scene provided by the virtual content display apparatus provided in the embodiment of the present application;

FIG. 15 is a schematic view of still another scenario provided by the virtual content display apparatus provided by the embodiments of the present application;

fig. 16 is a schematic structural diagram of a terminal provided in an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The embodiment of the application proposes a virtual content display method, which can be executed by a virtual content display device, which can be integrated in an electronic apparatus. The electronic device may include at least one of a terminal, a server, and the like.

It will be appreciated that the virtual article display method of the present embodiment may be executed on a server, or may be executed by both a terminal and a server.

The terminal can include, but is not limited to, a mobile phone, a computer, an intelligent voice interaction device, an intelligent household appliance, a vehicle-mounted terminal and the like.

The server may be an interworking server or a background server among a plurality of heterogeneous systems, may be an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, and may be a cloud server for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, basic cloud computing services such as big data and an artificial intelligence platform, and the like.

It should be noted that the embodiments of the present application may be applied to various scenarios, including, but not limited to, cloud technology, artificial intelligence, intelligent transportation, assisted driving, and the like.

In an embodiment, as shown in fig. 1, taking the electronic terminal as a server as an example, the virtual article display system provided in the embodiment of the present application may include a terminal 10, a server 11, and the like; the terminal 10 and the server 11 are connected via a network, for example, a wired or wireless network connection. Wherein the virtual article display device is integrated in the server. An augmented reality client may be integrated on the terminal 10.

In an embodiment, the server 11 may be configured to: receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; performing authority verification processing on the authority identification information; when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client such that the augmented reality client displays the virtual content.

In one embodiment, the terminal 10 may be configured to: the virtual content transmitted by the server 11 is received, and the virtual content is loaded and rendered so that the virtual content is realistic in the correct reality client.

The virtual content display method provided by the embodiment of the application relates to Computer Vision (CV) in the field of artificial intelligence (AI, artificial Intelligence), and in particular relates to the technical field of augmented reality (AR, augmented Reality) in Computer Vision. The embodiment of the application can realize the combination of the display of the virtual article and the augmented reality technology, thereby enriching the display mode of the virtual article, expanding the interaction mode between the user and the virtual article and increasing the interestingness of the virtual article.

Among these, artificial intelligence (AI, artificial Intelligence) is the theory, method, technique and application system that uses a digital computer or a digital computer-controlled machine to simulate, extend and expand human intelligence, sense the environment, acquire knowledge and use knowledge to obtain optimal results. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence, i.e. research on design principles and implementation methods of various intelligent machines, enables the machines to have functions of sensing, reasoning and decision. The artificial intelligence technology is a comprehensive subject, and relates to the technology with wide fields, namely the technology with a hardware level and the technology with a software level. Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises the directions of computer vision technology, voice processing technology, natural language processing technology, machine learning/deep learning and the like.

The Computer Vision technology (CV) is a science for researching how to make a machine "look at", and further means that a Computer replaces a human eye to perform machine Vision such as identifying and measuring on a target, and further performs image processing, so that the image is processed by the Computer to become an image more suitable for human eye observation or transmitting to an instrument for detection. As a scientific discipline, computer vision research-related theory and technology has attempted to build artificial intelligence systems that can acquire information from images or multidimensional data. Computer vision techniques typically include image processing, image recognition, three-dimensional object reconstruction, virtual reality, augmented reality, etc., as well as common biometric recognition techniques such as face recognition, human body gesture recognition, etc.

The augmented reality (Augmented Reality, AR) technology is a technology of skillfully fusing virtual information with a real scene, and widely uses various technical means such as multimedia, three-dimensional modeling, real-time tracking and registering, intelligent interaction, sensing and the like, and applies virtual information generated by a computer to the real scene after simulation and emulation of the virtual information such as characters, images, three-dimensional models, music, video and the like, thereby realizing the enhancement of the real scene.

The following will describe in detail. The following description of the embodiments is not intended to limit the preferred embodiments.

In an embodiment, the virtual content display apparatus may be integrated on a computer device such as a terminal or a server, so as to implement the virtual content display method provided in the embodiments of the present application. Specifically, the computer device may receive a virtual content acquisition instruction triggered by the augmented reality client based on the target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; performing authority verification processing on the authority identification information; when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client such that the augmented reality client displays the virtual content. According to the embodiment of the application, different target virtual contents can be displayed by different authority identification information, so that the target virtual contents corresponding to the target identification can be dynamically changed, each virtual content does not need to generate an identification, the required storage capacity of the virtual content display device is reduced, and the display efficiency of the virtual content is improved.

The embodiments of the present application will be described from the viewpoint of a virtual content display apparatus that may be integrated in a computer device, which may be a server or a terminal, or other devices.

As shown in fig. 2, a virtual content display method is provided, and the specific flow includes:

101. and receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark.

Wherein the client may comprise a computer connected to a network that accepts control and management of a network server, and is capable of sharing various resources on the network. For example, clients may include web browsers, application programs, applets, and the like.

The application programs may include application software on various terminals, among others. For example, the Application programs may include various mobile phone software (Application), tablet computer Application software, application software on a notebook computer, application software on a personal computer (PC, personal Computer), application software on a wearable electronic device, and so forth.

Among them, the applet (Mini Program) is an application Program that can be used without downloading and installing. In order to provide more diversified business services to users, developers can develop corresponding applets for applications of the terminal (e.g., instant messaging applications, shopping applications, mail applications, etc.), which can be embedded as sub-applications into the applications of the terminal, and can provide corresponding business services to users by running the sub-applications (i.e., corresponding applets) within the applications. Wherein the augmented reality client comprises a client with an augmented reality function

Wherein the augmented reality client may include a client having an augmented reality function. For example, an augmented reality client may include an APP with augmented reality functionality. For another example, the augmented reality client may include an applet with augmented reality functionality. For another example, the augmented reality client may include glasses with augmented reality functionality, and so on.

The augmented reality (Augmented Reality, AR) technology is a technology of skillfully fusing virtual information with a real world, and widely uses various technical means such as multimedia, three-dimensional modeling, real-time tracking and registering, intelligent interaction, sensing and the like, and applies virtual contents such as characters, images, three-dimensional models, music, videos and the like generated by a computer to the real world after simulation, so that the two kinds of information are mutually supplemented, thereby realizing the enhancement of the real world.

In one embodiment, the AR includes three technical points, namely three-dimensional registration (pursuit registration technology), virtual reality fusion display, and man-machine interaction. The method comprises the steps of firstly collecting data of a real scene through a camera and a sensor, transmitting the data into a processor for analysis and reconstruction, updating the spatial position change data of a user in a real environment in real time through accessories such as the camera, a gyroscope and the sensor on an AR head display or intelligent mobile equipment, so as to obtain the relative positions of the virtual scene and the real scene, realize the alignment of a coordinate system, perform fusion calculation of the virtual scene and the real scene, and finally present a synthesized image of the virtual scene and the real scene to the user. The user can acquire control signals through the AR head display or interaction accessories on the intelligent mobile equipment, such as a microphone, an eye tracker, an infrared sensor, a camera, a sensor and the like, and perform corresponding man-machine interaction and information updating to realize augmented reality interaction operation. The three-dimensional registration is the core of the AR technology, namely, a two-dimensional or three-dimensional object in a real scene is taken as a marker, and the virtual content and the real scene information are matched in a counterpoint mode, namely, the position, the size, the motion path and the like of the virtual object are required to be perfectly matched with the real environment, so that the virtual-real life steps are achieved.

In an embodiment, the identifying identification may include an identification that matches the virtual content with the real scene information in alignment. By identifying the identification, the virtual content and the real scene information can be matched, so that the virtual content and the real scene can be perfectly fused.

In one embodiment, the identification tag may be a two-dimensional object. For example, the identification mark may include a pattern of recording data symbol information, which is distributed in a plane by a certain rule using a certain geometric pattern, and which is black-white. For example, the identification identifier may include a two-dimensional code, and so on. As another example, the identification identifier may include a quick matrix response code (Quick Response code, QR code) and applet code, among others.

Wherein the target identification comprises an identification corresponding to a particular virtual content. A particular virtual content may be displayed by the object identification.

The virtual content may include content that may be generated by electronic device rendering and may be combined with the real world. Wherein, the virtual content can be two-dimensional content or three-dimensional content. For example, virtual content may include three-dimensional images, three-dimensional video, and three-dimensional text, among others. For another example, virtual content may include two-dimensional images, two-dimensional video, and two-dimensional text, among others. For another example, virtual content may include content in the format of.3ds,.ma,.x,.3dm,.c4d, and.obj.

In an embodiment, the augmented reality client may be integrated on a terminal with a camera. For example, the augmented reality client may be integrated on a cell phone with a camera. After the object starts the camera to scan the target identification through the augmented reality client, the virtual content display device receives the virtual content acquisition instruction. When the identification mark is a two-dimensional code and the augmented reality client is an APP, a user can start the mobile phone to scan the two-dimensional code through the APP, and then the virtual content display device receives a virtual content acquisition instruction.

In an embodiment, in order to better implement the virtual content display method provided in the embodiment of the present application, the embodiment of the present application correspondingly provides a virtual content display system. Wherein the virtual content display system may be as shown in fig. 3.

As shown in fig. 3, the virtual content display system may include a client, a presentation medium, a software development kit (Software Development Kit, SDK), and an AR cloud platform.

In an embodiment, the AR cloud platform may be a platform that provides technical support for the virtual content display method provided in the embodiments of the present application. Through the AP cloud platform, the virtual content display process can be configured, managed, stored and the like without developing the virtual content display process by a developer, so that the display efficiency of the virtual content is improved. For example, through an AR cloud platform, a mapping relationship between virtual content and identification, and so on, may be configured. For another example, through the AR cloud platform, identification tags may also be generated, and so on.

The AR cloud platform comprises a material management module, an operation management module, a technical platform module and a technical sharing module.

The material management module is responsible for managing virtual contents. For example, the material management module supports mainstream content standard files (e.g., 3ds/. Ma/. X/.3dm/. C4D/. Obj, etc.) that automatically transition to VRML or WRL upon reaching the server. In addition, the material management module also supports standard material files such as characters, pictures, videos and the like. Through the material management module, management operations such as starting and stopping, mounting and mounting the materials, checking the contents and the like can be realized.

The operation management module is responsible for managing the relationship among the two-dimension code, the two-dimension code and the virtual content. In addition, the operation management module can also realize user (equivalent to object) management, application management, authority management, distribution management, period management and release management.

For example, the two-dimension code management sub-module of the operation management module can provide functions of manually uploading the two-dimension code, encrypting according to information content, generating the two-dimension code, automatically shorting and linking according to links, generating the two-dimension code randomly, generating the two-dimension code in batches, binding the appointed user/user group and the like. And the two-dimensional code editing and deleting, starting and stopping, loading and unloading and other functional operations can be performed.

For another example, the operation management module can perform binding management on the virtual content correspondingly displayed when the two-dimensional code is identified and tracked. The method can perform operation management such as designated binding, designated user display (different users of the same marker display different contents), editing and deleting, enabling and disabling, putting on shelf and taking off the shelf and the like.

For another example, the user management sub-module of the operation management module can manage the application user, and can add, delete and examine the user, establish the management user group, and the like.

For another example, the application management sub-module of the operation management module can provide management of adding and deleting application functions, secret id/key generation, enabling and disabling applications and the like for management of different applications under the same tenant.

For another example, the management and operation of the distribution of virtual content to a particular user group may be performed by a distribution management sub-module of the operations management module. For example: advertisement virtual contents are distributed aiming at marks in the child education APP user group, special price commodity introduction virtual contents are distributed aiming at the VIP group in the shopping APP, and the like.

For another example, the period management sub-module of the operation management module may periodically manage delivery and distribution of the virtual content. For example, the virtual content of the APP of preschool education, industry training and magazine subscription class can be scheduled in advance through periodic management if the virtual content needs to be updated every week, and different virtual contents are displayed corresponding to the same marker in different time intervals.

The technical platform can be the technical support of other platforms. The functions of material dispatch, material conversion, application authentication, material storage, tenant management and the like can be realized through the technical platform.

The technology sharing module can enable technologies which can be supported by the technology platform to be realized in the material management module and the operation management module. For example, the material management module may be enabled to convert a c4d format file into a WRL file or a VRML file via a technology sharing module. For another example, the operation management module can realize the functions of batch import and batch operation through the technology sharing module.

In one embodiment, the SDK may be a software development kit that implements AR functionality. The SDK can realize the functions of identifying the identifier as AR pursuit, automatically positioning, pursuing, analyzing a two-dimensional code link, downloading virtual content corresponding to the link to an AR cloud platform, pursuing the angle, depth, deformation, orientation, perspective and the like between a two-dimensional code computing camera and the two-dimensional code, computing how the virtual content is displayed (perspective effect, size, map and the like of the virtual content), completing rendering of the virtual content and the like. Through the SDK, a client developer may develop a client with AR functionality. When the augmented reality client is developed, a developer can integrate the SDK into the augmented reality client so as to realize the AR function without debugging two-dimensional code content, display effect, virtual content, registering two-dimensional codes needing to be searched and other technical details, so that the development efficiency of the augmented reality client is improved.

Wherein the SDK may support identification tracking and parsing. For example, the SDK may enable the tracing and parsing of QR codes, applet codes, and other two-dimensional codes. In addition, the SDK can also support functions such as 3D gesture calculation, projection matrix calculation, server hand-held authentication, material downloading, material rendering, material loading cache, virtual reality synthesis, virtual reality display and the like.

In one embodiment, the presentation media may comprise presentation media of virtual content. For example, virtual content may be displayed in a blended manner with a real scene on a cell phone. For another example, the virtual content may be displayed through AR glasses and a real scene in a fused manner.

In an embodiment, the virtual content display apparatus may be integrated with an AR cloud platform, so that the virtual content display method provided in the embodiments of the present application may be implemented based on the AR cloud platform.

For example, through the AR cloud platform, the same user may be enabled to scan the same identification identifier for the possibility of displaying different virtual contents. For example, as shown in fig. 4, when the application user a scans the two-dimensional code by applying C, one virtual content is displayed, and when the application user a scans the two-dimensional code by applying D, another virtual content is displayed.

For another example, virtual content uploaded by different virtual content development ends can be received through the AR cloud platform. For example, as shown in fig. 5, the AR cloud platform may receive virtual content uploaded by an application operator, implement material management, operation management, and the like for the virtual content. In addition, the AR cloud platform can also receive virtual content uploaded by advertisers, and material management, operation management and the like of the virtual content are realized.

For another example, the user may also author virtual content through the AR cloud platform and store the created content into the AR cloud platform. For example, as shown in fig. 6, application user a and application user C may author virtual content through client application a and store the authored content into the cloud platform. For another example, as shown in fig. 6, an author may author virtual content through an authoring application C and store the authored content into a cloud platform.

For another example, the application user a may create virtual content on the APP by "authoring application" and upload the virtual content to the platform via the SDK, and bind the content to one of the tags on the user B's hand, for example, so that the effect similar to "private information transfer each other" and "private card" between ABs can be achieved.

In an embodiment, the AR cloud platform further has a visual operation platform, so that an AR cloud platform administrator can manage and control the AR cloud platform.

For example, as shown in FIG. 7, a visual interface for material management is provided. Through the material management platform, an AR cloud platform administrator can manage materials in the AR cloud platform.

As another example, as shown in fig. 8, a visual interface of the add-on material is provided. When the virtual content development end needs to add the material, the material can be added through the visual interface.

As another example, as shown in fig. 9, a visual management platform for identifying indicia is provided. Through the material management platform, an AR cloud platform administrator can manage the identification in the AR cloud platform.

For another example, as shown in FIG. 10, a visualization interface for newly created markers is provided. When the virtual content development end needs to newly build a mark, the mark can be added through the visual interface.

As another example, as shown in FIG. 11, a visual management platform for material delivery task management is provided. Through the material delivery task management platform, an AR cloud platform administrator can manage delivery tasks in the AR cloud platform.

For another example, as shown in fig. 12, a visual interface for newly-built task is provided, so that the virtual content development end can launch new task through the visual interface.

In an embodiment, the client may be integrated with an SDK, have an augmented reality function, and may acquire virtual content by identifying a terminal that acquires and displays the virtual content. For example, the client may include an application with augmented reality functionality. For another example, the client may include a content authoring platform with AR functionality, and so on.

102. And analyzing the virtual content acquisition instruction to obtain the authority identification information and the target link information of the target identification.

In an embodiment, the virtual content reality method provided by the embodiment of the application can realize that different authority identification information can display different target virtual contents. Therefore, after the virtual content display device receives the virtual content acquisition instruction, the virtual content acquisition instruction can be analyzed to obtain the authority identification information and the target link information of the target identification.

Wherein the rights identification information includes information that can identify the augmented reality client and identify the object that triggered the virtual content acquisition instruction. That is, by the rights identification information, it is possible to know who triggered the virtual content acquisition instruction by which augmented reality client. For example, with the rights identification information, the virtual content display apparatus is that the object a triggered the virtual content acquisition instruction through the augmented reality client a.

In an embodiment, the rights identification information may include client identification information and object identification information. The client identifying information may include information that identifies the augmented reality client. For example, the client identifying information may be a port number of the augmented reality client, and so on. Wherein the object identification information may include information that identifies the object. For example, the object identification information may include a login account number of a login augmented reality client of the object, and so on.

In an embodiment, the rights identification information may be signature information (SecretId). Wherein the SecretId may be used to identify the identity of the client. By the SecretId, the virtual content display apparatus can know which client requests the virtual content to be displayed.

In an embodiment, the link information may be generated for the identification identifier, and the link information of the identification identifier and the identification identifier may be bound, so that virtual content may be obtained through the link information, thereby saving storage space. The link information may be information having an identifying effect on the identification. For example, the link information may be an address symbol or a character string, or the like. For example, the link information may be a uniform resource locator (Uniform Resource Locator, URL), or the like.

In one embodiment, the virtual content acquisition instruction may be parsed in a plurality of ways to obtain rights identification information and target link information of the target identification.

For example, the virtual content acquisition instruction may be traversed, thereby obtaining rights identification information and target link information of the target identification.

As another example, the virtual content acquisition instruction generally has a specific information format that specifies what information is stored in what location of the virtual content acquisition instruction. Therefore, the information format can be used for directly positioning the storage positions of the authority identification information and the target link information, and reading the information on the positions, so that the authority identification information and the target link information of the target identification mark are obtained.

103. And carrying out authority verification processing on the authority identification information.

In an embodiment, the virtual content display method provided by the embodiment of the application can realize that different pieces of authority identification information can display different target virtual contents, so that authority verification processing can be performed on the authority identification information, and whether the authority identification information has the authority for displaying the virtual contents or not is determined according to the authority verification processing result.

In an embodiment, since the authority identification information may include the client identification information and the object identification information, the authority verification process may be performed on the client identification information and the object identification information when the authority verification process is performed on the authority identification information.

For example, whether the augmented reality client has authority to display the virtual content corresponding to the target identification mark and whether the object has authority to display the virtual content corresponding to the target identification mark can be judged by the client identification information and the object identification information.

In one embodiment, the rights identification information may be subjected to the rights verification process in a number of ways.

For example, the AR cloud platform may store preset rights access conditions, and then may perform rights verification processing on the client identification information and the object identification information through the preset rights access conditions.

For example, when the preset authority access condition only sets the authority of the augmented reality client, the client identification information and the preset access condition may be matched. When the matching is passed, the augmented reality client is indicated to have the authority of displaying the virtual content corresponding to the target identification mark.

For another example, when the preset authority access condition sets the authority of the augmented reality client and the object, the client identification information and the object identification information may be matched with the preset access condition. When the matching is passed, the augmented reality client and the object are indicated to have the authority of displaying the virtual content corresponding to the target identification mark.

In addition, the AR cloud platform can also use a signature method to carry out authority verification processing on the authority identification information.

For example, when the rights identification information is SecretId, the AR cloud platform may perform a rights verification process on the rights identification information using a verification key (SecretKey). The SecretKey may be a key pre-stored in the AR cloud platform for verifying SecretId.

104. And when the permission verification is passed, acquiring target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content.

In an embodiment, when the right verification is passed, the virtual content display device may acquire the target virtual content corresponding to the target link information according to the mapping relationship between the preset link information and the preset virtual content.

The mapping relation between the preset link information and the preset virtual content defines the association relation between the link information and the virtual content. By the mapping relation between the preset link information and the preset virtual content, it is possible to know which link information will display which virtual content.

In one embodiment, the mapping relationship between the preset link information and the preset virtual content may have various forms. For example, the mapping relationship may be presented in the form of a table. For another example, the mapping relationship may be presented in the form of a graph.

In an embodiment, the step of "obtaining the target virtual content corresponding to the target link information according to the mapping relationship between the preset link information and the preset virtual content when the right verification is passed" may include:

matching the target link information with preset link information to obtain a matching result;

and determining target virtual content corresponding to the target link information based on the mapping relation according to the matching result.

For example, a plurality of pieces of preset link information are stored in the AR cloud platform. Then, the target link information and the pieces of preset link information may be matched. When the target link information and the preset link information a are matched, the preset virtual content corresponding to the preset link information a can be determined as the target virtual content based on the mapping relation.

105. The target virtual content is sent to the augmented reality client such that the augmented reality client displays the target virtual content.

In an embodiment, after the virtual content display apparatus determines the target virtual content, the virtual content display apparatus may transmit the target virtual content to the augmented reality client such that the augmented reality client realizes the target virtual content.

For example, when the augmented reality client integrates the SDK proposed by the embodiment of the present application, the virtual content display apparatus may transmit the target virtual content to the SDK. The SDK may then render the target virtual content near the identification through the perspective projection matrix. For example, when the identification is a two-dimensional code, the SDK may render the target virtual content near the two-dimensional code through the perspective projection matrix, so that a mobile phone screen, a computer screen, or an HMD (head mounted display, AR glasses, stereoscopic projection, etc.) presents the rendering result.

In an embodiment, the AR cloud platform provided in the embodiment of the present application has a visual control page, through which a developer may upload virtual content to the AR cloud platform and configure the virtual content.

Thus, in an embodiment, before the step of receiving the virtual content acquisition instruction triggered by the augmented reality client based on the target identification, the step may include:

receiving a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded;

generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction;

binding the virtual content to be uploaded and the identification mark to obtain a virtual content after binding;

performing configuration processing on at least one bound virtual content based on the configuration information to obtain at least one configured virtual content;

storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to a virtual content development terminal.

Wherein the virtual content to be uploaded comprises the virtual content which the virtual content development terminal prepares to upload to the virtual content display device.

The configuration information may include content configured by the virtual content development end to upload virtual content. Through the configuration information, the virtual content to be uploaded can be displayed according to the intention of the virtual content development end.

In an embodiment, the virtual content display method provided by the embodiment of the application can realize that different objects scan the same identification mark to display different virtual contents, or the same object scan the same identification mark at different times to display different virtual contents. Accordingly, the configuration information may include at least one of authority configuration information, period configuration information, distribution configuration information, and the like.

The permission configuration information may include information that the virtual content development end configures for a display permission of the virtual content. By means of the rights configuration information, the virtual content developer can define what virtual content the different augmented reality clients will display and what virtual content the different objects will display. For example, the rights configuration information may define that virtual content a is displayed for object a and virtual content B is displayed for object B. For another example, the rights configuration information may define that virtual content a is displayed for augmented reality client a and virtual content is displayed for augmented reality client B.

The period configuration information may include information that the virtual content development end configures for a display period of the virtual content. By the period configuration information, the virtual content development terminal can specify what virtual content is displayed at what time. For example, by the period configuration information, the virtual content development terminal may designate that virtual content a be displayed in 1 month, virtual content B be displayed in 2 months, and virtual content C be displayed in 3 months.

The distribution configuration information may include information that the virtual content development end configures for a display scene of the virtual content. For example, advertisement virtual content is distributed for a mark in an APP user group for young child education, special price commodity introduction virtual content is distributed for a VIP group in a shopping APP, and the like.

In an embodiment, because the AR cloud platform may provide a function of generating the identification identifier for the virtual content developer, the virtual content display device may generate, after receiving the virtual content upload instruction, the identification identifier corresponding to each virtual content to be uploaded according to the virtual content upload instruction.

Wherein, when the virtual content is uploaded, the virtual content development terminal may already generate the identification for the virtual content to be uploaded. Therefore, the virtual content display apparatus can perform identification detection processing on the content to be uploaded, thereby judging whether the virtual content to be uploaded has identification. When the virtual content to be uploaded does not carry the identification mark, the identification mark is generated for the virtual content to be uploaded. Specifically, the step of generating an identification identifier corresponding to each virtual content to be uploaded according to the virtual content uploading instruction includes:

Performing identification detection processing on virtual content to be uploaded;

when the virtual content to be uploaded does not carry the identification mark, identifying the virtual content to be uploaded to obtain content information of the virtual content to be uploaded;

encrypting the content information to obtain encrypted content information;

an identification is generated based on the encrypted content information.

Wherein, the content information of the virtual content may include information capable of embodying characteristics of the virtual content. For example, when the virtual content is an image, the content information of the virtual content may include pixel values, color channel information, and the like of the virtual content. For another example, when the virtual content is text, the content information of the virtual content may include a font of the virtual content, a size of the word, semantic information of the word, and so on.

In an embodiment, when the virtual content to be uploaded carries the identification mark after identification detection processing is performed on the virtual content to be uploaded, binding processing can be performed on the virtual content to be uploaded and the identification mark, and the virtual content after binding is obtained. Then, configuring at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to a virtual content development terminal.

In an embodiment, when the virtual content to be uploaded does not carry the identification mark, the virtual content to be uploaded may be identified to obtain content information of the virtual content to be uploaded. And then, carrying out encryption processing on the content information to obtain encrypted content information. Next, an identification flag is generated based on the encrypted content information.

There are various methods for identifying the virtual content to be uploaded.

For example, when the virtual content to be uploaded is an image, tools such as a cross-platform computer vision library (Open Source Computer Vision Library, openCV) and the like can be used for identifying the virtual content to be uploaded, so as to obtain content information of the virtual content to be uploaded.

The OpenCV is a cross-platform computer vision library based on (open source) distribution, and can run on Linux, windows and Mac OS operating systems. The method is lightweight and efficient, is composed of a series of C functions and a small number of C++ classes, provides interfaces of Python, ruby, MATLAB and other languages, and realizes a plurality of general algorithms in the aspects of image processing and computer vision.

For another example, when the virtual content to be uploaded is text, the virtual content to be uploaded may be identified by using an optical character recognition (Optical character recognition, OCR) or the like, so as to obtain content information of the virtual content to be uploaded.

In one embodiment, the virtual content to be uploaded may be in a variety of different formats. For example, the virtual content to be uploaded may be in.3ds format and the virtual content to be uploaded may be in.ma format. Therefore, in order to improve the efficiency of processing the virtual content to be uploaded, format conversion can be performed on the virtual content to be uploaded, so as to obtain the virtual content after format conversion. Specifically, the step of identifying the virtual content to be uploaded to obtain content information of the virtual content to be uploaded when the virtual content to be uploaded does not carry the identification mark includes:

when the virtual content to be uploaded does not carry the identification mark, carrying out format identification on the virtual content to be uploaded to obtain format information of the virtual content to be uploaded;

based on format information of the virtual content to be uploaded, performing format conversion processing on the virtual content to be uploaded to obtain virtual content after format conversion;

and carrying out content identification on the virtual content after format conversion to obtain content information.

In one embodiment, the virtual content to be uploaded generally has a corresponding name with a format suffix name of the virtual content to be uploaded. Therefore, the suffix name of the virtual content to be uploaded can be identified, and the format information of the virtual content to be uploaded is obtained.

For example, when the format of the virtual content to be uploaded is.3ds, the suffix name of the virtual content name to be uploaded may have the name of.3ds. For another example, when the format of the virtual content to be uploaded is. Ma, the suffix name of the virtual content name to be uploaded will have the name of. Ma. Therefore, the format information of the virtual content to be uploaded can be obtained by identifying the suffix name of the virtual content name to be uploaded.

In an embodiment, after obtaining the format information of the virtual content to be uploaded, format conversion processing may be performed on the virtual content to be uploaded, so as to obtain the virtual content after format conversion. For example, virtual contents in the formats of.3ds, # ma, # x, # 3dm, # c4d, and # obj, etc. may be converted into VRML format or WRL format.

The format conversion processing can be performed on the virtual content to be uploaded in various modes, so that the virtual content after format conversion is obtained. For example, format conversion software or format conversion function may be used to perform format conversion processing on the virtual content to be uploaded, so as to obtain virtual content after format conversion. For another example, when the format of the virtual content to be uploaded cannot be directly converted into the target format, the format of the virtual content to be uploaded may be converted from the transition format into the target format after the format of the virtual content to be uploaded is converted into the transition format.

In an embodiment, after obtaining the post-format-conversion virtual content, content identification may be performed on the post-format-conversion virtual content to obtain content information.

In an embodiment, in order to improve reliability of the virtual content and the identification mark, to avoid deliberate damage or theft of the abnormal portion, the content information may be encrypted to obtain encrypted content information.

For example, the content information may be encrypted using a symmetric Algorithm (Data Encryption Standard, DES), an international data encryption Algorithm (International Data Encryption Algorithm, IDEA), a digital signature Algorithm (Digital Signature Algorithm, DSA), or a Digest Algorithm (MD 5), etc., to obtain encrypted content information.

In one embodiment, after obtaining the encrypted content information, the identification may be generated based on the encrypted content information.

For example, when the identification mark is a two-dimensional code, the encrypted content information may be subjected to encoding processing to obtain encoded information. The encrypted content information can be converted into binary numerical values by encoding the encrypted content information, and then the two-dimensional codes are generated based on the binary data, so that the efficiency and the accuracy are improved. For example, when the encrypted content information is "0123456", the encrypted content information may be converted into "0001 0000001000 0000001100 0101011001 1000011" by the encoding process. For another example, when the encrypted content information is "AC-42", the encrypted content information may be converted into "0010 000000101 00111001110 11100111001 000010" by the encoding process.

Then, normalization processing can be performed on the encoded information to obtain normalized information. For example, an end or padding symbol may be added to the encoded information, bit reordered, or error correction codes may be added, etc.

Next, a two-dimensional code may be generated based on the standardized information. For example, the data codes and error correction codes in the standardized information may be alternately stacked, wherein 0 may be identified by white squares and 1 may be identified by black squares. An initial two-dimensional code may be generated by stacking. Next, a positioning Pattern and a reference line (Timing Pattern) may be added to the initial two-dimensional code, thereby obtaining a target two-dimensional code.

In an embodiment, after the identification identifier of the virtual content to be uploaded is generated, the virtual content to be uploaded and the identification identifier may be bound to obtain the virtual content after being bound.

Because the identification identifier is often an image, the memory required for storing the identification identifier in the AR cloud platform is relatively large. Therefore, after the identification mark of the virtual content to be uploaded is generated, link information can be generated for the identification mark, the link information and the virtual content are bound, and the virtual content and the link information after being bound are stored in the AR cloud platform, so that storage space is saved.

In an embodiment, after the bound virtual content is obtained, configuration processing may be performed on at least one of the bound virtual content based on the configuration information, so as to obtain at least one configured virtual content.

The configuration information may include authority configuration information, period configuration information and distribution configuration information, so that the configuration processing may be performed on the bound virtual content based on the authority configuration information, the period configuration information and the distribution configuration information to obtain at least one configured virtual content. Specifically, the step of performing configuration processing on at least one bound virtual content based on the configuration information to obtain at least one configured virtual content may include:

acquiring link information of the virtual content after binding, wherein the link information characterizes an identification identifier corresponding to the virtual content after binding;

performing authority association processing on the bound virtual content and the link information based on the authority configuration information to obtain authority-associated virtual content;

performing periodic configuration processing on the virtual content after authority association and the link information based on the periodic configuration information to obtain virtual content after periodic configuration;

and carrying out distribution binding processing on the virtual content after periodic configuration and the link information based on the distribution configuration information to obtain the virtual content after configuration.

In an embodiment, the step of performing the rights association processing on the bound virtual content and the link information based on the rights configuration information to obtain the rights associated virtual content may include:

analyzing the authority configuration information to obtain at least one authority access condition;

and constructing a right mapping relation between the link information and the virtual content to be uploaded based on the right access condition to obtain the virtual content after the right association.

The access limiting condition may include a condition that the virtual content development terminal is configured to limit display of the virtual content. By limiting the access conditions, it is possible to limit what augmented reality clients will display what virtual content and what objects will display what virtual content.

For example, after the authority configuration information is analyzed, 5 authority access conditions are obtained, where the 5 authority access conditions are that the augmented reality client a corresponds to the virtual content 1 to be uploaded, the user group C in the augmented reality client B corresponds to the virtual content 2 to be uploaded, the user group D in the augmented reality client B corresponds to the virtual content 3 to be uploaded, the user group F in the augmented reality client B corresponds to the virtual content 4 to be uploaded, and the augmented reality client C corresponds to the virtual content 5 to be uploaded.

Therefore, based on the permission access condition, the virtual content display device can construct a permission mapping relation between the link information and the virtual content to be uploaded to obtain the virtual content after permission association.

For example, when the rights access condition is that the augmented reality client a corresponds to the virtual content 1 to be uploaded, the virtual content display apparatus may add the rights mapping relationship between the augmented reality client a and the link information of the virtual content 1 in the preset mapping table.

For another example, when the access condition of the rights is that the user group C in the augmented reality client B corresponds to the virtual content 2 to be uploaded, the virtual content display device may add the link information of the augmented reality client B and the virtual content 2 and the rights mapping relationship between the user group C and the link information of the virtual content 2 in the preset rights mapping table.

In an embodiment, the step of performing the periodic configuration processing on the virtual content after the rights association and the link information based on the periodic configuration information to obtain the virtual content after the periodic configuration may include:

analyzing the period configuration information to obtain a display period;

based on the display period, adding a release time point for the virtual content after the permission association;

And establishing a release mapping relation between the link information and the virtual content after the permission association based on the release time point to obtain the virtual content after the period configuration.

Wherein the display period includes information that plays a specified role in the display time of the virtual content. For example, the display period may be "virtual content 1:1 month, virtual content 2:2 months ", explaining that virtual content 1 is displayed at 1 month and virtual content 2 is displayed at 2 months. For another example, the display content may be "virtual content 1:2 months 14 days, virtual content 2:10 month 1 day ", it is explained that virtual content 1 will be displayed on day 2 month 14, and virtual content 2 will be displayed on day 10 month 1.

In one embodiment, after the display period is obtained, a post-rights-association virtual content distribution time point may be added based on the display period.

For example, when the display period is "virtual content 1:1 month ", a distribution time point of 1.1 to 1.31 may be added to the virtual content 1, which indicates that the virtual content 1 is displayed in a period of 1 month 1 day to 1 month 31 days. For another example, when the display period is "virtual content 1: at 2 months 14 days ", a distribution time point of 2.14 may be added to the virtual content 1, which indicates that the virtual content 1 is displayed within the period of 2 months 14 days.

In an embodiment, a release mapping relationship between the link information and the virtual content after the permission association can be established based on the release time point, so as to obtain the virtual content after the period configuration.

For example, a release time point may be added to the virtual content after the link information and the rights are associated, so that a release mapping relationship between the link information and the virtual content after the rights are associated is established.

For another example, a distribution mapping relationship between the link information and the virtual content after the permission association may be established in a preset time mapping table. The preset time mapping table is provided with time distribution points, so that the virtual content after the link information and the authority are associated can be added at the corresponding time distribution points.

In an embodiment, the step of "performing distribution binding processing on the virtual content after periodic configuration and the link information based on the distribution configuration information to obtain the configured virtual content" may include:

analyzing the distribution configuration information to obtain at least one distribution object identifier and virtual content corresponding to the distribution object identifier;

binding at least one distribution object identifier and the link information to obtain bound link information;

and constructing a distribution mapping relation between the binding link information and the virtual content after periodic configuration based on the virtual content corresponding to the distribution object identifier to obtain the virtual content after configuration.

The distribution configuration information may include information that the virtual content development end configures for a display scene of the virtual content. For example, advertisement virtual content is distributed for a mark in an APP user group for young child education, special price commodity introduction virtual content is distributed for a VIP group in a shopping APP, and the like. Therefore, the virtual content after periodic configuration and the link information can be distributed and bound based on the distribution configuration information, so that the virtual content after configuration is obtained.

In an embodiment, when the configuration information includes only the rights configuration information, the virtual content display device may perform the rights configuration only for the virtual content. For another example, when the configuration information includes only the authority configuration information or the period configuration information, the virtual content display apparatus may perform only the authority configuration and the period configuration on the virtual content, and so on. It should be noted that, the embodiments of the present application do not limit the configuration of virtual content.

In an embodiment, after the binding virtual content is configured, the virtual content display device may store at least one configured virtual content in the target virtual content repository, and send the identification identifier to the virtual content initiator.

In an embodiment, the AR cloud platform may manage different tenants and may also manage different applications under the same tenant. Therefore, at least one preset development end information storage library and a preset client end information storage library corresponding to each preset development end information storage library are arranged in the AR cloud platform. The preset developing end information storage library can store information of developing ends, and the preset client end information storage library can store information of each developing end in the client end. For example, the AR cloud platform has 2 preset development side information repositories, which are a preset development side information repository a and a preset development side information repository B, respectively. The preset development end information storage library A is used for storing information of the virtual content development end A, and the preset development end information storage library B is used for storing information of the virtual content development end B. The preset development end information storage library A comprises 3 preset client information storage libraries A1, A2 and A3. The preset client information storage bank A1 is used for storing information of the augmented reality client A1 in the virtual content development terminal a, the preset client information storage bank A2 is used for storing information of the augmented reality client A2 in the virtual content development terminal a, and the preset client information storage bank A3 is used for storing information of the augmented reality client A3 in the virtual content development terminal a.

Therefore, when the configured target virtual content is stored in the target virtual content repository, development-side information and client-side information of the configured virtual content can be acquired. Then, a target developer information repository for the configured virtual content is determined based on the developer information. Next, a target virtual content store is determined from the preset client information store of the target development side information store based on the client information. Specifically, the step of storing at least one configured virtual content in a target virtual content repository includes:

acquiring development end information and client end information of the configured virtual content;

determining a target development end information storage library in at least one preset development end information storage library based on development end information, wherein the target development end information storage library comprises at least one preset client information storage library;

screening a target virtual content storage library from at least one preset client information library based on the client information;

and storing the configured virtual content to a target virtual content storage library.

The development side information may include information indicating to which virtual content development side the virtual content belongs. The client information may indicate which augmented reality client of the virtual content development side the virtual content belongs to.

In an embodiment, after the development end information and the client end information of the configured virtual content are obtained, the development end information and the preset development end information may be matched, and a target development end information repository is determined in at least one preset development end information repository according to the matching result. Then, the client information and the preset client information can be matched, and a target virtual content storage library is screened out from the preset client information library in the target development end information storage library according to the matching result. Next, the configured virtual content may be stored in a target virtual content store.

In an embodiment, the embodiment of the application allows the virtual content bound by the link information to be updated, so that different virtual contents can be realized by scanning the same identification mark by a user at different times. Specifically, the virtual content display method provided by the embodiment of the application further includes:

receiving a binding relation update instruction which carries virtual content to be updated;

identifying the virtual content to be updated to obtain link information corresponding to the virtual content to be updated;

screening out virtual contents corresponding to the link information from a target virtual content storage library;

And updating the virtual content corresponding to the link information into the virtual content to be updated to obtain the updated virtual content.

In an embodiment, after obtaining the link information corresponding to the updated virtual content, the link information corresponding to the updated virtual content may be matched with the preset link information of the virtual content in the target virtual content library, and the virtual content corresponding to the link information may be screened out according to the matching result. Then, the virtual content corresponding to the link information can be updated to the virtual content to be updated, and updated virtual content is obtained. For example, the virtual content to be updated may be replaced with the original virtual content.

In an embodiment, the embodiment of the application further allows the configuration information of the virtual content to be changed, so that the authority mapping relationship, the release mapping relationship and the distribution mapping relationship between the virtual content and the link information are changed. Specifically, the virtual content display method provided by the embodiment of the application further includes:

receiving a configuration information updating instruction, wherein the configuration information updating instruction carries updated configuration information;

identifying the updated configuration information to obtain identification information of the updated configuration information;

based on the identification information, extracting virtual content to be configured and link information corresponding to the virtual content to be configured;

And carrying out configuration updating processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured based on the updating configuration information to obtain virtual content after configuration updating.

Wherein the update configuration information may include at least one of update authority configuration information, update period configuration information, and update distribution configuration information. For example, the update configuration information may include update authority configuration information, update cycle configuration information, and update distribution configuration information. For another example, the update configuration information may include only the update authority configuration information, only the update period configuration information, or only the update distribution configuration information. As another example, the update configuration information may include update authority configuration information and update period configuration information

Wherein the identification information of the update configuration information may include information indicating for which virtual content the update configuration information is.

In an embodiment, after the identification information is obtained, the virtual content to be configured and the link information corresponding to the virtual content to be configured may be extracted based on the identification information. And carrying out configuration updating processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured based on the updating configuration information to obtain the virtual content after configuration updating.

For example, when the update configuration information may include update authority configuration information, update period configuration information, and update distribution configuration information, the authority mapping relationship, the distribution mapping relationship, and the distribution mapping relationship between the virtual content to be configured and the link information corresponding to the virtual content to be configured may be changed, so as to obtain the virtual content after the configuration update.

For another example, when the update configuration information may include update authority configuration information, an authority mapping relationship between the virtual content to be configured and link information corresponding to the virtual content to be configured may be changed, so as to obtain virtual content after configuration update.

The embodiment of the application provides a virtual content display method, which comprises the following steps: receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; performing authority verification processing on the authority identification information; when the authority verification is passed, acquiring target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client such that the augmented reality client displays the target virtual content. By the virtual content display method provided by the embodiment of the application, different objects can scan the same target identification mark to display different target virtual contents or the same object scans the same target identification mark at different time to display different target virtual contents. By the method provided by the embodiment of the application, one identification mark and a plurality of different virtual contents can be bound, so that the identification mark does not need to be generated for each virtual content, resources are saved, and the efficiency of displaying the virtual contents is improved.

Secondly, the embodiment of the application can also receive a virtual content uploading instruction sent by the virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded; generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction; binding the virtual content to be uploaded and the identification mark to obtain a virtual content after binding; performing configuration processing on at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to a virtual content development terminal. According to the embodiment of the application, the AR cloud platform provides an instruction for configuring the virtual content for the virtual content development terminal, so that the authority mapping relation, the release mapping relation, the distribution configuration relation and the like of the virtual content and the link information can be configured. Through the AR cloud platform, the virtual content development terminal can enable the augmented reality client to rapidly realize the augmented reality function, so that the efficiency of virtual content display is improved.

In addition, by the virtual content display method provided by the embodiment of the application, various augmented reality application scenes can be supported. For example, newspapers, magazines, education, child animation, printed newspapers and magazines are all disposable content and are not refreshed over time. By adopting the scheme, the two-dimension code can be directly issued to charge annual fee to the user, and the operation platform of the system is configured with the function of triggering replacement of new content (pictures, videos and 3D animations according to months), so that the user only needs to sweep the fixed two-dimension code through APP (login verification annual fee member), and the latest content can be watched every month. For another example, the method proposed by the embodiment of the present application may be applied to industrial training with strong operability in machinery, medicine, and the like. AR markers may be placed in the scene, learning, for example, the procedure of repairing a car, the procedure of surgery, through an HMD head mounted display.

According to the method described in the above embodiments, examples are described in further detail below.

The method of the embodiment of the application will be described by taking the example that the virtual content display method is integrated on a server.

In one embodiment, as shown in fig. 13, a virtual content display method specifically includes the following steps:

301. The server receives a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded.

For example, a virtual content development end wants to develop an APP with augmented reality function. At this time, the virtual content development end may configure the virtual content through the AR cloud platform. For example, the virtual content development end may upload virtual content to the AR cloud platform and configure the virtual content through the AR cloud platform.

When the virtual content development end uploads the virtual content to the AR cloud platform, the server receives a virtual content uploading instruction.

In an embodiment, the AR cloud platform provides a visual interface for configuring the virtual content for the virtual content development end, so that after the virtual content development end uploads the virtual content to the AR cloud platform, the virtual content can be configured through the visual interface. Therefore, the server can also receive the virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded.

302. And the server generates an identification identifier corresponding to each virtual content to be uploaded according to the virtual content uploading instruction.

303. And the server binds the virtual content to be uploaded and the identification mark to obtain the virtual content after binding.

304. And the server performs configuration processing on the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content.

305. The server stores at least one configured virtual content in a target virtual content storage library, and sends the identification to the virtual content development terminal.

After the server sends the identification to the virtual content development terminal, the virtual content development terminal can distribute the identification to the object subscribed to the service thereof, so that the object can watch the virtual content provided by the virtual content development terminal on the augmented reality client.

306. And the server receives a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark.

Wherein, the augmented reality client can be an APP developed by the virtual content development end.

Assume that the target identification is identified as a target two-dimensional code.

For example, when the object wants to watch the virtual content, the object can scan the target two-dimensional code through the APP, and at this time, the server receives a virtual content acquisition instruction triggered by the augmented reality client based on the target two-dimensional code.

The SDK provided by the embodiment of the application is integrated in the augmented reality client, when an object can scan a target two-dimensional code through the APP, the SDK can recognize the target two-dimensional code frame by frame, and the three-dimensional gesture and perspective projection matrix of the target two-dimensional code are calculated. In addition, the SDK can analyze the two-dimensional code to obtain target link information of the two-dimensional code.

307. And the server analyzes the virtual content acquisition instruction to obtain the authority identification information and the target link information of the target identification.

308. And the server performs authority verification processing on the authority identification information.

309. And when the permission verification is passed, the server acquires the target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content.

310. The server sends the target virtual content to the augmented reality client such that the augmented reality client displays the target virtual content.

The embodiment of the application provides a virtual content display method, which comprises the following steps: the server receives a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark; the server analyzes the virtual content acquisition instruction to obtain authority identification information and target link information of target identification; the server performs authority verification processing on the authority identification information; when the authority verification is passed, the server acquires target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content; the server sends the target virtual content to the augmented reality client such that the augmented reality client displays the target virtual content. By the virtual content display method provided by the embodiment of the application, different objects can scan the same target identification mark to display different target virtual contents or the same object scans the same target identification mark at different time to display different target virtual contents. By the method provided by the embodiment of the application, one identification mark and a plurality of different virtual contents can be bound, so that the identification mark does not need to be generated for each virtual content, resources are saved, and the efficiency of displaying the virtual contents is improved.

Secondly, the embodiment of the application can also realize that the server receives a virtual content uploading instruction sent by the virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded; the server generates an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction; binding the virtual content to be uploaded and the identification mark to obtain a virtual content after binding; the server performs configuration processing on at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; the server stores at least one configured virtual content in a target virtual content storage library, and sends the identification to the virtual content development terminal. According to the embodiment of the application, the AR cloud platform provides an instruction for configuring the virtual content for the virtual content development terminal, so that the authority mapping relation, the release mapping relation, the distribution configuration relation and the like of the virtual content and the link information can be configured. Through the AR cloud platform, the virtual content development terminal can enable the augmented reality client to rapidly realize the augmented reality function, so that the efficiency of virtual content display is improved.

In order to better implement the virtual content display method provided in the embodiments of the present application, in an embodiment, a virtual content display apparatus is also provided, and the virtual content display apparatus may be integrated in a computer device. Wherein the meaning of nouns is the same as in the virtual content display method described above, specific implementation details can be referred to the description in the method embodiment.

In an embodiment, there is provided a virtual content display apparatus, which may be integrated in a computer device in particular, as shown in fig. 14, the virtual content display apparatus including: a first receiving unit 401, a first parsing unit 402, a right verifying unit 403, a first obtaining unit 404, and a first transmitting unit 406, specifically as follows:

a first receiving unit 401, configured to receive a virtual content acquisition instruction triggered by an augmented reality client based on a target identification identifier;

a first parsing unit 402, configured to parse the virtual content acquisition instruction to obtain rights identification information and target link information of the target identification;

a right verification unit 403, configured to perform right verification processing on the right identification information;

a first obtaining unit 404, configured to obtain, when the authority verification passes, a target virtual content corresponding to the target link information according to an authority mapping relationship between preset link information and preset virtual content;

A first sending unit 405, configured to send the target virtual content to the augmented reality client, so that the augmented reality client displays the virtual content.

In an embodiment, the first obtaining unit 404 includes:

In an embodiment, as shown in fig. 15, the virtual content display apparatus further includes:

a second receiving unit 501, configured to receive a virtual content upload instruction sent by a virtual content development end, where the virtual content upload instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded;

a generating unit 502, configured to generate, according to the virtual content upload instruction, an identification identifier corresponding to each virtual content to be uploaded;

a binding unit 503, configured to bind the virtual content to be uploaded and the identification identifier, so as to obtain a bound virtual content;

a configuration unit 504, configured to perform configuration processing on the at least one bound virtual content based on the configuration information, to obtain at least one configured virtual content;

And the storage unit 505 is configured to store the at least one configured virtual content in a target virtual content repository, and send the identification to the virtual content development end.

In an embodiment, the configuration unit 504 includes:

In an embodiment, the rights association subunit comprises:

In an embodiment, the period configuration subunit includes:

In an embodiment, the distribution binding subunit comprises:

In an embodiment, the generating unit 502 includes:

In an embodiment, the identification subunit comprises:

In an embodiment, the virtual content display apparatus further includes:

The embodiment of the application also provides a computer device, which may include a terminal or a server, for example, the terminal may be a mobile phone, a tablet computer, or the like; for another example, the computer device may be a server, etc. As shown in fig. 16, a schematic structural diagram of a terminal according to an embodiment of the present application is shown, specifically:

the computer device may include one or more processors 701 of a processing core, memory 702 of one or more computer readable storage media, power supply 703, and input unit 704, among other components. Those skilled in the art will appreciate that the computer device structure shown in FIG. 16 is not limiting of the computer device and may include more or fewer components than shown, or may be combined with certain components, or a different arrangement of components. Wherein:

the processor 701 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 702, and calling data stored in the memory 702, thereby performing overall detection of the computer device. Optionally, processor 701 may include one or more processing cores; preferably, the processor 701 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user pages, applications, etc., and the modem processor primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 701.

The memory 702 may be used to store software programs and modules, and the processor 701 executes various functional applications and data processing by executing the software programs and modules stored in the memory 702. The memory 702 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the computer device, etc. In addition, the memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 702 may also include a memory controller to provide access to the memory 702 by the processor 701.

The computer device further comprises a power supply 703 for powering the various components, preferably the power supply 703 is logically connected to the processor 701 by a power management system, whereby the functions of managing charging, discharging, and power consumption are performed by the power management system. The power supply 703 may also include one or more of any component, such as a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc.

The computer device may further comprise an input unit 704, which input unit 704 may be used for receiving input numerical or character information and generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.

Although not shown, the computer device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 701 in the computer device loads executable files corresponding to the processes of one or more application programs into the memory 702 according to the following instructions, and the processor 701 executes the application programs stored in the memory 702, so as to implement various functions, as follows:

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations of the above embodiments.

It will be appreciated by those of ordinary skill in the art that all or part of the steps of the various methods of the above embodiments may be performed by a computer program, or by computer program control related hardware, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present embodiments also provide a storage medium in which a computer program is stored, the computer program being capable of being loaded by a processor to perform the steps of any of the virtual content display methods provided by the embodiments of the present application. For example, the computer program may perform the steps of:

The steps in any virtual content display method provided in the embodiments of the present application may be executed by the computer program stored in the storage medium, so that the beneficial effects that any virtual content display method provided in the embodiments of the present application may be achieved, which are described in detail in the previous embodiments and are not repeated herein.

The foregoing has described in detail a virtual content display method provided by the embodiments of the present application, and specific examples have been applied herein to illustrate the principles and embodiments of the present application, where the foregoing examples are provided to assist in understanding the methods of the present application and their core ideas; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims

1. A virtual content display method, comprising:

receiving a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded, and the configuration information comprises authority configuration information, period configuration information and distribution configuration information;

generating an identification identifier corresponding to each virtual content to be uploaded according to the virtual content uploading instruction;

acquiring the link information of the bound virtual content, wherein the link information characterizes the identification corresponding to the bound virtual content;

performing periodic configuration processing on the virtual content after the authority association and the link information based on the periodic configuration information to obtain virtual content after periodic configuration;

based on the distribution configuration information, distributing and binding the virtual content after the periodic configuration and the link information to obtain the virtual content after the configuration;

Storing the at least one configured virtual content into a target virtual content storage library, and sending the identification to the virtual content development terminal;

and sending the target virtual content to the augmented reality client so that the augmented reality client displays the target virtual content.

2. The method of claim 1, wherein when the authority verification passes, obtaining the target virtual content corresponding to the target link information according to the mapping relationship between the preset link information and the preset virtual content, comprises:

matching the target link information with the preset link information to obtain a matching result;

3. The method of claim 1, wherein performing rights association processing on the virtual content to be uploaded and the link information based on the rights configuration information to obtain rights-associated virtual content comprises:

4. The method of claim 1, wherein the performing the periodic configuration processing on the rights-associated virtual content and the link information based on the periodic configuration information to obtain the periodic-configured virtual content includes:

analyzing the period configuration information to obtain a display period;

5. The method of claim 1, wherein the performing, based on the distribution configuration information, a distribution binding process on the periodically configured virtual content and the link information to obtain the configured virtual content includes:

binding the at least one distribution object identifier and the link information to obtain bound link information;

and constructing a distribution mapping relation between the binding link information and the periodically configured virtual content based on the virtual content corresponding to the distribution object identifier to obtain the configured virtual content.

6. The method of claim 1, wherein the generating, according to the virtual content upload instruction, an identification identifier corresponding to each virtual content to be uploaded includes:

performing identification detection processing on the virtual content to be uploaded;

Encrypting the content information to obtain encrypted content information;

and generating the identification mark based on the encrypted content information.

7. The method of claim 6, wherein identifying the virtual content to be uploaded when the virtual content to be uploaded does not carry an identification mark, obtaining content information of the virtual content to be uploaded, comprises:

based on the format information of the virtual content to be uploaded, performing format conversion processing on the virtual content to be uploaded to obtain virtual content after format conversion;

and carrying out content identification on the virtual content after format conversion to obtain the content information.

8. The method of claim 1, wherein the storing the at least one configured virtual content into a target virtual content store comprises:

determining a target development end information storage library in at least one preset development end information storage library based on the development end information, wherein the target development end information storage library comprises at least one preset client information storage library;

Screening the target virtual content storage library from the at least one preset client information library based on the client information;

and storing the configured virtual content to the target virtual content storage library.

9. The method of claim 1, wherein the method further comprises:

receiving a binding relation update instruction, wherein the binding relation update instruction carries virtual content to be updated;

identifying the virtual content to be updated to obtain link information corresponding to the updated virtual content;

screening out virtual contents corresponding to the link information from the target virtual content storage library;

and updating the virtual content corresponding to the link information into the virtual content to be updated to obtain updated virtual content.

10. The method of claim 1, wherein the method further comprises:

extracting virtual content to be configured and link information corresponding to the virtual content to be configured based on the identification information;

11. A virtual content display apparatus, comprising:

the second receiving unit is used for receiving a virtual content uploading instruction sent by the virtual content development end, wherein the virtual content uploading instruction carries at least one virtual content to be uploaded and configuration information corresponding to each virtual content to be uploaded, and the configuration information comprises authority configuration information, period configuration information and distribution configuration information;

the storage unit is used for storing the at least one configured virtual content into a target virtual content storage library and sending the identification to the virtual content development end;

the distribution binding subunit is used for carrying out distribution binding processing on the virtual content after the periodic configuration and the link information based on the distribution configuration information to obtain the virtual content after the configuration;

12. An electronic device comprising a memory and a processor; the memory stores an application program, and the processor is configured to execute the application program in the memory to perform the operations in the virtual content display method according to any one of claims 1 to 10.

13. A computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps in the virtual content display method of any one of claims 1 to 10.