WO2022110754A1

WO2022110754A1 - Resource loading method and apparatus, electronic device, storage medium, and program

Info

Publication number: WO2022110754A1
Application number: PCT/CN2021/098335
Authority: WO
Inventors: 张建博
Original assignee: 深圳市商汤科技有限公司
Priority date: 2020-11-27
Filing date: 2021-06-04
Publication date: 2022-06-02
Also published as: CN112437090A; CN112437090B

Abstract

The present disclosure relates to a resource loading method and apparatus, an electronic device, a storage medium, and a program. The method comprises: sending positioning information to a second electronic device, the positioning information being used for enabling the second electronic device to determine position information of a first electronic device according to the positioning information, and determining, according to the position information of the first electronic device, an augmented reality (AR) resource to be loaded; and receiving said AR resource sent from the second electronic device, and correspondingly displaying said AR resource. According to the embodiments of the present invention, a lightweight AR installation package can be achieved, thereby improving the download and installation efficiency of an AR application.

Description

Resource loading method and apparatus, electronic device, storage medium and program

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure is based on a Chinese patent application with application number 202011357349.2 and an application date of November 27, 2020, and claims the priority of the Chinese patent application, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technologies, and in particular, to a resource loading method and apparatus, an electronic device, a storage medium, and a program.

Background technique

AR (Augmented Reality, Augmented Reality) technology is a technology that ingeniously integrates virtual information with the real world. It widely uses multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction and sensing. The computer-generated text, images, three-dimensional models, music, videos and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world. AR technology is widely used in various fields, such as: AR navigation, AR games, etc.

SUMMARY OF THE INVENTION

The present disclosure proposes a resource loading technical solution for loading AR resources.

According to an aspect of the embodiments of the present disclosure, a resource loading method is provided, applied to a first electronic device, including:

Sending positioning information to the second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and determine the position information according to the position information of the first electronic device Augmented reality AR resources to be loaded;

Receive the AR resource to be loaded sent by the second electronic device, and display the AR resource to be loaded accordingly.

In a possible implementation manner, the receiving the AR resource to be loaded sent by the second electronic device, and correspondingly displaying the AR resource to be loaded, includes: receiving the AR resource sent by the second electronic device. The identification information of the AR resource to be loaded; the identification information of the target AR resource is determined from the identification information of the AR resource to be loaded; the identification information of the target AR resource is carried in the AR resource acquisition request, and sent to the AR resource acquisition request. The second electronic device sends an AR resource acquisition request, where the AR resource acquisition request is used to enable the second electronic device to acquire the target AR resource corresponding to the identification information of the target AR resource in response to the AR resource acquisition request; receive and The target AR resource sent by the second electronic device is displayed.

In a possible implementation manner, the receiving the AR resource to be loaded sent by the second electronic device, and correspondingly displaying the AR resource to be loaded, includes: receiving the AR resource sent by the second electronic device. The AR resource to be loaded; the target AR resource is determined from the AR resource to be loaded; the target AR resource is displayed.

In a possible implementation manner, in response to any one of the following situations, the sending the positioning information to the second electronic device includes: within a time period, the distance moved by the first electronic device is greater than a distance threshold; During the time period, the real-time location information of the first electronic device is located outside the positioning area; when the previous time period ends, a new time period starts; wherein, the positioning area is based on the location of the first electronic device in the The location information corresponding to the initial time of the time period is the center area.

In a possible implementation manner, the identification information of the AR resource to be loaded includes an AR resource identification and AR resource version information, and the identification information of the target AR resource is determined from the identification information of the AR resource to be loaded, Including: for the identification information of any AR resource to be loaded, in the case that the AR resource corresponding to the AR resource identifier is not cached locally, or the locally cached AR resource version information of the AR resource corresponding to the AR resource identifier, In the case of inconsistency with the AR resource version information, it is determined that the identification information of the AR resource to be loaded is the identification information of the target AR resource.

In a possible implementation manner, the positioning information includes an environment image where the first electronic device is located, and the environment image is used to enable the second electronic device to determine the first electronic device according to the environment image Location information of the device.

According to an aspect of the embodiments of the present disclosure, a resource loading method is provided, applied to a second electronic device, including:

receiving the positioning information sent by the first electronic device;

Determine location information of the first electronic device according to the location information;

Determine the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device;

Sending the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.

In a possible implementation manner, the sending the AR resource to be loaded to the first electronic device includes: sending identification information of the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is sent to the first electronic device. The identification information of the AR resource to be loaded is used to enable the first electronic device to determine the identification information of the target AR resource from the identification information of the AR resource to be loaded;

receiving an AR resource acquisition request sent by the first electronic device, where the AR resource acquisition request carries the identification information of the target AR resource;

In response to the AR resource acquisition request, acquire the target AR resource corresponding to the identification information of the target AR resource, and send the target AR resource to the first electronic device, wherein the target AR resource is displayed on the in the first electronic device.

In a possible implementation manner, the determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device includes: determining the range to be loaded according to the location information of the first electronic device; For any AR resource, if the location information corresponding to the AR resource is located within the to-be-loaded range, the AR resource is determined to be the to-be-loaded AR resource.

In a possible implementation manner, the determining the range to be loaded according to the location information of the first electronic device includes: determining range construction data; and according to the location information of the first electronic device and the range construction data, Determine the to-be-loaded range.

In a possible implementation manner, the positioning information further includes the network signal quality of the first electronic device and/or the moving speed of the first electronic device, and the determining the range construction data includes: according to the network signal quality, and determine the range construction data corresponding to the network signal quality; and/or, according to the movement speed, determine the range construction data corresponding to the movement speed.

In a possible implementation manner, the determining the to-be-loaded range according to the location information of the first electronic device and the range construction data includes: according to the location information of the first electronic device and the range construction data range construction data, determine the initial range to be loaded; determine the number of AR resources whose location information is within the initial range to be loaded; adjust the range construction data according to the number of AR resources to obtain the adjusted range construction data; The adjusted range construction data and the location information of the first electronic device determine the to-be-loaded range.

In a possible implementation manner, the determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device includes: determining the location information of each AR resource and the location information of the first electronic device. The distance between the location information; after sorting the AR resources according to the distance from small to large, the first preset number of AR resources are determined as the AR resources to be loaded.

In a possible implementation manner, the positioning information includes an image of an environment where the first electronic device is located, and the determining the position information of the first electronic device according to the positioning information includes: according to the first electronic device The image of the environment where the device is located visually locates the first electronic device to obtain location information of the first electronic device.

According to an aspect of the embodiments of the present disclosure, there is provided a resource loading apparatus, which is applied to a first electronic device, and the apparatus includes:

A sending module, configured to send positioning information to a second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and to determine the position information of the first electronic device according to the positioning information The location information of the device determines the augmented reality AR resources to be loaded;

A receiving module, configured to receive the AR resource to be loaded sent by the second electronic device, and to display the AR resource to be loaded accordingly.

In a possible implementation manner, the receiving module is further configured to: receive the identification information of the AR resource to be loaded sent by the second electronic device; determine from the identification information of the AR resource to be loaded Identification information of the target AR resource;

Carrying the identification information of the target AR resource in the AR resource acquisition request, and sending an AR resource acquisition request to the second electronic device, where the AR resource acquisition request is used to make the second electronic device respond to the AR The resource acquisition request acquires the target AR resource corresponding to the identification information of the target AR resource; and receives and displays the target AR resource sent by the second electronic device.

In a possible implementation manner, the receiving module is further configured to: receive the AR resource to be loaded sent by the second electronic device; determine the target AR resource from the AR resource to be loaded; display the AR resource to be loaded; Target AR resource.

In a possible implementation manner, the sending module is further configured to send positioning information to the second electronic device in response to any one of the following conditions: within a time period, the distance moved by the first electronic device is greater than the distance threshold; within the time period, the real-time location information of the first electronic device is located outside the positioning area; when the previous time period ends, a new time period starts; wherein, the positioning area is based on the first electronic device The location information corresponding to the device at the initial moment of the time period is the center of the area.

In a possible implementation manner, the identification information of the AR resource to be loaded includes the AR resource identification and the AR resource version information, and the receiving module is further configured to: for any identification information of the AR resource to be loaded, the identification information of the AR resource to be loaded is not stored locally. If the AR resource corresponding to the AR resource identifier is cached, or if the locally cached AR resource version information of the AR resource corresponding to the AR resource identifier is inconsistent with the AR resource version information, determine the pending AR resource. The identification information of the loaded AR resource is the identification information of the target AR resource.

According to an aspect of the embodiments of the present disclosure, there is provided a resource loading apparatus, which is applied to a second electronic device, and the apparatus includes:

a receiving module, configured to receive the positioning information sent by the first electronic device;

a first determining module, configured to determine the location information of the first electronic device according to the location information;

a second determining module, configured to determine the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device;

A sending module, configured to send the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.

In a possible implementation manner, the sending module is further configured to:

Sending the identification information of the AR resource to be loaded to the first electronic device, where the identification information of the AR resource to be loaded is used to enable the first electronic device to determine from the identification information of the AR resource to be loaded identification information of the target AR resource; receiving an AR resource acquisition request sent by the first electronic device, the AR resource acquisition request carrying the identification information of the target AR resource; in response to the AR resource acquisition request, acquiring the AR resource acquisition request The target AR resource corresponding to the identification information of the target AR resource, and the target AR resource is sent to the first electronic device, wherein the target AR resource is displayed in the first electronic device.

In a possible implementation manner, the second determining module is further configured to: determine the to-be-loaded range according to the location information of the first electronic device; for any AR resource, the location information corresponding to the AR resource In the case of being within the to-be-loaded range, the AR resource is determined to be the to-be-loaded AR resource.

In a possible implementation manner, the second determining module is further configured to: determine range construction data; and determine the to-be-loaded range according to the location information of the first electronic device and the range construction data.

In a possible implementation manner, the positioning information further includes the network signal quality of the first electronic device and/or the moving speed of the first electronic device, and the second determining module is further configured to: According to the network signal quality, range construction data corresponding to the network signal quality is determined; and/or, based on the movement speed, range construction data corresponding to the movement speed is determined.

In a possible implementation manner, the second determining module is further configured to: determine an initial range to be loaded according to the location information of the first electronic device and the range construction data; determine that the location information is located in the initial range the number of AR resources in the range to be loaded; adjust the range construction data according to the number of AR resources to obtain the adjusted range construction data; according to the adjusted range construction data and the position of the first electronic device information to determine the to-be-loaded range.

In a possible implementation manner, the second determining module is further configured to: determine the distance between the location information of each AR resource and the location information of the first electronic device; After sorting to the largest, the first preset number of AR resources are determined as the AR resources to be loaded.

In a possible implementation manner, the positioning information includes an image of the environment where the first electronic device is located, and the first determining module is further configured to: determine the first electronic device according to the image of the environment where the first electronic device is located. An electronic device performs visual positioning to obtain location information of the first electronic device.

According to an aspect of the embodiments of the present disclosure, there is provided an electronic device, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to Perform the above method.

According to an aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.

An embodiment of the present disclosure provides a computer program, including computer-readable code, when the computer-readable code is executed in an electronic device, the processor in the electronic device executes the above method.

In this embodiment of the present disclosure, the first electronic device may send positioning information to the second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and determine the augmented reality AR resource to be loaded according to the location information of the first electronic device, and then the first electronic device can receive the AR resource to be loaded sent by the second electronic device, and perform the AR resource to be loaded. Display accordingly. According to the resource loading method and device, electronic device, storage medium and program provided by the embodiments of the present disclosure, the corresponding AR resource to be loaded can be determined and loaded according to the location information of the first electronic device, which alleviates the need to package and download an AR application when downloading an AR application. The problem that the installation package of the AR application is too large caused by all the AR resources makes the installation package of the AR application lightweight, and improves the download and installation efficiency of the AR application without affecting the user's use.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. Other features and aspects of embodiments of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings herein are incorporated into and constitute a part of the specification, and these drawings illustrate embodiments consistent with the embodiments of the present disclosure, and together with the description, serve to explain the technical solutions of the embodiments of the present disclosure.

FIG. 1 shows a schematic diagram of a resource loading method according to an embodiment of the present disclosure;

FIG. 2 shows a flowchart of a resource loading method according to an embodiment of the present disclosure;

3 shows a flowchart of a resource loading method according to an embodiment of the present disclosure;

FIG. 4 shows a schematic diagram of a resource loading method according to an embodiment of the present disclosure;

FIG. 5 shows a schematic diagram of a resource loading method according to an embodiment of the present disclosure;

FIG. 6 shows a block diagram of a resource loading apparatus according to an embodiment of the present disclosure;

FIG. 7 shows a block diagram of a resource loading apparatus according to an embodiment of the present disclosure;

FIG. 8 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure;

FIG. 9 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures denote elements that have the same or similar functions. While various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently B these three cases. In addition, the term "at least one" herein refers to any combination of any one of the plurality or at least two of the plurality, for example, including at least one of A, B, and C, and may mean including from A, B, and C. Any one or more elements selected from the set of B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are set forth in the following detailed description. It will be understood by those skilled in the art that the present disclosure may be practiced without certain specific details. In some instances, methods, means, components and circuits well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present disclosure.

Users need to download the AR application to the terminal device before applying the AR application. If the AR resources involved in the AR application are packaged and downloaded at the same time when downloading the AR application, the installation package of the AR application will be too large. , If all AR resources are loaded from the cloud server after downloading and installing the AR application, the network transmission will take too long.

In order to solve the above technical problems, the embodiments of the present disclosure provide a resource loading method, which can determine the position information of a terminal device through VPS (Visual Positioning Service, visual positioning system) visual positioning, and then perform AR resource loading according to the position information of the terminal device. load. In some embodiments, referring to FIG. 1 , the AR application installation package does not include AR resources or includes some AR resources. After the terminal device downloads and installs the AR application program, the AR program can be used step by step according to the location information of the terminal device. Load AR resources. For example, the terminal device loads (AR resource 1, AR resource 2, and AR resource 3) at position 1, and loads (AR resource 4, AR resource 5, and AR resource 6) at position 2. In this way, the installation package of the AR application can be made lightweight, thereby improving the download and installation efficiency of the AR application.

2 shows a flowchart of a resource loading method according to an embodiment of the present disclosure. The resource loading method may be executed by a terminal device (hereinafter referred to as a first electronic device), and the terminal device may be a user equipment (User Equipment, UE), Mobile device, user terminal, terminal, cellular phone, cordless phone, Personal Digital Assistant (PDA), handheld device, computing device, vehicle-mounted device, wearable device, etc., the method can be stored in the memory by calling the processor implemented by means of computer readable instructions.

As shown in Figure 2, the resource loading method may include:

In step S21, the positioning information is sent to the second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and according to the positioning information of the first electronic device The location information determines the augmented reality AR resource to be loaded;

In step S22, the AR resource to be loaded sent by the second electronic device is received, and the AR resource to be loaded is displayed accordingly.

In the embodiment of the present disclosure, the above-mentioned second electronic device may include, for example, a cloud server or the like. The first electronic device may send positioning information to the second electronic device, where the positioning information may include the position information of the first electronic device (the first electronic device performs a positioning operation to obtain the position information), and the second electronic device may obtain the position information from the positioning information Location information of the first electronic device.

In a possible implementation manner, the positioning information may include an environment image where the first electronic device is located, and the environment image is used to enable the second electronic device to determine the location of the first electronic device according to the environment image. location information.

For example, the space can be reconstructed in advance by using a spatial reconstruction technology, for example, by using an SFM (Structure from Motion, motion recovery structure) spatial reconstruction technology, the spatial reconstruction is performed to obtain a three-dimensional model of the space. The first electronic device may collect an image of the environment where it is located, and send positioning information including the environment image to the second electronic device. After the second electronic device receives the positioning information, it can visually locate the first electronic device according to the environment image and the three-dimensional model to obtain the position information of the first electronic device.

After the second electronic device obtains the location information of the first electronic device, it can determine the AR resources to be loaded from all AR resources according to the location information of the first electronic device (in the case that the installation package of the AR application includes some AR resources) , the AR resource to be loaded may be determined from the remaining AR resources that are not packaged into the installation package), and the AR resource to be loaded may be sent to the first electronic device.

In some embodiments, after obtaining the location information of the first electronic device, the second electronic device may determine that the AR resource whose location information and the location information of the first electronic device satisfy the loading condition is the AR resource to be loaded. For example, when the distance between the location information of the AR resource and the location information of the first electronic device is within the distance threshold, it may be determined that the AR resource satisfies the loading condition, and the AR resource is determined as the AR resource to be loaded. Alternatively, a range to be loaded can be determined according to the position information of the first electronic device (for example, an area is determined with the position information of the first electronic device as the center, and the area is the range to be loaded), and the position information of the AR resource is located in the to-be-loaded range. When it is within the range, it can be determined that the AR resource is the AR resource to be loaded.

After receiving the AR resource to be loaded, the first electronic device may display the AR resource to be loaded accordingly. For example: display the AR resources to be loaded that have not been loaded locally on the first electronic device, or display the corresponding loading prompt information for the AR resources to be loaded that have been loaded locally but have been updated. It asks the user whether to update the AR resource to be loaded, and can display correspondingly in response to the user's confirmation operation for the loading prompt information. For example: in response to the confirmation operation for loading, load and display the AR resource to be loaded, and delete the local cached version, or in response to the confirmation operation for not loading, do not load the AR resource to be loaded, and display the local AR resource to be loaded. cached version.

In this way, the first electronic device can send positioning information to the second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and The location information of an electronic device determines the AR resource to be loaded, and then the first electronic device can receive the AR resource to be loaded sent by the second electronic device, and display the AR resource to be loaded accordingly. According to the resource loading method provided by the embodiment of the present disclosure, the corresponding AR resource to be loaded can be determined and loaded according to the location information of the first electronic device, which alleviates the AR application caused by packaging and downloading all AR resources when downloading the AR application. The problem that the installation package is too large makes the installation package of the AR application lightweight, which improves the download and installation efficiency of the AR application without affecting the user's use.

In a possible implementation manner, the receiving the AR resource to be loaded sent by the second electronic device, and correspondingly displaying the AR resource to be loaded, may include:

Receive the identification information of the AR resource to be loaded sent by the second electronic device.

Determine the identification information of the target AR resource from the identification information of the AR resource to be loaded;

Carrying the identification information of the target AR resource in an AR resource acquisition request, and sending an AR resource acquisition request to the second electronic device, where the AR resource acquisition request is used to make the second electronic device respond to the The AR resource acquisition request acquires the target AR resource corresponding to the identification information of the target AR resource;

receiving and displaying the target AR resource sent by the second electronic device.

For example, the second electronic device may determine the AR resources to be loaded from all AR resources according to the location information of the first electronic device, and obtain identification information of the AR resources to be loaded, where the identification information of the AR resources to be loaded may be used to identify the AR resources to be loaded. AR resource to be loaded. For example, the identification information of the AR resource to be loaded may include the ID and name of the AR resource to be loaded, and may also include version information of the AR resource to be loaded, and the like.

The first electronic device may determine the identification information of the target AR resource from the identification information of the AR resource to be loaded according to the identification information of the locally cached AR resource and the identification information of the AR resource to be loaded.

In a possible implementation manner, the identification information of the AR resource to be loaded includes AR resource identification and AR resource version information, and the identification information of the target AR resource is determined from the identification information of the AR resource to be loaded, including :

For the identification information of any AR resource to be loaded, if the AR resource corresponding to the AR resource identifier is not cached locally, or the locally cached AR resource version information of the AR resource corresponding to the AR resource identifier is the same as the AR resource version information of the AR resource. In the case that the AR resource version information is inconsistent, it is determined that the identification information of the AR resource to be loaded is the identification information of the target AR resource.

For example, for the identification information of any AR resource to be loaded, when the AR resource identification included in the identification information of the AR resource to be loaded does not exist in the AR resource identification corresponding to the locally cached AR resource, it is determined that the AR resource is not cached locally. For the AR resource to be loaded, the identification information of the AR resource to be loaded may be determined as the identification information of the target AR resource. Alternatively, the AR resource identifier included in the identifier information of the AR resource to be loaded exists in the AR resource identifier corresponding to the locally cached AR resource, but the AR resource version information corresponding to the AR resource identifier stored locally is the same as the AR resource identifier to be loaded. When the AR resource version information included in the identification information is inconsistent, it can be determined that the version of the AR resource to be loaded has been updated, so the identification information of the AR resource to be loaded can be determined as the identification information of the target AR resource.

After determining the target AR resource, the first electronic device may send an AR resource acquisition request to the second electronic device according to the identification information of the target AR resource. After receiving the AR resource acquisition request, the second electronic device may acquire the corresponding target AR resource according to the identification information of the target AR resource, and send the target AR resource to the first electronic device.

The first electronic device may receive the target AR resource sent by the second electronic device, and display the target AR resource on the display interface of the first electronic device. It should be noted that when the first electronic device has cached different versions of the target AR resource, the cached historical version may be deleted, and the target AR resource sent by the second electronic device may be cached. For example, if the AR resource is AR billboard 1, the locally cached version is version 1.0, and the version sent by the second electronic device is version 2.0, then the locally cached version 1.0 of AR billboard 1 can be deleted, and the cached version sent by the second electronic device is version 2.0. Version 2.0 of AR Billboard 1.

In this way, the AR resource can be loaded step by step according to the location information of the first electronic device, which can make the installation package of the AR application lightweight, and can improve the loading accuracy and efficiency in the process of loading the AR resource.

receiving the AR resource to be loaded sent by the second electronic device;

Determine the target AR resource from the AR resource to be loaded;

Display the target AR resource.

For example, the second electronic device may send the AR resource to be loaded to the first electronic device, and after receiving the AR resource to be loaded, the first electronic device may determine the target AR resource from the AR resource to be loaded, and load the AR resource for display Resource, wherein, for the method of determining the target AR resource, reference may be made to the foregoing embodiments, and details are not described herein again in this embodiment of the present disclosure.

In a possible implementation manner, in response to any of the following situations, the sending the positioning information to the second electronic device may include:

In a time period, when the distance moved by the first electronic device is greater than a distance threshold, sending positioning information to the second electronic device;

In a time period, when the real-time location information of the first electronic device is located outside the location area, sending the location information to the second electronic device;

or,

When the previous time period ends and a new time period starts, the positioning information is sent to the second electronic device; wherein, the positioning area is the area corresponding to the first electronic device at the initial moment of the time period. The location information is the center of the area.

For example, the first electronic device may send positioning information to the second electronic device every time period T, and the time period T may be preset or determined according to the moving speed of the first electronic device, for example: when When the moving speed of the first electronic device is relatively fast, a relatively small time period T can be set accordingly, and when the moving speed of the first electronic device is relatively slow, a relatively large time period T can be set accordingly. Or within the time period, a positioning area can be preset with the position information corresponding to the first electronic device at the initial moment of the time period as the center, and when the real-time position of the first electronic device is outside the positioning area, the second electronic device can be sent to the second electronic device. The positioning information is sent to reduce the interaction process with the second electronic device and improve resource utilization.

FIG. 3 shows a flowchart of a resource loading method according to an embodiment of the present disclosure. The resource loading method can be applied to a cloud server (hereinafter referred to as a second electronic device) for execution. Referring to FIG. 3 , the resource loading method provided by an embodiment of the present disclosure Can include:

In step S31, receiving the positioning information sent by the first electronic device;

In step S32, the location information of the first electronic device is determined according to the location information;

In step S33, determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device;

In step S34, the AR resource to be loaded is sent to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.

For example, the first electronic device may perform a positioning operation, and after obtaining the position information of the first electronic device, send the positioning information to the second electronic device, where the positioning information may include the position information of the first electronic device. After receiving the positioning information, the second electronic device may acquire the position information of the first electronic device from the positioning information.

Or, in a possible implementation manner, the positioning information includes an image of an environment where the first electronic device is located, and the determining the position information of the first electronic device according to the positioning information may include:

Visually locate the first electronic device according to an image of the environment where the first electronic device is located to obtain location information of the first electronic device.

For example, the first electronic device may send positioning information including an image of the environment where the first electronic device is located to the second electronic device (for a specific process, refer to the foregoing embodiment, which is not repeated in this embodiment of the present disclosure). After the second electronic device receives the positioning request, it visually locates the first electronic device according to the environment image and the three-dimensional model obtained by reconstructing the space in advance, and obtains the position information of the first electronic device. The specific process is not limited, and any visual positioning method can be used.

After the second electronic device obtains the location information of the first electronic device, the second electronic device may determine the AR resource to be loaded from the AR resources according to the location information of the first electronic device and the location information of each AR resource. In some embodiments, the second electronic device may determine that the AR resource whose location information and the location information of the first electronic device satisfy the loading condition is the AR resource to be loaded. For example: when the distance between the location information of the AR resource and the location information of the first electronic device is within the distance threshold, it may be determined that the AR resource satisfies the loading condition, and the AR resource may be determined as the AR resource to be loaded, or, according to the first The location information of the electronic device determines a to-be-loaded range (for example, an area is determined with the location information of the first electronic device as the center, and the area is the to-be-loaded range). When the location information of the AR resource is within the to-be-loaded range, it can be determined that The AR resource is the AR resource to be loaded.

After the second electronic device determines the AR resources to be loaded, it can obtain the AR resources to be loaded and send the AR resources to be loaded to the first electronic device, so that the first electronic device can load and display the AR resources to be loaded according to the cache situation of the AR resources . For example, when the first electronic device does not cache the AR resource to be loaded or the cached AR resource version information of the AR resource to be loaded is inconsistent with the AR resource version information of the AR resource to be loaded, the AR resource to be loaded is loaded and displayed.

In this way, the second electronic device can receive the positioning information sent by the first electronic device, and determine the position information of the first electronic device according to the positioning information. The second electronic device may determine the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device, and send the AR resource to be loaded to the first electronic device, so that the first electronic device The device displays the AR resource to be loaded accordingly. According to the resource loading method provided by the embodiments of the present disclosure, the AR resources can be loaded gradually according to the location information of the first electronic device, which alleviates the problem that the installation package of the AR application is too large due to downloading all the AR resources when downloading the AR application. The problem makes the installation package of the AR application lightweight, and improves the download and installation efficiency of the AR application without affecting the user's use.

In a possible implementation manner, the sending the AR resource to be loaded to the first electronic device may include:

Send the identification information of the AR resource to be loaded to the first electronic device, where the identification information of the AR resource to be loaded is used to enable the first electronic device to determine the target AR from the identification information of the AR resource to be loaded Identification information of the resource;

In response to the AR resource acquisition request, acquire the target AR resource corresponding to the identification information of the target AR resource, and send the target AR resource to the first electronic device, wherein the target AR resource is displayed on the first electronic device.

For example, after determining the AR resource to be loaded, the second electronic device may acquire identification information of the AR resource to be loaded, and send the identification information of the AR resource to be loaded to the first electronic device. The first electronic device may determine the identification information of the target AR resource from the identification information of the AR resource to be loaded according to the situation of the locally cached AR resource (for the specific process, refer to the foregoing embodiment, which is not repeated in this embodiment of the present disclosure).

After determining the identification information of the target AR resource, the first electronic device may send an AR resource acquisition request including the identification information of the target AR resource to the second electronic device. After receiving the AR resource acquisition request, the second electronic device can acquire the corresponding target AR resource according to the identification information of the target AR resource, and send the target AR resource to the first electronic device for caching and display. In this way, the AR resource can be loaded step by step according to the location information of the first electronic device, which can make the installation package of the AR application lightweight, and can improve the loading accuracy and efficiency in the process of loading the AR resource.

In a possible implementation manner, the determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device may include:

Determine the to-be-loaded range according to the location information of the first electronic device;

For any AR resource, if the location information corresponding to the AR resource is located within the to-be-loaded range, the AR resource is determined to be the to-be-loaded AR resource.

For example, a range to be loaded may be determined by using the position information of the first electronic device as a reference point. For example: take the position information of the first electronic device as the center point, determine a circular, rectangular or polygonal area, this area is the to-be-loaded area, the size of this area can be preset or dynamically determined, this disclosure implements The example does not specifically limit this.

The second electronic device may determine the AR resource whose location information is within the to-be-loaded range as the to-be-loaded AR resource. For example, referring to FIG. 4 , the position information P0 of the first electronic device can be used as the center point to determine a circular area as the range to be loaded, and then the AR resource 1, AR resource 2 and AR resource located in the to-be-loaded range 3 can be determined as the target AR resource.

In a possible implementation manner, the determining the range to be loaded according to the location information of the first electronic device may include:

Determining the scope to build the data;

The to-be-loaded range is determined according to the location information of the first electronic device and the range construction data.

For example, the above range construction data may be parameters for defining the area of the range to be loaded. For example: when the range to be loaded is a circular area, the above range construction data may be the radius of the circular area; when the range to be loaded is a rectangle, the above range construction data may include the length and width of the rectangular area. . The size of the range construction data can be preset, or can also be determined according to the loading requirements. For example, when the loading speed is required to be fast, the range construction data can be set smaller.

According to the range construction data and the position information of the first electronic device, the range to be loaded can be determined. For example, when the range to be loaded is a circular area, the position P0 of the first electronic device can be used as the center of the circle, and the range construction data is used as the radius to construct a circular area to obtain the range to be loaded. Alternatively, when the range to be loaded is a rectangle, the position P0 of the first electronic device may be taken as the center, and a rectangular area may be constructed with the range construction data as the length and width to obtain the range to be loaded.

It should be noted that the above-mentioned range to be loaded is a circular area or a rectangular area, which is an example of the range to be loaded in the embodiment of the present disclosure. In fact, the range to be loaded may have any shape, and the embodiment of the present disclosure does not define the range to be loaded. The shape presented does not make any restrictions.

In a possible implementation manner, the positioning request may further include the network signal quality of the first electronic device and/or the moving speed of the first electronic device, and the determining the range construction data may include:

determining, according to the network signal quality, range construction data corresponding to the network signal quality; and/or,

Based on the moving speed, range construction data corresponding to the moving speed is determined.

For example, when the first electronic device sends the positioning information, it may detect the network signal quality of the first electronic device and/or determine the moving speed of the first electronic device (which may include data such as speed, acceleration, etc.), and send the first electronic device to the network. The network signal quality of the device and/or the moving speed of the first electronic device are sent to the second electronic device through the positioning information.

In some embodiments, the network signal quality can be divided into multiple levels, for example: divided into high quality, good, poor and other levels (the network signal quality level and level are not limited in the embodiments of the present disclosure) , where, when the network signal quality is high quality, the corresponding range construction data is the first range construction data, when the network signal quality is good, the corresponding range construction data is the second range construction data, and when the network signal quality is poor, the corresponding range construction data The range construction data is the third range construction data, the first range construction data is larger than the second range construction data, and the second range construction data is larger than the third range construction data.

The second electronic device can determine the range construction data corresponding to the network signal quality according to the network signal quality of the first electronic device, so as to be able to set larger range construction data when the network signal quality is good, thereby expanding the to-be-loaded range , so that the first electronic device loads more AR resources, sets a smaller range construction data when the network signal quality is poor, and further narrows the to-be-loaded range to load less AR resources. In this way, the first electronic device can adaptively load the AR resource according to the quality of the network signal, which can bring better user experience.

In some embodiments, the moving speed can also be divided into multiple speed ranges, for example: 0 to 1m/s is divided into a first speed range, 1m/s to 2m/s is divided into a second speed range (excluding 1m/s), the speed greater than 2m/s is divided into the third speed range, wherein the first speed range corresponds to the fourth range construction data, the second speed range corresponds to the fifth range construction data, and the third speed range corresponds to the sixth range. The range construction data, the fourth range construction data is smaller than the fifth range construction data, and the fifth range construction data is smaller than the sixth range construction data.

The second electronic device may determine the range construction data corresponding to the movement speed according to the movement speed of the first electronic device. For example, when the movement speed of the first electronic device is within the first speed range, the range construction data may be determined as the fourth range Build data. In this way, the range construction data can be dynamically determined according to the moving speed of the first electronic device, so as to set a larger range construction data when the moving speed of the first electronic device is fast, thereby expanding the to-be-loaded range, so that the first electronic device moves faster. The electronic device loads more AR resources; when the moving speed of the first electronic device is slow, a smaller range construction data is set, thereby narrowing the to-be-loaded range, so that the first electronic device loads less AR resources. In this way, the loading process of the AR resources can be adapted to the moving process of the first electronic device, and the AR resources at the location of the first electronic device have not been loaded by the first electronic device due to the fast moving speed of the first electronic device. problems, which can lead to a better user experience.

In a possible implementation manner, the determining the range to be loaded according to the location information of the first electronic device and the range construction data may include:

determining an initial to-be-loaded range according to the location information of the first electronic device and the range construction data;

determining the number of AR resources whose location information is within the initial to-be-loaded range;

Adjust the scope construction data according to the quantity of the AR resources to obtain the adjusted scope construction data;

The to-be-loaded range is determined according to the adjusted range construction data and the position information of the first electronic device.

For example, after determining the range construction data, the second electronic device can determine an initial range to be loaded according to the range construction data and the position information of the first electronic device, for example, the position information of the first electronic device can be used as the center of the circle , with the range construction data as the radius, construct a circular initial range to be loaded. Determine the number of AR resources within the initial to-be-loaded range, and when the number of AR resources within the initial to-be-loaded range is large (for example, greater than the first threshold), the data can be constructed by narrowing down the range according to the preset adjustment strategy , or, when the number of AR resources located in the initial to-be-loaded range is small (for example, when it is less than the second threshold), the range construction data can be increased according to the preset adjustment strategy, and the range construction data and data can be constructed according to the adjusted range. The location information of the first electronic device is used to determine the to-be-loaded range (for the specific process, reference may be made to the foregoing embodiment, which is not repeated here in this embodiment of the present disclosure). In this way, the second electronic device can dynamically adjust the range to be loaded, and then adjust the number of AR resources loaded by the first electronic device, which can ensure the loading speed, alleviate the problem of users waiting due to loading AR resources, and improve user experience.

determining the distance between the location information of each AR resource and the location information of the first electronic device;

After sorting the AR resources according to the distance from small to large, the first preset number of AR resources are determined as the AR resources to be loaded.

For example, the distance between the location information of each AR resource and the location information of the first electronic device can be determined respectively, and the AR resources can be sorted according to the distance from small to large, and the first preset number of AR resources in the sequence can be sorted. The resource is determined as the AR resource to be loaded (or, the AR resources can be sorted from large to small according to the distance, and the last preset number of AR resources in the sequence can be determined as the AR resource to be loaded), and the preset number can be the preset number of AR resources. set value. For example, if the preset number is set to 5, the top 5 AR resources in the sequence can be determined as the AR resources to be loaded. In this way, the loading speed of AR resources can be guaranteed and the user experience can be improved.

In order to make those skilled in the art better understand the embodiments of the present disclosure, the following describes the embodiments of the present disclosure through specific examples.

Referring to FIG. 5 , the first electronic device may collect an image of the current environment, and send positioning information to the second electronic device according to the environment image. After receiving the positioning information, the second electronic device can perform visual positioning according to an image of the environment where the first electronic device is located, so as to obtain the position information of the first electronic device. The second electronic device may determine the range construction data, and use the position information of the first electronic device as a center point to construct the range to be loaded. Obtain the identification information (AR resource name, AR resource version information) of the AR resources of all AR resources located in the range to be loaded, and send the obtained identification information of the AR resource as the identification information of the AR resource to be loaded to the first electronic device equipment.

After receiving the identification information of the AR resource to be loaded, the first electronic device compares it with the locally cached AR resource, and the AR resource identified by the identification information of the AR resource to be loaded is not cached locally, or the locally cached AR resource identified by the identification information of the AR resource to be loaded is not cached locally. When the version information is inconsistent with the AR resource version information of the AR resource to be loaded, it may be determined that the identification information of the AR resource to be loaded is the identification information of the target AR resource, and a resource acquisition request is sent to the second electronic device according to the identification information of the target AR resource .

The second electronic device acquires the target AR resource according to the resource acquisition request, and sends the target AR resource to the first electronic device. The first electronic device receives the cache and displays the target AR resource, and after the time period T or when the distance moved by the first electronic device exceeds the distance threshold, the above process is repeated.

The resource loading method provided by the embodiment of the present disclosure can load the corresponding target AR resource according to the location information of the first electronic device, which alleviates the excessively large installation package of the AR application caused by packaging and downloading all the AR resources when downloading the AR application. The problem. In some embodiments, after the AR game application or AR navigation application is started, the user does not need to wait for all AR resources to be updated to complete the AR game or AR navigation. The location information of the electronic device loads AR resources, which improves the user experience.

It can be understood that the above method embodiments mentioned in the present disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, the present disclosure will not repeat them. Those skilled in the art can understand that, in the above method of the specific embodiment, the specific execution order of each step should be determined by its function and possible internal logic.

In addition, the present disclosure also provides resource loading apparatuses, electronic devices, computer-readable storage media, and programs, all of which can be used to implement any resource loading method provided by the present disclosure. For corresponding technical solutions and descriptions, refer to the corresponding records in the method section. ,No longer.

FIG. 6 shows a block diagram of a resource loading apparatus according to an embodiment of the present disclosure. The apparatus is applied to a first electronic device. As shown in FIG. 6 , the apparatus includes: a sending module 61, which can be configured to send to a second electronic device Positioning information, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and to determine the augmented reality AR resource to be loaded according to the position information of the first electronic device ; The receiving module 62 may be configured to receive the AR resource to be loaded sent by the second electronic device, and to display the AR resource to be loaded accordingly.

In this way, the first electronic device can send positioning information to the second electronic device, so that the second electronic device determines the position information of the first electronic device according to the positioning information, and determines the position information of the first electronic device according to the position of the first electronic device. The information determines the AR resource to be loaded, and then the first electronic device may receive the AR resource to be loaded sent by the second electronic device, and display the AR resource to be loaded accordingly. According to the resource loading apparatus provided by the embodiment of the present disclosure, the corresponding AR resource to be loaded can be determined and loaded according to the location information of the first electronic device, which alleviates the AR application caused by packaging and downloading all AR resources when downloading the AR application. The problem that the installation package is too large makes the installation package of the AR application lightweight, which improves the download and installation efficiency of the AR application without affecting the user's use.

In a possible implementation manner, the receiving module may be further configured to: receive the identification information of the AR resource to be loaded sent by the second electronic device; from the identification information of the AR resource to be loaded, Determine the identification information of the target AR resource; carry the identification information of the target AR resource in the AR resource acquisition request, and send the AR resource acquisition request to the second electronic device, and the AR resource acquisition request is used to make the AR resource acquisition request The second electronic device acquires the target AR resource corresponding to the identification information of the target AR resource according to the AR resource acquisition request; and receives and displays the target AR resource sent by the second electronic device.

In a possible implementation manner, the receiving module may be further configured to: receive the AR resource to be loaded sent by the second electronic device; determine the target AR resource from the AR resource to be loaded; display the AR resource to be loaded; Describe the target AR resource.

In a possible implementation manner, the sending module may also be configured to send positioning information to the second electronic device in response to any of the following conditions: within a time period, the distance moved by the first electronic device is greater than distance threshold; within the time period, the real-time location information of the first electronic device is located outside the positioning area; when the previous time period ends, a new time period starts; wherein, the positioning area is based on the first time period The position information corresponding to the electronic device at the initial moment of the time period is the center area.

In a possible implementation manner, the identification information of the AR resource to be loaded includes AR resource identification and AR resource version information, and the receiving module may also be used to: for any identification information of the AR resource to be loaded, in the local If the AR resource corresponding to the AR resource identifier is not cached, or if the locally cached AR resource version information of the AR resource corresponding to the AR resource identifier is inconsistent with the AR resource version information, determine the AR resource. The identification information of the AR resource to be loaded is the identification information of the target AR resource.

In a possible implementation manner, the positioning information may include an environment image where the first electronic device is located, and the environment image is used to enable the second electronic device to determine the first electronic device according to the environment image. Location information of electronic devices.

Fig. 7 shows a block diagram of a resource loading apparatus according to an embodiment of the present disclosure. The apparatus is applied to a second electronic device. As shown in Fig. 7 , the apparatus includes: a receiving module 71, which can be configured to receive data sent by the first electronic device The first determining module 72 can be used to determine the location information of the first electronic device according to the positioning information; the second determining module 73 can be used to determine the location information of the first electronic device from the enhanced The AR resource to be loaded is determined from the actual AR resource; the sending module 74 may be configured to send the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.

In this way, the second electronic device can receive the positioning information sent by the first electronic device, and determine the position information of the first electronic device according to the positioning information. The second electronic device may determine the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device, and send the AR resource to be loaded to the first electronic device, so that the first electronic device The device displays the AR resource to be loaded accordingly. According to the resource loading device provided by the embodiment of the present disclosure, AR resources can be loaded gradually according to the location information of the first electronic device, which alleviates the problem of excessively large installation packages of AR applications caused by downloading all AR resources when downloading AR applications. The problem makes the installation package of the AR application lightweight, and improves the download and installation efficiency of the AR application without affecting the user's use.

In a possible implementation manner, the sending module may be further configured to: send the identification information of the AR resource to be loaded to the first electronic device, where the identification information of the AR resource to be loaded is used for Make the first electronic device determine the identification information of the target AR resource from the identification information of the AR resource to be loaded; receive an AR resource acquisition request sent by the first electronic device, where the AR resource acquisition request carries the identification information of the target AR resource; in response to the AR resource acquisition request, acquire the target AR resource corresponding to the identification information of the target AR resource, and send the target AR resource to the first electronic device, wherein the The target AR resource is displayed in the first electronic device.

In a possible implementation manner, the second determining module may be further configured to: determine the to-be-loaded range according to the location information of the first electronic device; for any AR resource, at the location corresponding to the AR resource When the information is within the to-be-loaded range, it is determined that the AR resource is the to-be-loaded AR resource.

In a possible implementation manner, the second determining module may be further configured to: determine range construction data; and determine the to-be-loaded range according to the location information of the first electronic device and the range construction data.

In a possible implementation manner, the positioning information further includes the network signal quality of the first electronic device and/or the moving speed of the first electronic device, and the second determining module may also be used for : determining range construction data corresponding to the network signal quality according to the network signal quality; and/or determining range construction data corresponding to the movement speed according to the movement speed.

In a possible implementation manner, the second determining module may be further configured to: determine the initial range to be loaded according to the location information of the first electronic device and the range construction data; determine that the location information is located in the The number of AR resources in the range to be loaded initially; the range construction data is adjusted according to the number of AR resources to obtain the adjusted range construction data; the range construction data is adjusted according to the adjusted range construction data and the first electronic device. location information, to determine the to-be-loaded range.

In a possible implementation manner, the second determining module may be further configured to: determine the distance between the location information of each AR resource and the location information of the first electronic device; After sorting from small to large, the first preset number of AR resources are determined as AR resources to be loaded.

In a possible implementation manner, the positioning information includes an image of the environment where the first electronic device is located, and the first determining module may be further configured to: determine the The first electronic device performs visual positioning to obtain location information of the first electronic device.

In some embodiments, the functions or modules included in the apparatuses provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments. For specific implementation, reference may be made to the descriptions of the above method embodiments. For brevity, here No longer.

Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.

Embodiments of the present disclosure also provide a computer program product, including computer-readable codes. When the computer-readable codes are run on a device, a processor in the device executes a method for implementing the resource loading method provided by any of the above embodiments. instruction.

Embodiments of the present disclosure further provide another computer program product for storing computer-readable instructions, which, when executed, cause a computer to perform operations of the resource loading method provided by any of the foregoing embodiments.

The electronic device may be provided as a terminal, server or other form of device.

FIG. 8 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.

8, an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .

The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power supply assembly 806 provides power to various components of electronic device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .

Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 804 or transmitted via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 . For example, the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as wireless network (WiFi), second generation mobile communication technology (2G) or third generation mobile communication technology (3G), or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, a non-volatile computer-readable storage medium, such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.

FIG. 9 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, the electronic device 1900 may be provided as a server. 9, electronic device 1900 includes processing component 1922, which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922, such as applications. An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Additionally, the processing component 1922 is configured to execute instructions to perform the above-described methods.

The electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows Server ^™ ), a graphical user interface based operating system (Mac OS X ^™ ) introduced by Apple, a multi-user multi-process computer operating system (Unix ^™ ), Free and Open Source Unix-like Operating System (Linux ^™ ), Open Source Unix-like Operating System (FreeBSD ^™ ) or the like.

In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.

The present disclosure may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of the present disclosure.

A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code, written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the embodiments of the present disclosure.

Aspects of embodiments of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

The computer program product can be specifically implemented by hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

Various embodiments of the embodiments of the present disclosure have been described above, and the above descriptions are in some embodiments, not exhaustive, and not limited to the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the various embodiments, the practical application or improvement over the technology in the marketplace, or to enable others of ordinary skill in the art to understand the various embodiments disclosed herein.

Industrial Applicability

The present disclosure provides a resource loading method and apparatus, an electronic device, a storage medium and a program, wherein positioning information is sent to a second electronic device, where the positioning information is used to enable the second electronic device to determine according to the positioning information the location information of the first electronic device, and determine the augmented reality AR resource to be loaded according to the location information of the first electronic device; receive the AR resource to be loaded sent by the second electronic device, and Load AR resources for corresponding display.

Claims

A resource loading method, wherein, applied to a first electronic device, includes:

Sending positioning information to the second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and determine the position information according to the position information of the first electronic device Augmented reality AR resources to be loaded;

Receive the AR resource to be loaded sent by the second electronic device, and display the AR resource to be loaded accordingly.
The method according to claim 1, wherein the receiving the AR resource to be loaded sent by the second electronic device, and correspondingly displaying the AR resource to be loaded, comprises:

receiving the identification information of the AR resource to be loaded sent by the second electronic device;

From the identification information of the AR resource to be loaded, determine the identification information of the target AR resource;

Carry the identification information of the target AR resource in the AR resource acquisition request, and send the AR resource acquisition request to the second electronic device, where the AR resource acquisition request is used to make the second electronic device respond to the requested AR resource. The AR resource acquisition request acquires the target AR resource corresponding to the identification information of the target AR resource;

receiving and displaying the target AR resource sent by the second electronic device.
The method according to claim 1, wherein the receiving the AR resource to be loaded sent by the second electronic device, and correspondingly displaying the AR resource to be loaded, comprises:

receiving the AR resource to be loaded sent by the second electronic device;

Determine the target AR resource from the AR resource to be loaded;

Display the target AR resource.
The method according to any one of claims 1 to 3, wherein, in response to any one of the following conditions, the sending the positioning information to the second electronic device comprises:

Within a time period, the distance moved by the first electronic device is greater than a distance threshold;

During the time period, the real-time location information of the first electronic device is located outside the positioning area;

At the end of the previous time period, start a new time period;

The positioning area is an area centered on the location information corresponding to the first electronic device at the initial moment of the time period.
The method according to claim 2, wherein the identification information of the AR resource to be loaded includes an AR resource identification and AR resource version information, and the identification of the target AR resource is determined from the identification information of the AR resource to be loaded information, including:

For the identification information of any AR resource to be loaded, if the AR resource corresponding to the AR resource identifier is not cached locally, or the locally cached AR resource version information of the AR resource corresponding to the AR resource identifier is the same as the AR resource version information of the AR resource. If the version information of the AR resource is inconsistent, it is determined that the identification information of the AR resource to be loaded is the identification information of the target AR resource.
The method according to any one of claims 1 to 5, wherein the positioning information includes an environment image where the first electronic device is located, and the environment image is used to make the second electronic device locate according to the The environmental image determines location information of the first electronic device.
A resource loading method, wherein, applied to a second electronic device, comprising:

receiving the positioning information sent by the first electronic device;

Determine location information of the first electronic device according to the location information;

determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device;

Sending the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.
The method according to claim 7, wherein the sending the AR resource to be loaded to the first electronic device comprises:

Sending the identification information of the AR resource to be loaded to the first electronic device, where the identification information of the AR resource to be loaded is used to enable the first electronic device to determine from the identification information of the AR resource to be loaded Identification information of the target AR resource;

receiving an AR resource acquisition request sent by the first electronic device, where the AR resource acquisition request carries the identification information of the target AR resource;

In response to the AR resource acquisition request, acquire the target AR resource corresponding to the identification information of the target AR resource, and send the target AR resource to the first electronic device, wherein the target AR resource is displayed on the in the first electronic device.
The method according to claim 7 or 8, wherein the determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device comprises:

Determine the to-be-loaded range according to the location information of the first electronic device;

For any AR resource, if the location information corresponding to the AR resource is located within the to-be-loaded range, the AR resource is determined to be the to-be-loaded AR resource.
The method according to claim 9, wherein the determining the range to be loaded according to the location information of the first electronic device comprises:

Determining the scope to build the data;

The to-be-loaded range is determined according to the location information of the first electronic device and the range construction data.
The method according to claim 10, wherein the positioning information further includes the network signal quality of the first electronic device and/or the moving speed of the first electronic device, and the determining the range construction data includes:

determining, according to the network signal quality, range construction data corresponding to the network signal quality; and/or,

Based on the moving speed, range construction data corresponding to the moving speed is determined.
The method according to claim 10 or 11, wherein the determining the to-be-loaded range according to the location information of the first electronic device and the range construction data comprises:

determining an initial to-be-loaded range according to the location information of the first electronic device and the range construction data;

determining the number of AR resources whose location information is within the initial to-be-loaded range;

Adjust the scope construction data according to the quantity of the AR resources to obtain the adjusted scope construction data;

The to-be-loaded range is determined according to the adjusted range construction data and the location information of the first electronic device.
The method according to claim 7, wherein the determining the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device comprises:

determining the distance between the location information of each AR resource and the location information of the first electronic device;

After sorting the AR resources according to the distance from small to large, the first preset number of AR resources are determined as the AR resources to be loaded.
The method according to claim 7, wherein the positioning information includes an image of an environment where the first electronic device is located, and the determining the position information of the first electronic device according to the positioning information comprises:

Visually locate the first electronic device according to an image of the environment where the first electronic device is located to obtain location information of the first electronic device.
A resource loading apparatus, wherein, applied to a first electronic device, the apparatus includes:

A sending module, configured to send positioning information to a second electronic device, where the positioning information is used to enable the second electronic device to determine the position information of the first electronic device according to the positioning information, and to determine the position information of the first electronic device according to the positioning information The location information of the device determines the augmented reality AR resources to be loaded;

A receiving module, configured to receive the AR resource to be loaded sent by the second electronic device, and to display the AR resource to be loaded accordingly.
A resource loading apparatus, wherein, applied to a second electronic device, the apparatus includes:

a receiving module, configured to receive the positioning information sent by the first electronic device;

a first determining module, configured to determine the location information of the first electronic device according to the location information;

a second determining module, configured to determine the AR resource to be loaded from the augmented reality AR resource according to the location information of the first electronic device;

A sending module, configured to send the AR resource to be loaded to the first electronic device, wherein the AR resource to be loaded is displayed in the first electronic device.
An electronic device comprising:

processor;

memory for storing processor-executable instructions;

wherein the processor is configured to invoke the memory-stored instructions to perform the method of any one of claims 1 to 6; or the processor is configured to invoke the memory-stored instructions, to perform the method of any one of claims 7 to 14.
A computer-readable storage medium on which computer program instructions are stored, wherein, when the computer program instructions are executed by a processor, the method of any one of claims 1 to 6 is implemented; or, the computer program instructions The method of any one of claims 7 to 14 is implemented when executed by a processor.
A computer program comprising computer readable code, when the computer readable code is executed in an electronic device, a processor in the electronic device executes the method for implementing any one of claims 1 to 6 ; or, the processor in the electronic device executes the method for implementing any one of claims 7 to 14.