KR102272119B1 - Method and apparatus for offline interaction based on augmented reality - Google Patents

Abstract

The present application provides an augmented reality technology-based interactive mode that combines online virtual resource allocation and management with user's consumption and image scanning operations at an offline target location. the augmented reality server obtains consumed data of the user including consumption amount at the target location; allocating a corresponding amount of virtual resources to the user based on the consumption amount, and accumulating the allocated virtual resources in a virtual resource pool of the target place; in response to an image scanning operation performed by the augmented reality client device in an offline environment of the target location, determine whether a predetermined identifier corresponding to the target location is identified from image information obtained through scanning; In response to determining that the predetermined identifier corresponding to the target location has been identified from the image information obtained through the scanning, deliver virtual data related to the virtual resource in the virtual resource pool to the augmented reality client device so that the augmented reality client device is scanned in the real world and perform augmented display of the associated virtual data at a position corresponding to the predetermined identifier in the image.

Description

Method and apparatus for offline interaction based on augmented reality

The present application relates to the field of augmented reality, and more particularly to an offline interaction method and apparatus based on augmented reality.

Augmented reality (AR) technology calculates the position and angle of an image in real time, so that the corresponding image, video and 3D model are combined into the image, thereby integrating the virtual and real worlds, thereby creating a new interactive experience. It is a technology that is provided to users. With the continuous development of AR technology, AR technology is applied more widely. Therefore, how to better combine offline and online services using AR technology is important for improving user experience. As a prior art document, Chinese Patent Laid-Open Publication No. 104463623 (Gong
Open: 2015.03.25).

The present application provides an offline interaction method based on augmented reality. The method is applied to an augmented reality server, comprising the following steps: obtaining, at a target place, consumption data of a user including consumption amount; allocating a corresponding amount of virtual resource to the user based on the consumption amount, and accumulating the allocated virtual resource in a virtual resource pool of the target location; in response to an image scanning operation performed by the augmented reality client device in an offline environment of the target location, determining whether a predetermined identifier corresponding to the target location is identified from image information obtained through scanning; and in response to determining that the predetermined identifier corresponding to the target location has been identified from the image information obtained through scanning, deliver virtual data related to the virtual resource in the virtual resource pool to the augmented reality client device, so that the augmented reality client device is scanned. and causing the augmented display of the associated virtual data to be performed at a location corresponding to the predetermined identifier in the real-world image.

The present application also provides an offline interaction method based on augmented reality. The method is applied to an augmented reality client device, comprising the following steps: uploading consumption data of a user at a target place to an augmented reality server, wherein the consumption data includes a consumption amount, wherein the augmented reality server corresponds to a corresponding amount based on the consumption amount an uploading step of assigning a virtual resource of a to a user, and accumulating the allocated virtual resource in a virtual resource pool of a target place; performing image scanning in the offline environment of the target location in response to an image scanning operation performed by a user in the offline environment of the target location; Initiating image recognition for image information obtained through scanning, and when a predetermined identifier corresponding to a target place is identified from the image information, receiving virtual data transmitted by the augmented reality server and related to a virtual resource in the virtual resource pool step; and performing augmented display on the received virtual data at a location corresponding to the predetermined identifier in the scanned real-world image.

The present application also provides an offline interaction device based on augmented reality. The apparatus is applied to the augmented reality server, and includes: an acquiring module, configured to acquire consumption data at a target place, wherein the consumption data includes consumption amount; an allocation module, configured to allocate a corresponding amount of virtual resource to the user based on the consumption amount, and accumulate the allocated virtual resource in a virtual resource pool of the target place; a determining module, configured to, in response to an image scanning operation performed by the augmented reality client device in an offline environment of the target location, determine whether a predetermined identifier corresponding to the target location is identified from image information obtained through scanning; and in response to determining that the predetermined identifier corresponding to the target location has been identified from the image information obtained through scanning, deliver virtual data related to the virtual resource in the virtual resource pool to the augmented reality client device, so that the augmented reality client device is scanned. and a delivery module configured to perform augmented display of the associated virtual data at a location corresponding to the predetermined identifier in the real-world image.

The present application also provides an offline interaction device based on augmented reality. The apparatus is applied to an augmented reality client device, and includes: an upload module, configured to upload consumption data of a user at a target place to an augmented reality server, wherein the consumption data includes a consumption amount, so that the augmented reality server responds based on the consumption amount an upload module, configured to allocate an amount of virtual resources to the user, and to accumulate the allocated virtual resources in a virtual resource pool of the target location; a scanning module configured to perform image scanning in the offline environment of the target location in response to an image scanning operation performed by the user in the offline environment of the target location; Initiate image recognition for image information obtained through scanning, and when a predetermined identifier corresponding to a target place is identified from the image information, receive virtual data transmitted by the augmented reality server and related to a virtual resource in the virtual resource pool a configured receiving module; and a display module, configured to perform augmented display on the received virtual data at a location corresponding to the predetermined identifier in the scanned real-world image.

The present application provides an augmented reality technology-based interactive mode that combines online virtual resource allocation and management with user's consumption and image scanning operations at an offline target location.

The augmented reality client device may upload the consumption data of the user at the offline target place to the augmented reality server, and the augmented reality server allocates a corresponding amount of virtual resources to the user based on the consumption amount of the consumption data, and the allocated virtual resources accumulating in the virtual resource pool of the target place to convert consumption data of users in the offline target place into a corresponding amount of virtual resources, and accumulating virtual resources allocated to different users in the virtual resource pool of the target place, thereby A good offline target location can be selected by horizontally comparing and analyzing the total amount of virtual resources accumulated in virtual resource pools of different target locations.

Furthermore, upon reaching the offline target location, in addition to regular consumption at the target location, the user may use the augmented reality client device to scan the offline environment of the target location. The augmented reality client device may initiate image recognition for image information obtained through scanning; when a predetermined identifier corresponding to the target place is identified from image information obtained through scanning, receive virtual data transmitted by the augmented reality server and related to a virtual resource of the target place; performing augmented display on virtual data received at a location corresponding to a predetermined identifier in the scanned real-world image, thereby combining the user's offline image scanning operation with online virtual resource management using augmented reality image recognition technology. can In this way, the user can view the related information of the virtual resource in the virtual resource pool of the target location to more conveniently manage the virtual resource allocated to the user.

1 is a flowchart illustrating an offline interaction method based on augmented reality, according to an embodiment of the present application.
2 is a schematic diagram illustrating virtual data output in an AR scenario, according to an implementation of the present application.
3 is a logical block diagram illustrating an offline interaction device based on augmented reality, according to an implementation of the present application.
4 is a diagram illustrating a hardware structure of an augmented reality server including an offline interaction device based on augmented reality according to an embodiment of the present application.
5 is a logical block diagram illustrating another offline interaction device based on augmented reality, according to an implementation of the present application.
6 is a diagram illustrating a hardware structure of an augmented reality client device including another offline interaction apparatus based on augmented reality, according to an embodiment of the present application.

The present application provides an AR technology-based interactive mode that combines the user's consumption and image scanning operations at an offline target location with online virtual resource allocation and management. The interactive mode can be classified into an online interaction of virtual resource allocation and management, and an offline interaction of the user's consumption and image scanning at the target location.

During the online interaction, the AR client device may upload the consumption data of the user at the offline target place to the AR server, and the AR server may allocate a corresponding amount of virtual resources to the user based on the consumption amount of the consumption data, Accumulate the allocated virtual resources in the virtual resource pool of the target location to convert consumption data of users in the offline target location into a corresponding amount of virtual resources, and accumulate virtual resources allocated to different users in the virtual resource pool of the target location Thus, it is possible to horizontally compare and analyze the total amount of virtual resources accumulated in the virtual resource pools of different target places, thereby selecting a good offline target place.

During offline interaction, when reaching the offline target location, in addition to regular consumption at the target location, the user may use the AR client device to scan the offline environment of the target location. The AR client device may initiate image recognition for image information obtained through scanning; when a predetermined identifier corresponding to the target place is identified from image information obtained through scanning, receive virtual data transmitted by the AR server and related to a virtual resource of the target place; By performing augmented display on the virtual data received at a location corresponding to a predetermined identifier in the scanned real-world image, it is possible to combine online virtual resource management with the user's offline image scanning operation using AR image recognition technology. have. In this way, the user can view the related information of the virtual resource in the virtual resource pool of the target location to more conveniently manage the virtual resource allocated to the user.

For example, in an application scenario, the target venue may be any type of offline store, and the virtual asset may be a virtual asset (such as a virtual stock or virtual bond) corresponding to the offline store.

In the current scenario, after the user performs offline consumption in the offline store (for example, after completing the offline payment using the APP), the AR client device interacts with the AR server and uploads the related consumption data to the AR server. and the AR server may allocate a specific quantity of virtual assets of the offline store to the user based on the user's current consumption amount, and accumulate the allocated virtual assets in the virtual asset pool of the offline store. After the allocation is completed, the user takes ownership of the virtual asset, allowing the user to trade the virtual asset.

In addition, the user may scan a specific identifier of the offline store (such as a store logo) using the AR client device; The AR client device may initiate image recognition for image information obtained through scanning; When a specific identifier is successfully identified from the image information, the AR server sends related information (such as total value of virtual assets, unit value, change data of unit value) of virtual assets accumulated in the virtual asset pool of the offline store to the AR client be delivered to the device; The AR client device performs display superimposition on the relevant information at a location corresponding to a specific identifier of the scanned real-world image. In this way, the user can use the information displayed in the real-world image to be aware of the relevant situation of the virtual assets of the offline store, so that the virtual assets of the offline store held by the user can be better managed.

With reference to specific application scenarios, the present application is described below using specific implementations.

1 illustrates an offline interaction method based on augmented reality, according to an embodiment of the present application. This method includes the following steps.

Step 101: The AR client device uploads consumption data of the user in the target location to the AR server, and the consumption data includes consumption amount.

AR client devices are developed based on AR technology or incorporate AR functions. For example, the AR client device may be ALIPAY that integrates an AR service function. The AR client device performs image scanning in a real-world scenario in an offline environment; sending image data obtained through scanning to the AR server in real time; using the AR engine in the front end of the AR client device to visually render the virtual data pushed by the AR server in the back end; It is configured to superimpose and combine image data (such as real-world images) and virtual data obtained through scanning in real-world scenarios.

AR servers include AR client devices, server clusters, or servers that provide cloud platforms built on server clusters. For example, the AR server may be a payment platform that provides an interworking service for Alipay that integrates AR service functions. The AR server recognizes, based on the AR engine of the backend, the image scanned by the AR client device (certainly, the image may also be recognized by the AR client device based on the AR engine of the frontend); manage virtual data related to offline services; Based on the image recognition result, the relevant virtual data may be pushed to the AR client device. For example, the AR server may be configured to allocate a virtual object to the user based on the image recognition result, and push the allocation result of the virtual object to the AR client device.

The target place may include any type of offline consumption place, such as, for example, a brick-and-mortar store.

In fact, the AR client device may have an offline payment function, and the user responds by using the offline payment function of the AR client device when arriving at a target place with a user terminal device (such as a smartphone) in which the AR client device is installed. You can pay for consumer goods (such as merchandise) offline.

In this example, after the user completes the associated consumption at the target location, the AR client device may upload the user's current consumption data to the AR server for further processing. The consumption data may include a current consumption amount of the user.

For example, when the user completes consumption in the offline store by using the payment function of the AR client device, the user uses the AR client device to scan a two-dimensional payment code provided by the store owner, etc., to pay the store owner and enter the payment amount. In addition, the related payment function module provided in the AR client device may interact with the related payment platform to complete the additional payment. After payment is completed, the AR client device may upload consumption data related to the current consumption, such as a completed order, to the AR server.

Step 102: The AR server allocates a virtual resource of a corresponding amount to the user based on the consumption amount, and accumulates the allocated virtual resource in the virtual resource pool of the target location.

The virtual resource may include any type of online virtual resource that may be associated with a user's consumption. The AR server may allocate a corresponding amount of virtual resource to the user under a preconfigured virtual resource allocation rule based on the user's consumption amount.

In an implementation, the virtual resource may be a virtual asset corresponding to the target location. A specific type of virtual asset is not limited in this application. For example, virtual assets may actually be virtual stocks, virtual bonds, virtual options, other forms of virtual assets, and the like.

The virtual resource pool may be a virtual asset pool created for the target venue. Virtual resources allocated to different consumers may be accumulated in a virtual resource pool.

For example, in an implementation, the AR server may assign a unique store ID to each coordinated offline store in the system, and chain stores of the same brand may be distinguished (or distinctly distinct) using different store IDs. cannot be). Furthermore, the store ID of each offline store may uniquely correspond to a virtual asset ID, and the virtual asset ID may be an ID of a virtual asset account created for the offline store. After receiving the consumption data each time, the AR server may immediately allocate a corresponding amount of virtual assets to the user based on the consumption amount of the consumption data, and then add the allocated virtual assets to the virtual asset account for accumulation.

In this example, the AR server may obtain consumption data uploaded by the AR client device in real time. After receiving the consumption data uploaded by the AR client device, the AR server immediately processes the consumption data correspondingly, extracts relevant information such as consumption amount from the consumption data, and then provides it to the corresponding user under the pre-configured virtual resource allocation rule. A corresponding amount of virtual resources may be allocated.

The specific allocation logic included in the virtual resource allocation rule is not limited in the present application. When implementing the technical solution of the present application, a person skilled in the art may perform flexible configuration as needed.

For example, in an implementation, the virtual resource allocation rule may include: allocating an equal amount of virtual asset to a user based on consumption. Specifically, an amount of virtual assets equal to the value corresponding to the consumption amount may be allocated to the user based on the value corresponding to the consumption amount.

For another example, in other implementations, there may be a certain linear relationship between the amount consumed and the amount of virtual assets to be allocated. The virtual resource allocation rule may be a linear function constructed based on a linear relationship. As such, the user's consumption amount can be input into a linear function as an input parameter for calculation, and the consumption amount is converted into a corresponding amount of virtual assets to be allocated. Certainly, in practice, a linear relationship may be established as needed, and the amount of virtual assets to be allocated calculated using the linear function may be greater or less than the value corresponding to the consumption amount.

After the allocation is completed, the AR server adds the allocated virtual resource to the virtual resource account corresponding to the consumer, updates the total amount of virtual resources in the virtual resource account, and pushes the updated result to the AR client device in the form of a message. This allows the AR client device to perform a synchronous update.

For example, it is assumed that the virtual resource is a virtual asset corresponding to a target location. The AR server creates a corresponding virtual asset account for each user, allocates the virtual asset, and then updates the allocated virtual asset to the relevant user's virtual asset account in real time, and triggers the AR client device to account for the user's virtual resource account. A corresponding update message may be forwarded to the AR client device to synchronously update the amount of displayed virtual assets within.

In addition, the AR server may further accumulate the allocated virtual resources in the virtual resources of the target location.

Since the amount of virtual resources allocated to the user is related to the actual consumption of the user, the total amount and the sum value of the virtual resources accumulated in the virtual resource pool can be finally used as important indicators for measuring the revenue status of the target place in this method. have. Specifically, a larger total amount of virtual resources in the virtual resource pool dictates a greater amount of users traveling to a target location for consumption and a greater amount of time spent. As such, in practice, a good offline target venue with good revenue can be “identified” by horizontally comparing and analyzing the total amount and total value of virtual resources accumulated in the virtual resource pools of other target venues. For example, when the virtual resource is a virtual asset and the virtual resource pool is a virtual asset pool, the total amount and the sum value of virtual assets in the virtual asset pool of a plurality of offline stores having essentially consistent asset conditions are compared and analyzed, so that this type of Choose a good store with more consumers and a greater amount of time spent from the offline store.

Step 103: The AR client device performs image scanning in the offline environment of the target location in response to an image scanning operation performed by the user in the offline environment of the target location.

In this example, upon reaching the offline target location, in addition to completing offline consumption by using the payment function of the AR client device and obtaining a certain amount of virtual resources allocated by the AR server, the user can use the AR client device's image By using the scanning function, image scanning can be performed for a predetermined offline identifier of the target location.

The offline identifier may be any type of identifying information described by the AR server in the backend and associated with the target venue. For example, when the target place is an offline store, the offline identifier may be a logo of the offline store.

Step 104: The AR client device initiates image recognition for image information obtained through scanning.

In this example, after obtaining the corresponding image information from the offline environment of the target place through scanning, the AR client device starts image recognition for the image information in real time, so that the image information obtained through the scanning corresponds to the offline environment of the target place You can decide whether or not to include an identifier.

Image recognition may be performed on image information obtained through scanning based on an image recognition model provided in the AR client device, or after the AR client device uploads image information obtained through scanning to the AR server in real time, the AR server It may be performed by the AR server based on the image recognition model provided locally in the .

In an implementation, the AR client device may have an image recognition model locally. After obtaining image information of the offline environment of the target location through scanning by calling the camera of the AR terminal device, the AR client device continues to call the image recognition model to perform image recognition on the image information and upload the recognition result to the AR server can do. The AR server further confirms the recognition result.

In another implementation, the AR client device may upload image information obtained through scanning to the AR server in real time without an image recognition model provided locally, and the AR server may be configured to perform image recognition based on the image recognition model provided locally in the AR server. Image recognition is performed on image information, and then the recognition result is returned to the AR client device.

It is worth noting that the image recognition algorithm included in the image recognition model in this example is not limited. A person skilled in the art may refer to the record of the related technology when implementing the technical solution of the present application. For example, in an implementation, the image recognition model may be a deep learning model trained based on a neural network and a large amount of image recognition samples.

Step 105: The AR server determines whether a predetermined identifier corresponding to the target location is identified from image information obtained through scanning.

Step 106: In response to determining that the predetermined identifier corresponding to the target location has been identified from the image information obtained through scanning, the AR server delivers virtual data related to the virtual resource in the virtual resource pool to the AR client device.

In this example, after performing image recognition on image information obtained through scanning by the AR client device, the AR server determines whether an offline identifier corresponding to the target place is successfully identified from the image information based on the image recognition result can be further determined. In response to determining that the offline identifier corresponding to the target venue has been successfully identified from the image information, the AR server locally stores a database associated with the virtual resource pool of the target venue for virtual data related to the virtual resource within the virtual resource pool of the target venue. You can search.

In an embodiment, the virtual data related to the virtual resources in the virtual resource pool of the target location may include a sum value of virtual resources in the virtual resource pool, unit values of virtual resources in the virtual resource pool, change data of unit values, and the like.

For example, when the virtual resource is a virtual stock, the virtual data includes the total price of virtual stocks accumulated in the virtual stock fund pool of the target location, the price per share of the virtual stock in the virtual stock fund pool, price change data per share for a specific period, etc. may include.

Indeed, in fact, in addition to the various types of data shown above, such as, for example, store location, store's promotional information and store introduction, other forms of virtual data related to the target place may be introduced into the virtual data, They are not listed one by one in the application.

It is worth noting that the virtual data related to the virtual resource in the virtual resource pool of the target place can be obtained through real-time calculation by the AR server in the backend based on the actual situation of the virtual resource in the virtual resource pool.

After the AR server accumulates the virtual resource allocated to the user in the virtual resource pool of the target place, since the total amount of the current virtual resource in the virtual resource pool is changed, the AR server can be triggered immediately to recalculate the virtual data.

The AR server may calculate a unit value of the virtual resource in the virtual resource pool based on the total amount of the virtual resource in the virtual resource pool and the total value to be allocated corresponding to the target location. For example, when the virtual resource is a virtual asset, the total value to be allocated may be divided by the total amount of virtual assets in the virtual resource pool to obtain the unit value of the virtual asset in each unit stock.

The change data of the unit value may include the changed unit value and the change moment, so that the AR server can generate time sequence data for the unit value change based on the change moment and the changed unit value.

The total value to be allocated may be an index capable of reflecting the total value of the virtual resource to be allocated corresponding to the target location.

For example, in an implementation, when the virtual resource is a virtual asset, the sum value to allocate may be the total revenue of the target venue. In other words, when the unit value of the virtual asset in the virtual asset pool is calculated, the total revenue of the target place may be divided by the total amount of the virtual asset in the virtual asset pool to obtain the unit value of the virtual asset.

Clearly, in addition to the target location's total revenue, the sum value to assign is evaluated by other indexes that may reflect the target location's asset status, such as the target location's total net income, a third-party rating agency or platform on the target location. total assets to be allocated, or total virtual assets to be allocated customized for the target location based on asset status.

In practice, it is worth noting that the unit value can generally be changed dynamically according to the operating conditions of the target location. In this way, when the unit value of the virtual resource in the virtual resource pool is changed, the AR server can also immediately record the change data of the unit value through calculation.

In addition, after calculating the unit value of the virtual resources in the virtual resource pool, the AR server may further calculate the sum value of the virtual resources in the virtual resource pool and the total amount of virtual resources in the virtual resource pool based on the calculated unit value. .

In the present example, the AR server may deliver the virtual data to the AR client device after obtaining the virtual data related to the virtual resource in the virtual resource pool of the target location, and the AR client device may transmit the virtual data to the AR client device at the location corresponding to the offline identifier in the scanned real-world image. Perform augmented display of related virtual data.

Step 107: The AR client device performs augmented display on the received virtual data at a location corresponding to the predetermined identifier in the scanned real-world image.

In this example, after receiving the virtual data delivered by the AR server, the AR client device visually renders the virtual data by using the AR engine in the front end; superimpose and combine image data and virtual data obtained through scanning in a real-world scenario; Augmented display may be performed at a location corresponding to the offline identifier in the scanned real-world image.

In the implementation, it is assumed that the virtual data includes the sum value of virtual resources in the virtual resource pool, the unit value of the virtual resources in the virtual resource pool, and change data of the unit value.

First, after receiving the virtual data transmitted by the AR server, the AR client device may generate a visual graph corresponding to the change rule of the unit value based on the change data of the unit value. For example, the change data of the unit value may be time sequence data generated based on the changed unit value and the moment when the unit value is changed, and the time graph may be a two-dimensional curve generated based on the time sequence data. have.

Second, after generating the visual graph, the AR client device uses the AR engine in the front end to visually render the visual graph, the sum value of the virtual resources in the virtual resource pool, and the unit value of the virtual resources in the virtual resource pool, , augmented display may be performed at a location corresponding to the offline identifier in the scanned real-world image.

For example, referring to FIG. 2 , when the target place is an offline store and the virtual resource is a virtual stock of the offline store, the virtual data is the total price of the virtual stock accumulated in the virtual stock fund pool of the store, the total price of the virtual stock in the virtual stock fund pool It may include the price per share of the virtual stock, and change data of the price per share for a specific period.

After the user scans the logo of the target location using the AR client device, the AR server may deliver the virtual data to the AR client device. After receiving the virtual data, the AR client device first visually renders the change data of the price per share for a specific period, converts the change data of the price per share for the particular period into a two-dimensional curve that can reflect the price change, and then augmented for data such as two-dimensional curves, the total price of virtual stocks accumulated in the store's virtual stock fund pool, and the price per share of virtual stocks in the virtual stock fund pool at positions corresponding to the store's logo in the scanned real-world image. display can be performed.

In the present method, online virtual resource management is combined with an offline image scanning operation performed by a user by using AR image recognition technology, by using an AR client device to scan an offline identifier corresponding to a target place to obtain virtual resources of the target place By viewing related information of virtual resources in the pool, it can be seen that virtual resources allocated to users can be more conveniently managed.

In this example, the user interface of the AR client device may further provide a user entry for managing the virtual resource allocated to the user.

In an implementation, the user entry may include a first exchange entry and a second exchange entry. The first exchange entry may be used to exchange a virtual resource allocated to the user for a corresponding virtual voucher, and the second exchange entry may be used to exchange a virtual voucher held by the user for a virtual resource.

For example, when the virtual resource is a virtual asset, the first exchange entry may be a virtual asset purchase entry, and the second exchange entry may be a virtual asset sale entry. The virtual resource exchange request sent when the AR client device is triggered by the user in the first exchange entry may be a virtual resource purchase request, and the virtual resource exchange sent when the AR client device is triggered by the user in the second exchange entry The request may be a virtual resource sale request. The virtual voucher may be a virtual currency used to settle purchases and sales of virtual assets. In the initial state, the AR server may further create a virtual currency account for each user to manage the held virtual currency. In this way, the user can sell the held virtual asset by triggering the sale entry, and can settle the held virtual asset into virtual currency. Alternatively, the user may trigger a purchase entry to purchase virtual resources and settle the held virtual currency as virtual assets.

Upon detecting a trigger action (such as a tap action) performed by the user in the first exchange entry, the AR client device may input a virtual resource exchange interface to the user using the user interface, and in the virtual resource exchange interface, the user You can output the virtual resources currently held by . The user may select the corresponding virtual resource in the interface as the virtual resource to be exchanged, and input the amount of the virtual resource to be exchanged.

The AR client device obtains, at the backend, identification information of the virtual resource to be exchanged (such as a virtual resource ID) selected by the user and an input amount of the virtual resource to be exchanged; configure a virtual resource exchange request (ie, a first virtual resource exchange request) based on the obtained information; A virtual resource exchange request may then be sent to the AR server.

After receiving the virtual resource exchange request, the AR server may obtain identification information and an amount of the virtual resource to be exchanged included in the virtual resource exchange request, and may calculate a total value of the virtual resource to be exchanged. After the calculation is completed, the AR server allocates a virtual voucher having the same total value as the virtual resource to be exchanged to the user, adds the allocated virtual voucher to the virtual voucher account created for the user, and sends the exchange result in the form of a message By pushing to the AR client device, the user interface can be used to display the results to the user.

Correspondingly, upon detecting the trigger action performed by the user on the second exchange entry, the AR client device may input a virtual resource exchange interface to the user using the user interface, and prompt the current user on the virtual resource exchange interface. It is possible to output virtual resources to be exchanged by The user may select the corresponding virtual resource on the interface as the virtual resource to be exchanged, and input the amount of the virtual voucher to be exchanged.

The AR client device may obtain, in the backend, identification information of the virtual resource to be exchanged selected by the user and an input amount of the virtual voucher to be exchanged; configure a virtual resource exchange request (ie, a second virtual resource exchange request) based on the obtained information; A virtual resource exchange request may then be sent to the AR server.

After receiving the virtual resource exchange request, the AR server may obtain identification information and amount of the virtual resource to be exchanged included in the virtual resource exchange request, and calculate the amount of virtual resource having the same total value as the virtual voucher to be exchanged. After the calculation is completed, the AR server allocates a corresponding amount of virtual resource to the user, adds the allocated virtual resource to the virtual resource account created for the user, and pushes the exchange result in the form of a message to the AR client device. , the user interface may be used to display the exchange result to the user.

In this method, the user can conveniently use the holding virtual resources and virtual vouchers as necessary after recognizing the relevant conditions of virtual resources in the virtual resource pool of the target place in real time by viewing the relevant information of the virtual resources in the virtual resource pool of the target place. It can be seen that they are interchangeable.

Corresponding to the method implementation described above, the present application also provides an apparatus implementation.

Referring to FIG. 3 , the present application provides an offline interaction device 30 based on augmented reality, and the device is applied to an AR server. Referring to FIG. 4 , the hardware architecture of the AR server including the offline interaction device 30 based on augmented reality generally includes a CPU, a memory, a non-volatile memory, a network interface, an internal bus, and the like. In an example in which the offline interaction device 30 based on augmented reality is implemented by software, the offline interaction device 30 based on augmented reality can be generally understood as a computer program loaded into a memory, and After execution by the logic software and hardware form a combination device. The apparatus 30 includes: an acquisition module 301 configured to acquire, at a target location, consumption data of the user including consumption amounts; an allocation module 302, configured to allocate a corresponding amount of virtual resource to the user based on the consumption amount, and accumulate the allocated virtual resource in a virtual resource pool of the target place; a determining module 303, configured to, in response to an image scanning operation performed by the augmented reality client device in an offline environment of the target location, determine whether a predetermined identifier corresponding to the target location is identified from image information obtained through scanning; and in response to determining that the predetermined identifier corresponding to the target location has been identified from the image information obtained through scanning, deliver virtual data related to the virtual resource in the virtual resource pool to the augmented reality client device, so that the augmented reality client device is scanned. and a delivery module 304 configured to perform augmented display of the associated virtual data at a location corresponding to the predetermined identifier in the real-world image.

In this example, the virtual data includes the sum value of the virtual resources in the virtual resource pool, the unit value of the virtual resources in the virtual resource pool, and change data of the unit value.

The apparatus 30 is configured to: calculate a unit value of a virtual resource in the virtual resource pool based on the amount of the virtual resource in the virtual resource pool and the sum value to be allocated corresponding to the target location; record the change data of the unit value when the unit value of the virtual resource in the virtual resource pool is changed; and a calculation module 305 (not shown in FIG. 3 ), configured to calculate a sum value of the virtual resources in the virtual resource pool based on the calculated unit value and the amount of virtual resources in the virtual resource pool.

In this example, the allocation module 302 also receives a first virtual resource exchange request sent by the user using the augmented reality client device, wherein the first virtual resource exchange request includes an amount of virtual resource to be exchanged and the user Includes identification information of virtual resources to be exchanged by -; calculate a sum value of virtual resources to be exchanged based on the first virtual resource exchange request; assign to the user a virtual voucher having the same total value as the virtual resource to be exchanged; receive a second virtual resource exchange request sent by the user using the augmented reality client device, wherein the second virtual resource exchange request includes an amount of the virtual voucher to be exchanged by the user; calculating an amount of virtual resources having the same sum value as the virtual voucher to be exchanged based on the second virtual resource exchange request; and allocate a corresponding amount of virtual resource to the user.

In this example, the virtual resource is a virtual asset corresponding to the target venue, the sum value to be allocated is the total revenue of the target venue, the virtual voucher is a virtual currency, the first virtual resource exchange request is a virtual asset purchase request, and the second The virtual resource exchange request is a virtual asset sale request.

Referring to FIG. 5 , the present application provides an offline interaction apparatus 50 based on augmented reality, and the apparatus is applied to an AR client device. Referring to FIG. 6 , the hardware architecture of the AR client device including the offline interaction apparatus 50 based on augmented reality generally includes a CPU, a memory, a non-volatile memory, a network interface, an internal bus, and the like. In an example in which the offline interaction device 50 based on augmented reality is implemented by software, the offline interaction device 50 based on augmented reality can be generally understood as a computer program loaded into a memory, and After execution by the logic software and hardware form a combination device. The device 50 includes: an upload module 501, configured to upload consumption data of a user at a target location to an augmented reality server, wherein the consumption data includes a consumption amount, wherein the augmented reality server responds based on the consumption amount to a corresponding an upload module 501 for allocating an amount of virtual resources to a user, and causing the allocated virtual resources to accumulate in a virtual resource pool of a target place; a scanning module 502, configured to perform image scanning in the offline environment of the target location in response to an image scanning operation performed by the user in the offline environment of the target location; Initiate image recognition for image information obtained through scanning, and when a predetermined identifier corresponding to a target place is identified from the image information, receive virtual data transmitted by the augmented reality server and related to a virtual resource in the virtual resource pool configured receiving module 503; and a display module 504 configured to perform augmented display on the received virtual data at a location corresponding to the predetermined identifier in the scanned real-world image.

In this example, the virtual data includes the sum value of the virtual resources in the virtual resource pool, the unit value of the virtual resources in the virtual resource pool, and change data of the unit value.

The display module 504 generates a visual graph corresponding to the change rule of the unit value based on the received change data of the unit value; and perform the augmented display on the generated visual graph at a location corresponding to the received sum value of the virtual resource in the virtual resource pool, the unit value of the virtual resource in the virtual resource pool, and the predetermined identifier in the scanned real-world image. .

In this example, the user interface of the augmented reality client device includes a first exchange entry and a second exchange entry corresponding to the virtual resource.

The apparatus is configured to: send a first virtual resource exchange request to the augmented reality server in response to a trigger action performed by the user for the first exchange entry, wherein the first virtual resource exchange request is the The augmented reality server calculates the sum value of the virtual resource to be exchanged based on the first virtual resource exchange request, including the amount and the identification information of the virtual resource to be exchanged by the user, and has the same sum value as the virtual resource to be exchanged. to assign a virtual voucher to a user -; send a second virtual resource exchange request to the augmented reality server in response to a trigger action performed by the user on the second exchange entry, the second virtual resource exchange request including an amount of the virtual voucher to be exchanged by the user; make the augmented reality server calculate an amount of virtual resources having the same sum value as the virtual voucher to be exchanged based on the second virtual resource exchange request, and allocate a corresponding amount of virtual resources to the user - the configured sending module 505 further includes

In this example, the virtual resource is a virtual asset corresponding to the target location, the virtual voucher is a virtual currency, the first virtual resource exchange request is a virtual asset purchase request, and the second virtual resource exchange request is a virtual asset sale request.

Since the apparatus implementation basically corresponds to the method implementation, for relevant parts, reference may be made to the related description in the method implementation. The device implementations described above are merely examples. A unit described as an individual part may or may not be physically separable, and a part indicated as a unit may or may not be a physical unit, may be disposed in one location, and may be distributed over a plurality of network units . Some or all modules may be selected as necessary to achieve the purpose of the solution of the present application. Those skilled in the art can understand and implement embodiments of the present application without creative efforts.

The system, apparatus, module or unit described in the previous implementation may be implemented by using a computer chip or entity, or may be implemented by a product having a specific function. A typical implementation device is a computer. A computer may be, for example, a personal computer, laptop computer, mobile phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer or wearable device or any of these devices. It can be a combination.

Other embodiments of the present application may be readily understood by one of ordinary skill in the art after considering this specification and practicing the present disclosure. This application is intended to cover any variations, functions or adaptive changes of this application. These modifications, functions or adaptive changes follow the general principles of the present application and include common knowledge or commonly used technical means in the art, not disclosed in this application. This application and embodiments are considered by way of example only. The actual scope and spirit of the present application is set forth by the following claims.

It should be understood that this application is not limited to the precise structure described above shown in the accompanying drawings, and that modifications and changes may be made without departing from the scope of the present application. The scope of the present application is limited only by the appended claims.

The above description is merely an embodiment of the present application, and is not intended to limit the present application. Any modification, equivalent substitution, or improvement made without departing from the spirit and principle of the present application shall fall within the protection scope of the present application.

Claims (16)

A method for offline interaction based on augmented reality, comprising:
obtaining, by the augmented reality server, consumption data of the user at the target location, the consumption data including consumption amount;
allocating, by the augmented reality server, an amount of a virtual resource corresponding to the user based on the consumption amount;
accumulating, by the augmented reality server, an amount of virtual resources allocated to the user, to update the total amount of virtual resources in the user's virtual resource account;
updating, by the augmented reality server, a total quantity of virtual resources accumulated in the virtual resource pool of the target place and a total value of virtual resources accumulated in the virtual resource pool of the target place; the total amount and total value of virtual resources accumulated in the virtual resource pool are based on the amount of virtual resources allocated to the user and the amount of virtual resources allocated to other users;
delivering, by the augmented reality server, a corresponding update message to an augmented reality client device, wherein the corresponding update message sends the augmented reality client device to the augmented reality client device based on the amount of virtual resources allocated to the user. triggering to synchronously update the amount of displayed virtual resource in the virtual resource account;
In response to the image scanning operation performed by the augmented reality client device in the offline environment of the target place, a scanned real-world image of which a predetermined identifier corresponding to the target place is obtained through the image scanning operation by the augmented reality server determining whether it is identified from image information of and
In response to determining that a predetermined identifier corresponding to the target location has been identified from image information obtained through the image scanning operation, to the augmented reality client device by the augmented reality server, within the virtual resource pool of the target location. forwarding virtual data comprising the updated sum value of virtual resources, wherein the augmented reality client device superimposes and combines the virtual data with the image information at a location corresponding to a predetermined identifier in a scanned real-world image. configured to perform augmented display of virtual data. The offline interaction of claim 1, wherein the virtual data includes a sum value of the virtual resources in the virtual resource pool, a unit value of the virtual resources in the virtual resource pool, and change data of the unit value. way for. The method of claim 2, wherein the method comprises:
calculating a unit value of the virtual resource in the virtual resource pool based on the total amount of the virtual resource in the virtual resource pool and the total value to be allocated corresponding to the target location;
recording the change data of the unit value when the unit value of the virtual resource in the virtual resource pool is changed; and
calculating a sum value of the virtual resources in the virtual resource pool based on the calculated unit value and the amount of the virtual resources in the virtual resource pool. 4. The method of claim 3,
receiving, by the augmented reality server, a first virtual resource exchange request sent by a user using the augmented reality client device, wherein the first virtual resource exchange request is exchanged by the user and an amount of virtual resource to be exchanged - Contains identification information of the virtual resource to be ;
calculating, by the augmented reality server, a total value of virtual resources to be exchanged based on the first virtual resource exchange request;
allocating, by the augmented reality server, a virtual voucher having a sum value equal to a sum value of virtual resources to be exchanged to a user;
receiving, by the augmented reality server, a second virtual resource exchange request sent by the user using the augmented reality client device, the second virtual resource exchange request including an amount of virtual voucher to be exchanged by the user Ham - ;
calculating, by the augmented reality server, an amount of virtual resources having a sum value equal to a value of the amount of virtual vouchers to be exchanged based on the second virtual resource exchange request; and
and allocating, by the augmented reality server, a corresponding amount of virtual resource to the user. 5. The method according to any one of claims 2 to 4,
The virtual resource includes a virtual asset corresponding to the target location,
The total value to be allocated includes the total revenue of the target place,
Virtual vouchers contain virtual currency,
The first virtual resource exchange request includes a virtual asset purchase request,
and the second virtual resource exchange request comprises a virtual asset sale request. 5. The method of any one of claims 1 to 4, wherein the method comprises:
accumulating, by the augmented reality server, virtual resources allocated to different users in a virtual resource pool of the target location; and
selecting an offline target venue by horizontally comparing and analyzing, by the augmented reality server, a total amount of virtual resources accumulated in virtual resource pools of different different target venues. 6. The method according to claim 5, wherein the virtual resource pool comprises a virtual asset pool created for the target location, and virtual resources allocated to different users are accumulated in the virtual resource pool. 5. The method of any one of claims 1 to 4, wherein the method comprises:
and recalculating virtual data including the updated sum value of the virtual resource pool of the target venue. 5. The method according to any one of claims 1 to 4,
uploading, by the augmented reality client device, consumption data of the user at the target location to the augmented reality server, wherein the consumption data includes a consumption amount, wherein the augmented reality server generates a corresponding amount of virtual data based on the consumption amount Allows allocating resources to users - ;
Image in the offline environment of the target location for a predetermined offline identifier of the target location using the image scanning function of the augmented reality client device performed by the augmented reality client device by the user in the offline environment of the target location performing scanning;
initiating, by the augmented reality client device, image recognition for image information of a scanned real-world image obtained through the image scanning;
In response to determining that a predetermined identifier corresponding to the target location has been identified from the image information at the augmented reality server, communicated by the augmented reality client device, by the augmented reality server, and the virtual resource of the target location receiving virtual data comprising the updated sum value of the virtual resources in a pool; and
performing, by the augmented reality client device, augmented display of the received virtual data by superimposing and combining the virtual data with the image information at a position corresponding to the predetermined identifier in the scanned real-world image; A method for offline interaction that includes. delete 10. The method of claim 9, wherein performing the augmented display of the received virtual data at a location corresponding to the predetermined identifier in the scanned real-world image comprises:
generating a visual graph corresponding to a change rule of the unit value based on the received change data of the unit value; and
augmented for a visual graph generated at a location corresponding to the received sum value of the virtual resources in the virtual resource pool, the unit value of the virtual resource in the virtual resource pool, and the predetermined identifier in the scanned real-world image. A method for offline interaction comprising performing a display. 10. The method of claim 9, wherein the user interface of the augmented reality client device includes a first exchange entry and a second exchange entry corresponding to the virtual resource. 13. The method of claim 12,
sending, by the augmented reality client device, a first virtual resource exchange request to the augmented reality server in response to a trigger action performed by a user on the first exchange entry, wherein the first virtual resource exchange request is an exchange an amount of virtual resources to be exchanged and identification information of virtual resources to be exchanged by a user, wherein the augmented reality server calculates a sum value of virtual resources to be exchanged based on the first virtual resource exchange request;
allocating, by the augmented reality client device, a virtual voucher having a sum value equal to a sum value of virtual resources to be exchanged to a user;
sending, by the augmented reality client device, a second virtual resource exchange request to the augmented reality server in response to a trigger operation performed by a user on the second exchange entry, wherein the second virtual resource exchange request is an amount of virtual vouchers to be exchanged, wherein the augmented reality server calculates an amount of virtual resources having a sum value equal to a value of the amount of virtual vouchers to be exchanged based on the second virtual resource exchange request; and
allocating, by the augmented reality client device, a corresponding amount of virtual resource to a user. An apparatus for offline interaction based on augmented reality, comprising a plurality of modules configured to perform the method of any one of claims 1 to 4 . delete delete

Images