CN107038619B

CN107038619B - Virtual resource management method and device

Info

Publication number: CN107038619B
Application number: CN201710071890.9A
Authority: CN
Inventors: 尹欢密; 曾晓东; 张奇; 赵琳昕
Original assignee: Advanced New Technologies Co Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2017-02-09
Filing date: 2017-02-09
Publication date: 2021-02-19
Anticipated expiration: 2037-02-09
Also published as: CN107038619A

Abstract

The application provides a virtual resource management method, which is characterized by comprising the following steps: performing an image scan for an offline environment of a target user; extracting image features from the scanned offline target, and matching the extracted image features with image features of a preset target serving as a virtual management resource key; the preset target is pre-bound with virtual resources; and when the image characteristics of the offline target are matched with the image characteristics of the preset target, outputting a virtual resource management interface corresponding to the virtual resources, and displaying the binding number of the virtual resources in the virtual resource management interface. The scheme can obviously improve the privacy and the interestingness of virtual resource management.

Description

Virtual resource management method and device

Technical Field

The present application relates to the field of augmented reality, and in particular, to a virtual resource management method and apparatus.

Background

With the continuous development of the mobile internet and the explosive growth of the resource exchange demand on the subscriber line, more and more off-line entity resources are virtualized into virtual resources; different from the traditional offline resource exchange, the offline entity resources are virtualized into online virtual resources, so that a user can directly consume the virtual resources online, and the offline resource exchange efficiency can be remarkably improved; for example, taking the above virtual resources as virtual funds as an example, by virtualizing physical currency into virtual funds, the user can complete traditional offline business activities online.

However, in practical applications, when a user manages virtual resources in a virtual resource account, the user may need to manage all or part of the virtual resources in the virtual resource account in a completely private management environment because the virtual resources themselves have certain privacy attributes; therefore, how to improve the privacy of the user in managing the virtual resources has a very important meaning.

Disclosure of Invention

The application provides a virtual resource management method, which is applied to a client side and comprises the following steps:

performing an image scan for an offline environment of a target user;

extracting image features from the scanned offline target, and matching the extracted image features with image features of a preset target serving as a virtual management resource key; the preset target is pre-bound with virtual resources;

and when the image characteristics of the offline target are matched with the image characteristics of the preset target, outputting a virtual resource management interface corresponding to the virtual resources, and displaying the binding number of the virtual resources in the virtual resource management interface.

The present application further provides a virtual resource management device, which is applied to a client, the device includes:

a scanning module that performs image scanning for an offline environment of a target user;

the matching module extracts image features from the scanned offline target and matches the extracted image features with image features of a preset target serving as a virtual management resource key; the preset target is pre-bound with virtual resources;

and the output module is used for outputting a virtual resource management interface corresponding to the virtual resource when the image characteristics of the offline target are matched with the image characteristics of the preset target, and displaying the binding number of the virtual resource in the virtual resource management interface.

The application provides a brand-new interaction mode combining an image scanning and identifying mechanism and the requirement of a user for privacy management of virtual resources; the target user can use the preset target in the offline environment as the virtual resource management key, bind with a certain amount of virtual resources, when the client performs image scanning for the offline environment of a target user in response to an image scanning operation of the target user, image features may be extracted from the scanned offline object, and the extracted image features may be matched with image features of a preset object that is a virtual management resource key, and when the image characteristics of the offline target are matched with the image characteristics of the preset target, outputting a virtual resource management interface corresponding to the virtual resources, and displaying the binding number of the virtual resources in the virtual resource management interface, therefore, a private virtual resource management environment can be created for the target user based on an image scanning and identifying mechanism, and the privacy and interestingness of virtual resource management can be remarkably improved.

Drawings

FIG. 1 is a flowchart illustrating a virtual resource management method according to an embodiment of the present application;

FIG. 2 is a schematic diagram illustrating binding of virtual funds for a scanned offline target according to one embodiment of the present application;

FIG. 3 is a schematic view of a private savings interface shown in an embodiment of the present application;

FIG. 4 is a schematic diagram illustrating a target user managing private money through a virtual deposit box model according to an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating modification updates to the amount of the house money by the target user interacting with the virtual deposit box model according to one embodiment of the present application;

FIG. 6 is a logic block diagram of a virtual resource management device according to an embodiment of the present application;

fig. 7 is a hardware configuration diagram of a client that carries the virtual resource management device according to an embodiment of the present application.

Detailed Description

The application aims to provide a brand-new interaction mode combining an image scanning and identifying mechanism with the requirement of a user on privacy management of virtual resources.

The target user can scan any offline target in the offline environment through the user client, and the offline target is used as a virtual resource management key to be bound with the virtual resources in the preset number. When the user uses the user client to perform the image scanning operation on the offline target again, the user client may extract image features from the offline target and match the extracted image features with image features serving as the virtual resource management key; if the two are matched, a virtual resource management interface corresponding to the virtual resource can be output, and the binding number of the virtual resource is displayed in the virtual resource management interface, so that a private virtual resource management environment can be created for a target user based on an image scanning and identification mechanism, and the privacy and interestingness of virtual resource management can be remarkably improved.

For example, taking the above virtual resource as a virtual fund as an example, the target user may scan any offline target (such as any object, picture, identifier, or environment in the offline environment, etc.) in the offline environment through the client, and use the offline target as a management key of the virtual fund, and bind a certain amount of virtual fund to the offline target. After the binding is successful, when the target user scans the offline target again through the client, if the client verifies that the scanned offline target is the management key through image feature matching, the client may receive virtual data (such as the amount of the fund, and the like) returned by the server and related to the bound virtual fund, create a virtual resource management interface (such as a virtual deposit box model or a wallet model) for the target user, and then output the virtual resource management interface to the target user, so that the target user may complete the management of the virtual fund through the virtual resource management interface.

In this way, for the bound virtual fund, the fund can be visible to the user only when the user scans the offline target again through the client and the client successfully verifies through image feature matching that the scanned offline target is the management key, so that for the target user, the fund can be managed as "private house money" in a secret manner, and the privacy of the user on virtual fund management can be remarkably improved.

The present application is described below with reference to specific embodiments and specific application scenarios.

Referring to fig. 1, fig. 1 is a virtual resource management-based method according to an embodiment of the present application, where the method includes the following steps:

step 101, performing image scanning for an offline environment of a target user;

102, extracting image features from the scanned offline target, and matching the extracted image features with image features of a preset target serving as a virtual management resource key; the preset target is pre-bound with virtual resources;

step 103, when the image characteristics of the offline target are matched with the image characteristics of the preset target, outputting a virtual resource management interface corresponding to the virtual resources, and displaying the binding number of the virtual resources in the virtual resource management interface.

The virtual resources may include any type of online virtual resources obtained by virtualizing offline entity resources; for example, the virtual resource may be a virtual fund (such as electronic money), or other type of online virtual resource.

The virtual data may include any type of management data associated with the virtual resource; for example, when the virtual resource is virtual funds, the virtual data may include the amount of the virtual funds, interest, investment income, fund change records, and the like.

The execution subject of the technical solutions shown in steps 101 to 103 may be a user client equipped with image scanning and image recognition functions. For example, in one embodiment shown, the user client may be an AR (Augmented Reality) client.

The following describes the technical solution of the present application in detail by taking the above-mentioned user client as an AR client as an example.

In this case, the virtual resource management interface may be a 3D virtual resource management model created by the AR client based on the onboard AR engine. Obviously, the above user client is only exemplary when being used as an AR client, and in practical applications, the user client may be another type of user client with image scanning and image recognition functions.

The AR client is client software developed based on an AR technology or integrated with an AR function; for example, the AR client may be a bank APP integrated with an AR service function; or a third party payment APP; the AR client can scan images of a real scene in an offline environment through a carried image scanning tool and initiate image recognition aiming at a scanned offline target; and performing visual rendering on the virtual data which is pushed by the AR server side of the background and corresponds to the identified offline target through the AR engine of the foreground of the AR client side, and performing superposition and fusion on the virtual data and a real scene (compared with a real scene image).

The AR server comprises a server for providing services for the AR client, a server cluster or a cloud platform constructed based on the server cluster; for example, the AR service end may be a payment platform providing a docking service for a third-party payment APP integrated with an AR service function; the AR server is configured to perform image recognition on an image scanned by the AR client based on an AR engine in a background (of course, the image recognition process may also be completed by the AR client based on an AR engine in a foreground); and managing the content of the virtual data related to the offline service, and pushing the virtual data related to the identified offline target to the AR client based on the image identification result.

In the following embodiment, the target user may scan any offline target in the offline environment through the AR client, and use the offline target as the virtual resource management key to bind with the preset number of virtual resources. When the user uses the AR client to perform the image scanning operation again for the offline target, the AR client may extract image features from the offline target, and match the extracted image features with the image features serving as the virtual resource management key; if the two are matched, on one hand, the AR client may create a corresponding virtual resource management model (for example, a 3D virtual deposit box model or a wallet model) for the virtual resource based on the piggybacked AR engine; on the other hand, the AR client may receive the virtual data related to the virtual resource returned by the AR server, add the received virtual data to the virtual resource management model for display, and then perform enhanced display on the virtual resource management model in the scanned live-action image at a position corresponding to the offline target, thereby implementing creation of a private virtual resource management environment for the target user based on an image scanning and recognition mechanism in the AR technology.

1) Binding of virtual resources

In this example, the target user may scan any offline target in the offline environment through the AR client to bind a certain amount of virtual resources to the offline target. The AR client may respond to the image scanning operation of the user, perform image scanning for the offline environment of the target user, and initiate image recognition for the scanned image information.

The image recognition process for the scanned image information may be completed by the AR client based on an image recognition model installed in the AR engine of the foreground.

When the method is realized, an AR engine of an AR client foreground can synchronize an image feature sample library stored on an AR server to the local in advance; wherein a large number of predefined image feature samples of the offline object are stored in the image feature sample library.

In the process of scanning images by the AR client aiming at the offline environment of the target user, the image characteristics can be extracted from the scanned image information based on an image recognition model carried in an AR engine of a foreground; the specific type of the extracted image features is not particularly limited in this example; for example, color, shape, granularity, contour, number of complex feature points, etc. may be included.

After extraction is completed, the AR client side can respectively perform similarity matching on the extracted image features and the image feature samples in the image feature sample library; when the extracted image features match the image feature samples of any one of the predefined offline objects stored in the image feature library, it can be confirmed that the offline object is successfully identified from the scanned image information.

Of course, in practical applications, the image recognition process shown above may also be implemented by uploading scanned image information to the AR server in real time by the AR client, and the AR server completes the image recognition based on the image recognition model loaded in the background AR engine in the same manner as shown above, which is not particularly limited in this example.

In one embodiment, when the AR client performs image recognition on scanned image information based on its local image recognition model, the scanned feature points usually have depth information corresponding to the Z axis due to image scanning based on AR technology, usually scanning on a three-dimensional target); in this case, compared with the image feature sample recorded locally by the AR client, if there is a certain error in the accuracy of the depth information, the image feature extracted by the image recognition model may cause the 3D interface of the image recognition model to shake, thereby causing poor experience to the visual impression of the user;

for example, if X, Y is perfectly matched with X 'and Y' in precision, but Z and Z 'have a certain precision error, the 3D interface of the image recognition model will generate jitter if the image feature extracted by the image recognition model is (X, Y, Z) and the above-mentioned image feature sample recorded locally is (X', Y ', Z').

To cope with such a problem, in one embodiment shown, when the AR client performs image recognition on scanned image information, if a local image recognition model generates recognition jitter of a 3D interface, a 2D floating layer interface adapted to the 3D interface may be output, that is, the 3D interface is converted into one 2D interface, and the influence of depth information corresponding to the Z axis on the image recognition model is eliminated, so that the recognition jitter of the 3D interface may be effectively corrected.

In this example, after any offline target is identified from the scanned image information, the AR client may initiate an inquiry to the AR server at this time to determine whether the target user has bound a virtual resource for the offline target.

And the AR server side can respond to the query initiated by the AR client side, query whether the relevant records of the target user binding the virtual resources for the offline target are stored locally, and return the query result to the AR client side.

If the target user does not bind the virtual resource to the offline target before, the AR client can immediately output a prompt message to the target user through the image scanning interface after receiving the query result of the unbound virtual resource returned by the AR server.

The prompt message is used for prompting the target user to bind the virtual resource for the offline target and providing corresponding user options so that the target user can determine whether to bind the virtual resource for the offline target;

for example, when the virtual resource is virtual funds, the prompt information output by the AR client may specifically be a text prompt of "whether to bind virtual funds to the target", and two user options of "yes" and "no" are provided to the user, so that the target user determines whether to bind virtual funds to the target.

Certainly, in practical applications, when the AR client identifies a plurality of offline targets from the scanned image information, the AR client may also mark the identified offline targets on the image scanning interface, and prompt the user to select one of the marked offline targets to complete the binding of the virtual resource.

In this example, when the target user determines that the virtual resource is bound for the offline target by triggering the corresponding user option, the AR client may immediately enter the virtual resource binding interface corresponding to the offline target, and the target user binds the virtual resource for the offline target through the binding interface.

In the binding interface, an input option (such as an input box) for inputting the binding number and a corresponding binding confirmation option may be provided for the target user, and the target user may input the binding number of the virtual resource that needs to be bound for the offline target in the binding interface, and complete the operation of binding the virtual resource for the offline target by triggering the binding confirmation option.

For example, taking the virtual resource as a virtual fund as an example, the binding interface may be a setting interface for "hiding private money" on the scanned offline target, an input box may be provided in the interface, and a confirmation button (i.e., the binding confirmation option) may be provided, and the target user may input a certain amount of money in the setting interface, bind a piece of virtual fund corresponding to the amount of money as "private money" with the offline target, and further hide the piece of virtual fund on the offline target.

After entering the virtual resource binding interface, the AR client may obtain the number of virtual resources to be bound, which is input by the target user in the binding interface, and upload the obtained binding number corresponding to the virtual resources, the scanned image features of the offline target, and the scanned image information to the AR server after the target user triggers the binding confirmation option.

After receiving the information uploaded by the AR client, the AR server may set the image characteristics of the offline target and the image information scanned by the AR client as a virtual resource management key to be locally recorded, and establish a binding relationship between the image characteristics and the image data of the offline target, the virtual resource account of the target user, and the virtual resources corresponding to the binding amount.

After the binding relationship is established, the AR server may update the number of virtual resources in the virtual resource account of the target user, and return a notification message of successfully binding the virtual resources to the AR client. After receiving the notification message, the AR client may synchronously update the local display amount of the virtual resources in the virtual resource account of the target user.

In this example, after the target user successfully binds a certain amount of virtual resources to the scanned offline target through the AR client, in order to further improve the privacy of the virtual resource binding operation of this time, the AR client may further hide the local resource records corresponding to the amount of the bound virtual resources after receiving the notification message of successful binding.

The resource record specifically includes a transfer-in record and a transfer-out record of the bound virtual resource from the virtual resource account of the target user; for example, when the virtual resource is virtual funds, the resource record may specifically include the bound virtual funds, a revenue record in the funding account of the target user, and a consumption record.

By the method, other users can be ensured to immediately check the resource record of the virtual resource account of the target user and cannot know the existence of the successfully bound virtual resource, so that the privacy level of virtual resource binding operation can be improved, and a completely secret virtual resource management environment is created for the target user.

2) Validation of virtual resource management keys

In this example, after the target user successfully binds the virtual resource to the scanned offline target through the above-described interaction manner, the AR client may subsequently scan the same offline target again to manage the bound virtual resource.

Because the offline target scanned by the target user has a certain privacy to a certain extent, that is, other users cannot know what type of the offline target scanned by the target user in binding the virtual resource, the offline target scanned by the AR client can be used as a unique management approach for the bound virtual resource in this way.

In this example, when the target user has a management requirement for the bound virtual resource, the offline target may still be scanned by the AR client at this time; and the AR client can respond to the image scanning operation of the target user, initiate image identification for the scanned image information, and initiate query to the AR server when any offline target is identified from the image information, so as to determine whether the target user binds virtual resources for the offline target.

For example, in an implementation manner, the AR client may construct an inquiry request, and carry the image features proposed in the offline target in the inquiry request, and after receiving the inquiry request, the AR server may match the image features of the offline target with the image features serving as the virtual resource management keys in the resource binding record one by one, to determine whether the offline target has already bound the virtual resources and the image features.

Because the offline target has been bound with the virtual resource by the target user before, and the AR server locally stores the corresponding binding relationship, the AR server may respond to the query initiated by the AR client, and return the query result that the offline target has been bound with the virtual resource to the AR client.

After receiving the query result of the bound virtual resource returned by the AR server, the AR client may further immediately verify, in an image feature matching manner, whether the scanned offline target is a preset target to which the virtual resource is bound before the target user.

In an embodiment shown, when verifying that the scanned offline target is a preset target that is bound by a virtual resource before the target user, the AR client may perform two stages of preliminary verification on the scanned image information and further verification on the image feature of the scanned offline target.

When the method is implemented, the AR client side can firstly acquire the image characteristics and the image data which have established the binding relationship with the virtual resource account of the target user from the AR server side, and then locally record the acquired image characteristics and the image data. The image features and the image data acquired at this time are image data scanned by the AR client and image features of the scanned offline target when the target user binds the virtual resource.

Certainly, in practical applications, when a user scans an offline target through an AR client and binds a virtual resource to the offline target, the AR client may also locally pre-record image data scanned by the target user when binding the virtual resource and image features of the scanned offline target. In this case, the AR client may not repeatedly obtain the image feature and the image data that have established the binding relationship with the virtual resource account of the target user from the AR server.

After the AR client determines that the currently scanned offline target has been previously bound with the virtual resource by initiating an inquiry, first, the currently scanned image data may be matched with the locally recorded image data scanned by the target user when binding the virtual resource, so as to perform preliminary verification on the scanned image data;

if the scanned image data is matched with locally recorded image data scanned by the target user when the virtual resource is bound, the primary verification is passed, and the AR client can further match the scanned image characteristics of the offline target with locally recorded image characteristics of the offline target scanned by the target user when the virtual resource is bound;

if the scanned image feature of the offline target is matched with the locally recorded image feature of the offline target scanned by the target user when the virtual resource is bound, at this time, the verification is completed, and the AR may determine that the currently scanned offline target is the preset target scanned by the target user when the virtual resource is bound and used as the virtual resource management key.

Of course, in practical applications, the above-illustrated authentication process may also be performed by the AR server. In this case, the AR client may upload the scanned image data and the image features of the scanned offline target to the AR server. When the AR server receives the image data and the image features uploaded by the AR client, because the AR server has recorded locally at this time the image data scanned by the target user when binding the virtual resource for the offline target and the scanned image features of the offline target in advance, the AR server can perform preliminary verification on the image information uploaded by the AR client and further verify the image features of the offline target uploaded by the AR based on the locally recorded information, and the specific verification process is the same as the specific process shown above when performing verification by the AR client, which is not described in detail in this example.

3) Management of virtual resources

In this example, when the currently scanned offline target is finally determined by the AR client through the above matching process and is a preset target scanned by the target user as a virtual resource management key when binding virtual resources, the AR server may query virtual data related to the bound virtual resources through a local virtual resource binding record, and then issue the virtual data to the AR client;

for example, if the matching process is completed by the AR client, and the AR client verifies that the scanned offline target is the preset target, the AR client may send a request message to the AR server to request the AR server for virtual data related to the virtual resource that has been bound for the offline target. After receiving the request message, the AR server may query the relevant virtual data through the local virtual resource binding record, and then issue the relevant virtual data to the AR client. If the matching process shown above is completed by the AR server, the AR server may locally query the virtual data when verifying that the scanned offline target is the preset target, and then actively issue the virtual data to the AR client.

Of course, if the scanned image data does not match the image data recorded locally by the AR; or, the scanned image feature of the offline target is not matched with the image feature sample recorded locally, and at this time, the verification shown above as to whether the scanned offline target is the preset target fails, in this case, the AR client may output related prompt information through the image scanning interface to prompt the target user to re-execute image scanning, and re-execute the matching process of the image feature shown above.

In this example, after the AR client receives the virtual data sent by the AR server, a virtual resource management model may be created for the bound virtual resource through a modeling tool carried in the AR engine based on the foreground.

For example, taking the virtual resource as a virtual fund as an example, the virtual resource management model may be a 3D virtual deposit box model or a wallet model.

After the virtual resource management model is created, the AR client may add the received virtual data to the virtual resource management model, then superimpose and fuse the virtual resource management model of the virtual management model and the scanned live-action image, and perform enhanced display on a position corresponding to the offline target in the scanned live-action image, so that the target user manages the bound virtual resource.

The management data displayed in the virtual resource management model may correspond to the virtual data received by the AR client and delivered by the AR server.

In one embodiment, the virtual data may include a binding number of the bound virtual resource; in this case, the AR client may add the binding number of the virtual resources that have been bound to the virtual resource management model, and then perform augmented display of the virtual resource management model on the position corresponding to the offline target in the scanned live view image.

Of course, the virtual data may include other types of management data related to the virtual resource besides the binding number of the bound virtual resource; for example, when the virtual resource is virtual funds, the virtual data may include the amount of the virtual funds, interest, investment income, fund change records, and the like.

In addition, in practical application, in order to further optimize the management requirements of users, a corresponding management entry or function entry may be further introduced into the virtual resource management model on the basis of the virtual data, so as to facilitate the target user to better manage the bound virtual resources.

In one embodiment, the information presented in the virtual data management model may include one or more of the following:

the binding number of the virtual resources bound for the offline target;

management information related to the virtual resources bound;

an extraction entry corresponding to the bound virtual resource;

a consumption portal corresponding to the bound virtual resource.

For example, in the case that the virtual resource is virtual currency, the virtual data may include information of the amount, interest, investment income, and fund change record of the bound virtual currency, and the information shown in the virtual resource management model may further include a withdrawal entry (e.g., a function button) for the bound virtual currency and a consumption entry for the bound virtual currency. Therefore, when the target user manages the bound virtual fund through the virtual resource management model, the bound virtual fund can be further extracted or consumed.

In one embodiment shown, when a user needs to extract or consume an already bound virtual resource, an extraction entry or a consumption entry provided in the virtual resource management model may be triggered (e.g., clicked on); after detecting the trigger operation of the user for the above extraction entry or consumption entry, the AR client may respond to the trigger operation of the user and initiate further identity authentication for the user.

Wherein, the further authentication process is not particularly limited in this example;

for example, in an implementation manner, the further verification process may specifically be face verification performed on the target user. In this case, when the AR client detects a trigger operation of the user for the above-mentioned extraction entry or consumption entry, the AR client may output a prompt message prompting the target user to perform further face verification to determine its own identity in the image scanning interface at this time, guide the target user to complete the acquisition of own facial features, and then perform face verification on the target user; after the face verification is passed, the AR client may interact with the corresponding server at this time to perform an extraction operation or a consumption operation for the virtual resource, update the binding number of the virtual resource shown in the virtual resource management model, and hide the corresponding resource extraction record in order to improve the privacy of virtual resource management.

In addition, it should be noted that, in practical applications, when a user binds a virtual resource to a scanned offline target, image scanning quality of an AR client is generally affected by an offline environment of the user, so if there is strong interference (for example, insufficient light, etc.) in an image scanning environment where a target user is located when the virtual resource is bound to the offline target, it may cause the target user to still be able to successfully bind the offline target, but image information of the offline target uploaded to an AR server by the AR client is not clear enough, so that when the target user scans the offline target again by using the AR client, an image feature matching failure occurs, and the target user cannot view the bound virtual resource.

In order to cope with the above problem, the AR client may limit the number of times of the re-matching, and actively terminate the above-illustrated process of matching the image features of the scanned offline target with the image features of the offline target as the virtual resource management key when the number of times of the re-matching reaches a preset threshold. In an embodiment shown, in a normal state, the AR client may still output a relevant prompt message through the image scanning interface, prompt the target user to re-perform image scanning, and re-perform the above matching process. Meanwhile, the AR client may count the number of matching failures (for example, start a counter) in the background, and verify in real time whether the counted number of matching failures reaches the preset threshold; if the counted number of times of matching failure reaches a preset threshold, at this time, the AR client may terminate the above-indicated matching, and perform further authentication on the target user.

For example, still in the above further verification process, for example, to perform face verification on the target user, in this case, when the number of times of the re-matching reaches a preset threshold, the AR client may output a prompt message in the image scanning interface to prompt the target user to perform further face verification to determine the identity of the target user, guide the target user to complete the acquisition of facial features of the target user, and then perform face verification on the target user; after the face verification is passed, the AR server may issue the virtual data related to the bound virtual resource to the AR client at this time, and the AR client completes the creation and enhanced display of the virtual resource management model.

By the method, when the AR client still fails in matching after a plurality of scanning attempts to cause that the target user cannot obtain the management authority of the bound virtual resource, the matching process is terminated timely, the user identity is verified in other modes to obtain the management authority of the bound virtual resource, and therefore the problem that the virtual resource can be normally bound due to poor scanned image quality when the virtual resource is bound, but the user cannot normally manage the bound virtual resource due to matching failure when the user scans the same offline target again can be solved.

In this example, the target user may generally have a need to modify and update the amount of the bound virtual resources during the process of managing the bound virtual resources through the virtual resource management model created by the AR client.

Therefore, in order to improve the operation efficiency of the target user when modifying and updating the number of the bound virtual resources, the target user can be supported to complete the modification and updating of the number of the bound virtual resources by directly interacting with the virtual resource management model in the application.

In an embodiment shown, the AR client may pre-define several preset interaction operations for triggering modification and update of the amount of the bound virtual resources, and associate a corresponding update modification manner for the defined interaction operations.

After the AR client side performs enhanced display on the created virtual resource management model in the live-action image, detecting the interactive operation of the target user aiming at the virtual resource management model in real time, and determining whether the detected interactive operation is a predefined preset interactive operation or not; if so, the number of the bound virtual resources can be modified and updated based on a modification and update mode associated with the preset interactive operation.

The preset interaction operation may specifically include a long-press operation or a sliding operation for the virtual resource management model.

For example, in one illustrated implementation, the preset interactive operation may be a long-press operation of an interactive interface for the virtual resource management model. In this case, the modification update manner associated with the long press operation may specifically be that, as the time of the long press operation of the user increases, the AR client interacts with the AR server to synchronously increase the number of the bound virtual resources.

In another implementation shown, the preset interactive operation may be a sliding operation of an interactive interface for the virtual resource management model; in this case, the update manner associated with the sliding operation may specifically be to increase or decrease the number of the bound virtual resources based on the direction of the sliding operation;

for example, a swipe up operation may be defined as raising the number of virtual resources bound, and a swipe down operation may be defined as lowering the number of virtual resources bound; further, the AR client may also predefine a specific number modification range for each sliding operation of the target user;

the number modification range may be set based on actual requirements, and is not particularly limited in this example; for example, assuming that the quantity modification range is defined as 500, so that each time the target user performs an upward or downward sliding operation, the bank APP may correspondingly increase or decrease the quantity of the bound virtual resources by 500.

By the method, the target user can directly interact with the virtual resource management model, and the number of the bound virtual resources can be quickly modified and updated, so that the management efficiency of the virtual resources can be improved.

The following takes the above virtual resources as virtual funds as an example, and specifically describes the technical solutions shown in the above embodiments in combination with a specific application scenario.

In an application scenario of saving 'private house money' based on AR interaction, the AR client may be a bank APP integrated with an AR service function; the AR service end may be a bank service platform providing services for the bank APP.

In the application scenario, a target user can scan any offline target in an offline environment through a bank APP, the offline target is used as a management key of 'private house money', a certain amount of virtual funds are bound to the offline target, and then secret saving is carried out.

Referring to fig. 2, fig. 2 is a schematic diagram illustrating the scanned offline target bound virtual fund.

As shown in fig. 2, after the target user opens the image scanning function carried by the bank APP, the bank APP may output a piece of prompt information "aiming at a place where private house money is to be stored" in an image scanning interface, and at this time, the target user may perform image scanning on any offline target in an offline environment under the prompt of the prompt information.

After the bank APP recognizes the offline target through the AR engine of the foreground, the bank APP may enter a "private house money saving interface" (equivalent to the virtual fund binding interface), and the target user completes the binding of the virtual fund in the private house money saving interface, so as to "hide" the fund as private house money on the scanned offline target.

Referring to fig. 3, fig. 3 is a schematic diagram of a private room money saving interface shown in this example.

As shown in fig. 3, the target user may input the amount of money to be saved as the private money in the private money saving interface and set a corresponding saving policy; for example, several deposit policies such as "demand deposit", "one year", "two years", etc. selectable by the user may be provided in the private house deposit interface as shown in fig. 3, and the target user may directly select the corresponding deposit policy in the private house deposit interface as shown in fig. 3.

With continued reference to fig. 3, after the target user inputs the deposit amount and the corresponding deposit policy in the "private money deposit interface", the hidden deposit of the "private money" can be completed by triggering (e.g., clicking) the "deposit of private money" function button as shown in fig. 3. After detecting the triggering operation of the function button of the target user for saving the private house money', the bank APP can acquire the deposit amount and the deposit strategy input by the target user, upload the deposit amount and the deposit strategy, the scanned image information of the offline target and the image characteristic sample extracted from the image information to a bank service platform, locally record the image information and the image characteristic sample by the bank service platform in term, and use the offline target as a virtual resource management key; at the same time, a binding relationship may be established between the virtual resource account of the target user and the virtual funds corresponding to the entered savings amount.

After the binding relationship is established, the bank service platform can return a notification message that the deposit of the private money is successful to the bank APP; after receiving the notification message, the bank APP may update the account balance of the target user, and hide all the posting and posting records related to the hidden private house money.

At this time, the target user successfully binds a fund for the scanned offline target, and only when the bound virtual fund is scanned again by using the logged bank APP of the target user as a management key, the secret deposit fund can be checked, and the management authority of the fund is obtained.

In this example, when the target user needs to check and manage the hidden private money, the offline target may be scanned again through the bank APP, and the AR client verifies whether the scanned offline target is the management key; if the AR client verifies that the scanned offline target is the management key, a virtual deposit box model can be created for the target user based on virtual data (such as the amount of money, interest amount, and the like) returned by the AR server and related to the bound virtual fund, and the virtual deposit box model is displayed in an enhanced manner in the live-action image scanned by the bank APP, so that the target user can manage the bound 'private money' through the virtual deposit box model.

Referring to fig. 4, fig. 4 is a schematic diagram illustrating that the target user manages the "private money" through the virtual deposit box model in this example.

As shown in fig. 4, the information displayed by the virtual deposit box model may specifically include the amount of the private money "hidden", interest income of the private money, the drawing entry of the money, and the consuming entry of the money, etc. If the target user needs to extract the private money, the fund extraction can be completed by triggering the extraction entrance and entering a corresponding fund extraction interface after passing further identity authentication; correspondingly, if the target user needs to consume the private house money, the target user can also use the fund for consumption by triggering the consumption entrance and entering a corresponding payment interface after passing further identity authentication.

Referring to fig. 5, fig. 5 is a schematic diagram illustrating the modification and update of the amount of the "private money" by the target user interacting with the virtual deposit box model.

In one approach, as shown in fig. 5, the target user may perform a long press operation against the interactive interface of the deposit box model to trigger the bank APP to modify and update the amount of the already "hidden" private money. In this case, the bank APP may interact with the AR server along with the increase of the time that the user presses for a long time to synchronously increase the amount of the bound virtual fund; and the target user can trigger the increment of the amount of the private money by pressing the interactive interface of the deposit box model for a long time, and update the amount of the private money into the desired amount by controlling the long-pressing time.

With continued reference to fig. 5, in another implementation, the target user may perform a sliding operation on the interactive interface of the deposit box model to trigger the bank APP to modify and update the amount of the "hidden" private money. In this case, the bank APP may define an upward sliding operation as raising the number of bound virtual resources, a downward sliding operation as lowering the number of bound virtual resources, and predefining an amount modification amplitude for each sliding operation performed; therefore, when the target user slides upwards or downwards aiming at the virtual resource, the quantity of the bound virtual funds is sequentially increased or decreased according to the predefined amplitude; for example, assume that the amount modification is set to 500 dollars, so that the amount of the private house money is increased or decreased by 500 dollars for each upward or downward sliding of the target user over the interactive interface of the deposit box model.

Therefore, in this way, the target user can scan any offline target through the bank APP, bind a certain amount of virtual fund for the offline target, establish a virtual private house money saving box bound with the offline target, and use the scanned offline target as the only management entrance for opening the private house money saving box, so that a completely concealed saving account can be created for the user, and the privacy of virtual fund management is further improved.

It should be noted that, the application scenario of "private money" saving based on AR interaction is taken as an example in the above embodiment, and is only exemplary; obviously, the technical solution shown in the present application can be applied to other similar application scenarios besides the application scenario of "private money" saving based on AR interaction shown above;

for example, in another application scenario shown, which is based on a private wallet of AR interaction, the AR client may be a third party payment APP (such as Alipay) that integrates AR service functions; the AR service end may be a third party payment platform (such as an Alipay platform) for providing services for the third party payment APP. In this application scenario, the target user may still scan any offline target through the payment APP, bind a certain amount of virtual funds to the offline target, establish a virtual private wallet bound to the offline target, and use the scanned offline target as a unique management entry for opening the virtual private wallet, so that only after the target user performs image scanning again on the same offline target, the associated authority of the private wallet can be obtained, a completely hidden consumption account can be created for the user, thereby improving privacy of virtual fund management, and no other similar application scenarios are listed one by one in the application.

Through the embodiment, a brand-new interaction mode combining the image scanning and recognition mechanism of the augmented reality technology and the privacy management requirement of the user for the virtual resources is provided; the target user can scan any offline target in the offline environment through the AR client, and the offline target is used as a virtual resource management key to be bound with the virtual resources in the preset number. When the user uses the AR client to perform the image scanning operation again for the offline target, the AR client may extract image features from the offline target, and match the extracted image features with the image features serving as the virtual resource management key; if the two are matched, on one hand, the AR client can establish a corresponding virtual resource management model for the virtual resource based on the carried AR engine; on the other hand, the AR client may receive the virtual data related to the virtual resource returned by the AR server, add the received virtual data to the virtual resource management model for display, and then perform enhanced display on the virtual resource management model in the scanned live-action image at a position corresponding to the offline target, thereby implementing creation of a private virtual resource management environment for the target user based on an image scanning and recognition mechanism in the AR technology.

Corresponding to the method embodiment, the application also provides an embodiment of the device.

Referring to fig. 6, the present application provides a virtual resource management device 60 applied to a client; referring to fig. 7, the hardware architecture of the client carrying the virtual resource management device 60 generally includes a CPU, a memory, a non-volatile memory, a network interface, an internal bus, and the like; in software implementation, the virtual resource management device 60 may be generally understood as a computer program loaded in a memory, and a logic device formed by combining software and hardware after being executed by a CPU, where the device 60 includes:

a scanning module 601, which executes image scanning for the offline environment of the target user;

a matching module 602, configured to extract image features from the scanned offline target, and match the extracted image features with image features of a preset target serving as a virtual management resource key; the preset target is pre-bound with virtual resources;

the output module 603 is configured to, when the image feature of the offline target matches the image feature of the preset target, output a virtual resource management interface corresponding to the virtual resource, and display the binding number of the virtual resource in the virtual resource management interface.

In this example, the client is an augmented reality client; the virtual resource management interface is a virtual resource management model created by the augmented reality client;

the output module 603 further:

receiving virtual data which is issued by a server and is related to the virtual resources; wherein the virtual data comprises a binding number of the virtual resource;

creating a corresponding virtual resource management model for the bound virtual resource;

adding the virtual data to the virtual resource management model, and displaying the virtual resource management model in an enhanced manner at a position corresponding to the offline target in the scanned live-action image.

In this example, the apparatus 60 further comprises:

an identification module 604 (not shown in fig. 6) for image identification of the scanned image information;

an inquiry module 605 (not shown in fig. 6) that, when any offline target is identified from the image information, inquires of the server whether a virtual resource is bound to the offline target; and if the offline target is bound with the virtual resource, the matching module extracts image features from the scanned offline target and matches the extracted image features with the image features of a preset target serving as a virtual management resource key.

In this example, the apparatus 60 further comprises:

an obtaining module 606 (not shown in fig. 6), if the offline target does not bind the virtual resource, outputting a user prompt option for binding the virtual resource for the offline target; responding to the triggering operation of the user aiming at the user prompt option, entering a virtual resource binding interface corresponding to the offline target, and acquiring the binding quantity corresponding to the virtual resource, which is input by the target user on the virtual resource binding interface;

the uploading module 607 (not shown in fig. 6) uploads the obtained binding number and the image feature corresponding to the offline target to the server, so that the server sets the offline target as a virtual resource management key, and establishes a binding relationship between the image feature of the offline target, the virtual resource account of the target user, and the virtual resource corresponding to the binding number.

In this example, the output module 603 further:

receiving a notification message of successfully binding the virtual resources, which is returned by the augmented reality client; and updating the display quantity of the virtual resources in the virtual resource account of the target user, and hiding the resource records of the virtual resources corresponding to the binding quantity.

In this example, the matching module 602 further:

acquiring image characteristics bound with the virtual resource account of the target user from the server, and matching the scanned image characteristics of the offline target with the acquired image characteristics bound with the virtual resource account of the target user; alternatively, the first and second electrodes may be,

and uploading the extracted image features to the server, so that the server matches the received image features with the image features bound with the virtual resource account of the target user.

In this example, the output module 603 further:

detecting the interactive operation of the target user aiming at the virtual resource management interface;

determining whether the interactive operation is a preset interactive operation; the preset interactive operation comprises a long-time pressing operation or a sliding operation aiming at the virtual resource management interface;

and if so, synchronously modifying and updating the binding quantity of the virtual resources based on the preset interactive operation.

In this example, the output module 603 further:

performing further identity authentication for the target user in response to a fetch instruction or a consume instruction for the virtual resource triggered by the target user;

and after the identity authentication for the target user passes, executing extraction operation or consumption operation for the virtual resources, updating the binding number of the virtual resources shown in the virtual resource management interface, and hiding the corresponding resource extraction record or resource consumption record.

In this example, the virtual resource includes virtual funds.

For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.

The apparatuses, modules or units illustrated in the above embodiments may be specifically implemented by a computer chip or an entity, or implemented by an article with certain functions. A typical implementation device is a computer, which may take the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.

Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims

1. A virtual resource management method is applied to an augmented reality client, and comprises the following steps:

performing an image scan for an offline environment of a target user;

extracting image features from the scanned offline target, and matching the extracted image features with image features of a preset target which is a virtual management resource key bound with a virtual resource account of the target user; the preset target is pre-bound with virtual resources;

carrying out image identification on the scanned image information, and inquiring whether a virtual resource is bound to an offline target or not from a server when any offline target is identified from the image information;

if the offline target is not bound with the virtual resource, outputting a user prompt option for binding the offline target with the virtual resource; responding to the triggering operation of the user aiming at the user prompt option, entering a virtual resource binding interface corresponding to the offline target, and acquiring the binding quantity corresponding to the virtual resource, which is input by the target user on the virtual resource binding interface; uploading the acquired binding quantity and the image characteristics corresponding to the offline target to a server, setting the offline target as a virtual resource management key by the server, and establishing a binding relationship among the image characteristics of the offline target, the virtual resource account of the target user and the virtual resources corresponding to the binding quantity;

if the offline target is bound with the virtual resource, extracting image features from the scanned offline target, and matching the extracted image features with image features of a preset target serving as a virtual management resource key;

when the image characteristics of the offline target are matched with the image characteristics of the preset target, outputting a virtual resource management interface corresponding to the virtual resources, and displaying the binding number of the virtual resources in the virtual resource management interface; wherein the information presented in the virtual resource management interface further comprises a combination of one or more of the following information: an extraction entry corresponding to the bound virtual resource, a consumption entry corresponding to the bound virtual resource;

performing further identity authentication for the target user in response to a triggering operation of the target user for the extraction portal or the consumption portal;

2. The method of claim 1, wherein the virtual resource management interface is a virtual resource management model created for an augmented reality client;

the outputting a virtual resource management interface corresponding to the virtual resource, and displaying the binding number of the virtual resource in the virtual resource management interface, includes:

3. The method of claim 1, further comprising:

receiving a notification message of successfully binding the virtual resources, which is returned by the augmented reality client;

and updating the display quantity of the virtual resources in the virtual resource account of the target user, and hiding the resource records of the virtual resources corresponding to the binding quantity.

4. The method according to claim 1, wherein the matching the extracted image features with image features that are preset targets of a virtual management resource key comprises:

5. The method of claim 1, further comprising:

when image recognition is carried out on scanned image information, if a local image recognition model generates recognition jitter of a 3D interface, outputting a 2D floating layer interface which is adaptive to the 3D interface so as to carry out effect correction on the recognition jitter of the 3D interface.

6. The method of claim 1, further comprising:

if the extracted image features are not matched with the image features of the preset target, image scanning is conducted again aiming at the offline environment of the target user, and the extracted image features are matched with the image features of the preset target again;

when the number of times of re-matching reaches a preset threshold value, performing further identity authentication aiming at the target user;

and after the identity authentication for the target user passes, outputting a virtual resource management interface corresponding to the virtual resource, and displaying the binding number of the virtual resource in the virtual resource management interface.

7. The method of claim 1, further comprising:

8. The method of claim 1, wherein the information exposed in the virtual resource management interface further comprises the following information:

management information associated with the bound virtual resource.

9. The method of any of claims 1-8, wherein the virtual resource comprises virtual funds.

10. A virtual resource management device applied to an augmented reality client, the device comprising:

the matching module extracts image features from the scanned offline target and matches the extracted image features with image features of a preset target which is a virtual management resource key bound with a virtual resource account of the target user; the preset target is pre-bound with virtual resources;

an identification module for image identification of the scanned image information;

the query module is used for querying whether the offline target is bound with the virtual resource or not from the server side when any offline target is identified from the image information; if the offline target is bound with the virtual resource, the matching module extracts image features from the scanned offline target and matches the extracted image features with image features of a preset target serving as a virtual management resource key;

the acquisition module is used for outputting a user prompt option for binding the virtual resource for the offline target if the offline target is not bound with the virtual resource; responding to the triggering operation of the user aiming at the user prompt option, entering a virtual resource binding interface corresponding to the offline target, and acquiring the binding quantity corresponding to the virtual resource, which is input by the target user on the virtual resource binding interface;

the uploading module uploads the acquired binding quantity and the image characteristics corresponding to the offline target to a server, so that the server sets the offline target as a virtual resource management key, and establishes a binding relationship among the image characteristics of the offline target, the virtual resource account of the target user and the virtual resources corresponding to the binding quantity;

the output module is used for outputting a virtual resource management interface corresponding to the virtual resource when the image characteristics of the offline target are matched with the image characteristics of the preset target, and displaying the binding number of the virtual resource in the virtual resource management interface; wherein the information presented in the virtual resource management interface further comprises a combination of one or more of the following information: an extraction entry corresponding to the bound virtual resource, a consumption entry corresponding to the bound virtual resource;

the output module further performs further identity authentication for the target user in response to a triggering operation of the target user for the extraction portal or the consumption portal;

11. The apparatus of claim 10, wherein the virtual resource management interface is a virtual resource management model created for an augmented reality client;

the output module further:

12. The apparatus of claim 10, wherein the output module is further to:

13. The apparatus of claim 10, wherein the matching module is further to:

14. The apparatus of claim 10, wherein the output module is further to:

15. The apparatus of claim 10, wherein the information exposed in the virtual resource management interface further comprises the following information:

management information associated with the bound virtual resource.

16. The apparatus of any of claims 10-15, wherein the virtual resource comprises virtual funds.