WO2019001229A1

WO2019001229A1 - Method and device for realizing virtual resource customization

Info

Publication number: WO2019001229A1
Application number: PCT/CN2018/089941
Authority: WO
Inventors: 刘金来; 胡耀斌; 刘冬冬
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2017-06-27
Filing date: 2018-06-05
Publication date: 2019-01-03
Also published as: CN107396197A; CN107396197B

Abstract

The present invention relates to the technical field of Internet applications. Disclosed are a method and device for realizing virtual resource customization, a terminal, and a computer readable storage medium. The method comprises: receiving a trigger instruction for virtual resource customization, triggering loading of an image acquisition control according to the trigger instruction, starting specified image acquisition hardware by loading the image acquisition control, and extracting a customized virtual resource from image content outputted by the specified image acquisition hardware. The method and device for realizing virtual resource customization can realize customization of virtual resources.

Description

Method and device for realizing virtual resource customization

Technical field

The present invention relates to the field of Internet application technologies, and in particular, to a method and apparatus for implementing virtual resource customization, a terminal, and a computer readable storage medium.

Background technique

With the rapid development of Internet technology, the demand for interaction between users is getting higher and higher, and the interaction between users is enhanced by the mutual transmission of virtual resources.

For example, the live broadcast room provides users with an exchange channel, and each user interacts through the live broadcast room. A user in the live broadcast room can be used as an anchor to post video, audio, and other information in the live broadcast room. Other users in the live room can view this information as the viewer of the anchor. When the audience is interested in these, they can give virtual gifts such as electronic gifts to the anchor. After the host receives the virtual resources, the live room presents the virtual gifts presented to the anchor, thereby better realizing the interaction between the users.

However, in the current interaction between users, the virtual resources are pre-set, and the user can only select among the preset virtual resources, that is, the existing virtual resources can only be used for sending and sharing, and the existing virtual The resource form is not rich enough, and the virtual resource cannot be customized. The development cycle of the virtual resource is long and the update speed is slow, which greatly affects the enthusiasm of the user.

Summary of the invention

In order to solve the technical problem that the virtual resource form in the related art is not rich enough and the virtual resource cannot be customized, the present invention provides a method and device for realizing the virtual resource customization.

In one aspect, the present disclosure provides a method for implementing virtual resource customization, including:

Receiving a virtual resource custom trigger instruction;

Triggering loading of the image collection control according to the triggering instruction;

Opening the specified image acquisition hardware by loading the image capture control;

Extracting a custom virtual resource from image content output by the specified image acquisition hardware.

Optionally, after the step of performing the opening of the specified image capturing hardware by the loading of the image capturing control, the method further includes:

Forming a background area with respect to the image output area in the display interface with respect to the image acquisition hardware;

A translucent mask layer is created in the background region.

Optionally, the forming an image area in the image output area in the display interface with respect to the image capturing hardware includes:

A background area is formed in the image output area in the live video display interface with respect to the image acquisition hardware.

Optionally, the step of performing extraction of the customized virtual resource from the image content output by the specified image collection hardware includes:

Controlling, by the specified image acquisition hardware, the image content of the real scene to be collected;

Optimizing the image content to generate a custom virtual resource.

Optionally, the step of performing optimization processing on the image content to generate a customized virtual resource includes:

Generating a texture according to the image content;

Controlling multiple shaders to perform the effect processing of the texture in parallel to generate a custom virtual resource.

Optionally, after the step of performing the extraction of the customized virtual resource from the image content output by the specified image collection hardware, the method further includes:

Obtaining a target user identifier specified for the custom virtual resource;

And performing the transmission processing of the customized virtual resource according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.

Optionally, the step of performing the transmission process of the custom virtual resource according to the target user identifier, and the step of sharing the customized virtual resource to the terminal corresponding to the target user identifier includes:

Performing HTTP transmission of the customized virtual resource for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server;

After the customized virtual resource is successfully uploaded, the push notification of the customized virtual resource is sent according to the target user identifier.

Optionally, the receiving the virtual resource custom triggering instruction includes:

During the live video display process, a virtual resource custom trigger instruction is received.

In addition, the present invention provides another method for implementing virtual resource customization, the method is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast, the method includes:

Receiving, by the live broadcast server, a push notification sent by uploading a custom virtual resource to another terminal;

Responding to the push notification, downloading a corresponding custom virtual resource from the virtual resource server;

Displaying the customized virtual resource on the display interface of the terminal.

In another aspect, the present disclosure further provides an apparatus for implementing virtual resource customization, including:

The trigger instruction receiving module is configured to receive a trigger instruction of the virtual resource customization;

a control loading triggering module, configured to trigger loading of the image capturing control according to the triggering instruction;

An image capturing hardware opening module is configured to perform opening of the specified image capturing hardware by loading the image capturing control;

And a virtual resource extraction module, configured to extract a custom virtual resource from the image content output by the specified image collection hardware.

Optionally, the device further includes:

a background area forming module, configured to form a background area with respect to the image output area of the image capturing hardware in the display interface;

A mask layer generating module is configured to generate a translucent mask layer in the background area.

Optionally, the virtual resource extraction module includes:

An image acquisition unit, configured to control the collection of image content by the specified image acquisition hardware on a real scene;

An image optimization unit is configured to optimize the image content to generate a custom virtual resource.

Optionally, the image optimization unit includes:

a texture generation subunit, configured to generate a texture according to the image content;

The special effect processing sub-unit is configured to control multiple shaders to perform the special effect processing of the texture in parallel to generate a custom virtual resource.

In addition, the present disclosure further provides another device for implementing virtual resource customization, where the device is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast. The device includes:

a notification receiving module, configured to receive a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal;

a resource downloading module, configured to download a corresponding custom virtual resource from the virtual resource server in response to the push notification;

And a resource display module, configured to display the customized virtual resource on a display interface of the terminal.

In another aspect, the disclosure provides a terminal, where the terminal includes:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of implementing virtual resource customization described above.

In another aspect, the present disclosure also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the method of virtual resource customization described above.

The technical solutions provided by the embodiments of the present invention may include the following beneficial effects:

In the process of interaction between the terminals, the virtual resource custom triggering instruction is received, the image capturing control is triggered according to the triggering instruction, the specified image capturing hardware is turned on by the loading of the image capturing control, and the image outputted from the specified image capturing hardware is outputted. The content is extracted from the customized virtual resources, so that the virtual resources cannot be re-developed through a long development cycle, and the virtual resources can be customized according to actual needs, thereby greatly improving the richness of the virtual resources.

The above general description and the following detailed description are merely exemplary and are not intended to limit the invention.

DRAWINGS

The accompanying drawings, which are incorporated in the specification of FIG

1 is a schematic diagram of an implementation environment in accordance with an embodiment of the present invention.

2 is a flow chart of a method for implementing virtual resource customization, according to an exemplary embodiment.

FIG. 3 is a schematic diagram of an electronic gift, according to an exemplary embodiment.

4 is a flow chart showing the operational steps of an image capture control, according to an exemplary embodiment.

FIG. 5 is another method of implementing virtual resource customization according to the corresponding embodiment of FIG.

FIG. 6 is a schematic diagram of a background area shown in accordance with an exemplary embodiment.

FIG. 7 is a specific implementation flowchart of step S140 in the method for implementing virtual resource customization according to the embodiment shown in FIG. 2 .

FIG. 8 is a flow chart showing an optimization process of image content, according to an exemplary embodiment.

FIG. 9 is a specific implementation flowchart of step S142 in the method for implementing virtual resource customization according to the embodiment shown in FIG. 7.

FIG. 10 is a schematic diagram of image filter processing by GLProcessFramework, according to an exemplary embodiment.

FIG. 11 is a flowchart of another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2.

FIG. 12 is a specific implementation flowchart of step S220 in the method for implementing virtual resource customization according to the embodiment shown in FIG.

FIG. 13 is a flow chart showing interaction of a custom virtual resource, according to an exemplary embodiment.

FIG. 14 is a flowchart of another method for implementing virtual resource customization, according to an exemplary embodiment.

FIG. 15 is a schematic diagram of a scenario for implementing virtual resource customization in a live broadcast room.

FIG. 16 is a block diagram of an apparatus for implementing virtual resource customization, according to an exemplary embodiment.

FIG. 17 is a block diagram of another apparatus for implementing virtual resource customization according to the embodiment of FIG. 16.

FIG. 18 is a block diagram of the virtual resource extraction module 140 shown in the corresponding embodiment of FIG. 16.

FIG. 19 is a block diagram of an image optimization unit 142 shown in the corresponding embodiment of FIG. 18.

FIG. 20 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16.

FIG. 21 is a block diagram of the resource transfer module 220 in the device for customizing the virtual resource shown in the embodiment of FIG. 20.

FIG. 22 is a block diagram of another apparatus for implementing virtual resource customization, according to an exemplary embodiment.

FIG. 23 is a structural block diagram of a terminal according to an exemplary embodiment.

Detailed ways

The description will be made in detail herein with respect to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with aspects of the invention as detailed in the appended claims.

1 is a schematic diagram of an implementation environment in accordance with an embodiment of the present invention. As shown in FIG. 1, the implementation environment includes a terminal 10 and a server 20 that performs data transmission with the terminal 10.

The manner of association between the terminal 10 and the server 20 includes, but is not limited to, a data association manner between the terminal and the wireless network, such as WiFi, and the like. The specific association manner is not limited by this embodiment.

After the virtual resource customization is completed, the terminal 10 uploads the customized virtual resource to the server 20.

The terminal 10 can be a computer device such as a smart phone or a computer. The specific implementation is not limited by this embodiment.

2 is a flow chart of a method for implementing virtual resource customization, according to an exemplary embodiment. As shown in FIG. 2, the method for implementing virtual resource customization may include the following steps.

In step S110, a virtual resource customized trigger instruction is received.

A virtual resource is an electronic resource stored in the form of data in an Internet or a computer device, such as an electronic gift in the form of a picture or video, an electronic animation, or the like.

Typically, virtual resources are pre-made. After a long period of design and development, the produced virtual resources are stored in the Internet or computer equipment for selection.

For example, when performing video interaction between live broadcasts, interaction of virtual resources is performed by selecting one or more transmissions among pre-made virtual resources.

FIG. 3 is a schematic diagram of an electronic gift when a live video is shown, according to an exemplary embodiment. As shown in FIG. 3, after the electronic gift is completed, each electronic gift will be displayed in the lower area of the terminal display interface, such as 301, in the form of a gift identification. When 301 in FIG. 3 is selected, that is, when the electronic gift is selected as a cake, the electronic gift is transmitted to the designated terminal.

The trigger instruction is a command that indicates the customization of the virtual resource.

At the user level, the virtual instruction can be customized by the trigger instruction, and the ideal virtual resource can be created in real time according to the requirement, so as to better meet the user's needs, improve the richness of the virtual resource, and enhance the user's participation.

It can be understood that the present invention can be applied to trigger the customization of the virtual resource in the live broadcast, and can also trigger the customization of the virtual resource in the game, or can trigger the customization of the virtual resource in the video session. The application scenario of the present invention is not limited.

For example, in the interface for performing video live broadcast in FIG. 3, by clicking the button 302 preset in the terminal interface, the custom production of the virtual resource is instructed.

In step S120, the loading of the image acquisition control is triggered according to the triggering instruction.

The image acquisition control is a set of instructions that control the acquisition process of the image acquisition hardware.

4 is a flow chart showing the operational steps of an image capture control, according to an exemplary embodiment. In FIG. 4, first, it is determined by the image acquisition control whether the terminal supports the specified image acquisition hardware. For example, when the image acquisition hardware is specified as the camera, it is determined whether the camera is compatible with the terminal. If it is compatible, the camera is turned on. If it is not supported, a prompt message is displayed on the display interface of the terminal. Then, by obtaining the image content in the specified image acquisition hardware. Again, the image content in the specified image acquisition hardware is optimized to generate a custom virtual resource that meets the requirements. Finally, preview the generated custom virtual assets.

In step S130, the opening of the specified image acquisition hardware is performed by the loading of the image acquisition control.

The specified image acquisition hardware is an image acquisition device that is specified by image acquisition to provide material for a custom virtual resource. For example, a camera, a scanner, and the like.

Typically, there are multiple image acquisition hardware that are signaled to the terminal. The collection of image content is more convenient by specifying one or more image acquisition hardware.

After the image acquisition control is loaded, the image acquisition control is controlled to control the opening of the specified image acquisition hardware, and the image is collected.

In step S140, extraction of the custom virtual resource is performed from the image content output by the specified image acquisition hardware.

The image content specified by the image acquisition hardware can be dynamic, static, or a dynamic image containing audio.

When extracting a custom virtual resource, the image content of a specific area may be selected from the image content output by the specified image acquisition hardware as a custom virtual resource, or the image content of the image content output by the specified image acquisition hardware may be beautified. As a custom virtual resource, the virtual content of the image content output by the specified image acquisition hardware may be extracted by other means.

Using the method as described above, after receiving the trigger instruction of the custom virtual resource, by loading the image acquisition control, controlling the specified image acquisition hardware to collect the image content, and then customizing the image content output from the image acquisition hardware. The extraction of virtual resources enables the user to customize the virtual resources according to actual needs, thereby eliminating the need to re-develop virtual resources through a long development cycle and greatly improving the richness of virtual resources.

Optionally, FIG. 5 is another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2. After the step S130, the method for implementing the virtual resource customization may further include the following steps.

In step S160, a background area is formed with respect to the image output area in the display interface with respect to the image acquisition hardware.

The image output area is a display area of the image content collected by the image acquisition hardware on the display interface.

The background area is a peripheral area other than the image output area of the image capturing hardware in the display interface of the terminal.

FIG. 6 is a schematic diagram of a background area shown in accordance with an exemplary embodiment. As shown in FIG. 6, the area 501 is an image output area of the image acquisition hardware in the display interface, and the area 502 is a background area.

In step S170, a translucent mask layer is generated in the background area. The background area is covered by a translucent mask layer so as not to affect the display of the original content in the display interface. The original content in the display interface may be a statically displayed image or a video image being played. The original content in the display interface is not limited herein, and the mask layer does not affect the screen to which the mask is masked. The running of the application.

For example, before the customization of the virtual resource is performed, the live broadcast of the video is performed in the display interface of the terminal. When the virtual resource is customized, the background area formed by the image output area of the image capture hardware is displayed in the display interface. A translucent mask layer is generated, and after the mask layer is generated, the live video is still played in the display interface of the terminal.

It can be understood that the image output area of the image acquisition hardware in the display interface is controlled by the image acquisition control. By modifying the instruction content in the image acquisition control, the image output area of the image acquisition hardware is displayed in the image output area. Size adjustment.

The image output area of the predetermined position size is set in advance in the display interface of the terminal relative to the image acquisition hardware, and the image content located in the predetermined area is extracted from the image content collected by the specified image acquisition hardware, and a custom virtual resource is generated and outputted in the image. The area displays the custom virtual resource, thereby ensuring the consistency of the size of the custom virtual resource and facilitating image processing.

By using the method as described above, a semi-transparent mask layer is generated by generating a translucent mask layer with respect to a background area formed by the image output area of the image acquisition hardware in the display interface, without affecting the playback of the original content. Display, thus avoiding the stability of interaction between terminals due to custom virtual resources.

Optionally, FIG. 7 is a description of the details of step S140, which may include the following steps, according to an exemplary embodiment.

In step S141, the control specifies that the image acquisition hardware performs image content acquisition on the real scene in which it is located.

The image acquisition control is used to control the image acquisition hardware to collect the image content of the real scene.

Optionally, the image acquisition hardware is specified as a camera, and when the camera is controlled to capture image content, the focus processing is automatically performed in advance.

For example, the preset autofocus time is 2 seconds. After step S130 is completed, 2 seconds of autofocus will be taken before shooting, to avoid blurring of the captured image due to unfinished focus, thereby affecting the custom virtual resource. quality.

In a specific exemplary embodiment, phase detection by Focus Pixels technology provides depth information to achieve continuous autofocus.

Optionally, when the image acquisition hardware is specified to collect the image content, the specified image acquisition hardware has an optical image anti-shake function to prevent the image from being blurred due to user misoperation, thereby affecting the quality of the customized virtual resource.

In step S142, the image content is optimized to generate a custom virtual resource.

The optimization process is to improve the image content output by the specified image acquisition hardware, for example, beautification, special effects, filter processing, and the like.

In a specific exemplary embodiment, the image content is rendered by OpenGL, and each pixel in the captured image content is coordinate-converted, cropped, added with color or material, and finally displayed to realize the beautification of the image content. deal with.

FIG. 8 is a flow chart showing an optimization process of image content, according to an exemplary embodiment. In FIG. 8, after the image content is output by the camera, on the one hand, the low-resolution image is used to display the real-time state of the image content collection on the display interface; on the other hand, the image data process is used to optimize the image data stream of the image output by the camera. deal with. Finally, after the optimization process is completed, the optimized image is replaced on the display interface to display the low-resolution image, thereby ensuring the smoothness of the image and ensuring the quality of the image content after the optimization process.

Using the method as described above, the specified image acquisition hardware is controlled to collect the image content of the real scene, and then the optimized processing generates the custom virtual resource, improves the richness of the virtual resource, and makes the customized virtual resource through the beautification process. More beautiful, improve the quality of custom virtual resources.

Optionally, FIG. 9 is a description of the details of step S142, which may include the following steps, according to an exemplary embodiment.

In step S1421, a texture is generated according to the image content;

Texture is the pattern detail of the surface of an object in an image.

In a specific exemplary embodiment, the image content is rendered by FBO (Frame Buffer Object) to generate a texture.

In step S1422, a plurality of shaders are controlled to perform texture effect processing in parallel to generate a custom virtual resource.

Special effects processing on textures mainly includes pixel color calculation, texture coordinate calculation, atomization calculation, etc., through special effects processing, to achieve different filter effects of image content.

A shader is an editable program that processes image content. By creating multiple shaders, controlling multiple shaders to execute in parallel, and performing texture effects processing, the efficiency of special effects processing is greatly improved.

FIG. 10 is a schematic diagram of image filter processing by GLProcessFramework, according to an exemplary embodiment. In the image filter processing, the processing process that consumes a large amount of resources is completed by OpenGL, and the texture effect processing is performed by the scalable tree structure of GLProcessFramework. GLProcessFramework abstracts textures, FBOs, and shaders. The texture abstraction is Engine class: Picture Engine, Movie Engine, Video Camera Engine, FBO, and shader abstraction is Filter class: Process Filter, Engine class is responsible for passing textures and driving processes. Filter is responsible for implementing the effect on its corresponding FBO. It can be finally drawn in GLView to display the effect or directly output the result. Both the Engine class and the Filter class can add other Filter classes by concatenation or string to superimpose effects or output multiple effects at the same time. This makes it possible to superimpose multi-shader effects and to quickly obtain large-sized, high-quality images after shooting.

By using the method as described above, when optimizing the processed image content, by controlling multiple shaders to perform texture special effect processing in parallel, while realizing virtual resource customization, while ensuring the quality of the customized virtual resource, Greatly improve the custom efficiency of virtual resources.

Optionally, during the image optimization process, due to the processing performance limitation of the terminal, there is still a long processing time when processing the super large picture, such as the time consumption of the image interception and cropping after image acquisition, etc., for these unavoidable time consumption. By using an interactive process to optimize, so that users can not perceive these time consumption in use.

For example, adding a shutter effect or a cut-off animation after image acquisition, and also replacing the high-fidelity image with a fast intercepted visual residual image, giving the user a real-time effect, which greatly reduces the user's image acquisition. The perceived time of waiting.

Optionally, FIG. 11 is a flowchart of another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2. As shown in FIG. 11, after step S140, the method for implementing virtual resource customization may include the following steps.

In step S210, a target user identifier specified for the custom virtual resource is obtained.

It can be understood that in a scenario such as a live broadcast or a game, a customized virtual resource is sent by specifying a target user identifier and corresponding to the specified target user identifier.

The target user ID can be specified when the virtual resource customization is triggered. It can also be specified after the custom virtual resource is created. It can also be specified by other opportunities. The target user ID is not specified here. Timing is limited.

In step S220, the transmission process of the customized virtual resource is performed according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.

The transfer processing of a custom virtual resource is to send a custom virtual resource. The transmission processing may be directly transmitted through a local area network, or may be transmitted in real time through a network, or may be other transmission processing methods.

In a specific exemplary embodiment, a terminal where multiple users are located establishes a connection through network communication, and then sends a customized virtual resource to a terminal corresponding to the target user identifier through network communication, so as to implement interaction of the customized virtual resource.

Optionally, before sending the customized virtual resource, the sending confirmation instruction of the customized virtual resource is received, so as to prevent the generated custom virtual resource from being sent to the terminal corresponding to the other target user identifier when the requirement is not met.

After the method of the above-mentioned method is used, after the custom virtual resource is generated, the target user identifier is sent to the corresponding terminal, thereby more specifically satisfying the interaction requirement between the users, and realizing the customization of the virtual resource. Increased the richness of virtual resources.

Alternatively, FIG. 12 is a description of the details of step S220 shown in accordance with the corresponding embodiment of FIG. This step S220 can include the following steps.

In step S221, HTTP transmission of the customized virtual resource is performed for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server.

HTTP (HyperText Transfer Protocol) is a standard for requesting and responding between a terminal and a server.

Upload custom virtual resources to the virtual resource server via HTTP.

In step S222, after the customized virtual resource is successfully uploaded, the push notification of the customized virtual resource is sent according to the target user identifier.

Generally, each terminal establishes a connection through network communication. When a terminal sends a customized virtual resource to another terminal, the terminal first uploads the customized virtual resource to the virtual resource server, and then the other terminal downloads the customized virtual resource from the virtual resource server. To achieve the interaction of custom virtual resources between terminals.

FIG. 13 is a flow chart showing interaction of a custom virtual resource, according to an exemplary embodiment. In Figure 13, A, B, and C are terminals in which multiple terminals in the live broadcast are located, where A is the terminal where the broadcast is located, and terminal A sends video streams and audio streams to terminal B and terminal C through the QTX server, thereby implementing terminal A. Live broadcast with terminal B and terminal C. When the terminal B sends the customized virtual resource to the terminal A, the custom virtual resource is uploaded to the HTTP server. After the customized virtual resource is successfully uploaded, the terminal B will notify the QTX server to send the customized virtual resource to the terminal A and the terminal C. Push notifications.

After the method of the above-mentioned method is used, after the custom virtual resource is generated, the generated virtual resource is uploaded to the virtual resource server, and then sent to the corresponding terminal according to the target user identifier, thereby better satisfying the interaction between the users. The requirement realizes the customization of the virtual resource, improves the richness of the virtual resource, and transmits the virtual resource through the virtual resource server when the virtual resource is sent, so that the operation of the original application in the terminal is not affected, and the terminal is guaranteed to operate. Stability.

Optionally, a method for implementing virtual resource customization is illustrated according to an exemplary embodiment. After step S220, the method for implementing virtual resource customization may include the following steps.

In step S310, in response to the successful transmission of the custom virtual resource, the deduction of the corresponding amount is performed in the associated account.

It should be noted that when the virtual resource is customized and sent, a certain amount of money is required for purchase.

A linked account is an account that sends custom virtual resources.

When a custom virtual resource is sent, the terminal will log in to the corresponding account, and then the customized virtual resource will be sent to the account.

In a specific exemplary embodiment, the amount corresponding to each successful transmission of the custom virtual resource is 1 yuan, and after each successful sending of the customized virtual resource, 1 yuan is deducted from the account for sending the customized virtual resource.

By using the method as described above, the paid service is realized by the customization of the virtual resource, and the economic income is better brought about while satisfying the user's demand.

FIG. 14 is a flowchart of another method for implementing virtual resource customization, according to an exemplary embodiment. As shown in FIG. 14, the method is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast. The method for implementing virtual resource customization may include the following steps.

In step S410, a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal is received.

Push notifications are reminder notifications for terminals that receive custom virtual resources. The push notification contains the address information of the custom virtual resource in the server.

The terminal is prompted to perform the download of the customized virtual resource by receiving the push notification.

In step S420, in response to the push notification, the corresponding custom virtual resource is downloaded from the virtual resource server.

After receiving the push notification, the terminal downloads the corresponding custom virtual resource from the virtual resource server.

In step S430, the display of the customized virtual resource is performed on the display interface of the terminal.

After the custom virtual resource download is completed, the customized virtual resource is displayed to implement the interaction of the customized virtual resource.

With the method as described above, after receiving the push notification by the live broadcast server for uploading the custom virtual resource for other terminals, the terminal downloads the corresponding custom resource from the virtual resource server, and automatically sends the self-sentence to other terminals in the live broadcast. Defining virtual resources for display improves the richness of virtual resources when interacting between terminals in the live broadcast, and better satisfies the interaction requirements between terminals.

The following describes the method for implementing virtual resource customization as described above in conjunction with a specific application scenario. The method of implementing virtual resource customization runs in the terminal.

FIG. 15 is a schematic diagram of a scenario for implementing virtual resource customization in a live broadcast room. As shown in FIG. 15, the user clicks the custom gift button in the terminal interface to display a gift recognition and extraction interface above the video layer of the live broadcast. The interface does not affect the live broadcast process; after the camera is aimed at the target object for 2 seconds Successfully extracting the gift image; the terminal optimizes the gift image to generate a custom gift; previews the custom gift in the terminal interface; after the user determines that the custom gift meets the requirements and confirms, the custom gift is uploaded HTTP After the confirmation upload is completed, the other terminals in the live broadcast room send a push notification of the customized gift through the QTX server; after receiving the push notification of the custom gift, the other terminals in the live broadcast download the corresponding information from the HTTP server according to the push notification. Custom gift and show it.

The following is an apparatus embodiment of the present invention, which may be used to implement the foregoing method embodiment for implementing virtual resource customization. For details not disclosed in the device embodiment of the present invention, please refer to the method embodiment of the present invention for implementing virtual resource customization.

FIG. 16 is a block diagram of a device for implementing virtual resource customization, including but not limited to: a trigger instruction receiving module 110, a control loading trigger module 120, an image capturing hardware opening module 130, and a virtual resource, according to an exemplary embodiment. The module 140 is extracted.

The trigger instruction receiving module 110 is configured to receive a virtual resource custom triggering instruction;

The control loading triggering module 120 is configured to trigger loading of the image capturing control according to the triggering instruction;

The image capturing hardware opening module 130 is configured to perform opening of the specified image capturing hardware by loading the image capturing control;

The virtual resource extraction module 140 is configured to perform extraction of the customized virtual resource from the image content output by the specified image collection hardware.

The implementation process of the functions and functions of the modules in the foregoing device is specifically described in the implementation process of the corresponding steps in the method for implementing the virtual resource customization, and details are not described herein.

Optionally, FIG. 17 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16. The apparatus for implementing virtual resource customization according to the embodiment of FIG. 16 further includes, but is not limited to, a background area formation. Module 160 and mask layer generation module 170.

a background area forming module 160, configured to form a background area with respect to the image output area in the display interface with respect to the image capturing hardware;

The mask layer generating module 170 is configured to generate a translucent mask layer in the background area.

Optionally, the background area forming module 160 is specifically configured to form a background area in an image output area in the live video display interface with respect to the image capturing hardware.

Optionally, the trigger instruction receiving module 110 is specifically configured to: receive a virtual resource custom triggering instruction during the live video display process.

Optionally, as shown in FIG. 18, the virtual resource extraction module 140 shown in FIG. 16 includes, but is not limited to, an image acquisition unit 141 and an image optimization unit 142.

The image collection unit 141 is configured to control the collection of the image content by the specified image acquisition hardware on the real scene;

The image optimization unit 142 is configured to perform optimization processing on the image content to generate a custom virtual resource.

Alternatively, as shown in FIG. 19, the image optimization unit 142 shown in FIG. 18 includes, but is not limited to, a texture generation sub-unit 1421 and a special effect processing sub-unit 1422.

a texture generation sub-unit 1421, configured to generate a texture according to the image content;

The special effect processing sub-unit 1422 is configured to control the plurality of shaders to perform the special effect processing of the texture in parallel to generate a custom virtual resource.

Optionally, FIG. 20 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16. As shown in FIG. 20, the apparatus for implementing virtual resource customization shown in FIG. 16 further includes but not It is limited to: target user identity obtaining module 210 and resource transmission module 220.

The target user identifier obtaining module 210 is configured to acquire a target user identifier specified for the custom virtual resource.

The resource transmission module 220 is configured to perform the transmission process of the customized virtual resource according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.

Optionally, as shown in FIG. 21, the resource transmission module 220 shown in FIG. 20 includes, but is not limited to, a resource uploading unit 221 and a push notification sending unit 222.

The resource uploading unit 221 is configured to perform HTTP transmission of the customized virtual resource for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server;

The push notification sending unit 222 is configured to send a push notification of the custom virtual resource according to the target user identifier after the custom virtual resource is successfully uploaded.

FIG. 22 is a block diagram of another apparatus for implementing virtual resource customization according to an exemplary embodiment, where the apparatus is applied to a terminal between live broadcasts, and the terminal performs video data transmission through a live broadcast server and other terminals in the live broadcast. The method includes a but not limited to: a push notification receiving module 410, a virtual resource downloading module 420, and a resource displaying module 430.

The push notification receiving module 410 is configured to receive a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal;

The virtual resource downloading module 420 is configured to download a corresponding custom virtual resource from the virtual resource server in response to the push notification.

The resource display module 430 is configured to perform the display of the customized virtual resource on a display interface of the terminal.

FIG. 23 is a block diagram of a terminal 100, according to an exemplary embodiment. The terminal 100 may be the terminal 10 described in the above-described implementation environment.

Referring to FIG. 23, the terminal 100 may include one or more of the following components: a processing component 101, a memory 102, a power component 103, a multimedia component 104, an audio component 105, a sensor component 107, and a communication component 108. The above components are not all necessary, and the terminal 100 may add other components or reduce some components according to the requirements of the functions, which is not limited in this embodiment.

Processing component 101 typically controls the overall operation of terminal 100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations, and the like. Processing component 101 can include one or more processors 109 to execute instructions to perform all or part of the steps described above. Moreover, processing component 101 can include one or more modules to facilitate interaction between component 101 and other components. For example, processing component 101 can include a multimedia module to facilitate interaction between multimedia component 104 and processing component 101.

The memory 102 is configured to store various types of data to support operation at the terminal 100. Examples of such data include instructions for any application or method operating on terminal 100. The memory 102 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as SRAM (Static Random Access Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory) Erase programmable read-only memory, EPROM (Erasable Programmable Read Only Memory), PROM (Programmable Read-Only Memory), ROM (Read-Only Memory) Read memory), magnetic memory, flash memory, disk or optical disk. Also stored in the memory 102 is one or more modules configured to be executed by the one or more processors 109 to complete FIGS. 2, 5, 7, 9, 11, and 12 or all or part of the steps in any of the methods shown in FIG.

Power component 103 provides power to various components of terminal 100. Power component 103 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for terminal 100.

The multimedia component 104 includes a screen that provides an output interface between the terminal 100 and a user. In some embodiments, the screen may include an LCD (Liquid Crystal Display) and a TP (Touch Panel). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.

The audio component 105 is configured to output and/or input an audio signal. For example, the audio component 105 includes a microphone that is configured to receive an external audio signal when the terminal 100 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in memory 102 or transmitted via communication component 108. In some embodiments, the audio component 105 also includes a speaker for outputting an audio signal.

Sensor assembly 107 includes one or more sensors for providing terminal 100 with various aspects of status assessment. For example, the sensor assembly 107 can detect the open/closed state of the terminal 100, the relative positioning of the components, and the sensor assembly 107 can also detect a change in position of the terminal 100 or a component of the terminal 100 and a temperature change of the terminal 100. In some embodiments, the sensor assembly 107 can also include a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 108 is configured to facilitate wired or wireless communication between terminal 100 and other devices. The terminal 100 can access a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity), 2G or 3G, or a combination thereof. In an exemplary embodiment, communication component 108 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 108 further includes an NFC (Near Field Communication) module to facilitate short range communication. For example, the NFC module can be based on RFID (Radio Frequency Identification) technology, IrDA (Infrared Data Association) technology, UWB (Ultra-Wideband) technology, BT (Bluetooth) technology and others. Technology to achieve.

In an exemplary embodiment, the terminal 100 may be configured by one or more ASICs (Application Specific Integrated Circuits), DSP (Digital Signal Processing), and PLD (Programmable Logic Device). ), FPGA (Field-Programmable Gate Array), controller, microcontroller, microprocessor or other electronic component implementation for performing the above method.

The specific manner in which the processor of the terminal in this embodiment performs the operation has been described in detail in the embodiment of the method for implementing the virtual resource customization, and will not be explained in detail herein.

Optionally, the present invention further provides an intelligent terminal, which performs all or part of the method for implementing virtual resource customization as shown in any of FIG. 2, FIG. 5, FIG. 7, FIG. 9, FIG. 11, FIG. 12, and FIG. step. The device includes:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any of the above embodiments .

The specific manner in which the processor of the apparatus in this embodiment performs the operations has been described in detail in the method embodiment for implementing the virtual resource customization, and will not be described in detail herein.

In an exemplary embodiment, a storage medium is also provided, which is a computer readable storage medium, such as a temporary and non-transitory computer readable storage medium including instructions. The storage medium stores a computer program executable by the processor 109 of the terminal 100 to perform the above-described method of implementing virtual resource customization.

It is to be understood that the invention is not limited to the details of the details of The scope of the invention is limited only by the appended claims.

Claims

A method for implementing virtual resource customization, characterized in that the method comprises:

Receiving a virtual resource custom trigger instruction;

Triggering loading of the image collection control according to the triggering instruction;

Opening the specified image acquisition hardware by loading the image capture control;

Extracting a custom virtual resource from image content output by the specified image acquisition hardware.
The method according to claim 1, wherein after the step of specifying the opening of the image capturing hardware by the loading of the image capturing control, the method further comprises:

Forming a background area with respect to the image output area in the display interface with respect to the image acquisition hardware;

A translucent mask layer is created in the background region.
The method according to claim 2, wherein the forming an image area in the image output area in the display interface with respect to the image acquisition hardware comprises:

A background area is formed in the image output area in the live video display interface with respect to the image acquisition hardware.
The method according to claim 1, wherein the step of extracting a custom virtual resource from the image content output by the specified image acquisition hardware comprises:

Controlling, by the specified image acquisition hardware, the image content of the real scene to be collected;

Optimizing the image content to generate a custom virtual resource.
The method according to claim 4, wherein the step of performing optimization processing on the image content to generate a custom virtual resource comprises:

Generating a texture according to the image content;

Controlling multiple shaders to perform the effect processing of the texture in parallel to generate a custom virtual resource.
The method according to claim 1, wherein after the step of extracting a custom virtual resource from the image content output by the specified image acquisition hardware, the method further comprises:

Obtaining a target user identifier specified for the custom virtual resource;

And performing the transmission processing of the customized virtual resource according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.
The method according to claim 6, wherein the performing the transmission processing of the custom virtual resource according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier The steps include:

Performing HTTP transmission of the customized virtual resource for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server;

After the customized virtual resource is successfully uploaded, the push notification of the customized virtual resource is sent according to the target user identifier.
The method according to claim 1, wherein the receiving the virtual resource customized triggering instruction comprises:

During the live video display process, a virtual resource custom trigger instruction is received.
A method for implementing virtual resource customization, wherein the method is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast, the method includes:

Receiving, by the live broadcast server, a push notification sent by uploading a custom virtual resource to another terminal;

Responding to the push notification, downloading a corresponding custom virtual resource from the virtual resource server;

Displaying the customized virtual resource on the display interface of the terminal.
An apparatus for implementing virtual resource customization, wherein the apparatus comprises:

The trigger instruction receiving module is configured to receive a trigger instruction of the virtual resource customization;

a control loading triggering module, configured to trigger loading of the image capturing control according to the triggering instruction;

An image capturing hardware opening module is configured to perform opening of the specified image capturing hardware by loading the image capturing control;

And a virtual resource extraction module, configured to extract a custom virtual resource from the image content output by the specified image collection hardware.
The device according to claim 10, wherein the device further comprises:

a background area forming module, configured to form a background area with respect to the image output area of the image capturing hardware in the display interface;

A mask layer generating module is configured to generate a translucent mask layer in the background area.
The device according to claim 10, wherein the virtual resource extraction module comprises:

An image acquisition unit, configured to control the collection of image content by the specified image acquisition hardware on a real scene;

An image optimization unit is configured to optimize the image content to generate a custom virtual resource.
The apparatus according to claim 12, wherein said image optimization unit comprises:

a texture generation subunit, configured to generate a texture according to the image content;

The special effect processing sub-unit is configured to control multiple shaders to perform the special effect processing of the texture in parallel to generate a custom virtual resource.
A terminal, wherein the terminal comprises:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform as claimed in any one of claims 1-9 The method described.
A computer readable storage medium having stored thereon a computer program, wherein the computer program is executed by a processor to implement a method of implementing virtual resource customization according to any one of claims 1-9.