WO2019001229A1 - Procédé et dispositif de réalisation d'une personnalisation de ressources virtuelles - Google Patents

Procédé et dispositif de réalisation d'une personnalisation de ressources virtuelles Download PDF

Info

Publication number
WO2019001229A1
WO2019001229A1 PCT/CN2018/089941 CN2018089941W WO2019001229A1 WO 2019001229 A1 WO2019001229 A1 WO 2019001229A1 CN 2018089941 W CN2018089941 W CN 2018089941W WO 2019001229 A1 WO2019001229 A1 WO 2019001229A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual resource
image
custom
terminal
image acquisition
Prior art date
Application number
PCT/CN2018/089941
Other languages
English (en)
Chinese (zh)
Inventor
刘金来
胡耀斌
刘冬冬
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2019001229A1 publication Critical patent/WO2019001229A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543—Billing, e.g. for subscription services
    • H04N21/25435—Billing, e.g. for subscription services involving characteristics of content or additional data, e.g. video resolution or the amount of advertising
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics

Definitions

  • the present invention relates to the field of Internet application technologies, and in particular, to a method and apparatus for implementing virtual resource customization, a terminal, and a computer readable storage medium.
  • the live broadcast room provides users with an exchange channel, and each user interacts through the live broadcast room.
  • a user in the live broadcast room can be used as an anchor to post video, audio, and other information in the live broadcast room.
  • Other users in the live room can view this information as the viewer of the anchor.
  • the audience is interested in these, they can give virtual gifts such as electronic gifts to the anchor.
  • the live room presents the virtual gifts presented to the anchor, thereby better realizing the interaction between the users.
  • the virtual resources are pre-set, and the user can only select among the preset virtual resources, that is, the existing virtual resources can only be used for sending and sharing, and the existing virtual
  • the resource form is not rich enough, and the virtual resource cannot be customized.
  • the development cycle of the virtual resource is long and the update speed is slow, which greatly affects the enthusiasm of the user.
  • the present invention provides a method and device for realizing the virtual resource customization.
  • the present disclosure provides a method for implementing virtual resource customization, including:
  • Extracting a custom virtual resource from image content output by the specified image acquisition hardware Extracting a custom virtual resource from image content output by the specified image acquisition hardware.
  • the method further includes:
  • a translucent mask layer is created in the background region.
  • the forming an image area in the image output area in the display interface with respect to the image capturing hardware includes:
  • a background area is formed in the image output area in the live video display interface with respect to the image acquisition hardware.
  • the step of performing extraction of the customized virtual resource from the image content output by the specified image collection hardware includes:
  • the step of performing optimization processing on the image content to generate a customized virtual resource includes:
  • the method further includes:
  • the step of performing the transmission process of the custom virtual resource according to the target user identifier, and the step of sharing the customized virtual resource to the terminal corresponding to the target user identifier includes:
  • the push notification of the customized virtual resource is sent according to the target user identifier.
  • the receiving the virtual resource custom triggering instruction includes:
  • a virtual resource custom trigger instruction is received.
  • the present invention provides another method for implementing virtual resource customization, the method is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast, the method includes:
  • the present disclosure further provides an apparatus for implementing virtual resource customization, including:
  • the trigger instruction receiving module is configured to receive a trigger instruction of the virtual resource customization
  • control loading triggering module configured to trigger loading of the image capturing control according to the triggering instruction
  • An image capturing hardware opening module is configured to perform opening of the specified image capturing hardware by loading the image capturing control
  • a virtual resource extraction module configured to extract a custom virtual resource from the image content output by the specified image collection hardware.
  • the device further includes:
  • a background area forming module configured to form a background area with respect to the image output area of the image capturing hardware in the display interface
  • a mask layer generating module is configured to generate a translucent mask layer in the background area.
  • the virtual resource extraction module includes:
  • An image acquisition unit configured to control the collection of image content by the specified image acquisition hardware on a real scene
  • An image optimization unit is configured to optimize the image content to generate a custom virtual resource.
  • the image optimization unit includes:
  • a texture generation subunit configured to generate a texture according to the image content
  • the special effect processing sub-unit is configured to control multiple shaders to perform the special effect processing of the texture in parallel to generate a custom virtual resource.
  • the present disclosure further provides another device for implementing virtual resource customization, where the device is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast.
  • the device includes:
  • a notification receiving module configured to receive a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal
  • a resource downloading module configured to download a corresponding custom virtual resource from the virtual resource server in response to the push notification
  • a resource display module configured to display the customized virtual resource on a display interface of the terminal.
  • the disclosure provides a terminal, where the terminal includes:
  • At least one processor At least one processor
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of implementing virtual resource customization described above.
  • the present disclosure also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the method of virtual resource customization described above.
  • the virtual resource custom triggering instruction is received, the image capturing control is triggered according to the triggering instruction, the specified image capturing hardware is turned on by the loading of the image capturing control, and the image outputted from the specified image capturing hardware is outputted.
  • the content is extracted from the customized virtual resources, so that the virtual resources cannot be re-developed through a long development cycle, and the virtual resources can be customized according to actual needs, thereby greatly improving the richness of the virtual resources.
  • FIG. 1 is a schematic diagram of an implementation environment in accordance with an embodiment of the present invention.
  • FIG. 2 is a flow chart of a method for implementing virtual resource customization, according to an exemplary embodiment.
  • FIG. 3 is a schematic diagram of an electronic gift, according to an exemplary embodiment.
  • FIG. 4 is a flow chart showing the operational steps of an image capture control, according to an exemplary embodiment.
  • FIG. 5 is another method of implementing virtual resource customization according to the corresponding embodiment of FIG.
  • FIG. 6 is a schematic diagram of a background area shown in accordance with an exemplary embodiment.
  • FIG. 7 is a specific implementation flowchart of step S140 in the method for implementing virtual resource customization according to the embodiment shown in FIG. 2 .
  • FIG. 8 is a flow chart showing an optimization process of image content, according to an exemplary embodiment.
  • FIG. 9 is a specific implementation flowchart of step S142 in the method for implementing virtual resource customization according to the embodiment shown in FIG. 7.
  • FIG. 10 is a schematic diagram of image filter processing by GLProcessFramework, according to an exemplary embodiment.
  • FIG. 11 is a flowchart of another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2.
  • FIG. 12 is a specific implementation flowchart of step S220 in the method for implementing virtual resource customization according to the embodiment shown in FIG.
  • FIG. 13 is a flow chart showing interaction of a custom virtual resource, according to an exemplary embodiment.
  • FIG. 14 is a flowchart of another method for implementing virtual resource customization, according to an exemplary embodiment.
  • FIG. 15 is a schematic diagram of a scenario for implementing virtual resource customization in a live broadcast room.
  • FIG. 16 is a block diagram of an apparatus for implementing virtual resource customization, according to an exemplary embodiment.
  • FIG. 17 is a block diagram of another apparatus for implementing virtual resource customization according to the embodiment of FIG. 16.
  • FIG. 18 is a block diagram of the virtual resource extraction module 140 shown in the corresponding embodiment of FIG. 16.
  • FIG. 19 is a block diagram of an image optimization unit 142 shown in the corresponding embodiment of FIG. 18.
  • FIG. 20 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16.
  • FIG. 21 is a block diagram of the resource transfer module 220 in the device for customizing the virtual resource shown in the embodiment of FIG. 20.
  • FIG. 22 is a block diagram of another apparatus for implementing virtual resource customization, according to an exemplary embodiment.
  • FIG. 23 is a structural block diagram of a terminal according to an exemplary embodiment.
  • FIG. 1 is a schematic diagram of an implementation environment in accordance with an embodiment of the present invention. As shown in FIG. 1, the implementation environment includes a terminal 10 and a server 20 that performs data transmission with the terminal 10.
  • the manner of association between the terminal 10 and the server 20 includes, but is not limited to, a data association manner between the terminal and the wireless network, such as WiFi, and the like.
  • the specific association manner is not limited by this embodiment.
  • the terminal 10 uploads the customized virtual resource to the server 20.
  • the terminal 10 can be a computer device such as a smart phone or a computer.
  • the specific implementation is not limited by this embodiment.
  • FIG. 2 is a flow chart of a method for implementing virtual resource customization, according to an exemplary embodiment. As shown in FIG. 2, the method for implementing virtual resource customization may include the following steps.
  • step S110 a virtual resource customized trigger instruction is received.
  • a virtual resource is an electronic resource stored in the form of data in an Internet or a computer device, such as an electronic gift in the form of a picture or video, an electronic animation, or the like.
  • virtual resources are pre-made. After a long period of design and development, the produced virtual resources are stored in the Internet or computer equipment for selection.
  • interaction of virtual resources is performed by selecting one or more transmissions among pre-made virtual resources.
  • FIG. 3 is a schematic diagram of an electronic gift when a live video is shown, according to an exemplary embodiment.
  • each electronic gift will be displayed in the lower area of the terminal display interface, such as 301, in the form of a gift identification.
  • 301 in FIG. 3 is selected, that is, when the electronic gift is selected as a cake, the electronic gift is transmitted to the designated terminal.
  • the trigger instruction is a command that indicates the customization of the virtual resource.
  • the virtual instruction can be customized by the trigger instruction, and the ideal virtual resource can be created in real time according to the requirement, so as to better meet the user's needs, improve the richness of the virtual resource, and enhance the user's participation.
  • the present invention can be applied to trigger the customization of the virtual resource in the live broadcast, and can also trigger the customization of the virtual resource in the game, or can trigger the customization of the virtual resource in the video session.
  • the application scenario of the present invention is not limited.
  • step S120 the loading of the image acquisition control is triggered according to the triggering instruction.
  • the image acquisition control is a set of instructions that control the acquisition process of the image acquisition hardware.
  • FIG. 4 is a flow chart showing the operational steps of an image capture control, according to an exemplary embodiment.
  • the image acquisition control determines whether the terminal supports the specified image acquisition hardware. For example, when the image acquisition hardware is specified as the camera, it is determined whether the camera is compatible with the terminal. If it is compatible, the camera is turned on. If it is not supported, a prompt message is displayed on the display interface of the terminal. Then, by obtaining the image content in the specified image acquisition hardware. Again, the image content in the specified image acquisition hardware is optimized to generate a custom virtual resource that meets the requirements. Finally, preview the generated custom virtual assets.
  • step S130 the opening of the specified image acquisition hardware is performed by the loading of the image acquisition control.
  • the specified image acquisition hardware is an image acquisition device that is specified by image acquisition to provide material for a custom virtual resource.
  • a camera For example, a camera, a scanner, and the like.
  • image acquisition hardware there are multiple image acquisition hardware that are signaled to the terminal.
  • the collection of image content is more convenient by specifying one or more image acquisition hardware.
  • the image acquisition control is controlled to control the opening of the specified image acquisition hardware, and the image is collected.
  • step S140 extraction of the custom virtual resource is performed from the image content output by the specified image acquisition hardware.
  • the image content specified by the image acquisition hardware can be dynamic, static, or a dynamic image containing audio.
  • the image content of a specific area may be selected from the image content output by the specified image acquisition hardware as a custom virtual resource, or the image content of the image content output by the specified image acquisition hardware may be beautified.
  • the virtual content of the image content output by the specified image acquisition hardware may be extracted by other means.
  • FIG. 5 is another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2.
  • the method for implementing the virtual resource customization may further include the following steps.
  • step S160 a background area is formed with respect to the image output area in the display interface with respect to the image acquisition hardware.
  • the image output area is a display area of the image content collected by the image acquisition hardware on the display interface.
  • the background area is a peripheral area other than the image output area of the image capturing hardware in the display interface of the terminal.
  • FIG. 6 is a schematic diagram of a background area shown in accordance with an exemplary embodiment.
  • the area 501 is an image output area of the image acquisition hardware in the display interface
  • the area 502 is a background area.
  • a translucent mask layer is generated in the background area.
  • the background area is covered by a translucent mask layer so as not to affect the display of the original content in the display interface.
  • the original content in the display interface may be a statically displayed image or a video image being played.
  • the original content in the display interface is not limited herein, and the mask layer does not affect the screen to which the mask is masked. The running of the application.
  • the live broadcast of the video is performed in the display interface of the terminal.
  • the background area formed by the image output area of the image capture hardware is displayed in the display interface.
  • a translucent mask layer is generated, and after the mask layer is generated, the live video is still played in the display interface of the terminal.
  • the image output area of the image acquisition hardware in the display interface is controlled by the image acquisition control.
  • the image output area of the image acquisition hardware is displayed in the image output area. Size adjustment.
  • the image output area of the predetermined position size is set in advance in the display interface of the terminal relative to the image acquisition hardware, and the image content located in the predetermined area is extracted from the image content collected by the specified image acquisition hardware, and a custom virtual resource is generated and outputted in the image.
  • the area displays the custom virtual resource, thereby ensuring the consistency of the size of the custom virtual resource and facilitating image processing.
  • a semi-transparent mask layer is generated by generating a translucent mask layer with respect to a background area formed by the image output area of the image acquisition hardware in the display interface, without affecting the playback of the original content. Display, thus avoiding the stability of interaction between terminals due to custom virtual resources.
  • FIG. 7 is a description of the details of step S140, which may include the following steps, according to an exemplary embodiment.
  • step S141 the control specifies that the image acquisition hardware performs image content acquisition on the real scene in which it is located.
  • the image acquisition control is used to control the image acquisition hardware to collect the image content of the real scene.
  • the image acquisition hardware is specified as a camera, and when the camera is controlled to capture image content, the focus processing is automatically performed in advance.
  • the preset autofocus time is 2 seconds. After step S130 is completed, 2 seconds of autofocus will be taken before shooting, to avoid blurring of the captured image due to unfinished focus, thereby affecting the custom virtual resource. quality.
  • phase detection by Focus Pixels technology provides depth information to achieve continuous autofocus.
  • the specified image acquisition hardware has an optical image anti-shake function to prevent the image from being blurred due to user misoperation, thereby affecting the quality of the customized virtual resource.
  • step S142 the image content is optimized to generate a custom virtual resource.
  • the optimization process is to improve the image content output by the specified image acquisition hardware, for example, beautification, special effects, filter processing, and the like.
  • the image content is rendered by OpenGL, and each pixel in the captured image content is coordinate-converted, cropped, added with color or material, and finally displayed to realize the beautification of the image content. deal with.
  • FIG. 8 is a flow chart showing an optimization process of image content, according to an exemplary embodiment.
  • the low-resolution image is used to display the real-time state of the image content collection on the display interface; on the other hand, the image data process is used to optimize the image data stream of the image output by the camera. deal with.
  • the optimized image is replaced on the display interface to display the low-resolution image, thereby ensuring the smoothness of the image and ensuring the quality of the image content after the optimization process.
  • the specified image acquisition hardware is controlled to collect the image content of the real scene, and then the optimized processing generates the custom virtual resource, improves the richness of the virtual resource, and makes the customized virtual resource through the beautification process. More beautiful, improve the quality of custom virtual resources.
  • FIG. 9 is a description of the details of step S142, which may include the following steps, according to an exemplary embodiment.
  • step S1421 a texture is generated according to the image content
  • Texture is the pattern detail of the surface of an object in an image.
  • the image content is rendered by FBO (Frame Buffer Object) to generate a texture.
  • FBO Frazier Object
  • step S1422 a plurality of shaders are controlled to perform texture effect processing in parallel to generate a custom virtual resource.
  • Special effects processing on textures mainly includes pixel color calculation, texture coordinate calculation, atomization calculation, etc., through special effects processing, to achieve different filter effects of image content.
  • a shader is an editable program that processes image content. By creating multiple shaders, controlling multiple shaders to execute in parallel, and performing texture effects processing, the efficiency of special effects processing is greatly improved.
  • FIG. 10 is a schematic diagram of image filter processing by GLProcessFramework, according to an exemplary embodiment.
  • the processing process that consumes a large amount of resources is completed by OpenGL, and the texture effect processing is performed by the scalable tree structure of GLProcessFramework.
  • GLProcessFramework abstracts textures, FBOs, and shaders.
  • the texture abstraction is Engine class: Picture Engine, Movie Engine, Video Camera Engine, FBO, and shader abstraction is Filter class: Process Filter, Engine class is responsible for passing textures and driving processes. Filter is responsible for implementing the effect on its corresponding FBO. It can be finally drawn in GLView to display the effect or directly output the result.
  • Both the Engine class and the Filter class can add other Filter classes by concatenation or string to superimpose effects or output multiple effects at the same time. This makes it possible to superimpose multi-shader effects and to quickly obtain large-sized, high-quality images after shooting.
  • FIG. 11 is a flowchart of another method for implementing virtual resource customization according to the corresponding embodiment of FIG. 2. As shown in FIG. 11, after step S140, the method for implementing virtual resource customization may include the following steps.
  • step S210 a target user identifier specified for the custom virtual resource is obtained.
  • a customized virtual resource is sent by specifying a target user identifier and corresponding to the specified target user identifier.
  • the target user ID can be specified when the virtual resource customization is triggered. It can also be specified after the custom virtual resource is created. It can also be specified by other opportunities. The target user ID is not specified here. Timing is limited.
  • step S220 the transmission process of the customized virtual resource is performed according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.
  • the transfer processing of a custom virtual resource is to send a custom virtual resource.
  • the transmission processing may be directly transmitted through a local area network, or may be transmitted in real time through a network, or may be other transmission processing methods.
  • a terminal where multiple users are located establishes a connection through network communication, and then sends a customized virtual resource to a terminal corresponding to the target user identifier through network communication, so as to implement interaction of the customized virtual resource.
  • the sending confirmation instruction of the customized virtual resource is received, so as to prevent the generated custom virtual resource from being sent to the terminal corresponding to the other target user identifier when the requirement is not met.
  • the target user identifier is sent to the corresponding terminal, thereby more specifically satisfying the interaction requirement between the users, and realizing the customization of the virtual resource. Increased the richness of virtual resources.
  • FIG. 12 is a description of the details of step S220 shown in accordance with the corresponding embodiment of FIG.
  • This step S220 can include the following steps.
  • step S221 HTTP transmission of the customized virtual resource is performed for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server.
  • HTTP HyperText Transfer Protocol
  • step S222 after the customized virtual resource is successfully uploaded, the push notification of the customized virtual resource is sent according to the target user identifier.
  • each terminal establishes a connection through network communication.
  • the terminal When a terminal sends a customized virtual resource to another terminal, the terminal first uploads the customized virtual resource to the virtual resource server, and then the other terminal downloads the customized virtual resource from the virtual resource server. To achieve the interaction of custom virtual resources between terminals.
  • FIG. 13 is a flow chart showing interaction of a custom virtual resource, according to an exemplary embodiment.
  • A, B, and C are terminals in which multiple terminals in the live broadcast are located, where A is the terminal where the broadcast is located, and terminal A sends video streams and audio streams to terminal B and terminal C through the QTX server, thereby implementing terminal A.
  • the terminal B sends the customized virtual resource to the terminal A
  • the custom virtual resource is uploaded to the HTTP server.
  • the terminal B will notify the QTX server to send the customized virtual resource to the terminal A and the terminal C. Push notifications.
  • the generated virtual resource is uploaded to the virtual resource server, and then sent to the corresponding terminal according to the target user identifier, thereby better satisfying the interaction between the users.
  • the requirement realizes the customization of the virtual resource, improves the richness of the virtual resource, and transmits the virtual resource through the virtual resource server when the virtual resource is sent, so that the operation of the original application in the terminal is not affected, and the terminal is guaranteed to operate. Stability.
  • step S220 a method for implementing virtual resource customization is illustrated according to an exemplary embodiment.
  • the method for implementing virtual resource customization may include the following steps.
  • step S310 in response to the successful transmission of the custom virtual resource, the deduction of the corresponding amount is performed in the associated account.
  • a linked account is an account that sends custom virtual resources.
  • the terminal When a custom virtual resource is sent, the terminal will log in to the corresponding account, and then the customized virtual resource will be sent to the account.
  • the amount corresponding to each successful transmission of the custom virtual resource is 1 yuan, and after each successful sending of the customized virtual resource, 1 yuan is deducted from the account for sending the customized virtual resource.
  • the paid service is realized by the customization of the virtual resource, and the economic income is better brought about while satisfying the user's demand.
  • FIG. 14 is a flowchart of another method for implementing virtual resource customization, according to an exemplary embodiment. As shown in FIG. 14, the method is applied to a terminal in a live broadcast, and the terminal performs video data transmission by using a live broadcast server and other terminals in the live broadcast.
  • the method for implementing virtual resource customization may include the following steps.
  • step S410 a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal is received.
  • Push notifications are reminder notifications for terminals that receive custom virtual resources.
  • the push notification contains the address information of the custom virtual resource in the server.
  • the terminal is prompted to perform the download of the customized virtual resource by receiving the push notification.
  • step S420 in response to the push notification, the corresponding custom virtual resource is downloaded from the virtual resource server.
  • the terminal After receiving the push notification, the terminal downloads the corresponding custom virtual resource from the virtual resource server.
  • step S430 the display of the customized virtual resource is performed on the display interface of the terminal.
  • the customized virtual resource is displayed to implement the interaction of the customized virtual resource.
  • the terminal downloads the corresponding custom resource from the virtual resource server, and automatically sends the self-sentence to other terminals in the live broadcast.
  • Defining virtual resources for display improves the richness of virtual resources when interacting between terminals in the live broadcast, and better satisfies the interaction requirements between terminals.
  • the following describes the method for implementing virtual resource customization as described above in conjunction with a specific application scenario.
  • the method of implementing virtual resource customization runs in the terminal.
  • FIG. 15 is a schematic diagram of a scenario for implementing virtual resource customization in a live broadcast room.
  • the user clicks the custom gift button in the terminal interface to display a gift recognition and extraction interface above the video layer of the live broadcast.
  • the interface does not affect the live broadcast process; after the camera is aimed at the target object for 2 seconds Successfully extracting the gift image; the terminal optimizes the gift image to generate a custom gift; previews the custom gift in the terminal interface; after the user determines that the custom gift meets the requirements and confirms, the custom gift is uploaded HTTP After the confirmation upload is completed, the other terminals in the live broadcast room send a push notification of the customized gift through the QTX server; after receiving the push notification of the custom gift, the other terminals in the live broadcast download the corresponding information from the HTTP server according to the push notification. Custom gift and show it.
  • FIG. 16 is a block diagram of a device for implementing virtual resource customization, including but not limited to: a trigger instruction receiving module 110, a control loading trigger module 120, an image capturing hardware opening module 130, and a virtual resource, according to an exemplary embodiment.
  • the module 140 is extracted.
  • the trigger instruction receiving module 110 is configured to receive a virtual resource custom triggering instruction
  • the control loading triggering module 120 is configured to trigger loading of the image capturing control according to the triggering instruction
  • the image capturing hardware opening module 130 is configured to perform opening of the specified image capturing hardware by loading the image capturing control;
  • the virtual resource extraction module 140 is configured to perform extraction of the customized virtual resource from the image content output by the specified image collection hardware.
  • FIG. 17 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16.
  • the apparatus for implementing virtual resource customization according to the embodiment of FIG. 16 further includes, but is not limited to, a background area formation.
  • Module 160 and mask layer generation module 170 are also included in the apparatus for implementing virtual resource customization according to the embodiment of FIG. 16.
  • a background area forming module 160 configured to form a background area with respect to the image output area in the display interface with respect to the image capturing hardware
  • the mask layer generating module 170 is configured to generate a translucent mask layer in the background area.
  • the background area forming module 160 is specifically configured to form a background area in an image output area in the live video display interface with respect to the image capturing hardware.
  • the trigger instruction receiving module 110 is specifically configured to: receive a virtual resource custom triggering instruction during the live video display process.
  • the virtual resource extraction module 140 shown in FIG. 16 includes, but is not limited to, an image acquisition unit 141 and an image optimization unit 142.
  • the image collection unit 141 is configured to control the collection of the image content by the specified image acquisition hardware on the real scene;
  • the image optimization unit 142 is configured to perform optimization processing on the image content to generate a custom virtual resource.
  • the image optimization unit 142 shown in FIG. 18 includes, but is not limited to, a texture generation sub-unit 1421 and a special effect processing sub-unit 1422.
  • a texture generation sub-unit 1421 configured to generate a texture according to the image content
  • the special effect processing sub-unit 1422 is configured to control the plurality of shaders to perform the special effect processing of the texture in parallel to generate a custom virtual resource.
  • FIG. 20 is a block diagram of another apparatus for implementing virtual resource customization according to the corresponding embodiment of FIG. 16.
  • the apparatus for implementing virtual resource customization shown in FIG. 16 further includes but not It is limited to: target user identity obtaining module 210 and resource transmission module 220.
  • the target user identifier obtaining module 210 is configured to acquire a target user identifier specified for the custom virtual resource.
  • the resource transmission module 220 is configured to perform the transmission process of the customized virtual resource according to the target user identifier, so that the customized virtual resource is shared to the terminal corresponding to the target user identifier.
  • the resource transmission module 220 shown in FIG. 20 includes, but is not limited to, a resource uploading unit 221 and a push notification sending unit 222.
  • the resource uploading unit 221 is configured to perform HTTP transmission of the customized virtual resource for the target user identifier, so that the customized virtual resource is uploaded to the virtual resource server;
  • the push notification sending unit 222 is configured to send a push notification of the custom virtual resource according to the target user identifier after the custom virtual resource is successfully uploaded.
  • FIG. 22 is a block diagram of another apparatus for implementing virtual resource customization according to an exemplary embodiment, where the apparatus is applied to a terminal between live broadcasts, and the terminal performs video data transmission through a live broadcast server and other terminals in the live broadcast.
  • the method includes a but not limited to: a push notification receiving module 410, a virtual resource downloading module 420, and a resource displaying module 430.
  • the push notification receiving module 410 is configured to receive a push notification sent by the live broadcast server for uploading a custom virtual resource for another terminal;
  • the virtual resource downloading module 420 is configured to download a corresponding custom virtual resource from the virtual resource server in response to the push notification.
  • the resource display module 430 is configured to perform the display of the customized virtual resource on a display interface of the terminal.
  • FIG. 23 is a block diagram of a terminal 100, according to an exemplary embodiment.
  • the terminal 100 may be the terminal 10 described in the above-described implementation environment.
  • the terminal 100 may include one or more of the following components: a processing component 101, a memory 102, a power component 103, a multimedia component 104, an audio component 105, a sensor component 107, and a communication component 108.
  • a processing component 101 a memory 102
  • a power component 103 a power component 103
  • a multimedia component 104 a multimedia component 104
  • an audio component 105 a sensor component 107
  • a communication component 108 may be included in the terminal 100.
  • the above components are not all necessary, and the terminal 100 may add other components or reduce some components according to the requirements of the functions, which is not limited in this embodiment.
  • Processing component 101 typically controls the overall operation of terminal 100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations, and the like.
  • Processing component 101 can include one or more processors 109 to execute instructions to perform all or part of the steps described above.
  • processing component 101 can include one or more modules to facilitate interaction between component 101 and other components.
  • processing component 101 can include a multimedia module to facilitate interaction between multimedia component 104 and processing component 101.
  • the memory 102 is configured to store various types of data to support operation at the terminal 100. Examples of such data include instructions for any application or method operating on terminal 100.
  • the memory 102 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as SRAM (Static Random Access Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory) Erase programmable read-only memory, EPROM (Erasable Programmable Read Only Memory), PROM (Programmable Read-Only Memory), ROM (Read-Only Memory) Read memory), magnetic memory, flash memory, disk or optical disk. Also stored in the memory 102 is one or more modules configured to be executed by the one or more processors 109 to complete FIGS. 2, 5, 7, 9, 11, and 12 or all or part of the steps in any of the methods shown in FIG.
  • Power component 103 provides power to various components of terminal 100.
  • Power component 103 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for terminal 100.
  • the multimedia component 104 includes a screen that provides an output interface between the terminal 100 and a user.
  • the screen may include an LCD (Liquid Crystal Display) and a TP (Touch Panel). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the audio component 105 is configured to output and/or input an audio signal.
  • the audio component 105 includes a microphone that is configured to receive an external audio signal when the terminal 100 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 102 or transmitted via communication component 108.
  • the audio component 105 also includes a speaker for outputting an audio signal.
  • Sensor assembly 107 includes one or more sensors for providing terminal 100 with various aspects of status assessment.
  • the sensor assembly 107 can detect the open/closed state of the terminal 100, the relative positioning of the components, and the sensor assembly 107 can also detect a change in position of the terminal 100 or a component of the terminal 100 and a temperature change of the terminal 100.
  • the sensor assembly 107 can also include a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 108 is configured to facilitate wired or wireless communication between terminal 100 and other devices.
  • the terminal 100 can access a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity), 2G or 3G, or a combination thereof.
  • communication component 108 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 108 further includes an NFC (Near Field Communication) module to facilitate short range communication.
  • the NFC module can be based on RFID (Radio Frequency Identification) technology, IrDA (Infrared Data Association) technology, UWB (Ultra-Wideband) technology, BT (Bluetooth) technology and others. Technology to achieve.
  • the terminal 100 may be configured by one or more ASICs (Application Specific Integrated Circuits), DSP (Digital Signal Processing), and PLD (Programmable Logic Device). ), FPGA (Field-Programmable Gate Array), controller, microcontroller, microprocessor or other electronic component implementation for performing the above method.
  • ASICs Application Specific Integrated Circuits
  • DSP Digital Signal Processing
  • PLD Programmable Logic Device
  • FPGA Field-Programmable Gate Array
  • controller microcontroller
  • microprocessor microprocessor or other electronic component implementation for performing the above method.
  • the present invention further provides an intelligent terminal, which performs all or part of the method for implementing virtual resource customization as shown in any of FIG. 2, FIG. 5, FIG. 7, FIG. 9, FIG. 11, FIG. 12, and FIG. step.
  • the device includes:
  • At least one processor At least one processor
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any of the above embodiments .
  • a storage medium is also provided, which is a computer readable storage medium, such as a temporary and non-transitory computer readable storage medium including instructions.
  • the storage medium stores a computer program executable by the processor 109 of the terminal 100 to perform the above-described method of implementing virtual resource customization.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente invention se rapporte au domaine technique des applications Internet. L'invention concerne un procédé et un dispositif de réalisation d'une personnalisation de ressources virtuelles, un terminal, et un support de stockage lisible par ordinateur. Le procédé consiste à : recevoir une instruction de déclenchement pour une personnalisation de ressources virtuelles ; déclencher le chargement d'une commande d'acquisition d'image selon l'instruction de déclenchement ; démarrer un matériel d'acquisition d'image spécifiée via le chargement de la commande d'acquisition d'image ; et extraire une ressources virtuelles personnalisée à partir d'un contenu d'image délivré par le matériel d'acquisition d'image spécifiée. Le procédé et le dispositif de réalisation d'une personnalisation de ressources virtuelles peuvent réaliser une personnalisation de ressources virtuelles.
PCT/CN2018/089941 2017-06-27 2018-06-05 Procédé et dispositif de réalisation d'une personnalisation de ressources virtuelles WO2019001229A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710503890.1A CN107396197B (zh) 2017-06-27 2017-06-27 实现虚拟资源自定义的方法及装置
CN201710503890.1 2017-06-27

Publications (1)

Publication Number Publication Date
WO2019001229A1 true WO2019001229A1 (fr) 2019-01-03

Family

ID=60332874

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/089941 WO2019001229A1 (fr) 2017-06-27 2018-06-05 Procédé et dispositif de réalisation d'une personnalisation de ressources virtuelles

Country Status (2)

Country Link
CN (1) CN107396197B (fr)
WO (1) WO2019001229A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107396197B (zh) * 2017-06-27 2020-04-03 腾讯科技（深圳）有限公司 实现虚拟资源自定义的方法及装置
CN108156503B (zh) * 2017-12-14 2020-05-01 北京奇艺世纪科技有限公司 一种生成礼物的方法及装置
CN109407899A (zh) * 2018-09-12 2019-03-01 北京星云城科技有限公司 一种桌面交互投影系统
CN110139142A (zh) 2019-05-16 2019-08-16 北京达佳互联信息技术有限公司 虚拟物品显示方法、装置、终端及存储介质
CN110336682A (zh) * 2019-07-11 2019-10-15 顾永才 一种赠送虚拟礼物的系统及方法
CN110880139B (zh) * 2019-09-30 2021-03-02 珠海必要工业科技股份有限公司 一种商品展示方法、装置、终端、服务器及存储介质
CN112738608B (zh) * 2019-10-28 2022-07-26 腾讯科技（深圳）有限公司 直播视频互动方法、客户端、设备及介质
CN112188230A (zh) * 2020-10-12 2021-01-05 北京达佳互联信息技术有限公司 虚拟资源处理方法、装置、终端设备及服务器
CN113171605B (zh) * 2021-05-26 2024-02-02 网易（杭州）网络有限公司 虚拟资源获取方法、计算机可读存储介质和电子设备
CN114449355B (zh) * 2022-01-24 2023-06-20 腾讯科技（深圳）有限公司 一种直播互动的方法、装置、设备及存储介质
CN114584796B (zh) * 2022-02-11 2023-11-17 百果园技术(新加坡)有限公司 一种数据处理方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102811184A (zh) * 2012-08-28 2012-12-05 腾讯科技（深圳）有限公司 自定义表情的共享方法、终端、服务器及系统
US20160164961A1 (en) * 2014-12-09 2016-06-09 Samsung Electronics Co., Ltd. Method and apparatus for converting content using cloud
CN106228436A (zh) * 2016-08-26 2016-12-14 北京小米移动软件有限公司 直播平台虚拟物品设置方法及装置
CN106846040A (zh) * 2016-12-22 2017-06-13 武汉斗鱼网络科技有限公司 一种直播间中虚拟礼物显示方法和系统
CN107396197A (zh) * 2017-06-27 2017-11-24 腾讯科技（深圳）有限公司 实现虚拟资源自定义的方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108283811B (zh) * 2011-12-16 2021-12-31 星佳公司 在游戏中提供社交网络内容
CN105653167B (zh) * 2015-12-23 2019-02-12 广州华多网络科技有限公司 一种基于在线直播的信息展示方法及客户端
CN106648300A (zh) * 2016-10-14 2017-05-10 广州华多网络科技有限公司 图标消息差异化显示控制方法、装置和移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102811184A (zh) * 2012-08-28 2012-12-05 腾讯科技（深圳）有限公司 自定义表情的共享方法、终端、服务器及系统
US20160164961A1 (en) * 2014-12-09 2016-06-09 Samsung Electronics Co., Ltd. Method and apparatus for converting content using cloud
CN106228436A (zh) * 2016-08-26 2016-12-14 北京小米移动软件有限公司 直播平台虚拟物品设置方法及装置
CN106846040A (zh) * 2016-12-22 2017-06-13 武汉斗鱼网络科技有限公司 一种直播间中虚拟礼物显示方法和系统
CN107396197A (zh) * 2017-06-27 2017-11-24 腾讯科技（深圳）有限公司 实现虚拟资源自定义的方法及装置

Also Published As

Publication number Publication date
CN107396197A (zh) 2017-11-24
CN107396197B (zh) 2020-04-03

Similar Documents

Publication Publication Date Title
WO2019001229A1 (fr) Procédé et dispositif de réalisation d'une personnalisation de ressources virtuelles
CN106791893B (zh) 视频直播方法及装置
WO2019128787A1 (fr) Procédé et appareil de diffusion en direct de vidéo en réseau et dispositif électronique
CN112073649B (zh) 多媒体数据的处理方法、生成方法及相关设备
US10809879B2 (en) Displaying simulated media content item enhancements on mobile devices
CN106506448B (zh) 直播显示方法、装置及终端
WO2020093901A1 (fr) Procédé et appareil de génération de données, dispositif électronique et support de stockage lisible
US20150365600A1 (en) Composing real-time processed video content with a mobile device
WO2019105467A1 (fr) Procédé et dispositif de partage d'informations, support de stockage, et dispositif électronique
CN107526591B (zh) 切换直播间类型的方法和装置
CN105007515A (zh) 一种生成互动电视系统互动反馈信息的方法及装置
US20220272406A1 (en) Method for displaying interactive interface, method for generating interactive interface, and electronic device thereof
WO2020093798A1 (fr) Procédé et appareil d'affichage d'image cible, terminal, et support de stockage
WO2020088059A1 (fr) Procédé de lecture vidéo, appareil de lecture vidéo, dispositif électronique et support d'informations
CN113835649A (zh) 一种投屏方法和终端
CN112788354A (zh) 直播互动方法、装置、电子设备、存储介质及程序产品
CN112367554A (zh) 消息交互方法、装置、电子设备及存储介质
EP3264750A1 (fr) Procédé, dispositif et système d'enregistrement de programme de télévision
CN107566878B (zh) 直播中显示图片的方法及装置
CN110012336A (zh) 直播界面的图片配置方法、终端及装置
CN113873270A (zh) 一种游戏直播方法、装置、系统、电子设备及存储介质
CN116761009A (zh) 元宇宙全景直播场景下的视频播放方法、装置及直播系统
RU105102U1 (ru) Автоматизированная система для создания, обработки и монтажа видеороликов
WO2023174009A1 (fr) Procédé et appareil de traitement photographique basés sur la réalité virtuelle, et dispositif électronique
CN117119260A (zh) 视频的控制处理方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18823152

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18823152

Country of ref document: EP

Kind code of ref document: A1