CN113938696A

CN113938696A - Live broadcast interaction method and system based on user-defined virtual gift and computer equipment

Info

Publication number: CN113938696A
Application number: CN202111191414.3A
Authority: CN
Inventors: 曾家乐
Original assignee: Guangzhou Cubesili Information Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2021-10-13
Filing date: 2021-10-13
Publication date: 2022-01-14
Anticipated expiration: 2041-10-13
Also published as: CN113938696B

Abstract

The application relates to the technical field of network live broadcast, and provides a live broadcast interaction method, a live broadcast interaction system and computer equipment based on a user-defined virtual gift, wherein the method comprises the following steps: the server responds to the user-defined virtual gift generation request, and obtains a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value, wherein the user-defined virtual gift image is an animation image generated based on the entity gift image; the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value; the server responds to the virtual gift bar display request, and sends virtual gift bar data containing the user-defined virtual gift data to the client, so that the client displays the virtual gift bar with the user-defined virtual gift in the live broadcast interface. Compared with the prior art, the application realizes the user-defined configuration of the virtual gifts, enriches the diversity of the virtual gifts and can effectively promote the generation of live broadcast interaction behaviors.

Description

Live broadcast interaction method and system based on user-defined virtual gift and computer equipment

Technical Field

The embodiment of the application relates to the technical field of network live broadcast, in particular to a live broadcast interaction method and system based on a user-defined virtual gift and computer equipment.

Background

With the rapid development of internet technology and streaming media technology, live webcasting is becoming an entertainment means that is becoming popular. More and more users experience online interactions with the anchor within the live room, such as: present virtual gifts, speak in public screen areas, participate in online games, and the like.

At present, when audience presents virtual gifts to a main broadcast, because the audience can only select the virtual gifts provided by a live broadcast platform to present, the virtual gifts presenting requirements of the audience are difficult to meet, the virtual gifts presenting experience of the audience in a live broadcast room is improved, the user stickiness between the audience and the main broadcast is not enhanced, and the generation of live broadcast interaction behaviors is promoted.

Disclosure of Invention

The embodiment of the application provides a live broadcast interaction method, a live broadcast interaction system and computer equipment based on a user-defined virtual gift, which can solve the technical problem of how to meet the virtual gift presenting demand of audiences and improve the virtual gift presenting experience, and the technical scheme is as follows:

in a first aspect, an embodiment of the present application provides a live broadcast interaction method based on a custom virtual gift, including the steps of:

the server responds to a user-defined virtual gift generation request sent by the anchor client and acquires a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value; the user-defined virtual gift image is an animation image generated based on the entity gift image; the entity gift image displays the entity gift selected by the anchor;

the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value;

the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client; the client is a main broadcasting client or a spectator client which is added into a live broadcasting room;

the client receives the virtual gift certificate data and displays the virtual gift certificate with the self-defined virtual gift certificate in the live broadcast interface according to the virtual gift certificate data.

In a second aspect, an embodiment of the present application provides a live broadcast interactive system based on a custom virtual gift, including: a server and a client; the client comprises a main broadcasting client and an audience client;

the server is used for responding to a user-defined virtual gift generation request sent by the anchor client and acquiring a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value; the user-defined virtual gift image is an animation image generated based on the entity gift image; the entity gift image displays the entity gift selected by the anchor;

the server is used for generating user-defined virtual gift data according to the user-defined virtual gift image, the user-defined virtual gift name and the user-defined virtual gift value;

the server is used for responding to the virtual gift bar display request of the client and issuing virtual gift bar data containing the user-defined virtual gift data to the client; the client is a main broadcasting client or a spectator client which is added into a live broadcasting room;

the client is used for receiving the virtual gift bar data and displaying the virtual gift bar with the self-defined virtual gift in the live broadcast interface according to the virtual gift bar data.

In a third aspect, embodiments of the present application provide a computer device, a processor, a memory, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method according to the first aspect when executing the computer program.

In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program, which when executed by a processor implements the steps of the method according to the first aspect.

In the embodiment of the application, the server responds to a user-defined virtual gift generation request sent by the anchor client to obtain a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value; the user-defined virtual gift image is an animation image generated based on the entity gift image; the entity gift image displays the entity gift selected by the anchor; the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value; the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client; the client is a main broadcasting client or a spectator client which is added into a live broadcasting room; the client receives the virtual gift certificate data and displays the virtual gift certificate with the self-defined virtual gift certificate in the live broadcast interface according to the virtual gift certificate data. The embodiment of the application realizes the custom configuration of the virtual gift, improves the controllability of the anchor to the virtual gift, and enriches the diversity of the virtual gift, so that audiences can not only present the virtual gift provided by the live broadcast platform, but also can present the custom virtual gift made by the anchor, and further can effectively promote the generation of live broadcast interaction behavior, promote the experience of audience virtual gift presentation, and enhance the user stickiness between the audiences and the anchor.

For a better understanding and implementation, the technical solutions of the present application are described in detail below with reference to the accompanying drawings.

Drawings

Fig. 1 is a schematic view of an application scenario of a live broadcast interaction method based on a custom virtual gift according to an embodiment of the present application;

FIG. 2 is a schematic view of a virtual gift box displayed in a live broadcast interface provided by the present application;

fig. 3 is a schematic flowchart of a live broadcast interaction method based on a customized virtual gift according to a first embodiment of the present application;

fig. 4 is a schematic view illustrating a display of a customized virtual gift in a virtual gift box according to an embodiment of the present application;

fig. 5 is another schematic flow chart of a live broadcast interaction method based on a customized virtual gift according to the first embodiment of the present application;

fig. 6 is a schematic flowchart of a live interactive method based on a customized virtual gift according to the first embodiment of the present application;

FIG. 7 is a schematic display view of a custom virtual gift-making interface provided in an embodiment of the present application;

FIG. 8 is another schematic display view of a custom virtual gift-making interface provided by an embodiment of the present application;

FIG. 9 is a schematic illustration of yet another display of a custom virtual gift-making interface provided by an embodiment of the present application;

fig. 10 is a schematic flow chart of a customized virtual gift-based live broadcast interaction method according to the first embodiment of the present application;

fig. 11 is a schematic flowchart of a live interactive method based on a customized virtual gift according to a second embodiment of the present application;

fig. 12 is a schematic flowchart of a live interactive method based on a customized virtual gift according to a third embodiment of the present application;

FIG. 13 is a further illustration of a custom virtual gift-making interface according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of a live interactive system based on a customized virtual gift according to a fourth embodiment of the present application;

fig. 15 is a schematic structural diagram of a computer device according to a fifth embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if/if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

As will be appreciated by those skilled in the art, the terms "client," "terminal device," and "terminal device" as used herein include both wireless signal receiver devices, which include only wireless signal receiver devices without transmit capability, and receiving and transmitting hardware devices, which include receiving and transmitting hardware devices capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (personal communications Service), which may combine voice, data processing, facsimile and/or data communications capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global positioning system) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially a computer device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., wherein a computer program is stored in the memory, and the central processing unit loads a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby accomplishing specific functions.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

Referring to fig. 1, fig. 1 is a schematic view of an application scenario of a live broadcast interaction method based on a customized virtual gift provided in an embodiment of the present application, where the application scenario includes an anchor client 101, a server 102, and a viewer client 103 provided in the embodiment of the present application, and the anchor client 101 and the viewer client 103 interact with each other through the server 102.

The proposed clients of the embodiment of the present application include the anchor client 101 and the viewer client 103.

It is noted that there are many understandings of the concept of "client" in the prior art, such as: it may be understood as an application program installed in a computer device, or may be understood as a hardware device corresponding to a server.

In the embodiments of the present application, the term "client" refers to a hardware device corresponding to a server, and more specifically, refers to a computer device, such as: smart phones, smart interactive tablets, personal computers, and the like.

When the client is a mobile device such as a smart phone and an intelligent interactive tablet, a user can install a matched mobile application program on the client and can also access a Web application program on the client.

When the client is a non-mobile device such as a Personal Computer (PC), the user can install a matching PC application on the client, and similarly can access a Web application on the client.

The mobile application refers to an application program that can be installed in the mobile device, the PC application refers to an application program that can be installed in the non-mobile device, and the Web application refers to an application program that needs to be accessed through a browser.

Specifically, the Web application program may be divided into a mobile version and a PC version according to the difference of the client types, and the page layout modes and the available server support of the two versions may be different.

In the embodiment of the application, the types of live application programs provided to the user are divided into a mobile end live application program, a PC end live application program and a Web end live application program. The user can autonomously select a mode of participating in the live webcasting according to different types of the client adopted by the user.

The present application can divide the clients into a main broadcasting client 101 and a spectator client 103, depending on the identity of the user using the clients.

The anchor client 101 is a client that transmits a live video, and is generally a client used by an anchor (i.e., a live anchor user) in live streaming.

The viewer client 103 refers to an end that receives and views a live video, and is typically a client employed by a viewer viewing a video in a live network (i.e., a live viewer user).

The hardware at which the anchor client 101 and viewer client 103 are directed is essentially a computer device, and in particular, as shown in fig. 1, it may be a type of computer device such as a smart phone, smart interactive tablet, and personal computer. Both the anchor client 101 and the viewer client 103 may access the internet via known network access means to establish a data communication link with the server 102.

Server 102, acting as a business server, may be responsible for further connecting with related audio data servers, video streaming servers, and other servers providing related support, etc., to form a logically associated server cluster for serving related terminal devices, such as anchor client 101 and viewer client 103 shown in fig. 1.

In the embodiment of the present application, the anchor client 101 and the audience client 103 may join in the same live broadcast room (i.e., a live broadcast channel), where the live broadcast room is a chat room implemented by means of an internet technology, and generally has an audio/video broadcast control function. The anchor user is live in the live room through the anchor client 101, and the audience of the audience client 103 can log in the server 102 to enter the live room to watch the live.

In the live broadcast room, interaction between the anchor and the audience can be realized through known online interaction modes such as voice, video, characters and the like, generally, the anchor performs programs for audience users in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can also be popularized to other relevant scenes, such as a video conference scene, a product recommendation sale scene and any other scenes needing similar interaction.

Specifically, the viewer watches live broadcast as follows: a viewer may click on a live application installed on the viewer client 103 and choose to enter any one of the live rooms, triggering the viewer client 103 to load a live room interface for the viewer, the live room interface including a number of interactive components, for example: the video window, the virtual gift column, the public screen and the like can enable audiences to watch live broadcast in the live broadcast room by loading the interactive components, and perform various online interactions, wherein the online interaction modes comprise but are not limited to giving virtual gifts, speaking on the public screen and the like.

Currently, when presenting a virtual gift to a main broadcast, a viewer can trigger a viewer client to send a virtual gift bar display request to a server by clicking a virtual gift bar component displayed in a live broadcast interface, the server responds to the virtual gift bar display request and issues virtual gift bar data to the viewer client, and the viewer client receives the virtual gift bar data and displays the virtual gift bar in the live broadcast interface according to the virtual gift bar data.

Referring to fig. 2, fig. 2 is a schematic view illustrating a display of a virtual gift box in a live broadcast interface according to the present application. It can be seen that a number of live platform-provided virtual gifts 22 are displayed in the virtual gift box 21, and viewers can browse the virtual gifts 22 in the virtual gift box 21 and select any one of the virtual gifts to be presented to the anchor.

As the audience can only select the virtual gift provided by the live broadcast platform to present, the virtual gift presenting requirement of the audience is difficult to meet well, and the virtual gift presenting experience of the audience in the live broadcast room is improved. Therefore, the embodiment of the application provides a live broadcast interaction method based on the user-defined virtual gift. Referring to fig. 3, fig. 3 is a schematic flowchart illustrating a live broadcast interaction method based on a customized virtual gift according to a first embodiment of the present application, where the method includes the following steps:

s101: the server responds to a user-defined virtual gift generation request sent by the anchor client and acquires a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value; the user-defined virtual gift image is an animation image generated based on the entity gift image; the physical gift image shows the physical gift selected by the anchor.

S102: the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value.

S103: the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client; the client is a main broadcasting client or a spectator client which is added into a live broadcasting room.

S104: the client receives the virtual gift certificate data and displays the virtual gift certificate with the self-defined virtual gift certificate in the live broadcast interface according to the virtual gift certificate data.

In this embodiment, a live broadcast interaction method based on a customized virtual gift is described with two execution bodies, namely a server and a client. Wherein, the client comprises an anchor client and a spectator client.

With respect to step S101, the server obtains a custom virtual gift image, a custom virtual gift name, and a custom virtual gift value in response to a custom virtual gift generation request sent by the anchor client.

The user-defined virtual gift generation request at least comprises a main broadcasting identifier, a live broadcasting room identifier, a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value.

The anchor identification is a unique identification corresponding to the anchor, the live broadcast room identification is a live broadcast room corresponding to a unique identification corresponding to a live broadcast room (i.e., a channel), and the live broadcast room corresponding to the live broadcast room identification is created for the anchor. In an embodiment of the present application, the anchor identification and the live room identification are used to confirm which anchor is to generate the custom virtual gift and which live room audience can see the custom virtual gift in the virtual gift box.

The user-defined virtual gift image is an animation image generated based on the entity gift image, and the entity gift selected by the anchor is displayed in the entity gift image.

Specifically, the entity gift image may be identified from a live video frame corresponding to the anchor logo, or may be identified from a shot image uploaded by the anchor. The customized virtual gift image can be understood as an entity gift with an animation style, and various ways of generating a corresponding animation image based on the entity gift image are provided, which will be described in detail later.

The custom virtual gift name and the custom virtual gift value may be a virtual gift name and a virtual gift value that are autonomously set by the anchor, or may be provided to the anchor after object recognition of the physical gift image by a computer device (server or anchor client).

In steps S102 to S104, the server generates the customized virtual gift data according to the customized virtual gift image, the customized virtual gift name and the customized virtual gift value after acquiring the customized virtual gift image, the customized virtual gift name and the customized virtual gift value.

The user-defined virtual gift data comprises a user-defined virtual gift identifier, and the user-defined virtual gift identifier is the only identifier of the user-defined virtual gift.

Thereafter, when the server responds to the virtual gift bar display request of the client, the server issues virtual gift bar data containing the custom virtual gift data to the client.

Wherein, the client is a main broadcasting client or a spectator client which is added into a live broadcasting room.

Since the anchor makes the customized virtual gift, the virtual gift data sent by the server will include the customized virtual gift data.

In the present embodiment, the virtual gift certificate data includes display data of the virtual gift certificate and function data of the virtual gift certificate.

The display data of the virtual gift certificate includes, but is not limited to, style data of the virtual gift certificate, size data of the virtual gift certificate, position data of the virtual gift certificate, internal layout data of the virtual gift certificate, and display images, display sizes, display positions, and the like of the respective virtual gifts in the virtual gift certificate.

Wherein the display image, the display size and the display position of each virtual gift in the virtual gift box comprise the display image, the display size and the display position of the customized virtual gift in the virtual gift box.

The functional data of the virtual gift certificate is used to implement various functions of the virtual gift certificate, including but not limited to a virtual gift browsing function, a virtual gift selecting function, a quantity input function, a presentation confirmation function, and the like.

And after receiving the virtual gift bar data, the client presents the virtual gift bar with the self-defined virtual gift in the live broadcast interface according to the virtual gift bar data.

Referring to fig. 4, fig. 4 is a schematic view illustrating a display of a customized virtual gift in a virtual gift box according to an embodiment of the present application, and it can be seen that the customized virtual gift 23 is displayed in the virtual gift box 21, and fig. 4 shows only one display mode of the customized virtual gift, that is, the customized virtual gift is marked on a display image of the customized virtual gift 23. In alternative embodiments, the custom virtual gift 23 may be otherwise distinguished from the virtual gift 22 provided by the live platform.

The implementation process of presenting the customized virtual gift 23 is not different from the implementation process of presenting the general virtual gift 22, and is implemented by a series of operations such as selecting a virtual gift, inputting the presentation amount of the virtual gift, confirming the presentation, and completing the payment, and will not be described in detail here.

How to obtain the physical gift image, the custom virtual gift name and the custom virtual gift value in the embodiment of the present application will be described separately below.

(1) How to obtain the physical gift image.

In an alternative embodiment, before the server responds to the customized virtual gift generation request sent by the anchor client, referring to fig. 5, the method includes steps S105 to S108 as follows:

s105: the server responds to a user-defined virtual gift making starting request sent by the anchor client to acquire a live video picture acquired by the anchor client; wherein, the hand of the main broadcast in the live video picture is provided with the entity gift.

S106: and the server positions the hand region in the live video picture according to the live video picture and a preset human body part identification method.

S107: and the server acquires the boundary position of the entity gift according to the hand area in the live video picture and a preset object boundary detection method.

S108: and the server cuts the real gift image from the live video picture according to the boundary position of the real gift.

With respect to step S105, the server acquires a live video frame captured by the anchor client in response to the custom virtual gift-making start request sent by the anchor client.

In an alternative embodiment, a custom virtual gift making control may be displayed in the live broadcast interface, and the anchor triggers the anchor client to send out the custom virtual gift making opening request by interacting with the custom virtual gift making control.

In another optional embodiment, the server obtains live broadcast audio data collected by the anchor client, performs real-time semantic analysis on the live broadcast audio data, and sends out the custom virtual gift preparation opening request if the semantics and the audio related to opening the custom virtual gift preparation are identified. The audio content related to the semantics and the opening of the customized virtual gift making can be 'opening the homemade virtual gift playing method' and the like.

In this embodiment, a physical gift is placed on the hand of the anchor in the live video frame.

Specifically, the server responds to a custom virtual gift making starting request sent by the anchor client, and can also send first virtual gift making prompt information for prompting the anchor to place the entity gift at the hand so as to ensure that the entity gift image can be acquired from the live video picture. Meanwhile, the anchor can be prompted to keep the hand stable so as to ensure the manufacturing effect of the user-defined virtual gift.

In step S106, the human body part recognition method may be any one of the existing human body part recognition methods, and the human body part recognition method needs to be capable of locating the head, hands, torso, feet, and the like in the image. In this embodiment, based on the preset human body part identification method, a hand area in the live video picture is located, and since the live gift is placed on the anchor hand, the hand area in the live video picture records the image of the anchor hand and the image of the live gift.

Regarding step S107, the server acquires the boundary position of the real gift according to the hand region in the live video frame and a preset object boundary detection method.

In an optional embodiment, the object boundary detection method may be a color-based object boundary detection method, and since there is a difference between the human skin color and the color of the entity gift, the boundary position of the entity gift may be obtained through a change of the color.

In another alternative embodiment, the object boundary detection method may be an object boundary detection method based on a deep learning neural network, such as: the method can not only obtain the boundary positions of different entities in the image, but also identify the types of the entities in the image.

In step S108, after the boundary position of the entity gift is obtained, the entity gift image can be obtained according to the boundary position of the entity gift and the live video frame.

In this embodiment, the operation of making the virtual gift by the anchor can be greatly simplified by acquiring the real gift image from the live video frame, and the experience of making the virtual gift by the anchor is improved.

In an alternative embodiment, before the server responds to the customized virtual gift generation request sent by the anchor client, referring to fig. 6, the method includes steps S109 to S111 as follows:

s109: the server responds to a user-defined virtual gift making starting request sent by the anchor client, and obtains a first shot image and an entity gift area selected by the anchor in the first shot image; wherein the first photographed image is an image of the physical gift photographed in a preset background.

S110: the server acquires the boundary position of the entity gift according to the entity gift area in the first shot image and a preset object boundary detection method.

S111: the server cuts the physical gift image from the first captured image according to the boundary position of the physical gift.

Regarding step S109, the manner in which the customized virtual gift creation start request is generated in step S109 is the same as that in step S105, and a description thereof will not be repeated.

In this embodiment, the server obtains the first captured image and the entity gift area selected by the anchor in the first captured image in response to the custom virtual gift-making opening request sent by the anchor client.

Wherein the first photographed image is an image of the physical gift photographed in a preset background. For example: an image of a physical gift taken against a solid background.

In an alternative embodiment, the server sends the custom virtual gift making interface data to the anchor client in response to a custom virtual gift making start request sent by the anchor client, and the anchor client receives the custom virtual gift making interface data and displays the custom virtual gift making interface according to the custom virtual gift making interface data.

The user-defined virtual gift making interface can comprise a first selection control, the first selection control is used for selecting a mode of obtaining an entity gift image, and when the anchor selects to upload an image, the image uploading interface is displayed in the anchor client. The anchor can upload the first shot image by interacting with the image uploading interface, the anchor client receives the first shot image and displays the first shot image in the image uploading interface, and then the anchor selects an entity gift area by interacting with the first shot image in the image uploading interface, for example: the physical gift area is circled by a finger or a mouse.

Then, the server acquires the boundary position of the entity gift according to the entity gift area in the first shot image and a preset object boundary detection method.

The object boundary detection method in step S110 is the same as the object boundary detection method in step S107, and the description thereof is not repeated here.

Finally, the physical gift image can be cut out from the first photographed image according to the boundary position of the physical gift.

In this embodiment, the first captured image is obtained first, the first captured image is uploaded to the anchor client, the entity gift area manually selected by the anchor in the first captured image is obtained, the object boundary detection is performed on the entity gift area in the first captured image to obtain the boundary position of the entity gift, and finally the entity gift image is obtained by cutting the first captured image according to the boundary position of the entity gift.

The execution subject of steps S105 to S108 and S109 to S111 is not limited to the server, and may be executed by the anchor client.

Referring to fig. 7, fig. 7 is a display schematic diagram of a custom virtual gift-making interface provided in the embodiment of the present application, and as can be seen from fig. 7, a first selection control 71 is displayed in the custom virtual gift-making interface 7, where the first selection control 71 is used to select a manner of obtaining an entity gift image, and after the entity gift image is obtained, the obtained entity gift image 72 may also be displayed on the custom virtual gift-making interface for viewing by a host. The physical gift displayed in the physical gift image 72 shown in fig. 7 can be seen as a necklace.

(2) How to obtain the custom virtual gift image.

In an optional embodiment, the server responds to a custom virtual gift making starting request sent by the anchor client, obtains the entity gift image, and inputs the entity gift image to a pre-trained animation image generation network to obtain the custom virtual gift image.

The pre-trained animation image generation network is obtained according to a plurality of entity gift training images and animation images corresponding to the entity gift training images, and the animation styles of the animation images corresponding to the entity gift training images are the same.

The animation style includes but is not limited to fresh, dark, and antique.

Note that the animation style of the animation image trained on the same animation image generation network is the same.

In an optional embodiment, the animation image generation network and the animation image identification network jointly form an anti-neural network, and the pre-trained animation image generation network and the pre-trained animation image identification network are obtained by performing joint training on the animation image generation network and the animation image identification network.

Specifically, the process of joint training is as follows: a, acquiring a plurality of entity gift training images and cartoon images (with true labels) corresponding to the entity gift training images; b, inputting a plurality of entity gift training images into the animation image generation network to obtain first animation images (labels are false) corresponding to the plurality of entity gift training images output by the animation image generation network; step c, iteratively training the animation image identification network according to the animation images corresponding to the entity gift training images, the first animation images corresponding to the entity gift training images, a preset first loss function and a preset first model optimization algorithm, and optimizing trainable parameters in the animation image identification network until the value of the first loss function meets a preset first training termination condition to obtain the currently trained animation image identification network; d, modifying the label of the first cartoon image into true, inputting a plurality of first cartoon images into a currently trained cartoon image identification network, and acquiring a plurality of identification results of the first cartoon images; and e, the identification results of the plurality of first cartoon images meet a preset second training termination condition to obtain a pre-trained cartoon image generation network and a pre-trained cartoon image identification network. The preset second training termination condition is that the identification result of the plurality of first cartoon images is near 0.5, and the identification result is the probability of identifying the first cartoon images as true. If the probability value is close to 0 (the probability indicating that the first cartoon image is identified as true is 0), the generation effect of the cartoon image generation network is poor, and at the moment, the label of the first cartoon image is modified to be true, so that the obtained loss data can cause great adjustment of trainable parameters of the cartoon image generation network, and the optimization of the cartoon image generation network is realized. The closer the probability value is to 1 (indicating that the probability of identifying the first animation image as true is 1), the poorer the identification effect of the animation image identification network is, and therefore, it is necessary to continue training the animation image identification network. And the probability value is near 0.5, which indicates that the cartoon image identification network and the cartoon image generation network are in mutual confrontation, thereby achieving better training effect. F, the identification results of the plurality of first cartoon images do not meet the preset second training termination condition, loss data are obtained according to the identification results of the plurality of first cartoon images, the labels of the plurality of first cartoon images and a preset first loss function, trainable parameters of the cartoon image generation network are optimized according to the loss data and a preset second model optimization algorithm, and the currently trained cartoon image generation network is obtained; and g, inputting a plurality of entity gift training images into the currently trained virtual speech generation network model, re-acquiring first cartoon images corresponding to the plurality of entity gift training images, and iteratively executing the steps c to g until the identification results of the plurality of first cartoon images meet a preset second training termination condition to obtain the pre-trained cartoon image generation network and the pre-trained virtual speech identification network model.

The above loss function and model optimization algorithm are the existing loss function and the existing model optimization algorithm, respectively, and are not limited in detail here.

In this embodiment, the server randomly selects a pre-trained animation image generation network in a certain animation style, and inputs the entity gift image, thereby directly obtaining a custom virtual gift image in the certain animation style.

In another optional embodiment, the server generates customized virtual gift images in multiple animation styles and selects the images by the anchor, and specifically, the server responds to a customized virtual gift making and starting request sent by the anchor client, acquires a plurality of animation styles matched between the entity gift image and the live broadcast room, inputs the entity gift image into a pre-trained animation image generation network in each animation style, obtains the customized virtual gift images in each animation style, and sends the customized virtual gift images in each animation style to the anchor client.

The pre-trained cartoon image generation network under each cartoon style is obtained by training a plurality of entity gift training images and the cartoon images under the cartoon styles corresponding to the entity gift training images respectively.

The pre-trained animation image generation network for each animation style is the same as the training process described above, and will not be repeated here.

The plurality of animation styles adapted to the live broadcast room are determined according to preference data of users in the live broadcast room.

And then, the anchor client receives the customized virtual gift images in all the animation styles, displays the customized virtual gift images in all the animation styles in a customized virtual gift making interface, and sends the customized virtual gift images in the target animation styles selected by the anchor to the server.

Referring to fig. 8, fig. 8 is another schematic display diagram of a customized virtual gift-making interface provided in the embodiment of the present application, as can be seen from fig. 8, a customized virtual gift image 73 in each animation style is displayed in the customized virtual gift-making interface 7, and an anchor can select a target animation style by clicking the customized virtual gift image 73 in the customized virtual gift-making interface 7, and an anchor client obtains the target animation style and sends the customized virtual gift image in the target animation style to a server.

In this embodiment, by generating custom virtual gift images in a plurality of animation styles for selection by the anchor, the virtual gift production experience of the anchor can be further improved.

(3) How to obtain the custom virtual gift name and the custom virtual gift value.

The anchor client acquires the custom virtual gift name and the custom virtual gift value, displays the custom virtual gift name and the custom virtual gift value in a custom virtual gift making interface, and sends the custom virtual gift name and the custom virtual gift value to the server.

The user-defined virtual gift name and the user-defined virtual gift value are obtained after interaction between a name input control and a value input control displayed in a main broadcast and user-defined virtual gift manufacturing interface, or the user-defined virtual gift name and the user-defined virtual gift value are obtained by identification from live broadcast audio data collected by a main broadcast client.

Referring to fig. 9, fig. 9 is another schematic diagram of a customized virtual gift-making interface provided in the embodiment of the present application, and as can be seen from fig. 9, a name input control 74 and a value input control 75 in the customized virtual gift-making interface 7 are shown.

In an alternative embodiment, the automatic filling of the virtual gift name and the virtual gift value may be performed at the name input control 74 and the value input control 75, and the automatically filled virtual gift name and virtual gift value are determined by the type of object obtained by the object identification method, for example: the physical gift shown in the physical gift image 72 in fig. 9 is a necklace, the automatically filled virtual gift name can be a necklace, the automatically filled virtual gift value can be a virtual gift value adapted to the necklace, and the automatically filled virtual gift name and virtual gift value can provide the anchor with a name and value reference.

The custom virtual gift name and the custom virtual gift value are obtained by being identified from live broadcast audio data collected by an anchor client, and it should be noted that the semantic analysis method for the live broadcast audio data is any existing semantic analysis method, and the custom virtual gift name and the custom virtual gift value in the live broadcast audio data can be identified by performing semantic analysis. For example: the anchor says that the customized virtual gift A has a virtual gift value of B, the name of the virtual gift A can be obtained after semantic analysis, and the value of the virtual gift is B, so that the name of the virtual gift A is filled in the name input control, and the value of the virtual gift B is filled in the value input control.

In an optional embodiment, in order to improve the semantic analysis effect, a recording control may be displayed on the custom virtual gift manufacturing interface, the anchor records a recording containing a custom virtual gift name and a custom virtual gift value by interacting with the recording control, and obtains the custom virtual gift name and the custom virtual gift value by performing semantic analysis on the recording.

In another optional embodiment, to improve the semantic analysis effect, a second virtual gift-making prompt message may be displayed in the customized virtual gift-making interface to prompt the anchor to set the name and value of the customized virtual gift by audio.

After the customized virtual gift name and the customized virtual gift value are set, the anchor can modify and delete the customized virtual gift name and the customized virtual gift value.

Specifically, the anchor client responds to a custom virtual gift parameter modification instruction, obtains a modified custom virtual gift name and a modified custom virtual gift value, displays the modified custom virtual gift name and the modified custom virtual gift value in a custom virtual gift manufacturing interface, and sends the modified custom virtual gift name and the modified custom virtual gift value to the server; the modified custom virtual gift name and the modified custom virtual gift value are obtained after interaction between a name input control and a value input control displayed in a manufacture interface of the anchor and the custom virtual gift, or the modified custom virtual gift name and the modified custom virtual gift value are obtained by identification from audio live broadcast data collected by an anchor client.

Regarding the modified custom virtual gift name and the modified custom virtual gift value which are identified from the audio live broadcast data collected by the anchor client, it should be noted that the semantic analysis method for the live broadcast audio data is any existing semantic analysis method, and the custom virtual gift name and the custom virtual gift value which need to be modified in the live broadcast audio data can be identified by performing semantic analysis. For example: after the anchor says that the user-defined virtual gift name of the modified virtual gift A is C and the user-defined virtual gift value is D, the modified user-defined virtual gift name is C after semantic analysis and the modified user-defined virtual gift value is D, then the modified user-defined virtual gift name C is filled into the name input control, and the modified user-defined virtual gift value D is filled into the value input control.

The anchor client responds to the user-defined virtual gift parameter deleting instruction, cancels and displays the name and the value of the user-defined virtual gift in a user-defined virtual gift manufacturing interface, and sends a user-defined virtual gift parameter deleting request to the server, so that the server deletes the user-defined virtual gift parameter of the user-defined virtual gift. In some cases, the server may delete the custom virtual gift directly.

The customized virtual gift parameter deleting instruction can be issued when audio related to the deletion of the customized virtual gift is identified from audio live broadcast data collected by the anchor client, wherein the audio related to the deletion of the customized virtual gift can be 'the name a of the deleted customized virtual gift, and the value B of the customized virtual gift'.

In this embodiment, the anchor can set the name of the customized virtual gift and the value of the customized virtual gift in a manual input or audio control mode, so that the manufacturing requirement of the anchor can be met to a great extent, and the manufacturing difficulty is reduced.

In addition to obtaining the custom virtual gift image, the custom virtual gift name, and the custom virtual gift value, custom virtual gift special effect data may also be obtained.

In an alternative embodiment, before the server responds to the customized virtual gift generation request sent by the anchor client, referring to fig. 10, the method includes steps S112 to S114, which are as follows:

s112: the server responds to a custom virtual gift making and opening request sent by the anchor client side, and acquires a custom virtual gift image.

S113: the server obtains a plurality of types of customized virtual gift special effect data according to the customized virtual gift image and the plurality of types of virtual gift special effect types, and sends the plurality of types of customized virtual gift special effect data to the anchor client.

S114: the anchor client receives the plurality of types of customized virtual gift special effect data, displays the plurality of types of customized virtual gift special effects in a customized virtual gift manufacturing interface according to the plurality of types of customized virtual gift special effect data, acquires the type of customized virtual gift special effect selected by the anchor, and sends the type of customized virtual gift special effect to the server.

The virtual gift special effect type can be dynamic zooming of the virtual gift, dynamic shaking of the virtual gift, displaying of an aperture background and the like, and can also be a combination of different virtual gift special effect types.

The customized virtual gift special effect data is used for displaying the customized virtual gift special effect, after the customized virtual gift special effect data are sent to the anchor client side, the anchor client side receives the customized virtual gift special effect data, and the customized virtual gift special effect is displayed in the customized virtual gift manufacturing interface according to the customized virtual gift special effect data.

Because the customized virtual gift special effect is a dynamic special effect, the customized virtual gift special effect cannot be displayed through a static display schematic diagram. It can be confirmed that the anchor can select the custom virtual gift special effect type in the custom virtual gift making interface and send the custom virtual gift special effect type to the server.

Based on this, the step that the server obtains self-defining virtual gift image, self-defining virtual gift name and self-defining virtual gift value still includes: the server obtains the custom virtual gift special effect type. The server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value, and the method comprises the following steps: the server obtains custom virtual gift special effect data corresponding to the custom virtual gift special effect type, and generates the custom virtual gift data according to the custom virtual gift image, the custom virtual gift name, the custom virtual gift value and the custom virtual gift special effect data.

In the embodiment of the application, the anchor can customize the special effect type of the virtual gift, so that the making experience of the customized virtual gift is further improved, and the interactive experience of presenting the customized virtual gift by audiences can be improved.

In an alternative embodiment, the anchor may be prompted to change the value of the customized virtual gift after the anchor selects a specific type of customized virtual gift, and may also be prompted for an increased value of the customized virtual gift.

Since the customized virtual gift image, the customized virtual gift name and the customized virtual gift value are all set by the anchor, in order to prevent illegal operation, illegal review needs to be performed on the information, specifically, the server performs illegal review on the customized virtual gift image, the customized virtual gift name and the customized virtual gift value, and if the illegal review fails, illegal notification information is sent to the anchor client; and the anchor client receives the violation notification information and displays the violation notification information in a live broadcasting room interface.

The server cannot generate custom virtual gift data when the custom virtual gift fails the illegal review, which means that the custom virtual gift cannot be put on shelf and cannot be displayed in the virtual gift bar of the client.

In this embodiment, the customized virtual gift can conform to national and industrial regulations by performing violation review on the customized virtual gift image, the customized virtual gift name and the customized virtual gift value.

Referring to fig. 11, fig. 11 is a schematic flowchart of a live broadcast interaction method based on a customized virtual gift according to a second embodiment of the present application, including the following steps:

s201: the server responds to a user-defined virtual gift making and opening request sent by the anchor client, an entity gift image is obtained, the type of the entity gift is obtained according to the entity gift image, and if the type of the entity gift is a preset wearable type, wearing selection control data is sent to the anchor client.

S202: the anchor client receives the wearing selection control data, displays the wearing selection control in a user-defined virtual gift making interface according to the wearing selection control data, and sends a wearing selection result to the server; the wearing selection control is used for receiving a wearing selection result input by the anchor broadcast, and the wearing selection result is used for determining whether a custom virtual gift corresponding to the entity gift image needs to be displayed at a wearing part corresponding to a wearable category in a live broadcast video picture.

S203: the server responds to a user-defined virtual gift generation request sent by the anchor client and acquires a user-defined virtual gift image, a user-defined virtual gift name and a user-defined virtual gift value; the user-defined virtual gift image is an animation image generated based on the entity gift image; the physical gift image shows the physical gift selected by the anchor.

S204: the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value.

S205: the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client; the client is a main broadcasting client or a spectator client which is added into a live broadcasting room.

S206: the client receives the virtual gift certificate data and displays the virtual gift certificate with the self-defined virtual gift certificate in the live broadcast interface according to the virtual gift certificate data.

In this embodiment, S203 to S206 are the same as steps S101 to S104 in the first embodiment, and specifically, reference may be made to the description of the first embodiment, and the following describes steps S201 to S202 in detail, specifically as follows:

regarding step S201, the server responds to the customized virtual gift manufacturing start request sent by the anchor client, acquires the entity gift image, obtains the type of the entity gift by identifying the entity gift image, and issues the wearing selection control data to the anchor client if the entity gift type is a preset wearable type.

The preset wearable categories include necklaces, glasses, hats, hair accessories and the like.

The wearing selection control data comprises display data of the wearing selection control and function data of the wearing selection control, the display data of the wearing selection control is used for determining a display style, a display size, a display position and the like of the wearing selection control, and the function data of the wearing selection control is used for receiving a wearing selection result input by the anchor.

In step S202, the anchor client receives the wearing selection control data, displays the wearing selection control in the custom virtual gift making interface according to the wearing selection control data, and sends a wearing selection result to the server.

And the wearing selection result is used for determining whether the custom virtual gift corresponding to the entity gift image needs to be displayed at a wearing part corresponding to the wearable category in the live video picture.

And if the wearing selection result is wearing, displaying the self-defined virtual gift corresponding to the entity gift image at a wearing part corresponding to the wearable category in the live video picture. For example: the type of the entity gift is necklace, and then the self-defined virtual gift corresponding to the entity gift image needs to be displayed at a wearing part corresponding to the necklace in the live video picture, namely the neck of the anchor.

Specifically, the method further comprises the steps that the server responds to the virtual gift giving request, obtains the virtual gift identification, and sends out a virtual gift wearing display instruction if the virtual gift corresponding to the virtual gift identification is the user-defined virtual gift and the wearing selection result corresponding to the user-defined virtual gift is wearing; the client responds to the virtual gift wearing display instruction, obtains the live video picture after mixed flow, and displays the live video picture after mixed flow in a live broadcasting room interface.

The virtual gift wearing display instruction at least comprises a wearing part corresponding to the user-defined virtual gift.

The live video picture after the mixed flow is obtained according to the user-defined virtual gift image, the live video picture and the display position mixed flow of the wearing part corresponding to the user-defined virtual gift in the live video picture. The execution subject of the mixed flow can be a server or a client, and is not limited herein.

In this embodiment, the server responds to a custom virtual gift production start request sent by the anchor client to obtain an entity gift image, the entity gift image is identified to obtain the category of the entity gift, if the entity gift category is a preset wearable category, wearing selection control data is sent to the anchor client, the anchor client receives the wearing selection control data, the wearing selection control is displayed in a custom virtual gift production interface according to the wearing selection control data, and a wearing selection result is sent to the server, in the embodiment, for an entity gift belonging to the wearable category, the anchor can select whether to display the custom virtual gift corresponding to the entity gift image at a wearing part corresponding to the wearable category in a live video picture, so as to further improve the controllability of the anchor in the custom virtual gift production, and the experience that audience present custom virtual gifts can be further improved, and the generation of live broadcast interaction behavior is promoted.

Referring to fig. 12, fig. 12 is a schematic flowchart of a live broadcast interaction method based on a customized virtual gift according to a third embodiment of the present application, including the following steps:

s301: the anchor client acquires a custom virtual gift name, a custom virtual gift value and target user information, displays the custom virtual gift name, the custom virtual gift value and the target user information in a custom virtual gift making interface, and sends the custom virtual gift name, the custom virtual gift value and the target user information to a server; the user-defined virtual gift name, the user-defined virtual gift value and the target user information are obtained after interaction of a name input control, a value input control and a user information input control displayed in a manufacture interface of the anchor and the user-defined virtual gift, or the user-defined virtual gift name, the user-defined virtual gift value and the target user information are obtained by identification from live broadcast audio data collected by an anchor client.

S302: the server responds to a user-defined virtual gift generation request sent by the anchor client side, and obtains a user-defined virtual gift image, a user-defined virtual gift name, a user-defined virtual gift value and a target user identifier corresponding to target user information; the user-defined virtual gift image is an animation image generated based on the entity gift image; the physical gift image shows the physical gift selected by the anchor.

S303: the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value.

S304: the server responds to the virtual gift bar display request of the client, and if the client is the anchor client or the client is the audience client corresponding to the target user identification, virtual gift bar data containing the user-defined virtual gift data is issued to the client.

S305: the client receives the virtual gift certificate data and displays the virtual gift certificate with the self-defined virtual gift certificate in the live broadcast interface according to the virtual gift certificate data.

Steps S303 and S305 are the same as steps S102 and S104 in the first embodiment, and the description of the first embodiment can be specifically referred to, and steps S301, S302, and S304 are described below, specifically as follows:

in this embodiment, the anchor client not only obtains the customized virtual gift value of the customized virtual gift name, but also obtains the target user information, displays the target user information in the customized virtual gift making interface, and also sends the target user information to the server.

The target user information is obtained after interaction between the anchor and a user information input control displayed in the user-defined virtual gift making interface, or is obtained by identification from live broadcast audio data collected by an anchor client.

Referring to fig. 13, fig. 13 is a further schematic diagram illustrating a customized virtual gift-making interface according to an embodiment of the present application, and as can be seen from fig. 13, a name input control 74, a value input control 75, and a user information input control 76 are displayed in the customized virtual gift-making interface 7.

In an alternative embodiment, automatic population of target user information, which may be the age group or target user name of the target user, etc., may occur at the user information input control 76.

The automatically filled target user information is obtained by the server according to the virtual gift giving record of the audience in the live broadcast room.

Specifically, the server may obtain the age group of the audience presenting the virtual gift in the live broadcast room according to the virtual gift presenting record, and automatically fill the age group presenting the most virtual gift in the user information input control.

The server can also obtain the total value of presenting the virtual gift by each user in the live broadcast room according to the virtual gift presenting record, obtain the target user names corresponding to the top N target users with the total value arranged, and fill the target user names corresponding to the top N target users into the user information input control. N is a positive integer not less than 1.

The automatically filled target user information can provide a certain reference for the anchor, and the anchor can also carry out self-defined modification adjustment.

Regarding that the target user information is identified from the live audio data collected by the anchor client, it should be noted that the semantic analysis method for the live audio data is any existing semantic analysis method, and the target user information in the live audio data can be identified by performing semantic analysis. For example: the anchor says "User 1 is the User, customize virtual gift A, virtual gift value is B", the target User information that can be obtained after semantic analysis is the target User name User 1.

After making the exclusive self-defined virtual gift, the server responds to the virtual gift bar display request of the client, needs to judge whether the client is the main broadcasting client or the audience client corresponding to the target user identification, and if so, then sends the virtual gift bar data containing the self-defined virtual gift data to the client.

And the target user identification is the target user identification corresponding to the target user information.

In this embodiment, the anchor can make an exclusive custom virtual gift for the target user, so that the target user can give the exclusive custom virtual gift in the live broadcast room, thereby further improving the viscosity between the anchor and the audience user and promoting the generation of live broadcast interaction behavior.

In an alternative embodiment, for a proprietary custom virtual gift, the target user may also update the custom virtual gift parameters.

Specifically, the audience client corresponding to the target user identifier responds to the custom virtual gift parameter setting instruction, obtains a custom virtual gift color, a custom virtual gift display position, a custom virtual gift display duration and/or custom virtual gift sharing information, and sends the custom virtual gift color, the custom virtual gift display position, the custom virtual gift display duration and/or the custom virtual gift sharing information to the server.

The customized virtual gift parameter setting instruction may be issued after the target user successfully triggers the customized virtual gift, for example: and long-pressing the self-defined virtual gift in the virtual gift box.

The user-defined virtual gift parameter setting instruction at least comprises a user-defined virtual gift identifier.

And then, the server receives the custom virtual gift color, the custom virtual gift display position, the custom virtual gift display duration and/or the custom virtual gift sharing information, updates the custom virtual gift data according to the custom virtual gift color, the custom virtual gift display position and/or the custom virtual gift display duration, judges whether the custom virtual gift sharing information is shared or not when the server responds to a virtual gift bar display request of the audience client, and if so, sends the virtual gift bar data containing the updated custom virtual gift data to the audience client.

In this embodiment, the target user can update the color, the display position and the display duration of the customized virtual gift, and can also determine whether to share the customized virtual gift with other audiences in the live broadcast room, if the target user shares the customized virtual gift with other audiences in the live broadcast room, when the audience client in the live broadcast room requests to display the virtual gift bar, the server can send the virtual gift bar data containing the updated customized virtual gift data to the audience client, so that other audiences in the live broadcast room can give the customized virtual gift, and further, the target user can participate in the production of the customized virtual gift, the live broadcast interaction participation of the target user is improved, and the generation of the interaction behavior of other audiences can be promoted.

Referring to fig. 14, fig. 14 is a schematic structural diagram of a live interactive system based on a customized virtual gift according to a fourth embodiment of the present application, where the system 14 includes: a server 141 and a client 142; clients 142 include a cast client 1421 and a viewer client 1422;

the server 141 is configured to obtain a customized virtual gift image, a customized virtual gift name, and a customized virtual gift value in response to a customized virtual gift generation request sent by the anchor client 1421; the user-defined virtual gift image is an animation image generated based on the entity gift image; the entity gift image displays the entity gift selected by the anchor;

the server 141 is configured to generate custom virtual gift data according to the custom virtual gift image, the custom virtual gift name, and the custom virtual gift value;

the server 141 is configured to issue virtual gift certificate data including the custom virtual gift data to the client 142 in response to a virtual gift certificate display request of the client 142; among them, the client 142 is a main broadcasting client 1421 or a viewer client 1422 that has joined the live broadcasting room;

the client 142 is configured to receive the virtual gift bar data, and present the virtual gift bar with the customized virtual gift in the live broadcast interface according to the virtual gift bar data.

The live broadcast interaction system based on the customized virtual gift provided by the embodiment and the live broadcast interaction method based on the customized virtual gift belong to the same concept, and the implementation process is detailed in the method embodiment and is not repeated here.

Please refer to fig. 15, which is a schematic structural diagram of a computer device according to a fifth embodiment of the present application. As shown in fig. 15, the computer device 15 may include: a processor 150, a memory 151, and a computer program 152 stored in the memory 151 and operable on the processor 150, for example: live broadcast interactive program based on self-defined virtual gift; the steps in the first to third embodiments described above are implemented when the processor 150 executes the computer program 152.

The processor 150 may include one or more processing cores, among others. The processor 150 is connected to various parts in the computer device 15 by various interfaces and lines, executes various functions of the computer device 15 and processes data by executing or executing instructions, programs, code sets or instruction sets stored in the memory 151 and calling data in the memory 151, and optionally, the processor 150 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), Programmable Logic Array (PLA). The processor 150 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the touch display screen; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 150, but may be implemented by a single chip.

The Memory 151 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 151 includes a non-transitory computer-readable medium. The memory 151 may be used to store instructions, programs, code sets or instruction sets. The memory 151 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 151 may optionally be at least one memory device located remotely from the processor 150.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps of the foregoing embodiment, and a specific execution process may refer to specific descriptions of the foregoing embodiment, which is not described herein again.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules, so as to perform all or part of the functions described above. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, a module or a unit may be divided into only one logical function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium and used by a processor to implement the steps of the above-described embodiments of the method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc.

The present invention is not limited to the above-described embodiments, and various modifications and variations of the present invention are intended to be included within the scope of the claims and the equivalent technology of the present invention if they do not depart from the spirit and scope of the present invention.

Claims

1. A live broadcast interaction method based on a custom virtual gift is characterized by comprising the following steps:

the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client; the client is the anchor client or an audience client which is added into a live broadcast room;

and the client receives the virtual gift certificate data and presents the virtual gift certificate with the self-defined virtual gift certificate in a live broadcast interface according to the virtual gift certificate data.

2. The live interactive method based on customized virtual gift, as claimed in claim 1, wherein said server responds to the customized virtual gift generation request sent by the anchor client, and comprises the following steps:

the server responds to a user-defined virtual gift making starting request sent by the anchor client to acquire a live video picture acquired by the anchor client; wherein the entity gift is placed on the hand of the anchor in the live video picture;

the server positions a hand area in the live video picture according to the live video picture and a preset human body part identification method;

the server acquires the boundary position of the entity gift according to a hand area in the live video picture and a preset object boundary detection method;

and the server cuts the entity gift image from the live video picture according to the boundary position of the entity gift.

3. The live interactive method based on customized virtual gift, as claimed in claim 1, wherein said server responds to the customized virtual gift generation request sent by the anchor client, and comprises the following steps:

the server responds to a user-defined virtual gift making starting request sent by the anchor client side, and a first shot image and an entity gift area selected by the anchor in the first shot image are obtained; wherein the first photographed image is an image of the physical gift photographed in a preset background;

the server acquires the boundary position of the entity gift according to the entity gift area in the first shot image and a preset object boundary detection method;

the server cuts the physical gift image from the first photographed image according to the boundary position of the physical gift.

4. The customized virtual gift-based live interactive method as claimed in any one of claims 1 to 3, wherein said server responds to the virtual gift customized generation request sent by the anchor client, and comprises the following steps:

the server responds to a custom virtual gift making starting request sent by the anchor client, obtains the entity gift image, inputs the entity gift image into a pre-trained animation image generation network, and obtains the custom virtual gift image; the pre-trained animation image generation network is obtained according to a plurality of entity gift training images and animation images corresponding to the entity gift training images, and the animation styles of the animation images corresponding to the entity gift training images are the same.

5. The customized virtual gift-based live interactive method as claimed in any one of claims 1 to 3, wherein said server responds to the virtual gift customized generation request sent by the anchor client, and comprises the following steps:

the server responds to a user-defined virtual gift making starting request sent by the anchor client, a plurality of animation styles matched with the entity gift image and the live broadcast room are obtained, the entity gift image is input to a pre-trained animation image generation network under each animation style, a user-defined virtual gift image under each animation style is obtained, and the user-defined virtual gift image under each animation style is sent to the anchor client; the pre-trained animation image generation network under each animation style is obtained by training a plurality of entity gift training images and animation images under the animation styles corresponding to the entity gift training images respectively, and a plurality of animation styles matched with the live broadcast room are determined according to preference data of users in the live broadcast room;

the anchor client receives each customized virtual gift image in the animation style, displays each customized virtual gift image in the animation style in a customized virtual gift manufacturing interface, and sends the customized virtual gift image in the target animation style selected by the anchor to the server.

6. The customized virtual gift-based live interactive method as claimed in any one of claims 1 to 3, wherein said server responds to the virtual gift customized generation request sent by the anchor client, and comprises the following steps:

the anchor client acquires the custom virtual gift name and the custom virtual gift value, displays the custom virtual gift name and the custom virtual gift value in a custom virtual gift making interface, and sends the custom virtual gift name and the custom virtual gift value to the server; the user-defined virtual gift name and the user-defined virtual gift value are obtained after interaction between the anchor and a name input control and a value input control displayed in a user-defined virtual gift manufacturing interface, or the user-defined virtual gift name and the user-defined virtual gift value are obtained by identification from live broadcast audio data collected by an anchor client.

7. The live interactive method based on customized virtual gift as claimed in claim 6, wherein said server responds to the virtual gift customized generation request sent by the host client, and further comprising the steps of:

the anchor client responds to a custom virtual gift parameter modification instruction, acquires a modified custom virtual gift name and a modified custom virtual gift value, displays the modified custom virtual gift name and the modified custom virtual gift value in a custom virtual gift manufacturing interface, and sends the modified custom virtual gift name and the modified custom virtual gift value to the server; the modified custom virtual gift name and the modified custom virtual gift value are obtained after interaction between the anchor and the name input control and the value input control displayed in the custom virtual gift manufacturing interface, or the modified custom virtual gift name and the modified custom virtual gift value are obtained by identification from audio live broadcast data collected by the anchor client.

8. The customized virtual gift-based live interactive method as claimed in any one of claims 1 to 3, wherein said server responds to the virtual gift customized generation request sent by the anchor client, and comprises the following steps:

the server responds to a custom virtual gift making starting request sent by the anchor client to obtain a custom virtual gift image;

the server obtains a plurality of types of customized virtual gift special effect data according to the customized virtual gift image and the plurality of types of virtual gift special effect types, and sends the plurality of types of customized virtual gift special effect data to the anchor client;

the anchor client receives a plurality of types of the custom virtual gift special effect data, displays a plurality of types of custom virtual gift special effects in a custom virtual gift manufacturing interface according to the plurality of types of the custom virtual gift special effect data, acquires a custom virtual gift special effect type selected by the anchor, and sends the custom virtual gift special effect type to the server.

9. The live interactive method based on customized virtual gift as claimed in claim 8, wherein the step of obtaining the customized virtual gift image, the customized virtual gift name and the customized virtual gift value further comprises:

the server acquires the special effect type of the customized virtual gift;

the server generates custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value, and the method comprises the following steps:

the server obtains custom virtual gift special effect data corresponding to the custom virtual gift special effect type, and generates the custom virtual gift data according to the custom virtual gift image, the custom virtual gift name, the custom virtual gift value and the custom virtual gift special effect data.

10. The customized virtual gift-based live interactive method as claimed in any one of claims 1 to 3, wherein said server responds to the virtual gift customized generation request sent by the anchor client, and comprises the following steps:

the server responds to a user-defined virtual gift making starting request sent by the anchor client, acquires the entity gift image, acquires the type of the entity gift according to the entity gift image, and sends wearing selection control data to the anchor client if the type of the entity gift is a preset wearable type;

the anchor client receives the wearing selection control data, displays the wearing selection control in a user-defined virtual gift making interface according to the wearing selection control data, and sends a wearing selection result to the server; the wearing selection control is used for receiving the wearing selection result input by the main broadcast, and the wearing selection result is used for determining whether the custom virtual gift corresponding to the entity gift image needs to be displayed at a wearing part corresponding to the wearable category in a live video picture.

11. The live interactive method based on customized virtual gifts as claimed in claim 10, further comprising the steps of:

the server responds to a virtual gift giving request, acquires a virtual gift identifier, and sends a virtual gift wearing display instruction if a virtual gift corresponding to the virtual gift identifier is the user-defined virtual gift and the wearing selection result corresponding to the user-defined virtual gift is wearing; the virtual gift wearing display instruction at least comprises a wearing part corresponding to the self-defined virtual gift;

the client responds to the virtual gift wearing display instruction, obtains the mixed flow live video picture, and displays the mixed flow live video picture in the live broadcasting room interface; and the live video picture after the mixed flow is obtained according to the user-defined virtual gift image, the live video picture and the display position mixed flow of the wearing part corresponding to the user-defined virtual gift in the live video picture.

12. The customized virtual gift-based live interactive method of claim 6, wherein before the server responds to the virtual gift customized generation request sent by the anchor client, the method further comprises the following steps:

the anchor client acquires target user information and displays the target user information in the user-defined virtual gift making interface; the target user information is obtained after interaction between the anchor and a user information input control displayed in the user-defined virtual gift making interface, or the target user information is obtained by identification from the live broadcast audio data collected by the anchor client.

13. The live interactive method based on customized virtual gift as claimed in claim 12, wherein the step of obtaining the customized virtual gift image, the customized virtual gift name and the customized virtual gift value further comprises:

the server acquires a target user identifier corresponding to the target user information;

the server responds to a virtual gift bar display request of the client and issues virtual gift bar data containing the user-defined virtual gift data to the client, and the method comprises the following steps:

and the server responds to a virtual gift bar display request of a client, and if the client is the anchor client or the client is an audience client corresponding to the target user identification, virtual gift bar data containing the custom virtual gift data is issued to the client.

14. The live interactive method based on customized virtual gift, as recited in claim 13, wherein the client receives the virtual gift certificate data, and after presenting the virtual gift certificate with customized virtual gift in the live interface according to the virtual gift certificate data, further comprising the steps of:

the audience client corresponding to the target user identification responds to a user-defined virtual gift parameter setting instruction to obtain user-defined virtual gift color, user-defined virtual gift display position, user-defined virtual gift display duration and/or user-defined virtual gift sharing information, and sends the user-defined virtual gift color, the user-defined virtual gift display position, the user-defined virtual gift display duration and/or the user-defined virtual gift sharing information to the server;

the server receives the custom virtual gift color, the custom virtual gift display position, the custom virtual gift display duration and/or the custom virtual gift sharing information, updates the custom virtual gift data according to the custom virtual gift color, the custom virtual gift display position and/or the custom virtual gift display duration, judges whether the custom virtual gift sharing information is shared or not when responding to the virtual gift bar display request of the audience client, and if so, issues the virtual gift bar data containing the updated custom virtual gift data to the audience client.

15. The live interactive method based on customized virtual gifts as claimed in any one of claims 1 to 3, wherein before the server generates customized virtual gifts data according to the customized virtual gifts image, the customized virtual gifts name and the customized virtual gifts value, the method comprises the following steps:

the server conducts violation examination on the self-defined virtual gift image, the self-defined virtual gift name and the self-defined virtual gift value, and if the violation examination fails, violation notification information is sent to the anchor client;

and the anchor client receives the violation notification information and displays the violation notification information in the live broadcast interface.

16. A live broadcast interactive system based on a custom virtual gift is characterized by comprising: a server and a client; the client comprises a main broadcasting client and an audience client;

the server is used for generating custom virtual gift data according to the custom virtual gift image, the custom virtual gift name and the custom virtual gift value;

the server is used for responding to a virtual gift bar display request of the client and issuing virtual gift bar data containing the user-defined virtual gift data to the client; the client is the anchor client or an audience client which is added into a live broadcast room;

and the client is used for receiving the virtual gift certificate data and displaying the virtual gift certificate with the self-defined virtual gift in a live broadcast interface according to the virtual gift certificate data.

17. A computer device, comprising: processor, memory and computer program stored in the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1 to 15 are implemented when the processor executes the computer program.

18. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 15.