CN113329234B - Live broadcast interaction method and related equipment - Google Patents

Live broadcast interaction method and related equipment Download PDF

Info

Publication number
CN113329234B
CN113329234B CN202110592990.2A CN202110592990A CN113329234B CN 113329234 B CN113329234 B CN 113329234B CN 202110592990 A CN202110592990 A CN 202110592990A CN 113329234 B CN113329234 B CN 113329234B
Authority
CN
China
Prior art keywords
gift
live broadcast
virtual
gesture
triggering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110592990.2A
Other languages
Chinese (zh)
Other versions
CN113329234A (en
Inventor
徐冬博
蔡钦童
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202110592990.2A priority Critical patent/CN113329234B/en
Publication of CN113329234A publication Critical patent/CN113329234A/en
Application granted granted Critical
Publication of CN113329234B publication Critical patent/CN113329234B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4784Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards

Abstract

The application provides a live broadcast interactive method and related equipment, wherein a user in a live broadcast room presents a virtual gift to another user, the virtual gift is displayed on the live broadcast page, the gift receiving object can execute gesture triggering operation aiming at the virtual gift, corresponding gift triggering gesture is made, the obtained gift triggering image is displayed in the live broadcast page, under the condition that the gift triggering image and the virtual gift meet the gift triggering condition, the first special effect triggered by the virtual gift is directly displayed, the paying feeling of receiving live gifts by gift receiving objects is enhanced, the stickiness of the live broadcast rooms is increased, the interactive modes of displaying and receiving live gifts are enriched, and each user in the live broadcast room can visually see the process that the gift receiving object triggers the virtual gift receiving, so that the sense of importance of the gift receiving object on the gift presented by the gift presenting object is improved, and the participation enthusiasm of the user is improved.

Description

Live broadcast interaction method and related equipment
Technical Field
The application relates to the technical field of internet, in particular to a live broadcast interaction method and related equipment.
Background
In recent years, with the rapid development of internet communication technology, webcasting has been widely popularized so as to have the advantages of intuition, rapidness, good expression form, rich content, strong interactivity, unlimited region, divisible audience and the like of internet, and a webcasting can be used for live broadcasting by logging in webcasting application, and audiences can enter interested live broadcasting rooms by logging in webcasting application to watch the content of the webcasting live broadcasting.
After the audience enters the live broadcast room, the audience usually watches the live broadcast content of the anchor, or chats with the anchor in modes of voice, characters and the like, and the monotonous live broadcast interaction mode easily consumes the favor of the audience on the anchor and reduces the viscosity of the live broadcast room.
Disclosure of Invention
In view of this, in order to enrich the live broadcast interactive mode, increase the interest of the interaction and audience interaction enthusiasm, in order to increase the love of audience to the anchor, thus improve the viscidity of audience to the live broadcast room, the following technical scheme is proposed in the application:
on one hand, the application provides a live broadcast interaction method, which comprises the following steps:
outputting a live broadcast page of a live broadcast room, and displaying live broadcast content on the live broadcast page;
presenting a virtual gift for a gift receiving object of the live broadcast room;
responding to the gesture triggering operation of the gift receiving object on the displayed virtual gift, and displaying a corresponding gift triggering image on the live broadcast page; wherein the gift triggering image comprises a gift triggering gesture made by the gift receiving object;
in response to the gift triggering image displayed on the live page and the virtual gift meeting a gift triggering condition, displaying a first special effect triggered by the virtual gift.
In some embodiments, the method further comprises:
responding to the motion track information of the gift triggering gesture recognized from the live video stream of the live broadcast page, and dynamically displaying the gift triggering image according to the motion track of the gift triggering gesture;
the gift triggering image and the virtual gift displayed on the live broadcast page meet gift triggering conditions, which include:
the first display position of the gift trigger image dynamically displayed by the live broadcast page is matched with the specific display position of the virtual gift.
In some embodiments, the method further comprises, in presenting the first special effect that the virtual gift is triggered, the step of:
displaying respective object identifications of a gift sending object and a gift receiving object of the virtual gift on the live broadcast page; and/or the presence of a gas in the gas,
and outputting the voice prompt message that the gift receiving object successfully receives the virtual gift given by the gift sending object.
In some embodiments, in a process in which the gift triggering image and the virtual gift displayed in response to the live page satisfy a gift triggering condition, the method further includes:
updating the displayed virtual gift into a virtual gift output to be triggered with a second special effect;
the presenting the triggered first special effect of the virtual gift comprises:
and responding to the display duration of the virtual gift to be triggered to reach a first duration, and skipping to display the triggered first special effect of the virtual gift to be triggered.
In some embodiments, the updating the virtual gift to be presented to a to-trigger virtual gift output having a second special effect includes:
and adding a second special effect map in the gift triggering image at a specific position of the virtual gift, and magnifying and displaying the obtained virtual gift to be triggered with the second special effect.
In some embodiments, the method further comprises:
canceling the display of the virtual gift in response to the display duration of the virtual gift reaching a second duration and the gift triggering image not being recognized from the live video stream of the live broadcast page; and/or the presence of a gas in the gas,
and canceling the display of the virtual gift in response to the display duration of the virtual gift reaching a third duration and the gift triggering image displayed on the live broadcast page and the virtual gift not meeting the gift triggering condition.
In some embodiments, the presenting the first effect that the virtual gift is triggered comprises:
and playing a first special effect video file triggered aiming at the virtual gift, and displaying the first special effect triggered by the virtual gift on the live broadcast page.
In some embodiments, the virtual gift comprises a fireworks gift, and the displaying of the corresponding gift-triggering image on the live page in response to the gesture-triggered operation of the gift-receiving object on the displayed virtual gift comprises:
in response to a firework ignition gesture operation performed by the gift receiving object on the displayed firework gift, increasing display of a flame image at a specific display position of the recognized firework ignition gesture;
the displaying the first special effect that the virtual gift is triggered in response to the gift triggering image displayed on the live page and the virtual gift meeting a gift triggering condition comprises:
and responding to the flame image on the firework ignition gesture displayed on the live broadcast page, at least partially overlapping with a fuse display area contained in the firework gift, and displaying a firework bursting effect on the live broadcast page.
In some embodiments, in the presenting a virtual gift for a gift object of the live broadcast room, the method further comprises:
outputting a gift receiving notice in the live broadcast page displayed by the live broadcast client of the gift receiving object;
wherein the gift reception notification comprises a gift reception prompting message for the virtual gift, and/or gesture prompting information that the virtual object is triggered.
In some embodiments, the obtaining of the gift-triggering gesture includes:
acquiring gesture recognition information of the gift receiving object; the gesture recognition information is obtained by performing gesture recognition on the collected hand image of the gift receiving object;
determining the gesture type of the current gesture made by the gift receiving object by utilizing the gesture recognition information;
and if the gesture type is consistent with the trigger gesture type of the virtual gift, determining the current gesture as the gift trigger gesture of the virtual gift.
In some embodiments, in a case that the gift-receiving object is a first viewer of the live broadcast room and the gift-sending object is a main broadcast of the live broadcast room, the obtaining of the gesture recognition information includes:
skipping to display an identity verification panel of a gift receiving object aiming at the virtual gift in the live broadcast page output by the live broadcast terminal of the first audience;
outputting an authentication qualified notification in response to an authentication input operation of the first viewer with respect to the authentication panel;
responding to the gesture input operation of the first audience aiming at the virtual gift, and sending the obtained gesture recognition information to each live broadcast terminal of the live broadcast room for processing.
In another aspect, the present application provides a live interactive device, including:
the live broadcast content display module is used for outputting a live broadcast page of a live broadcast room and displaying live broadcast content on the live broadcast page;
the virtual gift display module is used for displaying a virtual gift of a gift receiving object aiming at the live broadcast room;
the gift triggering module is used for responding to the gesture triggering operation of the gift receiving object on the displayed virtual gift and displaying a corresponding gift triggering image on the live broadcast page; wherein the gift triggering image comprises a gift triggering gesture made by the gift receiving object;
and the special effect display module is used for responding to the gift triggering image displayed on the live broadcast page and the virtual gift meeting gift triggering conditions and displaying a first special effect triggered by the virtual gift.
In yet another aspect, the present application provides an electronic device, including: display screen, communication interface, memory and processor, wherein:
the memory is used for storing a program for realizing the live broadcast interaction method;
the processor is configured to load and execute the program stored in the memory, so as to implement the steps of the live broadcast interaction method.
In yet another aspect, the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is called and executed by a processor to implement the steps of the live broadcast interaction method.
Therefore, in the embodiment of the application, in the live broadcast process of the live broadcast room, if a certain user in the live broadcast room presents a virtual gift to another user, the application displays the virtual gift to be presented in the live broadcast page displaying the live broadcast content, the gift receiving object sees the virtual gift, and/or after receiving a corresponding gift receiving notice, directly executes gesture trigger operation on the virtual gift to make a corresponding gift trigger gesture, displays the obtained gift trigger image in the live broadcast page, and directly displays the first special effect triggered by the virtual gift under the condition that the gift trigger image and the virtual gift meet the gift trigger condition, enriches the live broadcast gift display and collection interaction modes, enables each user in the live broadcast room to visually see the process that the gift receiving object triggers the virtual gift receiving process, and enhances the payment feeling of the gift receiving object, the sense of attention of the gift receiving object to the gift given by the gift sending object is also improved, the user is prevented from excessively consuming the love of the anchor, so that the user can generate emotional coupling in the process of virtual gift giving and triggering acceptance, the stickiness of the live broadcast room is increased through the sense of payment, the user can participate actively, and the game is experienced in an immersion mode.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic system structure diagram of an alternative application environment suitable for the live broadcast interaction method and apparatus provided in the present application;
fig. 2 is a schematic flowchart of an alternative example of a live broadcast interaction method proposed in the present application;
fig. 3 is a schematic diagram illustrating different gift triggering gestures for different types of virtual gifts in the live broadcast interaction method provided by the present application;
fig. 4 is a schematic flowchart of another alternative example of the live broadcast interaction method proposed in the present application;
fig. 5 is a schematic flowchart illustrating an alternative example of determining a gift triggering gesture performed by a gift-receiving object with respect to a virtual gift in the live broadcast interaction method provided in the present application;
fig. 6 is a signaling flow diagram of another alternative example of the live broadcast interaction method proposed in the present application;
7a is a schematic diagram of an optional live broadcast page output by each live broadcast terminal in the live broadcast interaction method provided by the application;
7b is a schematic diagram of a gift panel popped up from a live broadcast page output by a live broadcast terminal of a gift sending object in the live broadcast interaction method provided by the application;
7c is an optional scene schematic diagram of displaying the virtual gift on a live broadcast page output by each live broadcast terminal in the live broadcast interaction method provided by the application;
7d is an optional scene schematic diagram of a gift triggering gesture made by a gift receiving object in a live broadcast page output by each live broadcast terminal in the live broadcast interaction method provided by the application;
7e is an optional scene schematic diagram showing a virtual object with a second special effect in a live broadcast page output by each live broadcast terminal in the live broadcast interaction method provided by the application;
7f, in the live broadcast interaction method provided by the application, each live broadcast terminal outputs an optional scene schematic diagram of a virtual object with a second special effect displayed in a live broadcast page in an enlarged manner;
7g, in the live broadcast interaction method provided by the application, each live broadcast terminal outputs an optional scene schematic diagram showing a first special effect received by a virtual object in a live broadcast page;
fig. 8a is a schematic diagram of another optional scene of the live broadcast interaction method provided in the present application;
fig. 8b is a schematic diagram of another optional scene of the live broadcast interaction method provided in the present application;
fig. 9 is a schematic structural diagram of an alternative example of a live interactive device provided in the present application;
fig. 10 is a schematic hardware structure diagram of an alternative example of an electronic device according to an embodiment of the present application;
fig. 11 is a hardware configuration diagram of yet another alternative example of an electronic device according to an embodiment of the present application.
Detailed Description
Aiming at the description of the background technology, the method and the device hope to enrich the live broadcast interaction mode and increase the operation interest of the user, thereby enhancing the participation of the user and improving the viscosity of the user to the live broadcast room. The scene that the audience gives the anchor gift is taken as an example for explanation, after the audience gives the anchor gift, the anchor can be required to make a series of actions aiming at the virtual gift presented on the live broadcast page, and the corresponding special effect of the gift is displayed, so that the aim of receiving the gift by the anchor is fulfilled.
The method mainly takes a gesture interaction mode as an example to explain the live broadcast interaction method provided by the application, and the implementation processes of other action interaction modes are similar, and the application is not detailed one by one.
It should be noted that, for the scenes of live broadcast interaction including but not limited to the scenes in which the audience presents gifts to the anchor broadcasts, and for the scenes in which multiple anchor broadcasts are live broadcast and gifts are presented mutually among different anchor broadcasts, the gifts can be received by combining gestures mainly according to the above mode, so that the diversity of live broadcast interaction is improved; similarly, for the scene that the gift is given to the specific audience by the anchor broadcast, the specific audience can also carry out live broadcast interaction according to the method, the display mode of the live broadcast gift is enriched, the interaction among different identity users in a live broadcast room is enhanced, and the specific implementation process is not detailed one by one.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings. The embodiments and features of the embodiments in the present application may be combined with each other without conflict. Also, the terms "a," "an," "the," and/or "the" are not intended to refer to the singular, but may include the plural unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" are intended to cover only the explicitly identified steps or elements as not constituting an exclusive list and that the method or apparatus may comprise further steps or elements. An element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Also, in the description of the embodiments of the present application, "/" indicates an inclusive meaning unless otherwise specified, for example, a/B may indicate a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two. The terms "first", "second" and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
Additionally, flowcharts are used herein to illustrate operations performed by systems according to embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, the various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or several steps of operations may be removed from the processes.
In conjunction with the above description of the technical concept of the present application, referring to fig. 1, a schematic system structure diagram of an alternative application environment suitable for the live broadcast interaction method and apparatus provided by the present application is shown, where the system may include: a plurality of live clients 10 and a live server 20, wherein:
the live client 10 may be an application program for a user to log in a live platform to meet the requirement of the user on live broadcasting or watching live broadcasting. In practical applications, the live client 10 may be an independent application installed in an electronic device used by a user, and the user may click an application icon of the live client 10 to log in a live platform; the method may also be a live client of a web page version, that is, a user may open a corresponding live web page according to an application program such as a browser, etc. by using the electronic device, watch live on the live web page or open a live room for live broadcast, etc. the specific type of the live client 10 is not limited in the present application, and may be determined according to circumstances.
It should be understood that the live broadcast platform is a multifunctional network live broadcast platform which integrates audio, video, desktop sharing, document sharing and interaction links and is constructed on the network by utilizing the internet and multimedia communication technology according to real-time social needs, and enterprises or individuals and the like can utilize the live broadcast platform to perform comprehensive communication and interaction of voice, video and data on line.
The electronic device may be a user terminal capable of performing human-computer interaction through one or more modes such as a keyboard, a touch screen, and voice interaction, and may specifically include, but not limited to, a smart phone, a tablet computer, a personal computer (UMPC), a desktop computer, a wearable device, a smart home device, and an in-vehicle device. The user can start the live broadcast client 10 of the electronic device, log in the personal account registered by the live broadcast platform, configure or update personal data information, communicate with other users logging in the live broadcast platform, and the like, and the implementation process and the live broadcast working principle of how the user logs in the live broadcast platform by using the live broadcast client 10 are not detailed in the application.
It should be understood that in any live broadcast room (denoted as live broadcast room a), a user who opens the live broadcast room to perform live broadcast may be referred to as anchor a, an electronic device used by anchor a who opens the live broadcast room may be denoted as an anchor terminal, and a live broadcast client used may be denoted as an anchor client; similarly, a user who enters the live broadcast room to watch live broadcast is taken as a spectator, the electronic equipment used by the spectator at the moment can be recorded as a spectator terminal, and the used live broadcast client is recorded as a spectator client.
If the anchor a of the live broadcast room a enters the live broadcast room B as a viewer, and the anchor watching the live broadcast of the live broadcast room B performs live broadcast, for the live broadcast room B, the electronic device used by the anchor a may be recorded as a viewer terminal, and the live broadcast client used may be recorded as a viewer client. It can be seen that the same user may be in the form of an anchor identity or an audience identity in different live broadcast rooms, and the role of the live broadcast client used by the same user may be determined specifically according to the identity of the user in the current live broadcast room.
The live broadcast server 20 may be a service device that manages resources and provides each live broadcast interaction function for the live broadcast client 10 started by the user, specifically, an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, a cloud server that provides cloud computing services, and the like.
In practical applications, the live broadcast server 20 can also push various notifications, such as an information update release notification, a main broadcast reward notification, a gift presentation success/failure notification, and the like, to each live broadcast client that logs in to the live broadcast platform, which can be determined according to a specific application scenario.
It should be understood that the system structure shown in fig. 1 does not constitute a limitation to the system of the application environment proposed in the embodiment of the present application, and in practical applications, the system may include more or fewer devices than those shown in fig. 1, or may combine some subsystems, such as a data storage device (e.g., a database server) for storing various live interaction data generated by the live client running, and various configuration information set by the user for the personal live account, and the present application is not listed here.
In some embodiments, for some important data obtained by a user using a live client, storage may be implemented by a distributed cloud storage system in a cloud storage (cloud storage) manner. Under the condition, each terminal of the live client is installed, various live servers corresponding to the live client can form a block chain, one electronic device/live server can be a node on the block chain, a user starts the live client by using a certain electronic device, data interaction with the live server can be achieved through a wired network or a wireless network, the interactive operation requirements of the user on each control displayed by the live client are met, and meanwhile the safe storage requirements of certain important data can also be met.
Referring to fig. 2, a flow chart of an alternative example of the live interactive method proposed by the present application is illustrated, and the method may be applied to an electronic device, and the product type of the electronic device may include, but is not limited to, the above listed electronic devices, as appropriate. As shown in fig. 2, the live broadcast interaction method provided in the embodiment of the present application may include, but is not limited to, the following steps:
step S11, outputting a live broadcast page of a live broadcast room, and displaying live broadcast content on the live broadcast page;
in combination with the related description of the live client, the user starts the live client, and after logging in the personal live account registered by the live platform, the live client establishes communication connection with the live server to realize data interaction between the live client and the live server and meet the live demand of the user. If the user can select any live broadcast room to enter, the live broadcast page of the live broadcast room is displayed on the live broadcast terminal used by the user, and the live broadcast content of the main broadcast of the live broadcast room is displayed in the live broadcast area of the live broadcast page.
Certainly, after the user logs in the live broadcast platform, the user can also apply for opening a certain live broadcast room as the anchor to carry out live broadcast, so that on the live broadcast terminal used by each user entering the live broadcast room, the live broadcast page of the live broadcast room opened by the anchor is output, the live broadcast content of the anchor is displayed in the live broadcast page, and the application carries out live broadcast on the live broadcast room opened by the user or does not detail the specific implementation process of watching live broadcast entering the existing live broadcast room.
Step S12, showing the virtual gift of the gift receiving object of the live broadcast room;
in the live broadcast process of the live broadcast room, if a certain user gives a gift to another user, for example, a certain audience gives a gift to a main broadcast of the live broadcast room, the audience can click a gift-giving function button in a live broadcast page displayed by a live broadcast terminal, a gift panel is output, at least one virtual gift (namely a virtual gift image) to be selected is displayed on the gift panel, the audience can select one virtual gift from the virtual gift according to actual conditions, and the gift-giving button is clicked to request the selected virtual gift to be sent to the main broadcast.
For a virtual gift of a gift receiving object (such as a main broadcast) selected by a gift sending object (such as the audience) and presented to a live broadcast room, the virtual gift can be displayed in a live broadcast page of the live broadcast room after the gift sending object clicks a presentation button, for example, the virtual gift image is directly displayed in a video playing area (namely a live broadcast area) of the live broadcast page, and the virtual gift is received by the gift receiving object in combination with gesture actions.
It can be seen that the notification method for sending the virtual gift in the direct broadcast room provided by the embodiment of the application is a method for directly displaying the virtual gift to be given in the live broadcast room and waiting for triggering of the gift receiving object, and compared with a method for directly playing the related information of the virtual gift to be given in the live broadcast room in a rolling manner, the method does not need the gift receiving object to execute any operation, increases the participation sense of the gift receiving object, and improves the existence sense of the gift sending object and the gift thereof in the live broadcast room, so that a user in the live broadcast room has time to accurately know the virtual gift to be given this time, and the enthusiasm of the user in participating in live broadcast interaction is improved.
It should be noted that, the present application does not limit the specific display mode of the above-mentioned virtual gift displayed on the live broadcast page of the live broadcast room, and if the virtual gift can be displayed at the middle position of the live broadcast area in the live broadcast page, the virtual gift can also be displayed at other positions, and the display position of the virtual gift in the live broadcast page can be determined according to the actual situation.
In addition, in order to avoid that the virtual gift is displayed in a live broadcast area of a live broadcast page for a long time and is not triggered to be received by a gift receiving object, and the live broadcast content is interfered to a live broadcast room user, the maximum display duration of the virtual gift in the live broadcast page can be set, once the actual display duration of the virtual gift is determined to reach the maximum display duration, the virtual gift is not continuously triggered to be received by the virtual gift receiving object, the display of the virtual gift in the live broadcast page is cancelled, and the virtual gift giving failure is also implied. The application does not limit the specific numerical value of the virtual gift in the maximum display time of the live broadcast page, and can be determined according to the situation.
Step S13, responding to the gesture trigger operation of the gift receiving object to the displayed virtual gift, and displaying a corresponding gift trigger image on the live broadcast page;
in combination with the above description on the technical concept of the application, for the virtual gift presented in the live broadcast room, in order to enhance the live broadcast interactivity of the gift receiving object and improve the immersion feeling of the live broadcast interactive playing method, the virtual gift receiving is realized by the gift receiving object in combination with the gesture, and the corresponding gift special effect is triggered. It should be noted that, for different types of virtual gifts, gesture types required for triggering the virtual gifts may be different, different types of virtual gifts that can be provided by the live broadcast platform may be predefined in the present application, and the gesture types of the corresponding gift triggering gestures are not described in detail in the specific implementation process.
As shown in fig. 3, the gesture types of the gift triggering gesture for triggering the virtual gift to be received and the corresponding gift special effect to be displayed may include, but are not limited to: the configuration of the virtual gift can be adjusted according to the requirements of the actual application scene and the receiving or using modes of the virtual gift, and the like, and the configuration is not listed here.
For example, if the virtual gift is a firework, a firecracker and other types of gifts, the corresponding gift triggering gesture can be a more-than-center gesture, and meanwhile, a flame can be displayed at the intersection position of a thumb and an index finger of the more-than-center gesture to ignite a firing cable of the virtual gift, so that special effects of firework bursting and firecracker firing are achieved, and the gift display mode and the interaction mode are enriched.
In yet another possible manner, for the virtual gift of the above type, an indication gesture (i.e. the first gesture in the second row in fig. 3) may also be used as its gift triggering gesture, and similarly, after the indication gesture is detected, a flame may be displayed at the index finger tip position to ignite the fuse of such virtual gift, and the implementation process is similar, and this application is not described in detail here.
Therefore, in practical application, gift triggering gestures corresponding to different types of virtual gifts can be configured by developers of the live broadcast platform, and therefore users logging in the live broadcast platform to enter a live broadcast room can receive the virtual gifts displayed on the live broadcast page in a triggering mode according to the corresponding relation between the virtual gift types and the gift triggering gestures uniformly configured by the live broadcast system.
In still other embodiments, in order to meet the personalized configuration requirements of the user, the user may also enter the live broadcast configuration page, and pre-configure gift triggering gestures corresponding to different types of virtual gifts according to personal preferences or habits.
Based on the above analysis, after seeing the virtual gift displayed on the live broadcast page of the live broadcast room, the gift receiving object serving as the virtual gift can make a gift triggering gesture corresponding to the virtual gift within the image acquisition range of the live broadcast terminal or the image acquisition device associated with the live broadcast terminal, and if the virtual gift is a firework gift, the gift receiving object can make a more comfortable gesture. In this case, gesture recognition may be performed on the collected hand image of the gift receiving object, it is determined whether a gesture performed by the gift receiving object is a gift triggering gesture corresponding to the virtual gift, it may be considered that the gesture performed by the gift receiving object on the virtual gift triggers operation, the gift receiving object wants to receive the virtual object, a corresponding gift triggering image may be displayed on a live broadcast page, for example, a heart-comparing gesture is displayed, and an image of a fire is displayed at a position where a thumb and an index finger of the heart-comparing gesture intersect.
Like this, each user that gets into the live broadcast room can be through watching the live broadcast page, just can directly perceivedly see receiving virtual gift to the gift object, and the live broadcast sees the virtual gift that the live broadcast room presented the overall process that is received by receiving the gift object promptly, has not only strengthened receiving the gift object and has paid out the sense, richenes live broadcast gift and collects the show mode, and to sending the gift object, also can directly perceivedly learn receiving the gift that the gift object formally received and give, and can not neglected, more can let the user actively participate in, immerse experience recreation.
As can be seen from the above analysis, the gift trigger image displayed on the live broadcast page may include a gift trigger gesture performed by a gift receiving object, and on this basis, a trigger object corresponding to a gift special effect trigger mode of the virtual gift may also be included, such as the above-mentioned flame for triggering the fireworks gift.
In step S14, in response to the gift triggering image and the virtual gift displayed on the live page satisfying the gift triggering condition, a first special effect triggered by the virtual gift is displayed.
As described above, in the process that the gift receiving object makes the gift triggering gesture corresponding to the virtual gift to be received currently, and maintains the gift triggering gesture, the gift receiving object may move the hand position to adjust the display position of the gift triggering image in the live broadcast page, so that the object included in the gift triggering image is associated with the virtual gift displayed on the live broadcast page, and meets the gift triggering condition, such as a fire ignition wire, a fist breaking golden egg gift, and the like, and the first special effect after the virtual gift is triggered, such as a firework display special effect, a winning fireworks special effect, and the like, may be directly displayed on the live broadcast page.
It can be seen that the specific content included in the gift triggering condition may be determined according to the type of the virtual gift, for example, in combination with the exchange use or receiving manner of the physical gift corresponding to the virtual gift, and similarly, the display effect and content of the first special effect may also be determined in combination with the type of the virtual gift and the display manner after the exchange use thereof.
In some embodiments, for the specific display implementation manner of the first special effect of the virtual gift, in a case that it is determined that the gift trigger image displayed on the live broadcast page and the virtual gift satisfy the gift trigger condition, the first special effect video file triggered for the virtual gift is played, the first special effect triggered for the virtual gift is displayed on the live broadcast page, and the first special effect triggered for the virtual gift is displayed on the live broadcast page.
To sum up, in the embodiment of the present application, during the live broadcast in the live broadcast room, if a user in the live broadcast room presents a virtual gift to another user, the application displays the virtual gift to be presented in the live broadcast page displaying the live broadcast content, the gift receiving object sees the virtual gift, and/or receives a corresponding gift receiving notification, and then directly performs a gesture triggering operation on the virtual gift, makes a corresponding gift triggering gesture, displays the obtained gift triggering image in the live broadcast page, and directly displays a first special effect triggered by the virtual gift under the condition that the gift triggering image and the virtual gift satisfy a gift triggering condition, so as to enrich the live broadcast gift display and receipt interaction manner, and enable each user in the live broadcast room to visually see the process of triggering the gift receiving object to receive the virtual gift, thereby enhancing the feeling of paying out the gift receiving object, the sense of attention of the gift receiving object to the gift given by the gift sending object is also improved, the user is prevented from excessively consuming the love of the anchor, so that the user can generate emotional coupling in the process of virtual gift giving and triggering acceptance, the stickiness of the live broadcast room is increased through the sense of payment, the user can participate actively, and the game is experienced in an immersion mode.
Referring to fig. 4, which is a flowchart illustrating another optional example of the live broadcast interaction method provided in the present application, this embodiment may be an optional detailed implementation manner of the live broadcast interaction method described in the foregoing embodiment, but is not limited to the detailed implementation manner described in this embodiment, and as illustrated in fig. 4, the detailed implementation method provided in this embodiment may include:
step S21, outputting a live broadcast page of the live broadcast room, and displaying live broadcast content on the live broadcast page;
step S22, showing the virtual gift of the gift receiving object of the live broadcast room;
regarding the implementation processes of step S21 and step S22, reference may be made to the description of the corresponding parts in the above embodiments, which is not repeated in this embodiment.
Step S23, canceling the display of the virtual gift in response to the display duration of the virtual gift reaching a second duration and no gift trigger image being recognized from the live video stream of the live page;
in the embodiment of the application, in a scene of delivering gifts in a live broadcast room, virtual gifts to be received by a gift receiving object can be displayed on a live broadcast page of the live broadcast room, so that each user in the live broadcast room can know the virtual gifts given by the gift delivering object (such as a certain audience) to the gift receiving object (such as a main broadcast of the live broadcast room), and the virtual gifts can be maintained for a certain display duration to wait for the gift receiving object to make a corresponding gift triggering gesture.
However, in order to avoid waiting for the gift receiving object to make a gesture for a long time, which causes the virtual gift to be always displayed in the live broadcast area of the live broadcast page, the live broadcast content is shielded, and the live broadcast content is interfered to be watched by the user in the live broadcast room, the application configures the corresponding longest display duration for the display duration of the virtual gift in the live broadcast room, which is recorded as the second duration, such as 10 seconds, so that the timing can be started from the moment when the virtual gift starts to be displayed in the live broadcast page until the statistical display duration reaches the second duration, the gift receiving object still does not make a corresponding gift triggering gesture, and the gift triggering gesture is successfully identified from the live broadcast video stream, and it can be considered that the gift receiving object does not accept the virtual gift due to factors such as unwanted or inconvenient factors, and the virtual gift does not need to be displayed any more, that the gift sending object fails to send the gift. It should be noted that the present application does not limit the specific value of the second time period.
In still other embodiments, in combination with the above analysis, the present application may further count that the duration of the virtual gift is displayed reaches a third duration, and cancel the display of the virtual gift when the gift triggering image displayed on the live page and the virtual gift do not satisfy the gift triggering condition, where the content of the gift triggering condition may refer to the description of the corresponding part of the above embodiments, and include, but are not limited to, the description of the corresponding part below. The specific value of the third duration is not limited in the present application and may be determined according to the circumstances.
In still other embodiments provided by the present application, in order to more directly remind the gift receiving object to receive the virtual gift and avoid missing the virtual gift, in the process of displaying the virtual gift on the live broadcast page of the live broadcast room, a gift receiving notification may be output in the live broadcast page displayed on the live broadcast client of the gift receiving object; at this time, the gift reception notification may include a gift reception prompting message for the virtual gift, such as a text prompting message that outputs the content of "xx (such as gift name) gift please accept xxxx (account name of gift-giving subject, etc.)", and the like.
In another possible implementation manner, the gift reception notification may also include gesture prompt information that the virtual object is triggered to notify what gift triggering gesture the gift object should make, so that the virtual gift reception can be accurately triggered, thereby avoiding a problem that the gift reception is delayed because the gift reception object forgets the gift triggering gesture corresponding to the current virtual gift, and even exceeds the maximum display duration of the virtual gift reception to cause a gift reception failure, and improving reliability and efficiency of virtual gift reception.
It should be understood that, after the live page of the live broadcast room shows the virtual gift for the gift-receiving object, the live client of the gift-receiving object may receive the virtual gift directly according to the operation manner described below in cooperation with the corresponding gift-triggering gesture after the virtual gift is seen by the gift-receiving object without outputting the above-mentioned gift-receiving notification.
Step S24, responding to the gesture triggering operation of the gift receiving object to the displayed virtual gift in the second duration, and displaying a corresponding gift triggering image on the live broadcast page;
as described above, in the process of displaying the virtual gift in the live broadcast room, before the display duration of the virtual gift does not reach the maximum display duration, the gift-receiving object makes a corresponding gift-triggering gesture, and the gift-triggering gesture is reliably recognized from the live broadcast video stream, it can be considered that the gift-receiving object is ready to receive the virtual gift, and the virtual gift does not need to cancel the display but needs to display a gift-triggering image capable of triggering the virtual gift, for example, the corresponding gift-triggering gesture is displayed on a live broadcast page, and a second special effect map can be displayed at a specific position of the gift-triggering gesture as needed, so that the object included in the second special effect map triggers the first display of the virtual gift. The present application does not limit the content of the gift-triggering image.
Step S25, responding to the motion track information of the gift triggering gesture recognized from the live video stream of the live broadcast page, and dynamically displaying a gift triggering image on the live broadcast page according to the motion track of the gift triggering gesture;
in the embodiment of the application, because the gift triggering image is determined based on the gift triggering gesture made by the gift receiving object, in practical application, the hand of the gift receiving object can be continuously moved to change the relative position relationship between the gesture made by the hand and the live client, so that the display position of the gift triggering gesture in the live page is correspondingly changed, and the display position of the virtual gift is usually fixed, so that under the condition that the display position of the gift triggering image is not matched with the display position of the virtual gift, that is, the first characteristic of displaying the virtual gift cannot be immediately triggered, the embodiment of the application can move the hand by the gift receiving object according to the above manner, so as to change the information content contained in the acquired live hand image, and after the hand image is sent to each live client as a part of a video stream, the motion trajectory information triggered by the gift triggering gesture can be identified from the live video stream, and then, dynamically displaying the gift triggering image according to the motion track of the identified gift triggering gesture.
Therefore, the display position of the gift triggering image displayed on the live broadcast page can be changed correspondingly along with the change of the display position of the gift triggering gesture made by the acceptance object, namely, the hand position of the gift receiving object is tracked, and the display position of the gift triggering image in the live broadcast page is adjusted. Implementation methods related to the dynamic presentation manner of the gift-triggering image include, but are not limited to, the implementation methods described above, as appropriate.
Step S26, responding to the first display position of the gift triggering image dynamically displayed on the live broadcast page, matching with the specific display position of the virtual gift, adding a second special effect map in the gift triggering image at the specific position of the virtual gift, and amplifying and displaying the obtained to-be-triggered virtual gift with the second special effect;
for the gift triggering condition described in the above embodiments, the present embodiment is described by taking the content that the first display position of the gift triggering image matches with the specific display position of the virtual gift as an example, but the present embodiment is not limited to the gift triggering condition of the content described in the present embodiment, and the present application does not limit the specific meaning that the first display position and the second display position match, as the case may be.
It can be seen that, in this embodiment, the gift receiving object changes the hand position according to the above-mentioned manner, and adjusts the display position of the gift trigger image in the live broadcast page, until the adjusted first display position matches with the specific display position of the virtual gift (such as the middle position of the live broadcast area in the live broadcast page), the application can update the displayed virtual gift to the virtual gift output to be triggered with the second special effect, that is, change the display effect of the virtual gift, and advance the progress of the virtual gift being received.
Specifically, in comparison with the display effect of the virtual gift directly selected by the gift-sending object, in the embodiment, when the gift triggering condition meeting the above content is determined, the second special effect map in the gift triggering image is added at the specific position of the virtual gift, and the obtained to-be-triggered virtual gift with the second special effect is displayed in an enlarged manner. As can be seen, in this embodiment, the displayed gift-triggering image includes, in addition to the gift-triggering gesture made by the gift-receiving object, a second special effect map located at a specific position of the gift-triggering gesture, such as a flame image, and the like, and may be determined according to the type of the virtual gift.
In some embodiments, a second special effect map in a gift trigger image can be added at a specific position of a virtual gift for displaying, and subsequent steps are carried out without amplification; of course, in order to further highlight the virtual gift to be triggered and received, the application may enlarge and display the virtual gift to which the second special effect map is added, and the specific enlargement ratio and the display position of the enlarged virtual gift to be triggered are not limited, which may be determined according to the circumstances.
Step S27, in response to the display duration of the to-be-triggered virtual gift reaching the first duration, skipping to display the triggered first special effect of the to-be-triggered virtual gift and the respective object identifiers of the gift sending object and the gift receiving object of the virtual gift.
The method comprises the steps of selecting a given virtual gift from a gift sending object, processing the virtual gift in a live broadcast page according to a mode to obtain a display state with a second special effect, and maintaining the display state of the virtual gift to be triggered with the second special effect for a certain time, such as 3 seconds, so as to remind or wait for a user in a live broadcast room to pay attention to the last moment that the virtual gift is received by a gift receiving object, and watching a first special effect displayed by triggering the virtual gift in a concentrated manner, such as a firework bursting effect, a lighting effect and the like. The present application does not limit the specific value of the first duration.
In some embodiments, in the process of displaying the first special effect, the method and the device for displaying the live broadcast gift of the live broadcast website can further display respective object identifiers of the gift sending object and the gift receiving object of the virtual gift on the live broadcast webpage, such as displaying respective live broadcast account head images of the gift sending object and the gift receiving object, so that a user in a live broadcast room can visually see which user and which user are in live broadcast gift interaction. It should be noted that, the content of the displayed object identifier is not limited in the present application, and may be determined according to the circumstances.
In still other embodiments, the present application may further output a voice prompt message that the gift-receiving object successfully receives the virtual gift given by the gift-sending object in a voice broadcast manner, and the present application does not limit the content of the voice prompt message. Therefore, the method and the system have the advantages that the live broadcast interactive playing method can stimulate more active parameters of the gift sending object and/or the gift receiving object by broadcasting the live broadcast gift interactive result and the object identifications of the two parties in the live broadcast room in the mode without being limited to the mode.
In summary, in the embodiment of the present application, in a scenario where any user of a live broadcast room is taken as a gift sending object (e.g., any audience) and presents a virtual gift to another user (e.g., a gift receiving object, such as a main broadcast of the live broadcast room), after the gift sending object selects the presented virtual gift, the virtual gift is displayed in a live broadcast page of the live broadcast room, so that each user of the live broadcast room can see the virtual gift, if the duration of the display of the virtual gift on the live broadcast page reaches a second duration, the gift receiving object still does not make a gift triggering gesture to receive the virtual gift, the present gift presentation fails, the display of the virtual gift is cancelled, and the blocking interference of the live broadcast content, which is waiting for the gift receiving object to receive the live broadcast content, in the process of always displaying is avoided.
If the gift receiving object makes the gift triggering gesture corresponding to the virtual gift within the second duration, that is, the gesture triggering operation is performed on the displayed virtual gift, a gift triggering image containing the gift triggering gesture is obtained and displayed in the live broadcast page of the live broadcast room, and under the condition that the gift triggering image is not matched with the display position of the virtual gift, the gift receiving object can move the hand to change the display position of the gift triggering gesture made by the hand in the live broadcast page, and simultaneously, the dynamic display of the gift triggering image is realized along with the movement track of the gift triggering gesture of the gift in the live broadcast page, so that each user in the live broadcast room can visually see the process that the gift receiving object receives the virtual gift, and meanwhile, the gift receiving object can synchronously determine whether the dynamically displayed gift triggering image is matched with the display position of the virtual gift, if so, the display position of the gift triggering gesture can be changed without moving the hand, and accordingly the receiving mode of the virtual gift in the live broadcast room is enriched and the paying-out feeling of the gift receiving object is greatly improved by the aid of the processing mode of dynamically displaying the gift triggering image.
Then, a second special effect map in the gift triggering image can be added to a specific position of the virtual gift, the virtual gift to be triggered with the second special effect is displayed in an enlarged mode, the last moment that the virtual gift is accepted is attracted to a live broadcast room user, after a first short time, the first special effect that the virtual gift is to be triggered is displayed in a live broadcast page in a skipping mode, and object marks of the gift sending object and the gift receiving object, so that the live broadcast room watching user can see the displaying effect of the received virtual gift, the gift sending object and the gift receiving object of the virtual gift are emphasized, the live broadcast room user is encouraged to actively participate in the live broadcast gift interactive playing method, and the viscosity of the live broadcast room is increased.
Based on the description of the above embodiments, in the implementation process of the live broadcast interaction method provided by the present application, the gesture made by the gift-receiving object needs to be accurately and quickly recognized, and specifically, the gesture made by the gift-receiving object is obtained by detecting the hand position of the gift-receiving object and then performing gesture recognition on the detected hand region.
Specifically, when a user A logs in a live broadcast platform by using a live broadcast client in a live broadcast terminal, enters a live broadcast room to watch live broadcast content of a main broadcast, or is used as a main broadcast to carry out live broadcast, if the user A is used as a user B in the live broadcast room to select a gift receiving object presenting a virtual gift, in the process of receiving the virtual gift displayed in the live broadcast room by combining gestures, the hand of the gift receiving object enters the image acquisition range of the live broadcast terminal or associated image acquisition equipment thereof to carry out image acquisition on the hand, the live broadcast terminal can carry out target identification on the acquired hand image to determine position information of a hand area contained in the hand image, and then carries out 3D detection on key point information of the hand to obtain key point information of the hand of the gift receiving object, so as to analyze the key point information of the hand and determine the gesture type made by the gift receiving object, or directly judging whether the gift receiving object makes a gift triggering gesture corresponding to the virtual gift.
The hand position detection and gesture recognition processes can be implemented by using an Artificial Intelligence (AI) technology, that is, a theory, a method, a technology and an application system for simulating, extending and expanding human Intelligence by using a digital computer or a machine controlled by a digital computer, sensing an environment, acquiring knowledge and obtaining an optimal result by using the knowledge, and an SDK (Software Development Kit) integrated with a live broadcast terminal, for example, the gesture recognition SDK can use a machine learning/deep learning mode to implement the hand position detection and gesture recognition functions. In order to improve the recognition efficiency, the model for realizing hand position detection and gesture recognition can be trained in advance, and if the model is obtained by performing supervised/unsupervised training on a plurality of sample hand images based on a machine learning algorithm, the hand images can be directly input into the model after being actually collected, and the gesture types of the gestures made by the gift-collecting object are output.
In still other embodiments, for the live broadcast scene proposed by the present application, as described above, the gesture and the motion trajectory thereof performed by the gift-receiving object need to be synchronously displayed in the live broadcast room, so that information of a hand region or a hand key point that needs to be detected can be added to a live broadcast video stream containing live broadcast content of a main broadcast, and it is ensured that each live broadcast terminal in the live broadcast room can recognize the gesture performed by the gift-receiving object from the received live broadcast video stream. Therefore, the whole processing process of hand position detection and gesture recognition can be further divided into a plurality of processing stages, and corresponding sub-models are trained according to different processing results, such as a hand detection model for detecting hand regions of directly acquired hand images, a hand mark model for detecting three-dimensional hand key point information contained in the hand region images, a gesture recognition model for recognizing gesture types according to the three-dimensional hand key point information, and the like. Thus, the plurality of sub-models form a learning framework of the hand position detection and gesture recognition system.
The training process of the different submodels can be realized by selecting a proper machine learning/deep learning algorithm, such as an artificial neural network, a belief network, reinforcement learning, transfer learning, inductive learning and other algorithms, and the specific training realization process of each submodel is not limited by the application.
For example, for the hand detection model, each sample hand image directly acquired may be used to train and learn an initial target detection network, and the target detection network that can accurately identify the hand region in the sample hand image is determined as the hand detection model; similarly, the hand mark model can be obtained based on training of a plurality of sample hand regions (such as hand regions containing a plurality of gestures); the gesture recognition model can be obtained based on training of a plurality of sample hand key point information, can be a classifier, and obtains a gesture type corresponding to each type of sample gesture key point information by classifying the plurality of sample gesture key point information. It should be noted that, the training implementation process of each sub-model described above includes, but is not limited to, the training method described above, as the case may be.
Based on the above analysis, in the implementation process of the live broadcast interaction method, in order to obtain a gift triggering gesture of the gift receiving object, as shown in fig. 5, the method may further include, but is not limited to, the following steps:
step S31, acquiring gesture recognition information of the gift collection object;
in combination with the above description of the gesture recognition process, the gesture recognition information of this embodiment may be obtained by performing gesture recognition on the collected hand image of the gift-receiving object, which may include, but is not limited to, three-dimensional gesture key point information, and as for the specific acquisition process of the gesture recognition information, reference may be made to the above description of the corresponding part, which is not described in detail herein.
It should be understood that, in a scene that a gift receiving object is a director of a live broadcast room, live broadcast terminals collect live broadcast content of the director and form a live broadcast video stream, the director makes a gift triggering gesture in an image collection range, and the gift triggering gesture can be sent to each live broadcast terminal of the live broadcast room as a part of the live broadcast video stream, so that the live broadcast terminals can extract gesture recognition information of the gift receiving object from the received live broadcast video stream, and corresponding gift triggering gesture is displayed in a live broadcast page of the live broadcast room.
Step S32, determining the gesture type of the current gesture made by the gift receiving object by using the gesture recognition information;
in step S33, if the gesture type is consistent with the trigger gesture type of the virtual gift, the current gesture is determined as the gift trigger gesture of the virtual gift.
After the above description, after recognizing the gesture made by the gift receiving object for the virtual gift from the live video stream, for example, classifying and recognizing the three-dimensional hand key point information included in the gesture recognition information, determining the gesture type of the gesture made by the gift receiving object, if the gesture made by the gift receiving object is the trigger gesture type corresponding to the virtual gift to be received currently, determining the current gesture as the gift trigger gesture of the virtual gift, which indicates that the gift receiving object completes the gesture trigger operation for the displayed virtual gift, and then displaying the gift trigger image including the gift trigger gesture according to the recognized gift trigger gesture, and further referring to the display position of the virtual gift, changing the relative position relationship between the hand maintaining the gift trigger gesture by the live gift receiving object and the image acquisition device associated with the live gift receiving object, so as to change the display position of the gift trigger image, until the gift triggering condition is met, the virtual gift is received, and the first special effect of the virtual gift is triggered and displayed.
It should be understood that, according to the above analysis manner, if the gesture type of the identified gift-receiving object is inconsistent with the trigger gesture type corresponding to the virtual gift, that is, the gift-receiving object does not make the gift trigger gesture corresponding to the virtual gift, and still takes the scene that the specific gesture corresponds to the fireworks gift as an example, the gift-receiving object to receive the fireworks gift makes a scissors gesture, which belongs to an invalid gesture for the fireworks gift and does not affect the fireworks gift, and if the anchor is the gift-receiving object, the scissors gesture at this time is displayed as the live broadcast content of the anchor and is not highlighted as the independent gesture shown in fig. 3.
In combination with the above description of the live broadcast interaction method provided by the present application, the following will take a scene that the audience B of the live broadcast room a gives the anchor a firework gift as an example to explain how the anchor combines with the gesture to realize acceptance of the firework gift, so as to enhance the paying sense of the anchor in the receiving process of the live broadcast gift, and further increase the viscosity of the live broadcast room. The live broadcast terminal used by the anchor A for live broadcast is recorded as the anchor terminal, a user who enters the live broadcast room A to watch the live broadcast of the anchor A can be called as a spectator, a live broadcast terminal used by a spectator to watch the live broadcast at present can be called as a spectator terminal, and a spectator B can be used for broadcasting any spectator in the live broadcast room A. Based on this, referring to a flow diagram of another optional example of the live broadcast interaction method provided by the present application shown in fig. 5, in an application scenario provided by this embodiment, the live broadcast interaction method may include:
step S41, the anchor terminal responds to the live broadcast request operation, outputs the live broadcast page of the live broadcast room A created aiming at the live broadcast request, and displays the live broadcast content of the anchor A in the video area of the live broadcast page;
step S42, the audience terminal responds to the watching request operation of the live broadcasting room A, and outputs the live broadcasting page of the live broadcasting room A to display the live broadcasting content of the anchor broadcasting A;
in practical application, when the anchor A is going to perform live broadcasting, the anchor terminal (such as the electronic device provided with the live client) can be used to log in the live broadcasting platform, a live broadcasting request is sent to the live broadcasting server, the live broadcasting server responds to the live broadcasting request, and a corresponding live broadcasting room A is created.
The live broadcast content display method comprises the steps that for each live broadcast terminal connected to a live broadcast room A, live broadcast video streams can be synchronously received and output, the live broadcast content of an anchor broadcast A can be displayed, the live broadcast video streams can be generated by collecting audio and video files in real time for the anchor broadcast A, and the specific implementation process is not detailed in the application. In addition, the working principle of creating a live broadcast room and entering the live broadcast room to watch live broadcast of the live broadcast platform is not described in detail in the present application, including but not limited to the implementation described in this embodiment.
For example, referring to a live broadcast page schematic diagram of a live broadcast room a shown in fig. 7a, a live broadcast page output on a display screen of a live broadcast terminal of a live broadcast room a is the same as content of a live broadcast page output by an audience terminal of each audience in the live broadcast room a, including but not limited to the live broadcast page layout structure shown in fig. 7a, it can be understood that the output live broadcast page may generally include a video area, also called a live broadcast area, for displaying live broadcast content of the live broadcast room a and a bullet screen area for displaying user interaction content in the live broadcast room a, a bullet screen sent by the live broadcast room a or each audience in the live broadcast room a may be displayed in the bullet screen area, and a specific display mode is not limited in this application.
Step S43, the spectator terminal responds to the gift triggering operation, and outputs a gift panel on the live broadcast page, and the gift panel displays at least one virtual gift to be selected;
continuing with the above description, the live broadcast page of the live broadcast room a shown in fig. 7a is still taken as an example, and for any viewer in the live broadcast room a, which is denoted as viewer B, the virtual gift is to be presented to the main broadcast a, the lower right gift icon can be clicked on the live broadcast page without affecting the viewing of the live broadcast content of the main broadcast a, so that in the live broadcast page output by the viewer terminal used by the viewer B, a gift panel pops up, as shown in the live broadcast page schematic diagram of the gift panel shown in fig. 7B, one or more virtual gifts that the viewer B can select to be presented can be displayed in the gift panel, and as required, the gift names of each virtual gift can be synchronously displayed, so that the user can accurately know the virtual gifts, so that the viewer B can select to present the virtual gift of the main broadcast a according to personal will, and fig. 7B only takes the scene of selecting fireworks as an example, the application does not limit the number, the type, the display mode and the like of the virtual gifts contained in the gift panel.
In some embodiments, the types and the number of virtual gifts that viewers with different affinities may choose to present may be different due to the different affinities between different viewers and the anchor, that is, the content included in the gift lists associated with the live accounts of different viewers may be different, such as the more virtual gift types that the viewers with higher affinities select, and the like, so that different viewers click on the gift icon on the live page, that is, perform a gift triggering operation, and the number and the type of virtual gifts displayed on the gift panel popped up by the live page may be different, including but not limited to the several virtual gifts shown in fig. b.
Step S44, the spectator terminal responds to the gift selection operation executed by the spectator B and displays the selected firework gift on the live broadcast page of the live broadcast room A;
as described above, in the scene where the viewer B selects the fireworks gifts from the popped-up gift panel, in response to the selection operation of the displayed fireworks gifts by the viewer B, the selection operation and the result of the viewer B may be sent to the live broadcast room a, so that the fireworks gifts (i.e., fireworks tube pictures) selected by the viewer B are displayed in the video area of the live broadcast page of the live broadcast room a, and as shown in fig. 7c, the fireworks gifts to be received may be displayed at the lower middle position of the video area of the live broadcast page, but not limited to the display position and the display mode shown in fig. 7 c.
It should be understood that, for other spectator terminals and the anchor terminal in the live broadcast room a, the firework gift selected by the spectator B to be gifted may be presented in the output live broadcast page in response to the gift selection operation performed by the spectator B. If can be through the live broadcast server in backstage, feed back spectator B to the result of selecting of fireworks gift to live broadcast room A in, guarantee that the video region of the live broadcast page of each live broadcast terminal output shows the content synchronization, do not detailed in this application of the concrete realization principle.
In practical application, in order to more clearly illustrate which user sends the virtual gift to be received displayed in the live broadcast page to which user, a corresponding gift notification may also be directly output in the live broadcast room, at this time, the gift notification may include respective object identifiers including a gift receiving object and a gift sending object, and the content and the output mode of the gift notification are not limited in the present application and may be determined as the case may be.
In some embodiments, in order to enable the gift-receiving object to receive the gift in time and avoid the situation that the virtual gift is not received and cancelled even after the virtual gift is displayed for too long time, the present application may also directly send a gift-receiving notification to the gift-receiving object to remind the gift-receiving object to combine with the corresponding gesture in time to complete the receiving operation of the virtual gift. The specific implementation process can refer to the description of the corresponding parts of the above embodiments.
Step S45, the anchor terminal responds to the firework ignition operation of the anchor A on the displayed firework gift, and sends the generated corresponding live broadcast video stream to a live broadcast server;
step S46, the live broadcast server forwards the live broadcast video stream to each live broadcast terminal entering the live broadcast room A, so that the video area of the live broadcast page output by each live broadcast terminal synchronously displays the live broadcast content;
for the anchor A of the live broadcast room A, after seeing the virtual gift image given to the anchor A in the video area of the live broadcast page, the firework gift is still taken as an example, the firework ignition gesture corresponding to the firework gift can be made in the image acquisition range.
Therefore, a specific gesture is made for the firework gift in the image acquisition range of the anchor broadcaster a, and the generated live video stream contains related information about the specific gesture, such as hand area image information of the anchor broadcaster a making the specific gesture, or three-dimensional hand key point information obtained by identifying the hand area image, and the like, as the case may be; in addition, the live video stream can also include normal live content of the anchor A, such as a game operation video file in a game live scene, a singing audio/video file in a singing live scene and the like.
It should be noted that, because the process of presenting the virtual gift in the live broadcast room does not affect the live broadcast of the anchor, the video area of the live broadcast page can still display the live broadcast content of the anchor, and in order to avoid the live broadcast content from shielding the virtual gift, the virtual gift displayed in the video area can be displayed on the live broadcast content, that is, the virtual gift is located at the uppermost layer of the image, and because the virtual gift occupies a smaller display area than the whole live broadcast content, the influence on the audience to watch the live broadcast content is not great.
Step S47, each live broadcast terminal identifies hand region information of the anchor A from the live broadcast video stream, and determines that the anchor A makes more than desired gestures for the displayed firework gifts by using the hand region information;
step S48, each live broadcast terminal adds the flame image to the heart comparing position of the heart comparing gesture, and displays the heart comparing gesture image with the flame special effect in the video area of the live broadcast page;
following the above description, for any live broadcast terminal accessing the live broadcast room a, the hand region information of the anchor broadcast a can be identified from the received live broadcast video stream, and in combination with the description content of the implementation method embodiment of the hand position detection and gesture identification described above, the live broadcast terminal can extract the three-dimensional hand key point information included in the hand region information, and by classifying the three-dimensional hand key point information, identify what type of gesture the gift triggering gesture made by the anchor broadcast a at this time is, whether the gesture is a mood gesture corresponding to the firework gift.
In the case that it is determined that the anchor a makes a heartburn gesture for the displayed firework gift, according to a preset gesture trigger rule of the firework gift, a flame image may be added to a heartburn position (i.e., an intersection position of an index finger and a thumb) of the heartburn gesture to display a heartburn gesture image with a flame effect, i.e., a firework ignition gesture image, in the video area, as shown in fig. 7 d. It should be understood that during the process of acquiring and displaying the mood images, the video area can still display the live content of the stage of the anchor A, and other users in the live broadcast room are not influenced to watch the live content.
Wherein, the determined specific heart gesture image with the specific flame effect can be displayed at any position of the video area, and fig. 7d only shows one display mode; and to the fireworks firing gesture that fireworks present corresponds, also not be limited to than heart gesture, can carry out dynamic adjustment according to actual demand, this application only explains with than heart gesture as an example, to the anchor adopts other types of fireworks firing gesture of presetting, and the realization process that triggers and accept fireworks present is similar, and this application does not do the detailed description one by one.
Step S49, each live broadcast terminal responds to the anchor A to maintain the motion trail information of the heart gesture, and dynamically displays the heart gesture image according to the motion trail of the heart gesture;
and S410, each live broadcast terminal responds to the flame image on the match gesture, at least partially overlaps with the firing cable display area of the firework gift, plays a firework bursting video file, and displays a firework bursting effect on a live broadcast page.
For the live broadcast interactive scene that the fireworks can be ignited by the flame and blooms and the main broadcast receives the fireworks gift, the flame display position on the specific gesture shown in figure 7d, different from the display position of the firing cable of the firework gift, the aim of ignition cannot be achieved visually, the display position of the firework gift is usually determined, the display position of the anchor as the gift receiving object cannot be changed through gestures, but the anchor can change the relative position relationship between the hand maintaining the specific gesture, and the image acquisition device, therefore, the display position of the heart-to-heart gesture displayed in the video region is changed, namely the display position of the flame image at the heart-to-heart position of the heart-to-heart gesture is synchronously changed, namely the flame effect displayed in the video region can move along with the movement of the heart-to-heart gesture, and the specific implementation process is not detailed in the application.
Based on this, the anchor A can continuously move the hand for maintaining the heart-to-heart gesture by watching the display position of the flame image on the heart-to-heart gesture displayed in the video area, change the display of the heart-to-heart gesture, so that the flame image is gradually close to the firing cable display area of the firework gift until the flame image is at least partially overlapped with the firing cable display area, thereby achieving the visual effect of firing the firing cable of the firework, at this time, in order to provide the special effect of firing the firework cylinder, the firework with the special effect of the flame can be simultaneously displayed in an enlarged manner, as shown in fig. 7f, the attention of each user in the live broadcast room A is attracted to be transferred from the live broadcast content to the virtual gift to be accepted of the firework cylinder.
Later, the process that the fireworks just can bloom in the firing cable of simulation entity fireworks section of thick bamboo needs the burning of certain duration, and this application can maintain the enlarged image of above-mentioned flame point fireworks section of thick bamboo for a long time, like 3s back, accomplishes the burning to the firing cable of fireworks section of thick bamboo, and direct output is similar with the bandwagon effect after the entity fireworks section of thick bamboo is lighted, as shown in fig. 7g promptly, shows the fireworks on the live page and bloies the special effect, specifically can play the fireworks and bloom the video file and realize.
In some embodiments, as shown in fig. 7g, while the live broadcast page of the live broadcast room a shows the firework bursting effect, the avatar of the audience B sending the gift and the avatar of the anchor a can be shown in the firework bursting effect, even the audience B can be output to the anchor a to give the firework gift success, or the anchor a successfully receives the voice notification of the firework gift of the audience B, and the like.
It should be appreciated that for other types of virtual gifts, such as firecracker gifts, golden egg gifts, blind box gifts, etc., the manner in which users accept these gifts is not consistent. Referring to the live broadcast interaction method shown in fig. 8a, in the live broadcast process, the implementation process of the audience B selecting the gift of the golden eggs and displaying the image of the golden eggs to be smashed in the live broadcast room a is similar, and details are not repeated in this embodiment. After seeing the presented gift of the golden egg, the anchor a can make a fist-holding gesture, so that each live broadcast terminal adds a hammer image to the fist-holding gesture to be displayed (as a first graph shown in fig. 8 a), the anchor a keeps moving the hand with the fist-holding gesture, so that the displayed hammer is continuously close to the golden egg to be cracked until the hammer is attached to the surface of the golden egg, the operation of cracking the golden egg is completed, the special effect that the gift of the golden egg is cracked (as a second graph shown in fig. 8 a) is displayed, and then the gift image contained in the golden egg is displayed, such as a loose pulley and the like displayed in a third graph shown in fig. 8 a.
Similarly, for the scene that audience B presents the gift of the blind box of the anchor A, the anchor makes a gesture of detaching the blind box, the anchor is close to the ribbon in the blind box, and the implementation process of displaying the gift by opening the blind box can be similar to the implementation process of the live broadcast interaction method of the scene of the firework gift and the golden egg gift given above with reference to the scene schematic diagram shown in fig. 8B, and the detailed description is omitted in the present application.
As can be seen, for different types of virtual gifts, gift triggering gestures which can accept the virtual gift and are intended to be made by the gift receiving object may be different, and in the live broadcast interaction process, a gift special effect displayed in a video area of a live broadcast page may also be changed accordingly, including but not limited to the above-listed application scenarios, as the case may be, which is not described in detail in this application.
In addition, it should be noted that the scenes presented to the anchor virtual gifts by the audience during the live interaction include, but are not limited to, live room scenes. If the scenes of live broadcast are carried out on a plurality of anchor broadcasters, the gift sending object can also be one of the anchor broadcasters, and the gift receiving object is the other anchor broadcaster; or the virtual gift is used as a game reward and is given to audiences meeting preset conditions in the live broadcast room by the anchor broadcast, and the like, and the process of realizing the live broadcast interaction method of the gift-sending object and the gift-receiving object is similar no matter what the identities of the gift-sending object and the gift-receiving object in the live broadcast room, and the process of giving the virtual gift to the anchor broadcast by the audience can refer to but is not limited to the above-described implementation process of giving the virtual gift to the anchor broadcast, and the application does not give details to other scenes one by one.
Under the condition that the gift receiving object is a first audience (namely any audience, such as audience B and the like) in a live broadcast room, and the gift sending object is a main broadcast of the live broadcast room, in order to enable each live broadcast terminal of the live broadcast room to obtain gesture recognition information of the first audience, an identity verification panel of the gift receiving object aiming at the virtual gift can be displayed in a live broadcast page output by the live broadcast terminal of the first audience in a skipping mode, so that the first audience is reminded to perform identity verification firstly, namely whether the first audience is the gift receiving object of the current virtual gift is verified, such as face recognition and the like, the identity verification method is not limited, and therefore, after identity input operation of the first audience aiming at the identity verification panel is responded, and after identity verification processing, if the first audience is the gift receiving object, an identity verification qualified notice can be output; then, the first viewer may make a corresponding gift triggering gesture, and send the obtained gesture recognition information to each live broadcast terminal of the live broadcast room for processing by responding to a gesture input operation of the first viewer for the virtual gift, for example, the gesture recognition information is sent to each live broadcast terminal in a live broadcast video stream sent by a main broadcast terminal of the main broadcast, so as to implement dynamic display of the gift triggering gesture in the live broadcast room, where the implementation process may refer to the description of the corresponding part of the above embodiment, and this embodiment is not described herein again.
To sum up, in order to enrich the live broadcast interaction mode, enhance the participation of users in the live broadcast room, improve the interest of live broadcast interaction, and attract more users to participate in the live broadcast interaction play method, the application displays the virtual gift presented in the live broadcast room, waits for the gift receiving object to receive the virtual gift in combination with the corresponding gesture, namely, the gift receiving object is required to make a gift triggering gesture capable of triggering the virtual gift to be received so as to participate in the live broadcast gift interaction play method, compared with the processing mode that the system directly and automatically places the presented virtual gift in the backpack of the gift receiving object, the gift receiving object provided by the application needs to make a series of actions so as to be capable of receiving the live broadcast interaction mode of the virtual gift, the payment feeling of the gift receiving object is increased, and the relationship between depth coupling and the gift sending object can make the users more actively participate in the live broadcast interaction method, the live interactive playing method is experienced in an immersion mode, and the viscosity of a live room is increased.
Referring to fig. 9, a schematic structural diagram of an alternative example of a live broadcast interaction apparatus provided in the present application, the apparatus may be applied to the electronic device described above, that is, a live broadcast terminal in a live broadcast room, and as shown in fig. 9, the apparatus may include:
the live broadcast content display module 11 is configured to output a live broadcast page of a live broadcast room, and display live broadcast content on the live broadcast page;
a virtual gift display module 12, configured to display a virtual gift of a gift receiving object for the live broadcast;
a gift triggering module 13, configured to respond to a gesture triggering operation of the gift-receiving object on the displayed virtual gift, and display a corresponding gift triggering image on the live broadcast page; wherein the gift triggering image comprises a gift triggering gesture made by the gift receiving object;
and the special effect display module 14 is configured to display a first special effect triggered by the virtual gift in response to the gift triggering image displayed on the live page and the virtual gift meeting a gift triggering condition.
In one possible implementation, the special effect display module 14 may include:
and the characteristic video file playing unit is used for playing the first special effect video file triggered by the virtual gift and displaying the triggered first special effect of the virtual gift on the live broadcast page.
For example, in a scenario where the virtual gift includes a fireworks gift, the gift triggering module 13 may include:
the firework lighting gesture display unit is used for responding to firework lighting gesture operation executed by the gift receiving object on the displayed firework gift and increasing display of a flame image at the specific display position of the recognized firework lighting gesture;
accordingly, the special effects display module 14 may include:
the firework display unit is used for responding to the display of the live broadcast page, the firework image on the firework ignition gesture is at least partially overlapped with a fuse display area contained in the firework gift, and the firework display special effect is displayed on the live broadcast page.
In some embodiments, the live interaction apparatus provided by the present application may further include:
the dynamic display module is used for responding to the motion track information of the gift triggering gesture recognized from the live video stream of the live broadcast page, and dynamically displaying the gift triggering image according to the motion track of the gift triggering gesture;
accordingly, the special effects display module 14 may include:
and the position matching unit is used for responding to a first display position of the gift triggering image dynamically displayed on the live broadcast page and matching with a specific display position of the virtual gift.
In still other embodiments, the live interaction apparatus provided by the present application may further include:
a second special effect displaying module, configured to update the displayed virtual gift to a to-be-triggered virtual gift output with a second special effect in a process that the special effect displaying module 14 responds to the gift triggering image displayed on the live broadcast page and the virtual gift and meets a gift triggering condition;
in one possible implementation, the second special effect showing module may include:
and the amplifying display unit is used for adding a second special effect map in the gift triggering image at a specific position of the virtual gift, and amplifying and displaying the obtained virtual gift to be triggered with the second special effect.
Accordingly, the special effects display module 14 may include:
and the first special effect display unit is used for responding to the display duration of the virtual gift to be triggered to reach a first duration, and skipping to display the triggered first special effect of the virtual gift to be triggered.
In still other embodiments, the live interaction apparatus provided by the present application may further include:
the object identifier display module is used for displaying respective object identifiers of a gift sending object and a gift receiving object of the virtual gift on the live broadcast page in the process of displaying the first special effect triggered by the virtual gift; and/or the presence of a gas in the gas,
and the voice prompt module is used for outputting a voice prompt message that the gift receiving object successfully receives the virtual gift given by the gift sending object in the process of displaying the first special effect triggered by the virtual gift.
In still other embodiments, the live interaction apparatus provided by the present application may further include:
a gift receiving notification module, configured to output a gift receiving notification in the live broadcast page displayed by the live broadcast client of the gift receiving object in the process of displaying the virtual gift of the gift receiving object for the live broadcast room;
wherein the gift reception notification comprises a gift reception prompting message for the virtual gift, and/or gesture prompting information that the virtual object is triggered.
Based on the description of the above embodiments, the live broadcast interaction apparatus may further include:
a first cancellation display module, configured to cancel display of the virtual gift in response to a display duration of the virtual gift reaching a second duration and the gift trigger image not being recognized from a live video stream of the live broadcast page; and/or the presence of a gas in the gas,
and the second display canceling module is used for responding to the display duration of the virtual gift reaching a third duration, displaying the live broadcast page, and canceling the display of the virtual gift when the gift triggering image and the virtual gift do not meet the gift triggering condition.
To obtain the gift-triggering gesture in the above embodiments, the gift-triggering module 13 may include:
the gesture recognition information acquisition unit is used for acquiring gesture recognition information of the gift receiving object; the gesture recognition information is obtained by performing gesture recognition on the collected hand image of the gift receiving object;
the gesture type determining module is used for determining the gesture type of the current gesture made by the gift receiving object by utilizing the gesture recognition information;
and the gift triggering gesture determination module is used for determining the current gesture as the gift triggering gesture of the virtual gift under the condition that the gesture type is consistent with the triggering gesture type of the virtual gift.
Wherein, receiving gift object is the first audience of live broadcast room, sending gift object is under the circumstances of the anchor broadcast of live broadcast room, in order to obtain gesture recognition information, the live broadcast interactive device of the live broadcast terminal of first audience can also include:
an authentication panel display module, configured to skip to display an authentication panel of a gift receiving object for the virtual gift in the live broadcast page output by the live broadcast terminal of the first viewer;
an authentication qualified notification module for outputting an authentication qualified notification in response to an authentication input operation of the first viewer with respect to the authentication panel;
and the gesture recognition information sending module is used for responding to the gesture input operation of the first audience aiming at the virtual gift and sending the obtained gesture recognition information to each live broadcast terminal of the live broadcast room for processing.
It should be noted that, regarding various modules in the embodiments of the apparatuses applicable to different electronic devices, the modules may be stored in the memory as program modules, and the processor executes the program modules stored in the memory to implement corresponding functions, and regarding functions implemented by the program modules and their combinations and achieved technical effects, reference may be made to the description of corresponding parts in the embodiments of the methods applicable to corresponding electronic devices, which is not described in detail in this embodiment.
The embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and the computer program is loaded and executed by a processor to implement the steps of the live broadcast interaction method executed by the corresponding electronic device side.
The present application also proposes a computer program product or a computer program comprising computer instructions stored in a computer readable storage medium. A processor of the computer device reads the computer instruction from the computer-readable storage medium, and executes the computer instruction, so that the computer device executes the methods provided in the various optional implementation manners in the aspect of the live broadcast interaction method or the aspect of the live broadcast interaction apparatus.
Referring to fig. 10, a schematic diagram of a hardware structure of an optional example of an electronic device provided in the embodiment of the present application is shown, where the electronic device may be adapted to a live broadcast interaction method and apparatus provided in the embodiment of the present application, and in practical application of the present application, the electronic device may serve as a live broadcast terminal, and as shown in fig. 10, a hardware structure of the electronic device may include: a display screen 31, a communication interface 32, a memory 33, and a processor 34;
in the embodiment of the present application, the communication interface 32, the memory 33, and the processor 34 may implement communication with each other through a communication bus, and the number of the communication interface 32, the memory 33, the processor 34, and the communication bus may be at least one.
The display screen 31 may be a touch type or non-touch type display screen, and in this embodiment, the display screen may be used in a live broadcast interaction method implementation process to implement display of content included in each page/panel, such as the display content shown in fig. 7a to 7g and fig. 8a and 8b, and the content display principle is not described in detail in this application.
Communication interface 32 may be a data interface of a communication module, such as a GSM module, a WIFI module, or a data interface of other wired or wireless communication networks, and may implement data interaction with other devices, and may further include interfaces such as a USB interface, a serial/parallel interface, and the like, for implementing data interaction between internal components of an electronic device, and may be determined according to a product type of the electronic device, which is not described in detail herein.
In the present embodiment, the memory 33 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage device. The processor 34 may be a Central Processing Unit (CPU), an application-specific integrated circuit (ASIC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device.
The memory 33 stores a program for implementing the live broadcast interaction method described in the above method embodiment, and the processor 34 calls and loads the program stored in the memory 33 to implement the steps of the live broadcast interaction method executed by the electronic device with the corresponding identity (i.e., the identity in the live broadcast room, such as the anchor terminal or the audience terminal, etc.), and the specific implementation process may refer to the description of the corresponding parts of the above method embodiment and will not be described again.
It should be understood that the structure of the electronic device shown in fig. 10 does not constitute a limitation to the electronic device in the embodiment of the present application, and in practical applications, the electronic device may include more or less components than those shown in fig. 10, or may combine some components, such as the image collector, the sound pickup, the microphone, the sensor module including various sensors, the antenna, the power management module, and the like shown in fig. 11, which is not listed here.
Finally, it should be noted that, in the present specification, the embodiments are described in a progressive or parallel manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The device, the electronic device and the system disclosed by the embodiment correspond to the method disclosed by the embodiment, so that the description is relatively simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether these functions are performed in hardware or software depends on the specific application of the solution and design pre-set conditions. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (14)

1. A live interaction method, comprising:
outputting a live broadcast page of a live broadcast room, and displaying live broadcast content on the live broadcast page;
presenting a virtual gift for a gift receiving object of the live broadcast room;
responding to the gesture triggering operation of the gift receiving object on the displayed virtual gift, and displaying a corresponding gift triggering image on the live broadcast page; wherein the gift triggering image comprises a gift triggering gesture made by the gift receiving object;
in response to the gift triggering gesture being associated with the virtual gift and the gift triggering image and the virtual gift displayed on the live page satisfying a gift triggering condition, displaying a first special effect triggered by the virtual gift after updating the displayed virtual gift to a to-be-triggered virtual gift with a second special effect, wherein the gift triggering condition is determined according to the type of the virtual gift.
2. The method of claim 1, further comprising:
responding to the motion track information of the gift triggering gesture recognized from the live video stream of the live broadcast page, and dynamically displaying the gift triggering image according to the motion track of the gift triggering gesture;
the gift triggering image and the virtual gift displayed on the live broadcast page meet gift triggering conditions, which include:
the first display position of the gift trigger image dynamically displayed by the live broadcast page is matched with the specific display position of the virtual gift.
3. The method of claim 1, wherein in presenting the first effect that the virtual gift was triggered, the method further comprises:
displaying respective object identifications of a gift sending object and a gift receiving object of the virtual gift on the live broadcast page; and/or the presence of a gas in the gas,
and outputting the voice prompt message that the gift receiving object successfully receives the virtual gift given by the gift sending object.
4. The method of claim 1, wherein presenting the triggered first special effect of the virtual gift comprises:
and responding to the display duration of the virtual gift to be triggered to reach a first duration, and skipping to display the triggered first special effect of the virtual gift to be triggered.
5. The method of claim 1, wherein the updating the virtual gift being presented to a to-be-triggered virtual gift having a second special effect comprises:
and adding a second special effect map in the gift triggering image at a specific position of the virtual gift, and magnifying and displaying the obtained virtual gift to be triggered with the second special effect.
6. The method according to any one of claims 1 to 5, further comprising:
canceling the display of the virtual gift in response to the display duration of the virtual gift reaching a second duration and the gift triggering image not being recognized from the live video stream of the live broadcast page; and/or the presence of a gas in the gas,
and canceling the display of the virtual gift in response to the display duration of the virtual gift reaching a third duration and the gift triggering image displayed on the live broadcast page and the virtual gift not meeting the gift triggering condition.
7. The method of any of claims 1-5, wherein presenting the triggered first effect of the virtual gift comprises:
and playing a first special effect video file triggered aiming at the virtual gift, and displaying the first special effect triggered by the virtual gift on the live broadcast page.
8. The method according to any one of claims 1 to 5, wherein the virtual gift comprises a fireworks gift, and the displaying of the corresponding gift triggering image on the live page in response to the gesture triggering operation of the gift-receiving object on the displayed virtual gift comprises:
in response to a firework ignition gesture operation performed by the gift receiving object on the displayed firework gift, increasing display of a flame image at a specific display position of the recognized firework ignition gesture;
the displaying a first special effect that the virtual gift is triggered after the displayed virtual gift is updated to a to-be-triggered virtual gift with a second special effect in response to the gift triggering gesture being associated with the virtual gift and the gift triggering image displayed by the live page and the virtual gift satisfying a gift triggering condition comprises:
and responding to the flame image on the firework ignition gesture displayed on the live broadcast page, at least partially overlapping with a fuse display area contained in the firework gift, and displaying a firework bursting effect on the live broadcast page.
9. The method of any one of claims 1 to 5, wherein in the presenting the virtual gift for the gift object of the live broadcast room, the method further comprises:
outputting a gift receiving notice in the live broadcast page displayed by the live broadcast client of the gift receiving object;
wherein the gift reception notification comprises a gift reception prompting message for the virtual gift, and/or a gesture prompting message triggered by the virtual gift.
10. The method according to any one of claims 1 to 5, wherein the obtaining of the gift-triggering gesture comprises:
acquiring gesture recognition information of the gift collecting object; the gesture recognition information is obtained by performing gesture recognition on the collected hand image of the gift receiving object;
determining the gesture type of the current gesture made by the gift receiving object by utilizing the gesture recognition information;
and if the gesture type is consistent with the trigger gesture type of the virtual gift, determining the current gesture as the gift trigger gesture of the virtual gift.
11. The method of claim 10, wherein in the case that the gift object is a first viewer of the live broadcast and the gift object is a anchor of the live broadcast, the obtaining of the gesture recognition information comprises:
skipping to display an identity verification panel of a gift receiving object aiming at the virtual gift in the live broadcast page output by the live broadcast terminal of the first audience;
outputting an authentication qualified notification in response to an authentication input operation of the first viewer with respect to the authentication panel;
responding to the gesture input operation of the first audience aiming at the virtual gift, and sending the obtained gesture recognition information to each live broadcast terminal of the live broadcast room for processing.
12. A live interaction device, the device comprising:
the live broadcast content display module is used for outputting a live broadcast page of a live broadcast room and displaying live broadcast content on the live broadcast page;
the virtual gift display module is used for displaying a virtual gift of a gift receiving object aiming at the live broadcast room;
the gift triggering module is used for responding to the gesture triggering operation of the gift receiving object on the displayed virtual gift and displaying a corresponding gift triggering image on the live broadcast page; wherein the gift triggering image comprises a gift triggering gesture made by the gift receiving object;
a special effect display module, configured to, in response to the gift-triggering gesture being associated with the virtual gift and the gift-triggering image displayed on the live page and the virtual gift satisfying a gift-triggering condition, display a first special effect that the virtual gift is triggered after the virtual gift to be displayed is updated to a to-be-triggered virtual gift having a second special effect, where the gift-triggering condition is determined according to the type of the virtual gift.
13. An electronic device, characterized in that the electronic device comprises: display screen, communication interface, memory and processor, wherein:
the memory for storing a program for implementing the live interaction method of claim 1;
the processor is used for loading and executing the program stored in the memory so as to realize the steps of the live broadcast interaction method as claimed in claim 1.
14. A computer-readable storage medium having stored thereon, a computer program for invocation and execution by a processor to implement the steps of the live interaction method of claim 1.
CN202110592990.2A 2021-05-28 2021-05-28 Live broadcast interaction method and related equipment Active CN113329234B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110592990.2A CN113329234B (en) 2021-05-28 2021-05-28 Live broadcast interaction method and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110592990.2A CN113329234B (en) 2021-05-28 2021-05-28 Live broadcast interaction method and related equipment

Publications (2)

Publication Number Publication Date
CN113329234A CN113329234A (en) 2021-08-31
CN113329234B true CN113329234B (en) 2022-06-10

Family

ID=77422343

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110592990.2A Active CN113329234B (en) 2021-05-28 2021-05-28 Live broadcast interaction method and related equipment

Country Status (1)

Country Link
CN (1) CN113329234B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113744135A (en) * 2021-09-16 2021-12-03 北京字跳网络技术有限公司 Image processing method, image processing device, electronic equipment and storage medium
CN113840154B (en) * 2021-09-22 2023-12-19 广州方硅信息技术有限公司 Live broadcast interaction method and system based on virtual gift and computer equipment
CN113691829B (en) * 2021-10-26 2022-04-08 阿里巴巴达摩院(杭州)科技有限公司 Virtual object interaction method, device, storage medium and computer program product
CN114143568B (en) * 2021-11-15 2024-02-09 上海盛付通电子支付服务有限公司 Method and device for determining augmented reality live image
US11960784B2 (en) 2021-12-07 2024-04-16 Snap Inc. Shared augmented reality unboxing experience
US11748958B2 (en) * 2021-12-07 2023-09-05 Snap Inc. Augmented reality unboxing experience
CN114257834B (en) * 2021-12-30 2023-12-08 广州方硅信息技术有限公司 Virtual gift interaction method and device, equipment and medium for live broadcasting room
CN114567792A (en) * 2022-02-18 2022-05-31 北京达佳互联信息技术有限公司 Virtual resource display method, device, equipment, server and storage medium
CN114679597B (en) * 2022-03-12 2023-12-26 上海哔哩哔哩科技有限公司 Live broadcast interaction method, anchor terminal, user terminal and system
CN115225923B (en) * 2022-06-09 2024-03-22 广州博冠信息科技有限公司 Method and device for rendering gift special effects, electronic equipment and live broadcast server
CN115314728A (en) * 2022-07-29 2022-11-08 北京达佳互联信息技术有限公司 Information display method, system, device, electronic equipment and storage medium
CN115937430B (en) * 2022-12-21 2023-10-10 北京百度网讯科技有限公司 Method, device, equipment and medium for displaying virtual object
CN116503289B (en) * 2023-06-20 2024-01-09 北京天工异彩影视科技有限公司 Visual special effect application processing method and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108076370A (en) * 2017-02-13 2018-05-25 北京市商汤科技开发有限公司 Information transferring method, device and electronic equipment
CN108986192A (en) * 2018-07-26 2018-12-11 北京运多多网络科技有限公司 Data processing method and device for live streaming
CN109195001A (en) * 2018-07-02 2019-01-11 广州虎牙信息科技有限公司 Methods of exhibiting, device, storage medium and the terminal of present is broadcast live
CN109618181A (en) * 2018-11-28 2019-04-12 网易(杭州)网络有限公司 Exchange method and device, electronic equipment, storage medium is broadcast live
CN109905754A (en) * 2017-12-11 2019-06-18 腾讯科技(深圳)有限公司 Virtual present collection methods, device and storage equipment
CN111541909A (en) * 2020-04-30 2020-08-14 广州华多网络科技有限公司 Panoramic live broadcast gift delivery method, device, equipment and storage medium
CN112383786A (en) * 2020-11-03 2021-02-19 广州繁星互娱信息科技有限公司 Live broadcast interaction method, device, system, terminal and storage medium
CN113038229A (en) * 2021-02-26 2021-06-25 广州方硅信息技术有限公司 Virtual gift broadcasting control method, virtual gift broadcasting control device, virtual gift broadcasting control equipment and virtual gift broadcasting control medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106658038A (en) * 2016-12-19 2017-05-10 广州虎牙信息科技有限公司 Live broadcast interaction method based on video stream and corresponding device thereof
CN109002249B (en) * 2017-05-31 2021-01-01 武汉斗鱼网络科技有限公司 Method, storage medium, device and system for realizing continuous shooting of gifts through long-press gesture
CN111010585B (en) * 2019-12-06 2021-10-22 广州方硅信息技术有限公司 Virtual gift sending method, device, equipment and storage medium
CN111147877B (en) * 2019-12-27 2022-04-12 广州方硅信息技术有限公司 Virtual gift presenting method, device, equipment and storage medium
CN111787411B (en) * 2020-06-18 2021-11-19 广州方硅信息技术有限公司 Virtual resource transfer method, device, equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108076370A (en) * 2017-02-13 2018-05-25 北京市商汤科技开发有限公司 Information transferring method, device and electronic equipment
CN109905754A (en) * 2017-12-11 2019-06-18 腾讯科技(深圳)有限公司 Virtual present collection methods, device and storage equipment
CN109195001A (en) * 2018-07-02 2019-01-11 广州虎牙信息科技有限公司 Methods of exhibiting, device, storage medium and the terminal of present is broadcast live
CN108986192A (en) * 2018-07-26 2018-12-11 北京运多多网络科技有限公司 Data processing method and device for live streaming
CN109618181A (en) * 2018-11-28 2019-04-12 网易(杭州)网络有限公司 Exchange method and device, electronic equipment, storage medium is broadcast live
CN111541909A (en) * 2020-04-30 2020-08-14 广州华多网络科技有限公司 Panoramic live broadcast gift delivery method, device, equipment and storage medium
CN112383786A (en) * 2020-11-03 2021-02-19 广州繁星互娱信息科技有限公司 Live broadcast interaction method, device, system, terminal and storage medium
CN113038229A (en) * 2021-02-26 2021-06-25 广州方硅信息技术有限公司 Virtual gift broadcasting control method, virtual gift broadcasting control device, virtual gift broadcasting control equipment and virtual gift broadcasting control medium

Also Published As

Publication number Publication date
CN113329234A (en) 2021-08-31

Similar Documents

Publication Publication Date Title
CN113329234B (en) Live broadcast interaction method and related equipment
CN113395533B (en) Virtual gift special effect display method and device, computer equipment and storage medium
CN112602077A (en) Interactive video content distribution
CN110784752A (en) Video interaction method and device, computer equipment and storage medium
CN111050222B (en) Virtual article issuing method, device and storage medium
CN113727130B (en) Message prompting method, system and device for live broadcasting room and computer equipment
WO2018125161A1 (en) Aggregation of media effects
CN114245221B (en) Interaction method and device based on live broadcasting room, electronic equipment and storage medium
CN112087655A (en) Method and device for presenting virtual gift and electronic equipment
CN113115114B (en) Interaction method, device, equipment and storage medium
CN113382274B (en) Data processing method and device, electronic equipment and storage medium
WO2015188753A1 (en) Interaction method based on multimedia programs and terminal device
CN113411656B (en) Information processing method, information processing device, computer equipment and storage medium
CN111294606B (en) Live broadcast processing method and device, live broadcast client and medium
CN106105172A (en) Highlight the video messaging do not checked
CN114466209A (en) Live broadcast interaction method and device, electronic equipment, storage medium and program product
WO2019047850A1 (en) Identifier displaying method and device, request responding method and device
WO2023040601A1 (en) Data matching method and apparatus, and device and computer-readable storage medium
CN112925462B (en) Account head portrait updating method and related equipment
CN113179416B (en) Live content rebroadcasting method and related equipment
CN109788327B (en) Multi-screen interaction method and device and electronic equipment
CN105577641B (en) System and method for inviting users to participate in an activity based on interactive recording
JP2016153925A (en) Server device, terminal device and processing method
CN112752159B (en) Interaction method and related device
CN113938700B (en) Live broadcast room switching method and device and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40050105

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant