CN113613033A - Method, device, electronic equipment and medium for live broadcast interaction between audience and anchor - Google Patents
Method, device, electronic equipment and medium for live broadcast interaction between audience and anchor Download PDFInfo
- Publication number
- CN113613033A CN113613033A CN202110887803.3A CN202110887803A CN113613033A CN 113613033 A CN113613033 A CN 113613033A CN 202110887803 A CN202110887803 A CN 202110887803A CN 113613033 A CN113613033 A CN 113613033A
- Authority
- CN
- China
- Prior art keywords
- audio
- target
- track
- interaction
- target sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 185
- 238000000034 method Methods 0.000 title claims abstract description 77
- 230000033764 rhythmic process Effects 0.000 claims abstract description 136
- 230000002452 interceptive effect Effects 0.000 claims abstract description 103
- 230000008569 process Effects 0.000 claims abstract description 36
- 230000000977 initiatory effect Effects 0.000 claims abstract description 32
- 238000000926 separation method Methods 0.000 claims description 30
- 238000000605 extraction Methods 0.000 claims description 20
- 238000004891 communication Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 13
- 239000000284 extract Substances 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a live broadcast interaction method, a live broadcast interaction device, electronic equipment and a medium for audiences and anchor, relates to the technical field of live broadcast, and can enrich the live broadcast interaction mode of the audiences and the anchor. The embodiment of the invention comprises the following steps: and the stream pushing client receives an interaction initiating instruction sent by the anchor, and then sends interaction information to the specified stream pulling client, wherein the interaction information represents the initiation of interaction. And the stream pulling client displays the audio track selection interface after receiving the interaction information, receives the target audio track selected by the audience on the audio track selection interface, and sends the audio track information carrying the target audio track selected by the audience on the audio track selection interface to the stream pushing client. And then the plug-flow client determines a target sub-audio on a target audio track included in the designated interactive audio and determines a rhythm point in the target sub-audio. And then receiving touch operation of the main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
Description
Technical Field
The present invention relates to the field of live broadcast technologies, and in particular, to a live broadcast interaction method, apparatus, electronic device, and medium for audience and anchor.
Background
Under the current live broadcast scene, when watching the live broadcast, audiences can only passively watch the live broadcast content of the anchor and publish comments in the live broadcast room, the anchor can only interact with the audiences by checking and replying the comments, and the live broadcast interaction mode of the audiences and the anchor is single.
Disclosure of Invention
The embodiment of the invention aims to provide a live broadcast interaction method, a live broadcast interaction device, electronic equipment and a live broadcast interaction medium for audiences and anchor, so as to enrich the live broadcast interaction mode of the audiences and the anchor. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a live broadcast interaction method between a viewer and a main broadcast, which is applied to a push streaming client, where the method includes:
receiving an interaction initiating instruction sent by a main broadcast;
responding to the interaction initiating instruction, sending interaction information to a specified pull stream client, wherein the interaction information is used for representing interaction initiation, so that the specified pull stream client displays an audio track selection interface after receiving the interaction information, receives a target audio track selected by a viewer on the audio track selection interface, and sends audio track information to the push stream client, and the audio track information is used for representing the target audio track selected by the viewer on the audio track selection interface;
receiving audio track information sent by the appointed pull stream client;
determining a designated interactive audio and a target sub audio on a target audio track included in the interactive audio, and determining a rhythm point in the target sub audio, wherein the volume of the rhythm point is greater than a preset volume;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
Optionally, the determining a target sub-audio on a target audio track included in the designated interactive audio includes:
when the interactive audio is a single-track audio, separating the target sub-audio from the interactive audio by using a preset separation algorithm;
or when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
Optionally, the determining a target sub-audio on a target audio track included in the designated interactive audio includes:
sending a separation request to a server, wherein the separation request comprises the interactive audio and the target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on a target audio track based on the target audio track identifier, and sends the target sub-audio to the stream pushing client;
and receiving the target sub-audio sent by the server.
Optionally, the determining a rhythm point in the target sub-audio includes:
extracting rhythm points in the target sub-audio by using a preset rhythm extraction algorithm;
or acquiring a rhythm file corresponding to the target sub-audio based on a preset corresponding relation between each sub-audio and the rhythm file, wherein the rhythm file comprises rhythm points in the sub-audio;
or sending an extraction request to a server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the stream pushing client; and receiving the rhythm point in the target sub-audio sent by the server.
Optionally, the number of the target audio tracks is multiple, the receiving of the touch operation of the main player in the process of playing the target sub-audio is performed, and an interaction result is obtained based on a time difference between a receiving time of the touch operation and a playing time of the rhythm point of the target sub-audio, including:
determining a designated audio track in a plurality of target audio tracks and taking sub-audio on the designated audio track as designated sub-audio;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the specified sub-audio.
In a second aspect, an embodiment of the present invention provides a live broadcast interaction method between a viewer and a main broadcast, which is applied to a pull streaming client, where the method includes:
receiving interaction information sent by a plug flow client, wherein the interaction information is used for expressing the initiation of interaction;
displaying an audio track selection interface, and receiving a target audio track selected by a viewer on the audio track selection interface;
and sending track information to the stream pushing client, wherein the track information is used for representing a target track selected by the audience on the track selection interface, so that the stream pushing client determines a target sub-audio on the target track included in the specified interactive audio and determines a rhythm point in the target sub-audio, the volume of the rhythm point is greater than the preset volume, a touch operation of a main player is received in the process of playing the target sub-audio, and an interaction result is obtained based on a time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
In a third aspect, an embodiment of the present invention provides a live broadcast interaction device for an audience and an anchor, which is applied to a push streaming client, where the device includes:
the receiving module is used for receiving an interaction initiating instruction sent by a main broadcast;
the sending module is used for responding to the interaction initiating instruction, sending interaction information to a specified pull stream client, wherein the interaction information is used for representing the initiation of interaction, so that the specified pull stream client displays an audio track selection interface after receiving the interaction information, receives a target audio track selected by the audience on the audio track selection interface, and sends audio track information to the push stream client, and the audio track information is used for representing the target audio track selected by the audience on the audio track selection interface;
the receiving module is further configured to receive audio track information sent by the specified pull stream client;
the system comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a designated interactive audio and a target sub audio on a target audio track included in the interactive audio, and determining a rhythm point in the target sub audio, and the volume of the rhythm point is greater than the preset volume;
the determining module is further configured to receive a touch operation of a main player in the process of playing the target sub-audio, and obtain an interaction result based on a time difference between a receiving time of the touch operation and a playing time of the rhythm point of the target sub-audio.
Optionally, the determining module is specifically configured to:
when the interactive audio is a single-track audio, separating the target sub-audio from the interactive audio by using a preset separation algorithm;
or when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
Optionally, the determining module is specifically configured to:
sending a separation request to a server, wherein the separation request comprises the interactive audio and the target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on a target audio track based on the target audio track identifier, and sends the target sub-audio to the stream pushing client;
and receiving the target sub-audio sent by the server.
Optionally, the determining module is specifically configured to:
extracting rhythm points in the target sub-audio by using a preset rhythm extraction algorithm;
or acquiring a rhythm file corresponding to the target sub-audio based on a preset corresponding relation between each sub-audio and the rhythm file, wherein the rhythm file comprises rhythm points in the sub-audio;
or sending an extraction request to a server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the stream pushing client; and receiving the rhythm point in the target sub-audio sent by the server.
Optionally, the number of the target audio tracks is multiple, and the determining module is specifically configured to:
determining a designated audio track in a plurality of target audio tracks and taking sub-audio on the designated audio track as designated sub-audio;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the specified sub-audio.
In a fourth aspect, an embodiment of the present invention provides a device for live interaction between a viewer and a main broadcast, where the device is applied to a pull streaming client, and the device includes:
the receiving module is used for receiving interaction information sent by the plug flow client, and the interaction information is used for representing the initiation of interaction;
the display module is used for displaying the audio track selection interface and receiving a target audio track selected by the audience on the audio track selection interface;
the system comprises a sending module and a stream pushing client, wherein the sending module is used for sending audio track information to the stream pushing client, the audio track information is used for representing a target audio track selected by the audience on the audio track selection interface, so that the stream pushing client determines a target sub audio frequency on the target audio track included in the specified interactive audio frequency and determines a rhythm point in the target sub audio frequency, the volume of the rhythm point is larger than the preset volume, touch operation of a main player is received in the process of playing the target sub audio frequency, and an interactive result is obtained based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub audio frequency.
In a fifth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of the live broadcast interaction method between any audience and the anchor when executing the program stored in the memory.
In a sixth aspect, the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when executed by a processor, the computer program implements the steps of any of the above-mentioned methods for live interaction between a viewer and a main broadcast.
In a seventh aspect, an embodiment of the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute any of the above-mentioned methods for a viewer to interact with a main broadcast.
According to the live broadcast interaction method, device, electronic equipment and medium for the audience and the anchor, after the stream pushing client receives the interaction initiating instruction sent by the anchor, the stream pushing client sends the interaction information to the specified stream pulling client, then the specified stream pulling client receives the target audio track selected by the audience, and sends the audio track information to the stream pushing client. And then the stream pushing client determines a target sub audio frequency on a target audio track included in the interactive audio frequency, determines a rhythm point in the target sub audio frequency, receives touch operation of the anchor in the process of playing the target sub audio frequency, and obtains an interactive result based on a time difference between the receiving time of the touch operation of the anchor and the playing time of the rhythm point of the target sub audio frequency. Therefore, according to the embodiment of the invention, after the anchor initiates the interaction instruction, the audience can select the target audio track, and the interaction result is obtained based on the rhythm point of the target sub-audio and the touch operation of the anchor. Because the interaction result is determined by the common operation of the anchor and the audiences, and the audio tracks selected by different audiences are different, the interaction form is enriched, and the live broadcast interaction mode of the audiences and the anchor is enriched.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by referring to these drawings.
Fig. 1 is a flowchart of a live interaction method between a viewer and a main broadcast according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for determining an interaction result according to an embodiment of the present invention;
fig. 3 is a flowchart of another method for live interaction between a viewer and a main broadcast according to an embodiment of the present invention;
FIG. 4 is an exemplary diagram of an audience user interface provided by an embodiment of the present invention;
fig. 5 is a signaling diagram of a live interaction process between a viewer and a host according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a live interaction device for audience and anchor according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another live interaction device for a viewer and a main broadcast according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived from the embodiments given herein by one of ordinary skill in the art, are within the scope of the invention.
The embodiment of the invention is applied to a live broadcast scene, a client used by a main broadcast during live broadcast is called a push stream client, and a client used by a viewer for watching the live broadcast is called a pull stream client.
At present, when watching a live broadcast, audiences can only passively watch live broadcast content of a main broadcast and publish comments in a live broadcast room, and the main broadcast can only interact with the audiences by checking and replying the comments, so that the interaction mode of the audiences and the main broadcast is single.
In order to enrich the live broadcast interaction mode between the audience and the anchor, an embodiment of the present invention provides a live broadcast interaction method between the audience and the anchor, which is applied to a stream pushing client, as shown in fig. 1, and the method includes the following steps:
s101, receiving an interaction initiating instruction sent by a main broadcast.
In one embodiment, the streaming client may indicate that an interaction instruction sent by the anchor is received when the anchor is detected to click an interaction button in the anchor user interface. Or, the stream pushing client may, in a voice recognition mode, indicate that an interaction instruction sent by the anchor is received when detecting a specified statement spoken by the anchor. For example, the specified statement may be "start an interaction".
Or the anchor may also send the instruction to initiate the interaction in other manners, which is not specifically limited in this embodiment of the present invention.
S102, responding to the initiating interaction instruction, sending interaction information to the specified stream pulling client, enabling the specified stream pulling client to display the audio track selection interface after receiving the interaction information, receiving the target audio track selected by the audience on the audio track selection interface, and sending the audio track information to the stream pushing client.
The interaction information is used for representing the initiation of interaction, and the audio track information is used for representing a target audio track selected by a viewer on the audio track selection interface. For example, the track information carries an identification of the target track selected by the viewer at the track selection interface.
In one embodiment, the push streaming client may send the interaction information to the server, and then the server sends the interaction information to the specified pull streaming client.
The audio track selection interface comprises a plurality of audio track icons of preset audio tracks, and the pull streaming client takes the preset audio tracks corresponding to the audio track icons selected by the user in the audio track selection interface as target audio tracks. That is, the viewer can select a target track from a plurality of preset tracks using the pull streaming client, and thus the interactive audio in S104 needs to include each preset track. Since the interactive audio may be any audio in the music library, each audio in the music library contains a respective predetermined audio track. For example, the preset audio track includes: a person track, a piano track, and a drum track.
S103, receiving the audio track information sent by the specified pull streaming client.
In one embodiment, the designated pull client may send the track information to the server, which sends the track information to the push client.
And S104, determining target sub-audio on a target audio track included in the designated interactive audio, and determining a rhythm point in the target sub-audio.
Alternatively, the designated interactive audio may be audio selected by the anchor. For example, the anchor can select audio from a music library and send an initiating interaction instruction, the initiating interaction instruction carries an interaction audio identifier at the moment, and the stream pushing client can obtain interaction audio corresponding to the interaction audio identifier from the music library based on the interaction audio identifier carried by the interaction instruction.
Alternatively, the designated interactive audio may be random audio. For example, the plug-flow client may randomly select one audio in a music library as the interactive audio.
The volume of the rhythm point is greater than a preset volume, for example, the preset volume is 60 db. For example, the rhythm point of the human voice audio is the pronunciation time point of each character, the rhythm point of the piano audio is the playing time point of each note, and the rhythm point of the drum voice audio is the playing time point of each drum point.
In an embodiment of the invention, the interactive audio is audio comprising a plurality of sounds, each of which may be on one track, i.e. the interactive audio may comprise a plurality of tracks, the target track being one of the plurality of tracks. Embodiments of the present invention refer to audio data on one track as one sub-audio.
And S105, receiving touch operation of the main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
After determining the target sub audio and the tempo point in S104, the target sub audio is played and S105 is performed.
In one embodiment, there are generally a plurality of rhythm points of the target sub-audio, and a plurality of touch operations of the corresponding anchor, and S105 needs to associate each touch operation with one rhythm point, and then determine a time difference between the touch operation and the corresponding rhythm point to obtain an interaction result. Optionally, the touch operation includes clicking, long-pressing, sliding, and/or double-clicking.
Optionally, the stream pushing client may search, for each touch operation, a play time having a minimum difference with a receiving time of the touch operation from the play times of the rhythm points, and use the rhythm point of the play time as the rhythm point corresponding to the touch operation.
In the embodiment of the present invention, the interaction result may be a time difference between a receiving time of each touch operation and a playing time of the rhythm point of the target sub-audio, or the interaction result may be an interaction score determined based on each time difference. For example, the plug-flow client may calculate a time difference between each touch operation and the corresponding rhythm point, then calculate a sum of the time differences, and determine an interaction score corresponding to the sum of the time differences based on a preset corresponding relationship between the time differences and the interaction scores.
Optionally, the touch operation received by the streaming client at the designated position of the anchor user interface is a touch operation related to the interaction result, so that the influence of the live interaction between the anchor and the audience on other functions in the anchor user interface is reduced.
According to the live broadcast interaction method, device, electronic equipment and medium for the audience and the anchor, after the stream pushing client receives the interaction initiating instruction sent by the anchor, the stream pushing client sends the interaction information to the specified stream pulling client, then the specified stream pulling client receives the target audio track selected by the audience, and sends the audio track information to the stream pushing client. And then the stream pushing client determines a target sub audio frequency on a target audio track included in the interactive audio frequency, determines a rhythm point in the target sub audio frequency, receives touch operation of the anchor in the process of playing the target sub audio frequency, and obtains an interactive result based on a time difference between the receiving time of the touch operation of the anchor and the playing time of the rhythm point of the target sub audio frequency. Therefore, according to the embodiment of the invention, after the anchor initiates the interaction instruction, the audience can select the target audio track, and the interaction result is obtained based on the rhythm point of the target sub-audio and the touch operation of the anchor. Because the interaction result is determined by the common operation of the anchor and the audiences, and the audio tracks selected by different audiences are different, the interaction form is enriched, and the live broadcast interaction mode of the audiences and the anchor is enriched.
Optionally, the specified pull client is a pull client that logs in a specified audience account. The designated audience account may be any account currently viewing the live broadcast room opened by the push streaming client, or may be an account currently viewing the gift sent to the live broadcast room, of the accounts currently viewing the live broadcast room opened by the push streaming client, whose sum meets a preset sum condition. For example, the preset money amount conditions include: the accumulated money ranking is not lower than the preset ranking and/or the total money of the gifts sent in the appointed time period reaches the preset money, and the like.
For example, after the push streaming client sends the interaction information to the server, the server sends the interaction information to the pull streaming client (i.e., the designated pull streaming client) that sends the account with the first gift money rank to the live broadcast room from among the accounts currently watching the live broadcast room.
Or after the stream pushing client sends the interactive information to the server, the server sends a prompt instruction to the stream pulling client which is watching the account of the live broadcast room at present, wherein the prompt instruction is used for prompting to strive for the interactive control right. And after receiving the prompt instruction, the pull stream client displays prompt information for indicating that the interactive control right is strived for on a user interface of the audience. And when detecting that the total sum of the gifts sent out by the live broadcast room after the account receives the prompt instruction reaches the preset sum, the server sends interactive information to the pull stream client of the account (namely, the appointed pull stream client).
The designated pull client can be one or more. When a plurality of specified pull-streaming clients are provided, the push-streaming client plays a target sub-audio on a target audio track represented by the audio track information every time the push-streaming client receives the audio track information sent by one specified pull-streaming client when executing S105, receives a touch operation of the anchor, and calculates a time difference between a receiving time of the touch operation and a playing time of a rhythm point of the target sub-audio. And finally, obtaining an interaction result according to the calculated time difference.
For example, the push streaming client receives the audio track information sent by the pull streaming client a, wherein the audio track information is used to represent audio track 1. The stream pushing client plays the sub audio 1 on the audio track 1 of the interactive audio, receives the touch operation of the main player, and calculates the time difference between the receiving time of each touch operation and the playing time of the rhythm point of the sub audio 1. In the process, the push streaming client receives the audio track information sent by the pull streaming client B, wherein the audio track information is used for representing the audio track 2. The stream pushing client stops playing the sub audio 1 and starts playing the sub audio 2 on the audio track 2 of the interactive audio from the current playing time. For example, if the current playback time is 1 minute 30 seconds, playback is started from 1 minute 30 seconds of the sub audio 2. And simultaneously receiving touch operations of the main broadcasting, and calculating the time difference between the receiving time of each touch operation and the playing time of the rhythm point of the sub audio 2. And then calculating the sum of the time differences, and taking the score corresponding to the sum as the interaction result.
The embodiment of the invention can adjust the sub-audio played by the plug-flow client in real time based on different audio tracks selected by different audiences, increases the audience number interacting with the anchor and realizes multi-person interaction between the anchor and the audiences.
In an embodiment of the present invention, the plug-streaming client may determine the target sub-audio by using the audio music separation module. When the audio-music separation module is located at the plug-streaming client, the manners of determining the target sub-audio on the target audio track included in the specified interactive audio in S104 include the following two manners:
in the first mode, when the interactive audio is a single-track audio, a preset separation algorithm is used to separate the target sub-audio from the interactive audio.
In one embodiment, the stream pushing client may call its own audio-music separation module, and separate the target sub-audio from the interactive audio by using a preset separation algorithm through the audio-music separation module.
The preset separation algorithm is an algorithm obtained based on an artificial intelligence algorithm.
For example, when the interactive audio is a monophonic track audio, various sounds are on one track, and when the target track is used to represent human voice, a preset separation algorithm may be used to extract a target sub-audio that only contains human voice from the interactive audio.
And secondly, when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
In one embodiment, the stream pushing client may invoke its own audio-music separation module to extract the target sub-audio on the target audio track of the interactive audio.
For example, there are three audio tracks in the interactive audio, the audio track 1 contains a piece of cucurbit flute sound, the audio track 2 contains a piece of violin and the audio track 3 contains a piece of human voice, and the time durations of the sub-audio frequencies on the three audio tracks are the same and equal to the time duration of the interactive audio. When the target track is used to represent a human voice, the target sub-audio on track 3 is acquired.
When the audio-music separation module is located in the server, the manner that the streaming client determines the target sub-audio on the target audio track included in the specified interactive audio in S104 may be implemented as follows: and sending a separation request to a server, wherein the separation request comprises interactive audio and a target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on the target audio track based on the target audio track identifier, and sends the target sub-audio to a stream pushing client. And then the plug-flow client receives the target sub-audio sent by the server.
In the embodiment of the invention, the server can call the audio and music separation module of the server, and the audio and music separation module is used for separating the interactive audio to obtain the target sub-audio on the target audio track. Optionally, the manner in which the server determines the target sub-audio may refer to the first manner and the second manner, which is not described herein again.
Optionally, the music library may store sub-audios on a plurality of preset audio tracks included in each audio in advance, where the target audio track may be an audio track selected by the audience in the plurality of preset audio tracks. On this basis, when executing the above S104, the stream pushing client may obtain the sub-audio on the target audio track included in the interactive audio from the music library.
In the embodiment of the invention, the plug-flow client can separate the interactive audio to obtain the sub-audio containing one sound, so that different sub-audios can be played based on the selection of the audience.
The above-mentioned ways of determining the tempo point in the target sub-audio in S104 include the following three ways:
in the mode 1, a preset rhythm extraction algorithm is utilized to extract rhythm points in the target sub-audio.
In the embodiment of the invention, the plug-flow client can call the music rhythm extraction module to extract the rhythm points in the target sub-audio by using a preset rhythm extraction algorithm.
The preset separation algorithm is an algorithm obtained based on an artificial intelligence algorithm.
Illustratively, when the target sub-audio is an audio including a human voice, a pronunciation time point of each word is taken as a rhythm point. When the target sub audio is an audio including a musical instrument sound, a time point of each note is taken as a rhythm point.
And 2, acquiring a rhythm file corresponding to the target sub-audio based on the preset corresponding relation between each sub-audio and the rhythm file. Wherein the tempo file comprises tempo points in the sub-audio.
In the embodiment of the invention, the preset corresponding relation between each sub-audio and the rhythm file can be stored in the music library in advance, and the stream pushing client can acquire the rhythm file corresponding to the target sub-audio from the music library when determining the rhythm point in the target sub-audio.
And 3, sending an extraction request to the server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the plug-streaming client. And then the plug-flow client receives the rhythm point in the target sub-audio sent by the server.
In the embodiment of the invention, the plug-flow client can determine the rhythm point in the target sub-audio, so that the difference between the touch operation of the anchor and the rhythm point can be determined in the subsequent interaction process, and the interaction result can be obtained.
Alternatively, the number of target tracks may be one or more.
In the case that the number of the target audio tracks is multiple, referring to fig. 2, the step S105 receives the touch operation of the anchor in the process of playing the target sub-audio, and based on the time difference between the receiving time of the touch operation of the anchor and the playing time of the rhythm point of the target sub-audio, the method for obtaining the interaction result includes the following two steps:
s1051, a designated track of the plurality of target tracks is determined, and the sub-audio on the designated track is taken as a designated sub-audio.
In an embodiment of the present invention, the specified track may be any one of the target tracks. For example, the streaming client may randomly select one track from a plurality of target tracks as the designated track.
Alternatively, the specified track may be one specified by the viewer. For example, the viewer selects 3 target tracks within the track selection interface and designates one of the target tracks as the designated track. At this time, the audio track information sent by the pull streaming client to the push streaming client may further include an identifier of a specified audio track.
S1052, receiving the touch operation of the main player in the process of playing the target sub audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the appointed sub audio.
For example, the target sub audio includes sub audio 1, sub audio 2, and sub audio 3, where sub audio 2 is a specific sub audio. And receiving touch operation of the main player in the process of playing the sub audio 1, the sub audio 2 and the sub audio 3, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the sub audio 2.
In the embodiment of the present invention, the push client may display the prompt information on the anchor user interface before and/or during the playing of the target sub-audio, where the prompt information is used to prompt the anchor to specify the sound of the sub-audio. For example, the prompt information includes "please click the screen at the tempo of the piano".
The embodiment of the invention can play one or more target sub-audios, and the more the played sub-audio amount is, the greater the interference on the main broadcasting resolution specifying sub-audio is, and the higher the interaction difficulty is, namely, in the embodiment of the invention, the audience can control the interaction difficulty, and the interestingness of the interaction between the main broadcasting and the audience is improved.
For example, assuming that the sub-audio of 4 tracks can be extracted from the interactive audio, which is A, B, C, D, when the target track is 1, the audio played in the interactive process can be A, B, C, D four sub-audio, that is, 4 interactive modes in total. When the number of the target audio tracks is 2, in the interaction process, playing A and B and designating sub-audio as A, playing A and B and designating sub-audio as B, playing B and C and designating sub-audio as C, playing C and D and designating sub-audio as D, playing A and D and designating sub-audio as A, playing A and D and designating sub-audio as D, namely, 8 modes are total. When the target tracks are 3, 12 modes in total are played A, B and C and designate sub-audio as A, A, B and C and designate sub-audio as B, A, B and C and designate sub-audio as C, B, C and D and designate sub-audio as B, B, C and D and designate sub-audio as C, B, C and D and designate sub-audio as D, A, C and D and designate sub-audio as A, A, C and D and designate sub-audio as C, A, C and D and designate sub-audio as D, play A, B and D and designate sub-audio as A, play A, B and D and designate sub-audio as B, play A, B and D and designate sub-audio as D during the interaction. When the target tracks are 4, A, B, D and C are played and the sub-audio is designated A, A, B, D and C and B, A, B, D and C, A, B, D and C and D during the interaction, for 4 modes. It can be seen that 4 kinds of seed audio can be combined to form 28 kinds of interaction modes, and the interaction form between the audience and the anchor provided by the embodiment of the invention is rich.
The embodiment of the invention provides a live broadcast interaction method of audiences and a main broadcast, which is applied to a pull stream client and comprises the following steps as shown in figure 3:
s301, receiving the interactive information sent by the plug flow client. Wherein the interaction information is used for indicating the initiation of the interaction.
S302, showing the audio track selection interface, and receiving the target audio track selected by the audience on the audio track selection interface.
For example, the track selection interface is shown in fig. 4, and the track selection interface is overlaid on the viewer-side user interface, and includes a selection prompt and a track icon of a preset track. The selection prompt in fig. 4 is "please select the track you want to play: "; the track icon includes: piano icons, drum kit icons, vocal icons, and other icons.
And S303, sending audio track information to the stream pushing client, so that the stream pushing client determines a target sub audio frequency on a target audio track included in the specified interactive audio frequency and determines a rhythm point in the target sub audio frequency, receiving touch operation of the main player in the process of playing the target sub audio frequency, and obtaining an interactive result based on a time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub audio frequency.
The audio track information is used for representing a target audio track selected by the audience on the audio track selection interface, and the volume of the rhythm point is larger than the preset volume.
According to the live broadcast interaction method of the audience and the anchor, the stream pushing client sends interaction information to the appointed stream pulling client after receiving the interaction initiating instruction sent by the anchor, and then the appointed stream pulling client receives the target audio track selected by the audience and sends the audio track information to the stream pushing client. And then the stream pushing client determines a target sub audio frequency on a target audio track included in the interactive audio frequency, determines a rhythm point in the target sub audio frequency, receives touch operation of the anchor in the process of playing the target sub audio frequency, and obtains an interactive result based on a time difference between the receiving time of the touch operation of the anchor and the playing time of the rhythm point of the target sub audio frequency. Therefore, according to the embodiment of the invention, after the anchor initiates the interaction instruction, the audience can select the target audio track, and the interaction result is obtained based on the rhythm point of the target sub-audio and the touch operation of the anchor. Because the interaction result is determined by the common operation of the anchor and the audiences, and the audio tracks selected by different audiences are different, the interaction form is enriched, and the live broadcast interaction mode of the audiences and the anchor is enriched.
It should be noted that, in the method for live interaction between the viewer and the anchor shown in fig. 1 and 3, the descriptions of the same steps can be referred to each other.
Referring to fig. 5, the following describes an overall process of a live broadcast interaction method between a viewer and a main broadcast according to an embodiment of the present invention with reference to an application scenario:
s501, the stream pushing client receives an interaction initiating instruction sent by the anchor.
And S502, the stream pushing client responds to the interaction initiating instruction and sends interaction information to the server. Wherein the interaction information is used for indicating the initiation of the interaction.
S503, the server sends the interaction information to the specified pull stream client.
S504, after the specified pull stream client receives the interaction information, the audio track selection interface is displayed, and the target audio track selected by the audience on the audio track selection interface is received.
And S505, the pull streaming client is appointed to send the audio track information to the server. Wherein the track information is used for representing a target track selected by the audience on the track selection interface.
S506, the server sends the audio track information to the stream pushing client.
And S507, after the stream pushing client receives the audio track information, determining target sub-audio on a target audio track included in the appointed interactive audio, and determining a rhythm point in the target sub-audio.
And S508, the stream pushing client receives the touch operation of the main broadcast in the process of playing the target sub-audio, and obtains an interaction result based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
In the related art, the audience controls the parameters of the interactive game in real time through the stream pulling client, the stream pushing client generates the interactive game based on the parameters of the interactive game, and the anchor completes the interactive game. The interaction mode of the audience and the anchor requires the audience to watch the screen closely and react to adjust the parameters of the interactive game in real time, which has higher requirements on the audience and requires more energy of the audience.
In the embodiment of the invention, the audience can control the difficulty of the interactive game only by selecting the audio track, and then the anchor completes the interactive game under the difficulty. The embodiment of the invention reduces the operation of the audience, namely reduces the energy paid by the audience while ensuring the interest of the interactive game and the richness of the form of the interactive game.
Based on the same inventive concept, corresponding to the embodiment shown in fig. 1, an embodiment of the present invention provides a live broadcast interaction apparatus for viewers and a main broadcast, which is applied to a push streaming client, and as shown in fig. 6, the apparatus includes: a receiving module 601, a sending module 602 and a determining module 603;
a receiving module 601, configured to receive an interaction initiating instruction sent by a host;
a sending module 602, configured to send, in response to an interaction initiating instruction, interaction information to an appointed streaming client, where the interaction information is used to indicate that interaction is initiated, so that the appointed streaming client displays a music track selection interface after receiving the interaction information, receives a target music track selected by an audience on the music track selection interface, and sends music track information to a streaming client, where the music track information is used to indicate the target music track selected by the audience on the music track selection interface;
the receiving module 601 is further configured to receive audio track information sent by a specified pull streaming client;
the determining module 603 is configured to determine a target sub-audio on a target audio track included in the specified interactive audio, and determine a rhythm point in the target sub-audio, where a volume of the rhythm point is greater than a preset volume;
the determining module 603 is further configured to receive a touch operation of the anchor in a process of playing the target sub-audio, and obtain an interaction result based on a time difference between a receiving time of the touch operation and a playing time of the rhythm point of the target sub-audio.
Optionally, the determining module 603 is specifically configured to:
when the interactive audio is a single-track audio, separating a target sub-audio from the interactive audio by using a preset separation algorithm;
or when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
Optionally, the determining module 603 is specifically configured to:
sending a separation request to a server, wherein the separation request comprises interactive audio and a target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on the target audio track based on the target audio track identifier, and sends the target sub-audio to a stream pushing client;
and receiving the target sub-audio sent by the server.
Optionally, the determining module 603 is specifically configured to:
extracting rhythm points in the target sub-audio by using a preset rhythm extraction algorithm;
or acquiring a rhythm file corresponding to the target sub-audio based on a preset corresponding relation between each sub-audio and the rhythm file, wherein the rhythm file comprises rhythm points in the sub-audio;
or sending an extraction request to the server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the stream pushing client; and receiving the rhythm point in the target sub-audio sent by the server.
Optionally, the number of target audio tracks is multiple, and the determining module 603 is specifically configured to:
determining a designated audio track of the plurality of target audio tracks and taking the sub-audio on the designated audio track as a designated sub-audio;
and receiving touch operation of the anchor in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the anchor and the playing time of the rhythm point of the appointed sub-audio.
Based on the same inventive concept, corresponding to the embodiment shown in fig. 3, an embodiment of the present invention provides a live broadcast interaction apparatus for viewers and a main broadcast, which is applied to a pull stream client, as shown in fig. 7, the apparatus includes: a receiving module 701, a display module 702 and a sending module 703;
the receiving module 701 is configured to receive interaction information sent by a stream pushing client, where the interaction information is used to indicate that interaction is initiated;
a display module 702, configured to display a track selection interface, and receive a target track selected by a viewer on the track selection interface;
the sending module 703 is configured to send, to the stream pushing client, audio track information, where the audio track information is used to indicate a target audio track selected by an audience on an audio track selection interface, so that the stream pushing client determines a target sub-audio on the target audio track included in the specified interactive audio and determines a rhythm point in the target sub-audio, where a volume of the rhythm point is greater than a preset volume, receives a touch operation of a main broadcast in a process of playing the target sub-audio, and obtains an interaction result based on a time difference between a receiving time of the touch operation and a playing time of the rhythm point of the target sub-audio.
An embodiment of the present invention further provides an electronic device, as shown in fig. 8, which includes a processor 801, a communication interface 802, a memory 803, and a communication bus 804, where the processor 801, the communication interface 802, and the memory 803 complete mutual communication through the communication bus 804,
a memory 803 for storing a computer program;
the processor 801 is configured to implement the steps executed by the push streaming client or the pull streaming client in the above method embodiment when executing the program stored in the memory 803.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above-mentioned methods for viewer-anchor live interaction.
In yet another embodiment, a computer program product containing instructions is provided, which when run on a computer, causes the computer to perform the method of any of the above embodiments of viewer live interaction with a host.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (14)
1. A method for live interaction between a viewer and a main broadcast is applied to a push streaming client, and comprises the following steps:
receiving an interaction initiating instruction sent by a main broadcast;
responding to the interaction initiating instruction, sending interaction information to a specified pull stream client, wherein the interaction information is used for representing interaction initiation, so that the specified pull stream client displays an audio track selection interface after receiving the interaction information, receives a target audio track selected by a viewer on the audio track selection interface, and sends audio track information to the push stream client, and the audio track information is used for representing the target audio track selected by the viewer on the audio track selection interface;
receiving audio track information sent by the appointed pull stream client;
determining a target sub audio frequency on a target audio track included in the appointed interactive audio frequency, and determining a rhythm point in the target sub audio frequency, wherein the volume of the rhythm point is greater than a preset volume;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
2. The method of claim 1, wherein determining the target sub-audio on the target audio track that the specified interactive audio comprises:
when the interactive audio is a single-track audio, separating the target sub-audio from the interactive audio by using a preset separation algorithm;
or when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
3. The method of claim 1, wherein determining the target sub-audio on the target audio track that the specified interactive audio comprises:
sending a separation request to a server, wherein the separation request comprises the interactive audio and the target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on a target audio track based on the target audio track identifier, and sends the target sub-audio to the stream pushing client;
and receiving the target sub-audio sent by the server.
4. The method according to any of claims 1-3, wherein the determining a tempo point in the target sub-audio comprises:
extracting rhythm points in the target sub-audio by using a preset rhythm extraction algorithm;
or acquiring a rhythm file corresponding to the target sub-audio based on a preset corresponding relation between each sub-audio and the rhythm file, wherein the rhythm file comprises rhythm points in the sub-audio;
or sending an extraction request to a server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the stream pushing client; and receiving the rhythm point in the target sub-audio sent by the server.
5. The method according to any one of claims 1 to 3, wherein the number of the target audio tracks is plural, the receiving a touch operation of a main player during the playing of the target sub-audio, and obtaining an interaction result based on a time difference between a receiving time of the touch operation and a playing time of a rhythm point of the target sub-audio comprises:
determining a designated audio track in a plurality of target audio tracks and taking sub-audio on the designated audio track as designated sub-audio;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the specified sub-audio.
6. A method for live interaction between a viewer and a main broadcast is applied to a pull stream client, and comprises the following steps:
receiving interaction information sent by a plug flow client, wherein the interaction information is used for expressing the initiation of interaction;
displaying an audio track selection interface, and receiving a target audio track selected by a viewer on the audio track selection interface;
and sending track information to the stream pushing client, wherein the track information is used for representing a target track selected by the audience on the track selection interface, so that the stream pushing client determines a target sub-audio on the target track included in the specified interactive audio and determines a rhythm point in the target sub-audio, the volume of the rhythm point is greater than the preset volume, a touch operation of a main player is received in the process of playing the target sub-audio, and an interaction result is obtained based on a time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub-audio.
7. A live interaction device between a viewer and a main broadcast, applied to a push streaming client, the device comprising:
the receiving module is used for receiving an interaction initiating instruction sent by a main broadcast;
the sending module is used for responding to the interaction initiating instruction, sending interaction information to a specified pull stream client, wherein the interaction information is used for representing the initiation of interaction, so that the specified pull stream client displays an audio track selection interface after receiving the interaction information, receives a target audio track selected by the audience on the audio track selection interface, and sends audio track information to the push stream client, and the audio track information is used for representing the target audio track selected by the audience on the audio track selection interface;
the receiving module is further configured to receive audio track information sent by the specified pull stream client;
the system comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a designated interactive audio and a target sub audio on a target audio track included in the interactive audio, and determining a rhythm point in the target sub audio, and the volume of the rhythm point is greater than the preset volume;
the determining module is further configured to receive a touch operation of a main player in the process of playing the target sub-audio, and obtain an interaction result based on a time difference between a receiving time of the touch operation and a playing time of the rhythm point of the target sub-audio.
8. The apparatus of claim 7, wherein the determining module is specifically configured to:
when the interactive audio is a single-track audio, separating the target sub-audio from the interactive audio by using a preset separation algorithm;
or when the interactive audio is multi-track audio, extracting target sub-audio on a target track of the interactive audio.
9. The apparatus of claim 7, wherein the determining module is specifically configured to:
sending a separation request to a server, wherein the separation request comprises the interactive audio and the target audio track identifier, so that the server separates the interactive audio, obtains a target sub-audio on a target audio track based on the target audio track identifier, and sends the target sub-audio to the stream pushing client;
and receiving the target sub-audio sent by the server.
10. The apparatus according to any one of claims 7 to 9, wherein the determining module is specifically configured to:
extracting rhythm points in the target sub-audio by using a preset rhythm extraction algorithm;
or acquiring a rhythm file corresponding to the target sub-audio based on a preset corresponding relation between each sub-audio and the rhythm file, wherein the rhythm file comprises rhythm points in the sub-audio;
or sending an extraction request to a server, wherein the extraction request comprises the target sub-audio, so that the server extracts the rhythm point in the target sub-audio and sends the rhythm point in the target sub-audio to the stream pushing client; and receiving the rhythm point in the target sub-audio sent by the server.
11. The apparatus according to any of claims 7 to 9, wherein the number of target audio tracks is multiple, and the determining module is specifically configured to:
determining a designated audio track in a plurality of target audio tracks and taking sub-audio on the designated audio track as designated sub-audio;
and receiving touch operation of a main player in the process of playing the target sub-audio, and obtaining an interaction result based on the time difference between the receiving time of the touch operation of the main player and the playing time of the rhythm point of the specified sub-audio.
12. A live interaction device between a viewer and a main broadcast, applied to a pull stream client, the device comprising:
the receiving module is used for receiving interaction information sent by the plug flow client, and the interaction information is used for representing the initiation of interaction;
the display module is used for displaying the audio track selection interface and receiving a target audio track selected by the audience on the audio track selection interface;
the system comprises a sending module and a stream pushing client, wherein the sending module is used for sending audio track information to the stream pushing client, the audio track information is used for representing a target audio track selected by the audience on the audio track selection interface, so that the stream pushing client determines a target sub audio frequency on the target audio track included in the specified interactive audio frequency and determines a rhythm point in the target sub audio frequency, the volume of the rhythm point is larger than the preset volume, touch operation of a main player is received in the process of playing the target sub audio frequency, and an interactive result is obtained based on the time difference between the receiving time of the touch operation and the playing time of the rhythm point of the target sub audio frequency.
13. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 1-6 when executing a program stored in the memory.
14. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110887803.3A CN113613033B (en) | 2021-08-03 | 2021-08-03 | Live broadcast interaction method and device for audience and anchor, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110887803.3A CN113613033B (en) | 2021-08-03 | 2021-08-03 | Live broadcast interaction method and device for audience and anchor, electronic equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113613033A true CN113613033A (en) | 2021-11-05 |
| CN113613033B CN113613033B (en) | 2024-05-28 |
Family
ID=78306638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110887803.3A Active CN113613033B (en) | 2021-08-03 | 2021-08-03 | Live broadcast interaction method and device for audience and anchor, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113613033B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100035685A1 (en) * | 2008-08-05 | 2010-02-11 | Cha Seung-Hee | Method for providing audio game, apparatus and computer-readable recording medium with program therefor |
| US20100081116A1 (en) * | 2005-07-26 | 2010-04-01 | Barasch Michael A | Method and system for providing web based interactive lessons with improved session playback |
| KR20130065751A (en) * | 2011-11-28 | 2013-06-20 | 신성규 | Method for providing rhythm game interface and multimedia apparatus using the same |
| CN107277636A (en) * | 2017-06-15 | 2017-10-20 | 广州华多网络科技有限公司 | It is a kind of it is live during interactive approach, user terminal, main broadcaster end and system |
| CN108259925A (en) * | 2017-12-29 | 2018-07-06 | 广州市百果园信息技术有限公司 | Music gifts processing method, storage medium and terminal in net cast |
| CN109348274A (en) * | 2018-09-12 | 2019-02-15 | 咪咕音乐有限公司 | Live broadcast interaction method and device and storage medium |
| CN112165628A (en) * | 2020-09-29 | 2021-01-01 | 广州繁星互娱信息科技有限公司 | Live broadcast interaction method, device, equipment and storage medium |
| US20210027800A1 (en) * | 2019-10-15 | 2021-01-28 | Beijing Dajia Internet Information Technology Co., Ltd. | Method for processing audio, electronic device and storage medium |
| CN112714334A (en) * | 2020-12-30 | 2021-04-27 | 广州方硅信息技术有限公司 | Music gift presenting method and device, equipment and medium thereof |
-
2021
- 2021-08-03 CN CN202110887803.3A patent/CN113613033B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100081116A1 (en) * | 2005-07-26 | 2010-04-01 | Barasch Michael A | Method and system for providing web based interactive lessons with improved session playback |
| US20100035685A1 (en) * | 2008-08-05 | 2010-02-11 | Cha Seung-Hee | Method for providing audio game, apparatus and computer-readable recording medium with program therefor |
| KR20130065751A (en) * | 2011-11-28 | 2013-06-20 | 신성규 | Method for providing rhythm game interface and multimedia apparatus using the same |
| CN107277636A (en) * | 2017-06-15 | 2017-10-20 | 广州华多网络科技有限公司 | It is a kind of it is live during interactive approach, user terminal, main broadcaster end and system |
| CN108259925A (en) * | 2017-12-29 | 2018-07-06 | 广州市百果园信息技术有限公司 | Music gifts processing method, storage medium and terminal in net cast |
| CN109348274A (en) * | 2018-09-12 | 2019-02-15 | 咪咕音乐有限公司 | Live broadcast interaction method and device and storage medium |
| US20210027800A1 (en) * | 2019-10-15 | 2021-01-28 | Beijing Dajia Internet Information Technology Co., Ltd. | Method for processing audio, electronic device and storage medium |
| CN112165628A (en) * | 2020-09-29 | 2021-01-01 | 广州繁星互娱信息科技有限公司 | Live broadcast interaction method, device, equipment and storage medium |
| CN112714334A (en) * | 2020-12-30 | 2021-04-27 | 广州方硅信息技术有限公司 | Music gift presenting method and device, equipment and medium thereof |
Non-Patent Citations (2)
| Title |
|---|
| OLIVER SCHREER: "State‐of‐the‐Art and Challenges in Media Production, Broadcast and Delivery", 《MEDIA PRODUCTION, DELIVERY AND INTERACTION FOR PLATFORM INDEPENDENT SYSTEMS: FORMAT-AGNOSTIC MEDIA》 * |
| 马艳;李学伟;王晓艳;: "基于ACR的多屏同步互动应用技术浅析", 电视技术, no. 21 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113613033B (en) | 2024-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104333782B (en) | A kind of main broadcaster formulates the order method and system, relevant device of task | |
| CN110446115A (en) | Living broadcast interactive method, apparatus, electronic equipment and storage medium | |
| WO2020093883A1 (en) | Method and device for obtaining video clip, server, and storage medium | |
| CN112753227B (en) | Method, computer readable medium and system for extracting metadata from a depiction of an event | |
| US10506268B2 (en) | Identifying media content for simultaneous playback | |
| US8158873B2 (en) | Systems and methods for generating a game device music track from music | |
| US11511200B2 (en) | Game playing method and system based on a multimedia file | |
| US9116605B2 (en) | System and method for generating event distribution information | |
| CN112261435B (en) | Social interaction method, device, system, equipment and storage medium | |
| WO2019013874A1 (en) | Non-linear content presentation and experience | |
| US20240170009A1 (en) | Audio processing for detecting occurrences of loud sound characterized by brief audio bursts | |
| US9305601B1 (en) | System and method for generating a synchronized audiovisual mix | |
| US20240223859A1 (en) | Management of non-linear content presentation and experience | |
| CN107896334A (en) | Carry out live method and apparatus | |
| CN111888765A (en) | Multimedia file processing method, device, equipment and medium | |
| CN112598961A (en) | Piano performance learning method, electronic device and computer readable storage medium | |
| US11775070B2 (en) | Vibration control method and system for computer device | |
| CN113613056A (en) | Animation special effect display method and device, electronic equipment and medium | |
| CN113613033B (en) | Live broadcast interaction method and device for audience and anchor, electronic equipment and medium | |
| CN112188226B (en) | Live broadcast processing method, device, equipment and computer readable storage medium | |
| CN110532419B (en) | Audio processing method and device | |
| JP7435119B2 (en) | Video data processing device, video distribution system, video editing device, video data processing method, video distribution method, and program | |
| US20230271093A1 (en) | Vocal collision queue | |
| EP4307207A1 (en) | Cheering service provision method for providing voice cheer using online voting function, and system therefor | |
| WO2019051689A1 (en) | Sound control method and apparatus for intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |