CN112637627A - User interaction method, system, terminal, server and storage medium in live broadcast - Google Patents
User interaction method, system, terminal, server and storage medium in live broadcast Download PDFInfo
- Publication number
- CN112637627A CN112637627A CN202011507035.6A CN202011507035A CN112637627A CN 112637627 A CN112637627 A CN 112637627A CN 202011507035 A CN202011507035 A CN 202011507035A CN 112637627 A CN112637627 A CN 112637627A
- Authority
- CN
- China
- Prior art keywords
- terminal
- live broadcast
- terminals
- server
- broadcast room
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/18—Network architectures or network communication protocols for network security using different networks or channels, e.g. using out of band channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
- H04L67/1046—Joining mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The embodiment of the invention relates to the field of live broadcast, and discloses a user interaction method, a user interaction system, a user interaction terminal, a user interaction server and a storage medium in live broadcast. In the embodiment of the invention, the user interaction method in live broadcast comprises the following steps: sending the identifier of the terminal to a server for managing the current live broadcast room; acquiring identifiers of other terminals except the terminal in the live broadcast room, which are pushed by the server; establishing point-to-point direct connection channels with the other terminals respectively through the identifiers of the other terminals; and performing information interaction with the other terminals by using the direct connection channel. In the embodiment of the invention, the user direct connection channel in the live broadcast is established, so that the information interaction efficiency in the live broadcast is improved, and the information processing pressure of a server for managing a live broadcast room is reduced.
Description
Technical Field
The embodiment of the invention relates to the field of live broadcast, in particular to user interaction in live broadcast.
Background
In some cases, when a user interacts in a live broadcast room, the user needs to upload the interaction to a server side, and the interaction is broadcasted to each user terminal in the current live broadcast room after the server side performs corresponding processing. For example, when a microphone is connected, a user voice stream needs to be uploaded to a server managing a current live broadcast room, mixed flow is performed at a server end, and then broadcast and distributed to each user terminal in the current live broadcast room.
Since the voice stream of the user in the room needs to be pushed to the server first and then processed and forwarded by the server, the whole network transmission link is long, the delay is high, and packet loss occurs. Meanwhile, the server centralized processing is adopted, so that the server load for managing the live broadcast room is large.
Disclosure of Invention
The embodiment of the invention aims to provide a user interaction method, a system, a terminal, a server and a storage medium in live broadcasting, so that a user can construct a direct connection channel with short link and low delay in the live broadcasting process, and the server load of a live broadcasting management room is reduced.
In order to solve the technical problem, an embodiment of the present invention provides a user interaction method in live broadcasting, which is applied to a terminal and includes the following steps: sending the identifier of the terminal to a server for managing the current live broadcast room; acquiring identifications of other terminals except the terminal in a live broadcast room pushed by a server; respectively establishing point-to-point direct connection channels with other terminals through the identifiers of the other terminals; and performing information interaction with other terminals by using the direct connection channel.
The embodiment of the invention provides a user interaction method in live broadcast, which is applied to a server and comprises the following steps:
receiving an identifier sent by a terminal joining a live broadcast room; and sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
The embodiment of the invention also provides a user interaction system in live broadcast, which is applied to a server and a terminal, wherein: the terminal includes:
the push module is used for sending the identifier of the terminal to a server for managing the current live broadcast room;
the acquisition module is used for acquiring the identifications of the other terminals except the terminal in the live broadcast room pushed by the server;
the connection module is used for establishing point-to-point direct connection channels with the other terminals through the identifiers of the other terminals;
and the interaction module is used for performing information interaction with other terminals by utilizing the direct connection channel.
A server, comprising:
the receiving module is used for receiving the identifier sent by the terminal joining the live broadcast room;
and the sending module is used for sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
An embodiment of the present invention further provides a terminal, including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of live user interaction for application to a terminal.
An embodiment of the present invention further provides a server, including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the on-air user interaction method applied to a server.
The embodiment of the invention also provides a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the live user interaction method applied to the terminal or the live user interaction method applied to the server is realized.
In the embodiment of the invention, the information interaction among users is directly realized in the live broadcast by respectively establishing point-to-point direct connection channels by the terminals in the live broadcast room; compared with a mode of indirectly realizing information interaction among users by taking a server for managing a live broadcast room as an intermediate transceiving and processing node in some situations, the method and the system for realizing the information interaction among the users have the advantages that a network transmission path is shorter and delay is low due to the fact that the mode that all terminals are directly connected is adopted; meanwhile, the pressure of a server for managing the live broadcast room on information processing is reduced.
In addition, the sending of the identifier of the terminal to a server managing a current live broadcast room includes: sending an adding request to a server for managing the current live broadcast room, wherein the adding request carries the identifier of the terminal and receives the security audit of the server; through the sign of other terminals, establish point-to-point directly connecting the passageway with other terminals respectively, include: and taking the other terminals as trusted terminals, and establishing point-to-point direct connection channels with the other terminals by using the identifiers of the other terminals. The implementation mode of the invention finally needs to establish a point-to-point direct connection channel, the direct connection channel is not provided with transfer equipment to ensure information safety, and the safety of information transmission can be effectively improved by carrying out safety audit on the terminal.
In addition, the information interaction is carried out with other terminals by utilizing the direct connection channel, and the information interaction comprises the following steps: and if the audio signal is received in the information interaction process, the audio signal is played after being subjected to local sound mixing processing. The mixed sound is adjusted and output in a floating way along with the real-time change trend of the input sound, so that the problem that the sound change is not obvious in the traditional sound equalization is solved.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
FIG. 1 is a flow chart of a method of user interaction in live broadcast provided in accordance with a first embodiment of the present invention;
FIG. 2 is a schematic diagram of a live user interaction method applied to a game live broadcast according to a first embodiment of the present invention;
fig. 3 is a schematic diagram of a terminal establishing a direct connection channel with other terminals according to a first embodiment of the present invention;
fig. 4 is a schematic diagram of information interaction between a terminal and other terminals through a direct connection channel according to a first embodiment of the present invention;
fig. 5 is a schematic diagram of a mixing process after receiving an audio signal according to a first embodiment of the present invention;
FIG. 6 is a flow chart of a method of user interaction in live broadcast provided in accordance with a second embodiment of the present invention;
FIG. 7 is a flow chart of a method of user interaction in live broadcast provided in accordance with a third embodiment of the present invention;
FIG. 8 is a flow chart of a method of user interaction in live broadcast provided in accordance with a fourth embodiment of the present invention;
FIG. 9 is a schematic diagram of a live user interaction system provided in accordance with a fifth embodiment of the present invention;
fig. 10 is a schematic diagram of a terminal provided in accordance with a sixth embodiment of the present invention;
fig. 11 is a schematic diagram of a server provided according to a seventh embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments. The following embodiments are divided for convenience of description, and should not constitute any limitation to the specific implementation manner of the present invention, and the embodiments may be mutually incorporated and referred to without contradiction.
A first embodiment of the present invention relates to a user interaction method in live broadcast, which is applied to a terminal, and a specific flow is shown in fig. 1.
102, acquiring identifiers of other terminals except a terminal in a live broadcast room pushed by a server;
103, respectively establishing point-to-point direct connection channels with other terminals through the identifiers of the other terminals;
and step 104, performing information interaction with other terminals by using the direct connection channel.
In the embodiment, the instant information communication of the user in the live broadcasting process is realized by using the point-to-point communication architecture, and the pressure of the server for completing information processing and information transfer is reduced. The server of the current live broadcast room is used as an intermediate node to complete the identification transmission of the terminal in the current live broadcast room, a point-to-point direct connection channel between the terminals is established through the identification, and the information interaction between the terminals is carried out in the direct connection channel; therefore, the communication between users is faster, and the information processing pressure of the server side is reduced. An example of using this embodiment for a live game process is shown in fig. 2.
The following describes implementation details of the user interaction method in live broadcast in this embodiment in a specific manner, and the following description is only provided for facilitating understanding of the implementation details and is not necessary for implementing this embodiment.
In step 101, an identifier of the terminal is sent to a server managing a current live broadcast room, where the identifier of the terminal is used to establish a connection channel with other terminals in the current live broadcast room. It is understood that the characteristic information, which is identified as being specific to the terminal and can distinguish the terminal from other terminals in the current room, includes but is not limited to: the address of the terminal, the ID of the terminal and account information of live login of the terminal.
In step 102, after the identifier of the terminal is sent to the server managing the current live broadcast room, the identifiers of the other terminals in the current live broadcast room except the terminal need to be obtained through the server managing the current live broadcast room, and the identifiers of the other terminals are important basis for establishing connection between the terminal and the other terminals.
Optionally, when the terminal acquires the identifier of the other terminal, the other terminal acquires the identifier of the terminal through the server, and a faster processing rate can be achieved when the direct connection channel is established in the post-processing.
In step 103, a request for establishing a point-to-point channel is sent through the received identifiers of the other terminals and the obtained identifiers, so as to establish a point-to-point direct channel, where the process of establishing the direct channel is shown in fig. 3. This terminal all has established point-to-point direct channel with all the other terminals in the current live room, point-to-point direct channel is independent of the transmission channel of live broadcast data in the current live room, and point-to-point direct channel is used for carrying on the information interaction between the user promptly, and live broadcast transmission channel is used for broadcasting the live broadcast data in the current live room, and both do not influence each other.
In step 104, the information interaction between the terminal and the other terminals is realized by using the point-to-point direct connection channel, as shown in fig. 4. Because the direct connection channel is a point-to-point bidirectional channel, the receiving and sending of information between terminals can be completed immediately, and the information transmission efficiency between user terminals is improved; the data packet loss rate can be effectively reduced due to the short transmission path; meanwhile, information transmission in the direct connection channel does not need data forwarding processing of the server, and the information processing pressure of the server side is effectively reduced.
In order to facilitate understanding of the present embodiment, the execution process of the present embodiment is described by taking an audio signal as an example. If multiple audio signals are received in the information interaction process, the audio signals are mixed locally and then played, and the flow of local audio mixing is shown in fig. 5. The calculation formula of the sound mixing is as follows:
the gradient factor is used for expressing the sound variation trend. Specifically, the gradient factor may be obtained by the following formula:
For example, the audio sampling rate λ, the audio sampling period t, the number N of direct channels to be mixed, and the gradient factor εnAnd the sum of the data of the direct connection channels needing to be mixed is represented as A + B +, then
Gradient factor epsilonn：
The fade factor is a parameter that characterizes the trend of the output volume, as exemplified below.
When sampling for the 1 st time, the direct connection channel needing sound mixing is 1 channel, N is 1, t is 1s, and the sampled data is x1The unit bit. Since it is the first sample and there is no previous result as a reference, the parameters in the formula associated with the previous result are ignored(ii) a The sampling is the initial reference value of the subsequent calculation, the unitization is needed, and the calculation is different from the other gradient factors, so the gradient factor of the first sampling is obtained
I.e. the output sound remains unchanged.
When sampling 2, for example, the direct connection channel that needs mixing currently is 2 channels, that is, N is 2, the current sampling time t is 1s, and the sound data sampled by each direct connection channel is x1, x2, and unit bit, respectively. Combining the first sampling calculation data, obtaining the gradual change factor of the time according to a formula
It can be seen from the result that if the sampling data of the No. 2 direct channel and the No. 1 direct channel are equal, the current gradient factor is still 1, the output volume remains unchanged, and if the newly added No. 2 channel sound is much larger than the No. 1 channel sound, the current gradient factor is also larger, and the volume change is larger.
When sampling is performed at the nth time, for example, the direct-connection channel that the current device needs to mix is 10 channels, that is, N is 10, the sampling time t of this time is 1s, and the sampled sound data of each stream is x1, x2 … x10, and the unit bit. The gradient factor is obtained according to the formula:
it can be seen that the gradient factor is obtained by multiplying the gradient factor average value of the previous n-1 times by the proportional trend of the volume values of the current time and the previous time, so that the gradient factor is a parameter obtained based on the sound change trend, the sound after sound mixing can be adjusted and output in a floating manner along with the real-time change trend of the input sound, and the problem that the sound change of the traditional sound equalization mixing is not obvious is solved.
In the embodiment of the invention, the information interaction among users is directly realized in the live broadcast by respectively establishing point-to-point direct connection channels by the terminals in the live broadcast room; compared with a mode of indirectly realizing information interaction among users by taking a server for managing a live broadcast room as an intermediate transceiving and processing node in some situations, the method has the advantages of shorter path of network transmission and low delay; meanwhile, the pressure of a server for managing the live broadcast room on information processing is reduced.
A second embodiment of the present invention relates to a user interaction method in live broadcast, which is applied to a terminal, and a specific flow is shown in fig. 6.
and step 204, performing information interaction with other terminals by using the direct connection channel.
Step 202 and step 204 are substantially the same as those in the first embodiment, and are not repeated for avoiding redundancy, and the main difference is that step 201 and step 204 are described below.
For step 201, a join request is sent to a server managing the current live broadcast room, the join request carries an identifier of the terminal, and security audit of the server is accepted. The security of the current broadcast room information can be improved by receiving the security audit of the server, the security audit is regarded as a credible terminal after passing, and the security audit mode comprises the following steps: symmetric encryption, asymmetric encryption, signature encryption, and the like. The implementation mode of the invention finally needs to establish a point-to-point direct connection channel, the direct connection channel is not provided with transfer equipment to ensure information safety, and the safety of information transmission can be effectively improved by carrying out safety audit on the terminal.
For step 203, the other terminals are used as trusted terminals, and point-to-point direct connection channels are respectively established with the other terminals by using the identifiers of the other terminals. After the terminal passes the security audit of the server, the terminal is determined as a trusted terminal, and as the other terminals in the current live broadcast room are also subjected to the security audit, the other terminals can also be used as trusted terminals. The terminal and the other terminals are respectively established through the marks of the other terminals, namely a point-to-point direct connection channel between the trusted terminal and the trusted terminal, and because both ends of the direct connection channel are the trusted terminals, the encryption and decryption steps for interactive information are not needed in the information interaction process, the information interaction time delay is lower, and the user experience is improved.
And receiving security audit before establishing the transmission channel, reducing the number of times of security verification for information interaction in establishing the transmission channel, and further improving the instantaneity of user interaction in live broadcast on the basis of the first embodiment.
If the audio signal transmitted by the direct connection channel is received in the interactive process, the audio signal is processed locally by adopting a sound mixing algorithm and then played,
further, those skilled in the art will appreciate that the present embodiment does not conflict with the first embodiment, and can be freely combined to achieve the object of the invention.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A third embodiment of the present invention relates to a user interaction method in live broadcast, which is applied to a server, and as shown in fig. 7, includes:
and step 302, sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
The following implementation details are provided to facilitate understanding and are not necessary to practice the present solution.
In step 301, a server managing the current live broadcast room serves as an intermediate node, receives an identifier sent by a terminal joining the live broadcast room, and uses the identifier as a characteristic basis for establishing point-to-point direct connection with other terminals in the current live broadcast room.
In step 302, the server managing the current live broadcast room sends the identifiers of the other terminals except the terminal in the current live broadcast room to the terminals according to the current database. And the server sends the identifications of the other terminals to the terminal, and the identifications are used as the basis for the terminal to establish point-to-point direct connection channels with the other terminals. The server completes the task of user interaction in the live broadcast after forwarding the identifier of the double ends, and further information processing in the direct connection channel is not needed.
Optionally, the received identifier of the terminal is sent to the other terminals, which is equivalent to sending a prompt for establishing the direct connection channel to the other terminals, so that a faster processing rate can be achieved when the request for establishing the direct connection channel is processed in a later stage.
For example, the identifier of the terminal M joining the live broadcast room is M, the identifier of the terminal N in the current live broadcast room is N, and the server managing the current live broadcast room receives the identifier M sent by the terminal M joining the live broadcast room and sends the identifier N to the terminal M, so that the terminal M and the terminal N establish a point-to-point direct connection channel mn.
When the user interaction method in the live broadcast is realized, the server for managing the live broadcast room only needs to forward the identification of each terminal, so that the terminal can establish a point-to-point direct connection channel for information interaction. The server is not required to execute data processing in the information transmission process, so that the information processing pressure of the server is greatly reduced.
A fourth embodiment of the present invention relates to a user interaction method in live broadcast, which is applied to a server, and as shown in fig. 8, includes:
and 402, sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
Step 402 is substantially the same as the third embodiment, and is not repeated for avoiding redundancy, and the main difference is step 401, which is described in detail below.
And carrying out safety audit on the terminal added into the live broadcast room, wherein the safety audit mode comprises the following steps: the terminal is identified as a credible terminal after the safety audit is passed, the safety of information transmission in the current live broadcast room can be improved, and because the safety audit is carried out before the channel is established, the two ends of the point-to-point direct connection channel are high reliable terminals, a connection channel is established between the credible terminals to carry out information interaction, the number of times of safety verification required when the direct connection channel is interacted is effectively reduced, and the interaction efficiency between users in live broadcast is ensured.
A fifth embodiment of the present invention relates to a live user interaction system, which is applied to a terminal and a server, as shown in fig. 9,
the terminal includes:
a push module 501, configured to send an identifier of a terminal to a server that manages a current live broadcast room;
an obtaining module 502, configured to obtain identifiers of other terminals in a live broadcast room pushed by a server, except for the terminal;
the connection module 503 is configured to establish point-to-point direct connection channels with the other terminals through the identifiers of the other terminals, respectively;
and the interaction module 504 is configured to perform information interaction with other terminals by using the direct connection channel.
The server includes:
the receiving module 505: receiving an identifier sent by a terminal joining a live broadcast room;
the sending module 506: and sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
For the push module 501, the terminal sends an identifier for identifying the terminal to the server, including: the address of the terminal, the ID of the terminal and account information of live login of the terminal.
Optionally, when the terminal sends the identifier for identifying the terminal to the server, the terminal sends a join request to the server managing the current live broadcast room, the request carries the identifier of the terminal, and receives security audit of the server, and after the request passes the security audit, the terminal is recorded as a trusted terminal.
For the obtaining module 502, the terminal obtains the marks of the other terminals in the current live broadcast room pushed by the server, so that the terminals can complete the point-to-point direct connection channel, and the sending and receiving of the marks are necessary conditions for establishing the point-to-point direct connection channel between the terminals.
For the connection module 503, a request for establishing a point-to-point channel is sent through the identifier of each terminal, and the establishment of a point-to-point direct connection channel is completed, where the channel is independent of a transmission channel of live broadcast data in a live broadcast room.
Optionally, the other terminals are used as trusted terminals, and point-to-point direct connection channels are respectively established with the other terminals by using the identifiers of the other terminals. Because both sides of the direct connection channel are trusted terminals, on the premise of ensuring the information transmission safety, the information encryption operation in the information interaction process can be effectively reduced, and the user interaction efficiency is improved.
For the interaction module 504, the point-to-point direct connection channel is used to perform user interaction in live broadcasting, and if a voice signal is received through the direct connection channel, the voice signal is played after being locally mixed.
In the embodiment of the invention, the terminal directly realizes the information interaction among users in the live broadcast by respectively establishing point-to-point direct connection channels by the terminal in the live broadcast room; compared with a mode of indirectly realizing information interaction among users by taking a server for managing a live broadcast room as an intermediate transceiving and processing node in some situations, the method has the advantages of shorter path of network transmission and low delay; meanwhile, the pressure of a server for managing the live broadcast room on information processing is reduced.
For the receiving module 505, the server receives an identifier sent by a terminal joining a live broadcast room, where the identifier is unique to the terminal and is characteristic information that can distinguish the terminal from other terminals in a current room, and the identifier includes but is not limited to: the address of the terminal, the ID of the terminal and account information of live login of the terminal.
Optionally, a join request sent by a terminal joining the live broadcast room is received, the join request carries an identifier of the terminal joining the live broadcast room, and security audit is performed on the terminal. The security auditing mode comprises the following steps: the terminal is identified as a credible terminal after passing the safety audit, so that the safety of information transmission in the current live broadcast room can be improved, and the follow-up safety verification operation in the user interaction process through a direct connection channel is reduced.
For the sending module 506, the server managing the current live broadcast room sends the identifiers of the other terminals in the current live broadcast room except the terminal to the terminal according to the current database, and the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction to execute the information interaction.
When the user interaction method in the live broadcast is realized, the server for managing the live broadcast room only needs to forward the identification of each terminal, so that the terminal can establish a point-to-point direct connection channel for information interaction. The server is not required to execute data processing in the information transmission process, so that the information processing pressure of the server is greatly reduced.
It should be understood that this embodiment is a system example corresponding to the above embodiment, and that this embodiment can be implemented in cooperation with the above embodiment. The related technical details mentioned in the above embodiments are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the above-described embodiments.
It should be noted that each module referred to in this embodiment is a logical module, and in practical applications, one logical unit may be one physical unit, may be a part of one physical unit, and may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, elements that are not so closely related to solving the technical problems proposed by the present invention are not introduced in the present embodiment, but this does not indicate that other elements are not present in the present embodiment.
A sixth embodiment of the present invention is directed to a terminal, as shown in fig. 10, including at least one processor 601; and the number of the first and second groups,
a memory 602 communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory 602 stores instructions executable by the at least one processor to enable the at least one processor to perform the method of live user interaction for application to a terminal.
Where the memory and processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting together one or more of the various circuits of the processor and the memory. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory may be used to store data used by the processor in performing operations.
The seventh embodiment of the present invention relates to a server, as shown in fig. 11, including at least one processor 701; and the number of the first and second groups,
a memory 702 communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory 702 stores instructions executable by the at least one processor to enable the at least one processor to perform the on-air user interaction method applied to a server.
Where the memory and processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting together one or more of the various circuits of the processor and the memory. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory may be used to store data used by the processor in performing operations.
An eighth embodiment of the present invention relates to a computer-readable storage medium storing a computer program. The computer program realizes the above-described method embodiments when executed by a processor.
That is, as can be understood by those skilled in the art, all or part of the steps in the method for implementing the embodiments described above may be implemented by a program instructing related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.
Claims (10)
1. A user interaction method in live broadcast is characterized in that the method is applied to a terminal and comprises the following steps:
sending the identifier of the terminal to a server for managing the current live broadcast room;
acquiring identifiers of other terminals except the terminal in the live broadcast room, which are pushed by the server;
establishing point-to-point direct connection channels with the other terminals respectively through the identifiers of the other terminals;
and performing information interaction with the other terminals by using the direct connection channel.
2. The live user interaction method of claim 1, further comprising:
and if the audio signal is received in the information interaction process, performing sound mixing processing locally and then playing.
3. The live user interaction method of claim 2, wherein the locally mixing comprises: mixing the received audio signal according to the following formula:
wherein the gradual change factor is used for expressing the sound change trend.
4. A method of user interaction in a live broadcast according to any of claims 1 to 3, characterized by:
and the live broadcast data transmission channel of the live broadcast room is independent of the point-to-point direct connection channel.
5. A user interaction method in live broadcast is characterized in that the method is applied to a server and comprises the following steps:
receiving an identifier sent by a terminal joining a live broadcast room;
and sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals can respectively establish point-to-point direct connection channels for information interaction.
6. The live user interaction method of claim 5, wherein the obtaining of the identifier sent by the terminal joining the live room comprises: and receiving a joining request sent by the terminal joining the live broadcast room, wherein the joining request carries the identifier of the terminal joining the live broadcast room, and the terminal is subjected to security audit.
7. A user interactive system in live broadcast is applied to a terminal and a server, and is characterized in that:
the terminal includes:
the push module is used for sending the identifier of the terminal to a server for managing the current live broadcast room;
the acquisition module is used for acquiring the identifications of the other terminals except the terminal in the live broadcast room, which are pushed by the server;
the connection module is used for establishing point-to-point direct connection channels with the other terminals through the identifiers of the other terminals respectively;
and the interaction module is used for performing information interaction with the other terminals by using the direct connection channel.
The server includes:
the receiving module is used for receiving the identifier sent by the terminal joining the live broadcast room;
and the sending module is used for sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals can respectively establish point-to-point direct connection channels for information interaction.
8. A terminal, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method of live user interaction as claimed in any one of claims 1 to 4.
9. A server, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method of live user interaction as claimed in any one of claims 5 to 6.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the live user interaction method applied to a terminal of any one of claims 1 to 4 or the live user interaction method applied to a server of any one of claims 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507035.6A CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507035.6A CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112637627A true CN112637627A (en) | 2021-04-09 |
| CN112637627B CN112637627B (en) | 2023-09-05 |
Family
ID=75317501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011507035.6A Active CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112637627B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114286189A (en) * | 2021-12-16 | 2022-04-05 | 康佳集团股份有限公司 | Ultra-high definition multi-channel live broadcast display processing method and system, intelligent terminal and medium |
| CN117560358A (en) * | 2023-11-30 | 2024-02-13 | 北京流金岁月科技有限公司 | Method, device and system for universal live broadcast voice intercom |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1909509A (en) * | 2006-07-19 | 2007-02-07 | 华为技术有限公司 | System, method and user terminal for realizing video live broadcast in media distributing network |
| US20080049943A1 (en) * | 2006-05-04 | 2008-02-28 | Lg Electronics, Inc. | Enhancing Audio with Remix Capability |
| CN101763458A (en) * | 2008-12-24 | 2010-06-30 | 中国移动通信集团公司 | Method and device for realizing online game |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
| CN102543087A (en) * | 2011-12-28 | 2012-07-04 | 中兴长天信息技术（南昌）有限公司 | Audio mixing method applied to multi-point mobile audio communication system |
| CN102610235A (en) * | 2011-12-22 | 2012-07-25 | 深圳市万兴软件有限公司 | Sound mixing processing method, device and intelligent equipment |
| CN107027048A (en) * | 2017-05-17 | 2017-08-08 | 广州市千钧网络科技有限公司 | A kind of live even wheat and the method and device of information displaying |
| CN107734349A (en) * | 2017-09-01 | 2018-02-23 | 合肥迅大信息技术有限公司 | Based on P2P net cast team teaching systems |
| CN108965428A (en) * | 2018-07-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | The transmission method of live data, device, electronic equipment, system |
| CN109361856A (en) * | 2018-10-26 | 2019-02-19 | 广州虎牙信息科技有限公司 | A kind of panorama live broadcasting method, device, terminal device and storage medium |
| CN109474684A (en) * | 2018-11-14 | 2019-03-15 | 广州虎牙信息科技有限公司 | A kind of method, apparatus, terminal device and storage medium obtaining live video stream |
| CN111654713A (en) * | 2020-04-20 | 2020-09-11 | 视联动力信息技术股份有限公司 | Live broadcast interaction method and device |
| CN111696515A (en) * | 2020-06-15 | 2020-09-22 | 杭州艾力特数字科技有限公司 | Audio mixing method for teaching recording and broadcasting |
-
2020
- 2020-12-18 CN CN202011507035.6A patent/CN112637627B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080049943A1 (en) * | 2006-05-04 | 2008-02-28 | Lg Electronics, Inc. | Enhancing Audio with Remix Capability |
| CN101690270A (en) * | 2006-05-04 | 2010-03-31 | Lg电子株式会社 | Enhancing audio with remixing capability |
| CN1909509A (en) * | 2006-07-19 | 2007-02-07 | 华为技术有限公司 | System, method and user terminal for realizing video live broadcast in media distributing network |
| CN101763458A (en) * | 2008-12-24 | 2010-06-30 | 中国移动通信集团公司 | Method and device for realizing online game |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
| CN102610235A (en) * | 2011-12-22 | 2012-07-25 | 深圳市万兴软件有限公司 | Sound mixing processing method, device and intelligent equipment |
| CN102543087A (en) * | 2011-12-28 | 2012-07-04 | 中兴长天信息技术（南昌）有限公司 | Audio mixing method applied to multi-point mobile audio communication system |
| CN107027048A (en) * | 2017-05-17 | 2017-08-08 | 广州市千钧网络科技有限公司 | A kind of live even wheat and the method and device of information displaying |
| CN107734349A (en) * | 2017-09-01 | 2018-02-23 | 合肥迅大信息技术有限公司 | Based on P2P net cast team teaching systems |
| CN108965428A (en) * | 2018-07-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | The transmission method of live data, device, electronic equipment, system |
| CN109361856A (en) * | 2018-10-26 | 2019-02-19 | 广州虎牙信息科技有限公司 | A kind of panorama live broadcasting method, device, terminal device and storage medium |
| CN109474684A (en) * | 2018-11-14 | 2019-03-15 | 广州虎牙信息科技有限公司 | A kind of method, apparatus, terminal device and storage medium obtaining live video stream |
| CN111654713A (en) * | 2020-04-20 | 2020-09-11 | 视联动力信息技术股份有限公司 | Live broadcast interaction method and device |
| CN111696515A (en) * | 2020-06-15 | 2020-09-22 | 杭州艾力特数字科技有限公司 | Audio mixing method for teaching recording and broadcasting |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114286189A (en) * | 2021-12-16 | 2022-04-05 | 康佳集团股份有限公司 | Ultra-high definition multi-channel live broadcast display processing method and system, intelligent terminal and medium |
| CN114286189B (en) * | 2021-12-16 | 2023-12-05 | 康佳集团股份有限公司 | Ultrahigh-definition multi-path live broadcast display processing method, system, intelligent terminal and medium |
| CN117560358A (en) * | 2023-11-30 | 2024-02-13 | 北京流金岁月科技有限公司 | Method, device and system for universal live broadcast voice intercom |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112637627B (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112637627B (en) | User interaction method, system, terminal, server and storage medium in live broadcast | |
| CN108777606B (en) | Decoding method, apparatus and readable storage medium | |
| CN104093102A (en) | Wireless sound system for transmitting audio based on WIFI and application method of wireless sound system | |
| TW201007706A (en) | Method for encoding a symbol, method for decoding a symbol, method for transmitting a symbol from a transmitter to a receiver, encoder, decoder and system for transmitting a symbol from a transmitter to a receiver | |
| CN105072665A (en) | Networking control and access method and corresponding terminal and equipment | |
| CN103220258B (en) | Meeting sound mixing method, terminal and Media Resource Server | |
| CN108768587B (en) | Encoding method, apparatus and readable storage medium | |
| CN106170934A (en) | Wireless forward pass passive optical network PON system, optical network device and method | |
| CN105119900A (en) | Information secure transmission method, network access method and corresponding terminals | |
| Hachem et al. | A layered caching architecture for the interference channel | |
| CN202231730U (en) | Emergency broadcast system based on broadcast data system | |
| US20150031289A1 (en) | Autonomous discovery and control of devices via an overlay communication channel | |
| CN101964715A (en) | Digital conference discussion system and digital conference communication method | |
| CN105282711B (en) | The method and terminal of network configuration information are sent, received based on multicasting technology | |
| US20160066116A1 (en) | Using single bitstream to produce tailored audio device mixes | |
| CN104424949A (en) | Method for transmitting and receiving voice packet and electronic device implementing the same | |
| CN105120012A (en) | Intelligent device, networking access method thereof, information reception method and device | |
| CN110149631B (en) | Method and system suitable for cloud loudspeaker box connection establishment | |
| CN106412767B (en) | Sound mixing method and sound mixing circuit | |
| CN208739395U (en) | Audio board and digital sound console | |
| WO2022012628A1 (en) | Multi-channel audio signal encoding/decoding method and device | |
| CN208128259U (en) | A kind of multi-channel digital power amplification system based on Dante network connection | |
| JP2018064139A (en) | High-definition video transmitter, high-definition video receiver, and high-definition video transmission/reception system | |
| CN110753232A (en) | Audio processing method, system and storage medium for online interactive scene | |
| CN104753690B (en) | A kind of information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |