CN113411327B - Audio adjustment method, system, device, equipment and medium for voice live broadcast - Google Patents
Audio adjustment method, system, device, equipment and medium for voice live broadcast Download PDFInfo
- Publication number
- CN113411327B CN113411327B CN202110672726.XA CN202110672726A CN113411327B CN 113411327 B CN113411327 B CN 113411327B CN 202110672726 A CN202110672726 A CN 202110672726A CN 113411327 B CN113411327 B CN 113411327B
- Authority
- CN
- China
- Prior art keywords
- audio
- microphone
- voice
- client
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application relates to an audio adjusting method, system, device, equipment and storage medium for voice live broadcast. The live broadcast adjusting method comprises the following steps: responding to a voice live broadcast room creating instruction, and creating a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcast room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; and adjusting the audio parameters of the audio stream of each microphone client according to the network state parameters of the voice live broadcast room, so that the method has the advantage of improving the stability of the voice live broadcast.
Description
Technical Field
The present application relates to the field of live webcasting technologies, and in particular, to an audio adjusting method, system, apparatus, electronic device, and storage medium for live voice broadcast.
Background
With the progress of network communication technology, live webcasting becomes a new network interaction mode, and live webcasting is popular among more and more audiences due to the characteristics of instantaneity, interactivity and the like.
At present, in a live voice scene of network live broadcast, a situation of live voice broadcast of multiple persons may exist, and multiple audio streams need to be processed. The inventor finds that, in the process of research, the current live voice broadcast may have unstable and interrupted voice transmission due to limited network bandwidth or other factors, which results in low stability of the live voice broadcast.
Disclosure of Invention
Based on this, an object of the present application is to provide an audio adjusting method, system, apparatus, device and storage medium for live voice broadcast, which have the advantage of improving the stability of live voice broadcast.
According to a first aspect of an embodiment of the present application, a method for adjusting audio of live voice broadcast is provided, where the method for adjusting audio of live voice broadcast includes:
responding to a voice live broadcast room creating instruction, and creating a voice live broadcast room;
receiving an audio stream of a microphone client in the voice live broadcasting room;
respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room;
and adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room.
According to a second aspect of the embodiments of the present application, an audio adjustment interaction system for live voice is provided, which includes a microphone client, a server, and a subscription client:
the microphone client side sends an audio stream to the server;
the server responds to a voice live broadcast room establishing instruction and establishes a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcast room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room;
and after the subscription user side subscribes each audio stream pushed by the server, receiving and playing each subscribed audio stream.
According to a third aspect of the embodiments of the present application, there is provided an audio adjusting apparatus for live voice, the audio adjusting apparatus for live voice comprising:
the creating module is used for responding to a voice live broadcasting room creating instruction and creating a voice live broadcasting room;
the receiving module is used for receiving the audio stream of the microphone client side in the voice live broadcast room;
the push module is used for respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room;
and the adjusting module is used for adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcasting room.
According to a fourth aspect of embodiments of the present application, there is provided an electronic apparatus, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to execute any of the live audio adjusting methods.
According to a fifth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement any one of the audio adjusting methods for live voice broadcast.
In a scene of voice live broadcast, responding to a voice live broadcast room establishing instruction, and establishing a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcasting room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; and adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room. Can come to each according to different network state parameters the audio parameter of the audio stream who goes up the microphone user end adjusts, for example reduces tone quality etc. when the network is poor, can ensure the low delay among the voice live broadcast room, improves the voice live broadcast stability.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
For a better understanding and practice, the present application is described in detail below with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic view of an application scenario of an audio adjustment method for live voice broadcast according to an embodiment of the present application;
fig. 2 is a flowchart of an audio adjustment method for live voice broadcast according to an embodiment of the present application;
fig. 3 is an interaction diagram of an audio adjustment method for live voice broadcast according to an embodiment of the present application;
fig. 4 is a flowchart of an audio adjustment method for live voice broadcast according to another embodiment of the present application;
fig. 5 is a flowchart of an audio adjustment method for live voice broadcast according to another embodiment of the present application;
fig. 6 is a flowchart of an audio adjustment method for live voice broadcast according to another embodiment of the present application;
fig. 7 is a flowchart of an audio adjusting method for live voice broadcast according to another embodiment of the present application;
fig. 8 is a schematic structural diagram of an audio adjusting apparatus for live voice broadcast according to an embodiment of the present application;
fig. 9 is a block diagram illustrating a structure of an electronic device according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the application, as detailed in the claims that follow.
In the description of the present application, it is to be understood that the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not necessarily used to describe a particular order or sequence, nor are they to be construed as indicating or implying relative importance. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as the case may be. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The word "if as used herein may be interpreted as" at 8230; \8230when "or" when 8230; \8230when "or" in response to a determination ". Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Referring to fig. 1, fig. 1 is a schematic view of an application scenario of an audio adjusting method for live voice broadcast according to an embodiment of the present application.
The application scene comprises a microphone client, a server and a subscription client. The microphone user side and the subscription user side interact through the server.
The customer end of going to the home is an end that sends live video or voice of the network, and is usually a customer end that is used by a main broadcast in live network, or may be a customer end that is used by some special audiences that can send live voice of the network.
The subscription user side refers to one side for receiving and watching live network video or voice, and is usually a user side adopted by audiences watching video or listening to voice in live network.
The hardware pointed by the microphone user end and the subscription user end essentially refers to a computer device, and specifically, it may be a computer device of a type such as a smart phone, a smart interactive tablet, a personal computer, and the like. The customer end and the subscription end can both access the internet through a known network access mode to establish a data communication link with the server.
The server can be used as a service server, and can be responsible for further connecting with a related audio data server, a video streaming server, and other servers providing related support, etc., so as to form a logically associated server cluster for providing services for related terminal devices, such as the microphone client and the subscription client.
The microphone client sends an audio stream to the server; the server responds to a voice live broadcast room establishing instruction and establishes a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcasting room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcasting room; and after the subscription user side subscribes each audio stream pushed by the server, receiving and playing each subscribed audio stream.
The first embodiment is as follows:
the embodiment of the application discloses an audio adjusting method for voice live broadcast, which is applied to the server.
The following describes in detail an audio adjusting method for live voice broadcast according to an embodiment of the present application with reference to fig. 2.
Referring to fig. 2, an embodiment of the present application provides an audio adjusting method for live voice broadcast, including the following steps:
s101: and responding to the voice live broadcasting room creating instruction, and creating the voice live broadcasting room.
In the embodiment of the present invention, the voice live broadcasting room creation instruction may be sent by a host (i.e., an administrator), and a user side used by the host is a host user side, which may perform management operations on the voice live broadcasting room, such as creating a voice live broadcasting room, deleting the voice live broadcasting room, and the like. And the server responds to the voice live broadcast room establishing instruction to establish the voice live broadcast room. Users (including the anchor and audiences) can join the voice live broadcasting room to carry out multi-person voice live broadcasting and listen to voice live broadcasting.
S102: and receiving the audio stream of the microphone user side in the voice live broadcast room.
The microphone client can collect voice data of a user, convert the voice data into audio streams and upload the audio streams to the server.
When a plurality of the microphone clients exist, various requests of the microphone clients can be queued according to a preset priority sequence, and the requests of the microphone clients with high priorities, such as the microphone clients corresponding to the host and the anchor, are preferentially processed. When receiving data of a plurality of uploading clients, the data of different uploading clients can be stored separately, can be stored in different storage areas, or can be stored separately by using a plurality of data structures, or can be processed separately.
In the embodiment of the invention, in a live voice scene, voice connection with microphone is a process with stronger interactivity, low delay is required at this time, the quality of tone quality is sacrificed in the process of requiring low delay, and the audio stream of the microphone user end can be acquired according to audio parameters with low tone quality and low delay.
S103: and respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room.
In the embodiment of the invention, the audio streams are pushed in a multi-stream subscription mode, that is, the pushing is issued without adopting a server confluence mode, when the server receives the audio streams of each microphone client, different audio streams can be respectively cached, so that the server can independently perform specific monitoring and control on one audio stream, more detailed adjustment can be performed on the microphone client, and a user can subscribe different audio streams in the subscriber client, so that the corresponding pushing of the audio streams is obtained from the server. After a user enters a certain voice live broadcasting room, the user can be automatically helped to subscribe the audio stream of the current main broadcasting on the TV in the voice live broadcasting room, the identity of the current main broadcasting on the TV matched with the unique identity can be inquired according to the unique identity of the voice live broadcasting room, namely, the identity of all current main broadcasting on the TV in the voice live broadcasting room is obtained, and the user can be automatically helped to subscribe the audio stream of all current main broadcasting on the TV in the voice live broadcasting room according to the identity, so that the audio stream of all current main broadcasting on the TV in the voice live broadcasting room can be sent to all users in the voice live broadcasting room.
Optionally, the server sends the subscription list, after the user side confirms the subscription, the server broadcasts all the audio streams, and the server receives the subscribed audio streams from all the audio streams according to the subscription result.
Optionally, the audio adjusting method for live voice broadcast further includes:
when a voice live broadcast exit request sent by a microphone user side is received, generating prompt information for prompting to cancel subscription of an audio stream of the microphone user side;
and sending the prompt information to a subscription user side subscribing the speaking user.
In this alternative embodiment, the user may unsubscribe from the push of one of the audio streams.
S104: and adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcasting room.
The audio parameters include, but are not limited to, sound quality, volume, priority, push or not, sampling frequency, sampling precision, number of channels, bit rate, and the like.
The network status parameters may include, but are not limited to, network signal parameters, available bandwidth, and the like.
The adjustment of the audio parameters of the audio stream at each of the microphone clients may include, but is not limited to, cutting off the push of the audio stream, controlling the priority, tone quality and volume of the speech of the user, and the like.
Specifically, the step of adjusting the audio parameters of the audio stream of each microphone client according to the network state parameters of the voice live broadcasting room includes:
and acquiring the network signal condition value of each microphone user terminal.
The network information status value is a numerical value reflecting the quality of a network signal and can be obtained through interfaces corresponding to different systems.
And if the network signal condition value is lower than a preset network signal condition threshold value, acquiring first audio setting parameter data.
And sending the first audio setting parameter data to the microphone client, so that the microphone client collects or receives audio streams according to the first audio setting parameter data.
In this optional implementation, the network signal condition value may be compared with the preset network signal condition threshold to determine whether the current network signal is good or bad, so as to adjust the audio setting parameter of the microphone client, so that the microphone client can collect the sound data with higher tone quality when the network signal is good, and collect the sound data with lower tone quality when the network signal is poor, thereby ensuring low delay in the voice live broadcast process.
Specifically, the step of adjusting the audio parameters of the audio stream of each microphone client according to the network state parameters of the voice live broadcast room includes:
receiving an audio adjusting request sent by a host user side, wherein the audio adjusting request comprises an adjusted user mark of a microphone user side and second audio setting parameter data;
and sending second audio setting parameter data to the corresponding microphone client according to the user mark, so that the microphone client sets the parameters for acquiring or receiving the audio stream according to the second audio setting parameter data.
In the embodiment of the present invention, the moderator (i.e. administrator) can directly control the audio setting parameters of the user who goes to the microphone (including the anchor and the audience who can speak) in the live voice room, such as turning down the volume, reducing the sound quality, and the like.
As shown in fig. 3, fig. 3 is an interaction diagram of an audio adjusting method for live voice broadcast disclosed in the present application, where the microphone client sends an audio stream to the server; the server responds to a voice live broadcast room establishing instruction and establishes a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcast room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room; and after the subscription user side subscribes each audio stream pushed by the server, receiving and playing each subscribed audio stream.
In a scene of voice live broadcast, responding to a voice live broadcast room establishing instruction, and establishing a voice live broadcast room; receiving an audio stream of a microphone client in the voice live broadcast room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; and adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room. Can come to each according to different network state parameters the audio parameter of the audio stream who goes up the microphone user end adjusts, for example reduces tone quality etc. when the network is poor, can ensure the low delay among the voice live broadcast room, improves the voice live broadcast stability.
Example two:
in this embodiment, the difference from the first embodiment is mainly that the audio streams at each of the microphone clients of the live speech room are further controlled and adjusted according to a preset control logic.
Optionally, as shown in fig. 4, the audio adjusting method for live voice broadcast further includes:
s201: when a singing instruction sent by a microphone user side is received, verifying a user identity carried by the singing instruction;
s202: if the user identity corresponding to the user identification is the anchor, sending third audio setting parameter data to a microphone user end corresponding to the user identification;
s203: and sending the instruction for forbidding speaking to other speaking user sides except the speaking user side corresponding to the user identity identification.
In this optional implementation, the anchor in the live voice broadcasting room can sing, in order to ensure high tone quality of the anchor singing, the third audio setting parameter data can be sent to the customer end that is corresponding to the user identification, it is ensured that high-quality audio data is collected, and meanwhile, the instruction for prohibiting speaking is sent to other customer ends that are except the customer end that is corresponding to the user identification, the speaking of other users or the anchor in the channel is prohibited first, and the permission for the anchor to speak with the host is reserved.
Optionally, as shown in fig. 5, the audio adjusting method for live voice broadcast further includes:
s301: when a plurality of microphone clients are in a microphone opening state, determining non-speaking clients from the plurality of microphone clients and determining the audio streams corresponding to the non-speaking clients as environmental sound audio streams according to the audio streams corresponding to the microphone clients, wherein the volumes of the non-speaking clients in a preset time range are all smaller than a preset volume threshold;
s302: and suspending the pushing of the environmental audio stream to the corresponding subscription user side.
In this optional embodiment, when a certain anchor speaks or speaks, other anchors may continue to start the call sometimes, and at this time, some environmental sounds of other anchors are collected, so as to ensure the clarity of the sound of the current anchor and save bandwidth, the audio transmission of the anchor may be temporarily cut off when a certain anchor is monitored for a period of time without speaking, for example, when the collected volume of the certain anchor is less than a threshold, so that other user terminals do not receive the audio data of the anchor, thereby saving bandwidth, and also ensuring the clarity of the sound of the anchor that is actually speaking at present.
Optionally, as shown in fig. 6, after the audio streams of the microphone clients are respectively pushed to the subscription client in the live voice broadcasting room, the live voice broadcasting audio adjusting method further includes:
s401: the subscription user side receives each subscribed audio stream and records the data of each audio stream to generate an audio data queue;
s402: detecting the audio data queue at fixed time according to a preset time interval;
s403: and if the data of the target audio stream exists in the audio data queue at the current detection moment, refreshing the sound wave display interface content of the audio live broadcast room corresponding to the position of the target audio stream according to the data of the target audio stream.
In this optional implementation, when the subscription user side receives an audio stream, the display interface of the live voice room needs to be displayed correspondingly, for example, on a sound wave, but since a plurality of voice streams are subscribed and the change frequency of the audio is higher, the refresh frequency of the interface is very high, which affects the performance of the subscription user side, in order to improve the performance of the subscription user side without being affected, data of each audio stream may be recorded through a queue, and the queue data is detected at regular time (for example, 500 milliseconds), and when the data of the audio stream is found in the queue data, the sound wave display interface content at the corresponding position of the display interface may be refreshed through the component.
Referring to fig. 7, the audio parameters include a microphone-up sequence, and step S104 includes steps S404, S405, and S406.
Wherein, the going-to-microphone sequence may be a sequence in which a plurality of users speak.
S501: responding to the boarding requests sent by a plurality of user terminals, and acquiring corresponding identity identifiers of a plurality of users;
s502: determining the boarding priority corresponding to the identity;
wherein, different users may have different identities, such as: moderator, anchor, paid (privileged) audience, general audience, and the like; different identities correspond to different boarding priorities.
S503: and determining the loading sequence of the plurality of user sides according to the loading priority.
The method can lead the boarding sequence of the users with high boarding priority to be forward, and ensure that the boarding requests of the users with high boarding priority are processed preferentially; when a plurality of users are on line at the same time, queuing processing is carried out according to the priority of on line from high to low.
Optionally, after determining the loading sequence of the multiple user terminals according to the loading priority, the audio adjusting method for live voice broadcast further includes:
when a request for adjusting the sequence of going to the home is received, the sequence of going to the home carried by the request for adjusting the sequence of going to the home is determined as the sequence of going to the home adjusted by the plurality of clients.
In this alternative embodiment, the moderator can adjust the order of putting on the wheat.
Example three:
the embodiment further provides an audio adjusting system for live voice broadcast, as shown in fig. 1, including a microphone client, a server, and a subscription client, please refer to the first embodiment of the present application for details not disclosed in the present embodiment.
The microphone client sends an audio stream to the server;
the server responds to a voice live broadcasting room establishing instruction to establish a voice live broadcasting room; receiving an audio stream of a microphone client in the voice live broadcasting room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcasting room;
and after the subscription user side subscribes each audio stream pushed by the server, receiving and playing each subscribed audio stream.
Optionally, the server obtains a network signal condition value of each customer end; if the network signal condition value is lower than a preset network signal condition threshold value, first audio setting parameter data are obtained; sending the first audio setting parameter data to the microphone client;
and the microphone client receives the first audio setting parameter data and collects or receives audio streams according to the first audio setting parameter data.
Optionally, the audio adjusting system for voice live broadcasting further includes a host user side, where the host user side sends an audio adjusting request to the server;
the server receives an audio adjustment request sent by a host user side, wherein the audio adjustment request comprises an adjusted user mark of a microphone user side and second audio setting parameter data; according to the user mark, second audio setting parameter data is sent to the corresponding microphone user side;
the microphone client receives second audio setting parameter data sent by the server; and setting the parameters of the collected or received audio stream according to the second audio setting parameter data.
Optionally, a plurality of clients send a request to the server for going to the home;
the server responds to the boarding requests sent by the user terminals and acquires the corresponding identity identifications of the users; determining the boarding priority corresponding to the identity; and determining the uploading sequence of the plurality of user sides according to the uploading priority.
Optionally, after the server determines the loading sequence of the plurality of user terminals according to the loading priority, the host user terminal sends a loading sequence adjustment request to the server;
when the server receives a microphone loading sequence adjustment request sent by a host user side, the microphone loading sequence carried by the microphone loading sequence adjustment request is determined as the microphone loading sequence adjusted by the plurality of user sides.
Optionally, after the server adjusts the audio parameters of the audio streams of the microphone user terminals according to the network state parameters of the voice live broadcast room, when a song-singing instruction sent by the microphone user terminal is received, the server verifies the user identity identifier carried by the song-singing instruction; if the user identity corresponding to the user identification is the anchor, sending third audio setting parameter data to a microphone user end corresponding to the user identification; and sending the instruction for forbidding speaking to other speaking user sides except the speaking user side corresponding to the user identity identification.
The microphone client receives the third audio setting parameter data; and receiving the speaking forbidding instruction.
Optionally, when a plurality of microphone clients are in a microphone opening state, determining a non-speaking client from the plurality of microphone clients and determining an audio stream corresponding to the non-speaking client as an environmental sound audio stream according to the audio stream corresponding to each microphone client, where the volume of the non-speaking client in a preset time range is less than a preset volume threshold; and suspending the pushing of the environmental audio stream to the corresponding subscription user side.
Optionally, after the server respectively pushes the audio streams of the microphone clients to the subscription client in the voice live broadcast room, the subscription client receives the subscribed audio streams, records the data of the audio streams, and generates an audio data queue; detecting the audio data queue at fixed time according to a preset time interval; and if the data of the target audio stream exists in the audio data queue at the current detection moment, refreshing the sound wave display interface content of the audio live broadcast room corresponding to the position of the target audio stream according to the data of the target audio stream.
Optionally, the customer end sends a voice live broadcast quitting request to the server;
when receiving a voice live broadcast quitting request sent by a microphone user end, the server generates prompt information for prompting to cancel subscription of an audio stream of the microphone user end; sending the prompt information to a subscription user end which subscribes the speaking user;
and the subscriber side receives the prompt message.
Example four:
the embodiment provides an audio adjusting device for live voice broadcast, which can be used for executing the audio adjusting method for live voice broadcast in the first embodiment of the application. For details not disclosed in the present embodiment, please refer to embodiment one of the present application.
Please refer to fig. 8, fig. 8 is a schematic structural diagram of an audio adjusting apparatus for live voice broadcast according to an embodiment of the present application. The audio adjusting device for live voice can operate in a server. The server device includes:
the creating module 601 is configured to create a live voice broadcasting room in response to a live voice broadcasting room creating instruction.
A receiving module 602, configured to receive an audio stream of a microphone client in the voice live broadcast room.
The pushing module 603 is configured to push the audio streams of the microphone clients to the subscription clients in the voice live broadcast room, respectively.
An adjusting module 604, configured to adjust an audio parameter of an audio stream at each microphone client according to a network state parameter of the voice live broadcasting room.
As an optional implementation manner, the manner of adjusting, by the adjusting module 604, the audio parameter of the audio stream of each microphone client according to the network state parameter of the voice live broadcast room specifically includes:
acquiring a network signal condition value of each microphone client;
if the network signal condition value is lower than a preset network signal condition threshold value, first audio setting parameter data are obtained;
and sending the first audio setting parameter data to the microphone client, so that the microphone client collects or receives audio streams according to the first audio setting parameter data.
As an optional implementation manner, the manner of adjusting, by the adjusting module 604, the audio parameter of the audio stream of each microphone client according to the network state parameter of the voice live broadcast room specifically includes:
receiving an audio adjusting request sent by a host user side, wherein the audio adjusting request comprises an adjusted user mark of a microphone user side and second audio setting parameter data;
and sending second audio setting parameter data to the corresponding microphone client according to the user mark, so that the microphone client sets the parameters for acquiring or receiving the audio stream according to the second audio setting parameter data.
As an optional implementation manner, the audio parameters include a microphone playing sequence, and the manner of adjusting, by the adjusting module 604, the audio parameters of the audio stream at each microphone playing client according to the network state parameter of the voice live broadcasting room specifically is:
responding to the boarding requests sent by a plurality of user terminals, and acquiring corresponding identity identifiers of a plurality of users;
determining the boarding priority corresponding to the identity;
and determining the loading sequence of the plurality of user sides according to the loading priority.
As an optional implementation manner, after the adjusting module 604 determines the loading order of the multiple user terminals according to the loading priority, the audio adjusting apparatus for live voice broadcast further includes:
a first determining module, configured to determine, when a request for adjusting a going-to-home sequence sent by a host user end is received, a going-to-home sequence carried by the request for adjusting the going-to-home sequence as a going-to-home sequence adjusted by the multiple user ends.
As an optional implementation manner, after the adjusting module 604 adjusts the audio parameter of the audio stream of each microphone client according to the network state parameter of the live voice broadcast room, the live voice broadcast audio adjusting apparatus further includes:
the verification module is used for verifying the user identity carried by the singing instruction when the singing instruction sent by the microphone user side is received;
the first sending module is used for sending third audio setting parameter data to a microphone user side corresponding to the user identity identification if the user identity corresponding to the user identity is a main broadcast;
the sending module is further configured to send the instruction for prohibiting speaking to other speaking clients except the speaking client corresponding to the user identifier.
As an optional implementation manner, the audio adjusting apparatus for live voice broadcast further includes:
the second determining module is used for determining a non-speaking client from the plurality of speaking clients and determining the audio stream corresponding to the non-speaking client as an environmental audio stream according to the audio stream corresponding to each speaking client when the plurality of speaking clients are in the open-speaking state, wherein the volume of the non-speaking client in a preset time range is smaller than a preset volume threshold;
and the suspension module is used for suspending the pushing of the environmental sound audio stream to the corresponding subscription user side.
As an optional implementation manner, after the pushing module 603 pushes the audio stream of each microphone client to a subscription client in the live voice broadcasting room, the live voice broadcasting audio adjusting apparatus further includes:
the recording generation module is used for receiving each subscribed audio stream by the subscription user side and recording data of each audio stream to generate an audio data queue;
the detection module is used for detecting the audio data queue at regular time according to a preset time interval;
and the refreshing module is used for refreshing sound wave display interface content of the audio live broadcast room corresponding to the target audio stream position according to the data of the target audio stream if the data of the target audio stream exists in the audio data queue at the current detection moment.
As an optional implementation manner, the audio adjusting method for live voice further includes:
the generating module is used for generating prompt information for prompting to cancel subscription of an audio stream of the microphone user side when a voice live broadcast quitting request sent by the microphone user side is received;
and the second sending module is used for sending the prompt message to a subscription user side which subscribes the speaking user.
Example five:
the embodiment provides an electronic device, which can be used for executing all or part of the steps of the audio adjustment method for live voice broadcast in the first embodiment of the present application. For details not disclosed in the present embodiment, please refer to embodiment one of the present application.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 900 may be, but is not limited to, a combination of one or more of various servers, personal computers, laptops, smartphones, tablets, and the like.
In the preferred embodiment of the present application, the electronic device 900 comprises a memory 901, at least one processor 902, at least one communication bus 903, and a transceiver 904.
Those skilled in the art will appreciate that the configuration of the electronic device shown in fig. 9 is not limited to the embodiments of the present application, and may be a bus-type configuration or a star-type configuration, and that the electronic device 900 may include more or less hardware or software than those shown, or a different arrangement of components.
In some embodiments, the electronic device 900 is a device capable of automatically performing numerical calculations and/or information processing according to instructions set or stored in advance, and the hardware includes but is not limited to a microprocessor, an application specific integrated circuit, a programmable gate array, a digital processor, an embedded device, and the like. The electronic device 900 may also include a client device, which includes, but is not limited to, any electronic product capable of interacting with a client through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, a digital camera, and the like.
It should be noted that the electronic device 900 is only an example, and other existing or future electronic products, such as those that may be adapted to the present application, are also included in the scope of the present application and are incorporated by reference herein.
In some embodiments, the memory 901 stores a computer program, and the computer program, when executed by the at least one processor 902, implements all or part of the steps in the audio adjustment method for live voice broadcast according to the first embodiment. The Memory 901 includes a Read-Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an electronically Erasable Programmable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory (EEPROM)), an optical Read-Only Memory (CD-ROM) or other optical disk Memory, a magnetic disk Memory, a tape Memory, or any other medium readable by a computer that can be used to carry or store data.
In some embodiments, the at least one processor 902 is a Control Unit (Control Unit) of the electronic device 900, connects various components of the whole electronic device 900 by using various interfaces and lines, executes or executes programs or modules stored in the memory 901, and calls data stored in the memory 901 to perform various functions of the electronic device 900 and process data. For example, when the at least one processor 902 executes the computer program stored in the memory, all or part of the steps of the audio adjustment method for live voice broadcast described in the embodiment of the present application are implemented; or all or part of the functions of the audio adjusting device for live voice. The at least one processor 902 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips.
In some embodiments, the at least one communication bus 903 is arranged to enable connective communication between the memory 901 and the at least one processor 902, etc.
The electronic device 900 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Example six:
the present embodiment provides a computer-readable storage medium, where a computer program is stored, where the instructions are suitable for being loaded by a processor and executing the audio adjusting method for live voice broadcast in the first embodiment of the present application, and a specific execution process may refer to specific descriptions in the first embodiment, which are not described herein again.
For the apparatus embodiment, since it substantially corresponds to the method embodiment, reference may be made to the partial description of the method embodiment for relevant points. The above-described device embodiments are merely illustrative, wherein the components described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art to which the present application pertains. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (12)
1. The utility model provides a live audio frequency adjustment system of pronunciation, includes last wheat user, server and subscription user, its characterized in that:
the microphone client sends an audio stream to the server;
the server responds to a voice live broadcasting room establishing instruction to establish a voice live broadcasting room; receiving an audio stream of a microphone client in the voice live broadcast room; respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room; adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room; when a plurality of microphone clients are in a microphone opening state, determining a non-speaking client from the microphone clients according to the audio stream corresponding to each microphone client, determining the audio stream corresponding to the non-speaking client as an environmental audio stream, and suspending pushing the environmental audio stream to a corresponding subscription client; the volume of the un-speaking user side in a preset time range is smaller than a preset volume threshold;
and after the subscription user side subscribes each audio stream pushed by the server, receiving and playing each subscribed audio stream.
2. An audio adjusting method for live voice broadcast is characterized in that the audio adjusting method for live voice broadcast comprises the following steps:
responding to a voice live broadcast room creating instruction, and creating a voice live broadcast room;
receiving an audio stream of a microphone client in the voice live broadcast room;
respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room;
adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcasting room;
when a plurality of microphone clients are in a microphone opening state, determining a non-speaking client from the microphone clients and determining the audio stream corresponding to the non-speaking client as an environmental sound audio stream according to the audio stream corresponding to each microphone client, wherein the volume of the non-speaking client in a preset time range is smaller than a preset volume threshold;
and suspending pushing the environmental audio stream to the corresponding subscription user side.
3. The audio adjusting method of claim 2, wherein the step of adjusting the audio parameters of the audio stream at each of the microphone clients according to the network status parameters of the live voice broadcasting room comprises:
acquiring a network signal condition value of each microphone client;
if the network signal condition value is lower than a preset network signal condition threshold value, first audio setting parameter data are obtained;
and sending the first audio setting parameter data to the microphone client, so that the microphone client collects or receives audio streams according to the first audio setting parameter data.
4. The audio adjusting method of claim 2, wherein the step of adjusting the audio parameters of the audio stream at each of the microphone clients according to the network status parameters of the live voice broadcasting room comprises:
receiving an audio adjusting request sent by a host user side, wherein the audio adjusting request comprises an adjusted user mark of a microphone user side and fourth audio setting parameter data;
and sending second audio setting parameter data to the corresponding microphone client according to the user mark, so that the microphone client sets the parameters for acquiring or receiving the audio stream according to the second audio setting parameter data.
5. The method as claimed in claim 2, wherein the audio parameters include a microphone sequence, and the step of adjusting the audio parameters of the audio stream at each microphone client according to the network status parameters of the live voice broadcast room includes:
responding to the boarding requests sent by a plurality of user terminals, and acquiring corresponding identity identifications of a plurality of users;
determining the boarding priority corresponding to the identity;
and determining the loading sequence of the plurality of user sides according to the loading priority.
6. The method as claimed in claim 5, wherein after determining the microphone loading order of the plurality of user terminals according to the microphone loading priority, the method further comprises:
when a request for adjusting the sequence of going to the home is received, the sequence of going to the home carried by the request for adjusting the sequence of going to the home is determined as the sequence of going to the home adjusted by the plurality of clients.
7. The method of claim 2, wherein after the audio parameters of the audio streams at the microphone clients are adjusted according to the network status parameters of the live voice broadcast room, the method further comprises:
when a singing instruction sent by a microphone user side is received, verifying a user identity carried by the singing instruction;
if the user identity corresponding to the user identification is the anchor, sending third audio setting parameter data to a microphone user end corresponding to the user identification;
and sending the speaking forbidding instruction to other speaking user sides except the speaking user side corresponding to the user identity identification.
8. The method according to any one of claims 2 to 7, wherein after the audio streams of the microphone clients are respectively pushed to the subscription client in the live voice broadcasting room, the method further includes:
the subscription user side receives each subscribed audio stream, records data of each audio stream and generates an audio data queue;
detecting the audio data queue at fixed time according to a preset time interval;
and if the data of the target audio stream exists in the audio data queue at the current detection moment, refreshing the sound wave display interface content of the audio live broadcast room corresponding to the position of the target audio stream according to the data of the target audio stream.
9. The audio adjustment method for live voice broadcast according to any one of claims 2 to 7, further comprising:
when a voice live broadcast quitting request sent by a microphone user side is received, generating prompt information for prompting to cancel subscription of an audio stream of the microphone user side;
and sending the prompt message to a subscribing user terminal subscribing the audio stream of the microphone user terminal.
10. The utility model provides a live audio frequency adjusting device of pronunciation which characterized in that:
the creating module is used for responding to a voice live broadcasting room creating instruction and creating a voice live broadcasting room;
the receiving module is used for receiving the audio stream of the microphone client side in the voice live broadcast room;
the push module is used for respectively pushing the audio stream of each microphone client to a subscription client in the voice live broadcast room;
the adjusting module is used for adjusting the audio parameters of the audio streams of the microphone clients according to the network state parameters of the voice live broadcast room;
the second determining module is used for determining non-speaking clients from the plurality of microphone clients and determining the audio streams corresponding to the non-speaking clients as environmental audio streams according to the audio streams corresponding to the microphone clients when the microphone clients are in the microphone-on state, wherein the volumes of the non-speaking clients in a preset time range are all smaller than a preset volume threshold;
and the suspension module is used for suspending the pushing of the environmental sound audio stream to the corresponding subscription user side.
11. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform an audio adaptation method of live speech according to any of claims 2 to 9.
12. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the audio adaptation method for live speech according to any one of claims 2 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110672726.XA CN113411327B (en) | 2021-06-17 | 2021-06-17 | Audio adjustment method, system, device, equipment and medium for voice live broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110672726.XA CN113411327B (en) | 2021-06-17 | 2021-06-17 | Audio adjustment method, system, device, equipment and medium for voice live broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113411327A CN113411327A (en) | 2021-09-17 |
| CN113411327B true CN113411327B (en) | 2023-02-17 |
Family
ID=77684772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110672726.XA Active CN113411327B (en) | 2021-06-17 | 2021-06-17 | Audio adjustment method, system, device, equipment and medium for voice live broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113411327B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111629210A (en) * | 2020-05-22 | 2020-09-04 | 北京大米科技有限公司 | Data processing method and device and electronic equipment |
| CN111935555A (en) * | 2020-08-20 | 2020-11-13 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method, device, system, equipment and storage medium |
| CN112019874A (en) * | 2020-09-09 | 2020-12-01 | 广州华多网络科技有限公司 | Live wheat-connecting method and related equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9646626B2 (en) * | 2013-11-22 | 2017-05-09 | At&T Intellectual Property I, L.P. | System and method for network bandwidth management for adjusting audio quality |
| CN106407353B (en) * | 2016-09-05 | 2020-06-30 | 广州酷狗计算机科技有限公司 | Method and device for playing animation |
| CN111163325A (en) * | 2019-12-18 | 2020-05-15 | 深圳市云歌人工智能技术有限公司 | Community live broadcast method and device and storage medium |
-
2021
- 2021-06-17 CN CN202110672726.XA patent/CN113411327B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111629210A (en) * | 2020-05-22 | 2020-09-04 | 北京大米科技有限公司 | Data processing method and device and electronic equipment |
| CN111935555A (en) * | 2020-08-20 | 2020-11-13 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method, device, system, equipment and storage medium |
| CN112019874A (en) * | 2020-09-09 | 2020-12-01 | 广州华多网络科技有限公司 | Live wheat-connecting method and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113411327A (en) | 2021-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3282669B1 (en) | Private communications in virtual meetings | |
| US11303757B2 (en) | Multiple device conferencing with improved destination playback | |
| US9030523B2 (en) | Flow-control based switched group video chat and real-time interactive broadcast | |
| US7558224B1 (en) | Management of packet-based audio devices within acoustic spaces | |
| CN105933375B (en) | Method and device for monitoring microphone connection session and server | |
| US10187432B2 (en) | Replaying content of a virtual meeting | |
| WO2013163951A1 (en) | Method, server, user terminal, and system for data presentation in multi-person conversation | |
| KR20080076803A (en) | Bandwidth requesting system, bandwidth requesting device, client device, bandwidth requesting method, content playback method, and program | |
| EP2863642B1 (en) | Method, device and system for video conference recording and playing | |
| CN104901820A (en) | System, device and method for speaking sequence control | |
| CN109743524B (en) | Data processing method of video network and video network system | |
| US11838572B2 (en) | Streaming video trunking | |
| US20180270452A1 (en) | Multi-point connection control apparatus and method for video conference service | |
| CN113766251A (en) | Processing method, system, server and storage medium for live broadcast and microphone connection | |
| US11582300B2 (en) | Streaming synchronized media content to separate devices | |
| CN105791987B (en) | The method and terminal that media data plays | |
| CN113411327B (en) | Audio adjustment method, system, device, equipment and medium for voice live broadcast | |
| CN112689115A (en) | Multi-party conference system and control method | |
| EP3661194A1 (en) | Video interaction management method and system, and computer-readable storage medium | |
| US20150106097A1 (en) | Method and device for providing distributed telepresence service | |
| CN111726642B (en) | Live broadcast method, apparatus and computer readable storage medium | |
| CN105282473A (en) | Method and system for playing back and monitoring remote multi-media records based on IPPBX equipment | |
| CN109818979A (en) | A kind of method, apparatus that realizing audio return, equipment and storage medium | |
| CN113824978B (en) | Speaking method, device, equipment and storage medium of live broadcasting room | |
| CN112995573B (en) | Video conference live broadcasting system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |