WO2018184266A1 - 直播频道中的通信方法、装置及系统 - Google Patents

直播频道中的通信方法、装置及系统 Download PDF

Info

Publication number
WO2018184266A1
WO2018184266A1 PCT/CN2017/081891 CN2017081891W WO2018184266A1 WO 2018184266 A1 WO2018184266 A1 WO 2018184266A1 CN 2017081891 W CN2017081891 W CN 2017081891W WO 2018184266 A1 WO2018184266 A1 WO 2018184266A1
Authority
WO
WIPO (PCT)
Prior art keywords
channel
audio
live
client
server
Prior art date
Application number
PCT/CN2017/081891
Other languages
English (en)
French (fr)
Inventor
李南波
Original Assignee
广州市百果园网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州市百果园网络科技有限公司 filed Critical 广州市百果园网络科技有限公司
Priority to JP2020504755A priority Critical patent/JP6976410B2/ja
Publication of WO2018184266A1 publication Critical patent/WO2018184266A1/zh
Priority to US16/591,881 priority patent/US11153110B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1818Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the embodiments of the present invention relate to the field of network live broadcast, and in particular, to a communication method, device, and system in a live channel.
  • the webcast system is an internet system that broadcasts the multimedia stream of the anchor client to multiple viewer clients.
  • the webcast system is usually divided by channels (or rooms or live rooms), each channel including: anchor and viewer.
  • the anchor client For each channel, the anchor client sends the collected multimedia stream to the server; the server sends the multimedia stream to the viewer client corresponding to the viewer in the channel, and each viewer client receives and plays the multimedia stream.
  • the viewer client receives the text communication information input in the input box of the channel, and sends the text communication information to the server; the server sends the text communication information to other clients corresponding to other users in the channel (the anchor client and Audience client).
  • the multimedia stream includes: a live stream and an audio stream.
  • a communication method in a live channel comprising:
  • the audio channel control is used to trigger an audio channel between the viewer client and the server;
  • the triggering operation for requesting to establish the audio channel corresponding to the target audio channel control, the target audio channel control being in the at least one audio channel control One;
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor client corresponding to the anchor identifier is used to provide a live stream of the live channel.
  • the displaying at least one audio channel control in the user interface of the live channel includes:
  • the first audio channel control is displayed in the user interface of the live channel, and the first audio channel corresponding to the first audio channel control is in a forbidden state; and the second audio is displayed in the second display mode. a channel control, wherein the second audio channel corresponding to the second audio channel control is allowed to establish a state;
  • the first audio channel control is not displayed; and the second audio channel control is displayed in a second display manner;
  • the first display mode is different from the second display mode.
  • the method further includes:
  • the third display mode includes replacing a default icon on the target audio channel control with an avatar icon corresponding to the audience identifier of the audience client.
  • the method further includes:
  • the collecting the first audio information after the audio channel is successfully established including:
  • the first audio information is collected according to the audio collection operation.
  • the method further includes:
  • Stop acquiring the first audio information according to the stop collecting operation.
  • the method further includes:
  • the fourth audio channel control is an audio channel control in the at least one audio channel control.
  • the collecting the first audio information after the audio channel is successfully established including:
  • the audio signal is collected according to the received audio collection operation
  • the first audio information is obtained by canceling the same information in the audio signal as the second audio information by an echo cancellation algorithm.
  • the method further includes:
  • the live view stream is prohibited from being acquired from the server.
  • a communication method in a live channel comprising:
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor client corresponding to the anchor identifier is used to provide a live stream of the live channel.
  • the channel establishment request includes at least a channel identifier corresponding to the target audio control, a channel identifier corresponding to the live channel, and a viewer identifier corresponding to the audience client.
  • the establishing an audio channel between the viewer client and the client according to the channel establishment request include:
  • the channel identifies a corresponding audio channel; and when the audio channel is allowed to be established, sends a channel establishment instruction to the server;
  • the audio channel between the viewer client and the viewer client is established in accordance with the channel establishment command.
  • the method further includes:
  • the channel disable state notification including a channel identifier and a channel identifier of the at least one audio channel; the channel disable state notification is used to notify the server that the channel identifier corresponds to the live channel corresponding to the channel identifier
  • the state of the first audio channel is a forbidden state;
  • the channel disable status notification is sent to the viewer client.
  • the method further includes:
  • the release disable state notification including a channel identifier of the first audio channel and the channel identifier; the release disable state notification is used to notify the server in a live channel corresponding to the channel identifier
  • the state of the first audio channel is an allowable establishment state;
  • a communication method in a live channel comprising:
  • a channel establishment request sent by the server includes a viewer identifier belonging to the live channel, and the channel establishment request is used to request to establish a viewer client corresponding to the audience identifier
  • An audio channel between the servers
  • the server is configured to establish the audio channel according to the channel establishment instruction
  • the method further includes:
  • At least one audio channel control is displayed in the user interface of the live channel, and the audio channel control is used to trigger an audio channel between the viewer client and the server.
  • the displaying at least one audio channel control in the user interface of the live channel includes:
  • the second audio channel control is displayed in a second display manner, and the audio channel corresponding to the second audio channel control is allowed to establish a state;
  • the fourth audio channel control is displayed in a fourth display manner, where the fourth display mode is used to indicate that the audio information is being transmitted on the audio channel corresponding to the fourth audio channel control.
  • the method further includes:
  • the server Transmitting the channel disable status notification to the server, the server determining, according to the channel disable status notification, that the status of the first audio channel in the live channel is a forbidden establishment status.
  • the method further includes:
  • the server determining, according to the release-disabled state notification, that the state of the first audio channel in the live channel is an allowable setup state.
  • a communication device in a live channel comprising:
  • a first display module configured to display at least one audio channel control in a user interface of the live channel, where the audio channel control is used to trigger an audio channel between the viewer client and the server;
  • a first receiving module configured to receive a triggering operation on a target audio channel control, where the triggering operation is used to request to establish the audio channel corresponding to the target audio channel control, where the target audio channel control is At least one of the audio channel controls;
  • An acquiring module configured to collect first audio information after the audio channel is successfully established
  • a sending module configured to send the first audio information to the server by using the audio channel, where the server is configured to distribute the first audio information to at least one other client that belongs to the live channel;
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor client corresponding to the anchor identifier is used to provide a live stream of the live channel.
  • the first display module includes:
  • a first display unit configured to display, in a user interface of the live channel, a first audio channel control in a first display manner, where the first audio channel corresponding to the first audio channel control is in a forbidden state;
  • the second display mode displays a second audio channel control, and the second audio channel corresponding to the second audio channel control is allowed to establish a state;
  • a second display unit configured to: in the user interface of the live channel, not display the first audio channel control; and display the second audio channel control in a second display manner;
  • the first display mode is different from the second display mode.
  • the device further includes:
  • a second display module configured to display, in a user interface of the live channel, the target audio channel control in a third display manner, where the third display mode is used to indicate that the audio channel corresponding to the target audio channel control is Occupied.
  • the device further includes:
  • a second receiving module configured to receive a disconnection operation, where the disconnecting operation is used to disconnect an audio channel corresponding to the target audio channel control
  • the third display module is configured to display the target audio channel control in a second display manner, where the second display mode is used to indicate that the audio channel corresponding to the target audio channel control is in an allowable setup state.
  • the collecting module includes:
  • a receiving unit configured to receive an audio collection operation
  • the first collecting unit is configured to start collecting the first audio information according to the audio collecting operation.
  • the device further includes:
  • a third receiving module configured to receive a stop collection operation
  • the device further includes:
  • a fourth display module configured to display in a fourth display manner in a user interface of the live channel a fourth audio channel control, where the fourth display mode is used to indicate that audio information is being transmitted on an audio channel corresponding to the fourth audio channel control; and the fourth audio channel control is audio in the at least one audio channel control Channel control.
  • the collecting module includes:
  • a second collecting unit configured to collect an audio signal according to the received audio collection operation after the audio channel is successfully established
  • a comparing unit configured to compare the audio signal with second audio information sent by the server, where a time at which the second audio information is received is located before a time when the audio signal is collected;
  • An echo cancellation unit configured to cancel the same information in the audio signal as the second audio information by using an echo cancellation algorithm to obtain the first audio information.
  • the device further includes:
  • the obtaining module is forbidden to prohibit obtaining the live view stream from the server when the viewer client is running in the background.
  • a communication device in a live channel comprising:
  • a request receiving module configured to receive a channel establishment request sent by a viewer client, where the channel establishment request is generated when the audience client receives a trigger operation on a target audio control, where the target audio control is One of at least one audio channel control displayed in the user interface of the live channel;
  • a channel establishing module configured to establish an audio channel with the audience client according to the channel establishment request
  • An information receiving module configured to receive first audio information sent by the audience client
  • An information sending module configured to distribute the first audio information to at least one other client that belongs to the live channel
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor client corresponding to the anchor identifier is used to provide a live stream of the live channel.
  • the channel establishment request includes at least a channel identifier corresponding to the target audio control, a channel identifier corresponding to the live channel, and a viewer identifier corresponding to the audience client.
  • the channel establishment module includes:
  • a request sending unit configured to send the channel establishment request to a management client that belongs to a live channel corresponding to the channel identifier, where the management client refers to a client having management rights in the live channel; Determining, by the client, whether to establish an audio channel corresponding to the channel identifier; and Sending a channel establishment instruction to the server when the audio channel is allowed to be established;
  • An instruction receiving unit configured to receive the channel establishment instruction sent by the management client
  • a channel establishing unit configured to establish the audio channel with the viewer client according to the channel establishment instruction.
  • the device further includes:
  • a first receiving module configured to receive, by the first receiving module, a channel disable state notification, where the channel disable state notification includes a channel identifier and a channel identifier of the at least one audio channel; and the channel disable state notification is used to notify the server of the channel identifier In the corresponding live channel, the state of the first audio channel corresponding to the channel identifier is a forbidden establishment state;
  • a first sending module configured to send the channel disable status notification to the audience client.
  • the device further includes:
  • a second receiving module configured to receive a release disable state notification, where the release disable state notification includes a channel identifier of the first audio channel and the channel identifier; and the release disable state notification is used to notify the server that the The state of the first audio channel in the live channel corresponding to the channel identifier is an allowable establishment state;
  • a second sending module configured to send the release disable status notification to the audience client.
  • a communication device in a live channel comprising:
  • a request display module configured to display, in a user interface of the live channel, a channel establishment request sent by the server, the channel establishment request including a viewer identifier belonging to the live channel, and the channel establishment request is used to request to establish the audience identifier An audio channel between the corresponding viewer client and the server;
  • An instruction sending module configured to send a channel establishment instruction to the server according to the channel establishment request; the server is configured to establish the audio channel according to the channel establishment instruction;
  • the information receiving module is configured to receive first audio information sent by the server, where the first audio information is sent by the audience client to the server.
  • the device further includes:
  • a control display module configured to display at least one audio channel control in the user interface of the live channel, where the audio channel control is used to trigger an audio channel between the viewer client and the server.
  • control display module includes:
  • a first display unit configured to display, in a user interface of the live channel, a first audio channel control in a first display manner; or, in a user interface of the live channel, not displaying the first sound a frequency channel control; the audio channel corresponding to the first audio channel control is in a forbidden state;
  • a second display unit configured to display, in a user interface of the live channel, a second audio channel control in a second display manner, where the audio channel corresponding to the second audio channel control is allowed to be established;
  • a third display unit configured to display, in a user interface of the live channel, a third audio channel control in a third display manner, where the third display mode is used to indicate that the audio channel corresponding to the third audio channel control is Occupation
  • a fourth display unit configured to display, in a user interface of the live channel, a fourth audio channel control in a fourth display manner, where the fourth display mode is used to indicate an audio channel corresponding to the fourth audio channel control Audio information is being transmitted.
  • the device further includes:
  • a first receiving module configured to receive a first channel setting operation
  • a first generation module configured to generate a channel disable state notification according to the channel identifier corresponding to the first audio channel indicated by the first channel setting operation and the channel identifier corresponding to the live channel;
  • a first sending module configured to send the channel disable status notification to the server, where the server determines, according to the channel disable status notification, that the status of the first audio channel in the live channel is a forbidden establishment status.
  • the device further includes:
  • a second receiving module configured to receive a second channel setting operation
  • a second generation module configured to generate a release disable state notification according to the channel identifier corresponding to the first audio channel indicated by the second channel setting operation and the channel identifier corresponding to the live channel;
  • a second sending module configured to send the release-disabled state notification to the server, where the server determines, according to the release-disabled state notification, that the state of the first audio channel in the live channel is an allowable establishment state.
  • a seventh aspect provides a communication system in a live channel, the system comprising: a viewer client and a management client;
  • the viewer client is a device provided by the fourth aspect
  • the server is a device provided by the fifth aspect
  • the management client is the device of the sixth aspect.
  • a computer readable storage medium stores instructions for causing a viewer client to perform the live channel provided by the first aspect when it is run on a viewer client Communication method.
  • a ninth aspect a computer readable storage medium storing instructions stored in a server, when executed on a server, causing a server to perform a communication method in a live channel provided by the second aspect .
  • a computer readable storage medium stores instructions, when executed on an anchor client, causing an anchor client to execute the live channel provided by the third aspect Communication method.
  • the channel establishment request establishes an audio channel with the viewer client, which solves the problem that the communication efficiency is low when the viewer communicates with other users through the text information; since the viewer can pass the audio channel between the viewer client and the server, Voice communication with other users in the same live channel, thus improving the communication efficiency of the viewer in the live channel.
  • FIG. 1 is a schematic structural diagram of a network live broadcast system according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a communication method in a live channel according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 6 is a flowchart of a communication method in a live channel according to another embodiment of the present invention.
  • FIG. 7 is a schematic diagram of setting an audio channel according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of setting an audio channel according to an embodiment of the present invention.
  • FIG. 9 is a flowchart of a communication method in a live channel according to another embodiment of the present invention.
  • FIG. 10 is a schematic diagram of setting an audio channel according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 14 is a schematic diagram of a live channel provided by an embodiment of the present invention.
  • FIG. 15 is a block diagram of a communication device in a live channel according to an embodiment of the present invention.
  • 16 is a block diagram of a communication device in a live channel according to another embodiment of the present invention.
  • 17 is a block diagram of a communication device in a live channel provided by an embodiment of the present invention.
  • FIG. 18 is a block diagram of a communication device in a live channel according to another embodiment of the present invention.
  • FIG. 19 is a block diagram of a communication device in a live channel according to an embodiment of the present invention.
  • FIG. 20 is a block diagram of a communication device in a live channel according to another embodiment of the present invention.
  • FIG. 21 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 22 is a schematic structural diagram of a server according to an embodiment of the present invention.
  • Live client The live client is an application for webcasting.
  • the live client includes an anchor client and a viewer client.
  • the anchor client is used to provide a live stream in the live channel.
  • the anchor client logs in with the anchor identifier;
  • the viewer client is used to play the live stream.
  • the viewer client logs in with the viewer identifier.
  • the user identifier, the mobile phone number, the ID number, the string assigned by the server, and the like, and the audience identifier is the user name, the mobile phone number, the ID number, the server-assigned string, and the like. This is not limited.
  • Live channel refers to a communication set, and the communication set corresponding to each live channel corresponds to a channel identifier.
  • the communication set corresponding to each live channel includes an anchor identifier and a viewer identifier.
  • the number of anchor identifiers is one, and the number of audience identifiers is at least one.
  • the anchor client is further configured to provide a live audio stream corresponding to the live channel, and correspondingly, the audience client corresponding to the audience identifier is used to play the live audio stream.
  • the live channel stream and/or the live audio stream are sent to the server through the uplink channel between the anchor client and the server.
  • the first uplink channel for transmitting the live video stream and the second uplink channel for transmitting the live audio stream are different uplink channels.
  • the viewer client obtains the live stream and/or the live stream from the server through the downlink channel between the client client and the server when the client client obtains the live stream and/or the live stream from the server.
  • the first downlink channel for transmitting the live picture stream and the second downlink channel for transmitting the live audio stream are different downlink channels.
  • the uplink channel refers to the channel through which the client sends streaming media data to the server; the downstream channel refers to the channel through which the server sends streaming media data to the client.
  • the client includes an anchor client and a viewer client.
  • the streaming media data is a live video stream and/or a live audio stream.
  • the anchor client when the anchor client provides both the live stream and the live stream, the live stream and the live stream collected by the anchor client at the same time can be played at the same time of the audience client.
  • a time stamp is also set in the live stream and the live stream, and the timestamp is used to indicate the collection time of the live stream and the live stream.
  • FIG. 1 is a schematic structural diagram of a webcast live broadcast system according to an embodiment of the present invention.
  • the webcast system includes a first terminal 110, a second terminal 120, and a server 130.
  • the first terminal 110 and the second terminal 120 include a mobile phone, a tablet computer, a laptop portable computer, a desktop computer, and the like, which are not limited in this embodiment.
  • the first terminal 110 is installed with an anchor client 111.
  • the anchor client 111 invokes the image acquisition component installed in the first terminal 110, and collects a live stream through the image collection component, and sends the live stream to the server 130.
  • the image acquisition component is a camera assembly.
  • the live video stream is a user interface of the local end collected by the image capturing component by the host client 111.
  • the anchor client 111 collects the game screen stream of the local end through the image acquisition component.
  • the anchor client 111 invokes the audio collection component installed in the first terminal 110, and collects a live audio stream through the audio collection component, and sends the live audio stream to the server 130.
  • audio The acquisition component is a microphone component.
  • the anchor client 111 transmits the live stream and the live stream by different transmission channels.
  • the first terminal 110 establishes a communication connection with the server 130 by way of a wireless network or a wired network.
  • the server 130 is configured to provide a background service for webcasting.
  • the server 130 transmits the streaming media data based on a CDN (Content Delivery Network).
  • the server 130 includes a streaming server 131, a live source server 132, at least one internal CDN node 133, and at least one border CDN node 134.
  • the CDN node is a CDN server.
  • the internal CDN node 133 connects the live broadcast source server 132 with the border CDN node 134; the border CDN node 134 connects the internal CDN node 133 with the first terminal 110 and the second terminal 120.
  • the border CDN node 134 does not directly access the live broadcast source server 132; the first terminal 110 and the second terminal 120 are only connected to the border CDN node 134.
  • the streaming server 131 is connected to the live source server 132; the streaming server 131 passes the streaming data to the live source server 132.
  • the first terminal 110 transmits the streaming media data to the border CDN node 134, and then the live media server 132 distributes the streaming media data to different users in the same live channel. Accordingly, the second terminal 120 The streaming media data is acquired from the border CDN node 134 in the near direction, thereby improving the transmission efficiency of the streaming media data.
  • the server 130 may also be at least one server cluster including the same streaming media data.
  • the server 130 is further configured to receive the streaming media data sent by the anchor client 111, and send the streaming media data to the second terminal 120.
  • the second terminal 120 establishes a communication connection with the server 130 by way of a wireless network or a wired network.
  • the second terminal 120 is installed with a viewer client 121.
  • the viewer client 121 plays the streaming media data uploaded by the anchor client 111, for example, playing the live video stream and the live audio stream uploaded by the anchor client 111.
  • the anchor client 111 and the viewer client 121 are in the same live channel.
  • the audience client 121 invokes the audio collection component installed in the second terminal 120, and collects the first audio information through the audio collection component, and sends the first audio information to the server 130.
  • the viewer client 121 sends the first audio information to the server 130 through an uplink channel between the viewer client 121 and the server 130.
  • the server 130 distributes the first audio information to at least one client belonging to the live channel by using a downlink channel with each client in the same live channel.
  • the wireless or wired network described above uses standard communication techniques and/or protocols.
  • the network is usually the Internet, but can also be any network, including but not limited to a Local Area Network (LAN), a Metropolitan Area Network (MAN), a Wide Area Network (WAN), a mobile, a wired or a wireless. Any combination of networks, private networks, or virtual private networks).
  • data exchanged over a network is represented using techniques and/or formats including HyperText Mark-up Language (HTML), Extensible Markup Language (XML), and the like.
  • HTTP HyperText Mark-up Language
  • XML Extensible Markup Language
  • you can use such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), and Internet Protocol Security (IPsec).
  • SSL Secure Socket Layer
  • TLS Transport Layer Security
  • VPN Virtual Private Network
  • IPsec Internet Protocol Security
  • Regular encryption techniques are used to encrypt all or some of the links.
  • the above described data communication techniques may also be replaced or supplemented
  • only the number of the first terminals 110 is one, and the number of the second terminals 120 is two.
  • the actual number of the first terminals 110 may be at least one.
  • the number of the second terminals 120 may also be at least one, which is not limited in this embodiment.
  • FIG. 2 shows a flowchart of a communication method in a live channel provided by an embodiment of the present invention.
  • the communication method is used in the webcast system shown in FIG. 1, and the method may include the following steps:
  • step 201 the viewer client displays at least one audio channel control in the user interface of the live channel.
  • At least one live channel is displayed, and the viewer selects a live channel of interest from the at least one live channel to watch the live broadcast.
  • the viewer client receives the channel selection operation, generates a channel selection instruction according to the channel selection operation, and sends the channel selection instruction to the server, the channel selection instruction includes a channel identifier of the live channel; the server according to the channel selection instruction
  • the streaming media data corresponding to the channel identifier is sent to the viewer client.
  • the viewer client enters the live channel, and displays the live stream in the stream data in the user interface of the live channel.
  • the server stores a correspondence between the channel identifier and the anchor identifier.
  • the channel identifier is used to identify a different live channel, and the channel identifier is a string that is assigned by the server, for example, the channel identifier is 101; or the channel identifier is the anchor identifier of the host broadcast, which is not limited in this embodiment.
  • At least one audio channel control is displayed in the user interface of the live channel, and each audio channel control is used to trigger an audio channel between the viewer client and the server.
  • the audience client transmits audio information through the audio channel, and realizes voice communication with other clients in the live channel, thereby improving communication efficiency.
  • the number of the audio channel controls is a preset number. In this embodiment, the value of the preset number is not limited. The number of the audio channel controls is illustratively eight.
  • Each audio channel control is used to indicate an audio channel, and different audio channel controls have different channel identifiers.
  • Each channel identifier is used to indicate an audio channel, and the channel identifier may be a string of numbers, letters, and the like, which is not limited in this embodiment. Illustratively, the channel identification is 1, 2, 3, and the like.
  • the terminal when displaying the audio channel control, the terminal simultaneously displays the channel identifier of the audio channel corresponding to the audio channel control.
  • the audio channel control is located in the upper left corner of the live broadcast channel in the live channel; or the audio channel control is located in the lower left corner of the live broadcast channel in the live channel; or the audio channel control is located in the upper right corner of the live channel, which is not in this embodiment.
  • the display position of the audio channel control is limited.
  • the audio channel control can also be implemented as a physical button set on the terminal, which is not limited in this embodiment.
  • the live screen 302 is displayed in the user interface, and eight audio channel controls 303 are displayed in the live screen 302, and the audio channel control is displayed above each audio channel control.
  • the terminal when displaying the audio channel control, may display a part of the audio channel control in the same display interface, and when receiving the user-triggered page turning operation, display the remaining part of the audio channel control in the display interface.
  • the terminal displays a channel management option, and when the channel management option is triggered, is used to display at least one audio channel control.
  • the channel management option is located in the upper left corner of the live broadcast screen in the live channel; or the channel management option is located in the lower left corner of the live broadcast screen in the live channel; or the channel management option is located in the upper right corner of the live channel, which is not correct in this embodiment.
  • the display position of the channel management option is limited.
  • the live screen 302 is displayed in the user interface, and the channel management option 401 is displayed in the live screen 302.
  • the viewer client After receiving the operation on the channel management option 401, the viewer client displays eight audio channel controls 303, and the channel identifier 304 of the audio channel corresponding to the audio channel control is displayed above each audio channel control.
  • step 202 the viewer client receives a triggering action on the target audio channel control.
  • the trigger operation is performed on the target client audio channel control of the viewer client.
  • the target audio channel control is one of at least one audio channel control displayed in the user interface.
  • the trigger operation is used to request the establishment of an audio channel corresponding to the target audio channel control.
  • the triggering operation is at least one of a click operation, a long press operation, a sliding operation, and a voice control operation, which is not limited in this embodiment.
  • the audience client after receiving the triggering operation, the audience client generates a channel establishment request according to the triggering operation, where the channel establishment request is used to request the server to establish an audio channel with the audience client.
  • the channel establishment request includes a channel identifier, a channel identifier, and a viewer identifier.
  • step 203 the viewer client sends a channel establishment request to the server.
  • the viewer client sends a channel establishment request to the server, so that the server can establish an audio channel between the viewer client and the server, so that the viewer client can send the collected audio information to other clients belonging to the same live channel. (including the anchor client and other viewer clients), without the viewer manually inputting the communication information, the communication between the viewer and other users in the live channel can be realized, and the communication efficiency between the viewer and other users in the live channel is improved. .
  • Step 204 The server receives a channel establishment request sent by the audience client.
  • step 205 the server sends a channel establishment request to the management client.
  • Administrative rights refer to the rights to manage users in the live channel, such as the ability to delete users, allow users to speak, and prohibit users from speaking.
  • the management client can restrict the viewer client requesting to establish an audio channel, and does not enable all viewer clients to establish an audio channel.
  • the server sends a channel establishment request to the management client, where the server determines the management client corresponding to the channel identifier according to the channel identifier in the channel establishment request, and sends a channel establishment request to the management client.
  • the server sends a channel establishment request to the management client, the channel identifier is not carried.
  • the server after receiving the channel establishment request, the server directly establishes an audio channel between the audience client and the server corresponding to the audience identifier, and does not need to send the channel establishment request to the management client.
  • Step 206 The management client receives a channel establishment request sent by the server in the live channel.
  • Step 207 The management client sends a channel establishment instruction to the server according to the channel establishment request.
  • the management client sends a channel establishment instruction to the server according to the channel establishment request, including: acquiring a channel identifier in the channel establishment request; and generating query information according to the channel identifier, the query information is used to query whether the management user is allowed to establish an audio channel corresponding to the channel identifier Outputting the inquiry information; if receiving the channel establishment operation, generating a channel establishment instruction, and transmitting the channel establishment instruction to the server; if receiving the prohibition establishment operation, generating a prohibition establishment instruction, and sending the prohibition establishment instruction to server.
  • the management client sends a prohibition establishment instruction to the server, the server prohibits the establishment of the audio channel corresponding to the channel identifier, and the process ends; or the server prohibits the establishment of the audio channel corresponding to the channel identifier, and sends the prohibition establishment information to the viewer client to notify The audio channel corresponding to the channel identifier of the viewer has been forbidden to be established.
  • the channel establishment instruction is used to instruct the server to establish an audio channel corresponding to the channel identifier; the prohibition establishment instruction is used to instruct the server to prohibit the establishment of the audio channel corresponding to the channel identifier.
  • Both the channel establishment instruction and the prohibition establishment instruction include a channel identification and a channel identification.
  • the channel establishment operation is a click operation, a long press operation, a slide operation, and a voice control operation, and the like, which is not limited in this embodiment.
  • the query information generated by the management client includes the viewer identification, such that the user using the management client can know which viewer sent the channel establishment request.
  • the management client after receiving the channel establishment request, the management client generates and displays the inquiry information 501, which includes the audience identification and the channel identification.
  • the management client receives the channel establishment operation acting on the setup option 502, generates a channel establishment instruction, and sends the channel establishment instruction to the server.
  • Step 208 The server receives a channel establishment instruction sent by the management client.
  • step 209 the server establishes an audio channel with the viewer client.
  • the server establishes an audio channel with the viewer client according to the channel establishment instruction, and the audio channel corresponds to the channel identifier in the channel establishment instruction.
  • the server after the server establishes an audio channel, sending a setup success message to the audience client, where The establishment success message is used to notify the viewer that the client audio channel has been successfully established.
  • Step 210 After the audio channel is successfully established, the audience client collects the first audio information.
  • the audience client directly calls the audio collection component to collect the first audio information.
  • the viewer client invokes the audio collection component to acquire the first audio information.
  • the audio collection operation is a click operation, a long press operation, a sliding operation, and a voice input operation in a user interface of the live channel; or the audio collection operation is an operation performed on a physical button set in the second terminal, This embodiment does not limit this.
  • the audience client directly uses the collected audio signal as the first audio information; or the viewer client performs the echo cancellation processing on the collected audio signal to obtain the first audio information.
  • the audience client obtains the first audio information after performing the echo cancellation processing on the collected audio signal, including: after the audio channel is successfully established, collecting the audio signal according to the received audio collection operation; and receiving the audio signal and receiving the audio signal
  • the second audio information sent by the server is compared, wherein the time at which the second audio information is received is located before the time when the audio signal is collected; the same information as the second audio information in the audio signal is eliminated by the echo cancellation algorithm, and the first audio information is obtained. .
  • the viewer client receives the second audio information sent by the server and plays the second audio information in real time. If the second audio information is included in the audio signal collected by the viewer client, the second audio message may result in the second The audio information is cyclically transmitted in each client in the live channel, and an echo is generated, and the audio information is played poorly.
  • the second audio information in the audio signal is eliminated by the echo cancellation algorithm, and the echo caused by the repeated acquisition of the second audio information by the viewer client is eliminated, thereby improving the playback effect of the audio information.
  • the second audio information includes audio information sent by the anchor client, and/or audio information sent by other viewer clients.
  • Other viewer clients refer to viewer clients other than the viewer client that obtains the first audio information in the same live channel.
  • the echo cancellation algorithm is a piece of code developed by the user, or is implemented by speex (a set of audio compression format for voice), or is implemented by a program provided by another vendor, which is not limited in this embodiment. .
  • step 211 the viewer client sends the first audio information to the server through the audio channel.
  • Step 212 The server receives the first audio information sent by the viewer client.
  • Step 213 the server distributes the first audio information to at least one of the same live channels. It's client.
  • the server distributes the first audio information to a part of other clients belonging to the same live channel as the viewer client, and the part of the other client is the client specified by the viewer client; or the server distributes the first audio information To all other clients belonging to the same live channel as the viewer client.
  • the server receives the live video stream and the live audio stream sent by the anchor client, the information is sent to other audience clients together.
  • Step 214 The management client receives the first audio information sent by the server.
  • each of the other clients can receive the first audio information.
  • the communication method in the live channel displays the audio channel control in the user interface of the live channel of the viewer client; receives the trigger operation on the audio channel control; generates according to the trigger operation.
  • a channel establishment request is sent to the server; the server establishes an audio channel with the viewer client according to the channel establishment request, and solves the problem that the communication efficiency is low when the viewer communicates with other users through the text information. Problem; since the viewer can perform voice communication with other users in the same live channel through the audio channel between the viewer client and the server, the communication efficiency of the viewer in the live channel is improved.
  • the management client determines whether to establish an audio channel, so that the server does not have to establish an audio channel for the viewer client that establishes the request for each transmission channel, thereby reducing the server establishment audio. The burden of the channel.
  • the steps 201 to 203, 210, and 211 can be separately implemented as a method embodiment on the viewer client side; the steps 204, 205, 208, 209, 212, and 213 can be separately implemented as a server side method embodiment; 207, 214 can be implemented as a method for managing the client side. This embodiment does not limit this.
  • the management client sets the usage rights of the audio channel corresponding to each audio channel control in the live channel.
  • FIG. 6 is a flowchart of a communication method in a live channel provided by another embodiment of the present invention.
  • the communication method is used in the webcast system shown in FIG. 1, and the method may include the following steps:
  • Step 601 The management client receives the first channel setting operation.
  • the first channel setting operation is for setting the state of the first audio channel to the prohibition establishment state.
  • the first audio channel is one of a plurality of uplink channels for transmitting audio information.
  • the status of the audio channel includes prohibiting the establishment of the state and allowing the establishment of the state.
  • Disabling the establishment state means that the server is prohibited from establishing the audio channel according to the channel establishment request;
  • allowing the establishment state means allowing the server to establish the audio channel according to the channel establishment request.
  • the first channel setting operation is a click operation, a long press operation, a slide operation, and a voice control operation, and the like, which is not limited in this embodiment.
  • the anchor client when the management client is a host broadcast client, the anchor client receives the first channel setting operation when creating the live channel; or the anchor client receives the live channel and receives the first audio channel before being established. A channel setting operation; or, the anchor client receives the first channel setting operation after the first audio channel is established, and the embodiment does not limit the timing at which the anchor client receives the first channel setting operation.
  • the viewer client when the management client is the viewer client, the viewer client receives the first channel setting operation after creating the live channel and before the first audio channel is established; or the management client is established in the first audio channel.
  • the embodiment After receiving the first channel setting operation, the embodiment does not limit the timing at which the management client receives the first channel setting operation.
  • the anchor client displays setting information 701 of each audio channel when the live channel is created.
  • the setting information 701 is used to prompt whether the anchor allows the corresponding audio channel to be established, and the anchor client receives the setting information 701.
  • the first channel setting operation, the audio channel 702 corresponding to the setting information 701 is prohibited from being established.
  • At least one audio channel control is displayed in a user interface of the live channel of the management client.
  • the management client is the host broadcast client
  • the management client sets the state of the first audio channel by receiving a first channel setting operation acting on the first audio channel control.
  • the first audio channel control is one of at least one audio channel control.
  • the at least one audio channel control displayed by the anchor client is the same as the at least one audio channel control displayed by the viewer client.
  • the anchor client displays eight audio channel controls, and the anchor client receives a first channel setting operation on the first audio channel control 801, and the first audio channel control 801 corresponds to the first audio channel. It is forbidden to establish.
  • the management client when the management client receives the first channel setting operation on the audio channel control, displaying the first audio channel control in the first display manner in the user interface of the live channel; or The first audio channel control is not displayed in the user interface of the live channel.
  • the management client displays the second audio channel control in the second display mode in the user interface of the live channel, and the audio channel corresponding to the second audio channel control is allowed to establish a state.
  • the first display mode is used to indicate that the audio channel corresponding to the first audio channel control is in a forbidden state.
  • the second display mode is used to indicate that the audio channel corresponding to the second audio channel control is allowed to establish a state.
  • the first display mode is different from the second display mode.
  • the first display mode and the second display mode are not limited.
  • the first display mode is displayed by the first default image
  • the second display mode is displayed by the second default image.
  • the anchor client receives the first channel setting operation on the first audio channel control 801, and displays the first audio channel control 801 in the live channel of the anchor client in the first default image 802. The remaining few audio channel controls are displayed in a second default image 803.
  • Step 602 The management client generates a channel disable state notification according to the first audio channel indicated by the first channel setting operation.
  • the channel disable status notification includes a channel identifier corresponding to the first audio channel and a channel identifier corresponding to the live channel.
  • the channel disable state notification is used to notify the server that the status of the first audio channel corresponding to the channel identifier is the forbidden establishment state in the live channel corresponding to the channel identifier.
  • step 603 the management client sends a channel disable status notification to the server.
  • step 604 the server receives the channel disable status notification.
  • the server After receiving the channel disable state notification, the server sets the state of the first audio channel corresponding to the channel identifier to the forbidden establishment state in the live channel corresponding to the channel identifier.
  • the setting, by the server, the state of the first audio channel to prohibit the establishment of the state is: modifying the state identifier of the first audio channel to a state identifier corresponding to the prohibition establishment state.
  • the state identifier is not limited.
  • the state identifier corresponding to the state of the prohibition establishment state is represented by 1, and the state identifier corresponding to the state of the permission state is indicated by 0.
  • step 605 the server sends a channel disable status notification to the audience client.
  • step 606 the viewer client receives the channel disable status notification sent by the server.
  • Step 607 The viewer client displays the first audio channel control in the first display manner, and displays the second audio channel control in the second display manner; or, does not display the first audio channel control, and displays the second audio channel in the second display manner. Control.
  • the viewer client Since the first audio channel corresponding to the first audio channel control has been prohibited from being established by the management client, in order to prompt the viewer that the first audio channel cannot be established, the viewer client displays the first audio channel control in the first display manner, or The first audio channel control is displayed.
  • the viewer client when the management client displays the first audio channel option in the first display manner, the viewer client also displays the first audio channel option in the first display manner.
  • the management client does not display the first audio channel option
  • the viewer client does not display the first audio channel option.
  • the other clients in the same live channel are the same as the first audio channel control and the second audio channel control in the foregoing management client and the viewer client, that is, the first audio channel is displayed in the first display manner.
  • the control displays the second audio channel control in a second display manner; or, does not display the first audio channel control, and displays the second audio channel control in a second display manner.
  • the communication method in the live channel manages each audio channel by the management client, so that the server does not have to establish all audio channels, thereby reducing the burden on the server to establish an audio channel.
  • steps 601 to 603 can be implemented separately as a method embodiment for managing the client side; steps 604 and 605 can be implemented separately as a server side method embodiment; steps 606 and 607 can be implemented separately as a viewer client side method.
  • the embodiment does not limit this embodiment.
  • FIG. 9 is a flowchart of a communication method in a live channel provided by another embodiment of the present invention.
  • the communication method is used in the webcast system shown in FIG. 1. After step 703, the method may include the following steps:
  • step 901 the management client receives the second channel setting operation.
  • the second channel setting operation is for switching the state of the first audio channel from the prohibition establishment state to the permission establishment state.
  • the second channel setting operation is a click operation, a long press operation, a slide operation, a voice control operation, and the like, which are not limited in this embodiment.
  • the management client receives the second channel setting operation after receiving the first channel setting operation; or receives the second channel setting operation after receiving the first channel request, and the embodiment does not receive the management client.
  • the timing of the second channel setting operation is limited.
  • the management client is in the user interface of the live channel, with the first default image 1001. Displaying the first audio channel control 1002, displaying the remaining audio channel controls with the second default image 1002, and the management client receiving the second channel setting operation acting on the first audio channel control 1002, and second The default image 1002 displays the first audio channel control 1002.
  • Step 902 The management client generates an un-disabled state notification according to the first audio channel indicated by the second channel setting operation indication.
  • the disabling state notification includes a channel identifier and a channel identifier of the first audio channel, and the deactivation state notification is used to notify the server that the state of the first audio channel in the live channel corresponding to the channel identifier is an allowable establishment state.
  • step 903 the management client sends a disabling status notification to the server.
  • step 904 the server receives the disabling status notification.
  • the server After receiving the disabling status notification, the server changes the state of the first audio channel corresponding to the channel identifier from the prohibition establishment state to the permission establishment state in the live channel corresponding to the channel identifier.
  • the manner that the server changes the state of the first audio channel from the forbidden establishment state to the permission establishment state is: changing the state identifier of the first audio channel from the state identifier corresponding to the prohibition establishment state to the state corresponding to the permission establishment state Logo.
  • the status indicator of the first audio channel will be modified from 1 to 0.
  • step 905 the server sends a disabling status notification to the viewer client.
  • step 906 the viewer client receives the disabling status notification sent by the server.
  • Step 907 The viewer client displays the first audio channel control and the second audio channel control in a second display manner.
  • the first audio channel corresponding to the first audio channel control is allowed to be established. Therefore, the first audio channel control and the second audio channel control are displayed in the same manner, and are all in the second display mode.
  • the communication method in the live channel improves the setting by allowing the management user to flexibly restore the audio channel that is prohibited from being established by restoring the permission of the first audio channel to be established by the management client.
  • the flexibility of the audio channel improves the setting by allowing the management user to flexibly restore the audio channel that is prohibited from being established by restoring the permission of the first audio channel to be established by the management client.
  • steps 901 to 903 can be implemented separately as a method embodiment for managing the client side; steps 904 and 905 can be implemented separately as a server side method embodiment; steps 906 and 907 can be implemented separately as a viewer client side method.
  • the embodiment does not limit this embodiment.
  • the target audio is displayed in the third display manner in the viewer client.
  • Channel control if the audio channel between the viewer client and the server is successfully established, the target audio is displayed in the third display manner in the viewer client.
  • the server distributes the channel identifier in the channel establishment request to all clients belonging to the live channel; each client receives the After the channel is identified, the audio channel control corresponding to the channel identifier is displayed in the third display mode to prompt the user that the audio channel corresponding to the audio channel control is occupied.
  • the third display manner includes, but is not limited to, the following: displaying in a preset color, displaying in a preset size, displaying an avatar icon corresponding to the audience identifier occupying the audio channel, and displaying the image in a preset image.
  • the third display mode includes other forms, and the embodiment is not enumerated here.
  • the avatar icon corresponding to the audience identifier occupying the audio channel is displayed as an example in the third display mode.
  • the server after receiving the channel establishment request, the server also needs to search for the avatar icon corresponding to the audience identifier in the channel establishment request in the pre-stored user information, and send the avatar to each client in the same live channel.
  • each client modifies the default icon of the audio channel control corresponding to the channel identifier to the avatar icon.
  • the user information is information corresponding to the audience identifier, and the user information includes: an avatar icon, an ID card number, a user name, a user friend, a user identifier assigned by the server, a user right, and the like, which are not limited in this embodiment.
  • the default icon is the same as the second default image.
  • the channel identification request sent by the viewer client includes a channel identifier of “1”, and the server sends the channel identifier “1” to each client in the live channel, in the user interface of the live channel of each client.
  • the audio channel control 1101 is modified by the default icon 1102 to the avatar icon 1103 corresponding to the viewer identification.
  • each of the foregoing clients includes a management client in a live channel.
  • step 211 when the viewer client sends the first audio information to the server through the audio channel, the target audio channel control is also displayed in the fourth display manner.
  • the viewer client when receiving the second audio information sent by the server, displays a fourth audio channel control corresponding to the second audio information in a fourth display manner, where the second audio information is sent by other viewer clients to server.
  • the fourth audio channel control is an audio channel control in at least one audio channel control.
  • the fourth audio channel control includes the target audio channel control, and the fourth audio channel control The number is determined based on the number of audio channels that are transmitting audio information.
  • the channel identifier is also sent to the server; the server sends the channel identifier to other clients in the same channel; each client displays the channel in the fourth display manner. Identifies the corresponding audio channel control.
  • the fourth display mode is used to indicate that the audio information is being transmitted on the audio channel corresponding to the fourth audio channel control.
  • This embodiment does not limit the fourth display mode.
  • the fourth display mode is an enlarged display audio channel control. In this way, each user in the same live channel can know that the audience client corresponding to the audio channel control is speaking through the audio channel control displayed in the fourth display manner.
  • the viewer client displays each audio channel control in the live channel.
  • the viewer client establishes an audio channel with the server through the audio channel control 1201
  • the audio channel control 1201 is displayed in an enlarged manner.
  • the viewer client receives the stop acquisition operation; and stops acquiring the first audio information according to the stop acquisition operation.
  • the viewer client displays each audio channel control in the live channel, and after the viewer client establishes an audio channel with the server through the audio channel control 1301, if the viewer client receives the action on the audio channel control 1301. Operation, an audio capture option 1302 is displayed to receive an audio capture operation on the audio capture option 1302, and the viewer client begins to acquire the first audio information. Then, if the viewer client receives the operation acting on the audio channel control 1301, the display stop acquisition option 1303 is displayed, and the stop acquisition operation acting on the stop collection option 1303 is received, and the viewer client stops collecting the first audio information sound. .
  • the audience client receives a disconnect operation; generates a channel disconnection instruction according to the disconnection operation; sends a channel disconnection instruction to the server; and the server disconnects according to the channel disconnection instruction Open an audio channel with the viewer client.
  • the viewer client displays the target audio channel control in a second display manner upon receiving the disconnect operation.
  • the disconnection operation is a click, long press, slide, etc. operation on the user interface of the live channel; or, the disconnect operation is an operation acting on the preset physical button; or the disconnect operation is a voice input operation, This embodiment does not limit the disconnection operation.
  • the channel disconnection command includes a channel identifier and a channel identifier
  • the server disconnects the audio channel corresponding to the channel identifier in the live channel corresponding to the channel identifier.
  • the server sends the channel identifier in the channel disconnection command to other clients in the same live channel, and each client displays the audio channel control corresponding to the channel identifier in the second display manner, so that the live channel is in the live channel.
  • Each user knows that the audio channel corresponding to the channel identifier has been disconnected.
  • the viewer client displays each audio channel control in the live channel, and after the viewer client establishes an audio channel with the server through the audio channel control 1401, if the viewer client receives the action on the audio channel control 1401
  • the operation displays a channel disconnection option 1402, and the receiving acts on the channel disconnection option 1402 to disconnect the channel, and the viewer client generates a channel disconnection command.
  • the display interface shown in FIG. 3 is displayed.
  • the live broadcast screen is prohibited from being obtained from the server, so that resources occupied by the viewer client may be saved.
  • the audio channel control can be displayed in at least two display modes at the same time, for example, in the user interface of the live channel, the identifier “1” is displayed in the first display manner.
  • the following is an example of watching the main broadcast live game in the live channel of the viewer client.
  • the game is broadcasted through the live channel, that is, the game screen and the game audio are sent to the server, and sent by the server to the audience client corresponding to each viewer in the live channel.
  • the viewer client If the viewer performs voice communication with other users in the live channel, clicking the audio channel control in the live channel, the viewer client generates a channel establishment request according to the click operation, and sends the channel establishment request to the server; the server uses the channel The establishment request is sent to the management client; the management client generates a channel establishment instruction according to the channel identifier in the channel establishment request and/or the user information of the audience client; the channel establishment instruction is sent to the server; and the server establishes the channel identifier in the channel establishment instruction. Corresponding audio channel.
  • the viewer client sends the first audio information through the established audio channel, so that the viewer can perform voice communication with other users in the live channel through the audio channel, thereby guiding the anchor to play the game, or discussing the function of the game with other viewers. .
  • the viewer performs voice communication with the anchor, so that the viewer can know the address of the anchor playing game, thereby participating in the game of the anchor, and realizing the function of the strangers participating in the game together.
  • the viewer client runs in the background, only the related process of acquiring the first audio information, transmitting the first audio information, and receiving the second audio information is executed, and other processes of the viewer client are prohibited from running, thereby saving the occupation of the viewer client.
  • the resources of the terminal increase the speed of other applications.
  • the viewer client does not collect the image information of the viewer, which saves the resources consumed by the server to transfer the image information, thereby saving the transmission pressure of the server.
  • the delay of the live broadcast is controlled within 500 ms, which improves the live broadcast effect.
  • FIG. 15 is a block diagram of a communication device in a live channel provided by an embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the apparatus may include: a first display module 1510, a first receiving module 1520, an acquisition module 1530, and a transmitting module 1540.
  • the first display module 1510 is configured to display at least one audio channel control in a user interface of the live channel, where the audio channel control is used to trigger an audio channel between the viewer client and the server;
  • the first receiving module 1520 is configured to receive a triggering operation on the target audio channel control, and the triggering operation is used to request to establish an audio channel corresponding to the target audio channel control, where the target audio channel control is one of the at least one audio channel control;
  • the acquiring module 1530 is configured to collect the first audio information after the audio channel is successfully established
  • the sending module 1540 is configured to send first audio information to the server through the audio channel, where the server is configured to distribute the first audio information to at least one other client belonging to the live channel;
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor client corresponding to the anchor identifier is used to provide a live stream corresponding to the live channel.
  • the communication device in the live channel displays the audio channel control in the user interface of the live channel of the viewer client; receives the trigger operation on the audio channel control; generates according to the trigger operation a channel establishment request to send the channel establishment request to the server;
  • the server establishes an audio channel with the viewer client according to the channel establishment request, which solves the problem that the communication efficiency is low when the viewer communicates with other users through the text information; since the viewer can pass between the viewer client and the server
  • the audio channel communicates with other users in the same live channel, thus improving the communication efficiency of the viewer in the live channel.
  • FIG. 16 shows a block diagram of a communication device in a live channel provided by another embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the first display module 1510 includes: a first display unit 1511 and a second display unit 1512.
  • the first display unit 1511 is configured to: in the user interface of the live channel, display the first audio channel control in a first display manner, where the first audio channel corresponding to the first audio channel control is in a forbidden state; and the second display mode is Displaying a second audio channel control, and the second audio channel corresponding to the second audio channel control is allowed to establish a state;
  • the second display unit 1512 is configured to: in the user interface of the live channel, not display the first audio channel control; and display the second audio channel control in the second display manner;
  • the first display mode is different from the second display mode.
  • the device further includes: a second display module 1550.
  • the second display module 1550 is configured to display the target audio channel control in a third display manner in the user interface of the live channel, where the third display mode is used to indicate that the audio channel corresponding to the target audio channel control is occupied.
  • the device further includes: a second receiving module 1560 and a third display module 1570.
  • a second receiving module 1560 configured to receive a disconnect operation, where the disconnect operation is used to disconnect the audio channel corresponding to the target audio channel control;
  • the third display module 1570 is configured to display the target audio channel control in a second display manner, where the second display mode is used to indicate that the audio channel corresponding to the target audio channel control is in an allowable setup state.
  • the collecting module 1530 includes: a receiving unit 1531 and a first collecting unit 1532.
  • the receiving unit 1531 is configured to receive an audio collection operation
  • the first collecting unit 1532 is configured to start collecting the first audio information according to the audio collecting operation.
  • the device further includes: a third receiving module 1580 and a stop collecting module 1590.
  • a third receiving module 1580 configured to receive a stop collection operation
  • the acquisition module 1590 is stopped for stopping the acquisition of the first audio information according to the stop acquisition operation.
  • the device further includes: a fourth display module 1591.
  • the fourth display module 1591 is configured to display, in a user interface of the live channel, a fourth audio channel control in a fourth display manner, where the fourth display mode is used to indicate that the audio information is being transmitted on the audio channel corresponding to the fourth audio channel control;
  • the fourth audio channel control is an audio channel control in at least one audio channel control.
  • the acquisition module 1530 includes: a second collection unit 1533, a comparison unit 1534, and an echo cancellation unit 1535.
  • the second collecting unit 1533 is configured to collect an audio signal according to the received audio collection operation after the audio channel is successfully established
  • the comparing unit 1534 is configured to compare the audio signal with the second audio information sent by the server, where the moment of receiving the second audio information is before the time when the audio signal is collected;
  • the echo cancellation unit 1535 is configured to cancel the same information in the audio signal as the second audio information by using an echo cancellation algorithm to obtain the first audio information.
  • the apparatus further includes: a forbidden acquisition module 1592.
  • the obtaining module 1592 is forbidden to prohibit the live video stream from being acquired from the server when the viewer client is running in the background.
  • FIG. 17 shows a block diagram of a communication device in a live channel provided by an embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the apparatus may include a request receiving module 1710, a channel establishing module 1720, an information receiving module 1730, and an information transmitting module 1740.
  • the request receiving module 1710 is configured to receive a channel establishment request sent by the viewer client, where the channel establishment request is generated when the audience client receives the trigger operation on the target audio control, and the target audio control is a user interface of the live channel.
  • a channel establishing module 1720 configured to establish an audio channel with the viewer client according to the channel establishment request
  • the information receiving module 1730 is configured to receive first audio information sent by the audience client.
  • the information sending module 1740 is configured to distribute the first audio information to at least one other client belonging to the live channel;
  • the communication set corresponding to the live channel includes an anchor identifier and a viewer identifier, and the anchor identifier pair
  • the anchor client should be used to provide a live stream corresponding to the live channel.
  • the communication device in the live channel displays the audio channel control in the user interface of the live channel of the viewer client; receives the trigger operation on the audio channel control; generates according to the trigger operation a channel establishment request is sent to the server; the server establishes an audio channel with the viewer client according to the channel establishment request, and solves the problem that the communication efficiency is low when the viewer communicates with other users through the text information. Problem; since the viewer can perform voice communication with other users in the same live channel through the audio channel between the viewer client and the server, the communication efficiency of the viewer in the live channel is improved.
  • FIG. 18 shows a block diagram of a communication device in a live channel provided by another embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the channel establishment request includes at least a channel identifier corresponding to the target audio control, a channel identifier corresponding to the live channel, and a viewer identifier corresponding to the audience client;
  • the channel establishment module 1720 includes a request sending unit 1721, an instruction receiving unit 1722, and a channel establishing unit 1723.
  • the request sending unit 1721 is configured to send the channel establishment request to the management client that belongs to the live channel corresponding to the channel identifier, and the management client refers to the client with the management authority in the live channel; the management client determines whether to allow the channel identifier to be established. Audio channel; and when the audio channel is allowed to be established, a channel establishment command is sent to the server;
  • the instruction receiving unit 1722 is configured to receive a channel establishment instruction sent by the management client;
  • the channel establishing unit 1723 is configured to establish an audio channel with the viewer client according to the channel establishment instruction.
  • the device further includes: a first receiving module 1750 and a first sending module 1760.
  • the first receiving module 1750 is configured to receive, by the first receiving module, a channel disable state notification, where the channel disable state notification includes a channel identifier and a channel identifier of the at least one audio channel, and the channel disable state notification is used to notify the server in the live channel corresponding to the channel identifier.
  • the state of the first audio channel corresponding to the channel identifier is a prohibited establishment state;
  • the first sending module 1760 is configured to send a channel disable status notification to the audience client.
  • the device further includes: a second receiving module 1770 and a second sending module 1780.
  • the second receiving module 1770 is configured to receive the release disable status notification, and the release the disable status notification includes a channel identifier and a channel identifier of the first audio channel; the un-disabled state notification is used to notify the server that the state of the first audio channel in the live channel corresponding to the channel identifier is an allowable establishment state;
  • the second sending module 1780 is configured to send the release disable status notification to the audience client.
  • FIG. 19 shows a block diagram of a communication device in a live channel provided by an embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the apparatus may include a request display module 1910, an instruction sending module 1920, and an information receiving module 1930.
  • the request display module 1910 is configured to display, in the user interface of the live channel, a channel establishment request sent by the server, the channel establishment request includes a viewer identifier belonging to the live channel, and the channel establishment request is used to request to establish the audience client and the server corresponding to the audience identifier. Audio channel between
  • the instruction sending module 1920 is configured to send a channel establishment instruction to the server according to the channel establishment request; the server is configured to establish an audio channel according to the channel establishment instruction;
  • the information receiving module 1930 is configured to receive first audio information sent by the server, where the first audio information is sent by the audience client to the server.
  • the communication device in the live channel displays the audio channel control in the user interface of the live channel of the viewer client; receives the trigger operation on the audio channel control; generates according to the trigger operation a channel establishment request is sent to the server; the server establishes an audio channel with the viewer client according to the channel establishment request, and solves the problem that the communication efficiency is low when the viewer communicates with other users through the text information. Problem; since the viewer can perform voice communication with other users in the same live channel through the audio channel between the viewer client and the server, the communication efficiency of the viewer in the live channel is improved.
  • FIG. 20 shows a block diagram of a communication device in a live channel provided by another embodiment of the present invention.
  • the apparatus has a function of executing the above-described method examples, and the functions may be implemented by hardware or by hardware to execute corresponding software.
  • the device further includes: a control display module 1940.
  • the control display module 1940 is configured to display at least one audio channel control in the user interface of the live channel, and the audio channel control is used to trigger an audio channel between the viewer client and the server.
  • control display module 1940 includes: a first display unit 1941, and a second display unit 1942, a third display unit 1943 and a fourth display unit 1944.
  • the first display unit 1941 is configured to display the first audio channel control in the first display manner in the user interface of the live channel; or, in the user interface of the live channel, the first audio channel control is not displayed; the first audio channel The audio channel corresponding to the control is forbidden to establish state;
  • the second display unit 1942 is configured to display, in a user interface of the live channel, a second audio channel control in a second display manner, where the audio channel corresponding to the second audio channel control is in an allowable setup state;
  • the third display unit 1943 is configured to display, in a user interface of the live channel, a third audio channel control in a third display manner, where the third display mode is used to indicate that the audio channel corresponding to the third audio channel control is occupied;
  • the fourth display unit 1944 is configured to display, in the user interface of the live channel, the fourth audio channel control in a fourth display manner, where the fourth display mode is used to indicate that the audio information is being transmitted on the audio channel corresponding to the fourth audio channel control.
  • the device further includes: a first receiving module 1950, a first generating module 1960, and a first sending module 1970.
  • a first receiving module 1950 configured to receive a first channel setting operation
  • the first generation module 1960 is configured to generate a channel disable state notification according to the channel identifier corresponding to the first audio channel indicated by the first channel setting operation and the channel identifier corresponding to the live channel;
  • the first sending module 1970 is configured to send a channel disable state notification to the server, and the server determines, according to the channel disable state notification, that the state of the first audio channel in the live channel is a forbidden establishment state.
  • the apparatus further includes: a second receiving module 1980, a second generating module 1990, and a second sending module 1991.
  • a second receiving module 1980 configured to receive a second channel setting operation
  • the second generation module 1990 is configured to generate a release disable state notification according to the channel identifier corresponding to the first audio channel indicated by the second channel setting operation and the channel identifier corresponding to the live channel;
  • the second sending module 1991 is configured to send the release disable state notification to the server, and the server determines, according to the release disable state notification, that the state of the first audio channel in the live channel is an allowable setup state.
  • FIG. 21 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal 2100 is configured to implement a communication method in a live channel provided in the foregoing embodiment. Specifically:
  • the terminal 2100 may include an RF (Radio Frequency) circuit 2110, a memory 2120 including one or more computer readable storage media, an input unit 2130, a display unit 2140, a sensor 2150, an audio circuit 2160, and a WiFi (wireless fidelity, wireless).
  • the fidelity module 2170 includes a processor 2180 having one or more processing cores, and a power supply 2190 and the like. It will be understood by those skilled in the art that the terminal structure shown in FIG. 21 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or combine some components, or different component arrangements. among them:
  • the RF circuit 2110 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, the downlink information is processed by one or more processors 2180. In addition, the data related to the uplink is sent to the base station. .
  • the RF circuit 2110 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc.
  • RF circuitry 2110 can also communicate with the network and other devices via wireless communication.
  • Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access) Divisional Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • e-mail Short Messaging Service
  • the memory 2120 can be used to store software programs and modules, and the processor 2180 executes various functional applications and data processing by running software programs and modules stored in the memory 2120.
  • the memory 2120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 2100 (such as audio data, phone book, etc.) and the like.
  • memory 2120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the memory 2120 may further include a memory controller to provide a processor 2180 and input unit 2130 access to memory 2120.
  • the input unit 2130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
  • the input unit 2130 may include an image input device 2131 and other input devices 2132.
  • the image input device 2131 may be a camera or an optical scanning device.
  • the input unit 2130 may also include other input devices 2132.
  • other input devices 2132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 2140 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of the terminal 2100, which can be composed of graphics, text, icons, video, and any combination thereof.
  • the display unit 2140 may include a display panel 2141.
  • the display panel 2141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • Terminal 2100 can also include at least one type of sensor 2150, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 2141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 2141 when the terminal 2100 moves to the ear. / or backlight.
  • the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the gesture of the mobile phone can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal 2100 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, not here Let me repeat.
  • An audio circuit 2160, a speaker 2161, and a microphone 2162 can provide an audio interface between the user and the terminal 2100.
  • the audio circuit 2160 can transmit the converted electrical data of the received audio data to the speaker 2161, and convert it into a sound signal output by the speaker 2161; on the other hand, the microphone 2162 converts the collected sound signal into an electrical signal, and the audio circuit 2160 After receiving, it is converted into audio data, and then processed by the audio data output processor 2180, transmitted to the terminal, for example, via the RF circuit 2110, or outputted to the memory 2120 for further processing.
  • the audio circuit 2160 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 2100.
  • WiFi is a short-range wireless transmission technology
  • the terminal 2100 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 2170, which provides users with wireless broadband. Internet access.
  • FIG. 21 shows the WiFi module 2170, it can be understood that it does not belong to the essential configuration of the terminal 2100, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 2180 is a control center of the terminal 2100 that connects various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 2120, and recalling data stored in the memory 2120, The functions and processing data of the terminal 2100 are executed to perform overall monitoring of the mobile phone.
  • the processor 2180 may include one or more processing cores; preferably, the processor 2180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 2180.
  • the terminal 2100 further includes a power source 2190 (such as a battery) for supplying power to the various components.
  • a power source 2190 such as a battery
  • the power source can be logically connected to the processor 2180 through the power management system to implement functions such as managing charging, discharging, and power management through the power management system.
  • the power supply 2190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
  • the terminal 2100 may further include a Bluetooth module or the like, and details are not described herein again.
  • terminal 2100 further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors.
  • the one or more programs described above include instructions for performing the above method.
  • FIG. 22 is a schematic structural diagram of a server according to an embodiment of the present invention.
  • the server 2200 includes a central processing unit (English: Central Processing Unit, CPU for short) 2201, including a random access memory (English: random access memory, abbreviation: RAM) 2202, and a read-only memory (English: read-only memory, referred to as: The system memory 2204 of the ROM 2203, and the system bus 2205 that connects the system memory 2204 and the central processing unit 2201.
  • the server 2200 also includes a basic input/output system (I/O system) 2206 that facilitates transfer of information between various devices within the computer, and mass storage for storing the operating system 2213, applications 2214, and other program modules 2215.
  • I/O system basic input/output system
  • the basic input/output system 2206 includes a display 2208 for displaying information and an input device 2209 such as a mouse, keyboard, etc. for user input of information. Wherein the display 2208 and Input device 2209 is connected to central processing unit 2201 by an input/output controller 2210 that is coupled to system bus 2205.
  • the basic input/output system 2206 can also include an input output controller 2210 for receiving and processing input from a plurality of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input/output controller 2210 also provides output to a display screen, printer, or other type of output device.
  • the mass storage device 2207 is connected to the central processing unit 2201 by a mass storage controller (not shown) connected to the system bus 2205.
  • the mass storage device 2207 and its associated computer readable medium provide non-volatile storage for the server 2200. That is, the mass storage device 2207 may include a computer readable medium (not shown) such as a hard disk or a Compact Disc Read-Only Memory (CD-ROM) drive.
  • a computer readable medium such as a hard disk or a Compact Disc Read-Only Memory (CD-ROM) drive.
  • the computer readable medium can include computer storage media and communication media.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • Computer storage medium includes RAM, ROM, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (English: electrically erasable programmable read-only memory) , referred to as: EEPROM), flash memory or other solid-state storage technology, CD-ROM, digital Versatile Disc (DVD) or other optical storage, tape cartridge, tape, disk storage or other magnetic storage devices.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory or other solid-state storage technology
  • CD-ROM compact disc
  • DVD digital Versatile Disc
  • the server 2200 may also be operated by a remote computer connected to the network through a network such as the Internet. That is, the server 2200 can be connected to the network 2212 through the network interface unit 2211 connected to the system bus 2205, or can also be connected to other types of networks or remote computer systems (not shown) using the network interface unit 2211. .
  • the embodiment of the present invention further provides a computer readable storage medium, which may be a computer readable storage medium included in the memory in the above embodiment; or may exist separately and not assembled into the terminal.
  • Computer readable storage medium may be a computer readable storage medium included in the memory in the above embodiment; or may exist separately and not assembled into the terminal.
  • Computer readable storage medium stores one or more programs that are used by one or more processors to perform the methods described above.
  • a plurality as referred to herein means two or more.
  • "and/or” describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately.
  • the character "/" generally indicates that the contextual object is an "or" relationship.
  • the storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明公开了一种直播频道中的通信方法、装置及系统,属于网络直播领域。该方法包括:在直播频道的用户界面中显示至少一个音频通道控件;接收作用于目标音频通道控件上的触发操作,触发操作用于请求建立与目标音频通道控件对应的音频通道;在音频通道建立成功后,采集第一音频信息;通过音频通道向服务器发送第一音频信息,服务器用于将第一音频信息分发至属于直播频道的至少一个其它客户端。本发明解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。

Description

直播频道中的通信方法、装置及系统
本申请要求于2017年04月07日提交中国专利局、申请号为201710223486.9、发明名称为“直播频道中的通信方法、装置及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明实施例涉及网络直播领域,特别涉及一种直播频道中的通信方法、装置及系统。
背景技术
网络直播系统是一种将主播客户端的多媒体流广播至多个观众客户端的互联网系统。网络直播系统通常按照频道(或称:房间或直播间)来进行划分,每个频道包括:主播和观众。
对于每个频道来说,主播客户端将采集到的多媒体流发送给服务器;服务器将多媒体流发送给该频道内的观众对应的观众客户端,各个观众客户端接收并播放该多媒体流。观众客户端接收在该频道的输入框中输入的文本通信信息,将该文本通信信息发送给服务器;服务器将该文本通信信息发送给该频道内的其它用户对应的其它客户端(主播客户端和观众客户端)。其中,多媒体流包括:直播画面流和音频流。
观众在需要与同一频道的其它用户进行通信时,需要手动输入文本通信信息才能实现,导致观众与同一频道的其它用户在直播频道内通信的效率较低。
发明内容
为了解决在直播频道中,由于观众通过输入文本通信信息来与该直播频道中的其它用户进行通信,导致观众与其它用户的通信效率不高的问题,本发明实施例提供了一种直播频道中的通信方法、装置及系统。所述技术方案如下:
第一方面,提供了一种直播频道中的通信方法,所述方法包括:
在直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立一条音频通道;
接收作用于目标音频通道控件上的触发操作,所述触发操作用于请求建立与所述目标音频通道控件对应的所述音频通道,所述目标音频通道控件是所述至少一个音频通道控件中的一个;
在所述音频通道建立成功后,采集第一音频信息;
通过所述音频通道向所述服务器发送所述第一音频信息,所述服务器用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
可选地,所述在直播频道的用户界面中显示至少一个音频通道控件,包括:
在所述直播频道的用户界面中,以第一显示方式显示第一音频通道控件,所述第一音频通道控件对应的第一音频通道为禁止建立状态;且以第二显示方式显示第二音频通道控件,所述第二音频通道控件对应的第二音频通道为允许建立状态;
或者,
在所述直播频道的用户界面中,不显示所述第一音频通道控件;且以第二显示方式显示所述第二音频通道控件;
其中,所述第一显示方式与所述第二显示方式不同。
可选地,所述接收作用于目标音频通道控件上的触发操作之后,还包括:
在所述直播频道的用户界面中,以第三显示方式显示所述目标音频通道控件,所述第三显示方式用于指示所述目标音频通道控件对应的音频通道被占用。
可选地,所述第三显示方式包括将所述目标音频通道控件上的默认图标,替换为登录所述观众客户端的观众标识对应的头像图标。
可选地,所述在所述直播频道的用户界面上以第三显示方式显示所述目标音频通道控件之后,还包括:
接收断开操作,所述断开操作用于断开所述目标音频通道控件对应的音频通道;
以第二显示方式显示所述目标音频通道控件,所述第二显示方式用于指示所述目标音频通道控件对应的音频通道为允许建立状态。
可选地,所述在所述音频通道建立成功后采集第一音频信息,包括:
接收音频采集操作;
根据所述音频采集操作开始采集所述第一音频信息。
可选地,所述根据所述音频采集操作开始采集所述第一音频信息之后,还包括:
接收停止采集操作;
根据所述停止采集操作停止采集所述第一音频信息。
可选地,所述方法还包括:
在所述直播频道的用户界面中,以第四显示方式显示第四音频通道控件,所述第四显示方式用于指示所述第四音频通道控件对应的音频通道上正在传输音频信息;所述第四音频通道控件为所述至少一个音频通道控件中的音频通道控件。
可选地,所述在所述音频通道建立成功后采集第一音频信息,包括:
在所述音频通道建立成功后,根据接收到的音频采集操作采集音频信号;
将所述音频信号与所述服务器发送的第二音频信息进行比较,其中,接收所述第二音频信息的时刻位于采集所述音频信号的时刻之前;
通过回声消除算法消除所述音频信号中与所述第二音频信息相同的信息,得到所述第一音频信息。
可选地,所述方法还包括:
当所述观众客户端在后台运行时,禁止从所述服务器获取所述直播画面流。
第二方面,提供了一种直播频道中的通信方法,所述方法包括:
接收观众客户端发送的通道建立请求,所述通道建立请求是所述观众客户端在接收到作用于目标音频控件上的触发操作时生成的,所述目标音频控件是在直播频道的用户界面中显示的至少一个音频通道控件中的一个;
根据所述通道建立请求建立与所述观众客户端之间的音频通道;
接收所述观众客户端发送的第一音频信息;
将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
可选地,所述通道建立请求至少包括所述目标音频控件对应的通道标识、所述直播频道对应的频道标识和所述观众客户端对应的观众标识;
所述根据所述通道建立请求建立与所述观众客户端之间的音频通道,包 括:
将所述通道建立请求发送至属于所述频道标识对应的直播频道的管理客户端,所述管理客户端是指所述直播频道中具有管理权限的客户端;所述管理客户端确定是否允许建立所述通道标识对应的音频通道;并在允许建立所述音频通道时,向服务器发送通道建立指令;
接收所述管理客户端发送的所述通道建立指令;
根据所述通道建立指令建立与所述观众客户端之间的所述音频通道。
可选地,所述方法还包括:
接收通道禁用状态通知,所述通道禁用状态通知包括至少一个音频通道的通道标识和频道标识;所述通道禁用状态通知用于通知服务器在所述频道标识对应的直播频道中,所述通道标识对应的第一音频通道的状态为禁止建立状态;
将所述通道禁用状态通知发送至所述观众客户端。
可选地,所述将所述通道禁用状态通知发送至所述观众客户端之后,还包括:
接收解除禁用状态通知,所述解除禁用状态通知包括所述第一音频通道的通道标识和所述频道标识;所述解除禁用状态通知用于通知所述服务器在所述频道标识对应的直播频道中所述第一音频通道的状态为允许建立状态;
将所述解除禁用状态通知发送至所述观众客户端。
第三方面,提供了一种直播频道中的通信方法,所述方法包括:
在直播频道的用户界面中显示服务器发送的通道建立请求,所述通道建立请求包括属于所述直播频道的观众标识,且所述通道建立请求用于请求建立所述观众标识对应的观众客户端与所述服务器之间的音频通道;
根据所述通道建立请求向所述服务器发送通道建立指令;所述服务器用于根据所述通道建立指令建立所述音频通道;
接收所述服务器发送的第一音频信息,所述第一音频信息由所述观众客户端发送至所述服务器。
可选地,所述方法还包括:
在所述直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立音频通道。
可选地,所述在直播频道的用户界面中显示至少一个音频通道控件,包括:
在所述直播频道的用户界面中,以第一显示方式显示第一音频通道控件;或者,在所述直播频道的用户界面中,不显示所述第一音频通道控件;所述第一音频通道控件对应的音频通道为禁止建立状态;
和/或,
在所述直播频道的用户界面中,以第二显示方式显示第二音频通道控件,所述第二音频通道控件对应的音频通道为允许建立状态;
和/或,
在所述直播频道的用户界面中,以第三显示方式显示第三音频通道控件,所述第三显示方式用于指示所述第三音频通道控件对应的音频通道被占用;
和/或,
在所述直播频道的用户界面中,以第四显示方式显示第四音频通道控件,所述第四显示方式用于指示所述第四音频通道控件对应的音频通道上正在传输音频信息。
可选地,所述方法还包括:
接收第一通道设置操作;
根据所述第一通道设置操作指示的第一音频通道对应的通道标识和所述直播频道对应的频道标识,生成通道禁用状态通知;
将所述通道禁用状态通知发送至所述服务器,所述服务器根据所述通道禁用状态通知确定在所述直播频道中所述第一音频通道的状态为禁止建立状态。
可选地,所述将所述通道禁用状态通知发送至所述服务器之后,还包括:
接收第二通道设置操作;
根据所述第二通道设置操作指示的所述第一音频通道对应的通道标识和所述直播频道对应的频道标识,生成解除禁用状态通知;
将所述解除禁用状态通知发送至所述服务器,所述服务器根据所述解除禁用状态通知确定在所述直播频道中所述第一音频通道的状态为允许建立状态。
第四方面,提供了一种直播频道中的通信装置,所述装置包括:
第一显示模块,用于在直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立一条音频通道;
第一接收模块,用于接收作用于目标音频通道控件上的触发操作,所述触发操作用于请求建立与所述目标音频通道控件对应的所述音频通道,所述目标音频通道控件是所述至少一个音频通道控件中的一个;
采集模块,用于在所述音频通道建立成功后,采集第一音频信息;
发送模块,用于通过所述音频通道向所述服务器发送所述第一音频信息,所述服务器用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
可选地,所述第一显示模块,包括:
第一显示单元,用于在所述直播频道的用户界面中,以第一显示方式显示第一音频通道控件,所述第一音频通道控件对应的第一音频通道为禁止建立状态;且以第二显示方式显示第二音频通道控件,所述第二音频通道控件对应的第二音频通道为允许建立状态;
第二显示单元,用于在所述直播频道的用户界面中,不显示所述第一音频通道控件;且以第二显示方式显示所述第二音频通道控件;
其中,所述第一显示方式与所述第二显示方式不同。
可选地,所述装置还包括:
第二显示模块,用于在所述直播频道的用户界面中,以第三显示方式显示所述目标音频通道控件,所述第三显示方式用于指示所述目标音频通道控件对应的音频通道被占用。
可选地,所述装置还包括:
第二接收模块,用于接收断开操作,所述断开操作用于断开所述目标音频通道控件对应的音频通道;
第三显示模块,用于以第二显示方式显示所述目标音频通道控件,所述第二显示方式用于指示所述目标音频通道控件对应的音频通道为允许建立状态。
可选地,所述采集模块,包括:
接收单元,用于接收音频采集操作;
第一采集单元,用于根据所述音频采集操作开始采集所述第一音频信息。
可选地,所述装置还包括:
第三接收模块,用于接收停止采集操作;
停止采集模块,用于根据所述停止采集操作停止采集所述第一音频信息。
可选地,所述装置还包括:
第四显示模块,用于在所述直播频道的用户界面中,以第四显示方式显示 第四音频通道控件,所述第四显示方式用于指示所述第四音频通道控件对应的音频通道上正在传输音频信息;所述第四音频通道控件为所述至少一个音频通道控件中的音频通道控件。
可选地,所述采集模块,包括:
第二采集单元,用于在所述音频通道建立成功后,根据接收到的音频采集操作采集音频信号;
比较单元,用于将所述音频信号与所述服务器发送的第二音频信息进行比较,其中,接收所述第二音频信息的时刻位于采集所述音频信号的时刻之前;
回声消除单元,用于通过回声消除算法消除所述音频信号中与所述第二音频信息相同的信息,得到所述第一音频信息。
可选地,所述装置还包括:
禁止获取模块,用于当所述观众客户端在后台运行时,禁止从所述服务器获取所述直播画面流。
第五方面,提供了一种直播频道中的通信装置,所述装置包括:
请求接收模块,用于接收观众客户端发送的通道建立请求,所述通道建立请求是所述观众客户端在接收到作用于目标音频控件上的触发操作时生成的,所述目标音频控件是在直播频道的用户界面中显示的至少一个音频通道控件中的一个;
通道建立模块,用于根据所述通道建立请求建立与所述观众客户端之间的音频通道;
信息接收模块,用于接收所述观众客户端发送的第一音频信息;
信息发送模块,用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
可选地所述通道建立请求至少包括所述目标音频控件对应的通道标识、所述直播频道对应的频道标识和所述观众客户端对应的观众标识;
所述通道建立模块,包括:
请求发送单元,用于将所述通道建立请求发送至属于所述频道标识对应的直播频道的管理客户端,所述管理客户端是指所述直播频道中具有管理权限的客户端;所述管理客户端确定是否允许建立所述通道标识对应的音频通道;并 在允许建立所述音频通道时,向服务器发送通道建立指令;
指令接收单元,用于接收所述管理客户端发送的所述通道建立指令;
通道建立单元,用于根据所述通道建立指令建立与所述观众客户端之间的所述音频通道。
可选地,所述装置还包括:
第一接收模块,用于第一接收模块接收通道禁用状态通知,所述通道禁用状态通知包括至少一个音频通道的通道标识和频道标识;所述通道禁用状态通知用于通知服务器在所述频道标识对应的直播频道中,所述通道标识对应的第一音频通道的状态为禁止建立状态;
第一发送模块,用于将所述通道禁用状态通知发送至所述观众客户端。
可选地,所述装置还包括:
第二接收模块,用于接收解除禁用状态通知,所述解除禁用状态通知包括所述第一音频通道的通道标识和所述频道标识;所述解除禁用状态通知用于通知所述服务器在所述频道标识对应的直播频道中所述第一音频通道的状态为允许建立状态;
第二发送模块,用于将所述解除禁用状态通知发送至所述观众客户端。
第六方面,提供了一种直播频道中的通信装置,所述装置包括:
请求显示模块,用于在直播频道的用户界面中显示服务器发送的通道建立请求,所述通道建立请求包括属于所述直播频道的观众标识,且所述通道建立请求用于请求建立所述观众标识对应的观众客户端与所述服务器之间的音频通道;
指令发送模块,用于根据所述通道建立请求向所述服务器发送通道建立指令;所述服务器用于根据所述通道建立指令建立所述音频通道;
信息接收模块,用于接收所述服务器发送的第一音频信息,所述第一音频信息由所述观众客户端发送至所述服务器。
可选地,所述装置还包括:
控件显示模块,用于在所述直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立音频通道。
可选地,所述控件显示模块,包括:
第一显示单元,用于在所述直播频道的用户界面中,以第一显示方式显示第一音频通道控件;或者,在所述直播频道的用户界面中,不显示所述第一音 频通道控件;所述第一音频通道控件对应的音频通道为禁止建立状态;
第二显示单元,用于在所述直播频道的用户界面中,以第二显示方式显示第二音频通道控件,所述第二音频通道控件对应的音频通道为允许建立状态;
第三显示单元,用于在所述直播频道的用户界面中,以第三显示方式显示第三音频通道控件,所述第三显示方式用于指示所述第三音频通道控件对应的音频通道被占用;
第四显示单元,用于在所述直播频道的用户界面中,以第四显示方式显示第四音频通道控件,所述第四显示方式用于指示所述第四音频通道控件对应的音频通道上正在传输音频信息。
可选地,所述装置还包括:
第一接收模块,用于接收第一通道设置操作;
第一生成模块,用于根据所述第一通道设置操作指示的第一音频通道对应的通道标识和所述直播频道对应的频道标识,生成通道禁用状态通知;
第一发送模块,用于将所述通道禁用状态通知发送至所述服务器,所述服务器根据所述通道禁用状态通知确定在所述直播频道中所述第一音频通道的状态为禁止建立状态。
可选地,所述装置还包括:
第二接收模块,用于接收第二通道设置操作;
第二生成模块,用于根据所述第二通道设置操作指示的所述第一音频通道对应的通道标识和所述直播频道对应的频道标识,生成解除禁用状态通知;
第二发送模块,用于将所述解除禁用状态通知发送至所述服务器,所述服务器根据所述解除禁用状态通知确定在所述直播频道中所述第一音频通道的状态为允许建立状态。
第七方面,提供了一种直播频道中的通信系统,所述系统包括:观众客户端和管理客户端;
所述观众客户端为第四方面提供的装置;
所述服务器为第五方面提供的装置;
所述管理客户端为第六方面的装置。
第八方面,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,当其在观众客户端上运行时,使得观众客户端执行上述第一方面所提供的直播频道中的通信方法。
第九方面,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,当其在服务器上运行时,使得服务器执行上述第二方面所提供的直播频道中的通信方法。
第十方面,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,当其在主播客户端上运行时,使得主播客户端执行上述第三方面所提供的直播频道中的通信方法。
本发明实施例提供的技术方案带来的有益效果包括:
通过在观众客户端的直播频道的用户界面中,显示音频通道控件;接收作用于音频通道控件上的触发操作;根据该触发操作生成频道建立请求,将该频道建立请求发送至服务器;由服务器根据该频道建立请求建立与该观众客户端之间的音频通道,解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。
附图说明
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明一个实施例提供的网络直播系统的结构示意图;
图2是本发明一个实施例提供的直播频道中的通信方法的流程图;
图3是本发明一个实施例提供的直播频道的示意图;
图4是本发明一个实施例提供的直播频道的示意图;
图5是本发明一个实施例提供的直播频道的示意图;
图6是本发明另一个实施例提供的直播频道中的通信方法的流程图;
图7是本发明一个实施例提供的设置音频通道的示意图;
图8是本发明一个实施例提供的设置音频通道的示意图;
图9是本发明另一个实施例提供的直播频道中的通信方法的流程图;
图10是本发明一个实施例提供的设置音频通道的示意图;
图11是本发明一个实施例提供的直播频道的示意图;
图12是本发明一个实施例提供的直播频道的示意图;
图13是本发明一个实施例提供的直播频道的示意图;
图14是本发明一个实施例提供的直播频道的示意图;
图15是本发明一个实施例提供的直播频道中的通信装置的框图;
图16是本发明另一个实施例提供的直播频道中的通信装置的框图;
图17是本发明一个实施例提供的直播频道中的通信装置的框图;
图18是本发明另一个实施例提供的直播频道中的通信装置的框图;
图19是本发明一个实施例提供的直播频道中的通信装置的框图;
图20是本发明另一个实施例提供的直播频道中的通信装置的框图;
图21是本发明一个实施例提供的终端的结构示意图;
图22是本发明一个实施例提供的服务器的结构示意图。
具体实施方式
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。
首先,对本申请提及的若干个名词进行介绍。
直播客户端:直播客户端是指用于进行网络直播的应用程序。直播客户端包括主播客户端和观众客户端。主播客户端用于提供直播频道中的直播画面流,此时,主播客户端登录有主播标识;观众客户端用于播放该直播画面流,此时,观众客户端登录有观众标识。
其中,主播标识为主播的用户名称、手机号、身份证号、服务器分配的字符串等;观众标识为观众的用户名称、手机号、身份证号、服务器分配的字符串等,本实施例对此不作限定。
直播频道(或称,直播间,房间等):是指一个通信集合,每个直播频道对应的通信集合对应有一个频道标识。每个直播频道对应的通信集合中包括主播标识和观众标识。通常,主播标识的数量为一个,观众标识的数量为至少一个。
可选地,主播客户端还用于提供直播频道对应的直播音频流,相应地,观众标识对应的观众客户端用于播放该直播音频流。
其中,主播客户端提供直播画面流和/或直播音频流时,通过主播客户端与服务器之间的上行通道,向服务器发送该供直播画面流和/或直播音频流。其中,用于传输直播画面流的第一上行通道和用于传输直播音频流的第二上行通道是不同的上行通道。
其中,观众客户端从服务器获取直播画面流和/或直播音频流时,通过观众客户端与服务器之间的下行通道,从服务器获取该供直播画面流和/或直播音频流。用于传输直播画面流的第一下行通道和用于传输直播音频流的第二下行通道是不同的下行通道。
上行通道是指客户端向服务器发送流媒体数据的通道;下行通道是指服务器向客户端发送流媒体数据的通道。其中,客户端包括主播客户端和观众客户端。
其中,流媒体数据为直播画面流和/或直播音频流。
可选地,当主播客户端既提供直播画面流,又提供直播音频流时,为了保证主播客户端在同一时刻采集到的直播画面流和直播音频流,能够在观众客户端的同一时刻播放,该直播画面流和直播音频流中还设置有时间戳,该时间戳用于指示直播画面流和直播音频流的采集时间。
请参考图1,其示出了本发明一个实施例提供的网络直播系统的结构示意图。该网络直播系统包括第一终端110、第二终端120和服务器130。
第一终端110和第二终端120包括手机、平板电脑、膝上型便携计算机和台式计算机等,本实施例对此不作限定。
可选地,第一终端110安装有主播客户端111。
主播客户端111调用第一终端110中安装的图像采集组件,并通过该图像采集组件采集直播画面流,将该直播画面流发送至服务器130。此时,示意性地,图像采集组件为摄像头组件。
可选地,直播画面流为主播客户端111通过图像采集组件采集到的本端的用户界面。比如:主播客户端111通过图像采集组件采集本端的游戏画面流。
主播客户端111调用第一终端110中安装的音频采集组件,并通过该音频采集组件采集直播音频流,将该直播音频流发送至服务器130。可选地,音频 采集组件为麦克风组件。
主播客户端111在发送直播画面流和直播音频流时,分别通过不同的传输通道传输。
第一终端110通过无线网络方式或者有线网络方式与服务器130建立通信连接。
服务器130用于提供网络直播的后台服务。
可选地,服务器130基于CDN(Content Delivery Network,内容分发网络)来传输流媒体数据。此时,服务器130包括流媒体服务器131、直播源服务器132、至少一个内部CDN节点133和至少一个边界CDN节点134。其中,CDN节点为CDN服务器。
内部CDN节点133连接直播源服务器132与边界CDN节点134;边界CDN节点134连接内部CDN节点133与第一终端110和第二终端120。边界CDN节点134不直接访问直播源服务器132;第一终端110和第二终端120仅连接到边界CDN节点134。
流媒体服务器131与直播源服务器132连接;流媒体服务器131将流媒体数据传入直播源服务器132。
通过上述网络架构,第一终端110将流媒体数据就近传输给边界CDN节点134,然后,由直播源服务器132将该流媒体数据分发给同一直播频道内的不同用户,相应地,第二终端120就近地从边界CDN节点134获取该流媒体数据,从而提高了流媒体数据的传输效率。
可选地,服务器130还可以为至少一个包括相同的流媒体数据的服务器集群。
服务器130还用于接收主播客户端111发送的流媒体数据,并将该流媒体数据发送至第二终端120。
第二终端120通过无线网络方式或者有线网络方式与服务器130建立通信连接。
第二终端120安装有观众客户端121。观众客户端121播放主播客户端111上传的流媒体数据,比如:播放主播客户端111上传的直播画面流和直播音频流。其中,主播客户端111与观众客户端121处于同一直播频道。
可选地,观众客户端121调用第二终端120中安装的音频采集组件,并通过该音频采集组件采集第一音频信息,将该第一音频信息发送至服务器130。
可选地,观众客户端121通过观众客户端121与服务器130之间的上行通道,将第一音频信息发送至服务器130。相应地,服务器130通过与同一直播频道中的各个客户端之间的下行通道,将该第一音频信息分发至属于该直播频道的至少一个客户端。
可选地,上述的无线网络或有线网络使用标准通信技术和/或协议。网络通常为因特网、但也可以是任何网络,包括但不限于局域网(Local Area Network,LAN)、城域网(Metropolitan Area Network,MAN)、广域网(Wide Area Network,WAN)、移动、有线或者无线网络、专用网络或者虚拟专用网络的任何组合)。在一些实施例中,使用包括超文本标记语言(HyperText Mark-up Language,HTML)、可扩展标记语言(Extensible Markup Language,XML)等的技术和/或格式来代表通过网络交换的数据。此外还可以使用诸如安全套接字层(Secure Socket Layer,SSL)、传输层安全(Trassport Layer Security,TLS)、虚拟专用网络(Virtual Private Network,VPN)、网际协议安全(Internet Protocol Security,IPsec)等常规加密技术来加密所有或者一些链路。在另一些实施例中,还可以使用定制和/或专用数据通信技术取代或者补充上述数据通信技术。
可选地,本实施例仅以第一终端110的个数为一个,第二终端120的个数为两个为例进行说明,在实际实现时,第一终端110的数量可以为至少一个,第二终端120的数量也可以为至少一个,本实施例对此不作限定。
请参考图2,其示出了本发明一个实施例提供的直播频道中的通信方法的流程图。该通信方法用于图1所示的网络直播系统中,该方法可以包括以下几个步骤:
步骤201,观众客户端在直播频道的用户界面中显示至少一个音频通道控件。
观众客户端在前台运行时,显示有至少一个直播频道,观众从该至少一个直播频道中,选择一个感兴趣的直播频道来观看直播。
相应地,观众客户端接收频道选择操作,根据该频道选择操作生成频道选择指令,将该频道选择指令发送给服务器,该频道选择指令包括直播频道的频道标识;服务器根据该频道选择指令将与该频道标识对应的流媒体数据发送至观众客户端。此时,观众客户端进入该直播频道,并在该直播频道的用户界面中显示该流媒体数据中的直播画面流。
其中,服务器中存储有频道标识与主播标识之间的对应关系。频道标识用于标识不同的直播频道,该频道标识为服务器分配的字符串,比如:频道标识为101;或者,频道标识为主播的主播标识,本实施例对此不作限定。
观众客户端进入直播频道后,在该直播频道的用户界面中显示至少一个音频通道控件,每个音频通道控件用于触发观众客户端与服务器之间建立一条音频通道。观众客户端通过该音频通道来传输音频信息,实现了与直播频道中的其它客户端进行语音通信,提高了通信效率。
其中,音频通道控件的个数为预设个数,本实施例不对该预设个数的数值作限定,示意性地,音频通道控件的个数为8个。
每个音频通道控件用于指示一条音频通道,且不同的音频通道控件对应有不同的通道标识。每个通道标识用于指示一条音频通道,通道标识可以为数字、字母等构成的字符串,本实施例对此不作限定。示意性地,通道标识为1、2、3等。
可选地,终端在显示音频通道控件时,同时显示该音频通道控件对应的音频通道的通道标识。
可选地,音频通道控件位于直播频道中的直播画面的左上角;或者,音频通道控件位于直播频道中的直播画面的左下角;或者,音频通道控件位于直播频道的右上角,本实施例不对音频通道控件的显示位置作限定。
当然,音频通道控件还可以实现为终端上设置的物理按键,本实施例对此不作限定。
参考图3,观众客户端进入直播频道301后,在用户界面中显示直播画面302,在直播画面302中显示有8个音频通道控件303,在每个音频通道控件的上方显示有该音频通道控件对应的音频通道的通道标识304。
可选地,终端在显示音频通道控件时,可以在同一显示界面中显示部分音频通道控件,当接收到用户触发的翻页操作时,在该显示界面中显示剩余部分的音频通道控件。
可选地,终端在直播频道中显示音频通道控件之前,显示通道管理选项,该通道管理选项被触发时,用于显示至少一个音频通道控件。
可选地,通道管理选项位于直播频道中的直播画面的左上角;或者,通道管理选项位于直播频道中的直播画面的左下角;或者,通道管理选项位于直播频道的右上角,本实施例不对通道管理选项的显示位置作限定。
参考图4,观众客户端进入直播频道301后,在用户界面中显示直播画面302,在直播画面302中显示有通道管理选项401。观众客户端接收到作用于通道管理选项401上的操作后,显示8个音频通道控件303,在每个音频通道控件的上方显示有该音频通道控件对应的音频通道的通道标识304。
步骤202,观众客户端接收作用于目标音频通道控件上的触发操作。
观众需要与直播频道中的主播进行通信时,在观众客户端目标音频通道控件上执行触发操作。
目标音频通道控件是用户界面中显示的至少一个音频通道控件中的一个。
触发操作用于请求建立与目标音频通道控件对应的音频通道。可选地,触发操作为点击操作、长按操作、滑动操作和语音控制操作中的至少一种,本实施例对此不作限定。
可选地,观众客户端接收到触发操作后,根据该触发操作生成通道建立请求,该通道建立请求用于请求服务器建立与观众客户端之间的音频通道。
可选地,通道建立请求包括频道标识、通道标识和观众标识。
步骤203,观众客户端将通道建立请求发送至服务器。
观众客户端通过将通道建立请求发送至服务器,使得服务器可以建立观众客户端与服务器之间的音频通道,这样,观众客户端能够将采集到的音频信息发送至属于同一直播频道中的其他客户端(包括主播客户端和其它观众客户端),无需观众手动输入通信信息,即可实现在直播频道中观众与其他用户之间的通信,提高了直播频道中,观众与其他用户之间的通信效率。
步骤204,服务器接收观众客户端发送的通道建立请求。
步骤205,服务器将通道建立请求发送至管理客户端。
管理客户端为主播客户端或者被授予管理权限的观众客户端。在同一直播频道中,管理客户端的数量为至少一个。管理权限是指对直播频道中的用户进行管理的权限,比如:删除用户、允许用户发言、禁止用户发言的权限。
本实施例中,管理客户端可以对请求建立音频通道的观众客户端进行限制,不会使得所有的观众客户端都能建立音频通道。
其中,服务器将通道建立请求发送至管理客户端,包括:服务器根据通道建立请求中的频道标识,确定该频道标识对应的管理客户端;向该管理客户端发送通道建立请求。
可选地,服务器向管理客户端发送通道建立请求时,不携带频道标识。
可选地,服务器接收到通道建立请求后,直接建立观众标识对应的观众客户端与服务器之间的音频通道,不需要向管理客户端发送该通道建立请求。
步骤206,管理客户端在直播频道中接收服务器发送的通道建立请求。
步骤207,管理客户端根据通道建立请求向服务器发送通道建立指令。
管理客户端根据通道建立请求向服务器发送通道建立指令,包括:获取通道建立请求中的通道标识;根据该通道标识生成询问信息,该询问信息用于询问管理用户是否允许建立通道标识对应的音频通道;输出该询问信息;若接收到通道建立操作,则生成通道建立指令,并将该通道建立指令发送至服务器;若接收到禁止建立操作,则生成禁止建立指令,并将该禁止建立指令发送至服务器。若管理客户端向服务器发送了禁止建立指令,则服务器禁止建立通道标识对应的音频通道,流程结束;或者,服务器禁止建立通道标识对应的音频通道,并向观众客户端发送禁止建立信息,以通知观众该通道标识对应的音频通道已被禁止建立。
其中,通道建立指令用于指示服务器建立通道标识对应的音频通道;禁止建立指令用于指示服务器禁止建立通道标识对应的音频通道。通道建立指令和禁止建立指令均包括通道标识和频道标识。
通道建立操作为点击操作、长按操作、滑动操作和语音控制操作等,本实施例对此不作限定。
禁止建立操作为点击操作、长按操作、滑动操作和语音控制操作等,本实施例对此不作限定。
可选地,管理客户端生成的询问信息包括观众标识,这样,使用管理客户端的用户可以获知是哪一个观众发送了通道建立请求。
参考图5,管理客户端接收到通道建立请求后,生成并显示询问信息501,询问信息501包括观众标识和通道标识。管理客户端接收到作用于建立选项502上的通道建立操作,生成通道建立指令,并将该通道建立指令发送至服务器。
步骤208,服务器接收管理客户端发送的通道建立指令。
步骤209,服务器建立与观众客户端之间的音频通道。
服务器根据通道建立指令建立与观众客户端之间的音频通道,该音频通道与通道建立指令中的通道标识相对应。
可选地,服务器建立音频通道之后,向观众客户端发送建立成功信息,该 建立成功信息用于通知观众客户端音频通道已建立成功。
步骤210,观众客户端在音频通道建立成功后,采集第一音频信息。
在一种实现方式中,观众客户端在音频通道建立成功后,直接调用音频采集组件采集第一音频信息。
在另一种实现方式中,观众客户端在音频通道建立成功后,若接收到音频采集操作,则调用音频采集组件采集第一音频信息。
其中,音频采集操作为作用于直播频道的用户界面中的点击操作、长按操作、滑动操作和语音输入操作;或者,该音频采集操作为作用于第二终端中设置的物理按键上的操作,本实施例对此不作限定。
可选地,观众客户端将采集到的音频信号直接作为第一音频信息;或者,观众客户端将采集到的音频信号进行回声消除处理后,得到第一音频信息。
其中,观众客户端将采集到的音频信号进行回声消除处理后,得到第一音频信息,包括:在音频通道建立成功后,根据接收到的音频采集操作采集音频信号;将该音频信号与接收到的服务器发送的第二音频信息进行比较,其中,接收第二音频信息的时刻位于采集音频信号的时刻之前;通过回声消除算法消除音频信号中与第二音频信息相同的信息,得到第一音频信息。
由于在直播频道中,观众客户端会接收到服务器发送的第二音频信息,并实时播放该第二音频信息,若观众客户端采集的音频信号中包括该第二音频信息,就会导致第二音频信息在直播频道中的各个客户端中循环传递,产生回声,音频信息的播放效果较差。本实施例中,通过回声消除算法消除音频信号中的第二音频信息,消除了由于观众客户端重复采集第二音频信息导致的回声,提高了音频信息的播放效果。
其中,第二音频信息包括主播客户端发送的音频信息,和/或,其他观众客户端发送的音频信息。其他观众客户端是指同一直播频道中,除获取第一音频信息的观众客户端之外的观众客户端。
可选地,回声消除算法为用户自行开发的一段代码,或者,通过speex(一套针对语音的音频压缩格式)来实现,或者,通过其他厂商提供的程序来实现,本实施例对此不作限定。
步骤211,观众客户端通过音频通道向服务器发送第一音频信息。
步骤212,服务器接收观众客户端发送的第一音频信息。
步骤213,服务器将第一音频信息分发至属于同一直播频道的至少一个其 它客户端。
可选地,服务器将第一音频信息分发至与观众客户端属于同一直播频道的部分其它客户端,该部分其它客户端为该观众客户端指定的客户端;或者,服务器将第一音频信息分发至与该观众客户端属于同一直播频道的所有其它客户端。
可选地,若服务器接收到主播客户端发送的直播画面流和直播音频流,则将这些信息一起发送至其他观众客户端。
步骤214,管理客户端接收服务器发送的第一音频信息。
可选地,若服务器将第一音频信息发送至同一直播频道中的所有其它客户端,则各个其它客户端均能接收到该第一音频信息。
综上所述,本实施例提供的直播频道中的通信方法,通过在观众客户端的直播频道的用户界面中,显示音频通道控件;接收作用于音频通道控件上的触发操作;根据该触发操作生成频道建立请求,将该频道建立请求发送至服务器;由服务器根据该频道建立请求建立与该观众客户端之间的音频通道,解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。
另外,通过由服务器将通道建立请求发送至管理客户端,由管理客户端来确定是否建立音频通道,使得服务器不必为每个发送通道建立请求的观众客户端都建立音频通道,减少了服务器建立音频通道的负担。
可选地,步骤201至203、210和211可单独实现为观众客户端侧的方法实施例;步骤204、205、208、209、212、213可单独实现为服务器侧的方法实施例;步骤206、207、214可单独实现为管理客户端侧的方法实施例,本实施例对此不作限定。
可选地,基于图2所示的实施例,管理客户端设置直播频道中各个音频通道控件所对应的音频通道的使用权限。
请参考图6,其示出了本发明另一个实施例提供的直播频道中的通信方法的流程图。该通信方法用于图1所示的网络直播系统中,该方法可以包括以下几个步骤:
步骤601,管理客户端接收第一通道设置操作。
第一通道设置操作用于将第一音频通道的状态设置为禁止建立状态。其中,第一音频通道为用于传输音频信息的多条上行通道中的一条。
其中,音频通道的状态包括禁止建立状态和允许建立状态。禁止建立状态是指禁止服务器根据通道建立请求建立该音频通道;允许建立状态是指允许服务器根据通道建立请求建立该音频通道。
第一通道设置操作为点击操作、长按操作、滑动操作和语音控制操作等,本实施例对此不作限定。
可选地,管理客户端为主播客户端时,主播客户端在创建直播频道时接收第一通道设置操作;或者,主播客户端在创建直播频道之后,且在第一音频通道被建立之前接收第一通道设置操作;或者,主播客户端在第一音频通道被建立之后,接收第一通道设置操作,本实施例不对主播客户端接收第一通道设置操作的时机作限定。
可选地,管理客户端为观众客户端时,观众客户端在创建直播频道之后,且在第一音频通道被建立之前接收第一通道设置操作;或者,管理客户端在第一音频通道被建立之后,接收第一通道设置操作,本实施例不对管理客户端接收第一通道设置操作的时机作限定。
参考图7,主播客户端在创建直播频道时,显示各个音频通道的设置信息701,该设置信息701用于提示主播是否允许对应的音频通道被建立,主播客户端接收作用于该设置信息701上的第一通道设置操作,该设置信息701对应的音频通道702被禁止建立。
可选地,管理客户端的直播频道的用户界面中显示至少一个音频通道控件。当管理客户端为主播客户端时,管理客户端通过接收作用于第一音频通道控件上的第一通道设置操作来设置第一音频通道的状态。第一音频通道控件为至少一个音频通道控件中的一个。
其中,主播客户端显示的至少一个音频通道控件与观众客户端显示的至少一个音频通道控件相同。
参考图8,主播客户端显示8个音频通道控件,主播客户端接收作用于该第一个音频通道控件801上的第一通道设置操作,该第一个音频通道控件801对应的第一音频通道被禁止建立。
可选地,管理客户端在接收到作用于音频通道控件上的第一通道设置操作时,在直播频道的用户界面中,以第一显示方式显示第一音频通道控件;或者, 在直播频道的用户界面中,不显示第一音频通道控件。
可选地,管理客户端在直播频道的用户界面中,以第二显示方式显示第二音频通道控件,第二音频通道控件对应的音频通道为允许建立状态。
其中,第一显示方式用于指示第一音频通道控件对应的音频通道为禁止建立状态。第二显示方式用于指示第二音频通道控件对应的音频通道为允许建立状态。
可选地,第一显示方式与第二显示方式不同。本实施例不对第一显示方式和第二显示方式作限定,示意性地,第一显示方式为以第一默认图像显示,第二显示方式为以第二默认图像显示。
参考图8,主播客户端接收到作用于第一个音频通道控件801上的第一通道设置操作,则在主播客户端的直播频道中,以第一默认图像802显示第一个音频通道控件801,以第二默认图像803显示剩下的几个音频通道控件。
步骤602,管理客户端根据第一通道设置操作指示的第一音频通道生成通道禁用状态通知。
通道禁用状态通知包括第一音频通道对应的通道标识和直播频道对应的频道标识。通道禁用状态通知用于通知服务器在频道标识对应的直播频道中,通道标识对应的第一音频通道的状态为禁止建立状态。
步骤603,管理客户端将通道禁用状态通知发送至服务器。
步骤604,服务器接收通道禁用状态通知。
服务器接收到通道禁用状态通知后,将频道标识对应的直播频道中,通道标识对应的第一音频通道的状态设置为禁止建立状态。
可选地,服务器将第一音频通道的状态设置为禁止建立状态的方式为:将第一音频通道的状态标识修改为禁止建立状态对应的状态标识。
本实施例不对状态标识的表示方式作限定,示意性地,该状态标识中禁止建立状态对应的状态标识用1来表示,该状态标识中允许建立状态对应的状态标识用0来表示。
步骤605,服务器将通道禁用状态通知发送至观众客户端。
步骤606,观众客户端接收服务器发送的通道禁用状态通知。
步骤607,观众客户端以第一显示方式显示第一音频通道控件,以第二显示方式显示第二音频通道控件;或者,不显示第一音频通道控件,以第二显示方式显示第二音频通道控件。
由于第一音频通道控件对应的第一音频通道已被管理客户端禁止建立,因此,为了提示观众第一音频通道无法建立,观众客户端以第一显示方式显示第一音频通道控件,或者,不显示第一音频通道控件。
可选地,为了保证观众客户端与管理客户端之间的同步,当管理客户端以第一显示方式显示第一音频通道选项时,观众客户端也以第一显示方式显示第一音频通道选项;当管理客户端不显示第一音频通道选项时,观众客户端也不显示第一音频通道选项。
可选地,同一直播频道中的其他客户端,与上述管理客户端和观众客户端显示第一音频通道控件和第二音频通道控件的方式相同,即,以第一显示方式显示第一音频通道控件,以第二显示方式显示第二音频通道控件;或者,不显示第一音频通道控件,以第二显示方式显示第二音频通道控件。
综上所述,本实施例提供的直播频道中的通信方法,通过由管理客户端来管理各个音频通道,使得服务器不必建立所有的音频通道,减少了服务器建立音频通道的负担。
可选地,步骤601至603可单独实现为管理客户端侧的方法实施例;步骤604和605可单独实现为服务器侧的方法实施例;步骤606和607可单独实现为观众客户端侧的方法实施例,本实施例对此不作限定。
可选地,基于图6所述的实施例,管理客户端设置了禁用的音频通道之后,还能够恢复该音频通道被建立的权限。
请参考图9,其示出了本发明另一个实施例提供的直播频道中的通信方法的流程图。该通信方法用于图1所示的网络直播系统中,在步骤703之后,该方法可以包括以下几个步骤:
步骤901,管理客户端接收第二通道设置操作。
第二通道设置操作用于将第一音频通道的状态从禁止建立状态切换为允许就建立状态。第二通道设置操作为点击操作、长按操作、滑动操作和语音控制操作等,本实施例对此不作限定。
可选地,管理客户端在接收到第一通道设置操作之后,接收第二通道设置操作;或者,在接收到第一通道请求之后,接收第二通道设置操作,本实施例不对管理客户端接收第二通道设置操作的时机作限定。
参考图10,管理客户端在直播频道的用户界面中,以第一默认图像1001 显示第一个音频通道控件1002,以第二默认图像1002显示剩下的几个音频通道控件,管理客户端接收作用于第一个音频通道控件1002上的第二通道设置操作,并以第二默认图像1002显示第一个音频通道控件1002。
步骤902,管理客户端根据第二通道设置操作指示的第一音频通道生成解除禁用状态通知。
解除禁用状态通知包括第一音频通道的通道标识和频道标识,该解除禁用状态通知用于通知服务器在频道标识对应的直播频道中第一音频通道的状态为允许建立状态。
步骤903,管理客户端将解除禁用状态通知发送至服务器。
步骤904,服务器接收解除禁用状态通知。
服务器接收到解除禁用状态通知后,将频道标识对应的直播频道中,通道标识对应的第一音频通道的状态从禁止建立状态修改为允许建立状态。
可选地,服务器将第一音频通道的状态从禁止建立状态修改为允许建立状态的方式为:将第一音频通道的状态标识从禁止建立状态对应的状态标识,修改为允许建立状态对应的状态标识。示意性地,将将第一音频通道的状态标识从1修改为0。
步骤905,服务器将解除禁用状态通知发送至观众客户端。
步骤906,观众客户端接收服务器发送的解除禁用状态通知。
步骤907,观众客户端以第二显示方式显示第一音频通道控件和第二音频通道控件。
此时,第一音频通道控件对应的第一音频通道被允许建立,因此,第一音频通道控件和第二音频通道控件的显示方式相同,均为第二显示方式。
综上所述,本实施例提供的直播频道中的通信方法,通过由管理客户端恢复第一音频通道允许被建立的权限,使得管理用户可以灵活地恢复被禁止建立的音频通道,提高了设置音频通道的灵活性。
可选地,步骤901至903可单独实现为管理客户端侧的方法实施例;步骤904和905可单独实现为服务器侧的方法实施例;步骤906和907可单独实现为观众客户端侧的方法实施例,本实施例对此不作限定。
可选地,基于上述各个实施例,在步骤209之后,若观众客户端与服务器之间的音频通道建立成功,则在该观众客户端中以第三显示方式显示目标音频 通道控。
可选地,为了使得同一直播频道中的各个客户端,能够获知哪一条音频通道被占用,服务器将通道建立请求中的通道标识分发至属于该直播频道的所有客户端;各个客户端接收到该通道标识后,通过第三显示方式显示通道标识对应的音频通道控件,以提示用户该音频通道控件对应的音频通道被占用。
可选地,第三显示方式包括但不限于以下几种:以预设颜色显示、以预设尺寸显示、以占用音频通道的观众标识对应的头像图标显示、以预设图片显示。当然,第三显示方式还包括其他形式,本实施例在此不再一一列举。
本实施例中,以第三显示方式为占用音频通道的观众标识对应的头像图标显示为例进行说明。在这种情况下,服务器接收到通道建立请求后,还需要在预先存储的用户信息中查找与通道建立请求中的观众标识对应的头像图标,并向同一直播频道中的各个客户端发送该头像图标,各个客户端接收到该头像图标后,将频道标识对应的音频通道控件的默认图标修改为该头像图标。
其中,用户信息是观众标识对应的信息,用户信息包括:头像图标、身份证号码、用户名称、用户好友、服务器分配的用户标识、用户权限等,本实施例对此不作限定。
可选地,默认图标与第二默认图像相同。
参考图11,观众客户端发送的通道建立请求包括的通道标识为“1”,服务器将该通道标识“1”发送至直播频道中的各个客户端,在各个客户端的直播频道的用户界面中,音频通道控件1101由默认图标1102修改为观众标识对应的头像图标1103。
可选地,上述的各个客户端包括直播频道中的管理客户端。
可选地,基于上述各个实施例,在步骤211中,观众客户端在通过音频通道向服务器发送第一音频信息时,还会以第四显示方式显示目标音频通道控件。
可选地,观众客户端在接收到服务器发送的第二音频信息时,以第四显示方式显示该第二音频信息对应的第四音频通道控件,该第二音频信息由其它观众客户端发送至服务器。其中,第四音频通道控件为至少一个音频通道控件中的音频通道控件。
可选地,第四音频通道控件包括该目标音频通道控件,第四音频通道控件 的数量是根据正在传输音频信息的音频通道的数量确定的。
可选地,观众客户端将第一音频信息发送至服务器时,还会向服务器发送通道标识;服务器将该通道标识发送给同一频道中的其他客户端;各个客户端以第四显示方式显示通道标识对应的音频通道控件。
其中,第四显示方式用于指示第四音频通道控件对应的音频通道上正在传输音频信息。本实施例不对第四显示方式作限定,示意性地,第四显示方式为放大显示音频通道控件。这样,同一直播频道中的各个用户通过以第四显示方式显示的音频通道控件,可以获知该音频通道控件对应的观众客户端正在发言。
参考图12,观众客户端在直播频道中,显示各个音频通道控件,当该观众客户端通过音频通道控件1201建立与服务器之间的音频通道时,若该观众客户端获取到第一音频信息,则该音频通道控件1201被放大显示。
可选地,基于上述各个实施例,在步骤210之后,观众客户端接收停止采集操作;根据该停止采集操作停止采集第一音频信息。
参考图13,观众客户端在直播频道中,显示各个音频通道控件,观众客户端通过音频通道控件1301建立与服务器之间的音频通道之后,若观众客户端接收到作用于音频通道控件1301上的操作,则显示音频采集选项1302,接收作用于该音频采集选项1302上的音频采集操作,则观众客户端开始采集第一音频信息。然后,若观众客户端接收到作用于音频通道控件1301上的操作,则显示停止采集选项1303,接收作用于该停止采集选项1303上的停止采集操作,则观众客户端停止采集第一音频信息音。
可选地,基于上述各个实施例,在步骤209之后,观众客户端接收断开操作;根据该断开操作生成通道断开指令;将通道断开指令发送至服务器;服务器根据通道断开指令断开与该观众客户端之间的音频通道。
可选地,观众客户端在接收到断开操作时,以第二显示方式显示目标音频通道控件。
其中,断开操作为作用于直播频道的用户界面上的点击、长按、滑动等操作;或者,断开操作为作用于预设物理按键上的操作;或者,断开操作为语音输入操作,本实施例不对断开操作作限定。
可选地,通道断开指令包括频道标识和通道标识,服务器将频道标识对应的直播频道中,通道标识对应的音频通道断开。
可选地,服务器将通道断开指令中的通道标识发送给同一直播频道中其他客户端,各个客户端均以第二显示方式显示该通道标识对应的音频通道控件,以使得该直播频道中的各个用户获知该通道标识对应的音频通道已断开。
参考图14,观众客户端在直播频道中,显示各个音频通道控件,观众客户端通过音频通道控件1401建立与服务器之间的音频通道之后,若该观众客户端接收到作用于音频通道控件1401上的操作,则显示通道断开选项1402,接收作用于通道断开选项1402上通道断开操作,则观众客户端生成通道断开指令。音频通道控件1401对应的音频通道断开后,显示图3所示的显示界面。
可选地,基于上述各个实施例,当观众客户端在后台运行时,禁止从服务器获取直播画面,这样,可以节省观众客户端占用的资源。
需要补充说明的是,在同一客户端的直播频道的用户界面中,可以同时以至少两种显示方式显示音频通道控件,比如:在直播频道的用户界面中,以第一显示方式显示标识“1”对应的音频通道控件,且以第二显示方式显示标识“2”对应的音频通道控件,且以第三显示方式显示标识“3”对应的音频通道控件,且以第四显示方式显示剩余的音频通道控件。
下面以观众客户端在直播频道中观看主播直播游戏为例进行说明。
主播创建直播频道后,通过该直播频道直播游戏,即,将游戏画面和游戏音频发送至服务器,由服务器发送至该直播频道中的各个观众对应的观众客户端。
若观众与该直播频道中的其他用户进行语音通信,则点击该直播频道中的音频通道控件,观众客户端根据点击操作生成通道建立请求,并将该通道建立请求发送至服务器;服务器将该通道建立请求发送至管理客户端;管理客户端根据通道建立请求中的通道标识和/或观众客户端的用户信息生成通道建立指令;将该通道建立指令发送至服务器;服务器建立该通道建立指令中通道标识对应的音频通道。
另外,观众客户端通过建立的音频通道发送第一音频信息,这样,观众可以通过该音频通道与直播频道中的其他用户进行语音通信,实现指导主播玩游戏,或者,和其他观众讨论游戏的功能。
另外,观众通过与主播进行语音通信,使得观众可以获知主播玩游戏的地址,从而参与主播的游戏,实现了陌生人之间共同参与游戏的功能。
另外,观众客户端在后台运行时,禁止从服务器获取直播画面,节省了观众客户端占用的终端的资源,提高了其他应用程序的运行速度。
另外,观众客户端在后台运行时,仅运行与获取第一音频信息、传输第一音频信息和接收第二音频信息的相关进程,禁止该观众客户端的其他进程运行,节省了观众客户端占用的终端的资源,提高了其他应用程序的运行速度。
另外,通过在直播游戏的过程中,观众客户端不采集观众的图像信息,节省了服务器传输图像信息消耗的资源,从而节省了服务器的传输压力。
通过上述方式,在直播游戏的过程中,将直播的延迟控制在了500ms之内,提高了直播效果。
下述为本发明装置实施例,可以用于执行本发明方法实施例。对于本发明装置实施例中未披露的细节,请参照本发明方法实施例。
请参考图15,其示出了本发明一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。该装置可以包括:第一显示模块1510、第一接收模块1520、采集模块1530和发送模块1540。
第一显示模块1510,用于在直播频道的用户界面中显示至少一个音频通道控件,音频通道控件用于触发观众客户端与服务器之间建立一条音频通道;
第一接收模块1520,用于接收作用于目标音频通道控件上的触发操作,触发操作用于请求建立与目标音频通道控件对应的音频通道,目标音频通道控件是至少一个音频通道控件中的一个;
采集模块1530,用于在音频通道建立成功后,采集第一音频信息;
发送模块1540,用于通过音频通道向服务器发送第一音频信息,服务器用于将第一音频信息分发至属于直播频道的至少一个其它客户端;
其中,直播频道对应的通信集合中包括主播标识和观众标识,主播标识对应的主播客户端用于提供直播频道对应的直播画面流。
综上所述,本实施例提供的直播频道中的通信装置,通过在观众客户端的直播频道的用户界面中,显示音频通道控件;接收作用于音频通道控件上的触发操作;根据该触发操作生成频道建立请求,将该频道建立请求发送至服务器; 由服务器根据该频道建立请求建立与该观众客户端之间的音频通道,解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。
基于图15所示的实施例,请参考图16,其示出了本发明另一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。
第一显示模块1510,包括:第一显示单元1511和第二显示单元1512。
第一显示单元1511,用于在直播频道的用户界面中,以第一显示方式显示第一音频通道控件,第一音频通道控件对应的第一音频通道为禁止建立状态;且以第二显示方式显示第二音频通道控件,第二音频通道控件对应的第二音频通道为允许建立状态;
第二显示单元1512,用于在直播频道的用户界面中,不显示第一音频通道控件;且以第二显示方式显示第二音频通道控件;
其中,第一显示方式与第二显示方式不同。
可选地,该装置还包括:第二显示模块1550。
第二显示模块1550,用于在直播频道的用户界面中,以第三显示方式显示目标音频通道控件,第三显示方式用于指示目标音频通道控件对应的音频通道被占用。
可选地,该装置还包括:第二接收模块1560和第三显示模块1570。
第二接收模块1560,用于接收断开操作,断开操作用于断开目标音频通道控件对应的音频通道;
第三显示模块1570,用于以第二显示方式显示目标音频通道控件,第二显示方式用于指示目标音频通道控件对应的音频通道为允许建立状态。
可选地,采集模块1530,包括:接收单元1531和第一采集单元1532。
接收单元1531,用于接收音频采集操作;
第一采集单元1532,用于根据音频采集操作开始采集第一音频信息。
可选地,该装置还包括:第三接收模块1580和停止采集模块1590。
第三接收模块1580,用于接收停止采集操作;
停止采集模块1590,用于根据停止采集操作停止采集第一音频信息。
可选地,该装置还包括:第四显示模块1591。
第四显示模块1591,用于在直播频道的用户界面中,以第四显示方式显示第四音频通道控件,第四显示方式用于指示第四音频通道控件对应的音频通道上正在传输音频信息;第四音频通道控件为至少一个音频通道控件中的音频通道控件。
可选地,采集模块1530,包括:第二采集单元1533、比较单元1534和回声消除单元1535。
第二采集单元1533,用于在音频通道建立成功后,根据接收到的音频采集操作采集音频信号;
比较单元1534,用于将音频信号与服务器发送的第二音频信息进行比较,其中,接收第二音频信息的时刻位于采集音频信号的时刻之前;
回声消除单元1535,用于通过回声消除算法消除音频信号中与第二音频信息相同的信息,得到第一音频信息。
可选地,该装置还包括:禁止获取模块1592。
禁止获取模块1592,用于当观众客户端在后台运行时,禁止从服务器获取直播画面流。
相关细节可参考图2、图7和图9所示的方法实施例。
请参考图17,其示出了本发明一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。该装置可以包括:请求接收模块1710、通道建立模块1720、信息接收模块1730和信息发送模块1740。
请求接收模块1710,用于接收观众客户端发送的通道建立请求,通道建立请求是观众客户端在接收到作用于目标音频控件上的触发操作时生成的,目标音频控件是在直播频道的用户界面中显示的至少一个音频通道控件中的一个;
通道建立模块1720,用于根据通道建立请求建立与观众客户端之间的音频通道;
信息接收模块1730,用于接收观众客户端发送的第一音频信息;
信息发送模块1740,用于将第一音频信息分发至属于直播频道的至少一个其它客户端;
其中,直播频道对应的通信集合中包括主播标识和观众标识,主播标识对 应的主播客户端用于提供直播频道对应的直播画面流。
综上所述,本实施例提供的直播频道中的通信装置,通过在观众客户端的直播频道的用户界面中,显示音频通道控件;接收作用于音频通道控件上的触发操作;根据该触发操作生成频道建立请求,将该频道建立请求发送至服务器;由服务器根据该频道建立请求建立与该观众客户端之间的音频通道,解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。
可选地,基于图17所示的实施例,参考图18,其示出了本发明另一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。
通道建立请求至少包括目标音频控件对应的通道标识、直播频道对应的频道标识和观众客户端对应的观众标识;
通道建立模块1720,包括:请求发送单元1721、指令接收单元1722和通道建立单元1723。
请求发送单元1721,用于将通道建立请求发送至属于频道标识对应的直播频道的管理客户端,管理客户端是指直播频道中具有管理权限的客户端;管理客户端确定是否允许建立通道标识对应的音频通道;并在允许建立音频通道时,向服务器发送通道建立指令;
指令接收单元1722,用于接收管理客户端发送的通道建立指令;
通道建立单元1723,用于根据通道建立指令建立与观众客户端之间的音频通道。
可选地,该装置还包括:第一接收模块1750和第一发送模块1760。
第一接收模块1750,用于第一接收模块接收通道禁用状态通知,通道禁用状态通知包括至少一个音频通道的通道标识和频道标识;通道禁用状态通知用于通知服务器在频道标识对应的直播频道中,通道标识对应的第一音频通道的状态为禁止建立状态;
第一发送模块1760,用于将通道禁用状态通知发送至观众客户端。
可选地,该装置还包括:第二接收模块1770和第二发送模块1780。
第二接收模块1770,用于接收解除禁用状态通知,解除禁用状态通知包括 第一音频通道的通道标识和频道标识;解除禁用状态通知用于通知服务器在频道标识对应的直播频道中第一音频通道的状态为允许建立状态;
第二发送模块1780,用于将解除禁用状态通知发送至观众客户端。
相关细节可参考图2、图7和图9所示的方法实施例。
请参考图19,其示出了本发明一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。该装置可以包括:请求显示模块1910、指令发送模块1920和信息接收模块1930。
请求显示模块1910,用于在直播频道的用户界面中显示服务器发送的通道建立请求,通道建立请求包括属于直播频道的观众标识,且通道建立请求用于请求建立观众标识对应的观众客户端与服务器之间的音频通道;
指令发送模块1920,用于根据通道建立请求向服务器发送通道建立指令;服务器用于根据通道建立指令建立音频通道;
信息接收模块1930,用于接收服务器发送的第一音频信息,第一音频信息由观众客户端发送至服务器。
综上所述,本实施例提供的直播频道中的通信装置,通过在观众客户端的直播频道的用户界面中,显示音频通道控件;接收作用于音频通道控件上的触发操作;根据该触发操作生成频道建立请求,将该频道建立请求发送至服务器;由服务器根据该频道建立请求建立与该观众客户端之间的音频通道,解决了观众通过文字信息与其他用户进行通信时,通信效率较低的问题;由于观众能够通过观众客户端与服务器之间的音频通道,与同一直播频道中的其他用户进行语音通信,因此,提高了观众在直播频道中的通信效率。
基于图19所示的实施例,参考图20,其示出了本发明另一个实施例提供的直播频道中的通信装置的框图。该装置具有执行上述方法示例的功能,功能可以由硬件实现,也可以由硬件执行相应的软件实现。
可选地,该装置还包括:控件显示模块1940。
控件显示模块1940,用于在直播频道的用户界面中显示至少一个音频通道控件,音频通道控件用于触发观众客户端与服务器之间建立音频通道。
可选地,控件显示模块1940,包括:第一显示单元1941、第二显示单元 1942、第三显示单元1943和第四显示单元1944。
第一显示单元1941,用于在直播频道的用户界面中,以第一显示方式显示第一音频通道控件;或者,在直播频道的用户界面中,不显示第一音频通道控件;第一音频通道控件对应的音频通道为禁止建立状态;
第二显示单元1942,用于在直播频道的用户界面中,以第二显示方式显示第二音频通道控件,第二音频通道控件对应的音频通道为允许建立状态;
第三显示单元1943,用于在直播频道的用户界面中,以第三显示方式显示第三音频通道控件,第三显示方式用于指示第三音频通道控件对应的音频通道被占用;
第四显示单元1944,用于在直播频道的用户界面中,以第四显示方式显示第四音频通道控件,第四显示方式用于指示第四音频通道控件对应的音频通道上正在传输音频信息。
可选地,该装置还包括:第一接收模块1950、第一生成模块1960和第一发送模块1970。
第一接收模块1950,用于接收第一通道设置操作;
第一生成模块1960,用于根据第一通道设置操作指示的第一音频通道对应的通道标识和直播频道对应的频道标识,生成通道禁用状态通知;
第一发送模块1970,用于将通道禁用状态通知发送至服务器,服务器根据通道禁用状态通知确定在直播频道中第一音频通道的状态为禁止建立状态。
可选地,该装置还包括:第二接收模块1980、第二生成模块1990和第二发送模块1991。
第二接收模块1980,用于接收第二通道设置操作;
第二生成模块1990,用于根据第二通道设置操作指示的第一音频通道对应的通道标识和直播频道对应的频道标识,生成解除禁用状态通知;
第二发送模块1991,用于将解除禁用状态通知发送至服务器,服务器根据解除禁用状态通知确定在直播频道中第一音频通道的状态为允许建立状态。
相关细节可参考图2、图7和图9所示的方法实施例。
需要说明的是:上述实施例提供的装置在实现其功能时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的装置与方法实施例属于同 一构思,其具体实现过程详见方法实施例,这里不再赘述。
请参考图21,其示出了本发明一个实施例提供的终端的结构示意图。该终端2100用于实施上述实施例中提供的直播频道中的通信方法。具体来讲:
终端2100可以包括RF(Radio Frequency,射频)电路2110、包括有一个或一个以上计算机可读存储介质的存储器2120、输入单元2130、显示单元2140、传感器2150、音频电路2160、WiFi(wireless fidelity,无线保真)模块2170、包括有一个或者一个以上处理核心的处理器2180、以及电源2190等部件。本领域技术人员可以理解,图21中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。其中:
RF电路2110可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,交由一个或者一个以上处理器2180处理;另外,将涉及上行的数据发送给基站。通常,RF电路2110包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(SIM)卡、收发信机、耦合器、LNA(Low Noise Amplifier,低噪声放大器)、双工器等。此外,RF电路2110还可以通过无线通信与网络和其他设备通信。无线通信可以使用任一通信标准或协议,包括但不限于GSM(Global System of Mobile communication,全球移动通讯系统)、GPRS(General Packet Radio Service,通用分组无线服务)、CDMA(Code Division Multiple Access,码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service,短消息服务)等。
存储器2120可用于存储软件程序以及模块,处理器2180通过运行存储在存储器2120的软件程序以及模块,从而执行各种功能应用以及数据处理。存储器2120可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据终端2100的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器2120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地,存储器2120还可以包括存储器控制器,以提供处理器 2180和输入单元2130对存储器2120的访问。
输入单元2130可用于接收输入的数字或字符信息,以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。具体地,输入单元2130可包括图像输入设备2131以及其他输入设备2132。图像输入设备2131可以是摄像头,也可以是光电扫描设备。除了图像输入设备2131,输入单元2130还可以包括其他输入设备2132。具体地,其他输入设备2132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元2140可用于显示由用户输入的信息或提供给用户的信息以及终端2100的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示单元2140可包括显示面板2141,可选地,可以采用LCD(Liquid Crystal Display,液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置显示面板2141。
终端2100还可包括至少一种传感器2150,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板2141的亮度,接近传感器可在终端2100移动到耳边时,关闭显示面板2141和/或背光。作为运动传感器的一种,重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于终端2100还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路2160、扬声器2161,传声器2162可提供用户与终端2100之间的音频接口。音频电路2160可将接收到的音频数据转换后的电信号,传输到扬声器2161,由扬声器2161转换为声音信号输出;另一方面,传声器2162将收集的声音信号转换为电信号,由音频电路2160接收后转换为音频数据,再将音频数据输出处理器2180处理后,经RF电路2110以发送给比如另一终端,或者将音频数据输出至存储器2120以便进一步处理。音频电路2160还可能包括耳塞插孔,以提供外设耳机与终端2100的通信。
WiFi属于短距离无线传输技术,终端2100通过WiFi模块2170可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带 互联网访问。虽然图21示出了WiFi模块2170,但是可以理解的是,其并不属于终端2100的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。
处理器2180是终端2100的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器2120内的软件程序和/或模块,以及调用存储在存储器2120内的数据,执行终端2100的各种功能和处理数据,从而对手机进行整体监控。可选地,处理器2180可包括一个或多个处理核心;优选的,处理器2180可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器2180中。
终端2100还包括给各个部件供电的电源2190(比如电池),优选的,电源可以通过电源管理系统与处理器2180逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源2190还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
尽管未示出,终端2100还可以包括蓝牙模块等,在此不再赘述。
具体在本实施例中,终端2100还包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行。上述一个或者一个以上程序包含用于执行上述方法的指令。
图22是本发明一个实施例提供的服务器的结构示意图。服务器2200包括中央处理单元(英文:Central Processing Unit,简称:CPU)2201、包括随机存取存储器(英文:random access memory,简称:RAM)2202和只读存储器(英文:read-only memory,简称:ROM)2203的系统存储器2204,以及连接系统存储器2204和中央处理单元2201的系统总线2205。所述服务器2200还包括帮助计算机内的各个器件之间传输信息的基本输入/输出系统(I/O系统)2206,和用于存储操作系统2213、应用程序2214和其他程序模块2215的大容量存储设备2207。
所述基本输入/输出系统2206包括有用于显示信息的显示器2208和用于用户输入信息的诸如鼠标、键盘之类的输入设备2209。其中所述显示器2208和 输入设备2209都通过连接到系统总线2205的输入/输出控制器2210连接到中央处理单元2201。所述基本输入/输出系统2206还可以包括输入输出控制器2210以用于接收和处理来自键盘、鼠标、或电子触控笔等多个其他设备的输入。类似地,输入/输出控制器2210还提供输出到显示屏、打印机或其他类型的输出设备。
所述大容量存储设备2207通过连接到系统总线2205的大容量存储控制器(未示出)连接到中央处理单元2201。所述大容量存储设备2207及其相关联的计算机可读介质为服务器2200提供非易失性存储。也就是说,所述大容量存储设备2207可以包括诸如硬盘或者只读光盘(英文:Compact Disc Read-Only Memory,简称:CD-ROM)驱动器之类的计算机可读介质(未示出)。
不失一般性,所述计算机可读介质可以包括计算机存储介质和通信介质。计算机存储介质包括以用于存储诸如计算机可读指令、数据结构、程序模块或其他数据等信息的任何方法或技术实现的易失性和非易失性、可移动和不可移动介质。计算机存储介质包括RAM、ROM、可擦除可编程只读存储器(英文:erasable programmable read-only memory,简称:EPROM)、电可擦除可编程只读存储器(英文:electrically erasable programmable read-only memory,简称:EEPROM)、闪存或其他固态存储其技术,CD-ROM、数字通用光盘(英文:Digital Versatile Disc,简称:DVD)或其他光学存储、磁带盒、磁带、磁盘存储或其他磁性存储设备。当然,本领域技术人员可知所述计算机存储介质不局限于上述几种。上述的系统存储器2204和大容量存储设备2207可以统称为存储器。
根据本发明的各种实施例,所述服务器2200还可以通过诸如因特网等网络连接到网络上的远程计算机运行。也即服务器2200可以通过连接在所述系统总线2205上的网络接口单元2211连接到网络2212,或者说,也可以使用网络接口单元2211来连接到其他类型的网络或远程计算机系统(未示出)。
本发明实施例还提供了一种计算机可读存储介质,该计算机可读存储介质可以是上述实施例中的存储器中所包含的计算机可读存储介质;也可以是单独存在,未装配入终端中的计算机可读存储介质。该计算机可读存储介质存储有一个或者一个以上程序,该一个或者一个以上程序被一个或者一个以上的处理器用来执行上述方法。
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。
以上仅为本发明的较佳实施例,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。

Claims (12)

  1. 一种直播频道中的通信方法,其特征在于,所述方法包括:
    在直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立一条音频通道;
    接收作用于目标音频通道控件上的触发操作,所述触发操作用于请求建立与所述目标音频通道控件对应的所述音频通道,所述目标音频通道控件是所述至少一个音频通道控件中的一个;
    在所述音频通道建立成功后,采集第一音频信息;
    通过所述音频通道向所述服务器发送所述第一音频信息,所述服务器用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
    其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
  2. 根据权利要求1所述的方法,其特征在于,所述在所述音频通道建立成功后采集第一音频信息,包括:
    接收音频采集操作;
    根据所述音频采集操作开始采集所述第一音频信息。
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述音频采集操作开始采集所述第一音频信息之后,还包括:
    接收停止采集操作;
    根据所述停止采集操作停止采集所述第一音频信息。
  4. 根据权利要求1至3任一所述的方法,其特征在于,所述在所述音频通道建立成功后采集第一音频信息,包括:
    在所述音频通道建立成功后,根据接收到的音频采集操作采集音频信号;
    将所述音频信号与所述服务器发送的第二音频信息进行比较,其中,接收所述第二音频信息的时刻位于采集所述音频信号的时刻之前;
    通过回声消除算法消除所述音频信号中与所述第二音频信息相同的信息,得到所述第一音频信息。
  5. 一种直播频道中的通信方法,其特征在于,所述方法包括:
    接收观众客户端发送的通道建立请求,所述通道建立请求是所述观众客户端在接收到作用于目标音频控件上的触发操作时生成的,所述目标音频控件是在直播频道的用户界面中显示的至少一个音频通道控件中的一个;
    根据所述通道建立请求建立与所述观众客户端之间的音频通道;
    接收所述观众客户端发送的第一音频信息;
    将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
    其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
  6. 根据权利要求5所述的方法,其特征在于,所述通道建立请求至少包括所述目标音频控件对应的通道标识、所述直播频道对应的频道标识和所述观众客户端对应的观众标识;
    所述根据所述通道建立请求建立与所述观众客户端之间的音频通道,包括:
    将所述通道建立请求发送至属于所述频道标识对应的直播频道的管理客户端,所述管理客户端是指所述直播频道中具有管理权限的客户端;所述管理客户端确定是否允许建立所述通道标识对应的音频通道;并在允许建立所述音频通道时,向服务器发送通道建立指令;
    接收所述管理客户端发送的所述通道建立指令;
    根据所述通道建立指令建立与所述观众客户端之间的所述音频通道。
  7. 一种直播频道中的通信方法,其特征在于,所述方法包括:
    在直播频道的用户界面中显示服务器发送的通道建立请求,所述通道建立请求包括属于所述直播频道的观众标识,且所述通道建立请求用于请求建立所述观众标识对应的观众客户端与所述服务器之间的音频通道;
    根据所述通道建立请求向所述服务器发送通道建立指令;所述服务器用于根据所述通道建立指令建立所述音频通道;
    接收所述服务器发送的第一音频信息,所述第一音频信息由所述观众客户端发送至所述服务器。
  8. 根据权利要求7所述的方法,其特征在于,所述方法还包括:
    在所述直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立音频通道。
  9. 一种直播频道中的通信装置,其特征在于,所述装置包括:
    第一显示模块,用于在直播频道的用户界面中显示至少一个音频通道控件,所述音频通道控件用于触发观众客户端与服务器之间建立一条音频通道;
    第一接收模块,用于接收作用于目标音频通道控件上的触发操作,所述触发操作用于请求建立与所述目标音频通道控件对应的所述音频通道,所述目标音频通道控件是所述至少一个音频通道控件中的一个;
    采集模块,用于在所述音频通道建立成功后,采集第一音频信息;
    发送模块,用于通过所述音频通道向所述服务器发送所述第一音频信息,所述服务器用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
    其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
  10. 一种直播频道中的通信装置,其特征在于,所述装置包括:
    请求接收模块,用于接收观众客户端发送的通道建立请求,所述通道建立请求是所述观众客户端在接收到作用于目标音频控件上的触发操作时生成的,所述目标音频控件是在直播频道的用户界面中显示的至少一个音频通道控件中的一个;
    通道建立模块,用于根据所述通道建立请求建立与所述观众客户端之间的音频通道;
    信息接收模块,用于接收所述观众客户端发送的第一音频信息;
    信息发送模块,用于将所述第一音频信息分发至属于所述直播频道的至少一个其它客户端;
    其中,所述直播频道对应的通信集合中包括主播标识和观众标识,所述主播标识对应的主播客户端用于提供所述直播频道对应的直播画面流。
  11. 一种直播频道中的通信装置,其特征在于,所述装置包括:
    请求显示模块,用于在直播频道的用户界面中显示服务器发送的通道建立请求,所述通道建立请求包括属于所述直播频道的观众标识,且所述通道建立请求用于请求建立所述观众标识对应的观众客户端与所述服务器之间的音频通道;
    指令发送模块,用于根据所述通道建立请求向所述服务器发送通道建立指令;所述服务器用于根据所述通道建立指令建立所述音频通道;
    信息接收模块,用于接收所述服务器发送的第一音频信息,所述第一音频信息由所述观众客户端发送至所述服务器。
  12. 一种直播频道中的通信系统,其特征在于,所述系统包括:观众客户端、服务器和管理客户端;
    所述观众客户端为权利要求9所述的装置;
    所述服务器为权利要求10所述的装置;
    所述管理客户端为权利要求11所述的装置。
PCT/CN2017/081891 2017-04-07 2017-04-25 直播频道中的通信方法、装置及系统 WO2018184266A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2020504755A JP6976410B2 (ja) 2017-04-07 2017-04-25 生中継チャンネルにおける通信方法、装置及びシステム
US16/591,881 US11153110B2 (en) 2017-04-07 2019-10-03 Communication method and terminal in live webcast channel and storage medium thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710223486.9A CN107124661B (zh) 2017-04-07 2017-04-07 直播频道中的通信方法、装置及系统
CN201710223486.9 2017-04-07

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/591,881 Continuation US11153110B2 (en) 2017-04-07 2019-10-03 Communication method and terminal in live webcast channel and storage medium thereof

Publications (1)

Publication Number Publication Date
WO2018184266A1 true WO2018184266A1 (zh) 2018-10-11

Family

ID=59724701

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/081891 WO2018184266A1 (zh) 2017-04-07 2017-04-25 直播频道中的通信方法、装置及系统

Country Status (4)

Country Link
US (1) US11153110B2 (zh)
JP (1) JP6976410B2 (zh)
CN (1) CN107124661B (zh)
WO (1) WO2018184266A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113163215A (zh) * 2020-01-22 2021-07-23 华为技术有限公司 基于云手机的直播方法和直播系统
CN113473161A (zh) * 2020-03-31 2021-10-01 腾讯科技(成都)有限公司 直播方法、装置、设备及计算机存储介质

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111355969B (zh) * 2019-02-13 2022-08-23 鸿合科技股份有限公司 一种互动直播方法及客户端、服务器、电子设备
CN110956969B (zh) * 2019-11-28 2022-06-10 北京达佳互联信息技术有限公司 直播音频处理方法、装置、电子设备和存储介质
CN112968826B (zh) * 2020-02-05 2023-08-08 北京字节跳动网络技术有限公司 语音交互方法、装置和电子设备
CN114257905B (zh) * 2020-09-23 2023-04-07 华为技术有限公司 音频处理方法、计算机可读存储介质、及电子设备
CN114513677A (zh) * 2020-11-10 2022-05-17 深圳思为科技有限公司 一种直播方法、装置、服务器以及计算机可读存储介质
CN112330996A (zh) * 2020-11-13 2021-02-05 北京安博盛赢教育科技有限责任公司 一种直播教学的控制方法、装置、介质和电子设备
CN112616068A (zh) * 2020-12-31 2021-04-06 北京达佳互联信息技术有限公司 一种任务处理方法、装置、电子设备及存储介质
CN113068054B (zh) * 2021-03-16 2023-04-07 北京卡路里信息技术有限公司 直播中的信息展示方法及信息展示装置、计算机可读存储介质
CN113162844B (zh) * 2021-04-01 2023-01-20 维沃移动通信有限公司 即时通信方法、装置、电子设备及存储介质
CN113453033B (zh) * 2021-06-29 2023-01-20 广州方硅信息技术有限公司 直播间信息传送处理方法及其装置、设备与介质
CN113238756B (zh) * 2021-07-08 2021-10-22 北京达佳互联信息技术有限公司 直播业务处理方法、装置、电子设备及存储介质
CN113542783B (zh) * 2021-07-13 2023-06-06 北京字节跳动网络技术有限公司 音频处理方法、直播设备、以及直播系统
CN113613028B (zh) * 2021-08-03 2023-08-08 北京达佳互联信息技术有限公司 直播数据处理方法、装置、终端、服务器及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020095679A1 (en) * 2001-01-18 2002-07-18 Bonini Robert Nathaniel Method and system providing a digital cinema distribution network having backchannel feedback
CN103533292A (zh) * 2013-09-27 2014-01-22 掌赢信息科技(上海)有限公司 手机视频直拍直播中的双向语音通话装置
CN105828214A (zh) * 2016-03-31 2016-08-03 徐文波 视频直播中互动的实现方法和装置
CN105898609A (zh) * 2015-12-14 2016-08-24 乐视网信息技术(北京)股份有限公司 一种实现在视频直播过程中进行语音互动的方法及客户端

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW463503B (en) 1998-08-26 2001-11-11 United Video Properties Inc Television chat system
JP2009201005A (ja) 2008-02-25 2009-09-03 Onkyo Corp 動電型スピーカー
US20150296247A1 (en) * 2012-02-29 2015-10-15 ExXothermic, Inc. Interaction of user devices and video devices
US9208784B2 (en) * 2013-01-08 2015-12-08 C21 Patents, Llc Methododolgy for live text broadcasting
CN104104703B (zh) * 2013-04-09 2018-02-13 广州华多网络科技有限公司 多人音视频互动方法、客户端、服务器及系统
JP6311337B2 (ja) 2014-02-10 2018-04-18 株式会社リコー 宛先管理システム、通信システム、プログラム、及び宛先管理方法
CN104168517B (zh) * 2014-08-04 2017-10-13 广州华多网络科技有限公司 进入直播频道的方法及系统
CN104166547B (zh) * 2014-08-07 2018-07-27 广州华多网络科技有限公司 一种频道的控制方法和装置
US10666696B2 (en) * 2014-09-05 2020-05-26 Minerva Project, Inc. System and method for a virtual conference interactive timeline
CN105530535A (zh) * 2014-09-29 2016-04-27 中兴通讯股份有限公司 一种多人观看视频实时互动的方法及系统
CN104394432B (zh) * 2014-11-26 2018-03-16 广州华多网络科技有限公司 一种视频直播间的创建方法及服务设备
CN112152904B (zh) 2015-02-16 2022-12-09 钉钉控股(开曼)有限公司 网络交互方法
CN104822001B (zh) * 2015-04-23 2018-12-18 腾讯科技(深圳)有限公司 回声消除数据同步控制方法和装置
CN105100080B (zh) * 2015-06-30 2018-11-23 广州华多网络科技有限公司 一种基于在线直播的牌类互动方法、相关设备及系统
CN106341695B (zh) 2016-08-31 2020-08-11 腾讯数码(天津)有限公司 直播间互动方法、装置及系统
US10469975B2 (en) * 2017-05-15 2019-11-05 Microsoft Technology Licensing, Llc Personalization of spatial audio for streaming platforms
US10867601B2 (en) * 2018-01-17 2020-12-15 Citrix Systems, Inc. In-band voice-assistant/concierge for controlling online meetings
US10602234B2 (en) * 2018-07-12 2020-03-24 Rovi Guides, Inc. Systems and methods for gamification of real-time instructional commentating
US10863245B2 (en) * 2018-09-27 2020-12-08 Rovi Guides, Inc. Augmentation of audio/video content with enhanced interactive content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020095679A1 (en) * 2001-01-18 2002-07-18 Bonini Robert Nathaniel Method and system providing a digital cinema distribution network having backchannel feedback
CN103533292A (zh) * 2013-09-27 2014-01-22 掌赢信息科技(上海)有限公司 手机视频直拍直播中的双向语音通话装置
CN105898609A (zh) * 2015-12-14 2016-08-24 乐视网信息技术(北京)股份有限公司 一种实现在视频直播过程中进行语音互动的方法及客户端
CN105828214A (zh) * 2016-03-31 2016-08-03 徐文波 视频直播中互动的实现方法和装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113163215A (zh) * 2020-01-22 2021-07-23 华为技术有限公司 基于云手机的直播方法和直播系统
CN113473161A (zh) * 2020-03-31 2021-10-01 腾讯科技(成都)有限公司 直播方法、装置、设备及计算机存储介质
CN113473161B (zh) * 2020-03-31 2024-05-24 腾讯科技(成都)有限公司 直播方法、装置、设备及计算机存储介质

Also Published As

Publication number Publication date
CN107124661A (zh) 2017-09-01
CN107124661B (zh) 2020-05-19
JP6976410B2 (ja) 2021-12-08
US11153110B2 (en) 2021-10-19
JP2020517206A (ja) 2020-06-11
US20200036545A1 (en) 2020-01-30

Similar Documents

Publication Publication Date Title
WO2018184266A1 (zh) 直播频道中的通信方法、装置及系统
CN106791892B (zh) 一种轮麦直播的方法、装置和系统
CN109756758B (zh) 直播控制方法及装置
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
CN107371044B (zh) 电子设备互动方法、电子设备、用户终端及服务器
US11477316B2 (en) Information processing system, wireless terminal, and information processing method
WO2015096679A1 (zh) 一种同屏互动方法以及装置
US9503893B2 (en) Communication management system, relay device, communication control system, communication system, communication method, and recording medium storing communication control program
US9736518B2 (en) Content streaming and broadcasting
WO2018205786A1 (zh) 分享录屏视频的方法、装置及设备
US9172908B2 (en) Unpaired devices
US9756373B2 (en) Content streaming and broadcasting
CN112738540B (zh) 多设备直播切换方法、装置、系统、电子设备和可读存储介质
US10164784B2 (en) Communication terminal, communication system, and data transmission method
CN114629932B (zh) 电子设备间的协同方法、电子设备及存储介质
CN109495769B (zh) 视频通信方法、终端、智能电视、服务器及存储介质
US20160262206A1 (en) Communication system, communication method, relay device, and computer program product
US9094574B2 (en) Information processing apparatus, conference system, and computer program products
US10205686B2 (en) Communication terminal, communication system, and output method
US9602768B2 (en) Apparatus, system, and method of managing terminals, and recording medium
JP6441481B2 (ja) 情報照会方法、装置、プログラム及び記録媒体
US10326843B2 (en) System, apparatus, and method of managing communication, and recording medium
US20150244813A1 (en) Session control system, communication system, session control method, and recording medium storing session control program
CN105357101B (zh) 即时通信方法、装置及系统
US20170064377A1 (en) Content streaming and broadcasting

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17904824

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020504755

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17904824

Country of ref document: EP

Kind code of ref document: A1