WO2017008627A1 - 多媒体直播方法、装置和系统 - Google Patents

多媒体直播方法、装置和系统 Download PDF

Info

Publication number
WO2017008627A1
WO2017008627A1 PCT/CN2016/087444 CN2016087444W WO2017008627A1 WO 2017008627 A1 WO2017008627 A1 WO 2017008627A1 CN 2016087444 W CN2016087444 W CN 2016087444W WO 2017008627 A1 WO2017008627 A1 WO 2017008627A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia
multimedia live
live broadcast
live stream
terminal
Prior art date
Application number
PCT/CN2016/087444
Other languages
English (en)
French (fr)
Inventor
梁鉴东
张志东
赖晶
欧文军
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2017008627A1 publication Critical patent/WO2017008627A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand

Definitions

  • the present invention relates to the field of Internet technologies, and in particular, to a multimedia live broadcast method, apparatus, and system.
  • multimedia live broadcasts can be conducted through the Internet, so that viewers can watch the multimedia live stream of the multimedia live broadcast.
  • the multimedia live stream is a live video stream of the game
  • the user terminal can broadcast the displayed content of the currently running mobile game interface.
  • the commentator can add commentary information to the multimedia live stream, so that the viewer can further understand the live content according to the commentary information.
  • the live broadcast party and the commentator must be in the same place to realize the multimedia commentary, that is, the multimedia live stream and the commentary information must be acquired and synthesized at the same time, which leads to the geographical limitation of the multimedia commentary, thereby reducing the efficiency of the multimedia live broadcast.
  • an embodiment of the present invention provides a multimedia live broadcast method, apparatus, and system.
  • the technical solution is as follows:
  • a method for multimedia live broadcast comprising:
  • a multimedia live broadcast method where the method includes:
  • the first multimedia live stream of the user
  • the comment information is added to the first multimedia live stream to obtain a second multimedia live stream;
  • a multimedia live broadcast apparatus comprising:
  • a first receiving module configured to receive a request for obtaining a first multimedia live stream sent by the terminal, where the request for acquiring the first multimedia live stream carries a live broadcast address of the live broadcast user;
  • a first sending module configured to send the first multimedia live stream to the commenting terminal in response to the request for obtaining the first multimedia live stream received from the narrating terminal, so that the narrating terminal is in the Adding commentary information to the first multimedia live stream, obtaining a second multimedia live stream, and returning to the second multimedia live stream;
  • the second sending module is configured to send the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • a multimedia live broadcast apparatus where the apparatus includes:
  • a fourth sending module configured to send a request for acquiring a first multimedia live stream to the network side, where the request for acquiring the first multimedia live stream carries a live broadcast address of the live broadcast user, so that the network side is based on the a live broadcast address, returning the first multimedia live stream of the live broadcast user;
  • Adding a module when receiving the first multimedia live stream sent by the network side, adding commentary information to the first multimedia live stream, to obtain a second multimedia live stream;
  • the fifth sending module is configured to send the second multimedia live stream to the network side, so that the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • the fifth aspect provides a multimedia live broadcast system, including a live broadcast collection terminal, a network side device, a commenting terminal, a viewing user terminal, and a network, wherein the live broadcast collecting terminal, the network side device, the commenting terminal, and the viewing user terminal pass the Network communication,
  • the live broadcast collection terminal is configured to collect a first multimedia live stream
  • the network side device is configured to send the first multimedia live broadcast stream to the commentary terminal, and receive from the commentary terminal, in response to a request for obtaining the first multimedia live stream received from a commenting terminal, a second multimedia live stream, and sending the second multimedia live stream to the viewing user terminal to implement a multimedia live broadcast;
  • a requesting terminal configured to send the request for acquiring the first multimedia live stream to the network side device, and receive the first multimedia live stream from the network side device, to the first multiple Adding commentary information to the live stream of the media to obtain a second multimedia live stream, and transmitting the second multimedia live stream to the network side device;
  • the viewing user terminal is configured to receive the second multimedia live stream and play the same.
  • the network side receives the request for acquiring the first multimedia live stream sent by the terminal, and the network side obtains the first multimedia based on the Sending, by the request of the live stream, the first multimedia live stream of the live broadcast user to the commenting terminal, so that the commenting terminal adds the commentary information to the first multimedia live stream, and obtains the second multimedia live stream, and returns
  • the second multimedia live stream when receiving the second multimedia live stream sent by the narration terminal, the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast, thereby realizing The off-site interpretation of the multimedia live stream improves the efficiency of multimedia live broadcast.
  • FIG. 1 is a structural diagram of a multimedia live broadcast system according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a first multimedia live broadcast method according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a second multimedia live broadcast method according to an embodiment of the present invention.
  • FIG. 4A is a flowchart of a third multimedia live broadcast method according to an embodiment of the present invention.
  • 4B is a schematic diagram of an interface of an application switching box according to an embodiment of the present invention.
  • 4C is a schematic diagram of an application interface of a parkour game according to an embodiment of the present invention.
  • 4D is a schematic diagram of a play interface of a second multimedia live stream according to an embodiment of the present invention.
  • FIG. 5 is a structural diagram of another multimedia live broadcast system according to an embodiment of the present invention.
  • FIG. 6 is a flowchart of a fourth multimedia live broadcast method according to an embodiment of the present invention.
  • FIG. 7 is a block diagram of a first multimedia live broadcast apparatus according to an embodiment of the present invention.
  • FIG. 8 is a block diagram of a second multimedia live broadcast apparatus according to an embodiment of the present invention.
  • FIG. 9 is a block diagram of a second sending module according to an embodiment of the present invention.
  • FIG. 10 is a block diagram of a third multimedia live broadcast apparatus according to an embodiment of the present invention.
  • FIG. 11 is a block diagram of an adding module according to an embodiment of the present invention.
  • FIG. 12 is a block diagram of a fourth multimedia live broadcast apparatus according to an embodiment of the present invention.
  • FIG. 13 is a block diagram of a fifth multimedia live broadcast apparatus according to an embodiment of the present invention.
  • the live collection terminal can collect the video of the progress of the game and obtain the live stream of the game video.
  • the live broadcast collection terminal can collect the commentary information of the video live stream of the game by the commentator.
  • the live broadcast collection terminal may generate a live video stream of the game video with the commentary based on the live broadcast stream of the game video and the commentary information, and send the live broadcast stream of the game video with the commentary to the server.
  • the server may send the live video stream of the game video with the commentary to the viewing user terminal to implement the multimedia live broadcast with the commentary.
  • FIG. 1 is a structural diagram of a multimedia live broadcast system according to an embodiment of the present invention.
  • the system includes a live broadcast collection terminal, a network side, a comment terminal, a network, and a viewing user terminal.
  • the live broadcast collection terminal and the network side can be connected through a network, and the network side and the commentary terminal can be connected through a network, and the network side can also be connected to the viewing user terminal through a network.
  • the live broadcast collection terminal is configured to collect and send the first multimedia live stream.
  • the live broadcast collection terminal may include a video capture device, such as a video camera, to collect video of the live broadcast object to form a multimedia live broadcast stream.
  • the live broadcast collection terminal may further include a communication device, such as a transmitter, to facilitate transmitting the multimedia live stream.
  • the first multimedia live stream can be collected from content displayed on the live broadcast collection terminal.
  • the live broadcast collection terminal can display, for example, the game progress running on the live broadcast collection terminal or the audio or video played on the live broadcast collection terminal, and the displayed content can be collected as a multimedia live stream. For live broadcast.
  • the network side is an intermediary for data transmission between the live broadcast collection terminal and the comment terminal, and is configured to receive the first multimedia live stream sent by the live broadcast collection terminal.
  • the network side may receive a request for obtaining the first multimedia live stream sent by the terminal; in response to the received acquisition request, the network side forwards the first multimedia live stream to the commenting terminal for processing by the commenting terminal.
  • the network side is also used as an intermediary for the data transmission between the narration terminal and the viewing user terminal, and is configured to receive the live video stream processed by the narration terminal and send it to the viewing user terminal for viewing by the user terminal.
  • the narration terminal is configured to receive the first multimedia live stream forwarded by the network side, add narration information to the first multimedia live stream, obtain a second multimedia live stream, and send the second multimedia live stream Give the network side. Thereby, a multimedia live stream with commentary information can be implemented.
  • the narration terminal can include an audio capture device, such as a recording device, to collect audio narration information.
  • the commentary information can be audio, video, text, images, or any combination thereof.
  • the elaboration information may be an individual frame inserted into the first multimedia live stream, all frames, or spliced to the first multimedia live stream header or trailer, and the invention is not limited in this respect.
  • the viewing user terminal receives a multimedia live stream from the network side and plays the multimedia live stream. It can be understood that the viewing user terminal can decompress, decode, and/or decrypt the multimedia live stream to play the multimedia live stream, and the invention is not limited in this respect.
  • FIG. 2 is a flowchart of a multimedia live broadcast method according to an embodiment of the present invention. The method is for the network side, see Figure 2, which method comprises the following steps.
  • Step 201 Receive a request for obtaining the first multimedia live stream sent by the terminal.
  • the request for acquiring the first multimedia live stream may carry the identifier information of the requested multimedia live stream, so that the network side retrieves and sends the requested multimedia live stream, for example, The number of the live multimedia stream, the address of the multimedia live stream source device, or the machine identifier.
  • Step 202 Send the requested first multimedia live stream to the narration terminal in response to the request, so that the narration terminal adds narration information to the first multimedia live stream to obtain the second multimedia. Live stream and return to the second multimedia live stream.
  • the commentary information can be audio, video, text, images, or any combination thereof.
  • the elaboration information may be an individual frame inserted into the first multimedia live stream, all frames, or spliced to the first multimedia live stream header or trailer, and the invention is not limited in this respect.
  • Step 203 Receive a second multimedia live stream from the commenting terminal.
  • Step 204 Send the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • the network side receives the request for acquiring the first multimedia live stream sent by the terminal, and the network side obtains the first multimedia of the live user based on the request for acquiring the first multimedia live stream.
  • the live stream is sent to the narration terminal, so that the narration terminal adds narration information to the first multimedia live stream, obtains a second multimedia live stream, and returns the second multimedia live stream, when receiving the narration terminal
  • the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • the method before receiving the request for obtaining the first multimedia live stream sent by the terminal, the method further includes:
  • sending the second multimedia live stream to the viewing user terminal including:
  • the acquired second multimedia live stream is sent to the viewing user terminal based on the viewing user identifier.
  • the live broadcast collection terminal is a mobile terminal used for multimedia live broadcast, and the live broadcast collection terminal uses a multimedia live broadcast system for live broadcast.
  • the optional embodiments of the present invention may be used in any combination to form an optional embodiment of the present invention.
  • FIG. 3 is a flowchart of a multimedia live broadcast method according to an embodiment of the present invention. The method is used to explain a terminal, see FIG. 3, the method includes:
  • Step 301 Send a request for acquiring the first multimedia live stream to the network side.
  • the request for obtaining the first multimedia live stream may carry the live broadcast address of the live broadcast user, so that the network side returns the first multimedia live broadcast stream of the live broadcast user based on the live broadcast address.
  • Step 302 Receive, by the network side device, the first multimedia live stream that is sent in response to the request.
  • Step 303 Add commentary information to the first multimedia live stream to obtain a second multimedia live stream.
  • Step 304 Send the second multimedia live stream to the network side, so that the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • the terminal sends a request for acquiring the first multimedia live stream to the network side, so that the network side returns the first multimedia live stream of the live broadcast user based on the request, and receives the network side sending The first multimedia live stream, the commenting terminal adds the commentary information to the first multimedia live stream, and obtains the second multimedia live stream, and the commenting terminal sends the second multimedia live stream to the network side, so that The network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • adding the commentary information to the first multimedia live stream, and obtaining the second multimedia live stream includes:
  • the optional embodiments of the present invention may be used in any combination to form an optional embodiment of the present invention.
  • the second multimedia live broadcast can be generated by explaining the application used by the terminal to play the first multimedia live stream.
  • the applications used by the stream are the same or different.
  • an application used by the terminal to play the first multimedia live stream is referred to as a first application
  • an application used to generate a second multimedia live stream is referred to as a second application.
  • the method provided by the embodiments of the present invention will be described in detail below through two different embodiments.
  • FIG. 4A is a flowchart of a multimedia live broadcast method according to an embodiment of the present invention. Referring to Figure 4A, the method includes:
  • Step 401 When the live broadcast collection terminal receives the multimedia live broadcast command, the live broadcast request is sent to the network side, where the live broadcast request carries the live broadcast address and the live broadcast user identifier.
  • the live broadcast collection terminal When the live broadcast collection terminal receives the multimedia live broadcast command, the live broadcast collection terminal can obtain the live broadcast address and the live broadcast user identifier of the live broadcast user, and generate a multimedia live broadcast request based on the live broadcast address and the live broadcast user identifier, and send the multimedia live broadcast request to the broadcast live broadcast request.
  • Network side When the live broadcast collection terminal receives the multimedia live broadcast command, the live broadcast collection terminal can obtain the live broadcast address and the live broadcast user identifier of the live broadcast user, and generate a multimedia live broadcast request based on the live broadcast address and the live broadcast user identifier, and send the multimedia live broadcast request to the broadcast live broadcast request.
  • the live broadcast collection terminal is a terminal corresponding to the live broadcast user, and the live broadcast collection terminal is a mobile terminal for multimedia live broadcast, such as a mobile phone or a tablet computer, and the live broadcast collection terminal can perform live broadcast by using a multimedia live broadcast system.
  • the live broadcast system can be the system shown in Figure 1 above.
  • the multimedia live broadcast command is used for multimedia live broadcast, and the multimedia live broadcast command can be triggered by the live broadcast user, and the live broadcast user can be triggered by a specified operation, which can be a specified key operation, a sliding operation, a click operation, etc.
  • a specified operation which can be a specified key operation, a sliding operation, a click operation, etc.
  • the embodiment of the invention is not specifically limited thereto.
  • the live broadcast address is an address for the live broadcast collection terminal to perform a live broadcast of the multimedia.
  • the live broadcast address may be an identifier of the live broadcast of the live broadcast collection terminal, a channel address of the live broadcast collection terminal, a channel identifier, and the like. This is not specifically limited.
  • the live broadcast user identifier is an identifier of the live broadcast user, and the live broadcast user identifier is used to uniquely identify the live broadcast user.
  • the live broadcast user identifier may be an account of the live broadcast user.
  • the nickname of the live broadcast user is not specifically limited in this embodiment of the present invention.
  • Step 402 When the network side receives the multimedia live broadcast request, send a multimedia live broadcast response to the live broadcast collection terminal, so that the live broadcast collection terminal returns the first based on the live broadcast address after receiving the multimedia live broadcast response. Live media stream.
  • the network side may send a multimedia live broadcast response to the live broadcast collection terminal according to the live broadcast user identifier, to determine that the live broadcast collection terminal can perform multimedia live broadcast.
  • the live broadcast address may be sent to the network side according to the live broadcast address.
  • the live broadcast collection terminal when the live broadcast collection terminal receives the multimedia live broadcast response sent by the network side, the live broadcast collection terminal may collect the application interface that is currently running, obtain the video information, and the application interface currently running on the live broadcast collection terminal.
  • the generated voice is collected to obtain audio information, and the video information and the audio information are respectively encoded to obtain a first multimedia live stream, and the first multimedia live stream is sent to the network side based on the live broadcast address.
  • the application interface currently running by the live broadcast collection terminal is a parkour game interface having a motion track
  • the parkour game may include a target object, and the target object may be moved on the motion track, so when the live broadcast
  • the collecting terminal may collect the game interface that is running before, obtain the game video information, and collect the sound generated by the currently running game interface, and obtain the game audio information, and the game video is obtained.
  • the information and the game audio information are separately encoded to obtain a first multimedia live stream, and the first multimedia live stream is sent to the network side based on the live broadcast address.
  • the application program of the application interface currently running by the live broadcast collection terminal may be an application program installed in the live broadcast collection terminal, and the live broadcast collection terminal may receive the multimedia live response sent by the network side.
  • the live broadcast prompt information is displayed to prompt the user to switch the application where the application interface is located to the foreground of the live broadcast collection terminal, so that the live broadcast collection terminal collects the application interface.
  • the user can manually switch the application where the application interface is located to the foreground of the live broadcast collection terminal.
  • the live broadcast collection terminal can also display an application switching box, and the live broadcast is displayed in the application switching box. Collecting the identifiers of all the applications installed by the terminal. When the live collection terminal receives the selection instruction of the identifier of the application where the application interface is located, the application where the application interface is located may be switched to the foreground.
  • the identifier of the application may be an icon, a name, and the like of the application, and the selection instruction may be triggered by the user, and the user may trigger the operation by using a specified operation, which is not specifically limited in this embodiment of the present invention.
  • the live broadcast collection terminal may display an application switch box as shown in FIG. 4B, if the identifier of the application is an icon of the application, In the application switching box, an icon of all the applications installed by the live collection terminal may be displayed.
  • the application interface When the live collection terminal receives the selection instruction of the icon of the application where the application interface is located, the application interface may be applied. The program switches to the foreground to display the application interface as shown in FIG. 4C.
  • the live broadcast collection terminal can not only collect the sound generated by the application interface currently running on the live broadcast collection terminal, but also collect the external environment sound of the live broadcast user. Specifically limited.
  • the method for encoding the video information and the audio information by the live broadcast collection terminal may be referred to the related art, which is not specifically limited in this embodiment of the present invention.
  • Step 403 The network side receives the first multimedia live stream sent by the live broadcast collection terminal according to the live broadcast address, and responds to the request when receiving the request for acquiring the first multimedia live broadcast stream sent by the narration terminal. Sending the requested first multimedia live stream to the comment terminal.
  • the request for obtaining the first multimedia live stream carries the live broadcast address of the live broadcast user.
  • the commenting terminal may send a request for acquiring the first multimedia live stream to the network side. That is, when the terminal receives the multimedia acquisition instruction, the narration terminal may send a request for acquiring the first multimedia live stream to the network side, and the network side receives the first multimedia live stream sent by the narration terminal.
  • the network side may obtain the first multimedia live stream of the live broadcast user based on the live broadcast address of the live broadcast user, and send the obtained first multimedia live broadcast stream to the comment terminal.
  • the terminal is a terminal corresponding to the narrator, and the multimedia acquisition command may be triggered by the narrator, and the narrator may be triggered by a specified operation, which is not specifically limited in the embodiment of the present invention.
  • the start time of the request for the terminal to send the first multimedia live stream to the network side may not be synchronized with the start time of the live broadcast of the live broadcast collection terminal, for example, when the live broadcast collection terminal performs multimedia.
  • the start time of the live broadcast is 8:25:30
  • the commenting terminal sends the first multimedia live broadcast to the network side.
  • the start time of the stream request may be 8:26.
  • the network side interpreting the terminal to send the first multimedia live stream may be classified into the following three types, including:
  • the network side when the network side receives the request for obtaining the first multimedia live stream sent by the narration terminal, and then receives the first multimedia live stream sent by the live broadcast collection terminal, the network side can directly collect the live broadcast.
  • the first multimedia live stream sent by the terminal is forwarded to the narration terminal.
  • the network side when the network side receives the first multimedia live stream sent by the live broadcast collection terminal, and then receives the request for obtaining the first multimedia live stream sent by the narration terminal, the network side receives the live broadcast collection terminal.
  • the first multimedia live stream When the first multimedia live stream is sent, the first multimedia live stream may be buffered, and the request for acquiring the first multimedia live stream sent by the commenting terminal is received, and the cached first multimedia live stream is obtained. And sending the obtained first multimedia live stream to the comment terminal.
  • the network side when the network side receives the first multimedia live stream sent by the live broadcast collection terminal, and then receives the request for obtaining the first multimedia live stream sent by the narration terminal, the network side receives the live broadcast collection terminal.
  • the first multimedia live stream When the first multimedia live stream is sent, the first multimedia live stream may not be cached, but when the request for obtaining the first multimedia live stream sent by the commenting terminal is received, the first acquisition is obtained. After the receiving time of the request of the live broadcast stream, the first multimedia live stream sent by the live broadcast collection terminal is sent to the commenting terminal.
  • Step 404 When the terminal receives the first multimedia live stream sent by the network side, adding the commentary information to the first multimedia live stream, obtaining the second multimedia live stream, and the second multimedia The live stream is sent to the network side.
  • the commenting terminal can also collect the playing interface of the first multimedia live stream and the commentary information of the first multimedia live stream by the commentator, respectively, for the first multimedia live stream and
  • the narration information is encoded to obtain a second multimedia live stream, and the second multimedia live stream is sent to the network side, thereby realizing the off-site interpretation of the multimedia live stream, and improving the efficiency of the multimedia live broadcast.
  • the method for encoding the first multimedia live stream and the narration information by the terminal can refer to related technologies, which is not elaborated in the embodiment of the present invention.
  • Step 405 The network side receives the second multimedia live stream sent by the narration terminal, and when receiving the first multimedia play request sent by the user terminal, obtains the first address based on the play address of the second multimedia live stream.
  • the second multimedia broadcast stream carries the play address of the second multimedia live stream and the viewing user identifier.
  • the viewing user terminal may send a first multimedia play request to the network side, that is, when the viewing user terminal receives the first multimedia play instruction, the first time may be sent to the network side.
  • Multimedia playback request When the network side receives the first multimedia play request sent by the user terminal, the network may obtain the second multimedia live stream based on the play address of the second multimedia live stream that is carried by the first multimedia play request.
  • the second multimedia live stream is the first multimedia live stream that adds the understanding information
  • the play address of the first multimedia live stream and the play address of the second multimedia live stream different.
  • the first multimedia play instruction is used to play the second multimedia live stream, and the first multimedia play instruction may be triggered by the viewing user, and the viewing user may be triggered by a specified operation, in the embodiment of the present invention. This is not specifically limited.
  • the viewing user terminal is a terminal corresponding to the viewing user
  • the viewing user identifier is an identifier of the viewing user
  • the viewing user identifier is used to uniquely identify the viewing user.
  • the viewing user identifier may be an account, a nickname, etc. of the viewing user. The embodiment of the present invention does not specifically limit this.
  • Step 406 The network side sends the second multimedia live stream to the viewing user terminal based on the viewing user identifier to implement multimedia live broadcast.
  • the viewing user terminal After the second multimedia live stream is sent to the viewing user terminal based on the viewing user identifier, the viewing user terminal receives the second multimedia live stream and decodes the second multimedia live stream, thereby The decoded second multimedia live stream is played, and the multimedia live broadcast is realized.
  • the second multimedia live stream is obtained by adding the commentary information to the first multimedia live stream. Therefore, when the user terminal plays the second multimedia live stream, the viewing user terminal can also use the text.
  • the form shows the commentary information. For example, as shown in FIG. 4D, when viewing the user multimedia terminal to play the first multimedia live stream, the viewing user terminal may display the commentary information of the current application interface in FIG. 4D. “The game player’s processing while turning is still quite powerful. ".
  • the network side can not only store the second multimedia live stream, but also store the first multimedia live stream, that is, the viewing user can not only view the second multimedia live stream. Stream, you can also watch the first multimedia live stream.
  • the operation of the user watching the first multimedia live stream may be: when the viewing user terminal receives the second multimedia play instruction, the viewing user terminal may send the second multimedia play request to the network side, and second The multimedia play request carries the play address of the first multimedia live stream and the viewing user identifier.
  • the network side receives the second multimedia play request sent by the user terminal, the first multimedia live stream may be obtained based on the play address of the first multimedia live stream that is carried by the second multimedia play request. And transmitting, according to the viewing user identifier, the first multimedia live stream to the viewing user terminal.
  • the second multimedia play command is used to play the first multimedia live stream, and the second multimedia play command can be triggered by the viewing user, and the viewing user can be triggered by a specified operation, in the embodiment of the present invention. This is not specifically limited.
  • the server cluster may form a network, and the network may be a CDN network (Content Delivery Network), and at this time, when the network side and the live broadcast When the collection terminal performs interaction, the network side may select a server that is closer to the live broadcast collection terminal to interact with the CDN network based on the CDN network.
  • the network side may select a server that is closer to the narration terminal to interact with the CDN network based on the CDN network.
  • the network side can select a server that is closer to the user terminal to interact with the CDN network based on the CDN network, thereby reducing the interaction time and improving the interaction efficiency.
  • the live broadcast collection terminal may upload the first multimedia live stream of the live broadcast of the multimedia to the network side, and the network side receives the first multimedia live stream, and receives the first multimedia obtained by the interception terminal.
  • the first multimedia live stream may be sent to the commenting terminal, so that the commenting terminal adds the commentary information to the first multimedia live stream, and obtains the second multimedia live stream, and the second
  • the multimedia live stream is sent to the network side, and the network side receives the second multimedia live stream sent by the narration terminal, and when receiving the first multimedia play request sent by the viewing user terminal, based on the first multimedia
  • the physical play request acquires the second multimedia live stream and sends the second multimedia live stream to the viewing user terminal, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • the system architecture diagram shown in FIG. 5 may be used to perform the method provided in the following embodiments.
  • the network side may include a live server and a comment server, where the live broadcast Both the server and the narration server can be separate servers or a cluster of servers consisting of multiple servers.
  • Figure 6 is a flowchart of a multimedia live broadcast method provided by an embodiment of the present invention. Referring to Figure 6, the method includes the following steps.
  • Step 601 When the live broadcast collection terminal receives the multimedia live broadcast command, the live broadcast request is sent to the live broadcast server, where the live broadcast request carries the live broadcast address and the live broadcast user identifier.
  • the live broadcast collection terminal When the live broadcast collection terminal receives the multimedia live broadcast command, the live broadcast collection terminal can obtain the live broadcast address and the live broadcast user identifier of the live broadcast user, and generate a multimedia live broadcast request based on the live broadcast address and the live broadcast user identifier, and send the multimedia live broadcast request to the broadcast live broadcast request. Live server.
  • the live broadcast collection terminal is a terminal corresponding to the live broadcast user, and the live broadcast collection terminal is a mobile terminal for multimedia live broadcast, such as a mobile phone or a tablet computer, and the live broadcast collection terminal can perform live broadcast by using a multimedia live broadcast system.
  • the live broadcast system can be the system shown in Figure 5 above.
  • the multimedia live broadcast command is used for multimedia live broadcast, and the multimedia live broadcast command can be triggered by the live broadcast user, and the live broadcast user can be triggered by a specified operation, which can be a specified key operation, a sliding operation, a click operation, etc.
  • a specified operation which can be a specified key operation, a sliding operation, a click operation, etc.
  • the embodiment of the invention is not specifically limited thereto.
  • the live broadcast address is an address for the live broadcast collection terminal to perform a live broadcast of the multimedia.
  • the live broadcast address may be an identifier of the live broadcast of the live broadcast collection terminal, a channel address of the live broadcast collection terminal, a channel identifier, and the like. This is not specifically limited.
  • the live broadcast user identifier is an identifier of the live broadcast user, and the live broadcast user identifier is used to uniquely identify the live broadcast user.
  • the live broadcast user identifier may be an account of the live broadcast user.
  • the nickname of the live broadcast user is not specifically limited in this embodiment of the present invention.
  • Step 602 When the live broadcast server receives the multimedia live broadcast request, the live broadcast user sends a multimedia live broadcast response to the live broadcast collection terminal, so that the live broadcast collection terminal returns the first based on the live broadcast address after receiving the multimedia live broadcast response. Live media stream.
  • the live broadcast server may send a multimedia live broadcast response to the live broadcast collection terminal to determine that the live broadcast collection terminal can perform multimedia live broadcast.
  • the live broadcast address may be sent to the live broadcast server according to the live broadcast address.
  • the live broadcast collection terminal when the live broadcast collection terminal receives the multimedia live broadcast response sent by the live broadcast server, the live broadcast collection terminal may collect the application interface, obtain the video information, and the application interface currently running on the live broadcast collection terminal.
  • the generated sound is collected to obtain audio information, and the video information and the audio information are respectively encoded to obtain a first multimedia live stream, and the first multimedia live stream is sent to the live broadcast server based on the live broadcast address.
  • the application interface currently running by the live collection terminal is a parkour game interface with a motion track. Therefore, when the live collection terminal receives the multimedia live response sent by the network side, the game interface can be collected and the game is obtained. Video information, and collecting sound generated by the currently running game interface, obtaining game audio information, respectively encoding the game video information and the game audio information, thereby obtaining a first multimedia live stream, and based on the live broadcast address, Sending the first multimedia live stream to the live broadcast server.
  • the application program of the application interface currently running by the live broadcast collection terminal may be an application program installed in the live broadcast collection terminal, and the live broadcast collection terminal may receive the multimedia live response sent by the network side.
  • the foreground of the terminal is operated, so that the live collection terminal collects the application interface.
  • the user can manually switch the application where the application interface is located to the foreground of the live broadcast collection terminal.
  • the live broadcast collection terminal can also display an application switching box, and the live broadcast is displayed in the application switching box. Collecting the identifiers of all the applications installed by the terminal. When the live collection terminal receives the selection instruction of the identifier of the application where the application interface is located, the application where the application interface is located may be switched to the foreground.
  • the identifier of the application may be an icon, a name, and the like of the application, and the selection instruction may be triggered by the user, and the user may trigger the operation by using a specified operation, which is not specifically limited in this embodiment of the present invention.
  • the live broadcast collection terminal may display an application switch box as shown in FIG. 4B, if the identifier of the application is an icon of the application, In the application switching box, an icon of all the applications installed by the live collection terminal may be displayed.
  • the application interface When the live collection terminal receives the selection instruction of the icon of the application where the application interface is located, the application interface may be applied. The program switches to the foreground to display the application interface as shown in FIG. 4C.
  • the live broadcast collection terminal can not only collect the sound generated by the application interface currently running on the live broadcast collection terminal, but also collect the external environment sound of the live broadcast user. Specifically limited.
  • the method for encoding the video information and the audio information by the live broadcast collection terminal may be referred to the related art, which is not specifically limited in this embodiment of the present invention.
  • Step 603 The live server receives the first multimedia live stream sent by the live broadcast collection terminal according to the live broadcast address, and receives a request for acquiring the first multimedia live stream sent by the narration terminal, in response to the request. And sending the requested first multimedia live stream to the narration terminal, where the request for acquiring the first multimedia live stream carries the live broadcast address of the live broadcast user.
  • the commenting terminal may send a request for acquiring the first multimedia live stream to the live server. That is, when the terminal receives the multimedia acquisition instruction, the narration terminal may send a request for acquiring the first multimedia live stream to the live server, and the live server receives the first multimedia live stream sent by the narration terminal.
  • the live broadcast server may obtain the first multimedia live stream of the live broadcast user based on the live broadcast address of the live broadcast user, and send the obtained first multimedia live broadcast stream to the comment terminal.
  • the terminal is a terminal corresponding to the narrator, and the multimedia acquisition command may be triggered by the narrator, and the narrator may be triggered by a specified operation, which is not specifically limited in the embodiment of the present invention.
  • the start time of the request for the terminal to send the first multimedia live stream to the live broadcast server may not be synchronized with the start time of the live broadcast of the live broadcast collection terminal, for example, when the live broadcast collection terminal performs multimedia.
  • the start time of the live broadcast is 8:25:30, and the start time of the request for the terminal to send the first multimedia live stream to the live server may be 8:26.
  • the situation in which the live broadcast server sends the first multimedia live stream to the commenting terminal can be classified into the following three types, including:
  • the live broadcast server when the live server receives the first multimedia live stream sent by the live broadcast collection terminal after receiving the request for the first multimedia live stream sent by the narration terminal, the live broadcast server can directly collect the live broadcast. The first multimedia live stream sent by the terminal is forwarded to the narration terminal.
  • the live broadcast server receives the live broadcast collection terminal. hair And sending, by the first multimedia live stream, the first multimedia live stream, and receiving the request for acquiring the first multimedia live stream sent by the commenting terminal, to obtain the cached first multimedia live stream And sending the obtained first multimedia live stream to the comment terminal.
  • the live broadcast server receives the live broadcast collection terminal.
  • the first multimedia live stream may not be cached, but when the request for obtaining the first multimedia live stream sent by the commenting terminal is received, the first acquisition is obtained.
  • the first multimedia live stream sent by the live broadcast collection terminal is sent to the commenting terminal.
  • Step 604 When the terminal receives the first multimedia live stream sent by the live server, adding the commentary information to the first multimedia live stream, obtaining the second multimedia live stream, and the second multimedia The live stream is sent to the narration server.
  • the terminal When the terminal receives the first multimedia live stream sent by the live server, the first multimedia live stream is decoded, and the decoded first multimedia live stream is played by the first application, and is played.
  • the commenting terminal In the process of decoding the first multimedia live stream, when the commenting terminal receives the commenting instruction through the second application, the commenting terminal can also collect the playing interface of the first multimedia live stream through the second application.
  • the commentator encodes the first multimedia live stream and the commentary information to obtain the second multimedia live stream, and sends the second multimedia live stream to the commentary.
  • the server realizes the remote interpretation of the multimedia live stream and improves the efficiency of the multimedia live broadcast.
  • commenting instruction is used to explain the currently played first multimedia live stream through the second application, and the commenting instruction can be triggered by the narrator, and the narrator can trigger by the specified operation, which is an embodiment of the present invention. This is not specifically limited.
  • the method for encoding the first multimedia live stream and the commentary information by the terminal can refer to related technologies, which is not described in detail in the embodiment of the present invention.
  • Step 605 The narration server receives the second multimedia live stream sent by the narration terminal, and when receiving the first multimedia play request sent by the viewing user terminal, acquires the first address based on the play address of the second multimedia live stream.
  • the second multimedia broadcast stream carries the play address of the second multimedia live stream and the viewing user identifier.
  • the viewing user terminal may send a first multimedia play request to the narration server, that is, when the viewing user terminal receives the first multimedia play instruction, may send the first message to the narration server.
  • Multimedia playback request When the acknowledgment server receives the first multimedia play request sent by the user terminal, the second multimedia live stream may be obtained based on the play address of the second multimedia live stream carried by the first multimedia play request.
  • the second multimedia live stream is the first multimedia live stream that adds the understanding information
  • the play address of the first multimedia live stream and the play address of the second multimedia live stream different.
  • the first multimedia play instruction is used to play the second multimedia live stream, and the first multimedia play instruction may be triggered by the viewing user, and the viewing user may be triggered by a specified operation, in the embodiment of the present invention. This is not specifically limited.
  • the viewing user terminal is a terminal corresponding to the viewing user
  • the viewing user identifier is an identifier of the viewing user
  • the viewing user identifier is used to uniquely identify the viewing user.
  • the viewing user identifier may be an account, a nickname, etc. of the viewing user. The embodiment of the present invention does not specifically limit this.
  • Step 606 The narration server sends the second multimedia live stream to the viewing user terminal based on the viewing user identifier. To achieve multimedia live broadcast.
  • the viewing user terminal After the narration server sends the second multimedia live stream to the viewing user terminal based on the viewing user identifier, the viewing user terminal receives the second multimedia live stream, and decodes the second multimedia live stream, thereby The decoded second multimedia live stream is played, and the multimedia live broadcast is realized.
  • the second multimedia live stream is obtained by adding the commentary information to the first multimedia live stream. Therefore, when the user terminal plays the second multimedia live stream, the viewing user terminal can also use the text.
  • the form shows the commentary information. For example, as shown in FIG. 4D, when viewing the user multimedia terminal to play the first multimedia live stream, the viewing user terminal may display the commentary information of the current application interface in FIG. 4D. “The game player’s processing while turning is still quite powerful. ".
  • the live broadcast server may store the first multimedia live stream
  • the narration server may store the second multimedia live stream
  • the viewing user The terminal may obtain the first multimedia live stream from the live server for playing, and when the viewing user views the second multimedia live stream, the viewing user terminal may obtain the second multimedia live stream from the narration server for playing.
  • the operation that the viewing user terminal can obtain the first multimedia live stream from the live server may be: when the viewing user terminal receives the second multimedia play instruction, the viewing user terminal may send the broadcast to the live server. And a second multimedia play request, where the second multimedia play request carries the play address of the first multimedia live stream and the viewing user identifier.
  • the live broadcast server may obtain the first multimedia live stream based on the play address of the first multimedia live stream that is carried by the second multimedia play request. And sending, according to the viewing user identifier, the first multimedia live stream to the viewing user terminal, so that the viewing user terminal plays the first multimedia live stream.
  • the second multimedia play command is used to play the first multimedia live stream, and the second multimedia play command can be triggered by the viewing user, and the viewing user can be triggered by a specified operation, in the embodiment of the present invention. This is not specifically limited.
  • the live server when the live server is a live server cluster composed of multiple servers, the live server cluster can be a network, and the network can be a CDN network.
  • the live broadcast The server may select a server that is closer to the live broadcast collection terminal to interact with the live broadcast server cluster based on the CDN network.
  • the live server may select a server that is closer to the commenting terminal to interact with the live server cluster based on the CDN network.
  • the live server can select a server that is closer to the user terminal to interact with the live server cluster based on the CDN network, thereby reducing interaction time and improving interaction efficiency. .
  • the narration server when the narration server is a narration server cluster composed of multiple servers, the narration server cluster may form a network, and the network may be a CDN network.
  • the narration server when the narration server interacts with the live collection terminal, the narration server may be based on The CDN network, from the commentary server cluster, selects a server that is closer to the live broadcast collection terminal to interact.
  • the narration server may select a server that is closer to the narration terminal to interact from the narration server cluster based on the CDN network.
  • the narration server when the narration server interacts with the viewing user terminal, the narration server can select a server that is closer to the user terminal to interact from the narration server cluster based on the CDN network, thereby reducing interaction time and improving interaction efficiency. .
  • the live broadcast collection terminal may upload the first multimedia live stream of the live multimedia broadcast to the live broadcast.
  • the server receives the first multimedia live stream, and when receiving the request for obtaining the first multimedia live stream sent by the narration terminal, the first multimedia live stream may be sent to the narration terminal, so that the narration terminal Adding commentary information to the first multimedia live stream, obtaining a second multimedia live stream, and transmitting the second multimedia live stream to the commentary server, and the commenting server receives the second multimedia live stream sent by the commenting terminal.
  • the user terminal realizes the off-site explanation of the multimedia live stream and improves the efficiency of the multimedia live broadcast.
  • an embodiment of the present invention provides a device 700 for multimedia live broadcast, and the device 700 includes:
  • the first receiving module 701 is configured to receive, by the narration terminal, a request for acquiring the first multimedia live stream
  • the first sending module 702 is configured to send the requested first multimedia live stream to the narration terminal in response to the request, so that the narration terminal adds narration information to the first multimedia live stream, and obtains a second multimedia live stream, and returning the second multimedia live stream;
  • the first receiving module 701 further receives the second multimedia live stream from the commenting terminal.
  • the second sending module 703 is configured to send the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • the apparatus 700 further includes:
  • the second receiving module 704 is configured to receive a multimedia live broadcast request sent by the live broadcast collection terminal, where the multimedia live broadcast request carries a live broadcast address and a live broadcast user identifier;
  • the third sending module 705 is configured to send a multimedia live broadcast response to the live broadcast collection terminal, so that the live broadcast collection terminal returns the first multimedia live broadcast stream based on the live broadcast address after receiving the multimedia live broadcast response.
  • the second sending module 703 includes:
  • the receiving unit 7031 is configured to receive a first multimedia play request sent by the user terminal, where the first multimedia play request carries a play address and a view user identifier of the second multimedia live stream;
  • the obtaining unit 7032 is configured to acquire a second multimedia live stream based on the play address.
  • the sending unit 7033 is configured to send the acquired second multimedia live stream to the viewing user terminal based on the viewing user identifier.
  • the live broadcast collection terminal is a mobile terminal used for multimedia live broadcast, and the live broadcast collection terminal uses a multimedia live broadcast system for live broadcast.
  • the network side receives the request for acquiring the first multimedia live stream sent by the terminal, and the network side obtains the first multimedia of the live user based on the request for acquiring the first multimedia live stream.
  • the live broadcast stream is sent to the narration terminal, so that the narration terminal adds the narration information to the first multimedia live stream, obtains the second multimedia live stream, and returns the second multimedia live stream, and receives the narration terminal to send
  • the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • an embodiment of the present invention provides a device 1000 for multimedia live broadcast, and the device 1000 includes:
  • the fourth sending module 1001 is configured to send, to the network side, a request for acquiring the first multimedia live stream, where the network side can be based. Returning the first multimedia live stream of the live broadcast user to the request;
  • the receiving module 1004 is configured to receive, by the network side, the first multimedia live stream that is sent in response to the request.
  • the adding module 1002 is configured to add the commentary information to the first multimedia live stream to obtain a second multimedia live stream;
  • the fifth sending module 1003 is configured to send the second multimedia live stream to the network side, so that the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast.
  • the adding module 1002 includes:
  • the playing unit 10021 is configured to play the first multimedia live stream
  • the collecting unit 10022 is configured to: during the playing of the first multimedia live stream, collect the first multimedia live stream and the commentary information of the first multimedia live stream;
  • the generating unit 10023 generates a second multimedia live stream based on the first multimedia live stream and the commentary information.
  • the terminal sends a request for acquiring the first multimedia live stream to the network side, so that the network side returns the first multimedia of the live broadcast user based on the request for acquiring the first multimedia live stream.
  • the live stream when receiving the first multimedia live stream sent by the network side, the commenting terminal adds the commentary information to the first multimedia live stream, and obtains the second multimedia live stream, and the commenting terminal is the second most
  • the live broadcast stream is sent to the network side, so that the network side sends the second multimedia live stream to the viewing user terminal to realize multimedia live broadcast, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • the multimedia live broadcast device provided by the foregoing embodiment when the multimedia live broadcast device provided by the foregoing embodiment is in live broadcast multimedia, only the division of each functional module is used for example. In an actual application, the function distribution may be completed by different functional modules according to requirements. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above.
  • the device for the multimedia live broadcast provided by the foregoing embodiment is the same as the method for the live broadcast of the multimedia. The specific implementation process is described in detail in the method embodiment, and details are not described herein again.
  • the multimedia live broadcast device may be a server 1200 including a central processing unit (CPU) 1201, a system memory 1204 including a random access memory (RAM) 1202 and a read only memory (ROM) 1203, and a connection system memory 1204 and System bus 1205 of central processing unit 1201.
  • Server 1200 also includes a basic input/output system (I/O system) 1206 that facilitates the transfer of information between various devices within the computer, and a mass storage device 1207 for storing operating system 1213, applications 1214, and other program modules 1215.
  • I/O system basic input/output system
  • the basic input/output system 1206 includes a display 1208 for displaying information and an input device 1209 such as a mouse, keyboard, etc. for user input of information.
  • the display 1208 and the input device 1209 are both connected to the central processing unit 1201 via an input-output controller 1210 that is coupled to the system bus 1205.
  • the basic input/output system 1206 can also include an input output controller 1210 for receiving and processing input from a plurality of other devices, such as a keyboard, mouse, or electronic stylus.
  • input-output controller 1210 also provides output to a display screen, printer, or other type of output device.
  • the mass storage device 1207 is connected to the central processing unit 1201 by a mass storage controller (not shown) connected to the system bus 1205.
  • the mass storage device 1207 and its associated computer readable medium provide non-volatile storage for the server 1200. That is, the mass storage device 1207 may include, for example, a hard disk or A computer readable medium (not shown) such as a CD-ROM drive.
  • the computer readable medium can include computer storage media and communication media.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • Computer storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid state storage technologies, CD-ROM, DVD or other optical storage, tape cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices.
  • RAM random access memory
  • ROM read only memory
  • EPROM Erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • the server 1200 may also be operated by a remote computer connected to the network through a network such as the Internet. That is, the server 1200 can be connected to the network 1212 through the network interface unit 1211 connected to the system bus 1205, or can also be connected to other types of networks or remote computer systems (not shown) using the network interface unit 1211. .
  • the memory further includes one or more programs, the one or more programs being stored in a memory, the one or more programs comprising instructions for performing the multimedia live broadcast method provided by the embodiments of the present invention, including:
  • the network side before the network side receives the request for obtaining the first multimedia live stream sent by the narration terminal, the network side further includes:
  • the network side sends the second multimedia live stream to the viewing user terminal, including:
  • the acquired second multimedia live stream is sent to the viewing user terminal based on the viewing user identifier.
  • the live broadcast collection terminal is a mobile terminal used for multimedia live broadcast, and the live broadcast collection terminal uses a multimedia live broadcast system for live broadcast.
  • the network side receives the request for acquiring the first multimedia live stream sent by the terminal, and the network side obtains the first multimedia of the live user based on the request for acquiring the first multimedia live stream.
  • the live stream is sent to the narration terminal, so that the narration terminal adds narration information to the first multimedia live stream, obtains a second multimedia live stream, and returns the second multimedia live stream, when receiving the narration terminal
  • the network side sends the second multimedia live stream to the viewing user terminal to implement multimedia live broadcast, thereby realizing the off-site interpretation of the multimedia live stream and improving the efficiency of the multimedia live broadcast.
  • FIG. 13 is a block diagram of a multimedia live broadcast apparatus provided by an embodiment of the present invention.
  • the multimedia live broadcast apparatus may be a terminal 1300.
  • the terminal 1300 may include a communication unit 1310, including one or more computers.
  • WIFI Wireless Fidelity
  • FIG. 13 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:
  • the communication unit 1310 can be used for transmitting and receiving information or receiving and transmitting signals during a call.
  • the communication unit 1310 can be an RF (Radio Frequency) circuit, a router, a modem, or the like.
  • RF circuits as communication units include, but are not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, and a LNA (Low Noise Amplifier, low).
  • SIM Subscriber Identity Module
  • the communication unit 1310 can also communicate with the network and other devices through wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
  • the memory 1320 can be used to store software programs and modules, and the processor 1380 executes various functional applications and data processing by running software programs and modules stored in the memory 1320.
  • the memory 1320 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 1300 (such as audio data, phone book, etc.) and the like.
  • memory 1320 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 1320 can also include a memory controller to provide access to memory 1320 by processor 1380 and input unit 1330.
  • Input unit 1330 can be used to receive input numeric or character information, as well as to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
  • the input unit 1330 can include a touch-sensitive surface 1331 and other input devices 1332.
  • Touch-sensitive surface 1331 also referred to as a touch display or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 1331 or The operation near the touch-sensitive surface 1331) and driving the corresponding connecting device according to a preset program.
  • the touch-sensitive surface 1331 may include two parts of a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 1380 is provided and can receive commands from the processor 1380 and execute them.
  • the touch sensitive surface 1331 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 1330 can also include other input devices 1332.
  • other input devices 1332 may include, but are not limited to, physical keyboards, function keys One or more of (such as volume control buttons, switch buttons, etc.), trackball, mouse, joystick, and the like.
  • Display unit 1340 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of terminal 1300, which can be composed of graphics, text, icons, video, and any combination thereof.
  • the display unit 1340 can include a display panel 1341.
  • the display panel 1341 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • the touch-sensitive surface 1331 may cover the display panel 1341, and when the touch-sensitive surface 1331 detects a touch operation thereon or nearby, it is transmitted to the processor 1380 to determine the type of the touch event, and then the processor 1380 according to the touch event The type provides a corresponding visual output on the display panel 1341.
  • touch-sensitive surface 1331 and display panel 1341 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 1331 can be integrated with display panel 1341 to effect input. And output function.
  • Terminal 1300 can also include at least one type of sensor 1350, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1341 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1341 and/or the backlight when the terminal 1300 moves to the ear.
  • the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the terminal 1300 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, not here Let me repeat.
  • Audio circuit 1360, speaker 1361, and microphone 1362 can provide an audio interface between the user and terminal 1300.
  • the audio circuit 1360 can transmit the converted electrical data of the received audio data to the speaker 1361, and convert it into a sound signal output by the speaker 1361; on the other hand, the microphone 1362 converts the collected sound signal into an electrical signal, by the audio circuit 1360. After receiving, it is converted into audio data, and then processed by the audio data output processor 1380, sent to, for example, another terminal via the communication unit 1310, or outputted to the memory 1320 for further processing.
  • the audio circuit 1360 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 1300.
  • the terminal may be configured with a wireless communication unit 1370, which may be a WIFI module.
  • the WIFI is a short-range wireless transmission technology, and the terminal 1300 can help the user to send and receive emails, browse web pages, and access streaming media through the wireless communication unit 1370, which provides wireless broadband Internet access for users.
  • the wireless communication unit 1370 is shown in the drawings, it can be understood that it does not belong to the essential configuration of the terminal 1300, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 1380 is a control center of the terminal 1300 that connects various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1320, and recalling data stored in the memory 1320, The various functions and processing data of the terminal 1300 are performed to perform overall monitoring of the mobile phone.
  • the processor 1380 may include one or more processing cores; preferably, the processor 1380 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 1380.
  • the terminal 1300 also includes a power source 1390 (such as a battery) for powering various components.
  • the power source can be logically coupled to the processor 1380 through a power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the power supply 1360 can also include one or more DC or AC power sources, a recharging system, and power Any component such as source fault detection circuit, power converter or inverter, power status indicator.
  • the terminal 1300 may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the terminal further includes one or more programs, the one or more programs being stored in the memory and configured to be executed by one or more processors, the one or more programs including
  • the instructions for performing the multimedia live broadcast method provided by the embodiment of the present invention include:
  • adding the commentary information to the first multimedia live stream, and obtaining the second multimedia live stream includes:
  • the terminal is configured to send a request for acquiring the first multimedia live stream to the network side, where the request for acquiring the first multimedia live stream carries the live broadcast address of the live broadcast user, so that the network side is based on the live broadcast.
  • the address returns the first multimedia live stream of the live broadcast user.
  • the commenting terminal adds the commentary information to the first multimedia live stream to obtain the second multimedia.
  • the live broadcast stream, the narration terminal sends the second multimedia live stream to the network side, so that the network side sends the second multimedia live stream to the viewing user terminal to implement the multimedia live broadcast, thereby realizing the multimedia live stream.
  • Interpretation in different places has improved the efficiency of multimedia live broadcast.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Human Computer Interaction (AREA)

Abstract

提供了一种多媒体直播方法、装置和系统。所述方法包括:响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端;从所述解说终端接收第二多媒体直播流,其中所述第二多媒体直播流是所述解说终端在所述第一多媒体直播流中添加解说信息而生成;以及将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。

Description

多媒体直播方法、装置和系统
本申请要求于2015年7月15日提交中国专利局、申请号为201510417223.2、发明名称为“多媒体直播方法与装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及互联网技术领域,特别涉及一种多媒体直播方法、装置和系统。
背景技术
随着互联网技术的发展,可以通过互联网进行多媒体直播,使观众观看该多媒体直播的多媒体直播流。比如,当多媒体直播流为游戏视频直播流时,用户终端可以对当前运行的手机游戏界面的显示内容进行直播。而为了满足观众的视听需求,解说员可以在该多媒体直播流中添加解说信息,使观众能够根据解说信息对直播内容有进一步了解。
一般来说,直播方和解说员必须在同一地点才能实现多媒体解说,也即是,多媒体直播流和解说信息必须同时获取并合成,导致多媒体解说受到了地域限制,进而降低了多媒体直播的效率。
发明内容
为了解决现有技术的问题,本发明实施例提供了一种多媒体直播方法、装置和系统。所述技术方案如下:
第一方面,提供了一种多媒体直播方法,所述方法包括:
接收解说终端发送的获取第一多媒体直播流的请求,所述获取第一多媒体直播流的请求中携带直播方的直播地址;
响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端,使所述解说终端在所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回所述第二多媒体直播流;
将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
第二方面,提供了一种多媒体直播方法,所述方法包括:
向网络侧发送获取第一多媒体直播流的请求,所述获取第一多媒体直播流的请求中携带直播用户的直播地址,使所述网络侧基于所述直播地址,返回所述直播用户的第一多媒体直播流;
当接收到所述网络侧发送的第一多媒体直播流时,向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流;
将所述第二多媒体直播流发送给所述网络侧,使所述网络侧将所述第二多媒体直播流 发送给观看用户终端,以实现多媒体直播。
第三方面,提供了一种多媒体直播装置,所述装置包括:
第一接收模块,用于接收解说终端发送的获取第一多媒体直播流的请求,所述获取第一多媒体直播流的请求中携带直播用户的直播地址;
第一发送模块,用于响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端,使所述解说终端在所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回所述第二多媒体直播流;
第二发送模块,用于将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
第四方面,提供了一种多媒体直播装置,所述装置包括:
第四发送模块,用于向网络侧发送获取第一多媒体直播流的请求,所述获取第一多媒体直播流的请求中携带直播用户的直播地址,使所述网络侧基于所述直播地址,返回所述直播用户的第一多媒体直播流;
添加模块,用于当接收到所述网络侧发送的第一多媒体直播流时,向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流;
第五发送模块,用于将所述第二多媒体直播流发送给所述网络侧,使所述网络侧将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
第五方面,提供了一种多媒体直播系统,包括直播采集终端、网络侧设备、解说终端、观看用户终端以及网络,其中所述直播采集终端、网络侧设备、解说终端及观看用户终端通过所述网络进行通信,
所述直播采集终端用于采集第一多媒体直播流;
所述网络侧设备用于响应于从解说终端接收的获取所述第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端,从所述解说终端接收第二多媒体直播流,并将所述第二多媒体直播流发送给所述观看用户终端,以实现多媒体直播;
解说终端,用于向所述网络侧设备发送获取所述第一多媒体直播流的所述请求,从所述网络侧设备接收所述第一多媒体直播流,向所述第一多媒体直播流中添加解说信息得到第二多媒体直播流,以及将所述第二多媒体直播流发送给所述网络侧设备;并且
所述观看用户终端用于接收所述第二多媒体直播流并进行播放。
本发明实施例提供的技术方案带来的有益效果是:在本发明实施例中,网络侧接收解说终端发送的获取第一多媒体直播流的请求,网络侧基于该获取第一多媒体直播流的请求,将该直播用户的第一多媒体直播流发送给解说终端,使该解说终端在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流,当接收到该解说终端发送的第二多媒体直播流时,网络侧将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
附图说明
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本 领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种多媒体直播系统架构图;
图2是本发明实施例提供的第一种多媒体直播方法的流程图;
图3是本发明实施例提供的第二种多媒体直播方法的流程图;
图4A是本发明实施例提供的第三种多媒体直播方法的流程图;
图4B是本发明实施例提供的一种应用程序切换框界面示意图;
图4C是本发明实施例提供的一种跑酷类游戏的应用界面示意图;
图4D是本发明实施例提供的一种第二多媒体直播流的播放界面示意图;
图5是本发明实施例提供的另一种多媒体直播系统架构图;
图6是本发明实施例提供的第四种多媒体直播方法的流程图;
图7是本发明实施例提供的第一种多媒体直播装置的框图;
图8是本发明实施例提供的第二种多媒体直播装置的框图;
图9是本发明实施例提供的一种第二发送模块的框图;
图10是本发明实施例提供的第三种多媒体直播装置的框图;
图11是本发明实施例提供的一种添加模块的框图;
图12是本发明实施例提供的第四种多媒体直播装置的框图;
图13是本发明实施例提供的第五种多媒体直播装置的框图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明实施方式作进一步地详细描述。
在一些多媒体直播流为游戏视频直播流的场景中,游戏玩家与解说员在同一地点,或者由游戏玩家兼职解说员。在游戏玩家玩游戏的过程中,直播采集终端可以采集游戏进展的视频,得到游戏视频直播流。另外,该直播采集终端可以采集解说员对该游戏视频直播流的解说信息。该直播采集终端可以基于该游戏视频直播流和该解说信息,生成带解说的游戏视频直播流,并将带解说的游戏视频直播流发送给服务器。服务器接收到带解说的游戏视频直播流之后,可以将带解说的游戏视频直播流发送给观看用户终端,以实现带解说的多媒体直播。
本发明实施例提供一种改进的多媒体直播架构。图1是本发明实施例提供的一种多媒体直播系统架构图。参见图1,该系统包括直播采集终端、网络侧、解说终端、网络和观看用户终端。该直播采集终端与网络侧可以通过网络进行连接,该网络侧与解说终端可以通过网络进行连接,该网络侧还可以与观看用户终端通过网络进行连接。
直播采集终端用于采集并发送第一多媒体直播流。本领域技术人员可以理解,所述直播采集终端可以包括视频采集设备,例如摄像机,以便于采集直播对象的视频,形成多媒体直播流。所述直播采集终端还可以包括通信设备,例如发射机,以便于发送所述多媒体直播流。
可以理解,所述第一多媒体直播流可以采集自在所述直播采集终端上显示的内容。换 言之,所述直播采集终端可以进行显示,例如在所述直播采集终端上运行的游戏进展或者在所述直播采集终端上播放的音频或视频,并且可以将所显示的内容采集为多媒体直播流供直播。
网络侧是直播采集终端和解说终端之间数据传输的中介,用于接收直播采集终端发送的第一多媒体直播流。另外,网络侧可以接收解说终端发送的获取第一多媒体直播流的请求;响应于所接收的获取请求,网络侧将第一多媒体直播流转发给解说终端,供解说终端进行处理。该网络侧还作为解说终端与观看用户终端之间数据传输的中介,用于接收解说终端处理后的直播视频流,并发送给观看用户终端,供用户终端观看。
解说终端用于接收网络侧转发的第一多媒体直播流,并在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并将第二多媒体直播流发送给网络侧。从而,可以实现带解说信息的多媒体直播流。在一些实施例中,所述解说终端可以包括音频采集设备,例如录音设备,以便采集音频解说信息。
可以理解,所述解说信息可以是音频、视频、文本、图像,或其任意组合。解说信息可以是插入到第一多媒体直播流的个别帧、所有帧,或者拼接到第一多媒体直播流头或尾,本发明在此方面不受限制。
所述观看用户终端从网络侧接收多媒体直播流,并且播放所述多媒体直播流。可以理解,所述观看用户终端可以对多媒体直播流进行解压、解码、和/或解密操作,以便播放所述多媒体直播流,本发明在此方面不受限制。
图2是本发明实施例提供的一种多媒体直播方法的流程图。该方法用于网络侧,参见图2,该方法包括以下步骤。
步骤201:接收解说终端发送的获取第一多媒体直播流的请求。
根据本发明实施例的一种实现,所述获取第一多媒体直播流的请求中可以携带所请求多媒体直播流的标识信息,以便网络侧检索并发送所请求的多媒体直播流,例如,可以携带多媒体直播流的编号、多媒体直播流源设备的地址或机器标识等。
步骤202:响应于所述请求,将所请求的所述第一多媒体直播流发送给解说终端,使该解说终端在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流。
可以理解,所述解说信息可以是音频、视频、文本、图像,或其任意组合。解说信息可以是插入到第一多媒体直播流的个别帧、所有帧,或者拼接到第一多媒体直播流头或尾,本发明在此方面不受限制。
步骤203:从所述解说终端接收第二多媒体直播流。
步骤204:将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
在本发明实施例中,网络侧接收解说终端发送的获取第一多媒体直播流的请求,网络侧基于该获取第一多媒体直播流的请求,将该直播用户的第一多媒体直播流发送给解说终端,使该解说终端在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流,当接收到该解说终端发送的第二多媒体直播流时,网络侧将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
可选地,接收解说终端发送的获取第一多媒体直播流的请求之前,还包括:
接收直播采集终端发送的多媒体直播请求,该多媒体直播请求携带直播地址和直播用户标识;
基于该直播用户标识,向该直播采集终端发送多媒体直播响应,使该直播采集终端接收到该多媒体直播响应之后,基于该直播地址返回第一多媒体直播流。
可选地,将该第二多媒体直播流发送给观看用户终端,包括:
接收观看用户终端发送的第一多媒体播放请求,该第一多媒体播放请求中携带该第二多媒体直播流的播放地址和观看用户标识;
基于播放地址,获取第二多媒体直播流;
基于观看用户标识,将获取的该第二多媒体直播流发送给该观看用户终端。
可选地,该直播采集终端为用于多媒体直播的移动终端,该直播采集终端采用多媒体直播系统进行直播。
上述所有可选技术方案,均可按照任意结合形成本发明的可选实施例,本发明实施例对此不再一一赘述。
图3是本发明实施例提供的一种多媒体直播方法的流程图。该方法用于解说终端,参见图3,该方法包括:
步骤301:向网络侧发送获取第一多媒体直播流的请求。
在一些示例性实现中,该获取第一多媒体直播流的请求中可以携带直播用户的直播地址,使该网络侧基于该直播地址,返回直播用户的第一多媒体直播流。
步骤302:从所述网络侧设备接收响应于所述请求发送的所述第一多媒体直播流;
步骤303:向第一多媒体直播流中添加解说信息,得到第二多媒体直播流。
步骤304:将该第二多媒体直播流发送给网络侧,使该网络侧将第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
在本发明实施例中,解说终端向网络侧发送获取第一多媒体直播流的请求,使该网络侧基于该请求返回直播用户的第一多媒体直播流,当接收到网络侧发送的第一多媒体直播流时,解说终端向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,解说终端将该第二多媒体直播流发送给网络侧,使该网络侧将第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
可选地,向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,包括:
播放第一多媒体直播流;
在播放该第一多媒体直播流的过程中,采集播放的第一多媒体直播流和解说用户对该第一多媒体直播流的解说信息;
基于该第一多媒体直播流和该解说信息,生成第二多媒体直播流。
上述所有可选技术方案,均可按照任意结合形成本发明的可选实施例,本发明实施例对此不再一一赘述。
由于解说终端播放第一多媒体直播流所采用的应用程序,可以与生成第二多媒体直播 流所采用的应用程序相同或者不同。为了便于描述,将解说终端播放第一多媒体直播流所采用的应用程序称为第一应用程序,将生成第二多媒体直播流所采用的应用程序称为第二应用程序。下面将通过两个不同的实施例,对本发明实施例提供的方法进行详细阐述。
在第一应用程序和第二应用程序相同的场景下,可以采用上述图1所示的系统架构图来执行如下实施例提供的方法,图1中的网络侧可以为单个服务器,还可以为多个服务器组成的服务器集群。图4A是本发明实施例提供的一种多媒体直播方法的流程图。参见图4A,该方法包括:
步骤401:当直播采集终端接收到多媒体直播指令时,向网络侧发送多媒体直播请求,该多媒体直播请求中携带直播地址和直播用户标识。
当直播采集终端接收到多媒体直播指令时,该直播采集终端可以获取直播用户的直播地址和直播用户标识,并基于该直播地址和直播用户标识,生成多媒体直播请求,并将该多媒体直播请求发送给网络侧。
需要说明的是,直播采集终端为直播用户对应的终端,直播采集终端为用于多媒体直播的移动终端,比如,手机、平板电脑等,且该直播采集终端可以采用多媒体直播系统进行直播,该多媒体直播系统可以为上述图1所示的系统。
其中,多媒体直播指令用于进行多媒体直播,且多媒体直播指令可以由直播用户触发,该直播用户可以通过指定操作来触发,该指定操作可以为指定按键操作、滑动操作、单击操作等等,本发明实施例对此不做具体限定。
另外,直播地址为该直播采集终端进行多媒体直播的地址,比如,该直播地址可以为该直播采集终端所在直播间的标识、该直播采集终端所在的频道地址、频道标识等等,本发明实施例对此不做具体限定。
再者,直播用户标识为直播用户的标识,该直播用户标识用于唯一标识该直播用户,比如,直播用户标识可以为直播用户的账号,当然,该直播用户标识还可以是其他标识,比如,直播用户的昵称,本发明实施例对此不做具体限定。
步骤402:当网络侧接收到该多媒体直播请求时,基于该直播用户标识,向直播采集终端发送多媒体直播响应,使该直播采集终端接收到该多媒体直播响应之后,基于该直播地址返回第一多媒体直播流。
当网络侧接收到该多媒体直播请求时,该网络侧可以基于该直播用户标识,向直播采集终端发送多媒体直播响应,以确定该直播采集终端可以进行多媒体直播。而当直播采集终端接收到网络侧发送的多媒体直播响应时,可以基于该直播地址,向网络侧发送第一多媒体直播流。
在本发明实施例中,当直播采集终端接收到网络侧发送的多媒体直播响应时,可以对直播采集终端当前运行的应用界面进行采集,得到视频信息,以及对该直播采集终端当前运行的应用界面产生的声音进行采集,得到音频信息,将该视频信息和音频信息分别进行编码,从而得到第一多媒体直播流,并基于该直播地址,将第一多媒体直播流发送给网络侧。
比如,直播采集终端当前运行的应用界面为具有运动轨道的跑酷类游戏界面,在该跑酷类游戏中可以包括一个目标对象,该目标对象可以在该运动轨道上运动,因此,当直播 采集终端接收到网络侧发送的多媒体直播响应时,可以对前运行的游戏界面进行采集,得到游戏视频信息,以及对当前运行的游戏界面产生的声音进行采集,得到游戏音频信息,将该游戏视频信息和游戏音频信息分别进行编码,从而得到第一多媒体直播流,并基于该直播地址,将第一多媒体直播流发送给网络侧。
需要说明的是,该直播采集终端当前运行的应用界面所在的应用程序可以是事先安装在该直播采集终端中的应用程序,且该直播采集终端可以在接收到网络侧发送的多媒体直播响应时,显示直播提示信息,以提示用户将该应用界面所在的应用程序切换到该直播采集终端的前台运行,从而使该直播采集终端对该应用界面进行采集。其中,该用户可以手动地将该应用界面所在的应用程序切换到该直播采集终端的前台运行,当然,该直播采集终端还可以显示一个应用程序切换框,在该应用程序切换框中显示该直播采集终端已安装的所有应用程序的标识,当该直播采集终端接收到该应用界面所在应用程序的标识的选择指令时,可以将该应用界面所在应用程序切换到前台运行。
其中,应用程序的标识可以为该应用程序的图标、名称等,且该选择指令可以由用户触发,该用户可以通过指定操作触发,本发明实施例对此不做具体限定。
比如,当该直播采集终端接收到网络侧发送的多媒体直播响应时,该直播采集终端可以显示如图4B所示的应用程序切换框,假如,应用程序的标识为该应用程序的图标,此时,在该应用程序切换框中可以显示该直播采集终端已安装的所有应用程序的图标,当该直播采集终端接收到该应用界面所在应用程序的图标的选择指令时,可以将该应用界面所在应用程序切换到前台运行,从而显示如图4C所示的应用界面。
在本发明实施例中,直播采集终端不仅可以对该直播采集终端当前运行的应用界面产生的声音进行采集,还可以对该直播用户所在的外界环境声音进行采集,本发明实施例对此不做具体限定。
另外,直播采集终端将该视频信息和音频信息分别进行编码的方法可以参考相关技术,本发明实施例对此不做具体限定。
步骤403:网络侧基于该直播地址,接收该直播采集终端发送的第一多媒体直播流,并当接收到解说终端发送的获取第一多媒体直播流的请求时,响应于所述请求,将所请求的所述第一多媒体直播流发送给解说终端。该获取第一多媒体直播流的请求中携带该直播用户的直播地址。
为了对第一多媒体直播流进行解说,该解说终端可以向网络侧发送获取第一多媒体直播流的请求。也即是,当解说终端接收到多媒体获取指令时,该解说终端可以向网络侧发送获取第一多媒体直播流的请求,当网络侧接收到解说终端发送的获取第一多媒体直播流的请求时,网络侧可以基于该直播用户的直播地址,获取直播用户的第一多媒体直播流,并将获取的第一多媒体直播流发送给解说终端。
需要说明的是,解说终端为解说员对应的终端,多媒体获取指令可以由解说员触发,该解说员可以通过指定操作来触发,本发明实施例对此不做具体限定。
另外,在本发明实施例中,解说终端向网络侧发送获取第一多媒体直播流的请求的开始时间和直播采集终端进行多媒体直播的开始时间可能不同步,比如,当直播采集终端进行多媒体直播的开始时间为8点25分30秒,解说终端向网络侧发送获取第一多媒体直播 流的请求的开始时间可能为8点26分。此时,网络侧向解说终端发送第一多媒体直播流的情况可以分为以下三种,包括:
第一种情况,当网络侧接收到解说终端发送的获取第一多媒体直播流的请求之后,才接收到直播采集终端发送的第一多媒体直播流时,网络侧可以直接将直播采集终端发送的第一多媒体直播流转发给解说终端。
第二种情况,当网络侧接收到直播采集终端发送的第一多媒体直播流之后,才接收到解说终端发送的获取第一多媒体直播流的请求时,网络侧接收到直播采集终端发送的第一多媒体直播流时,可以缓存第一多媒体直播流,并在接收到解说终端发送的获取第一多媒体直播流的请求,获取缓存的第一多媒体直播流,并将获取的第一多媒体直播流发送给解说终端。
第三种情况,当网络侧接收到直播采集终端发送的第一多媒体直播流之后,才接收到解说终端发送的获取第一多媒体直播流的请求时,网络侧接收到直播采集终端发送的第一多媒体直播流时,也可以不缓存第一多媒体直播流,而是在接收到解说终端发送的获取第一多媒体直播流的请求时,将该获取第一多媒体直播流的请求的接收时间之后,直播采集终端发送的第一多媒体直播流发送给解说终端。
步骤404:当解说终端接收到网络侧发送的第一多媒体直播流时,向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并将第二多媒体直播流发送给网络侧。
当解说终端接收到网络侧发送的第一多媒体直播流时,对第一多媒体直播流进行解码,并播放解码后的第一多媒体直播流,而在播放解码后的第一多媒体直播流的过程中,该解说终端还可以采集第一多媒体直播流的播放界面和解说员对第一多媒体直播流的解说信息,分别对第一多媒体直播流和解说信息进行编码,得到第二多媒体直播流,并将第二多媒体直播流发送至网络侧,实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
需要说明的是,该解说终端分别对第一多媒体直播流和解说信息进行编码的方法可以参考相关技术,本发明实施例对此不进行详细阐述。
步骤405:网络侧接收解说终端发送的第二多媒体直播流,并当接收到观看用户终端发送的第一多媒体播放请求时,基于第二多媒体直播流的播放地址,获取第二多媒体直播流,第一多媒体播放请求中携带第二多媒体直播流的播放地址和观看用户标识。
为了观看到该多媒体直播,该观看用户终端可以向网络侧发送第一多媒体播放请求,也即是,当观看用户终端接收到第一多媒体播放指令时,可以向网络侧发送第一多媒体播放请求。当网络侧接收到观看用户终端发送的第一多媒体播放请求时,可以基于第一多媒体播放请求携带的第二多媒体直播流的播放地址,获取第二多媒体直播流。
需要说明的是,由于第二多媒体直播流是添加了解说信息的第一多媒体直播流,因此,第一多媒体直播流的播放地址和第二多媒体直播流的播放地址不同。另外,第一多媒体播放指令用于对第二多媒体直播流进行播放,且第一多媒体播放指令可以由观看用户触发,该观看用户可以通过指定操作来触发,本发明实施例对此不做具体限定。
再者,观看用户终端为观看用户对应的终端,且观看用户标识为观看用户的标识,该观看用户标识用于唯一标识该观看用户,比如,观看用户标识可以为观看用户的账号、昵称等等,本发明实施例对此不做具体限定。
步骤406:网络侧基于该观看用户标识,将第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
在网络侧基于该观看用户标识,将第二多媒体直播流发送给观看用户终端之后,观看用户终端接收该第二多媒体直播流,并对第二多媒体直播流进行解码,从而播放解码后的第二多媒体直播流,实现了多媒体直播。
其中,由于第二多媒体直播流是对第一多媒体直播流添加解说信息而得到,因此,当观看用户终端播放第二多媒体直播流时,该观看用户终端还可以通过文字的形式显示解说信息。比如,如图4D所示,在观看用户终端播放第一多媒体直播流时,该观看用户终端可以在图4D中显示当前应用界面的解说信息“游戏玩家在拐弯时的处理还是挺厉害的”。
可选地,在本发明实施例中,网络侧不仅可以存储第二多媒体直播流,还可以存储第一多媒体直播流,也即是,观看用户不仅可以观看第二多媒体直播流,还可以观看第一多媒体直播流。而观看用户观看第一多媒体直播流的操作可以为:当观看用户终端接收到第二多媒体播放指令时,该观看用户终端可以向网络侧发送第二多媒体播放请求,第二多媒体播放请求中携带第一多媒体直播流的播放地址和观看用户标识。当网络侧接收到观看用户终端发送的第二多媒体播放请求时,可以基于第二多媒体播放请求携带的第一多媒体直播流的播放地址,获取第一多媒体直播流,并基于该观看用户标识,将第一多媒体直播流发送给该观看用户终端。
其中,第二多媒体播放指令用于对第一多媒体直播流进行播放,且第二多媒体播放指令可以由观看用户触发,该观看用户可以通过指定操作来触发,本发明实施例对此不做具体限定。
需要说明的是,当网络侧为多个服务器组成的服务器集群时,该服务器集群可以组成一个网络,该网络可以是CDN网络(Content Delivery Network,内容分发网络),此时,当网络侧与直播采集终端进行交互时,网络侧可以基于该CDN网络,从该服务器集群中,选择距离直播采集终端较近的服务器进行交互。当网络侧与解说终端进行交互时,网络侧可以基于该CDN网络,从该服务器集群中,选择距离解说终端较近的服务器进行交互。同理,当网络侧与观看用户终端进行交互时,网络侧可以基于该CDN网络,从该服务器集群中,选择距离观看用户终端较近的服务器进行交互,减少了交互时间,提高了交互效率。
在本发明实施例中,直播采集终端可以将多媒体直播的第一多媒体直播流上传到网络侧,网络侧接收第一多媒体直播流,当接收到解说终端发送的获取第一多媒体直播流的请求时,可以将第一多媒体直播流发送给解说终端,使解说终端向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并将第二多媒体直播流发送给网络侧,网络侧再接收解说终端发送的第二多媒体直播流,并当接收到观看用户终端发送的第一多媒体播放请求时,基于该第一多媒体播放请求,获取第二多媒体直播流,并将第二多媒体直播流发送给观看用户终端,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
在第一应用程序和第二应用程序不同的场景下,可以采用图5所示的系统架构图来执行如下实施例提供的方法,此时,网络侧可以包括直播服务器和解说服务器,其中,直播服务器和解说服务器均可以为单独的服务器,还可以为多个服务器组成的服务器集群。图 6是本发明实施例提供的一种多媒体直播方法的流程图。参见图6,该方法包括以下步骤。
步骤601:当直播采集终端接收到多媒体直播指令时,向直播服务器发送多媒体直播请求,该多媒体直播请求中携带直播地址和直播用户标识。
当直播采集终端接收到多媒体直播指令时,该直播采集终端可以获取直播用户的直播地址和直播用户标识,并基于该直播地址和直播用户标识,生成多媒体直播请求,并将该多媒体直播请求发送给直播服务器。
需要说明的是,直播采集终端为直播用户对应的终端,直播采集终端为用于多媒体直播的移动终端,比如,手机、平板电脑等,且该直播采集终端可以采用多媒体直播系统进行直播,该多媒体直播系统可以为上述图5所示的系统。
其中,多媒体直播指令用于进行多媒体直播,且多媒体直播指令可以由直播用户触发,该直播用户可以通过指定操作来触发,该指定操作可以为指定按键操作、滑动操作、单击操作等等,本发明实施例对此不做具体限定。
另外,直播地址为该直播采集终端进行多媒体直播的地址,比如,该直播地址可以为该直播采集终端所在直播间的标识、该直播采集终端所在的频道地址、频道标识等等,本发明实施例对此不做具体限定。
再者,直播用户标识为直播用户的标识,该直播用户标识用于唯一标识该直播用户,比如,直播用户标识可以为直播用户的账号,当然,该直播用户标识还可以是其他标识,比如,直播用户的昵称,本发明实施例对此不做具体限定。
步骤602:当直播服务器接收到该多媒体直播请求时,基于该直播用户标识,向直播采集终端发送多媒体直播响应,使该直播采集终端接收到该多媒体直播响应之后,基于该直播地址返回第一多媒体直播流。
当直播服务器接收到该多媒体直播请求时,该直播服务器可以基于该直播用户标识,向直播采集终端发送多媒体直播响应,以确定该直播采集终端可以进行多媒体直播。而当直播采集终端接收到直播服务器发送的多媒体直播响应时,可以基于该直播地址,向直播服务器发送第一多媒体直播流。
在本发明实施例中,当直播采集终端接收到直播服务器发送的多媒体直播响应时,可以对直播采集终端当前运行的应用界面进行采集,得到视频信息,以及对该直播采集终端当前运行的应用界面产生的声音进行采集,得到音频信息,将该视频信息和音频信息分别进行编码,从而得到第一多媒体直播流,并基于该直播地址,将第一多媒体直播流发送给直播服务器。
比如,直播采集终端当前运行的应用界面为具有运动轨道的跑酷类游戏界面,因此,当直播采集终端接收到网络侧发送的多媒体直播响应时,可以对前运行的游戏界面进行采集,得到游戏视频信息,以及对当前运行的游戏界面产生的声音进行采集,得到游戏音频信息,将该游戏视频信息和游戏音频信息分别进行编码,从而得到第一多媒体直播流,并基于该直播地址,将第一多媒体直播流发送给直播服务器。
需要说明的是,该直播采集终端当前运行的应用界面所在的应用程序可以是事先安装在该直播采集终端中的应用程序,且该直播采集终端可以在接收到网络侧发送的多媒体直播响应时,显示直播提示信息,以提示用户将该应用界面所在的应用程序切换到该直播采 集终端的前台运行,从而使该直播采集终端对该应用界面进行采集。其中,该用户可以手动地将该应用界面所在的应用程序切换到该直播采集终端的前台运行,当然,该直播采集终端还可以显示一个应用程序切换框,在该应用程序切换框中显示该直播采集终端已安装的所有应用程序的标识,当该直播采集终端接收到该应用界面所在应用程序的标识的选择指令时,可以将该应用界面所在应用程序切换到前台运行。
其中,应用程序的标识可以为该应用程序的图标、名称等,且该选择指令可以由用户触发,该用户可以通过指定操作触发,本发明实施例对此不做具体限定。
比如,当该直播采集终端接收到网络侧发送的多媒体直播响应时,该直播采集终端可以显示如图4B所示的应用程序切换框,假如,应用程序的标识为该应用程序的图标,此时,在该应用程序切换框中可以显示该直播采集终端已安装的所有应用程序的图标,当该直播采集终端接收到该应用界面所在应用程序的图标的选择指令时,可以将该应用界面所在应用程序切换到前台运行,从而显示如图4C所示的应用界面。
在本发明实施例中,直播采集终端不仅可以对该直播采集终端当前运行的应用界面产生的声音进行采集,还可以对该直播用户所在的外界环境声音进行采集,本发明实施例对此不做具体限定。
另外,直播采集终端将该视频信息和音频信息分别进行编码的方法可以参考相关技术,本发明实施例对此不做具体限定。
步骤603:直播服务器基于该直播地址,接收该直播采集终端发送的第一多媒体直播流,并当接收到解说终端发送的获取第一多媒体直播流的请求时,响应于所述请求,将所请求的所述第一多媒体直播流发送给解说终端,该获取第一多媒体直播流的请求中携带该直播用户的直播地址。
为了对第一多媒体直播流进行解说,该解说终端可以向直播服务器发送获取第一多媒体直播流的请求。也即是,当解说终端接收到多媒体获取指令时,该解说终端可以向直播服务器发送获取第一多媒体直播流的请求,当直播服务器接收到解说终端发送的获取第一多媒体直播流的请求时,直播服务器可以基于该直播用户的直播地址,获取直播用户的第一多媒体直播流,并将获取的第一多媒体直播流发送给解说终端。
需要说明的是,解说终端为解说员对应的终端,多媒体获取指令可以由解说员触发,该解说员可以通过指定操作来触发,本发明实施例对此不做具体限定。
另外,在本发明实施例中,解说终端向直播服务器发送获取第一多媒体直播流的请求的开始时间和直播采集终端进行多媒体直播的开始时间可能不同步,比如,当直播采集终端进行多媒体直播的开始时间为8点25分30秒,解说终端向直播服务器发送获取第一多媒体直播流的请求的开始时间可能为8点26分。此时,直播服务器向解说终端发送第一多媒体直播流的情况可以分为以下三种,包括:
第一种情况,当直播服务器接收到解说终端发送的获取第一多媒体直播流的请求之后,才接收到直播采集终端发送的第一多媒体直播流时,直播服务器可以直接将直播采集终端发送的第一多媒体直播流转发给解说终端。
第二种情况,当直播服务器接收到直播采集终端发送的第一多媒体直播流之后,才接收到解说终端发送的获取第一多媒体直播流的请求时,直播服务器接收到直播采集终端发 送的第一多媒体直播流时,可以缓存第一多媒体直播流,并在接收到解说终端发送的获取第一多媒体直播流的请求,获取缓存的第一多媒体直播流,并将获取的第一多媒体直播流发送给解说终端。
第三种情况,当直播服务器接收到直播采集终端发送的第一多媒体直播流之后,才接收到解说终端发送的获取第一多媒体直播流的请求时,直播服务器接收到直播采集终端发送的第一多媒体直播流时,也可以不缓存第一多媒体直播流,而是在接收到解说终端发送的获取第一多媒体直播流的请求时,将该获取第一多媒体直播流的请求的接收时间之后,直播采集终端发送的第一多媒体直播流发送给解说终端。
步骤604:当解说终端接收到直播服务器发送的第一多媒体直播流时,向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并将第二多媒体直播流发送给解说服务器。
当解说终端接收到直播服务器发送的第一多媒体直播流时,对第一多媒体直播流进行解码,并通过第一应用程序播放解码后的第一多媒体直播流,而在播放解码后的第一多媒体直播流的过程中,当解说终端通过第二应用程序接收到解说指令时,该解说终端还可以通过第二应用程序采集第一多媒体直播流的播放界面和解说员对第一多媒体直播流的解说信息,分别对第一多媒体直播流和解说信息进行编码,得到第二多媒体直播流,并将第二多媒体直播流发送至解说服务器,实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
需要说明的是,解说指令用于通过第二应用程序对当前播放的第一多媒体直播流进行解说,且解说指令可以由解说员触发,该解说员可以通过指定操作触发,本发明实施例对此不做具体限定。
另外,该解说终端分别对第一多媒体直播流和解说信息进行编码的方法可以参考相关技术,本发明实施例对此不进行详细阐述。
步骤605:解说服务器接收解说终端发送的第二多媒体直播流,并当接收到观看用户终端发送的第一多媒体播放请求时,基于第二多媒体直播流的播放地址,获取第二多媒体直播流,第一多媒体播放请求中携带第二多媒体直播流的播放地址和观看用户标识。
为了观看到该多媒体直播,该观看用户终端可以向解说服务器发送第一多媒体播放请求,也即是,当观看用户终端接收到第一多媒体播放指令时,可以向解说服务器发送第一多媒体播放请求。当解说服务器接收到观看用户终端发送的第一多媒体播放请求时,可以基于第一多媒体播放请求携带的第二多媒体直播流的播放地址,获取第二多媒体直播流。
需要说明的是,由于第二多媒体直播流是添加了解说信息的第一多媒体直播流,因此,第一多媒体直播流的播放地址和第二多媒体直播流的播放地址不同。另外,第一多媒体播放指令用于对第二多媒体直播流进行播放,且第一多媒体播放指令可以由观看用户触发,该观看用户可以通过指定操作来触发,本发明实施例对此不做具体限定。
再者,观看用户终端为观看用户对应的终端,且观看用户标识为观看用户的标识,该观看用户标识用于唯一标识该观看用户,比如,观看用户标识可以为观看用户的账号、昵称等等,本发明实施例对此不做具体限定。
步骤606:解说服务器基于该观看用户标识,将第二多媒体直播流发送给观看用户终 端,以实现多媒体直播。
在解说服务器基于该观看用户标识,将第二多媒体直播流发送给观看用户终端之后,观看用户终端接收该第二多媒体直播流,并对第二多媒体直播流进行解码,从而播放解码后的第二多媒体直播流,实现了多媒体直播。
其中,由于第二多媒体直播流是对第一多媒体直播流添加解说信息而得到,因此,当观看用户终端播放第二多媒体直播流时,该观看用户终端还可以通过文字的形式显示解说信息。比如,如图4D所示,在观看用户终端播放第一多媒体直播流时,该观看用户终端可以在图4D中显示当前应用界面的解说信息“游戏玩家在拐弯时的处理还是挺厉害的”。
可选地,在本发明实施例中,直播服务器可以存储第一多媒体直播流,解说服务器可以存储第二多媒体直播流,当观看用户观看第一多媒体直播流,该观看用户终端可以从直播服务器上获取第一多媒体直播流进行播放,而当观看用户观看第二多媒体直播流时,该观看用户终端可以从解说服务器上获取第二多媒体直播流进行播放。
其中,该观看用户终端可以从直播服务器上获取第一多媒体直播流进行播放的操作可以为:当观看用户终端接收到第二多媒体播放指令时,该观看用户终端可以向直播服务器发送第二多媒体播放请求,第二多媒体播放请求中携带第一多媒体直播流的播放地址和观看用户标识。当直播服务器接收到观看用户终端发送的第二多媒体播放请求时,可以基于第二多媒体播放请求携带的第一多媒体直播流的播放地址,获取第一多媒体直播流,并基于该观看用户标识,将第一多媒体直播流发送给该观看用户终端,使该观看用户终端播放第一多媒体直播流。
其中,第二多媒体播放指令用于对第一多媒体直播流进行播放,且第二多媒体播放指令可以由观看用户触发,该观看用户可以通过指定操作来触发,本发明实施例对此不做具体限定。
需要说明的是,当直播服务器为多个服务器组成的直播服务器集群时,该直播服务器集群可以组成一个网络,该网络可以是CDN网络,此时,当直播服务器与直播采集终端进行交互时,直播服务器可以基于该CDN网络,从该直播服务器集群中,选择距离直播采集终端较近的服务器进行交互。当直播服务器与解说终端进行交互时,直播服务器可以基于该CDN网络,从该直播服务器集群中,选择距离解说终端较近的服务器进行交互。同理,当直播服务器与观看用户终端进行交互时,直播服务器可以基于该CDN网络,从该直播服务器集群中,选择距离观看用户终端较近的服务器进行交互,减少了交互时间,提高了交互效率。
另外,当解说服务器为多个服务器组成的解说服务器集群时,该解说服务器集群可以组成一个网络,该网络可以是CDN网络,此时,当解说服务器与直播采集终端进行交互时,解说服务器可以基于该CDN网络,从该解说服务器集群中,选择距离直播采集终端较近的服务器进行交互。当解说服务器与解说终端进行交互时,解说服务器可以基于该CDN网络,从该解说服务器集群中,选择距离解说终端较近的服务器进行交互。同理,当解说服务器与观看用户终端进行交互时,解说服务器可以基于该CDN网络,从该解说服务器集群中,选择距离观看用户终端较近的服务器进行交互,减少了交互时间,提高了交互效率。
在本发明实施例中,直播采集终端可以将多媒体直播的第一多媒体直播流上传到直播 服务器,直播服务器接收第一多媒体直播流,当接收到解说终端发送的获取第一多媒体直播流的请求时,可以将第一多媒体直播流发送给解说终端,使解说终端向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并将第二多媒体直播流发送给解说服务器,解说服务器再接收解说终端发送的第二多媒体直播流,并当接收到观看用户终端发送的第一多媒体播放请求时,基于该第一多媒体播放请求,获取第二多媒体直播流,并将第二多媒体直播流发送给观看用户终端,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
参见图7,本发明实施例提供了一种多媒体直播的装置700,该装置700包括:
第一接收模块701,用于接收解说终端发送的获取第一多媒体直播流的请求;
第一发送模块702,用于响应于所述请求,将所请求的所述第一多媒体直播流发送给解说终端,使解说终端在该第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流;
所述第一接收模块701还从所述解说终端接收所述第二多媒体直播流。
第二发送模块703,用于将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
可选地,参见图8,该装置700还包括:
第二接收模块704,用于接收直播采集终端发送的多媒体直播请求,该多媒体直播请求携带直播地址和直播用户标识;
第三发送模块705,用于基于该直播用户标识,向直播采集终端发送多媒体直播响应,使该直播采集终端接收到该多媒体直播响应之后,基于该直播地址返回第一多媒体直播流。
可选地,参见图9,该第二发送模块703包括:
接收单元7031,用于接收观看用户终端发送的第一多媒体播放请求,该第一多媒体播放请求中携带第二多媒体直播流的播放地址和观看用户标识;
获取单元7032,用于基于该播放地址,获取第二多媒体直播流;
发送单元7033,用于基于观看用户标识,将获取的第二多媒体直播流发送给观看用户终端。
可选地,该直播采集终端为用于多媒体直播的移动终端,该直播采集终端采用多媒体直播系统进行直播。
在本发明实施例中,网络侧接收解说终端发送的获取第一多媒体直播流的请求,网络侧基于该获取第一多媒体直播流的请求,将该直播用户的第一多媒体直播流发送给解说终端,使该解说终端在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流,当接收到解说终端发送的第二多媒体直播流时,网络侧将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
参见图10,本发明实施例提供了一种多媒体直播的装置1000,该装置1000包括:
第四发送模块1001,用于向网络侧发送获取第一多媒体直播流的请求,网络侧可以基 于该请求,返回直播用户的第一多媒体直播流;
接收模块1004,用于从所述网络侧接收响应于所述请求发送的所述第一多媒体直播流。
添加模块1002,用于向该第一多媒体直播流中添加解说信息,得到第二多媒体直播流;
第五发送模块1003,用于将第二多媒体直播流发送给网络侧,使该网络侧将第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
可选地,参见图11,添加模块1002包括:
播放单元10021,用于播放该第一多媒体直播流;
采集单元10022,用于在播放第一多媒体直播流的过程中,采集播放的第一多媒体直播流和解说用户对该第一多媒体直播流的解说信息;
生成单元10023,基于该第一多媒体直播流和该解说信息,生成第二多媒体直播流。
在本发明实施例中,解说终端向网络侧发送获取第一多媒体直播流的请求,使该网络侧基于该获取第一多媒体直播流的请求,返回直播用户的第一多媒体直播流,当接收到网络侧发送的第一多媒体直播流时,解说终端向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,解说终端将该第二多媒体直播流发送给网络侧,使该网络侧将第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
需要说明的是:上述实施例提供的多媒体直播的装置在直播多媒体时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的多媒体直播的装置与多媒体直播的方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。
请参考图12,其示出了本发明实施例提供的一种多媒体直播装置的框图。该多媒体直播的装置可以为服务器1200,该服务器1200包括中央处理单元(CPU)1201、包括随机存取存储器(RAM)1202和只读存储器(ROM)1203的系统存储器1204,以及连接系统存储器1204和中央处理单元1201的系统总线1205。服务器1200还包括帮助计算机内的各个器件之间传输信息的基本输入/输出系统(I/O系统)1206,和用于存储操作系统1213、应用程序1214和其他程序模块1215的大容量存储设备1207。
所述基本输入/输出系统1206包括有用于显示信息的显示器1208和用于用户输入信息的诸如鼠标、键盘之类的输入设备1209。其中所述显示器1208和输入设备1209都通过连接到系统总线1205的输入输出控制器1210连接到中央处理单元1201。所述基本输入/输出系统1206还可以包括输入输出控制器1210以用于接收和处理来自键盘、鼠标、或电子触控笔等多个其他设备的输入。类似地,输入输出控制器1210还提供输出到显示屏、打印机或其他类型的输出设备。
所述大容量存储设备1207通过连接到系统总线1205的大容量存储控制器(未示出)连接到中央处理单元1201。所述大容量存储设备1207及其相关联的计算机可读介质为服务器1200提供非易失性存储。也就是说,所述大容量存储设备1207可以包括诸如硬盘或 者CD-ROM驱动器之类的计算机可读介质(未示出)。
不失一般性,所述计算机可读介质可以包括计算机存储介质和通信介质。计算机存储介质包括以用于存储诸如计算机可读指令、数据结构、程序模块或其他数据等信息的任何方法或技术实现的易失性和非易失性、可移动和不可移动介质。计算机存储介质包括RAM、ROM、EPROM、EEPROM、闪存或其他固态存储其技术,CD-ROM、DVD或其他光学存储、磁带盒、磁带、磁盘存储或其他磁性存储设备。当然,本领域技术人员可知所述计算机存储介质不局限于上述几种。上述的系统存储器1204和大容量存储设备1207可以统称为存储器。
根据本发明的各种实施例,服务器1200还可以通过诸如因特网等网络连接到网络上的远程计算机运行。也即服务器1200可以通过连接在所述系统总线1205上的网络接口单元1211连接到网络1212,或者说,也可以使用网络接口单元1211来连接到其他类型的网络或远程计算机系统(未示出)。
所述存储器还包括一个或者一个以上的程序,所述一个或者一个以上程序存储于存储器中,所述一个或者一个以上程序包含用于进行本发明实施例提供的多媒体直播方法的指令,包括:
响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端;
从所述解说终端接收第二多媒体直播流,其中所述第二多媒体直播流是所述解说终端在所述第一多媒体直播流中添加解说信息而生成;以及
将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
可选地,网络侧接收解说终端发送的获取第一多媒体直播流的请求之前,还包括:
接收直播采集终端发送的多媒体直播请求,该多媒体直播请求携带直播地址和直播用户标识;
基于该直播地址和该直播用户标识,向该直播采集终端发送多媒体直播响应,使该直播采集终端接收到该多媒体直播响应之后,基于该直播地址返回第一多媒体直播流。
可选地,网络侧将该第二多媒体直播流发送给观看用户终端,包括:
接收观看用户终端发送的第一多媒体播放请求,该第一多媒体播放请求中携带该第二多媒体直播流的播放地址和观看用户标识;
基于播放地址,获取第二多媒体直播流;
基于观看用户标识,将获取的该第二多媒体直播流发送给该观看用户终端。
可选地,该直播采集终端为用于多媒体直播的移动终端,该直播采集终端采用多媒体直播系统进行直播。
在本发明实施例中,网络侧接收解说终端发送的获取第一多媒体直播流的请求,网络侧基于该获取第一多媒体直播流的请求,将该直播用户的第一多媒体直播流发送给解说终端,使该解说终端在第一多媒体直播流中添加解说信息,得到第二多媒体直播流,并返回该第二多媒体直播流,当接收到该解说终端发送的第二多媒体直播流时,网络侧将该第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
请参考图13,其示出了本发明实施例提供的一种多媒体直播装置的框图,该多媒体直播的装置可以为终端1300,终端1300可以包括通信单元1310、包括有一个或一个以上计算机可读存储介质的存储器1320、输入单元1330、显示单元1340、传感器1350、音频电路1360、WIFI(Wireless Fidelity,无线保真)模块1370、包括有一个或者一个以上处理核心的处理器1380、以及电源1390等部件。本领域技术人员可以理解,图13中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。其中:
通信单元1310可用于收发信息或通话过程中,信号的接收和发送,该通信单元1310可以为RF(Radio Frequency,射频)电路、路由器、调制解调器、等网络通信设备。特别地,当通信单元1310为RF电路时,将基站的下行信息接收后,交由一个或者一个以上处理器1380处理;另外,将涉及上行的数据发送给基站。通常,作为通信单元的RF电路包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(SIM)卡、收发信机、耦合器、LNA(Low Noise Amplifier,低噪声放大器)、双工器等。此外,通信单元1310还可以通过无线通信与网络和其他设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于GSM(Global System of Mobile communication,全球移动通讯系统)、GPRS(General Packet Radio Service,通用分组无线服务)、CDMA(Code Division Multiple Access,码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service,短消息服务)等。存储器1320可用于存储软件程序以及模块,处理器1380通过运行存储在存储器1320的软件程序以及模块,从而执行各种功能应用以及数据处理。存储器1320可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据终端1300的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器1320可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地,存储器1320还可以包括存储器控制器,以提供处理器1380和输入单元1330对存储器1320的访问。
输入单元1330可用于接收输入的数字或字符信息,以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。优选地,输入单元1330可包括触敏表面1331以及其他输入设备1332。触敏表面1331,也称为触摸显示屏或者触控板,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触敏表面1331上或在触敏表面1331附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触敏表面1331可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1380,并能接收处理器1380发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触敏表面1331。除了触敏表面1331,输入单元1330还可以包括其他输入设备1332。优选地,其他输入设备1332可以包括但不限于物理键盘、功能键 (比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元1340可用于显示由用户输入的信息或提供给用户的信息以及终端1300的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示单元1340可包括显示面板1341,可选的,可以采用LCD(Liquid Crystal Display,液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置显示面板1341。进一步的,触敏表面1331可覆盖显示面板1341,当触敏表面1331检测到在其上或附近的触摸操作后,传送给处理器1380以确定触摸事件的类型,随后处理器1380根据触摸事件的类型在显示面板1341上提供相应的视觉输出。虽然在图13中,触敏表面1331与显示面板1341是作为两个独立的部件来实现输入和输入功能,但是在某些实施例中,可以将触敏表面1331与显示面板1341集成而实现输入和输出功能。
终端1300还可包括至少一种传感器1350,比如光传感器、运动传感器以及其他传感器。光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板1341的亮度,接近传感器可在终端1300移动到耳边时,关闭显示面板1341和/或背光。作为运动传感器的一种,重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于终端1300还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路1360、扬声器1361,传声器1362可提供用户与终端1300之间的音频接口。音频电路1360可将接收到的音频数据转换后的电信号,传输到扬声器1361,由扬声器1361转换为声音信号输出;另一方面,传声器1362将收集的声音信号转换为电信号,由音频电路1360接收后转换为音频数据,再将音频数据输出处理器1380处理后,经通信单元1310以发送给比如另一终端,或者将音频数据输出至存储器1320以便进一步处理。音频电路1360还可能包括耳塞插孔,以提供外设耳机与终端1300的通信。
为了实现无线通信,该终端上可以配置有无线通信单元1370,该无线通信单元1370可以为WIFI模块。WIFI属于短距离无线传输技术,终端1300通过无线通信单元1370可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图中示出了无线通信单元1370,但是可以理解的是,其并不属于终端1300的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。
处理器1380是终端1300的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器1320内的软件程序和/或模块,以及调用存储在存储器1320内的数据,执行终端1300的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器1380可包括一个或多个处理核心;优选的,处理器1380可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1380中。
终端1300还包括给各个部件供电的电源1390(比如电池),优选的,电源可以通过电源管理系统与处理器1380逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源1360还可以包括一个或一个以上的直流或交流电源、再充电系统、电 源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
尽管未示出,终端1300还可以包括摄像头、蓝牙模块等,在此不再赘述。
在本实施例中,终端还包括有一个或者一个以上的程序,这一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行,所述一个或者一个以上程序包含用于进行本发明实施例提供的多媒体直播方法的指令,包括:
向网络侧设备发送获取第一多媒体直播流的请求;
从所述网络侧设备接收响应于所述请求发送的所述第一多媒体直播流;
向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流;以及
将所述第二多媒体直播流发送给所述网络侧设备,其中所述网络侧设备将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
可选地,向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,包括:
播放第一多媒体直播流;
在播放该第一多媒体直播流的过程中,采集播放的第一多媒体直播流和解说用户对该第一多媒体直播流的解说信息;
基于该第一多媒体直播流和该解说信息,生成第二多媒体直播流。
在本发明实施例中,解说终端向网络侧发送获取第一多媒体直播流的请求,该获取第一多媒体直播流的请求中携带直播用户的直播地址,使该网络侧基于该直播地址,返回直播用户的第一多媒体直播流,当接收到网络侧发送的第一多媒体直播流时,解说终端向第一多媒体直播流中添加解说信息,得到第二多媒体直播流,解说终端将该第二多媒体直播流发送给网络侧,使该网络侧将第二多媒体直播流发送给观看用户终端,以实现多媒体直播,从而实现了多媒体直播流的异地解说,提高了多媒体直播的效率。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。
以上所述仅为本发明的较佳实施例,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。

Claims (17)

  1. 一种多媒体直播方法,应用于网络侧设备,所述方法包括:
    响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端;
    从所述解说终端接收第二多媒体直播流,其中所述第二多媒体直播流是所述解说终端在所述第一多媒体直播流中添加解说信息而生成;以及
    将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
  2. 如权利要求1所述的方法,还包括:
    接收直播采集终端发送的多媒体直播请求,所述多媒体直播请求携带直播地址和直播用户标识;
    基于所述直播用户标识,向所述直播采集终端发送多媒体直播响应,使所述直播采集终端接收到所述多媒体直播响应之后,基于所述直播地址返回所述第一多媒体直播流。
  3. 如权利要求2所述的方法,其中所述获取第一多媒体直播流的请求携带所述直播地址,并且所述方法还包括基于所述直播地址检索所述第一多媒体直播流并将所述第一多媒体直播流发送给所述解说终端。
  4. 如权利要求1所述的方法,其中,所述将所述第二多媒体直播流发送给观看用户终端,包括:
    接收观看用户终端发送的第一多媒体播放请求,所述第一多媒体播放请求中携带所述第二多媒体直播流的播放地址和观看用户标识;
    基于所述播放地址,获取所述第二多媒体直播流;
    基于所述观看用户标识,将获取的所述第二多媒体直播流发送给所述观看用户终端。
  5. 如权利要求1-4任一项权利要求所述的方法,其中,所述第一多媒体直播流采集自在直播采集终端上显示的内容。
  6. 一种多媒体直播方法,包括:
    向网络侧设备发送获取第一多媒体直播流的请求;
    从所述网络侧设备接收响应于所述请求发送的所述第一多媒体直播流;
    向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流;以及
    将所述第二多媒体直播流发送给所述网络侧设备,其中所述网络侧设备将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
  7. 如权利要求6所述的方法,其中,所述向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流,包括:
    播放所述第一多媒体直播流;
    在播放所述第一多媒体直播流的过程中,采集播放的第一多媒体直播流和解说用户对所述第一多媒体直播流的解说信息;
    基于所述第一多媒体直播流和所述解说信息,生成第二多媒体直播流。
  8. 如权利要求6所述的方法,其中,所述获取第一多媒体直播流的请求携带所述第一多媒体直播流的直播地址,所述网络侧设备基于所述直播地址检索所述第一多媒体直播流并将所述第一多媒体直播流发送给所述解说终端。
  9. 一种多媒体直播装置,包括一个或多个处理器和存储有程序模块的存储器,所述程序模块包括:
    第一发送模块,用于响应于从解说终端接收的获取第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端;
    第一接收模块,用于从所述解说终端接收第二多媒体直播流,其中所述第二多媒体直播流是所述解说终端在所述第一多媒体直播流中添加解说信息而生产;以及
    第二发送模块,用于将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
  10. 如权利要求9所述的装置,还包括:
    第二接收模块,用于接收直播采集终端发送的多媒体直播请求,所述多媒体直播请求携带直播地址和直播用户标识;
    第三发送模块,用于基于所述直播用户标识,向所述直播采集终端发送多媒体直播响应,使所述直播采集终端接收到所述多媒体直播响应之后,基于所述直播地址返回所述第一多媒体直播流。
  11. 如权利要求9所述的装置,其中所述获取第一多媒体直播流的请求携带所述直播地址,并且所述程序模块还包括检索模块,用于基于所述直播地址检索所述第一多媒体直播流。
  12. 如权利要求9所述的装置,其中,所述第二发送模块包括:
    接收单元,用于接收观看用户终端发送的第一多媒体播放请求,所述第一多媒体播放请求中携带所述第二多媒体直播流的播放地址和观看用户标识;
    获取单元,用于基于所述播放地址,获取所述第二多媒体直播流;
    发送单元,用于基于所述观看用户标识,将获取的所述第二多媒体直播流发送给所述观看用户终端。
  13. 如权利要求9-12任一项权利要求所述的装置,其中,所述第一多媒体直播流采集自在直播采集终端上显示的内容。
  14. 一种多媒体直播装置,包括一个或多个处理器和存储有程序模块的存储器,所述程序模块包括:
    发送模块,用于向网络侧发送获取第一多媒体直播流的请求;
    接收模块,用于从所述网络侧接收响应于所述请求发送的所述第一多媒体直播流;
    添加模块,用于向所述第一多媒体直播流中添加解说信息,得到第二多媒体直播流;
    所述发送模块还用于将所述第二多媒体直播流发送给所述网络侧,其中所述网络侧将所述第二多媒体直播流发送给观看用户终端,以实现多媒体直播。
  15. 如权利要求14所述的装置,其中,所述添加模块包括:
    播放单元,用于播放所述第一多媒体直播流;
    采集单元,用于在播放所述第一多媒体直播流的过程中,采集播放的第一多媒体直播流和解说用户对所述第一多媒体直播流的解说信息;
    生成单元,基于所述第一多媒体直播流和所述解说信息,生成第二多媒体直播流。
  16. 一种多媒体直播系统,包括直播采集终端、网络侧设备、解说终端、观看用户终端以及网络,其中所述直播采集终端、网络侧设备、解说终端及观看用户终端通过所述网络进行通信,
    所述直播采集终端用于采集第一多媒体直播流;
    所述网络侧设备用于响应于从解说终端接收的获取所述第一多媒体直播流的请求,将所述第一多媒体直播流发送给所述解说终端,从所述解说终端接收第二多媒体直播流,并将所述第二多媒体直播流发送给所述观看用户终端,以实现多媒体直播;
    解说终端,用于向所述网络侧设备发送获取所述第一多媒体直播流的所述请求,从所述网络侧设备接收所述第一多媒体直播流,向所述第一多媒体直播流中添加解说信息得到第二多媒体直播流,以及将所述第二多媒体直播流发送给所述网络侧设备;并且
    所述观看用户终端用于接收所述第二多媒体直播流并进行播放。
  17. 如权利要求16所述的多媒体直播系统,其中所述直播采集终端位于所述解说终端的远程。
PCT/CN2016/087444 2015-07-15 2016-06-28 多媒体直播方法、装置和系统 WO2017008627A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510417223.2A CN105025314B (zh) 2015-07-15 2015-07-15 多媒体直播方法与装置
CN201510417223.2 2015-07-15

Publications (1)

Publication Number Publication Date
WO2017008627A1 true WO2017008627A1 (zh) 2017-01-19

Family

ID=54414964

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/087444 WO2017008627A1 (zh) 2015-07-15 2016-06-28 多媒体直播方法、装置和系统

Country Status (2)

Country Link
CN (1) CN105025314B (zh)
WO (1) WO2017008627A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112312144A (zh) * 2019-07-31 2021-02-02 腾讯科技(深圳)有限公司 一种直播方法、装置、设备和存储介质
CN112383794A (zh) * 2020-12-01 2021-02-19 咪咕互动娱乐有限公司 直播方法、直播系统、服务器和计算机存储介质
CN112738540A (zh) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105025314B (zh) * 2015-07-15 2016-11-16 腾讯科技(深圳)有限公司 多媒体直播方法与装置
CN105407361A (zh) * 2015-11-09 2016-03-16 广州华多网络科技有限公司 一种音视频直播数据的处理方法和装置
CN105430424B (zh) * 2015-11-26 2018-12-04 广州华多网络科技有限公司 一种视频直播的方法、装置和系统
CN105791958A (zh) * 2016-04-22 2016-07-20 北京小米移动软件有限公司 游戏直播方法及装置
CN106101192B (zh) * 2016-05-31 2020-11-03 上海银赛计算机科技有限公司 信息交互方法和装置
CN106105244A (zh) 2016-06-12 2016-11-09 北京小米移动软件有限公司 上传视频的方法、装置及摄像装置
CN106507161B (zh) 2016-11-29 2019-11-15 腾讯科技(深圳)有限公司 视频直播方法及直播装置
CN106817628B (zh) * 2017-01-26 2019-12-20 成都市亚丁胡杨科技股份有限公司 一种网络直播平台
CN107360442A (zh) * 2017-08-29 2017-11-17 广州华多网络科技有限公司 一种直播方法、装置及电子设备
CN109769132B (zh) * 2019-01-15 2021-02-02 北京中视广信科技有限公司 一种基于帧同步的多路远程直播视频解说方法
CN109803154B (zh) * 2019-01-17 2020-12-11 腾讯科技(深圳)有限公司 棋类比赛的直播方法、设备及存储介质
CN109618178A (zh) * 2019-01-21 2019-04-12 北京奇艺世纪科技有限公司 一种直播方法、装置及系统
CN110661801B (zh) * 2019-09-26 2021-05-07 腾讯科技(深圳)有限公司 一种数据传输方法、装置、以及计算机存储介质
CN110935158B (zh) * 2019-12-02 2021-05-04 庄丰锴 篮球视频的交互方法、装置、智能篮球架及存储介质
CN111314714B (zh) * 2020-02-27 2021-06-01 腾讯科技(深圳)有限公司 一种游戏直播方法和装置
CN112561576A (zh) * 2020-12-08 2021-03-26 广州繁星互娱信息科技有限公司 直播应用的界面显示方法、装置、设备及存储介质
CN112788358B (zh) * 2020-12-31 2022-02-18 腾讯科技(深圳)有限公司 游戏对局的视频直播方法、视频发送方法、装置及设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090286604A1 (en) * 2008-05-16 2009-11-19 Microsoft Corporation Adaptive live commentary in hosted game
CN102325173A (zh) * 2011-08-30 2012-01-18 重庆抛物线信息技术有限责任公司 一种混音视频共享方法及系统
CN104135667A (zh) * 2014-06-10 2014-11-05 腾讯科技(深圳)有限公司 一种视频异地解说同步方法、终端设备,及系统
CN105025314A (zh) * 2015-07-15 2015-11-04 腾讯科技(深圳)有限公司 多媒体直播方法与装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8649659B2 (en) * 2010-10-06 2014-02-11 Motorola Mobility Llc Method and system for transitioning media output among two or more devices
CN103856787B (zh) * 2012-12-04 2017-02-22 上海文广科技(集团)有限公司 基于公网的带解说音频回传的直播系统及其直播方法
CN103218157B (zh) * 2013-03-04 2016-08-17 东莞宇龙通信科技有限公司 一种移动终端及解说信息的管理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090286604A1 (en) * 2008-05-16 2009-11-19 Microsoft Corporation Adaptive live commentary in hosted game
CN102325173A (zh) * 2011-08-30 2012-01-18 重庆抛物线信息技术有限责任公司 一种混音视频共享方法及系统
CN104135667A (zh) * 2014-06-10 2014-11-05 腾讯科技(深圳)有限公司 一种视频异地解说同步方法、终端设备,及系统
CN105025314A (zh) * 2015-07-15 2015-11-04 腾讯科技(深圳)有限公司 多媒体直播方法与装置

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112312144A (zh) * 2019-07-31 2021-02-02 腾讯科技(深圳)有限公司 一种直播方法、装置、设备和存储介质
CN112312144B (zh) * 2019-07-31 2022-11-29 腾讯科技(深圳)有限公司 一种直播方法、装置、设备和存储介质
CN112383794A (zh) * 2020-12-01 2021-02-19 咪咕互动娱乐有限公司 直播方法、直播系统、服务器和计算机存储介质
CN112383794B (zh) * 2020-12-01 2023-10-20 咪咕互动娱乐有限公司 直播方法、直播系统、服务器和计算机存储介质
CN112738540A (zh) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质
CN112738540B (zh) * 2020-12-25 2023-09-05 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质

Also Published As

Publication number Publication date
CN105025314B (zh) 2016-11-16
CN105025314A (zh) 2015-11-04

Similar Documents

Publication Publication Date Title
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
US10841661B2 (en) Interactive method, apparatus, and system in live room
CN106791892B (zh) 一种轮麦直播的方法、装置和系统
JP6450029B2 (ja) 広告プッシュシステム、装置及び方法
JP6522014B2 (ja) ビデオリモートコメンタリー同期方法及びシステム並びにターミナルデバイス
WO2017020663A1 (zh) 弹幕视频直播方法、装置、视频源设备及网络接入设备
WO2017076143A1 (zh) 视频的直播流转点播数据的方法、装置及系统
TWI565315B (zh) 基於視頻的交互方法、終端、伺服器及系統
WO2017202348A1 (zh) 一种视频播放方法、装置及计算机存储介质
WO2018192415A1 (zh) 数据的直播方法、相关设备及系统
JP6430656B2 (ja) コンテンツアイテムを表示するシステム、方法、及び装置
CN107333162B (zh) 一种播放直播视频的方法和装置
KR20190086517A (ko) 생방송방 비디오 스트림 전송 제어방법, 해당 서버 및 이동단말
WO2021083168A1 (zh) 视频分享方法及电子设备
CN103391473B (zh) 一种提供及获取音视频的方法和装置
WO2018184266A1 (zh) 直播频道中的通信方法、装置及系统
CN106973330B (zh) 一种屏幕直播方法、装置和系统
WO2017215661A1 (zh) 一种场景音效的控制方法、及电子设备
WO2017215660A1 (zh) 一种场景音效的控制方法、及电子设备
CN106254910B (zh) 一种记录图像的方法和装置
WO2018205786A1 (zh) 分享录屏视频的方法、装置及设备
CN113986167A (zh) 投屏控制方法、装置、存储介质及显示设备
WO2018095130A1 (zh) 一种确定直播时长的方法和系统
CN104967608B (zh) 播放多媒体文件的方法、移动终端及固定终端
WO2017215511A1 (zh) 一种场景音效的控制方法、及相关产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16823774

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16823774

Country of ref document: EP

Kind code of ref document: A1