WO2018094556A1 - 直播间视频流推送控制方法及相应的服务器与移动终端 - Google Patents

直播间视频流推送控制方法及相应的服务器与移动终端 Download PDF

Info

Publication number
WO2018094556A1
WO2018094556A1 PCT/CN2016/106755 CN2016106755W WO2018094556A1 WO 2018094556 A1 WO2018094556 A1 WO 2018094556A1 CN 2016106755 W CN2016106755 W CN 2016106755W WO 2018094556 A1 WO2018094556 A1 WO 2018094556A1
Authority
WO
WIPO (PCT)
Prior art keywords
video stream
terminal
live
live video
server
Prior art date
Application number
PCT/CN2016/106755
Other languages
English (en)
French (fr)
Inventor
李学凌
胡建强
陈健鸿
吴晨
Original Assignee
广州市百果园信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州市百果园信息技术有限公司 filed Critical 广州市百果园信息技术有限公司
Priority to KR1020197017630A priority Critical patent/KR102257646B1/ko
Priority to PCT/CN2016/106755 priority patent/WO2018094556A1/zh
Priority to CN201680002272.2A priority patent/CN107005721B/zh
Priority to JP2019528445A priority patent/JP6818144B2/ja
Priority to EP16922245.2A priority patent/EP3547697A4/en
Priority to US16/463,065 priority patent/US11616990B2/en
Publication of WO2018094556A1 publication Critical patent/WO2018094556A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0815—Network architectures or network communication protocols for network security for authentication of entities providing single-sign-on or federations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25875—Management of end-user data involving end-user authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743—Video hosting of uploaded data from client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring

Definitions

  • the present invention relates to the field of network live broadcast technology, and in particular, to a video stream push control method between live broadcasts and a corresponding server and mobile terminal.
  • the current live broadcast platform includes a live broadcast platform for the mobile terminal and a live broadcast platform for the PC.
  • the anchor needs to simultaneously broadcast the content on the PC (such as the game screen on the PC) and the anchor personal image to better interact with the viewing user.
  • the live broadcast method is called multi-view or multi-view.
  • the platform is broadcast live, and the current multi-view simultaneous live broadcast adopts the following schemes:
  • the general WEB live broadcast platform uses the WEB end background plus the third-party live streaming software for live broadcast. After the user registers the account on the WEB-side live broadcast platform and obtains the live broadcast permission of the WEB end through the process, the user needs to measure the speed for the personal network, and according to the specified
  • the third-rate live streaming software is configured at the code rate. The process is not only complicated, but also needs to master various settings of the third-party live broadcast software, and needs manual speed measurement and configuration, which is inconvenient for multi-platform live broadcast.
  • the mobile terminal uses manual mode for cross-platform live broadcast:
  • the user can pass The direction and position of the mobile camera are adjusted, and the multi-view live broadcast is performed in the form of manual broadcast; the operation is relatively simple, but because the range of the live broadcast and the content of the live broadcast are difficult to be guaranteed, the quality of the live broadcast is low, and the camera at the mobile end is also used.
  • the broadcast of content on other platforms affects the user's operation during the live broadcast and interaction with the viewer, which has a great impact on the interactive effect during the live broadcast.
  • the primary object of the present invention is to provide a live stream video stream push control method and a server for performing the method steps.
  • Another object of the present invention is to provide a live stream video stream push control method and a mobile terminal that performs the method steps.
  • the present invention provides a live stream video stream push control method, which is executed by a server and includes the following steps:
  • the server sends the received first live video stream uploaded by the first terminal to the second terminal;
  • the server receives a third live video stream that is merged between the second live video stream and the first live video stream that is uploaded by the second terminal, and is pushed to a member user of the live broadcast room.
  • the server sends, according to the pre-protocol information, the unique device identifier of the first terminal, the identity information of the anchor user, and the feature information of the live broadcast to the second terminal according to the pre-protocol information, to upload the first terminal.
  • a live video stream is sent to the second terminal.
  • the steps are further included:
  • the server sends a control instruction for collecting the second live video stream to the second terminal, to generate a control window for collecting the second live video stream on the user interface of the second terminal.
  • the first, second, and third live video streams each include an image stream and an audio stream
  • the third live video stream includes an image stream of at least one of the first live video stream and the second live video stream.
  • An audio stream of at least one of the two is also included.
  • the present invention further provides a live stream video stream push control method, which is performed by a first terminal, and includes the following steps:
  • the first terminal acquires the pre-protocol information output by the second terminal, and initiates a connection request including the pre-protocol information to the server as the anchor user identity;
  • the first terminal uploads the locally generated first live video stream to the server in response to the confirmation instruction of the anchor user.
  • the pre-protocol information is characterized by a two-dimensional code
  • the first terminal acquires the pre-protocol information by scanning a two-dimensional code by a camera.
  • the first terminal provides an operation interface for confirming the connection, in response to the confirmation command of the anchor user, after receiving the confirmation instruction of the anchor user. Upload the locally generated first live video stream to the server.
  • the method further includes the following steps:
  • the first terminal sends a control instruction for collecting the second live video stream to the second terminal by using the server, to generate a control window for collecting the second live video stream on the user interface of the second terminal.
  • the present invention further provides a live stream video stream push control method, which is performed by a second terminal, and includes the following steps:
  • the second terminal outputs a link identifier that represents the pre-protocol information
  • the second terminal collects the local second live video stream, and merges at least one of the first live video stream and the second video stream into a third live video stream, and uploads the same to the server to make the server broadcast to the live stream. At least one user in between pushes the third live video stream.
  • the pre-protocol information includes a unique device identifier of the second terminal.
  • the second terminal receives the first live video stream and collects the second live video.
  • the process of streaming and the process of merging the third live video stream work in parallel with the process of uploading the third live video stream.
  • the present invention further provides a server configured to perform the following steps:
  • a third live video stream that is formed by combining at least one of the second live video stream and the first live video stream, and pushes the third live video stream to the member user of the live broadcast room.
  • the present invention further provides a mobile terminal configured to perform the following steps:
  • the locally generated first live video stream is uploaded to the server in response to the confirmation command of the anchor user.
  • the present invention further provides a mobile terminal configured to perform the following steps:
  • the present invention further provides a live stream video stream push control system, including a first terminal, at least two terminals of the second terminal, and a server for establishing a communication connection therewith, wherein:
  • the second terminal outputs a link identifier that represents pre-protocol information
  • the first terminal acquires pre-protocol information output by the second terminal, and initiates a connection request including the pre-protocol information to the server as an anchor user identity, where Responding to the confirmation command of the anchor user, the terminal uploads the locally generated first live video stream to the server, and the server sends the first live video stream uploaded by the first terminal to the second terminal in response to the connection request.
  • the server Receiving, by the second terminal, the server a first live video stream, and combining at least one of the first live video stream and the locally collected second live video stream into a third live video stream, and uploading the third live video stream to a server, where The server receives the third live video stream uploaded by the second terminal, and pushes it to the member user of the live broadcast room.
  • the present invention has the following advantages:
  • the present invention considers that the live content of the live broadcast includes video stream, audio stream, barrage information, gift information, etc. Based on the separation and merge technology of the live video stream, the live video stream of different terminals is merged through the host user terminal and uploaded to the server. Then, the server pushes the merged video stream to each viewing user in the live broadcast room, reducing the pressure on the server to merge the video stream too much, and saving resources.
  • the present invention uses the mobile terminal as the anchor to perform the fast login and authentication entry of the live broadcast.
  • the live broadcast application on the mobile terminal is configured with the portal of the active broadcast to quickly open the live broadcast, and the user can quickly open the mobile terminal only after logging in to the live broadcast platform account.
  • Live broadcast in conjunction with the fast-automatic live support when the PC does not add third-party peripherals, the live client on the PC can quickly and automatically configure the live parameters to record on the PC if the third-party external camera is not added.
  • Software/desktop screen greatly reduces the opening threshold of multi-end video stream, enabling faster and more flexible multi-platform live broadcast process.
  • the present invention is based on the mobile terminal and the PC-side account separation system, and utilizes the higher-performance image processing capability of the PC end, and the convenience of the mobile terminal to quickly open the live broadcast, and the live broadcast content is processed, merged, and uploaded to the PC.
  • the server is then pushed by the server to each viewing user in the live broadcast to ensure the time synchronization of the live video stream.
  • the present invention combines the advantages of the video live client of the mobile terminal and the PC end, simplifies the operation steps of the multi-platform and multi-view live broadcast, and reduces the technical threshold of multi-platform and multi-view live broadcast, so that the anchor user uses multiple platforms, Multi-view simultaneous live broadcast is more convenient and faster, improving live broadcast efficiency and enhancing user experience.
  • FIG. 1 is a schematic flow chart of an embodiment of a method for controlling video stream push between live broadcasts according to the present invention
  • FIG. 2 is a schematic diagram showing an embodiment of displaying a merge mode selection window on a first terminal operation interface after the server establishes a connection with the first terminal;
  • FIG. 3 is a schematic diagram of an embodiment of a third live video stream of the present invention.
  • FIG. 4 is a schematic flow chart of an embodiment of a video stream push control method for live broadcast according to the present invention.
  • FIG. 5 is a schematic diagram of an operation interface of the first terminal acquiring pre-protocol information
  • FIG. 6 is a schematic diagram of an embodiment of a video stream push control device for live broadcast according to the present invention.
  • FIG. 7 is a schematic diagram of an embodiment of a live stream video stream push control apparatus according to the present invention.
  • FIG. 8 is a schematic diagram of an embodiment of a live stream video stream push control apparatus according to the present invention.
  • FIG. 9 is a schematic structural diagram of an embodiment of a mobile terminal according to the present invention.
  • FIG. 10 is a schematic diagram of a system for implementing a live video stream push control method according to the present invention.
  • terminal and terminal device used herein include both a wireless signal receiver device, a device having only a wireless signal receiver without a transmitting capability, and a receiving and transmitting hardware.
  • Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver.
  • PCS Personal Communications Service
  • PDA Personal Digital Assistant
  • terminal may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form.
  • the "terminal” and “terminal device” used herein may also be a communication terminal, an internet terminal, a music/video playing terminal, and may be, for example, a PDA, a MID (Mobile Internet Device), and/or have a music/video playback.
  • Functional mobile phones can also be smart TVs, set-top boxes and other devices.
  • the remote network device used herein includes, but is not limited to, a computer, a network host, a single network server, a plurality of network server sets, or a cloud composed of multiple servers.
  • the cloud is composed of a large number of computers or network servers based on Cloud Computing, which is a kind of distributed computing, a super virtual computer composed of a group of loosely coupled computers.
  • the communication between the remote network device, the terminal device and the WNS server can be implemented by any communication method, including but not limited to, mobile communication based on 3GPP, LTE, WIMAX, TCP/IP, UDP protocol. Computer network communication and short-range wireless transmission based on Bluetooth and infrared transmission standards.
  • the user interface/operation interface of the present invention generally refers to a display interface that can be used to send control instructions to the smart terminal.
  • it can be an option (or a button in the setting page of the Android system).
  • Adding by the application, the same below) may also be an option in the notification bar or interactive page called from the desktop, or may be the application An option in a page constructed by an active component of the sequence.
  • the live broadcast room includes the following meanings: 1 a virtual space (or virtual room) created based on the webcast platform.
  • the live broadcast room is generally created by the anchor client and connected to multiple viewing clients, that is, live broadcast.
  • the anchor and the plurality of viewers are included in the room, and the viewing client located in the virtual space can watch the live content of the anchor client, and the user of the anchor client and the user who views the client, the user who views the client, and the user who views the client.
  • 2 an instant messaging platform that aggregates users together in groups, such as a video conferencing system, where users log in to the client to enter the group, and the user is in the group.
  • the group exists as a member of the group.
  • the same group contains multiple group members.
  • the user can join or leave the group arbitrarily. Within the group, various interactions such as text, voice, and video can be performed.
  • FIG. 1 is a schematic flowchart of an embodiment of a video stream push control method in a live broadcast according to the present invention.
  • the method is performed by a network device, where the network device includes but is not limited to a single network server and multiple network servers.
  • a server group or a Cloud Computing-based cloud consisting of a large number of hosts or network servers, including steps S100-S120:
  • Step S100 Receive a connection request initiated by the anchor user of the live broadcast from the first terminal and include pre-protocol information output by the second terminal.
  • the first terminal of the anchor user of the live broadcast identifies the link identifier of the pre-protocol information output by the second terminal, and then obtains the pre-protocol information, and then the first terminal initiates a connection request including the pre-protocol information to the server, and the server receives The connection request is made for subsequent processing.
  • the pre-protocol information includes a unique device identifier of the second terminal and an authorization token or authentication information for establishing a dedicated link between the server and the terminal, and the pre-protocol information is processed by using an encryption method and stored in the representation pre-protocol.
  • the link identifier of the information the corresponding authorized application must parse and obtain the pre-protocol information from the link identifier.
  • the secret mode and the link identifier for characterizing the pre-protocol information are defined by each live broadcast platform, and the pre-protocol information can be obtained after the application code authorized by the live broadcast platform identifies the link identifier.
  • the link identifier for characterizing the pre-protocol information is outputted by a two-dimensional code
  • the two-dimensional code is black and white graphic record data distributed on a two-dimensional plane by a predetermined geometric pattern according to a predetermined rule.
  • Symbol information the two-dimensional code skillfully uses the concept of "0" and "1" bitstreams that form the basis of the computer's internal logic, and uses multiple geometric shapes corresponding to binary to represent text, numerical values, etc.
  • the two-dimensional code is read by the image input device or the photoelectric scanning device to obtain information contained in the two-dimensional code.
  • the two-dimensional code has multiple commonalities of bar code technology: each code has its own specific character set; each character occupies a predetermined width; and has a certain check function and the like.
  • Step S110 Send the first live video stream uploaded by the received first terminal to the second terminal in response to the connection request.
  • the server verifies the pre-protocol information in the response to the connection request. If the pre-protocol information matches the pre-protocol information rule defined by the live broadcast platform, the connection request is a legal connection request, and the unique device identifier of the first terminal is used. The identity information of the anchor user and the feature information of the live broadcast are sent to the second terminal to establish a dedicated communication link with the second terminal, and then the first live video stream uploaded by the received first terminal is sent to the second terminal. .
  • the server receives the connection request and establishes a dedicated network communication link with the second terminal
  • the information about completing the connection with the second terminal is fed back to the first terminal, and the confirmation from the first terminal is received.
  • the first live video stream uploaded by the first terminal is delivered to the second terminal.
  • sending, by the second terminal, a control instruction for collecting the second live video stream to generate a control window for collecting the second live video stream on the user interface of the second terminal, and then the anchor user selects the second live video in the control window.
  • the streamed video source can quickly capture the second live video stream.
  • Step S120 Receive a third live video stream that is merged between the second live video stream and the first live video stream that is uploaded by the second terminal, and push the third live video stream to the member user of the live broadcast room.
  • the first, second, and third live video streams each include an image stream and an audio stream
  • the third live video stream includes an image stream of at least one of the first live video stream and the second live video stream.
  • An audio stream of at least one of the two is also included, and the types of the third live video stream include:
  • FIG. 4 is a schematic diagram of an embodiment of a third live video stream of the present invention, including an image stream of a first live video stream and an image stream of a second live video stream, and may further include an audio stream of the two, where The image stream of a live video stream is the character window shown in the figure, and the image stream of the second live video stream is an image window of the “PC screen” shown in the figure, which realizes multi-view and cross-platform synchronous live broadcast.
  • the on/off option of the corresponding video stream and the audio stream is provided on the first terminal and the second terminal for the anchor user to select, and when the anchor user selects to turn on/off the image stream or the audio stream of a certain video stream,
  • the corresponding synthesized third live video stream is changed accordingly, so that the anchor user can better display the content of the live broadcast according to the need.
  • the anchor user wants to temporarily close the image stream and the audio stream of the first live video stream, and interact better with the audience user through the second video stream and the audio stream.
  • the anchor user can select to close the first live video stream on the first terminal, and the second live video stream collected by the second terminal is used as the merged third video stream, and then the server receives the second terminal upload. After the third live video stream is pushed to the audience member of the live broadcast room; preferably, the anchor user can also select to close the first live video stream on the second terminal, and the server no longer delivers the first live video stream.
  • the first live video stream and the audio stream on/off option button provided on the second terminal user interface are connected after the anchor user selects the "close” option button
  • the communication link of the first live video stream is closed, and the first live video stream is no longer received.
  • the anchor user may further set the image stream of the first live video stream and the image area of the second live video stream, and the corresponding combined third
  • the live video stream is modified according to the modification of the first live video stream and the second live video stream, and the modified third live video stream is uploaded to the server, and the server further pushes the third live video stream to the live broadcast room.
  • FIG. 3 is a schematic flowchart of an embodiment of a video stream push control method in a live broadcast of the present invention.
  • the method is performed by a first terminal, and the first terminal is preferably a mobile terminal.
  • the method may also be understood to be performed by a video live application on the first terminal, including steps S200-S220:
  • Step S200 Acquire pre-protocol information output by the second terminal, and initiate a connection request including the pre-protocol information to the server as the anchor user identity.
  • the pre-protocol information includes a unique device identifier of the second terminal and an authorization token or authentication information for establishing a dedicated link between the server and the terminal, and the pre-protocol information is processed by using an encryption method and stored in the representation pre-protocol.
  • the link identifier of the information the corresponding authorized application must parse and obtain the pre-protocol information from the link identifier.
  • the encryption mode of the pre-protocol information and the link identifier for characterizing the pre-protocol information are defined by each live broadcast platform, and the pre-protocol information can be obtained after the application code authorized by the live broadcast platform identifies the link identifier.
  • the first terminal of the anchor user of the live broadcast identifies the link identifier of the pre-protocol information output by the second terminal, and then obtains the pre-protocol information, that is, the user runs the live video application on the first terminal and uses the anchor identity to Forming a representation form of the pre-protocol information, identifying a link identifier that represents the pre-protocol information, acquiring the pre-protocol information, and then initiating a connection request including the pre-protocol information to the server, to use the server to identify the unique device identifier of the first terminal, and the anchor
  • the identity information of the user and the feature information of the live broadcast are sent to the second terminal, where the identity information of the anchor user is the anchor user UID on the live broadcast platform, and is used to represent the unique one of the anchor users.
  • the feature information of the live broadcast room is the live broadcast room.
  • Channel ID As shown in FIG. 5, it is an operation interface diagram of the first terminal acquiring pre-protocol information.
  • the scan box is displayed by clicking a button such as “PC live broadcast” pointed by the arrow in FIG. 5, and then scanning the second terminal by using a two-dimensional code.
  • the form output represents the link identifier of the pre-protocol information, and then obtains the corresponding pre-protocol information, and simultaneously initiates a connection request including the pre-protocol information to the server as the anchor identity.
  • Step S210 Upload the locally generated first live video stream to the server in response to the confirmation instruction of the anchor user.
  • the server verifies the pre-protocol information in the response to the connection request, and if the pre-protocol information matches the pre-protocol information rule defined by the live broadcast platform, the connection request is regarded as a legal connection request, and then the first terminal is unique.
  • the device identifier, the identity information of the anchor user, and the feature information of the live broadcast are sent to the second terminal to establish a dedicated communication link with the second terminal; after the server establishes a dedicated communication link with the second terminal, the first terminal is After the first terminal receives the prompt information, the first terminal generates an operation interface for confirming the connection on the user interface of the first terminal, and is configured to receive an acknowledgement instruction of the anchor user, for example, on the user interface of the first terminal.
  • a button such as a "confirm" connection is provided, and the first live video stream generated locally is uploaded to the server when the confirmation command of the anchor user is received, so that the server delivers the first live video stream to the second terminal.
  • the first terminal sends a control instruction for collecting the second live video stream to the second terminal by using the server, so as to generate a control window for collecting the second live video stream on the user interface of the second terminal.
  • the anchor user selects the video source of the second live video stream in the control window, and the second live video stream can be quickly collected.
  • FIG. 3 is a schematic flowchart of another embodiment of a video stream push control method in a live broadcast according to the present invention.
  • the method is performed by a second terminal, and considering the image processing performance of the terminal,
  • the second terminal is preferably a PC, and the method is also understood to be performed by a video live client on the second terminal, including steps S300-S320:
  • Step S300 Output a link identifier that represents the pre-protocol information.
  • the pre-protocol information includes a unique device identifier of the second terminal and an authorization token or authentication information for establishing a dedicated link between the server and the terminal, and the pre-protocol information is processed by using an encryption method and stored in the representation pre-protocol.
  • the link identifier of the information the pre-protocol information must be parsed and obtained from the link identifier by the corresponding authorized application.
  • the encryption method of the pre-protocol information and the link identifier for characterizing the pre-protocol information are used by each live broadcast platform. The pre-protocol information can be obtained by the application that is authorized by the live broadcast platform to identify the link identifier.
  • the link identifier that represents the pre-protocol information is output by using a two-dimensional code.
  • a button on the video live client operating interface on the PC side is provided with a button such as “share live broadcast”, which is used to generate the link identifier of the pre-protocol information and present it on the user interface of the terminal.
  • the “share live broadcast” button After the user clicks the “share live broadcast” button, Outputting a two-dimensional code on the operation interface of the live video client, and the video broadcast client on the first terminal authorized by the live broadcast platform can obtain the pre-protocol letter by scanning the two-dimensional code. interest.
  • Step S310 Receive a first live video stream delivered by the server, in response to the connection request initiated by the first terminal to the server that includes the pre-protocol information.
  • the first terminal of the anchor user in the live broadcast identifies the link identifier of the pre-protocol information output by the second terminal, and then obtains the pre-protocol information, and then the first terminal initiates a connection request including the pre-protocol information to the server,
  • the second terminal responds to the request to receive the unique device identifier of the first terminal, the identity information of the anchor user, and the feature information between the live broadcasts, thereby establishing a dedicated communication link with the server, and then receiving the server through the dedicated link.
  • the first live video stream sent.
  • the first server sends the first delivery. Live video stream.
  • Step S320 Collect a local second live video stream, and merge at least one of the first live video stream and the second video stream into a third live video stream, and upload the same to the server to make the server broadcast to the live stream. At least one user in between pushes the third live video stream.
  • the image stream of the second live video stream collected by the second terminal includes a process picture (such as a game window picture) and a desktop picture (ie, the entire desktop picture of the second terminal), so the control window includes the above two image stream selections.
  • the user collects the corresponding video source as the second live video stream according to his own needs.
  • the anchor user selects to push the third live video stream
  • the second terminal merges the first live video stream and the second live video stream into the third live video stream while collecting the second live video stream
  • the third live video stream is uploaded to the server, so that the server pushes the third live video stream to at least one user in the live room.
  • Parallel work refers to the completion of two or more jobs of the same or different nature at the same time or within the same time interval.
  • Parallel work has 1 time overlap: adjacent processes are wrong in time. Open, use overlapping parts of the same set of hardware in turn; 2Resource sharing: Let multiple users use the same set of resources in turn in a certain time sequence to improve resource utilization; 3Repetition of resources: repeatedly set hardware resources and improve hardware reliability And performance.
  • the parallel operation means that the second terminal can synchronously/synchronize the second live video stream when receiving the first live video stream, and simultaneously/synchronize the received first live stream.
  • the video stream and the collected second live video stream are merged into a third live video stream, and the third live video stream is simultaneously/synchronized to be uploaded to the server, ensuring simultaneous/synchronization of the live video stream.
  • the image stream of the corresponding first and second live video streams and the on/off option of the audio stream are provided on the second terminal for the anchor user to select, and when the anchor user selects to turn on/off the image of a live video stream.
  • the corresponding synthesized third live video stream changes, allowing the anchor user to better display the content of the live broadcast as needed.
  • the anchor user may further set an image stream of the first live video stream and a display area size of the image stream of the second live video stream, and the corresponding combined third live video stream is Modifying the modification of the first live video stream and the second live video stream, and uploading the modified third live video stream to the server, and then pushing the third live video stream to the live broadcast room to provide the host broadcast user More custom choices to ensure the live content of the live broadcast.
  • a live broadcast video stream push control apparatus comprising: a receiving request module: configured to receive an anchor user of the live broadcast room from a first terminal The initiated connection request includes the pre-protocol information output by the second terminal; the response requesting module is configured to send the received first live video stream uploaded by the first terminal to the second terminal in response to the connection request; the video push module And a third live video stream that is formed by combining the second live video stream and the first live video stream that is uploaded by the second terminal, and is sent to a member user of the live broadcast room.
  • a live broadcast video stream push control apparatus comprising: an obtaining module: configured to acquire pre-protocol information output by the second terminal, and The anchor user identity initiates a connection request including the pre-protocol information to the server; and the sending module is configured to upload the locally generated first live video stream to the server in response to the confirmation instruction of the anchor user.
  • a live stream video stream push control apparatus includes: an output module: configured to output a link identifier that represents pre-protocol information; a receiving module: configured to receive, by the first terminal, a connection request that includes the pre-protocol information to the server, to receive a first live video stream that is sent by the server, and a merge module that is configured to collect a local second live video stream, and Merging at least one of the first live video stream and the second video stream into a third live video stream, and uploading the same to the server, so that the server pushes the third live video stream to at least one user in the live room .
  • the present invention further provides a server, including a processor, configured to perform the following steps:
  • a third live video stream that is formed by combining at least one of the second live video stream and the first live video stream, and pushes the third live video stream to the member user of the live broadcast room.
  • the present invention further provides a mobile terminal, including a processor, a memory, a touch-sensitive display, and a camera, wherein the processor is configured to perform the following steps:
  • the locally generated first live video stream is uploaded to the server in response to the confirmation command of the anchor user.
  • the present invention further provides a mobile terminal configured to perform the following steps:
  • FIG. 9 is a schematic structural diagram of an embodiment of a mobile terminal according to the present invention.
  • the mobile terminal can be any mobile terminal, tablet, PDA (Personal Digital Assistant), POS (Point of Sales), on-board computer, and the like, and the mobile terminal is used as a mobile phone as an example:
  • the mobile phone includes: a radio frequency (RF) circuit 910, a memory 920, an input unit 930, a display unit 940, a sensor 950, an audio circuit 960, a wireless fidelity (WiFi) module 970, and a processor 980. And power supply 990 and other components.
  • RF radio frequency
  • the structure of the handset shown in FIG. 9 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different components may be arranged.
  • the RF circuit 910 can be used for receiving and transmitting signals during and after receiving or transmitting information, in particular, after receiving the downlink information of the base station, and processing it to the processor 980; in addition, transmitting the designed uplink data to the base station.
  • RF circuit 910 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
  • LNA Low Noise Amplifier
  • RF circuitry 910 can also communicate with the network and other devices via wireless communication.
  • the above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.
  • GSM Global System of Mobile communication
  • GPRS General Packe
  • the memory 920 can be used to store software programs and modules, and the processor 980 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 920.
  • the memory 920 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
  • memory 920 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the input unit 930 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset.
  • the input unit 930 may include a touch panel 931 and other input devices 932.
  • the touch panel 931 also referred to as a touch screen, can collect touch operations on or near the user (such as a user using a finger, a stylus, or the like on the touch panel 931 or near the touch panel 931. Operation) and according to a preset program Drive the corresponding connecting device.
  • the touch panel 931 can include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 980 is provided and can receive commands from the processor 980 and execute them.
  • the touch panel 931 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 930 may also include other input devices 932.
  • other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 940 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone.
  • the display unit 940 can include a display panel 941.
  • the display panel 941 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch panel 931 can cover the display panel 941. When the touch panel 931 detects a touch operation on or near the touch panel 931, the touch panel 931 transmits to the processor 980 to determine the type of the touch event, and then the processor 980 according to the touch event. The type provides a corresponding visual output on display panel 941.
  • touch panel 931 and the display panel 941 are used as two independent components to implement the input and input functions of the mobile phone in FIG. 9, in some embodiments, the touch panel 931 and the display panel 941 may be integrated. Realize the input and output functions of the phone.
  • the handset may also include at least one type of sensor 950, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 941 according to the brightness of the ambient light, and the proximity sensor may close the display panel 941 and/or when the mobile phone moves to the ear. Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • the gesture of the mobile phone such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration
  • vibration recognition related functions such as pedometer, tapping
  • the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • An audio circuit 960, a speaker 961, and a microphone 962 can provide an audio interface between the user and the handset.
  • the audio circuit 960 can transmit the converted electrical data of the received audio data to the speaker 961.
  • the speaker 961 converts the sound signal into an audio signal output.
  • the microphone 962 converts the collected sound signal into an electrical signal, which is received by the audio circuit 960 and converted into audio data, and then processed by the audio data output processor 980 through the RF circuit. 910 is sent to, for example, another handset, or audio data is output to memory 920 for further processing.
  • WiFi is a short-range wireless transmission technology
  • the mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 970, which provides users with wireless broadband Internet access.
  • FIG. 9 shows the WiFi module 970, it can be understood that it does not belong to the essential configuration of the mobile phone, and can be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 980 is the control center of the handset, which connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 920, and invoking data stored in the memory 920, executing The phone's various functions and processing data, so that the overall monitoring of the phone.
  • the processor 980 may include one or more processing units; preferably, the processor 980 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 980.
  • the handset also includes a power source 990 (such as a battery) that supplies power to the various components.
  • a power source 990 such as a battery
  • the power source can be logically coupled to the processor 980 through a power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the handset also includes a camera and is electrically coupled to the processor 980 and other components of the handset.
  • FIG. 10 is a schematic diagram of a system for controlling a video stream push between live broadcasts according to the present invention, including a first terminal, a second terminal, a plurality of servers, and a plurality of viewing users.
  • the system schematic diagram illustrates the method of the present invention.
  • the main flow chart wherein the anchor user initiates a connection request including the pre-protocol information output by the second terminal from the first terminal to the identity server, and the identity device verifies the pre-protocol information, and then the unique device identifier of the first terminal and the anchor user
  • the identity information and the feature information of the live broadcast are sent to the second terminal, and then the video stream server establishes a communication link with the first terminal to receive the first live video stream uploaded by the first terminal, and establish a dedicated chain with the second terminal.
  • the first live video stream is sent to the second terminal by using the dedicated link, and the second terminal simultaneously collects the local second live video stream, and then at least one of the first live video stream and the second live video stream. Synthesizing the third live video stream and uploading it to the video stream server, and then the third live video stream by the video stream server Push to each user in the live room, A, B, C.
  • the following example illustrates an implementation process of the present invention in combination with a server, a first terminal (mobile terminal), and a second terminal (PC terminal).
  • the user needs to quickly open and simultaneously broadcast the game screen and personal image, firstly open the video live broadcast application on the mobile terminal.
  • Program quickly create a live broadcast room after logging in to the live platform account. At this time, the user is the host broadcast user.
  • the user interface on the end outputs a link identifier that represents the pre-protocol information (using a two-dimensional code as a link identifier for characterizing the pre-protocol information), and then the user clicks the “PC live broadcast” button on the mobile terminal to pop up a two-dimensional code scanning interface.
  • the camera of the mobile terminal scans the two-dimensional code outputted on the PC end interface, obtains the pre-protocol information of the representation, and initiates a connection request containing the pre-protocol information to the server, and after the server completes the request verification, the unique device identifier of the mobile terminal and the anchor user are used.
  • the UID and the channel ID of the live broadcast are sent to the PC.
  • the video stream server and the mobile terminal and the PC end are established.
  • the communication link is connected to the first terminal, and the user completes the confirmation connection on the mobile terminal, and then uploads the locally generated first live video stream to the video stream server, where the video stream server A live video stream is sent to the PC, and then the user selects the video source to be collected as the second live video stream on the PC, and then the PC combines the received first live video stream with the locally collected second live video stream.
  • the third live video stream, and the user can adjust and control the image picture size ratio of the first and second live video streams on the PC side to better display the live content, and finally merge the third live video into the PC end.
  • the stream is uploaded to the video stream server, and the third live video stream is pushed by the video stream server to each viewing user in the live broadcast room.
  • a live stream video stream push control method includes the following steps:
  • a third live video stream that is formed by combining at least one of the second live video stream and the first live video stream, and pushes the third live video stream to the member user of the live broadcast room.
  • the method further includes the step of: sending a control instruction for collecting the second live video stream to the second terminal, to Generating a control window for collecting the second live video stream on the user interface of the second terminal;
  • the subsequent steps are continued when an acknowledgment command from the first terminal is received.
  • the locally generated first live video stream is uploaded to the server in response to the confirmation command of the anchor user.
  • the pre-protocol information is characterized by a two-dimensional code, and the pre-protocol information is obtained by scanning a two-dimensional code by a camera;
  • the operation interface for confirming the connection is provided in response to the confirmation instruction of the anchor user, to upload the locally generated content to the server after receiving the confirmation instruction of the anchor user.
  • the another method for controlling the video stream to be sent between the live broadcasts further includes the following steps: sending, by the server, a control instruction for collecting the second live video stream to the second terminal, to generate and collect the second live video stream on the user interface of the second terminal Control window.
  • a third live broadcast video stream push control method including the following steps:
  • the process of receiving the first live video stream and the process of collecting the second live video stream and the process of merging the third live video stream work in parallel with the process of uploading the third live video stream.
  • a live stream video stream push control device comprising:
  • a receiving request module configured to receive a connection request that is sent by the anchor user in the live broadcast from the first terminal and includes pre-protocol information output by the second terminal;
  • the response requesting module is configured to send the first live video stream uploaded by the received first terminal to the second terminal in response to the connection request;
  • the video push module is configured to receive a third live video stream that is merged by the second live video stream and the first live video stream and is sent to the member of the live broadcast room. user.
  • a live stream video stream push control device comprising:
  • An obtaining module configured to acquire pre-protocol information output by the second terminal, and initiate a connection request including the pre-protocol information to the server as an anchor user identity;
  • the sending module is configured to upload a locally generated first live video stream to the server in response to the confirmation instruction of the anchor user.
  • a live stream video stream push control device comprising:
  • Output module used to output a link identifier that represents pre-protocol information
  • a receiving module configured to receive a first live video stream delivered by the server, in response to the connection request initiated by the first terminal to the server that includes the pre-protocol information
  • a merge module configured to collect a local second live video stream, and merge at least one of the first live video stream and the second video stream into a third live video stream, and upload the same to the server to enable the server Pushing the third live video stream to at least one user in the live room.
  • a server includes a processor for performing the first live video stream push control method.
  • a mobile terminal includes a processor, a memory, a touch sensitive display, a camera, and is characterized in that The processor is configured to perform any one of the foregoing second and third live video stream push control methods.
  • the present invention considers that the live content of the live broadcast includes video stream, audio stream, barrage information, gift information, etc. Based on the separation and merge technology of the live video stream, the live video stream of different terminals is merged through the host user terminal and uploaded to the server. Then, the server pushes the merged video stream to each viewing user in the live broadcast room, reduces the pressure of the server to merge the video stream excessively, and saves resources; at the same time, the present invention uses the mobile terminal as the anchor to perform live broadcast fast login and authentication entry.
  • the broadcast threshold of the multi-end video stream is greatly reduced, and the multi-platform live broadcast process is realized more quickly and flexibly; in addition, the present invention is based on the mobile terminal and the PC end.
  • the account separation system utilizes the higher-performance image processing capability of the PC and cooperates with the mobile terminal to quickly open the live broadcast.
  • the live content is processed and merged by the PC, and then uploaded to the server, and then pushed by the server to the live broadcast room. Each viewing user ensures the time synchronization of the live video stream.
  • the present invention combines the advantages of the video live client of the mobile terminal and the PC end, simplifies the operation steps of the multi-platform and multi-view live broadcast, and reduces the technical threshold of multi-platform and multi-view live broadcast, so that the anchor user uses multiple platforms, Multi-view simultaneous live broadcast is more convenient and faster, improving live broadcast efficiency and enhancing user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

涉及网络直播技术领域，具体涉及一种直播间视频流推送控制方法及相应的服务器与移动终端。所述方法包括步骤：接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。基于视频流分离以及合并为技术基础实现多平台同步直播，并且实现视频流的分享及灵活组合，使多平台直播更加方便快捷，提高直播效率，提升直播内容，进而提升用户体验。

Description

直播间视频流推送控制方法及相应的服务器与移动终端 【技术领域】
本发明涉及网络直播技术领域，具体涉及一种直播间视频流推送控制方法及相应的服务器与移动终端。
【背景技术】
随着互联网技术及智能移动终端设备的发展，各种互联网产品给人们的工作、生活带来了很多便利与娱乐，近年来，各类用于视频直播的直播平台层出不穷，视频直播给人们带来更实时的社交体验。而目前的直播平台包括了用于移动端的直播平台和用于PC端的直播平台。
由于视频直播需求的多样性，主播需要同时直播PC端上的内容(如PC上的游戏画面)和主播个人形象，以跟观看用户进行更好的互动，该直播方式称之为多视角或多平台同步直播，目前的多视角同步直播采用如下几种方案：
1.独立的PC客户端加第三方外设摄像头进行组合直播：
采用这种方案，需要单独开发一套PC端完整的客户端软件，并且配合第三方的外部摄像头，手动将需要直播的进程窗口与摄像头组合以后，通过直播客户端向服务器上传直播流，然后再由服务器下发到各个观看端；操作设置的流程复杂，并且涉及第三方外设的安装、使用以及第三方视频软件的加入才可以实现人与进程窗口同步直播的效果。
2.WEB端加第三方直播推流软件以及外设摄像头进行组合直播：
一般的WEB直播平台使用WEB端后台加上第三方直播推流软件进行直播，用户在WEB端直播平台注册账号并通过流程获得WEB端的直播权限后，还需要针对个人网络进行测速，并且按照指定的码率配置好第三方直播推流软件，不仅流程相当复杂，而且需要掌握第三方直播软件的各种设置，且需要进行人工测速并配置，不方便多平台直播的进行。
3.移动端使用手工形式进行跨平台直播：
在移动端进行直播的过程中，如果需要直播PC端的内容，用户可以通 过调整移动端摄像头的方向以及位置，采用手动转播的形式进行多视角直播；该操作相对简单，但因为直播的范围以及直播的内容难以得到保证，导致直播的质量较低，同时以移动端的摄像头进行对其他平台的内容的转播，影响用户在直播过程中的操作以及与观众之间的互动，对直播过程中的互动效果有很大的影响。
总而言之，目前所支持的多视角、跨平台直播方法，或者操作流程繁琐，或者直播效果不佳，无法满足主播用户快捷地分享多端的直播内容、让直播内容以及互动得到更好体验的效果。
【发明内容】
本发明的首要目的在于提供一种直播间视频流推送控制方法及执行该方法步骤的服务器。
本发明的另一目的在于提供直播间视频流推送控制方法及执行该方法步骤的移动终端。
为实现该目的，本发明采用如下技术方案：
第一方面，本发明提供一种直播间视频流推送控制方法，该方法由服务器执行，包括如下步骤：
服务器接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
服务器响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
服务器接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
具体的，服务器响应所述连接请求，根据所述预协议信息将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，以将第一终端上传的第一直播视频流下发至第二终端。
进一步的，在所述响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端步骤之后，所述接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推 送给所述直播间的成员用户步骤之前，还包括步骤：
服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口。
具体的，所述第一、第二、第三直播视频流均包含图像流和音频流，所述第三直播视频流包括第一直播视频流、第二直播视频流至少之一的图像流，还包括该两者至少之一的音频流。
第二方面，本发明还提供一种直播间视频流推送控制方法，该方法由第一终端执行，包括如下步骤：
第一终端获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
第一终端响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
具体的，所述预协议信息以二维码形式表征，所述第一终端通过摄像头扫描二维码获取所述预协议信息。
优选的，在所述以主播用户身份向服务器发起所述连接请求后，所述响应于主播用户的确认指令前，第一终端提供确认连接的操作界面，以在接收到主播用户的确认指令后向服务器上传本地产生的第一直播视频流。
进一步的，所述方法还包括后续步骤：
第一终端通过服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口。
第三方面，本发明还提供一种直播间视频流推送控制方法，该方法由第二终端执行，包括如下步骤：
第二终端输出表征预协议信息的链接标识；
第二终端响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
第二终端采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
具体的，所述预协议信息包含第二终端的唯一设备标识。
较佳的，所述第二终端接收第一直播视频流的过程与采集第二直播视频 流的过程与合并第三直播视频流的过程与上传第三直播视频流的过程并行工作。
另外的，与所述第一方面相对应的，本发明还提供一种服务器，其被配置为用于执行如下步骤：
接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
另外的，与所述第二方面相对应的，本发明还提供一种移动终端，其被配置为用于执行如下步骤：
获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
再者，与所述第三方面相对应的，本发明还提供一种移动终端，其被配置为用于执行如下步骤：
输出表征预协议信息的链接标识；
响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
最后，本发明还提供一种直播间视频流推送控制系统，包括第一终端、第二终端的至少两个终端以及与之建立通信连接的服务器，其特征在于：
所述第二终端输出表征预协议信息的链接标识，所述第一终端获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求，所述第一终端响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流，所述服务器响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端，所述第二终端接收服务器下发的 第一直播视频流，并将所述第一直播视频流和本地采集的第二直播视频流至少之一合并为第三直播视频流，并将所述第三直播视频流上传到服务器，所述服务器接收第二终端上传的第三直播视频流，并将之推送给所述直播间的成员用户。
与现有技术相比，本发明具备如下优点：
本发明考虑到直播间的直播内容包括视频流、音频流、弹幕信息、礼物信息等，基于直播视频流的分离与合并技术，将不同终端的直播视频流通过主播用户终端合并后上传到服务器，再由服务器将合并后的视频流推送至直播间的各个观看用户，降低服务器过多地合并视频流的压力，节省资源。
同时，本发明利用移动端作为主播进行直播的快速登陆及认证入口，一般地，在移动端的直播应用均配置了主播快速开启直播的入口，用户只需登录直播平台账号后即可快速开启移动端的直播；以此配合PC端不添加第三方外设时快速自动化的直播支持，在PC端上的直播客户端，若不添加第三方外部摄像头，可以快速、自动地配置直播参数以录制PC端上软件/桌面的画面；极大降低多端视频流的开播门槛，实现更加快速、灵活地多平台直播流程。
另外，本发明基于移动端以及PC端账号分离体系，利用PC端较高性能的图像处理能力，配合移动端快速开启直播的便捷性，将各直播内容由PC端进行处理、合并，进而上传至服务器，再由服务器推送至直播间的各个观看用户，保证直播视频流的时间同步性。
综上所述，本发明结合移动端以及PC端各自的视频直播客户端优势，简化多平台、多视角直播的操作步骤，降低多平台、多视角直播的技术门槛，使得主播用户使用多平台、多视角同步直播更加方便、快捷，提高直播效率，进而提升用户体验。
显然，上述有关本发明优点的描述是概括性的，更多的优点描述将体现在后续的实施例揭示中，以及，本领域技术人员也可以本发明所揭示的内容合理地发现本发明的其他诸多优点。
本发明附加的方面和优点将在下面的描述中部分给出，这些将从下面的描述中变得明显，或通过本发明的实践了解到。
【附图说明】
图1为本发明直播间视频流推送控制方法的一实施例流程示意图；
图2所示是服务器与第一终端建立连接后，在第一终端操作界面上显示合并模式选择窗口的一个实施例示意图；
图3所示是本发明第三直播视频流的一个实施例示意图；
图4所示是本发明直播间视频流推送控制方法一实施例流程示意图；
图5所示是第一终端获取预协议信息的一操作界面示意图；
图6所示是本发明直播间视频流推送控制装置的一实施例示意图；
图7所示是本发明直播间视频流推送控制装置的一实施例示意图；
图8所示是本发明直播间视频流推送控制装置的一实施例示意图；
图9所示是本发明移动终端的一实施例结构示意图；
图10是实现本发明所述直播间视频流推送控制方法的系统示意图。
【具体实施方式】
下面结合附图和示例性实施例对本发明作进一步地描述，其中附图中相同的标号全部指的是相同的部件。此外，如果已知技术的详细描述对于示出本发明的特征是不必要的，则将其省略。
本技术领域技术人员可以理解，除非特意声明，这里使用的单数形式“一”、“一个”、“所述”和“该”也可包括复数形式。应该进一步理解的是，本发明的说明书中使用的措辞“包括”是指存在所述特征、整数、步骤、操作、元件和/或组件，但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元件、组件和/或它们的组。应该理解，当我们称元件被“连接”或“耦接”到另一元件时，它可以直接连接或耦接到其他元件，或者也可以存在中间元件。此外，这里使用的“连接”或“耦接”可以包括无线连接或无线耦接。这里使用的措辞“和/或”包括一个或更多个相关联的列出项的全部或任一单元和全部组合。
本技术领域技术人员可以理解，除非另外定义，这里使用的所有术语(包括技术术语和科学术语)，具有与本发明所属领域中的普通技术人员的一般理解相同的意义。还应该理解的是，诸如通用字典中定义的那些术语，应该被理解为具有与现有技术的上下文中的意义一致的意义，并且除非像这里一 样被特定定义，否则不会用理想化或过于正式的含义来解释。
本技术领域技术人员可以理解，这里所使用的“终端”、“终端设备”既包括无线信号接收器的设备，其仅具备无发射能力的无线信号接收器的设备，又包括接收和发射硬件的设备，其具有能够在双向通信链路上，执行双向通信的接收和发射硬件的设备。这种设备可以包括：蜂窝或其他通信设备，其具有单线路显示器或多线路显示器或没有多线路显示器的蜂窝或其他通信设备；PCS(Personal Communications Service，个人通信系统)，其可以组合语音、数据处理、传真和/或数据通信能力；PDA(Personal Digital Assistant，个人数字助理)，其可以包括射频接收器、寻呼机、互联网/内联网访问、网络浏览器、记事本、日历和/或GPS(Global Positioning System，全球定位系统)接收器；常规膝上型和/或掌上型计算机或其他设备，其具有和/或包括射频接收器的常规膝上型和/或掌上型计算机或其他设备。这里所使用的“终端”、“终端设备”可以是便携式、可运输、安装在交通工具(航空、海运和/或陆地)中的，或者适合于和/或配置为在本地运行，和/或以分布形式，运行在地球和/或空间的任何其他位置运行。这里所使用的“终端”、“终端设备”还可以是通信终端、上网终端、音乐/视频播放终端，例如可以是PDA、MID(Mobile Internet Device，移动互联网设备)和/或具有音乐/视频播放功能的移动电话，也可以是智能电视、机顶盒等设备。
本技术领域技术人员可以理解，这里所使用的远端网络设备，其包括但不限于计算机、网络主机、单个网络服务器、多个网络服务器集或多个服务器构成的云。在此，云由基于云计算(Cloud Computing)的大量计算机或网络服务器构成，其中，云计算是分布式计算的一种，由一群松散耦合的计算机集组成的一个超级虚拟计算机。本发明的实施例中，远端网络设备、终端设备与WNS服务器之间可通过任何通信方式实现通信，包括但不限于，基于3GPP、LTE、WIMAX的移动通信、基于TCP/IP、UDP协议的计算机网络通信以及基于蓝牙、红外传输标准的近距无线传输方式。
本技术领域技术人员可以理解，本发明所述的用户界面/操作界面泛指能够用于向智能终端发送控制指令的显示界面，例如，可以为Android系统的设置页面中的一个选项(或按键，由所述应用程序添加其中，下同)，也可以是从桌面呼出的通知栏或者交互页面中的一个选项，还可以是所述应用程 序的一个活动组件所构造的页面中的一个选项。
本领域技术人员应当理解，本发明所称的“应用”、“应用程序”、“应用软件”以及类似表述的概念，是业内技术人员所公知的相同概念，是指由一系列计算机指令及相关数据资源有机构造的适于电子运行的计算机软件。除非特别指定，这种命名本身不受编程语言种类、级别，也不受其赖以运行的操作系统或平台所限制。理所当然地，此类概念也不受任何形式的终端所限制。
直播间：本发明所述直播间包括以下含义，①一种基于网络直播平台创建的一个虚拟空间(或虚拟房间)，直播间一般由主播客户端创建并连接有多个观看客户端，即直播间中包括了主播及多个观众，位于该虚拟空间内的观看客户端可以观看主播客户端的直播内容，同时主播客户端的用户与观看客户端的用户、观看客户端的用户与观看客户端的用户之间还可以进行语音、图片、文字或赠送电子赠品的互动；②一种以群组方式将用户聚合在一起的即时通讯平台，例如视频会议系统，用户通过登录客户端的方式进入群组，用户在群组内以群组成员的身份存在，同一个群组内包含有多个群组成员，用户可任意加入或退出群组，在群组内，可以进行文字、语音、视频等多种互动。
第一方面，如图1所示是本发明直播间视频流推送控制方法的一实施例流程示意图，该方法由网络设备执行，所述网络设备包括但不限于单个网络服务器、多个网络服务器组成的服务器组或基于云计算(Cloud Computing)的由大量主机或网络服务器构成的云，其包括步骤S100～S120:
步骤S100：接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求。
直播间的主播用户的第一终端识别由第二终端输出的表征预协议信息的链接标识，进而获取所述预协议信息，然后第一终端向服务器发起包含该预协议信息的连接请求，服务器接收到该连接请求以作后续处理。
具体的，所述预协议信息包含第二终端的唯一设备标识及建立服务器与终端的专属链路的授权令牌或鉴权信息，并且所述预协议信息通过加密方式处理、存储在表征预协议信息的链接标识中，必须经相应授权的应用程序才能从所述链接标识中解析、得到所述预协议信息。一般地，预协议信息的加 密方式、表征预协议信息的链接标识由各直播平台自行定义，经该直播平台授权的应用程序识别所述链接标识后方能得到所述预协议信息。
在一种实施方式中，所述表征预协议信息的链接标识通过二维码的形式输出，二维码是通过特定的几何图形按预定的规律在二维平面上分布的黑白相间的图形记录数据符号信息，二维码在代码编制上巧妙地利用构成计算机内部逻辑基础的“0”、“1”比特流的概念，使用多个与二进制相对应的几何形体来表示文字、数值等信息，可以通过图象输入设备或光电扫描设备识读二维码以获取二维码中包含的信息。二维码具有条码技术的多个共性：每种码制有其特定的字符集；每个字符占有预定的宽度；并且具有一定的校验功能等。
步骤S110：响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端。
服务器响应于所述连接请求，校验其中的预协议信息，若该预协议信息与直播平台定义的预协议信息规则匹配，则视该连接请求为合法连接请求，将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，以建立与第二终端的专属通信链路，进而将接收到的第一终端上传的第一直播视频流下发至第二终端。
优选的，在服务器接收所述连接请求、建立与第二终端的专属网络通信链路后，将与第二终端完成建立连接的信息反馈给第一终端，且在接收到来自第一终端的确认指令时，才将接收到的第一终端上传的第一直播视频流下发至第二终端。同时，向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口，然后主播用户在该控制窗口中选择第二直播视频流的视频源，即可快速采集第二直播视频流。
步骤S120：接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
具体的，所述第一、第二、第三直播视频流均包含图像流和音频流，所述第三直播视频流包括第一直播视频流、第二直播视频流至少之一的图像流，还包括该两者至少之一的音频流，第三直播视频流的种类包括：
①第一直播视频流的图像流及第一直播视频流的音频流；
②第二直播视频流的图像流及第二直播视频流的音频流；
③第一直播视频流的图像流及第一直播视频流的音频流以及第二直播视频流的图像流；
④第一直播视频流的图像流及第二直播视频流的图像流以及第二直播视频流的音频流；
⑤第一直播视频流的图像流及第一直播视频流的音频流与第二直播视频流的图像流以及第二直播视频流的音频流。
如图4所示是本发明第三直播视频流的一个实施例示意图，其包括第一直播视频流的图像流及第二直播视频流的图像流，还可以包括两者的音频流，其中第一直播视频流的图像流为图中所示的人物窗口，第二直播视频流的图像流为图中所示的“PC画面”的图像窗口，实现了多视角、跨平台同步直播。
优选的，在第一终端和第二终端上提供相应的视频流、音频流的开启/关闭选项供主播用户进行选择，当主播用户选择开启/关闭某一视频流的图像流或音频流时，相应合成的第三直播视频流随之改变，让主播用户能更好地根据需要展示直播间的内容。例如，当前的第三直播视频流为上述第⑤种类时，主播用户想暂时关闭第一直播视频流的图像流、音频流而通过第二视频流、音频流与观众用户进行更好的互动，此时主播用户可以在第一终端上选择关闭第一直播视频流，此时第二终端所采集的第二直播视频流即作为合并后的第三视频流，然后服务器在接收到第二终端上传的第三直播视频流后将之推送至直播间的观众用户；较佳地，主播用户亦可在第二终端上选择关闭第一直播视频流，此时服务器不再将第一直播视频流下发给第二终端，然后由第二终端所采集的第二直播视频流作为合并后的第三视频流并上传到服务器，服务器再将该第三直播视频流推送给直播间的观看用户，例如在第二终端用户界面上提供的第一直播视频流、音频流的开启/关闭选项按钮，在主播用户选择“关闭”选项按钮后则将接收第一直播视频流的通信链路关闭，不再接收第一直播视频流。
更佳的，在第二终端的用户界面上，主播用户还可以设置第一直播视频流的图像流及第二直播视频流的图像流的显示区域大小，相应合并后的第三 直播视频流根据对第一直播视频流和第二直播视频流的修改而进行修改，并将修改后的第三直播视频流之上传到服务器，服务器进而将第三直播视频流推送至直播间，为主播用户提供更多的自定义选择，保证直播间直播内容的展示。
第二方面，如图3所示是本发明直播间视频流推送控制方法一实施例流程示意图，在本实施例中，该方法由第一终端执行，所述第一终端优选为移动终端，所述方法亦可理解为由第一终端上的视频直播应用程序执行，包括步骤S200～S220：
步骤S200：获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求。
具体的，所述预协议信息包含第二终端的唯一设备标识及建立服务器与终端的专属链路的授权令牌或鉴权信息，并且所述预协议信息通过加密方式处理、存储在表征预协议信息的链接标识中，必须经相应授权的应用程序才能从所述链接标识中解析、得到所述预协议信息。一般地，预协议信息的加密方式、表征预协议信息的链接标识由各直播平台自行定义，经该直播平台授权的应用程序识别所述链接标识后方能得到所述预协议信息。
直播间的主播用户的第一终端识别由第二终端输出的表征预协议信息的链接标识，进而获取所述预协议信息，即用户在第一终端运行该视频直播应用程序并以主播身份根据所述预协议信息的表征形式，识别表征预协议信息的链接标识，获取所述预协议信息，然后向服务器发起包含该预协议信息的连接请求，以通过服务器将第一终端的唯一设备标识、主播用户的身份信息和直播间的特征信息发送至第二终端，其中主播用户的身份信息为直播平台上的主播用户UID，用以表征唯一的一个主播用户，另外，直播间的特征信息即直播间的频道ID。如图5所示是第一终端获取预协议信息的一操作界面示意图，通过点击图5中箭头所指向的诸如“PC直播”的按钮，出现扫描框，然后通过扫描第二终端以二维码形式输出的表征预协议信息的链接标识，进而获取相应的预协议信息，同时以主播身份向服务器发起包含该预协议信息的连接请求。
步骤S210：响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。。
服务器响应于所述连接请求，校验其中的预协议信息，若该预协议信息与该直播平台定义的预协议信息规则匹配，则视该连接请求为合法连接请求，然后将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，以建立与第二终端的专属通信链路；在服务器建立与第二终端的专属通信链路后，向第一终端反馈连接建立完成的提示信息，第一终端接收到该提示信息后在第一终端的用户界面上生成确认连接的操作界面，用于接收主播用户的确认指令，例如在第一终端的用户界面上提供诸如“确认”连接的按钮，且当接收到主播用户的确认指令时，才将本地产生的第一直播视频流上传到服务器，以使得服务器将该第一直播视频流下发至第二终端。
优选的，在主播用户确认连接后，第一终端通过服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口，然后主播用户在该控制窗口中选择第二直播视频流的视频源，即可快速采集第二直播视频流。
第三方面，如图3所示是本发明直播间视频流推送控制方法另一实施例流程示意图，在本实施例中，该方法由第二终端执行，考虑到终端的图像处理性能，所述第二终端优选为PC端，所述方法亦可理解为由第二终端上的视频直播客户端执行，包括步骤S300-S320：
步骤S300：输出表征预协议信息的链接标识。
具体的，所述预协议信息包含第二终端的唯一设备标识及建立服务器与终端的专属链路的授权令牌或鉴权信息，并且所述预协议信息通过加密方式处理、存储在表征预协议信息的链接标识中，必须经相应授权的应用程序才能从所述链接标识中解析、得到所述预协议信息，一般地，预协议信息的加密方式、表征预协议信息的链接标识由各直播平台自行定义，经该直播平台授权的应用程序识别所述链接标识后方能得到所述预协议信息，在一种实施方式中，所述表征预协议信息的链接标识通过二维码的形式输出。例如，PC端上的视频直播客户端操作界面上设有诸如“分享直播”的按钮，用于将预协议信息生成链接标识并呈现在终端的用户界面上，用户点击“分享直播”按钮后，在视频直播客户端的操作界面上输出一个二维码，经直播平台授权的第一终端上的视频直播客户端通过扫描该二维码即可获取到所述预协议信 息。
步骤S310：响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流。
在直播间的主播用户的第一终端识别由第二终端输出的表征预协议信息的链接标识，进而获取所述预协议信息，然后第一终端向服务器发起包含该预协议信息的连接请求后，第二终端响应该请求接收服务器发送的第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息，以此建立与服务器的专属通信链路，进而通过该专属链路接收服务器下发的第一直播视频流。
优选的，在第二终端响应所述连接请求、建立与服务器的专属通信链路后，且当服务器接收到第一终端的确认指令并反馈给第二终端时，才接收服务器下发的第一直播视频流。
步骤S320：采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
在第二终端接收到当服务器反馈的接收到第一终端的确认指令的同时，接收服务器发送的采集第二直播视频流的控制指令，第二终端接收到该控制指令，在用户界面上生成采集第二直播视频流的控制窗口，然后主播用户在该控制窗口中选择第二直播视频流的视频源，即可快速采集第二直播视频流。一般地，第二终端采集的第二直播视频流的图像流包括进程画面(如游戏窗口画面)和桌面画面(即第二终端的整个桌面画面)，因此控制窗口中包含上述2种图像流选择，用户根据自己的需要采集相应的视频源作为第二直播视频流。然后主播用户选择推送第三直播视频流，此时，第二终端在采集第二直播视频流的同时将接收到第一直播视频流与第二直播视频流合并为第三直播视频流，并将第三直播视频流上传到服务器，以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
具体的，第二终端的所述接收第一直播视频流的过程与采集第二直播视频流的过程与合并第三直播视频流的过程与上传第三直播视频流的过程并行工作。并行工作是指同一时刻或同一时间间隔内完成两种或两种以上性质相同或不相同的工作，并行工作具有①时间重叠性：相邻处理过程在时间上错 开，轮流重叠使用同一套硬件的各部分；②资源共享性：让多个用户按照一定的时间顺序轮流使用同一套资源，提高资源利用率；③资源重复：重复设置硬件资源，提高硬件可靠性和性能。具体的，对于本发明实施例而言，并行工作是指第二终端在接收第一直播视频流时，可以同步/同步采集第二直播视频流，并同时/同步将所接收到的第一直播视频流和所采集的第二直播视频流合并成第三直播视频流，且同时/同步将第三直播视频流上传到服务器，保证了直播视频流的同时/同步性。
优选的，在第二终端上提供相应的第一、第二直播视频流的图像流、音频流的开启/关闭选项供主播用户进行选择，当主播用户选择开启/关闭某一直播视频流的图像流或音频流时，相应合成的第三直播视频流随之改变，让主播用户能更好地根据需要展示直播间的内容。
更佳的，在第二终端的用户界面上，主播用户还可以设置第一直播视频流的图像流及第二直播视频流的图像流的显示区域大小，相应合并后的第三直播视频流根据对第一直播视频流和第二直播视频流的修改而进行修改，并将修改后的第三直播视频流之上传到服务器，服务器进而将第三直播视频流推送至直播间，为主播用户提供更多的自定义选择，保证直播间直播内容的展示。
与所述第一方面的方法相对应的，如图6所示是本发明一种直播间视频流推送控制装置，包括：接收请求模块：用于接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；响应请求模块：用于响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；视频推送模块：用于接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
与所述第二方面的方法相对应的，如图7所示是本发明一种直播间视频流推送控制装置，包括：获取模块：用于获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；发送模块：用于响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
与所述第三方面的方法相对应的，如图8所示是本发明一种直播间视频流推送控制装置，包括：输出模块：用于输出表征预协议信息的链接标识； 接收模块：用于响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；合并模块：用于采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
另外，与第一方面相对应的，本发明还提供一种服务器，包括处理器，所述处理器被配置为用于执行如下步骤：
接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
再者，与第二方面相对应的，本发明还提供一种移动终端，包括处理器、存储器、触敏显示器、摄像头，其特征在于，所述处理器用于执行如下步骤：
获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
最后，与第三方面相对应的，本发明还提供一种移动终端，其被配置为用于执行如下步骤：
输出表征预协议信息的链接标识；
响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
如图9所示是本发明移动终端的一实施例结构示意图。该移动终端可以为手机、平板电脑、PDA(Personal Digital Assistant，个人数字助理)、POS(Point of Sales，销售终端)、车载电脑等任意终端设备，以移动终端为手机为例：
参考图9，手机包括：射频(Radio Frequency，RF)电路910、存储器920、输入单元930、显示单元940、传感器950、音频电路960、无线保真(wireless fidelity，WiFi)模块970、处理器980、以及电源990等部件。本领域技术人员可以理解，图9中示出的手机结构并不构成对手机的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图9对手机的各个构成部件进行具体的介绍：
RF电路910可用于收发信息或通话过程中，信号的接收和发送，特别地，将基站的下行信息接收后，给处理器980处理；另外，将设计上行的数据发送给基站。通常，RF电路910包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier，LNA)、双工器等。此外，RF电路910还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(Global System of Mobile communication，GSM)、通用分组无线服务(General Packet Radio Service，GPRS)、码分多址(Code Division Multiple Access，CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution，LTE)、电子邮件、短消息服务(Short Messaging Service，SMS)等。
存储器920可用于存储软件程序以及模块，处理器980通过运行存储在存储器920的软件程序以及模块，从而执行手机的各种功能应用以及数据处理。存储器920可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器920可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元930可用于接收输入的数字或字符信息，以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地，输入单元930可包括触控面板931以及其他输入设备932。触控面板931，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板931上或在触控面板931附近的操作)，并根据预先设定的程式 驱动相应的连接装置。可选的，触控面板931可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器980，并能接收处理器980发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板931。除了触控面板931，输入单元930还可以包括其他输入设备932。具体地，其他输入设备932可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元940可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元940可包括显示面板941，可选的，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板941。进一步的，触控面板931可覆盖显示面板941，当触控面板931检测到在其上或附近的触摸操作后，传送给处理器980以确定触摸事件的类型，随后处理器980根据触摸事件的类型在显示面板941上提供相应的视觉输出。虽然在图9中，触控面板931与显示面板941是作为两个独立的部件来实现手机的输入和输入功能，但是在某些实施例中，可以将触控面板931与显示面板941集成而实现手机的输入和输出功能。
手机还可包括至少一种传感器950，比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板941的亮度，接近传感器可在手机移动到耳边时，关闭显示面板941和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路960、扬声器961，传声器962可提供用户与手机之间的音频接口。音频电路960可将接收到的音频数据转换后的电信号，传输到扬声器961， 由扬声器961转换为声音信号输出；另一方面，传声器962将收集的声音信号转换为电信号，由音频电路960接收后转换为音频数据，再将音频数据输出处理器980处理后，经RF电路910以发送给比如另一手机，或者将音频数据输出至存储器920以便进一步处理。
WiFi属于短距离无线传输技术，手机通过WiFi模块970可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图9示出了WiFi模块970，但是可以理解的是，其并不属于手机的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器980是手机的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器920内的软件程序和/或模块，以及调用存储在存储器920内的数据，执行手机的各种功能和处理数据，从而对手机进行整体监控。可选的，处理器980可包括一个或多个处理单元；优选的，处理器980可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器980中。
手机还包括给各个部件供电的电源990(比如电池)，优选的，电源可以通过电源管理系统与处理器980逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
尽管未示出，手机还包括摄像头，并与所述处理器980及手机其他组件电连接。
如图10所示是本发明所述直播间视频流推送控制方法的系统示意图，其中包括第一终端、第二终端、多个服务器及多个观看用户，该系统示意图展示了本发明所述方法的主要流程图，其中，主播用户从第一终端向身份服务器发起包含第二终端输出的预协议信息的连接请求，身份服务器验证所述预协议信息后将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，然后视频流服务器建立与第一终端的通信链路以接收第一终端上传的第一直播视频流、及建立与第二终端的专属链路以通过该专属链路将第一直播视频流下发至第二终端，第二终端同时采集本地的第二直播视频流，再将第一直播视频流和第二直播视频流两者至少之一合成第三直播视频流并上传到视频流服务器，然后由视频流服务器将第三直播视频流 推送给直播间的各个用户甲、乙、丙。
下面举例结合服务器、第一终端(移动端)、第二终端(PC端)说明本发明的一种实施过程，用户需要快速开启同时直播游戏画面及个人形象，首先开启移动端上的视频直播应用程序，登陆直播平台账号后快速创建直播间，此时用户为主播用户，另外在PC端上开启视频直播客户端并登录该直播平台账号，然后点击PC端上的“分享直播”按钮，在PC端上的用户界面输出表征预协议信息的链接标识(以二维码为表征预协议信息的链接标识为例)，然后用户点击移动端上的“PC直播”按钮，弹出二维码扫描界面，利用移动端的摄像头扫描PC端界面上输出的二维码，获取其表征的预协议信息并向服务器发起包含该预协议信息的连接请求，服务器完成请求验证后，将移动端的唯一设备标识、主播用户的UID及直播间的频道ID发送给PC端，此时建立视频流服务器与手机端及PC端的通信链路连接并将连接建立完成的信息反馈给第一终端，用户在移动端上完成确认连接后，将本地产生的第一直播视频流上传到视频流服务器，由视频流服务器将所述第一直播视频流下发给PC端，接着用户在PC端上选择所要采集视频源作为第二直播视频流，然后PC端将接收到的第一直播视频流跟本地采集的第二直播视频流合成为第三直播视频流，并且用户在PC端上可以根据需要调整控制第一、第二直播视频流的图像画面大小比例，以更好地显示直播内容，最后PC端将合并成的第三直播视频流上传到视频流服务器，由视频流服务器将第三直播视频流推送给直播间的各个观看用户。
概括地说，本发明提供的技术方案如下：
一种直播间视频流推送控制方法，包括如下步骤：
接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
在以上直播间视频流推送控制方法中，进一步包括如下技术内容：
所述响应该连接请求，将接收到的第一终端上传的第一直播视频流下发 至第二终端的步骤，具体为：
响应该连接请求，根据所述预协议信息将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，以将第一终端上传的第一直播视频流下发至第二终端；
在所述响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端步骤之后，所述接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户步骤之前，还包括步骤：向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口；
在接收所述连接请求之后，当接收到来自第一终端的确认指令时，才继续后续步骤。
同时提供另一种直播间视频流推送控制方法，包括如下步骤：
获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
在该另一种直播间视频流推送控制方法中，进一步包括如下技术内容：
所述预协议信息以二维码形式表征，通过摄像头扫描二维码获取所述预协议信息；
在所述以主播用户身份向服务器发起所述连接请求后，所述响应于主播用户的确认指令前，提供确认连接的操作界面，以在接收到主播用户的确认指令后向服务器上传本地产生的第一直播视频流；
所述另一种直播间视频流推送控制方法还包括后续步骤：通过服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口。
同时提供第三种直播间视频流推送控制方法，包括如下步骤：
输出表征预协议信息的链接标识；
响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
在该第三种直播间视频流推送控制方法中，进一步包括如下技术内容：
所述接收第一直播视频流的过程与采集第二直播视频流的过程与合并第三直播视频流的过程与上传第三直播视频流的过程并行工作。
一种直播间视频流推送控制装置，包括：
接收请求模块：用于接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
响应请求模块：用于响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
视频推送模块：用于接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
一种直播间视频流推送控制装置，包括：
获取模块：用于获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
发送模块：用于响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
一种直播间视频流推送控制装置，包括：
输出模块：用于输出表征预协议信息的链接标识；
接收模块：用于响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
合并模块：用于采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
一种服务器，包括处理器，该处理器用于执行上述第一种直播间视频流推送控制方法。
一种移动终端，包括处理器、存储器、触敏显示器、摄像头，其特征在 于，所述处理器用于执行上述第二、第三种直播间视频流推送控制方法中的任意一个。
本发明考虑到直播间的直播内容包括视频流、音频流、弹幕信息、礼物信息等，基于直播视频流的分离与合并技术，将不同终端的直播视频流通过主播用户终端合并后上传到服务器，再由服务器将合并后的视频流推送至直播间的各个观看用户，降低服务器过多地合并视频流的压力，节省资源；同时，本发明利用移动端作为主播进行直播的快速登陆及认证入口，以此配合PC端不添加第三方外设时快速自动化的直播支持，极大降低多端视频流的开播门槛，实现更加快速、灵活地多平台直播流程；另外，本发明基于移动端以及PC端账号分离体系，利用PC端较高性能的图像处理能力，配合移动端快速开启直播的便捷性，将各直播内容由PC端进行处理、合并，进而上传至服务器，再由服务器推送至直播间的各个观看用户，保证直播视频流的时间同步性。
综上所述，本发明结合移动端以及PC端各自的视频直播客户端优势，简化多平台、多视角直播的操作步骤，降低多平台、多视角直播的技术门槛，使得主播用户使用多平台、多视角同步直播更加方便、快捷，提高直播效率，进而提升用户体验。
虽然上面已经示出了本发明的一些示例性实施例，但是本领域的技术人员将理解，在不脱离本发明的原理或精神的情况下，可以对这些示例性实施例做出改变，本发明的范围由权利要求及其等同物限定。

Claims (14)

  1. 一种直播间视频流推送控制方法，其特征在于，包括如下步骤：
    服务器接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
    服务器响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
    服务器接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
  2. 根据权利要求1所述的方法，其特征在于，所述响应该连接请求，根据所述预协议信息将第一终端的唯一设备标识、主播用户的身份信息及直播间的特征信息发送给第二终端，以将第一终端上传的第一直播视频流下发至第二终端。
  3. 根据权利要求1所述的方法，其特征在于，在所述响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端步骤之后，所述接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户步骤之前，还包括步骤：
    服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口。
  4. 根据权利要求1所述的方法，其特征在于，所述第一、第二、第三直播视频流均包含图像流和音频流，所述第三直播视频流包括第一直播视频流、第二直播视频流至少之一的图像流，还包括该两者至少之一的音频流。
  5. 一种直播间视频流推送控制方法，其特征在于，包括如下步骤：
    第一终端获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
    第一终端响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
  6. 根据权利要求5所述的方法，其特征在于，所述预协议信息以二维码形式表征，通过摄像头扫描二维码获取所述预协议信息。
  7. 根据权利要求5所述的方法，其特征在于，在所述以主播用户身份向服务器发起所述连接请求后，所述响应于主播用户的确认指令前，第一终端提供确认连接的操作界面，以在接收到主播用户的确认指令后向服务器上传本地产生的第一直播视频流。
  8. 根据权利要求5所述的方法，其特征在于，所述方法还包括后续步骤：
    通过服务器向第二终端发送采集第二直播视频流的控制指令，以在第二终端的用户界面上生成采集第二直播视频流的控制窗口。
  9. 一种直播间视频流推送控制方法，其特征在于，包括如下步骤：
    第二终端输出表征预协议信息的链接标识；
    第二终端响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
    第二终端采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
  10. 根据权利要求9所述的方法，其特征在于，所述第二终端接收第一直播视频流的过程与采集第二直播视频流的过程与合并第三直播视频流的过程与上传第三直播视频流的过程并行工作。
  11. 一种服务器，其被配置为用于执行如下步骤：
    接收所述直播间的主播用户从第一终端发起的包含由第二终端输出的预协议信息的连接请求；
    响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端；
    接收第二终端上传的由第二直播视频流与所述第一直播视频流至少之一合并而成的第三直播视频流，并将之推送给所述直播间的成员用户。
  12. 一种移动终端，其被配置为用于执行如下步骤：
    获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求；
    响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流。
  13. 一种移动终端，其被配置为用于执行如下步骤：
    输出表征预协议信息的链接标识；
    响应于第一终端向服务器发起的包含所述预协议信息的连接请求，接收服务器下发的第一直播视频流；
    采集本地的第二直播视频流，并将所述第一直播视频流和第二视频流至少之一合并为第三直播视频流，并将之上传到服务器以使得所述服务器向直播间的至少一个用户推送所述第三直播视频流。
  14. 一种直播间视频流推送控制系统，包括第一终端、第二终端的至少两个终端以及与之建立通信连接的服务器，其特征在于：
    所述第二终端输出表征预协议信息的链接标识，所述第一终端获取由第二终端输出的预协议信息，并以主播用户身份向服务器发起包含该预协议信息的连接请求，所述第一终端响应于主播用户的确认指令，向服务器上传本地产生的第一直播视频流，所述服务器响应该连接请求，将接收到的第一终端上传的第一直播视频流下发至第二终端，所述第二终端接收服务器下发的第一直播视频流，并将所述第一直播视频流和本地采集的第二直播视频流至少之一合并为第三直播视频流，并将所述第三直播视频流上传到服务器，所述服务器接收第二终端上传的第三直播视频流，并将之推送给所述直播间的成员用户。
PCT/CN2016/106755 2016-11-22 2016-11-22 直播间视频流推送控制方法及相应的服务器与移动终端 WO2018094556A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
KR1020197017630A KR102257646B1 (ko) 2016-11-22 2016-11-22 생방송방 비디오 스트림 전송 제어방법, 해당 서버 및 이동단말
PCT/CN2016/106755 WO2018094556A1 (zh) 2016-11-22 2016-11-22 直播间视频流推送控制方法及相应的服务器与移动终端
CN201680002272.2A CN107005721B (zh) 2016-11-22 2016-11-22 直播间视频流推送控制方法及相应的服务器与移动终端
JP2019528445A JP6818144B2 (ja) 2016-11-22 2016-11-22 ライブルームの映像ストリームのプッシュ制御方法及び相応するサーバーと移動端末
EP16922245.2A EP3547697A4 (en) 2016-11-22 2016-11-22 PUSHING CONTROL METHOD FOR LIVE BROADCASTING ROOM VIDEO STREAM AND RELATED SERVER AND MOBILE DEVICE
US16/463,065 US11616990B2 (en) 2016-11-22 2016-11-22 Method for controlling delivery of a video stream of a live-stream room, and corresponding server and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/106755 WO2018094556A1 (zh) 2016-11-22 2016-11-22 直播间视频流推送控制方法及相应的服务器与移动终端

Publications (1)

Publication Number Publication Date
WO2018094556A1 true WO2018094556A1 (zh) 2018-05-31

Family

ID=59431224

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/106755 WO2018094556A1 (zh) 2016-11-22 2016-11-22 直播间视频流推送控制方法及相应的服务器与移动终端

Country Status (6)

Country Link
US (1) US11616990B2 (zh)
EP (1) EP3547697A4 (zh)
JP (1) JP6818144B2 (zh)
KR (1) KR102257646B1 (zh)
CN (1) CN107005721B (zh)
WO (1) WO2018094556A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109274979A (zh) * 2018-08-31 2019-01-25 广州虎牙信息科技有限公司 直播间跳转方法、装置、存储介质和服务器
CN110062254A (zh) * 2019-04-19 2019-07-26 上海连尚网络科技有限公司 一种弹幕发布的方法及设备
CN112312226A (zh) * 2020-10-28 2021-02-02 北京达佳互联信息技术有限公司 连麦方法、系统、装置、电子设备及存储介质
CN112954378A (zh) * 2021-02-05 2021-06-11 广州方硅信息技术有限公司 直播间语音弹幕的播放方法、装置、电子设备及介质

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107846633B (zh) 2016-09-18 2023-07-14 腾讯科技（深圳）有限公司 一种直播方法及系统
CN106792081B (zh) * 2016-12-07 2020-01-10 腾讯科技（深圳）有限公司 直播视频的推送方法及装置
CN108259409B (zh) * 2016-12-28 2020-08-11 腾讯科技（深圳）有限公司 信息处理方法、终端及系统
CN108055577A (zh) * 2017-12-18 2018-05-18 北京奇艺世纪科技有限公司 一种直播交互方法、系统、装置及电子设备
CN108093267B (zh) * 2017-12-27 2020-12-04 广州虎牙信息科技有限公司 一种直播方法、装置、存储介质及电子设备
CN109982148B (zh) * 2019-04-03 2022-05-20 广州虎牙信息科技有限公司 一种直播方法、装置、计算机设备与存储介质
CN110213522B (zh) * 2019-05-27 2021-07-27 腾讯科技（深圳）有限公司 一种视频数据处理方法、装置以及相关设备
CN112312144B (zh) * 2019-07-31 2022-11-29 腾讯科技（深圳）有限公司 一种直播方法、装置、设备和存储介质
CN110519610B (zh) * 2019-08-14 2021-08-06 咪咕文化科技有限公司 直播资源处理方法及系统、服务器和客户端设备
CN111372093B (zh) * 2020-03-09 2022-02-25 广州市百果园信息技术有限公司 直播房间管理方法、装置、设备及存储介质
WO2021185302A1 (zh) * 2020-03-20 2021-09-23 华为技术有限公司 基于云手机的直播和配置方法以及相关装置和系统
CN112291629B (zh) * 2020-03-27 2022-08-23 北京字节跳动网络技术有限公司 交互方法、装置、电子设备和可读介质
KR102227062B1 (ko) * 2020-04-10 2021-03-12 주식회사 에이에스엘 실시간 방송중계장치
CN111641839B (zh) 2020-05-27 2021-09-21 北京达佳互联信息技术有限公司 直播方法、装置、电子设备及存储介质
CN113810726B (zh) * 2020-06-12 2023-07-18 阿里巴巴集团控股有限公司 一种控制方法、控制装置和控制设备
CN116405631A (zh) * 2020-07-08 2023-07-07 华为技术有限公司 屏幕共享方法、终端和存储介质
CN113949885B (zh) * 2020-07-15 2023-08-15 腾讯科技（深圳）有限公司 直播处理方法、装置、电子设备及计算机可读存储介质
US11683538B2 (en) * 2020-09-03 2023-06-20 Meta Platforms, Inc. Live group video streaming
CN112337100B (zh) * 2020-11-05 2022-11-18 北京字节跳动网络技术有限公司 基于直播的数据处理方法、装置、电子设备和可读介质
CN112423008B (zh) * 2020-11-09 2021-10-29 北京达佳互联信息技术有限公司 直播方法、装置、终端、服务器以及存储介质
CN114666613B (zh) * 2020-12-22 2024-01-05 华为终端有限公司 一种网络直播方法及电子设备
CN112866727B (zh) * 2020-12-23 2024-03-01 贵阳叁玖互联网医疗有限公司 一种可接收第三方推流的流媒体直播方法及系统
CN112911319B (zh) * 2021-01-19 2023-02-28 广州华多网络科技有限公司 多用户视频连线控制方法及其装置、设备和介质
CN112565810A (zh) * 2021-02-25 2021-03-26 北京映客芝士网络科技有限公司 一种直播间的合并处理方法、装置、介质及电子设备
US20220329910A1 (en) * 2021-04-07 2022-10-13 Meta Platforms, Inc. Generation and delivery of content items for synchronous viewing experiences
CN113014950A (zh) * 2021-05-24 2021-06-22 北京创新乐知网络技术有限公司 一种直播同步的方法、系统和电子设备
CN113473168B (zh) * 2021-07-02 2023-08-08 北京达佳互联信息技术有限公司 直播方法及系统、便携设备执行的直播方法及便携设备
CN113630614A (zh) * 2021-08-09 2021-11-09 广州虎牙科技有限公司 游戏直播方法、装置、系统、电子设备及可读存储介质
CN113727131B (zh) * 2021-08-31 2023-03-14 北京达佳互联信息技术有限公司 交互方法、系统、装置、电子设备及计算机可读存储介质
CN113891044B (zh) * 2021-09-29 2023-03-24 天翼物联科技有限公司 视频直播方法、装置、计算机设备及计算机可读存储介质
CN114466207A (zh) * 2022-01-18 2022-05-10 阿里巴巴（中国）有限公司 直播控制方法及计算机存储介质
CN114845124B (zh) * 2022-03-21 2024-02-20 广西广播电视信息网络股份有限公司 基于WebSocket同步控制的机顶盒直播方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1696923A (zh) * 2004-05-10 2005-11-16 北京大学 网络上的多种媒体的同步合成存储发布系统及操作该系统的方法
CN102780916A (zh) * 2012-04-12 2012-11-14 天脉聚源(北京)传媒科技有限公司 一种视频直播流汇聚分发方法
US20130307920A1 (en) * 2012-05-15 2013-11-21 Matt Cahill System and method for providing a shared canvas for chat participant
CN105407384A (zh) * 2014-09-15 2016-03-16 上海天脉聚源文化传媒有限公司 一种利用二维码标识媒体播放内容的方法、装置及系统
WO2016150317A1 (zh) * 2015-03-23 2016-09-29 阿里巴巴集团控股有限公司 直播视频的合成方法、装置及系统
CN106028137A (zh) * 2016-06-22 2016-10-12 北京小米移动软件有限公司 直播处理方法及装置
CN106101753A (zh) * 2016-08-24 2016-11-09 凌义川 一种音视频互动直播管理系统

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689641A (en) * 1993-10-01 1997-11-18 Vicor, Inc. Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal
US20070157281A1 (en) * 2005-12-23 2007-07-05 United Video Properties, Inc. Interactive media guidance system having multiple devices
US20080092047A1 (en) * 2006-10-12 2008-04-17 Rideo, Inc. Interactive multimedia system and method for audio dubbing of video
US20110078717A1 (en) * 2009-09-29 2011-03-31 Rovi Technologies Corporation System for notifying a community of interested users about programs or segments
US9369673B2 (en) * 2011-05-11 2016-06-14 Blue Jeans Network Methods and systems for using a mobile device to join a video conference endpoint into a video conference
US9380336B2 (en) * 2011-06-20 2016-06-28 Enseo, Inc. Set-top box with enhanced content and system and method for use of same
US9026666B2 (en) * 2012-02-14 2015-05-05 Avaya Inc. Communication session cloning using barcodes
KR101579603B1 (ko) * 2012-06-27 2016-01-04 네이버 주식회사 이미지 인증키를 이용한 ｔｖ와 스마트폰의 연동 시스템, 방법 및 컴퓨터 판독 가능한 기록 매체
US8909933B2 (en) * 2012-10-25 2014-12-09 International Business Machines Corporation Decoupled cryptographic schemes using a visual channel
US9276978B2 (en) 2012-12-31 2016-03-01 Microsoft Technology Licensing, Llc Program based caching in live media distribution
CN104243430A (zh) * 2013-06-20 2014-12-24 腾讯科技（深圳）有限公司 一种流媒体播放方法及装置
CN104426963B (zh) * 2013-08-29 2018-06-15 腾讯科技（深圳）有限公司 关联终端的方法和终端
EP2849448A1 (fr) * 2013-09-13 2015-03-18 Nagravision S.A. Méthode pour contrôler l'accès à du contenu diffusé
US9516259B2 (en) * 2013-10-22 2016-12-06 Google Inc. Capturing media content in accordance with a viewer expression
US10291597B2 (en) * 2014-08-14 2019-05-14 Cisco Technology, Inc. Sharing resources across multiple devices in online meetings
US9344681B2 (en) * 2014-08-21 2016-05-17 Infocus Corporation Systems and methods of incorporating live streaming sources into a video conference
JP6561241B2 (ja) * 2014-09-02 2019-08-21 株式会社コナミデジタルエンタテインメント サーバ装置、動画配信システム、それに用いられる制御方法及びコンピュータプログラム
US9891803B2 (en) * 2014-11-13 2018-02-13 Google Llc Simplified projection of content from computer or mobile devices into appropriate videoconferences
US10021458B1 (en) * 2015-06-26 2018-07-10 Amazon Technologies, Inc. Electronic commerce functionality in video overlays
US10440436B1 (en) * 2015-06-26 2019-10-08 Amazon Technologies, Inc. Synchronizing interactive content with a live video stream
US9973819B1 (en) * 2015-06-26 2018-05-15 Amazon Technologies, Inc. Live video stream with interactive shopping interface
US9883249B2 (en) * 2015-06-26 2018-01-30 Amazon Technologies, Inc. Broadcaster tools for interactive shopping interfaces
US10390064B2 (en) * 2015-06-30 2019-08-20 Amazon Technologies, Inc. Participant rewards in a spectating system
CN105306468B (zh) * 2015-10-30 2019-01-11 广州华多网络科技有限公司 一种合成视频数据实时共享的方法及其主播客户端
WO2018027237A1 (en) * 2016-08-05 2018-02-08 Sportscastr.Live Llc Systems, apparatus, and methods for scalable low-latency viewing of broadcast digital content streams of live events
CN107846633B (zh) * 2016-09-18 2023-07-14 腾讯科技（深圳）有限公司 一种直播方法及系统
US10516707B2 (en) * 2016-12-15 2019-12-24 Cisco Technology, Inc. Initiating a conferencing meeting using a conference room device
US11417091B2 (en) * 2017-05-30 2022-08-16 Ptc Inc. Use of coordinated local user devices during a shared augmented reality session
US10404481B2 (en) * 2017-06-06 2019-09-03 Cisco Technology, Inc. Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1696923A (zh) * 2004-05-10 2005-11-16 北京大学 网络上的多种媒体的同步合成存储发布系统及操作该系统的方法
CN102780916A (zh) * 2012-04-12 2012-11-14 天脉聚源(北京)传媒科技有限公司 一种视频直播流汇聚分发方法
US20130307920A1 (en) * 2012-05-15 2013-11-21 Matt Cahill System and method for providing a shared canvas for chat participant
CN105407384A (zh) * 2014-09-15 2016-03-16 上海天脉聚源文化传媒有限公司 一种利用二维码标识媒体播放内容的方法、装置及系统
WO2016150317A1 (zh) * 2015-03-23 2016-09-29 阿里巴巴集团控股有限公司 直播视频的合成方法、装置及系统
CN106028137A (zh) * 2016-06-22 2016-10-12 北京小米移动软件有限公司 直播处理方法及装置
CN106101753A (zh) * 2016-08-24 2016-11-09 凌义川 一种音视频互动直播管理系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3547697A4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109274979A (zh) * 2018-08-31 2019-01-25 广州虎牙信息科技有限公司 直播间跳转方法、装置、存储介质和服务器
CN109274979B (zh) * 2018-08-31 2021-03-23 广州虎牙信息科技有限公司 直播间跳转方法、装置、存储介质和服务器
CN110062254A (zh) * 2019-04-19 2019-07-26 上海连尚网络科技有限公司 一种弹幕发布的方法及设备
CN112312226A (zh) * 2020-10-28 2021-02-02 北京达佳互联信息技术有限公司 连麦方法、系统、装置、电子设备及存储介质
CN112312226B (zh) * 2020-10-28 2023-06-27 北京达佳互联信息技术有限公司 连麦方法、系统、装置、电子设备及存储介质
CN112954378A (zh) * 2021-02-05 2021-06-11 广州方硅信息技术有限公司 直播间语音弹幕的播放方法、装置、电子设备及介质

Also Published As

Publication number Publication date
CN107005721A (zh) 2017-08-01
EP3547697A1 (en) 2019-10-02
JP2020504488A (ja) 2020-02-06
US11616990B2 (en) 2023-03-28
KR20190086517A (ko) 2019-07-22
KR102257646B1 (ko) 2021-06-09
US20190281327A1 (en) 2019-09-12
CN107005721B (zh) 2020-07-24
JP6818144B2 (ja) 2021-01-20
EP3547697A4 (en) 2020-04-22

Similar Documents

Publication Publication Date Title
WO2018094556A1 (zh) 直播间视频流推送控制方法及相应的服务器与移动终端
WO2018059352A1 (zh) 直播视频流远程控制方法及装置
WO2019149049A1 (zh) 一种业务处理方法、终端、服务器及相关产品
US10834432B2 (en) Method, device and system for in-sequence live streaming
WO2019137248A1 (zh) 视频插帧方法、存储介质以及终端
WO2018095146A1 (zh) 直播间视频流合成方法、装置及终端设备
US20130262687A1 (en) Connecting a mobile device as a remote control
WO2015124033A1 (zh) 视频交互方法、终端、服务器及系统
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
WO2019036942A1 (zh) 一种显示方法及装置
JP5990845B2 (ja) メディアコンテンツを共有するための方法、端末デバイス、およびコンテンツ共有システム
CN107333162B (zh) 一种播放直播视频的方法和装置
WO2021083168A1 (zh) 视频分享方法及电子设备
WO2018120955A1 (zh) 直播编码的方法、装置、终端、联动编码服务器及系统
US9602868B2 (en) Method and apparatus for controlling a media device
WO2015143900A1 (zh) 网络会议中进行数据共享的方法、装置及系统
CN110224920B (zh) 一种分享方法及终端设备
CN112312144B (zh) 一种直播方法、装置、设备和存储介质
CN113810732B (zh) 直播内容显示方法、装置、终端、存储介质及程序产品
WO2016119165A1 (zh) 历史聊天记录展示的方法和装置
WO2017215661A1 (zh) 一种场景音效的控制方法、及电子设备
WO2021078215A1 (zh) 一种云游戏跨终端切换的方法和相关装置
WO2021190373A1 (zh) 一种交互方法、交互系统和显示设备
CN114071425A (zh) 电子设备间的协同方法、协同系统和电子设备
CN111447598B (zh) 一种交互方法和显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16922245

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019528445

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20197017630

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2016922245

Country of ref document: EP

Effective date: 20190624