CN106385590B - Video push long-range control method and device - Google Patents

Video push long-range control method and device Download PDF

Info

Publication number
CN106385590B
CN106385590B CN201610818772.5A CN201610818772A CN106385590B CN 106385590 B CN106385590 B CN 106385590B CN 201610818772 A CN201610818772 A CN 201610818772A CN 106385590 B CN106385590 B CN 106385590B
Authority
CN
China
Prior art keywords
video
server
video stream
live broadcast
sources
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610818772.5A
Other languages
Chinese (zh)
Other versions
CN106385590A (en
Inventor
陈永坚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huaduo Network Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201610818772.5A priority Critical patent/CN106385590B/en
Publication of CN106385590A publication Critical patent/CN106385590A/en
Application granted granted Critical
Publication of CN106385590B publication Critical patent/CN106385590B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365Multiplexing of several video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541Rights Management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26606Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for generating or managing entitlement messages, e.g. Entitlement Control Message [ECM] or Entitlement Management Message [EMM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • H04N21/274Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2747Remote storage of video programs received via the downstream path, e.g. from the server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a kind of video push long-range control method, and described method includes following steps: obtaining direct broadcasting room main broadcaster's client video flowing comprising multipath video source from server;It is parsed from the video flowing and shows at least corresponding video image of video source or its identification information all the way;Reception acts on video image corresponding to one or more of described video source or the operational order of its identification information, it submits to the server and is requested with the operational order corresponding operation, push to direct broadcasting room to drive the server to synthesize corresponding target video stream.The present invention can be passed through field control terminal field control personnel based on the access of multi-channel video and the performance live streaming of direct broadcasting room main broadcaster is remotely switched and controlled, to reach the video image of output optimal viewing angle effect.

Description

Video push remote control method and device
Technical Field
The invention relates to the technical field of network live broadcast, in particular to a video switching control method and device.
Background
With the development of science and technology, internet-based live webcasts are growing up rapidly, and users can watch video programs in live webcasts by using a playing terminal anytime and anywhere. With the increasing attention of users to webcast, how to output high-definition video in webcast process is also becoming more important.
Many users today prefer to watch their own desired programs on the internet. In the live broadcast industry, a director often performs some talents, such as dancing, magic, etc., in the middle of a program in order to attract more fans. At this time, the camera is far away from the anchor, so that switching of the multi-channel video sources is inconvenient to control, and a user often cannot see the anchor or cannot see a specific area of the anchor, so that actions of the anchor cannot be restored by 360 degrees.
In the prior art, when the anchor broadcasts or videos are shot, the anchor broadcasts cannot switch and control the output video streams in real time, so that the problems of 'unclear and invisible' often occur, the video definition is not high, and the user experience is poor.
Disclosure of Invention
In view of the above problems, the present invention provides a video switching control method and a corresponding apparatus.
The invention also provides a device for executing the video push remote control method.
In order to solve the problems, the invention adopts the following technical scheme:
in a first aspect, the present invention provides a video push remote control method, including the following steps:
acquiring a main broadcasting client video stream of a live broadcasting room containing a plurality of video sources from a server;
analyzing and displaying at least one video image corresponding to the video source or identification information thereof from the video stream;
and receiving an operation instruction acting on one or more corresponding video images or identification information thereof in the video source, and submitting an operation request corresponding to the operation instruction to the server so as to drive the server to synthesize a corresponding target video stream and push the target video stream to a live broadcast room.
With reference to the first aspect, in a first implementation manner of the first aspect, the live broadcast client side video stream that includes multiple video sources is implemented by encoding, compressing, and packaging the video sources into an upstream video stream by the live broadcast client side, and uploading the upstream video stream to the server.
With reference to the first aspect, in a second implementation manner of the first aspect, the step of submitting, to the server, an operation request corresponding to the operation instruction further includes:
submitting current user identity information to a signaling server, wherein the identity information is associated with the ID of the anchor client of the live broadcast room and a corresponding secret key, and the signaling server authenticates according to the identity information and returns an authorization token;
and submitting the token to the server, wherein the token needs to be acquired again after being invalid.
With reference to the first aspect, in a third implementation manner of the first aspect, the step of driving the server to synthesize the corresponding target video stream and push the target video stream to a live broadcast room specifically includes:
generating and displaying a path of preview video stream according to the operation instruction and submitting an operation request corresponding to the operation instruction to the server;
and under the action of the operation request, the server is driven to synthesize a target video stream consistent with the preview video stream and push the target video stream to a live broadcast room so as to display the target video stream on a main broadcast client side of the live broadcast room.
With reference to the third implementation manner of the first aspect, in a fourth implementation manner of the first aspect, the method further includes:
the operation instruction is a switching control instruction used for selecting any one of the video sources as the target video stream;
and submitting an operation request corresponding to the control instruction to the server to drive the server to push the target video stream to the live broadcast room so as to synchronously display the video image of the selected video source at the anchor client of the live broadcast room.
With reference to the third implementation manner of the first aspect, in a fifth implementation manner of the first aspect, the operation instruction is a video merge instruction, a merge request corresponding to the merge instruction is submitted to the server to drive the server to synthesize a target video stream including multiple video sources, and the target video stream is pushed to a live broadcast room to display video images of the multiple video sources on a live broadcast client side of the live broadcast room on the same screen.
With reference to the third implementation manner of the first aspect, in a sixth implementation manner of the first aspect, the operation instruction is a video editing instruction, an editing request corresponding to the editing instruction is submitted to the server to drive the server to synthesize a target video stream including subtitles, background music, and special effects, and the target video stream is pushed and displayed on a live broadcast client in a live broadcast room.
With reference to the first aspect, in a seventh implementation manner of the first aspect, the step of parsing and displaying at least one video image corresponding to the video source or identification information thereof from the video stream specifically includes:
displaying a user interface to select one or more video images corresponding to the video sources or identification information thereof and display the selected video images or the identification information on a preview window;
and displaying a user interface for switching the video image of the preview window to a live window.
In a second aspect, the present invention provides a video push remote control device, including:
the acquisition module acquires a video stream of a main broadcasting client of a live broadcasting room containing a plurality of paths of video sources from a server;
the analysis module is used for analyzing and displaying at least one video image corresponding to the video source or identification information thereof from the video stream;
and the processing module is used for receiving an operation instruction which acts on one or more corresponding video images in the video sources or identification information thereof, and submitting an operation request corresponding to the operation instruction to the server so as to drive the server to synthesize a corresponding target video stream and push the target video stream to a live broadcast room.
In a third aspect, the present invention provides a mobile terminal, including:
the display is used for displaying a user interface and realizing man-machine interaction;
one or more processors;
a memory;
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors;
the one or more programs may be configured to cause the one or more processors to construct modules for performing the methods of the above-described aspects.
Compared with the prior art, the technical scheme of the invention at least has the following advantages:
the invention can acquire the multi-channel video stream collected and uploaded to the video server by the anchor client of the live broadcast room in real time, receive the operation instruction of the user, submit the operation request corresponding to the operation instruction to the server, and based on the operation instruction, the invention is matched with the server technology, and remotely switches and controls the live broadcast of the anchor of the live broadcast room in real time through the field control end, so as to achieve the effect of outputting local video and specific visual angle, thereby outputting the video image with optimal visual angle effect and more clearness in the live broadcast room.
The implementation of the invention solves the problems of frequent 'unclear and unseen' caused by the fact that the anchor can not switch and control the output video stream in real time when the anchor plays or shoots the video, low video definition, poor user experience and the like in the prior art.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating an embodiment of a method for remote control of video push according to the present invention.
Fig. 2 is a schematic diagram of a display interface of a field control terminal according to an embodiment of the present invention.
Fig. 3 is a schematic diagram of a second display interface of the field control terminal according to the embodiment of the invention.
Fig. 4 is a third schematic view of a display interface of the field control terminal according to the embodiment of the present invention.
FIG. 5 is a flowchart illustrating an embodiment of a video push remote control device according to the present invention.
Fig. 6 is a block diagram of a mobile terminal part according to the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention.
In some of the flows described in the present specification and claims and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, with the order of the operations being numbered, e.g., S11, S12, etc., merely to distinguish between various operations, and the order of the operations by themselves is not meant to imply any order of execution. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As will be appreciated by those skilled in the art, "terminal" as used herein includes both devices that are wireless signal receivers, devices that have only wireless signal receivers without transmit capability, and devices that include receive and transmit hardware, devices that have receive and transmit hardware capable of performing two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "terminal" or "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. As used herein, the "terminal" and "terminal Device" may also be a Mobile terminal, a web terminal, and a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.
As one of ordinary skill in the art will appreciate, the terms involved in the present invention are meant to be resolved as follows:
network interactive live broadcast: aiming at users with live broadcast requirements, by utilizing the Internet (or a private network) and an advanced multimedia communication technology and constructing a multifunctional network live broadcast platform integrating audio, video, desktop sharing, document sharing and interaction links on the network, enterprises or individuals can directly carry out comprehensive communication and interaction of voice, video and data on line. The system mainly comprises a live broadcast client, a live broadcast webpage end and a management background.
User Interface (UI): is a medium for interaction and information exchange between the system and the user, which realizes the conversion between the internal form of the information and the human acceptable form. The user interface is designed between a user and hardware to interactively communicate with each other, and aims to enable the user to conveniently and efficiently operate the hardware to achieve bidirectional interaction and complete work which is expected to be completed by means of the hardware.
The method is mainly suitable for terminals with communication functions, such as intelligent notebook terminals or intelligent tablet terminals, is not limited to the type of the operating system, and can be used for operating systems such as Android, IOS, Windows Phone and Saiban.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, in a multi-channel video push remote control method provided by the present invention, in a specific implementation manner, the method specifically includes the following steps:
and S11, acquiring the live broadcast client video stream containing the multi-channel video source from the server.
The method comprises the steps that a main broadcast client of a live broadcast room acquires video information of a plurality of cameras as a multi-channel video source, and the client preprocesses the multi-channel video source into streaming media to be suitable for streaming transmission and simultaneously meet the requirement of network broadband on the data flow of the streaming media. The preprocessing is mainly realized by reducing the quality, and adopting an efficient compression algorithm and an efficient encoding method to encode, compress and pack the video source into an uplink video stream and upload the uplink video stream to the server.
And the field control terminal acquires the uplink video stream containing the multi-channel video source from the server in real time, correspondingly decodes and displays the uplink video stream so as to perform subsequent processing operation on the uplink video stream, thereby achieving the purpose of remotely controlling the video push of the anchor client of the live broadcast room.
And S12, analyzing and displaying at least one video image corresponding to the video source or the identification information thereof from the video stream.
Referring to fig. 2 and fig. 3, fig. 3 shows a display interface of a field control terminal not accessing a video stream, and fig. 3 shows a display interface of a field control terminal accessing a video source for displaying a video image corresponding to the video source or identification information thereof and other control key information.
The field control terminal acquires a live broadcast client video stream containing multiple video sources from the server and correspondingly decodes the live broadcast client video stream, extracts at least one decoded video stream and displays the video stream in a video monitoring window such as a lower row window in fig. 2 and fig. 3, wherein the video monitoring window is used for displaying at least one video stream to be processed, and the at least one decoded video stream can be displayed in the video monitoring window in the form of a preview image or displayed in the video monitoring window by using identification information corresponding to the at least one video stream.
Receiving a selection instruction of one or more corresponding video images or identification information thereof in the video sources acting on the video monitoring window, and displaying the selected one or more video images corresponding to the video sources on a preview window, such as the upper left window in fig. 2 and 3, wherein the preview window is used for displaying the preview effect of the processed video stream.
Receiving a switching instruction for a preview window, and switching a video image corresponding to one or more video sources to a live broadcast window, such as an upper right window in fig. 2 and 3, where the live broadcast window is used to display a live broadcast state of a currently live broadcast video stream. In the window, a control key in the live broadcast state, such as the switch key in fig. 2 and fig. 3, is provided for receiving a control instruction for the current live broadcast state, where the control instruction includes operation instructions of live broadcast start, live broadcast pause, and live broadcast close.
And S13, receiving an operation instruction acting on one or more corresponding video images in the video sources or identification information thereof, and submitting an operation request corresponding to the operation instruction to the server so as to drive the server to synthesize a corresponding target video stream and push the target video stream to a live broadcast room.
The field control terminal receives an operation instruction which acts on one or more corresponding video images in the video source or identification information thereof, generates and displays a path of preview video stream according to the operation instruction, submits an operation request corresponding to the operation instruction to the server, and drives the server to synthesize a path of target video stream consistent with the preview video stream under the action of the operation request and pushes the target video stream to a live broadcast room so as to display the target video stream at a main broadcast client of the live broadcast room. The target video stream, referred to herein as being identical to the preview video stream, may have a temporal delay between the two video streams due to network transmission, and thus, those skilled in the art will appreciate the existence of such an error as they understand the present invention.
When the field control terminal submits the operation request to the server, the field control terminal needs to obtain the authorization of the signaling server and submit the authorization token returned by the signaling server based on the successful authentication to the server. The authorization process is specifically realized by submitting current user identity information to a signaling server, wherein the identity information is associated with the ID of the anchor client of the live broadcast room and a corresponding secret key, and the signaling server authenticates according to the identity information and returns an authorization token. The token has a general valid value of 7 days or other preset values, and needs to log in again after expiration, or acquire a new token before failure.
The operation instruction can also be a switching control instruction used for selecting any one of the video sources as the target video stream; and submitting an operation request corresponding to the control instruction to the server according to the switching control instruction so as to drive the server to push the target video stream to the live broadcast room to synchronously display the video image of the selected video source at the anchor client side of the live broadcast room.
Referring to fig. 4, fig. 4 shows a display interface of the field control terminal accessing two video sources, for displaying video images or identification information thereof corresponding to the two video sources. In one possible design, the following two operation commands are preferred by the present invention to illustrate the remote control method of the present invention.
The operation instruction is a video merging instruction, a merging request corresponding to the merging instruction is submitted to the server to drive the server to synthesize a target video stream containing multiple video sources, and the target video stream is pushed to a live broadcast room to display video images of the multiple video sources on a main broadcast client side of the live broadcast room on the same screen.
As shown in fig. 4, the field control terminal provides a video monitoring window, a user can generate a trigger instruction for selecting any multiple channels of the video sources by operating through the video monitoring window, and switches the trigger instruction to a preview window, the preview window provides an example menu window for combining the video images of the selected multiple channels of video sources, as shown in the lower left of the preview window in fig. 4, the user selects a combination form through the window for calling, and the combined preview video stream can be switched to a live broadcast window through a switching button on the user interface.
And secondly, the operation instruction is a video editing instruction, an editing request corresponding to the editing instruction is submitted to the server to drive the server to synthesize a target video stream containing subtitles, background music and special effects, and the target video stream is pushed and displayed on a main broadcasting client side of a live broadcasting room.
As shown in fig. 4, the added materials such as subtitles, pictures, background music, special effects, scenes, etc. are remixed with the video, the video sources are cut and merged, and the target video streams with different expressive power are generated by secondary encoding.
By combining the above embodiments, the field control terminal can acquire, in real time, multiple paths of video streams collected and uploaded to the video server by the main broadcast client in the live broadcast room, receive an operation instruction of a user, and submit an operation request corresponding to the operation instruction to the server, on the basis, the field control terminal is matched with the server technology, and remote switching and control are performed on live performance of the main broadcast in the live broadcast room in real time, so that an effect of outputting a high-definition video is achieved.
Referring to fig. 5, in order to further describe the video push remote control method of the present invention, a video push remote control device is provided, which in one embodiment includes an obtaining module 11, a parsing module 12, and a processing module 13. Wherein,
the acquisition module 11: a live room anchor client video stream containing multiple video sources is obtained from a server.
The method comprises the steps that a main broadcast client of a live broadcast room acquires video information of a plurality of cameras as a multi-channel video source, and the client preprocesses the multi-channel video source into streaming media to be suitable for streaming transmission and simultaneously meet the requirement of network broadband on the data flow of the streaming media. The preprocessing is mainly realized by reducing the quality, and adopting an efficient compression algorithm and an efficient encoding method to encode, compress and pack the video source into an uplink video stream and upload the uplink video stream to the server.
And the field control terminal in the module acquires the uplink video stream containing multiple video sources from the server in real time, correspondingly decodes and displays the uplink video stream to perform subsequent processing operation on the uplink video stream so as to achieve the video push of the anchor client of the remote control live broadcast room.
The analysis module 12: and analyzing and displaying at least one path of video image or identification information thereof corresponding to the video source from the video stream.
The field control terminal correspondingly decodes the video acquired by the acquisition module 11, extracts at least one decoded video stream and displays the at least one decoded video stream on a video monitoring window, where the video monitoring window is used to display at least one video stream to be processed, and the at least one decoded video stream may be displayed on the video monitoring window in the form of a preview image or displayed on the video monitoring window in the form of identification information corresponding to the at least one video stream.
Receiving a selection instruction of one or more corresponding video images or identification information thereof in the video sources acting on the video monitoring window, and displaying the selected one or more video images corresponding to the video sources on a preview window, wherein the preview window is used for displaying the preview effect of the processed video stream.
Receiving a switching instruction aiming at a preview window, and switching the video images corresponding to one or more video sources to a live broadcast window, wherein the preview window is used for displaying the live broadcast state of the current live broadcast video stream. In the window, a control key in a live broadcast state is provided for receiving a control instruction aiming at the current live broadcast state, wherein the control instruction comprises operation instructions of live broadcast starting, live broadcast pausing and live broadcast closing.
The processing module 13: and receiving an operation instruction acting on one or more corresponding video images or identification information thereof in the video source, and submitting an operation request corresponding to the operation instruction to the server so as to drive the server to synthesize a corresponding target video stream and push the target video stream to a live broadcast room.
The field control terminal receives an operation instruction which acts on one or more corresponding video images in the video source or identification information thereof, generates and displays a path of preview video stream according to the operation instruction, submits an operation request corresponding to the operation instruction to the server, and drives the server to synthesize a path of target video stream consistent with the preview video stream under the action of the operation request and pushes the target video stream to a live broadcast room so as to display the target video stream at a main broadcast client of the live broadcast room. The target video stream, referred to herein as being identical to the preview video stream, may have a temporal delay between the two video streams due to network transmission, and thus, those skilled in the art will appreciate the existence of such an error as they understand the present invention.
When the field control terminal submits the operation request to the server, the field control terminal needs to obtain the authorization of the signaling server and submit the authorization token returned by the signaling server based on the successful authentication to the server. The authorization process is specifically realized by submitting current user identity information to a signaling server, wherein the identity information is associated with the ID of the anchor client of the live broadcast room and a corresponding secret key, and the signaling server authenticates according to the identity information and returns an authorization token. The token has a general valid value of 7 days or other preset values, and needs to log in again after expiration, or acquire a new token before failure.
The operation instruction can also be a switching control instruction used for selecting any one of the video sources as the target video stream; and submitting an operation request corresponding to the control instruction to the server according to the switching control instruction so as to drive the server to push the target video stream to the live broadcast room to synchronously display the video image of the selected video source at the anchor client side of the live broadcast room.
In one possible design, the following two operation commands are preferred by the present invention to illustrate the remote control method of the present invention.
The operation instruction is a video merging instruction, a merging request corresponding to the merging instruction is submitted to the server to drive the server to synthesize a target video stream containing multiple video sources, and the target video stream is pushed to a live broadcast room to display video images of the multiple video sources on a main broadcast client side of the live broadcast room on the same screen.
The field control terminal provides a video monitoring window, a user can generate a trigger instruction for selecting any multiple paths of video sources by operating through the video monitoring window and switches the trigger instruction to a preview window, the preview window provides an example menu window for video image combination of the selected multiple paths of video sources, the user selects a combination form for calling through the window, and the combined preview video stream can be switched to a live broadcast window through a switching button on the user interface.
And secondly, the operation instruction is a video editing instruction, an editing request corresponding to the editing instruction is submitted to the server to drive the server to synthesize a target video stream containing subtitles, background music and special effects, and the target video stream is pushed and displayed on a main broadcasting client side of a live broadcasting room.
Through remixing added materials such as subtitles, pictures, background music, special effects, scenes and the like with the video, cutting and combining video sources, and through secondary coding, generating target video streams with different expressive power.
The embodiment of the invention is used for solving the problems that in the prior art, when a video is taken or a main broadcast is in progress, the main broadcast cannot switch and control the output video stream in real time, so that the output video stream is often not seen clearly and cannot be seen, the video definition is not high, and the user experience is poor.
As shown in fig. 6, for convenience of description, only the parts related to the embodiment of the present invention are shown, and details of the specific technology are not disclosed, please refer to the method part of the embodiment of the present invention. The terminal may be any terminal device including a notebook, a tablet, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, etc., taking the terminal as the notebook as an example:
fig. 6 is a block diagram illustrating a partial structure of a notebook related to a terminal provided by an embodiment of the present invention. Referring to fig. 6, the notebook includes: a display 0612, a processor 0610, a memory 0611, and the like. Those skilled in the art will appreciate that the notebook configuration shown in FIG. 6 does not constitute a limitation of the notebook, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the notebook specifically with reference to fig. 6:
the memory 0611 may be used to store software programs and modules, and the processor 0610 may execute various functional applications and data processing of the notebook by operating the software programs and modules stored in the memory 0611. The memory 0611 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, an application (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the notebook, etc. In addition, memory 0611 may comprise high speed random access memory and may also comprise non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The display 0612 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor, and can receive and execute commands sent by the processor. In addition, the display can be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave.
The display 0612 may be used to display information entered by or provided to the user as well as various menus of the notebook, such as an information editing interface. The Display 0612 may include a Display panel, and may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, when the display 0612 detects a touch operation on or near the display, the touch operation is transmitted to the processor to determine the type of touch event, and then the processor provides a corresponding visual output on the display according to the type of touch event.
The processor 0610 is a control center of the notebook computer, connects various parts of the entire notebook computer using various interfaces and lines, and performs various functions of the notebook computer and processes data by operating or executing software programs and/or modules stored in the memory 0611 and calling data stored in the memory 0611, thereby integrally monitoring the notebook computer. Alternatively, processor 0610 may include one or more processing units; preferably, the processor 0610 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 0610.
The notebook further includes a power supply (e.g., a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the processor 0610 through a power management system, so that the power management system may manage charging, discharging, and power consumption.
Although not shown, the notebook may further include a mouse, a keyboard, a camera, a wireless module, and other peripheral devices, which are not described herein.
In this embodiment of the present invention, the processor 0610 included in the terminal further has the following functions:
acquiring a main broadcasting client video stream of a live broadcasting room containing a plurality of video sources from a server;
analyzing and displaying at least one video image corresponding to the video source or identification information thereof from the video stream;
and receiving an operation instruction acting on one or more corresponding video images or identification information thereof in the video source, and submitting an operation request corresponding to the operation instruction to the server so as to drive the server to synthesize a corresponding target video stream and push the target video stream to a live broadcast room.
And the live broadcast client-side video stream containing the multi-channel video sources is realized by encoding the video sources through the live broadcast client-side, compressing and packaging the video sources into an uplink video stream and uploading the uplink video stream to the server.
The step of submitting the operation request corresponding to the operation instruction to the server further comprises:
submitting current user identity information to a signaling server, wherein the identity information is associated with the ID of the anchor client of the live broadcast room and a corresponding secret key, and the signaling server authenticates according to the identity information and returns an authorization token;
and submitting the token to the server, wherein the token needs to be acquired again after being invalid.
Generating and displaying a path of preview video stream according to the operation instruction and submitting an operation request corresponding to the operation instruction to the server;
and under the action of the operation request, the server is driven to synthesize a target video stream consistent with the preview video stream and push the target video stream to a live broadcast room so as to display the target video stream on a main broadcast client side of the live broadcast room.
The operation instruction is a switching control instruction used for selecting any one of the video sources as the target video stream;
and submitting an operation request corresponding to the control instruction to the server to drive the server to push the target video stream to the live broadcast room so as to synchronously display the video image of the selected video source at the anchor client of the live broadcast room.
The operation instruction is a video merging instruction, a merging request corresponding to the merging instruction is submitted to the server to drive the server to synthesize a target video stream containing multiple video sources, and the target video stream is pushed to a live broadcast room to display video images of the multiple video sources on a live broadcast client side in the live broadcast room on the same screen.
The operation instruction is a video editing instruction, an editing request corresponding to the editing instruction is submitted to the server to drive the server to synthesize a target video stream containing subtitles, background music and special effects, and the target video stream is pushed and displayed on a main broadcasting client side of a live broadcast room.
Displaying a user interface to select one or more video images corresponding to the video sources or identification information thereof and display the selected video images or the identification information on a preview window;
and displaying a user interface for switching the video image of the preview window to a live window.
By combining the above embodiments, in a possible application scenario, multiple cameras in a live broadcast room perform video source acquisition on the performance of a main broadcast in real time, an main broadcast client in the live broadcast room acquires the video source in real time and uploads the video source to the server, a field control terminal acquires and displays the video source from the server, and a field control person at the field control end performs lens switching according to the displayed video source, so as to present a main broadcast interface with an optimal viewing angle to audiences through switching of the field control person, thereby realizing that the video switching of the live broadcast room is accessed by a director of the field control person to remotely control the video switching of the live broadcast room in real time so as to output a video image with a specific viewing angle.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, or the like.
It will be understood by those skilled in the art that all or part of the steps in the method for implementing the above embodiments may be implemented by hardware that is instructed to implement by a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
While the mobile terminal and the router provided by the present invention have been described in detail, those skilled in the art will appreciate that the present invention is not limited to the above embodiments, and that the present invention is not limited to the above embodiments.

Claims (10)

1. A video push remote control method is characterized by comprising the following steps:
acquiring a main broadcasting client video stream of a live broadcasting room containing a plurality of video sources from a server;
analyzing the video stream and displaying at least one video image corresponding to the video source or identification information thereof through a display interface; the display interface comprises a video monitoring window, a preview window and a live broadcast window; extracting at least one decoded video stream and displaying the video stream on the video monitoring window; receiving a selection instruction of one or more corresponding video images or identification information thereof in the video sources acting on the video monitoring window, and displaying the video images corresponding to the selected one or more video sources on a preview window; receiving a switching instruction aiming at the preview window, and switching the video images corresponding to one or more video sources to the live broadcast window; the preview window provides an example menu window for video image combination of multiple video sources, and the combination form of the video images of the multiple video sources is selected through the example menu window;
receiving an operation instruction acting on one or more corresponding video images in the video sources or identification information thereof, wherein the operation instruction is a video merging instruction, submitting a merging request corresponding to the merging instruction to the server so as to drive the server to synthesize a target video stream containing multiple video sources, and pushing the target video stream to a live broadcast room so as to display the video images of the multiple video sources on a live broadcast client side in the live broadcast room on the same screen.
2. The remote control method for video push as claimed in claim 1, wherein said live broadcast client video stream containing multiple video sources is implemented by encoding, compressing and packaging said video sources into an upstream video stream by said live broadcast client and uploading the upstream video stream to said server.
3. The video push remote control method according to claim 1, wherein the step of submitting the operation request corresponding to the operation instruction to the server further comprises:
submitting current user identity information to a signaling server, wherein the identity information is associated with the ID of the anchor client of the live broadcast room and a corresponding secret key, and the signaling server authenticates according to the identity information and returns an authorization token;
and submitting the token to the server, wherein the token needs to be acquired again after being invalid.
4. The video push remote control method according to claim 1, wherein the step of driving the server to synthesize the corresponding target video stream and push the target video stream to the live broadcast room specifically includes:
generating and displaying a path of preview video stream according to the operation instruction and submitting an operation request corresponding to the operation instruction to the server;
and under the action of the operation request, the server is driven to synthesize a target video stream consistent with the preview video stream and push the target video stream to a live broadcast room so as to display the target video stream on a main broadcast client side of the live broadcast room.
5. The video push remote control method according to claim 4, further comprising:
the operation instruction is a switching control instruction used for selecting any one of the video sources as the target video stream;
and submitting an operation request corresponding to the control instruction to the server to drive the server to push the target video stream to the live broadcast room so as to synchronously display the video image of the selected video source at the anchor client of the live broadcast room.
6. The method as claimed in claim 4, wherein the operation command is a video merge command, a merge request corresponding to the merge command is submitted to the server to drive the server to compose a target video stream including multiple video sources, and the target video stream is pushed to a live broadcast room to display video images of the multiple video sources on the same screen at a live broadcast client of the live broadcast room.
7. The method according to claim 4, wherein the operation command is a video editing command, and an editing request corresponding to the editing command is submitted to the server to drive the server to compose a target video stream containing subtitles, background music, and special effects, and the target video stream is pushed and displayed on a live room anchor client.
8. The video push remote control method according to claim 1, wherein the step of parsing and displaying at least one video image corresponding to the video source or identification information thereof from the video stream specifically includes:
displaying a user interface to select one or more video images corresponding to the video sources or identification information thereof and display the selected video images or the identification information on a preview window;
and displaying a user interface for switching the video image of the preview window to a live window.
9. A video push remote control device, comprising:
the acquisition module acquires a video stream of a main broadcasting client of a live broadcasting room containing a plurality of paths of video sources from a server;
the analysis module is used for analyzing the video stream and displaying at least one video image corresponding to the video source or identification information thereof through a display interface; the display interface comprises a video monitoring window, a preview window and a live broadcast window; extracting at least one decoded video stream and displaying the video stream on the video monitoring window; receiving a selection instruction of one or more corresponding video images or identification information thereof in the video sources acting on the video monitoring window, and displaying the video images corresponding to the selected one or more video sources on a preview window; receiving a switching instruction aiming at the preview window, and switching the video images corresponding to one or more video sources to the live broadcast window; the preview window provides an example menu window for video image combination of multiple video sources, and the combination form of the video images of the multiple video sources is selected through the example menu window;
and the processing module is used for receiving an operation instruction which acts on one or more corresponding video images in the video sources or identification information thereof, wherein the operation instruction is a video merging instruction, submitting a merging request corresponding to the merging instruction to the server so as to drive the server to synthesize a target video stream containing multiple video sources, and pushing the target video stream to a live broadcast room so as to display the video images of the multiple video sources on the same screen at a main broadcast client side of the live broadcast room.
10. A mobile terminal, comprising:
the display is used for displaying a user interface and realizing man-machine interaction;
one or more processors;
a memory;
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors;
the one or more programs for driving the one or more processors to construct modules for performing the method of any of claims 1-8.
CN201610818772.5A 2016-09-12 2016-09-12 Video push long-range control method and device Active CN106385590B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610818772.5A CN106385590B (en) 2016-09-12 2016-09-12 Video push long-range control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610818772.5A CN106385590B (en) 2016-09-12 2016-09-12 Video push long-range control method and device

Publications (2)

Publication Number Publication Date
CN106385590A CN106385590A (en) 2017-02-08
CN106385590B true CN106385590B (en) 2019-08-02

Family

ID=57936428

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610818772.5A Active CN106385590B (en) 2016-09-12 2016-09-12 Video push long-range control method and device

Country Status (1)

Country Link
CN (1) CN106385590B (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108282598B (en) * 2017-05-19 2020-12-15 广州华多网络科技有限公司 Software broadcasting guide system and method
CN108289159B (en) * 2017-05-25 2020-12-04 广州华多网络科技有限公司 Terminal live broadcast special effect adding system and method and terminal live broadcast system
CN109391780A (en) * 2017-08-10 2019-02-26 徐文波 Video guide's method, apparatus and intelligent terminal on the line carried out in a kind of intelligent terminal
CN107547910A (en) * 2017-08-24 2018-01-05 深圳依偎控股有限公司 A kind of method and device live based on more equipment
CN108024123A (en) * 2017-11-08 2018-05-11 北京密境和风科技有限公司 A kind of live video processing method, device, terminal device and server
CN109963162B (en) * 2017-12-25 2021-04-30 阿里巴巴集团控股有限公司 Cloud directing system and live broadcast processing method and device
CN108200348B (en) * 2018-02-01 2020-08-04 安徽爱依特科技有限公司 Live broadcast platform based on camera
CN109257614B (en) * 2018-09-11 2021-05-07 腾讯数码(天津)有限公司 Live session access control method, device and storage medium
CN112449231B (en) * 2019-08-30 2023-02-03 腾讯科技(深圳)有限公司 Multimedia file material processing method and device, electronic equipment and storage medium
CN110691282B (en) * 2019-10-16 2021-11-02 北京字节跳动网络技术有限公司 Video processing method and device, storage medium and electronic equipment
CN112752033B (en) * 2019-10-31 2022-03-22 上海哔哩哔哩科技有限公司 Broadcasting directing method and system
CN110971926B (en) * 2019-12-02 2022-01-25 咪咕视讯科技有限公司 Video playing method, video processing device and storage medium
CN111918079A (en) * 2020-07-30 2020-11-10 广州世祥教育科技有限公司 Multi-mode live broadcast and automatic editing teaching system and method and electronic equipment
CN111954018B (en) 2020-08-14 2022-03-25 北京达佳互联信息技术有限公司 Live broadcast room management method, system, device, equipment and storage medium
CN112153412B (en) * 2020-08-20 2022-10-21 深圳市捷视飞通科技股份有限公司 Control method and device for switching video images, computer equipment and storage medium
CN111970464B (en) * 2020-08-25 2023-06-20 西安万像电子科技有限公司 Image data display method and device and image data display system
CN113473158B (en) * 2021-06-30 2024-01-30 北京百度网讯科技有限公司 Live broadcast data processing method, device, electronic equipment and medium
CN113938756B (en) * 2021-10-25 2022-11-18 联想(北京)有限公司 Display interface sharing processing method and system
CN114222190B (en) * 2021-12-14 2023-10-17 广州华多网络科技有限公司 Remote control processing and response method and device, equipment, medium and product thereof
CN115243058A (en) * 2022-05-23 2022-10-25 广州播丫科技有限公司 Live broadcast machine capable of realizing remote live broadcast and working method thereof
CN115514914A (en) * 2022-09-28 2022-12-23 深圳市拓普智造科技有限公司 Multimedia remote video system, method and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103154990A (en) * 2010-10-07 2013-06-12 Lg电子株式会社 Method for producing advertisement content using a display device and display device for same
CN105245937A (en) * 2015-09-30 2016-01-13 武汉科优达科技有限公司 Video scene control system and method
CN105872569A (en) * 2015-11-27 2016-08-17 乐视云计算有限公司 Video playing method and system, and devices
CN105828091B (en) * 2016-03-28 2018-11-09 广州华多网络科技有限公司 The playback method and system of video frequency program in network direct broadcasting

Also Published As

Publication number Publication date
CN106385590A (en) 2017-02-08

Similar Documents

Publication Publication Date Title
CN106385590B (en) Video push long-range control method and device
US11330332B2 (en) Systems and methods for transmission of data streams
CN110597774B (en) File sharing method, system, device, computing equipment and terminal equipment
US20180152736A1 (en) Live video recording, streaming, viewing, and storing mobile application, and systems and methods of use thereof
WO2018095174A1 (en) Control method, device, and terminal apparatus for synthesizing video stream of live streaming room
CN107872732B (en) Self-service interactive video live broadcast system
US20190342241A1 (en) Systems and methods for manipulating and/or concatenating videos
WO2018095146A1 (en) Method, device, and terminal apparatus for synthesizing video stream of live streaming room
CA2884407C (en) System and method for broadcasting interactive content
US20190281327A1 (en) Method For Controlling Delivery Of A Video Stream Of A Live-Stream Room, and Corresponding Server and Mobile Terminal
US20150124048A1 (en) Switchable multiple video track platform
CN101938626B (en) Video session terminal, system, and method
US20170280200A1 (en) Direct capture and sharing of screenshots from video programming
CN103369367B (en) Streamable content is used to improve the system and method for Consumer's Experience
US20090323802A1 (en) Compact camera-mountable video encoder, studio rack-mountable video encoder, configuration device, and broadcasting network utilizing the same
CN112055227A (en) Cloud game interaction method, system, device, storage medium and electronic equipment
US10439831B1 (en) Media control system, platform and method
US20180227504A1 (en) Switchable multiple video track platform
KR102313531B1 (en) System for cloud streaming service, method of cloud streaming service using single session multi-access and apparatus for the same
CN112584084B (en) Video playing method and device, computer equipment and storage medium
US20230209102A1 (en) Electronic device and operating method therefor
CN116456122A (en) Live video data processing method, device and system
KR20070063108A (en) An album service method and system using an effective image pre-processing method for several images

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20170208

Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

Contract record no.: X2021980000101

Denomination of invention: Remote control method and device of video push

Granted publication date: 20190802

License type: Common License

Record date: 20210106