CN111711833A - Live video stream push control method, device, equipment and storage medium - Google Patents

Live video stream push control method, device, equipment and storage medium Download PDF

Info

Publication number
CN111711833A
CN111711833A CN202010740451.4A CN202010740451A CN111711833A CN 111711833 A CN111711833 A CN 111711833A CN 202010740451 A CN202010740451 A CN 202010740451A CN 111711833 A CN111711833 A CN 111711833A
Authority
CN
China
Prior art keywords
video stream
screen direction
live broadcast
broadcast room
encoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010740451.4A
Other languages
Chinese (zh)
Other versions
CN111711833B (en
Inventor
任强强
童欢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN202010740451.4A priority Critical patent/CN111711833B/en
Publication of CN111711833A publication Critical patent/CN111711833A/en
Application granted granted Critical
Publication of CN111711833B publication Critical patent/CN111711833B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H04N21/234372Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution for performing aspect ratio conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42202Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4221Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities

Abstract

The application discloses a live video stream push control method, a live video stream push control device, equipment and a storage medium, wherein the method comprises the following steps: responding to a screen direction switching instruction received by local equipment in the process of pushing a video stream in a live broadcast room, and acquiring video stream coding configuration information corresponding to a target screen direction; while maintaining the existing stream pushing link of the video stream, pausing the execution of the encoding of the video stream, and updating the corresponding configuration required by the encoding of the video stream according to the encoding configuration information; and restarting to execute the encoding of the video stream so as to continuously push the video stream to the live broadcast room, so that a user in the live broadcast room displays the subsequently received video stream according to the layout which is matched with the target screen direction. According to the method and the device, when the network live broadcast is carried out, even if the screen direction is switched, the stability of the video plug flow link can be ensured, and a user receiving the video flow can obtain more natural transition video pictures.

Description

Live video stream push control method, device, equipment and storage medium
Technical Field
The present application relates to a network live broadcast control technology, and in particular, to a live broadcast video stream push control method, apparatus, device, and storage medium.
Background
When the network is broadcast directly, the video stream acquired by the camera equipment of the anchor user in the live broadcast room is encoded and then pushed to the server through the stream pushing link between the electronic equipment of the anchor user and the server, and the video stream is processed by the server and then pushed to the live broadcast room for display. And after receiving the video stream returned by the server, the anchor user can also play the returned video stream in a graphical user interface of a live broadcast room of the anchor user.
In the process of pushing a video stream to a server, a user of a host sometimes performs an operation of switching a screen direction, for example, a mobile phone used for shooting is switched from a state of being vertically placed to a state of being horizontally rotated, and vice versa. Conceivably, because the camera is rotated in the rotation of the mobile phone, the switching often results in the effect that the video stream returned by the server is synchronous when being displayed, the user side feels that the direction of the scenery is disordered at the moment, and the abnormal display effect is not in line with the application requirement.
In a solution of the prior art, when it is known that a main broadcast user rotates a mobile phone device, the video stream is stopped being pushed to a server, the server can only report an error to a user in a live broadcast room at this time or no longer output any information, and the user in the live broadcast room cannot receive any video stream, so that the user can only report an error in an original video play window or make the play window in a state without content.
In another solution, when it is known that the anchor user rotates the mobile phone device, the video stream is not pushed to the server, but the related configuration information is modified synchronously to notify the server that the user device performs the screen direction switching. In this case, the server keeps the configuration information in the first direction and receives the configuration information in the second direction suddenly, and this sudden nature is transmitted to all users in the live broadcast room, so that when the display state of the first direction is suddenly switched to the display state of the second direction in the video playing window of the user in the live broadcast room, there is no transition between the two size frames, and the switching effect is not good enough.
Therefore, the two modes in the prior art have the defect that the processing of the situation that the video stream of the anchor user is suddenly switched to the screen direction has a beautiful center, and the smoothness of the picture switching of the video stream is influenced by some factors which are not controlled by the anchor side, so that the space for further improving the user experience exists.
Disclosure of Invention
The first objective of the present application is to provide a live video stream push control method, so as to solve the problem of video stream picture transition caused by switching the screen direction in the live network process, so as to improve the viewing experience of the user.
As another object of the present application, a live video stream push control apparatus adapted to the foregoing method is provided.
As a further object of the present application, an electronic device adapted thereto is provided based on the foregoing method.
As a further object of the present application, a non-volatile storage medium is provided, which is adapted to store a computer program implemented according to the method.
In order to meet various purposes of the application, the following technical scheme is adopted in the application:
a live video stream push control method adapted to a primary object of the present application includes the following steps:
responding to a screen direction switching instruction received by local equipment in the process of pushing a video stream in a live broadcast room, and acquiring video stream coding configuration information corresponding to a target screen direction;
while maintaining the existing stream pushing link of the video stream, pausing the execution of the encoding of the video stream, and updating the corresponding configuration required by the encoding of the video stream according to the encoding configuration information;
and restarting to execute the encoding of the video stream so as to continuously push the video stream to the live broadcast room, so that a user in the live broadcast room displays the subsequently received video stream according to the layout which is matched with the target screen direction.
In one embodiment, a switching control is provided on a live broadcast user interface of the local device for controlled switching and triggering the screen direction switching instruction, a first screen direction switching instruction is generated due to odd number of touches of the switching control, and the target screen direction is determined to be longitudinal/transverse; and generating a second screen direction switching instruction due to even number of touch control of the switching control, and determining the target screen direction as horizontal/longitudinal.
In another class of embodiments, the local device pre-determines the target screen direction by recognizing motion data of a self acceleration sensor, and determines that the target screen direction is horizontal or vertical and triggers a corresponding screen direction switching instruction when the motion data matches with a trigger condition of the screen direction switching instruction.
In a further embodiment, the encoding configuration information includes resolution information, encoding format information, and transmission rate information corresponding to the target screen direction.
In a preferred embodiment, the push link is maintained between the local device and the server by a heartbeat packet, and after the encoding of the video stream is restarted, the local device sends the heartbeat packet through the push link to ensure that the push link is maintained.
In a further embodiment, the method further comprises the following subsequent steps:
and receiving the video stream returned by the live broadcast room, decoding the video stream, and displaying the video stream according to the layout matched with the direction of the target screen after the decoding is successful.
In a preferred embodiment, the layout adapted to the target screen direction is associated with one or more specific information contained in the encoding configuration information.
Another object of the present application is to provide a live video stream push control apparatus, which includes:
the switching unit is used for responding to a screen direction switching instruction received by local equipment in the process of pushing the video stream in the live broadcast room and acquiring video stream coding configuration information corresponding to a target screen direction;
the control unit is used for pausing the execution of the coding of the video stream while maintaining the existing stream pushing link of the video stream, and updating the corresponding configuration required by the coding of the video stream according to the coding configuration information;
and the restarting unit is used for restarting and executing the coding of the video stream so as to continuously push the video stream to the live broadcast room, so that a user in the live broadcast room displays the subsequently received video stream according to the layout which is adaptive to the target screen direction.
The electronic device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the live video stream push control method.
A non-volatile storage medium storing a computer program implemented according to the live video stream push control method is provided for adapting to a further object of the present application, and when the computer program is called by a computer, the computer program executes the steps included in the method.
Compared with the prior art, the application has the following advantages:
firstly, the application can improve the stability of the video stream pushing process of the network live broadcast.
In principle, the method starts execution by responding to a screen direction switching instruction received in the process of pushing the video stream in the live broadcasting room, further suspends the execution of the coding of the video stream under the condition of maintaining a current pushing link of the video stream, updates the coding configuration of the current video stream to the coding configuration of the video stream corresponding to the target screen direction, and then restarts the execution of the video stream coding, so that when a user in the live broadcasting room pauses the coding at a main broadcasting side, a cut-off error report cannot be caused due to the fact that a pushing link cannot be disconnected, a last picture before the pause coding can be maintained, when the main broadcasting side restarts the coding, new coding configuration information can be analyzed from the received video stream, and matching display is carried out according to the layout of the target screen direction according to the new configuration. It can be understood that, since the present application updates the configuration information of the video stream push by pausing the execution of the encoding of the video stream thereof instead of pausing the video stream push link, or by stopping the push link and the encoding at the same time, the problem of error or uncontrolled picture transition caused by the switching of the screen direction of the terminal by the anchor user can be effectively solved.
Secondly, the implementation of the application enables the live broadcast room video stream to keep natural switching transition even when the anchor user switches the screen direction. As described above, since the stream push link is maintained, and only the encoding is paused and restarted, when the anchor user stops encoding, the video playing window of the viewer user naturally displays the last frame of image before the encoding is stopped according to the existing implementation logic, without error reporting, and without operations such as stretching and amplifying, the picture remains natural, until the recoded video stream is received, the video playing window analyzes new encoding configuration information from the video stream to adjust the video stream to the display layout in the target screen direction, which is smooth and natural, improves the user experience, and further does not need to modify any code for the video playing plugin called by the live session application program.
In addition, the application provides various capacities for identifying the switching screen direction of the anchor user for the application program of the live broadcast room, and through the capacities, the anchor user can conveniently control the screen direction, and the user can conveniently control the screen direction to be switched through a control on a graphical user interface or through an event that the screen direction is switched through the pre-judgment of an acceleration sensor by the terminal equipment of the user, so that the anchor user can conveniently control the screen direction to achieve the various effects, and the application brings great efficiency improvement for the program development level.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;
fig. 2 is a schematic flowchart of an exemplary embodiment of a live video stream push control method according to the present application;
fig. 3 is a schematic diagram of an interaction process implemented by a computer program in a network deployment architecture when the computer program is executed according to the live video stream push control method of the present application;
fig. 4 is a schematic block diagram of an exemplary embodiment of a live video stream push control apparatus according to the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (personal communications Service), which may combine voice, data processing, facsimile and/or data communications capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global positioning system) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.
The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.
It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.
Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud end, and serves as a front-end application server, which can serve as or be responsible for further connecting a related data server, a video streaming server, a scoring server for scoring an instant video stream, and other servers providing related support, so as to form a logically associated server cluster to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure. Both the smart phone and the personal computer can access the internet through a known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server. In the related technical solution of the present application, the server 80 is responsible for establishing a live broadcast room operation service, and the terminal correspondingly operates an application program corresponding to the live broadcast room.
The webcast referred to in this application refers to a webcast room web service implemented based on the foregoing network deployment architecture.
The live broadcast room is a video chat room realized by means of an internet technology and generally has an audio and video broadcast control function. The development of the activity of the live broadcast room depends on the participation of a plurality of live broadcast room users, the live broadcast room users mainly comprise a main broadcast user and audience users, the main broadcast user and the audience users can realize interaction through known online interaction modes such as voice, video, characters and the like, generally, the main broadcast user performs programs for the audience users in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can be popularized to other relevant scenes, such as an educational training scene, a video conference scene, a product recommendation and sale scene, and any other scene needing similar interaction.
Generally, a platform side providing live broadcast service of a live broadcast room network provides related application programs, so that a host user and a viewer user can access a cloud server through running of the related application programs on terminal electronic equipment to realize live broadcast interaction. These applications may of course also provide other supplementary services and value added services.
After the application program of the live broadcast room is operated, a user enters a specific live broadcast room through a related entrance, and the live broadcast room correspondingly provides a graphical user interface for interaction among the users. In general, a graphical user interface of a live broadcast room includes a video playing window displayed by a video player, and is used for decoding a video stream pushed by a playing server and generated by a main broadcast user, and a related control for the user to perform information interaction is further provided. The live broadcast room can generally allow the video playing window to be played in a full-screen mode, and related controls for information interaction are temporarily hidden. The specific interface design schemes are not sufficient, and detailed descriptions are omitted.
As is well known, a video stream in a live broadcast room is generated from a camera unit of an electronic device of a user, and the camera unit may be a camera of the electronic device, or an external camera that is electrically connected to the electronic device. Besides driving the camera unit to acquire the video stream, the electronic device may further determine, according to user settings or in combination with an acceleration sensor carried by the electronic device, whether a current screen orientation of the electronic device is horizontal or vertical, so that the current screen orientation may be determined according to the orientation relationship, and further, various applications including a live broadcast room application may adjust a frame direction of the video stream generated by the camera unit by using the screen orientation, typically, adjusting a resolution from 1080 × 1920 to 1920 × 1080, for example.
The main broadcasting user of the live broadcasting room adjusts the electronic equipment from horizontal placement to vertical placement, in order to make the picture of the video stream synchronous with the current screen direction of the main broadcasting user, the change of the picture direction of the video stream is usually involved, and the setting of the picture of the video stream is usually realized at the stage of coding the video stream for transmitting to the server, therefore, the switching of the screen direction of the live broadcasting equipment needs to adjust the related coding mode.
The server can make coding configuration information in different screen directions for the anchor user according to the network condition and the service provided by the network condition, wherein the coding configuration information generally comprises the resolution of a video stream picture, the conversion rate for adapting the network bandwidth, a configuration scheme adopted when a network signal for indicating the electronic equipment of the anchor user is weak, a coding format received by the server and the like. Correspondingly, the coding configuration information generally includes resolution information, transmission rate information, weak network configuration information, coding format information, and the like. The principle is generally observed for encoding video streams, and those skilled in the art can know that some information is required and not required flexibly, for example, in the present application, encoding format information (e.g. designated as h.264 format) and resolution information (e.g. designated as 1080 × 1920 in a certain screen direction) are required, and the rest can be flexibly processed. In view of this, the respective specific information of the encoding configuration information will not be expanded.
Correspondingly, a user of the live broadcast room, especially a main broadcast user, can acquire the adaptive coding configuration information under the condition of different screen directions from the server in advance, that is, the coding configuration information in the target screen direction is usually downloaded to the terminal equipment of the main broadcast user in advance, so that the application program of the live broadcast room can be called conveniently when needed. Of course, the application program can request the server again to obtain the latest coding configuration information matched with different screen directions as required, and local corresponding data can be updated at any time.
Those skilled in the art should understand the principles and concepts disclosed herein before: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.
Referring to fig. 2 and fig. 3, an exemplary embodiment of a live video stream push control method according to the present application is shown as including the following steps:
step S11, responding to a screen direction switching instruction received by the local device during the process of pushing the video stream in the live broadcast room, acquiring video stream coding configuration information corresponding to the target screen direction:
fig. 3 is a schematic diagram of a logic schematic diagram based on program development thinking, and illustrates an implementation of a server side and a client side, where the client side includes an anchor side and a viewer side, and both are typically installed with a live broadcast application, and a media SDK is actually a development kit integrated into the application. That is, the live room application can theoretically implement all the functions of the anchor, the client and the media SDK shown in the figure, and it is considered as performing in different situations according to different users. In the following description, the subjects of execution between the specific interactions referred to in fig. 3 will be described separately so as not to obscure the description.
The method is executed in the process of broadcasting and pushing the video stream by the anchor user, so that the scene of execution of the method is that live broadcasting is in progress, and the anchor user suddenly initiates a screen direction switching instruction. Such a screen direction switching instruction may be recognized in one or more ways for the native device. Specifically, the following can be referred to:
in one mode, when the application program of the live broadcast room is developed, a switching control is provided for the graphical user interface of the live broadcast room, and a screen direction switching instruction is sent to the local equipment through the switching function of the switching control, so that the state switching of the screen representing the local equipment between the horizontal state and the longitudinal state is realized. For the anchor user, the anchor user sees the switching control from the live broadcast user interface of the local device, so that the switching control is triggered in a pointing mode to generate the screen direction switching instruction. The simple and direct implementation mode is that the switching control is designed to be a unidirectional switch, that is, odd number of times of touch control of the switching control is used for triggering and generating a first screen direction switching instruction, and the target screen direction is determined to be longitudinal/transverse; and even number of touch control of the switching control is used for triggering and generating a second screen direction switching instruction, and the target screen direction is determined to be horizontal/longitudinal. Therefore, the user can send different screen direction switching instructions through odd-number or even-number touch control.
In another mode, the live-air application program may not provide the switching control, and the application program may implement prejudgment on the screen switching intention of the terminal device by using the motion trend embodied by the motion data of the acceleration sensor of the terminal device of the anchor user. The technology of predicting the screen switching direction through the acceleration sensor is well known to those skilled in the art, so that when the live broadcast room application program can verify that the related data meets the triggering condition of the screen direction switching instruction according to the related system notification or system event triggered by the local device when the local device generates a screen switching trend, the live broadcast room application program can predict that the anchor user is about to send a screen switching instruction aiming at the target screen direction. For example, when the application program prejudgment related data of the live broadcast room represents that the local equipment is inclining towards the longitudinal direction, a first screen direction switching instruction is triggered, and the longitudinal direction is determined as the corresponding target screen direction; similarly, when the application program of the live broadcast room judges that the related data represent that the local equipment is inclining towards the transverse direction, a second screen direction switching instruction is triggered, and the transverse direction is determined as the corresponding target screen direction.
Referring to the examples of the various configurations of the trigger screen direction switching instruction and the corresponding target screen direction disclosed above, it can be understood that the live broadcast application program starts the execution of the subsequent process by using the trigger of the screen direction switching instruction as an entry to execute the method of the present application.
After the screen direction switching instruction and the corresponding target screen direction are determined, the live broadcast room application program can further acquire video stream coding configuration information corresponding to the target screen direction. As mentioned above, the live-room application can call up the encoding configuration information in the vertical or horizontal direction according to the target screen direction. In an example of the present application, it may be assumed that the encoding configuration information only includes resolution information, transmission code rate information, and encoding format information, which is not repeated.
This step will be more clearly understood in conjunction with the program implementation example of fig. 3: in fact, the program development can be realized by constructing a monitor instruction, which monitors the screen direction switching instruction, i.e. the screenorimentchanged instruction shown in fig. 3. When the screen direction switching instruction is triggered, the target screen direction can be obtained correspondingly, so that corresponding coding and preview configuration can be obtained according to the target screen direction, wherein the coding and preview configuration is referred to as coding configuration information for description in the text of the application. It can be seen that through the execution of this step, the encoding configuration information corresponding to the target screen direction is obtained.
Step S12, while maintaining the existing stream pushing link of the video stream, pausing the encoding of the video stream, and updating the corresponding configuration required for encoding the video stream according to the encoding configuration information:
during the process of pushing the video stream from the host to the server, a push link is maintained, when the encoded video stream is continuously uploaded to the server, it means that the push link is continuously active and thus maintained, and once the video stream is no longer uploaded and the server fails to receive the relevant data mark transmitted by the host user via the push link, the server considers that the push link has been interrupted. Therefore, the program developer can evaluate whether the time for implementing the step affects the maintenance of the plug flow link, and flexibly consider whether to send the relevant data mark to the server to maintain the plug flow link in the temporary process of suspending the uploading of the video stream coding to the server.
Generally, in order to ensure the maintenance of the push link due to a conservative policy, the present application recommends sending a heartbeat packet to the server through the push link at the local device, where the heartbeat packet is used as a data marker for the server to determine whether the push link continues to exist. Therefore, the heartbeat packet is sent between the local equipment of the anchor user and the server at regular time through the push flow link, so that the maintenance of the push flow link can be ensured without influencing the realization of the inventive spirit of the application.
The implementation of the key steps of the present application depends on the continuous existence of the streaming link, that is, while the streaming link is maintained, the present application reconfigures the coding configuration information required for coding by suspending the coding of the video stream, and then re-pushes the coded video stream after completing the configuration.
Referring to fig. 3, corresponding to this step, after the application program in the live broadcast room acquires the coding configuration information, it issues a stopEncoder instruction to notify the media SDK integrated by the application program to stop coding the video stream, and then, executes an updatepreviewe and encodedeconfig instruction, which is configured to implement reconfiguration of coding configuration information on which the media SDK is encoded, and after the configuration, when the media SDK subsequently encodes the video stream, it applies new resolution, coding format, transmission code rate, and weak network configuration information to implement coding.
It will be appreciated that if the original media SDK was encoded at a frame resolution of 1080 × 1920, then it may be configured to instead encode at a frame resolution of 1920 × 1080. Similarly, it can be understood that any decoding program receiving the media SDK encoded in this manner can identify and determine the target screen direction according to the information provided by this resolution, so that the display layout of the video stream played in the video playing window can be adaptively adjusted (or not automatically adjusted, depending on the flexible setting of the application development logic).
The push stream link between the main broadcast end and the server is maintained all the time, so that the server does not disconnect the push stream link between the main broadcast end and other users in the live broadcast room and does not report faults to other users.
Step S13, restarting to perform encoding on the video stream so as to continue to push the video stream to the live broadcast room, so that the user in the live broadcast room displays the subsequently received video stream in a layout adapted to the target screen direction:
please continue to combine with fig. 3, when the application issues an instruction to update the encoding configuration information of the media SDK integrated with the application, the instruction is usually expressed as writing or replacing the encoding configuration information to a certain place, at this time, the updating of the encoding configuration information is completed, and then, a startEncoder instruction can be issued to the media SDK, it can be understood that the instruction aims to notify the media SDK to call the updated encoding configuration information to continue to encode the video stream according to a normal flow and upload the video stream to the server, so that other users in the live broadcast room continue to receive the updated encoded video stream.
For a viewer user of the live broadcast room, the video playback window of the graphical user interface maintains the last frame of the video stream before the stop encoding, in a layout that matches the screen orientation (e.g., landscape) in which the main broadcast user's native device was originally located.
When the video stream uploaded by the anchor user and updated with the encoding configuration information is pushed to the live broadcast room user by the server, and when the stream information reaches the live broadcast room application program on the user side, the media SDK integrated by the application program can decode the stream information. The media SDK can know that the new encoding configuration information has been changed from the original, e.g., horizontal, to the current vertical by decoding the video frames of the received video stream, so that the user in the live broadcast room can adjust the corresponding layout to match the new target screen direction according to the change, so that the video layout at the user side can be substantially synchronized with the video layout at the anchor side.
It is to be understood that the target screen direction-adaptive layout referred to herein may include not only displaying the horizontal or vertical layout of the size of the frame presented when the video stream is played according to the information such as the resolution in the encoding configuration information, such as changing the aspect ratio of the current video playing window (also including the video stream frame) according to the resolution information, or setting the horizontal or vertical position of the current video playing window, but also adjusting the size of the video stream frame, the display direction of the control related to the video stream in the graphical user interface between live broadcast, and the like, which should be understood by those skilled in the art.
It can be further understood that when the video stream arriving after re-encoding is displayed in the video playing window, the whole process of switching the screen direction is actually completed, and this process is usually short in reality, and after a user at the audience side watches a stopped video frame, the user at the audience side can adapt to the target screen direction of the main broadcasting user quickly to adjust the display layout of the subsequent video stream, and the picture in the video playing window is not disconnected or has no error, and the picture stretching deformation can not occur, so that the whole process is stable and can be smoothly transited.
It should be noted that, as shown in fig. 3, the media SDK provided as the live broadcast room application program is also integrated on the side of the anchor user, so that after the anchor user uploads the re-encoded video stream to the server, the anchor user can receive the video stream returned by the server in a subsequent step, and then display the video stream in the video playing window of the graphical user interface of the anchor user, so as to implement synchronization of the video contents of the anchor user and the viewer user, and thus, the interface effect obtained after the method is executed can be synchronously viewed from the live broadcast graphical user interface of the anchor user.
Referring to fig. 3, after the anchor user finishes updating the coding configuration information and resumes uploading the coded video stream to the server, the anchor user invokes an instruction updateHeart to send the heartbeat packet to the server, and obviously, the sending of the heartbeat packet is performed as an insurance policy invocation considering that there is a risk of causing disconnection of the stream pushing link in the whole process of stopping coding, updating the coding configuration information and restarting coding. In fact, the heartbeat packet may be triggered to execute in any time node of the whole process of step S12, or may be executed multiple times, and the same insurance effect can be achieved.
It should be emphasized again that fig. 3 is only used to show an implementation logic of program development, in which the various functional steps implemented in the media SDK are not suitable for limiting the problem solving steps of the method and the flow thereof, and the live room application installed by the live room application can contain the media SDK, whether the anchor user or the viewer user, but the functions used may be different. According to the disclosure of the present application, the functions implemented by the SDKs shown in fig. 3 can be completely verified on the anchor user side in theory, but considering that the present application mainly solves the problem of controlling the generation and the encoded push of the video stream, the function of decoding the video frame may not be invoked on the anchor user side, but the function of decoding the video frame is necessarily implemented on the viewer user side.
Further, a live video stream push control apparatus of the present application may be constructed by functionalizing the steps in the methods disclosed in the above embodiments, and according to this idea, please refer to fig. 4, wherein in an exemplary embodiment, the apparatus includes:
the switching unit 11 is configured to respond to a screen direction switching instruction received by the local device in a process of pushing a video stream in a live broadcast room, and acquire video stream coding configuration information corresponding to a target screen direction;
a control unit 12, configured to suspend encoding of a video stream while maintaining an existing stream pushing link of the video stream, and update a corresponding configuration required for encoding the video stream according to the encoding configuration information;
and the restarting unit 13 is configured to restart to perform encoding on the video stream so as to continue to push the video stream to the live broadcast room, so that a user in the live broadcast room displays a subsequently received video stream in a layout which is adapted to the target screen direction.
Further, to facilitate the implementation of the present application, the present application provides an electronic device, including a central processing unit and a memory, where the central processing unit is configured to invoke and run a computer program stored in the memory to perform the steps of the live video stream push control method in the foregoing embodiments.
It can be seen that the memory is suitable for a non-volatile storage medium, and by implementing the foregoing method as a computer program and installing the computer program into an electronic device such as a mobile phone, the related program code and data are stored in the non-volatile storage medium of the electronic device, and further by operating the program by a central processing unit of the electronic device, the program is called from the non-volatile storage medium into a memory for operation, so as to achieve the desired purpose of the present application. Therefore, it is understood that in an embodiment of the present application, a non-volatile storage medium may also be provided, in which a computer program implemented according to various embodiments of the live video stream push control method is stored, and when the computer program is called by a computer, the computer program executes the steps included in the method.
In summary, the present application ensures that, even if a screen direction switching event occurs during live broadcast, the stability of the video stream pushing link can be ensured, so that a user receiving a video stream can obtain a more natural transition video picture.
Those skilled in the art will appreciate that the present application relates to an apparatus for performing one or more of the operations, methods described in the present application. These devices may be specially designed and manufactured for the required purposes, or they may comprise known devices in general-purpose computers. These devices have computer programs stored in their memories that are selectively activated or reconfigured. Such a computer program may be stored in a device (e.g., computer) readable medium, including, but not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magnetic-optical disks, ROMs (Read-Only memories), RAMs (Random Access memories), EPROMs (erasable Programmable Read-Only memories), EEPROMs (electrically erasable Programmable Read-Only memories), flash memories, magnetic cards, or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a bus. That is, a readable medium includes any medium that stores or transmits information in a form readable by a device (e.g., a computer).
It will be understood by those within the art that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. Those skilled in the art will appreciate that the computer program instructions may be implemented by a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the aspects specified in the block or blocks of the block diagrams and/or flowchart illustrations disclosed herein.
Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims (10)

1. A live video stream push control method is characterized by comprising the following steps:
responding to a screen direction switching instruction received by local equipment in the process of pushing a video stream in a live broadcast room, and acquiring video stream coding configuration information corresponding to a target screen direction;
while maintaining the existing stream pushing link of the video stream, pausing the execution of the encoding of the video stream, and updating the corresponding configuration required by the encoding of the video stream according to the encoding configuration information;
and restarting to execute the encoding of the video stream so as to continuously push the video stream to the live broadcast room, so that a user in the live broadcast room displays the subsequently received video stream according to the layout which is matched with the target screen direction.
2. The method of claim 1, wherein: providing a switching control on a live broadcast room user interface of the local equipment for controlled switching and triggering the screen direction switching instruction, generating a first screen direction switching instruction due to odd touch of the switching control, and determining the target screen direction as longitudinal/transverse; and generating a second screen direction switching instruction due to even number of touch control of the switching control, and determining the target screen direction as horizontal/longitudinal.
3. The method of claim 1, wherein: the local equipment judges the target screen direction in advance by identifying the motion data of the acceleration sensor of the local equipment, and when the motion data is matched with the triggering condition of the screen direction switching instruction, the local equipment judges that the target screen direction is transverse or longitudinal and triggers the corresponding screen direction switching instruction.
4. The method of claim 1, wherein: the coding configuration information comprises resolution information, coding format information and transmission code rate information corresponding to the target screen direction.
5. The method of claim 1, wherein the push link is maintained between the native device and the server via heartbeat packets, and wherein after the encoding of the video stream is restarted, the native device sends heartbeat packets over the push link to ensure that the push link is maintained.
6. The method of claim 1, further comprising the subsequent steps of:
and receiving the video stream returned by the live broadcast room, decoding the video stream, and displaying the video stream according to the layout matched with the direction of the target screen after the decoding is successful.
7. The method according to any one of claims 1 to 6, wherein the layout adapted to the target screen direction is associated with one or more specific information contained in the encoding configuration information.
8. A live video stream push control device, comprising:
the switching unit is used for responding to a screen direction switching instruction received by local equipment in the process of pushing the video stream in the live broadcast room and acquiring video stream coding configuration information corresponding to a target screen direction;
the control unit is used for pausing the execution of the coding of the video stream while maintaining the existing stream pushing link of the video stream, and updating the corresponding configuration required by the coding of the video stream according to the coding configuration information;
and the restarting unit is used for restarting and executing the coding of the video stream so as to continuously push the video stream to the live broadcast room, so that a user in the live broadcast room displays the subsequently received video stream according to the layout which is adaptive to the target screen direction.
9. An electronic device comprising a central processor and a memory, wherein the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the live video stream push control method according to any one of claims 1 to 7.
10. A non-volatile storage medium, characterized in that it stores a computer program implemented by the live video stream push control method according to any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised by the method.
CN202010740451.4A 2020-07-28 2020-07-28 Live video stream push control method, device, equipment and storage medium Active CN111711833B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010740451.4A CN111711833B (en) 2020-07-28 2020-07-28 Live video stream push control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010740451.4A CN111711833B (en) 2020-07-28 2020-07-28 Live video stream push control method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111711833A true CN111711833A (en) 2020-09-25
CN111711833B CN111711833B (en) 2022-04-26

Family

ID=72547945

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010740451.4A Active CN111711833B (en) 2020-07-28 2020-07-28 Live video stream push control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111711833B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112492337A (en) * 2020-11-26 2021-03-12 北京达佳互联信息技术有限公司 Communication method, communication device, server and storage medium
CN112738540A (en) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 Multi-device live broadcast switching method, device and system, electronic device and readable storage medium
CN113115119A (en) * 2021-04-02 2021-07-13 北京达佳互联信息技术有限公司 Video stream processing method, device and storage medium
CN113613029A (en) * 2021-08-06 2021-11-05 腾讯科技(深圳)有限公司 Live broadcast picture display method and device, storage medium and electronic equipment
CN114786068A (en) * 2022-04-27 2022-07-22 中央广播电视总台 Switching method and device, and video net switching system and method
CN115190340A (en) * 2021-04-01 2022-10-14 华为终端有限公司 Live broadcast data transmission method, live broadcast equipment and medium
CN115334353A (en) * 2022-08-11 2022-11-11 北京达佳互联信息技术有限公司 Information display method and device, electronic equipment and storage medium
CN115396714A (en) * 2022-08-11 2022-11-25 广州方硅信息技术有限公司 Live broadcast room layout adjusting method, computer equipment and storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222570A (en) * 2008-01-25 2008-07-16 中兴通讯股份有限公司 Image browser using for mobile terminal and image regulation method
CN104184980A (en) * 2014-07-21 2014-12-03 联想(北京)有限公司 Data processing method and electronic device
US20160219248A1 (en) * 2013-08-29 2016-07-28 Vid Scale, Inc. User-adaptive video telephony
US20160309118A1 (en) * 2013-12-31 2016-10-20 Huawei Technologies Co., Ltd. Method and Apparatus for Adapting To Screen Orientation Switching During Video Call
CN106131470A (en) * 2016-06-24 2016-11-16 维沃移动通信有限公司 A kind of method of video record and mobile terminal
CN106303661A (en) * 2016-08-29 2017-01-04 武汉斗鱼网络科技有限公司 A kind of live client realizes the method and system of self adaptation screen rotation
CN106406848A (en) * 2016-03-28 2017-02-15 乐视控股(北京)有限公司 Terminal horizontal/vertical screen switching method and device
CN106484349A (en) * 2016-09-26 2017-03-08 腾讯科技(深圳)有限公司 The treating method and apparatus of live information
CN106506554A (en) * 2016-12-29 2017-03-15 广州华多网络科技有限公司 The method of live coding, device, terminal, linkage encoder server and system
CN107454416A (en) * 2017-09-12 2017-12-08 广州酷狗计算机科技有限公司 Video flow sending method and device
US20180014049A1 (en) * 2016-07-08 2018-01-11 Tastemade, Inc. Orientation Based, Aspect Ratio Switching Video Playback System
CN108156481A (en) * 2016-12-02 2018-06-12 深圳市优朋普乐传媒发展有限公司 A kind of detection method and device of live source
CN111327863A (en) * 2018-12-17 2020-06-23 中移(杭州)信息技术有限公司 Video call processing method and device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222570A (en) * 2008-01-25 2008-07-16 中兴通讯股份有限公司 Image browser using for mobile terminal and image regulation method
US20160219248A1 (en) * 2013-08-29 2016-07-28 Vid Scale, Inc. User-adaptive video telephony
US20160309118A1 (en) * 2013-12-31 2016-10-20 Huawei Technologies Co., Ltd. Method and Apparatus for Adapting To Screen Orientation Switching During Video Call
CN104184980A (en) * 2014-07-21 2014-12-03 联想(北京)有限公司 Data processing method and electronic device
CN106406848A (en) * 2016-03-28 2017-02-15 乐视控股(北京)有限公司 Terminal horizontal/vertical screen switching method and device
CN106131470A (en) * 2016-06-24 2016-11-16 维沃移动通信有限公司 A kind of method of video record and mobile terminal
US20180014049A1 (en) * 2016-07-08 2018-01-11 Tastemade, Inc. Orientation Based, Aspect Ratio Switching Video Playback System
CN106303661A (en) * 2016-08-29 2017-01-04 武汉斗鱼网络科技有限公司 A kind of live client realizes the method and system of self adaptation screen rotation
CN106484349A (en) * 2016-09-26 2017-03-08 腾讯科技(深圳)有限公司 The treating method and apparatus of live information
CN108156481A (en) * 2016-12-02 2018-06-12 深圳市优朋普乐传媒发展有限公司 A kind of detection method and device of live source
CN106506554A (en) * 2016-12-29 2017-03-15 广州华多网络科技有限公司 The method of live coding, device, terminal, linkage encoder server and system
CN107454416A (en) * 2017-09-12 2017-12-08 广州酷狗计算机科技有限公司 Video flow sending method and device
CN111327863A (en) * 2018-12-17 2020-06-23 中移(杭州)信息技术有限公司 Video call processing method and device

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112492337B (en) * 2020-11-26 2023-05-23 北京达佳互联信息技术有限公司 Communication method, communication device, server and storage medium
CN112492337A (en) * 2020-11-26 2021-03-12 北京达佳互联信息技术有限公司 Communication method, communication device, server and storage medium
CN112738540A (en) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 Multi-device live broadcast switching method, device and system, electronic device and readable storage medium
CN112738540B (en) * 2020-12-25 2023-09-05 广州虎牙科技有限公司 Multi-device live broadcast switching method, device, system, electronic device and readable storage medium
CN115190340B (en) * 2021-04-01 2024-03-26 华为终端有限公司 Live broadcast data transmission method, live broadcast equipment and medium
CN115190340A (en) * 2021-04-01 2022-10-14 华为终端有限公司 Live broadcast data transmission method, live broadcast equipment and medium
CN113115119A (en) * 2021-04-02 2021-07-13 北京达佳互联信息技术有限公司 Video stream processing method, device and storage medium
WO2022206185A1 (en) * 2021-04-02 2022-10-06 北京达佳互联信息技术有限公司 Video stream processing method and apparatus
CN113613029A (en) * 2021-08-06 2021-11-05 腾讯科技(深圳)有限公司 Live broadcast picture display method and device, storage medium and electronic equipment
CN113613029B (en) * 2021-08-06 2022-11-08 腾讯科技(深圳)有限公司 Live broadcast picture display method and device, storage medium and electronic equipment
CN114786068B (en) * 2022-04-27 2023-11-21 中央广播电视总台 Switching method and device, video net switching system and method
CN114786068A (en) * 2022-04-27 2022-07-22 中央广播电视总台 Switching method and device, and video net switching system and method
CN115396714A (en) * 2022-08-11 2022-11-25 广州方硅信息技术有限公司 Live broadcast room layout adjusting method, computer equipment and storage medium
CN115334353A (en) * 2022-08-11 2022-11-11 北京达佳互联信息技术有限公司 Information display method and device, electronic equipment and storage medium
CN115334353B (en) * 2022-08-11 2024-03-12 北京达佳互联信息技术有限公司 Information display method, device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN111711833B (en) 2022-04-26

Similar Documents

Publication Publication Date Title
CN111711833B (en) Live video stream push control method, device, equipment and storage medium
CN106658205B (en) Live broadcast room video stream synthesis control method and device and terminal equipment
US10728594B2 (en) Method and apparatus for transmitting data of mobile terminal
JP6310073B2 (en) Drawing system, control method, and storage medium
US9370718B2 (en) System and method for delivering media over network
CN101316358B (en) Transmitting digital media streams to devices
JP7410290B2 (en) Edge computing proxy for cloud gaming and 5G
US20140115587A1 (en) Exception handling method, apparatus, and client
CN102460407A (en) Virtual desktop services
CN105516791A (en) Intelligent household streaming media seamless connection realization method and intelligent household streaming media seamless connection realization system
EP1537716B1 (en) Audio visual media encoding system
WO2022111421A1 (en) Screen projection method and apparatus for application interface, device, and storage medium
CN102917246B (en) Application data supplying method, device and system based on virtual machine
CN113727178B (en) Screen-throwing resource control method and device, equipment and medium thereof
CN112312154A (en) Network live broadcast control and execution method and corresponding device, equipment and medium
CN112333529B (en) Live streaming loading method and device, equipment and medium thereof
KR20130099515A (en) Apparatas and method of displaying a contents using for key frame in a terminal
CN111935510B (en) Double-browser application loading method and display equipment
JP2014183488A (en) Streaming receiver
CN111107387B (en) Video transcoding method and device and computer storage medium
CN113727177B (en) Screen-throwing resource playing method and device, equipment and medium thereof
CN113453059B (en) Cloud game data processing method, device, equipment and medium
CN114513668A (en) Live video hardware encoder control method and device, computer equipment and storage medium
CN114095451A (en) Data processing method and device and computer readable storage medium
US11005908B1 (en) Supporting high efficiency video coding with HTTP live streaming

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210113

Address after: 511442 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 29th floor, building B-1, Wanda Plaza, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant