CN114710681A

CN114710681A - Multi-channel live broadcast display control method and device, equipment and medium thereof

Info

Publication number: CN114710681A
Application number: CN202210302017.7A
Authority: CN
Inventors: 鲍琦
Original assignee: Guangzhou Cubesili Information Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2022-03-24
Filing date: 2022-03-24
Publication date: 2022-07-05

Abstract

The application relates to the technical field of network live broadcast, and discloses a multipath live broadcast display control method, a device and a medium thereof, wherein the method comprises the following steps: acquiring a plurality of paths of video streams participating in video connection; calling a layout template of a video area of a corresponding live broadcast room according to the number of the video streams, wherein the layout template comprises layout information of playing windows corresponding to all paths of video streams, and the layout information comprises a cutting size for cutting the corresponding playing windows; creating a corresponding playing window for each path of video stream, and enabling the playing window to present a shape which is cut correspondingly according to the cutting size in the layout information; and loading the video pictures of the video streams into corresponding playing windows. The method and the device for displaying the video streams have the advantages that the video frames of the video streams are displayed through the round-corner window, reasonable layout of the multiple paths of video streams in the video microphone connecting mode can be achieved in a live webcast scene, and accordingly efficient utilization of information expression space of a graphical user interface is achieved.

Description

Multi-channel live broadcast display control method and device, equipment and medium thereof

Technical Field

The present application relates to the field of live webcasting technologies, and in particular, to a multi-channel live webcasting display control method, and a corresponding apparatus, computer device, and computer-readable storage medium.

Background

In a network live broadcast scene, main broadcast users can get through live broadcast rooms of each other through a video connecting mode, audience users in each live broadcast room can watch video pictures generated after video streams of each main broadcast user are mixed, and therefore the main broadcast users are allowed to achieve application purposes of talent exhibition, information sharing, knowledge education and the like, the main broadcast users can participate in social labor through activities to obtain profits, and overall social benefits are promoted.

When video streams corresponding to a plurality of anchor users are displayed simultaneously in a live broadcast room, in a traditional processing mode, a corresponding rectangular playing window is set for each path of video stream, the rectangular playing windows are simply arranged on a graphical user interface no matter the number of the playing windows, the single-screen display area of the terminal equipment is limited, when a plurality of rectangular playing windows exist, the screen space is crowded, the display spaces of other types of information can be squeezed, and the information expression efficiency of the terminal equipment is greatly influenced. If a space is reserved for the expression of other information, the size of the rectangular playing window of each video stream is necessarily reduced, and therefore, the display of the content of each video stream is adversely affected. Some methods place the mainly displayed video stream on the bottom layer of the graphical user interface, place the information that needs to be displayed in other video streams and the live broadcast room on the top layer, and avoid blocking the main image of the bottom layer as much as possible, but under the effect of this method, the flowing characters, colors, images and the like of the top layer still cause interference to the video image of the bottom layer.

Therefore, the traditional method for processing the layout display of the multi-channel live video stream has inherent contradiction which influences the overall display effect of the information due to lack of layout flexibility and needs to be overcome.

Disclosure of Invention

A primary object of the present application is to solve at least one of the above problems and provide a multi-channel live show control method, and a corresponding apparatus, computer device, and computer-readable storage medium.

In order to meet various purposes of the application, the following technical scheme is adopted in the application:

one of the purposes of the present application is to provide a multi-channel live broadcast display control method, which comprises the following steps:

acquiring a plurality of paths of video streams participating in video connection;

calling a layout template of a video area of a corresponding live broadcast room according to the number of the video streams, wherein the layout template comprises layout information of playing windows corresponding to all paths of video streams, and the layout information comprises a cutting size for cutting the corresponding playing windows;

creating a corresponding playing window for each path of video stream, and enabling the playing window to present a shape which is cut correspondingly according to the cutting size in the layout information;

and loading the video pictures of the video streams into corresponding playing windows.

In some embodiments of the deepening, a corresponding playing window is created for each path of video stream, so that the playing window presents a shape that is cut according to the cutting size in the layout information, including the following steps:

judging whether the cutting size in the layout information of each playing window represents no cutting, if so, drawing the playing window into a regular rectangular window in the first drawing surface according to the window size and the window position in the layout information;

if the cutting size of the playing window represents the effective cutting size, drawing the playing window and the window position into a regular temporary rectangular window in a second drawing surface according to the window size in the layout information;

and applying the cutting size to the temporary rectangular window to carry out cutting to enable the temporary rectangular window to become a round-corner window, wherein the round-corner window comprises a right circular window or a rectangular window with round-corner characteristics.

In some embodiments of the extension, after the step of loading the video frames of the video streams into the corresponding playing windows, the method includes any one or more of the following steps:

responding to a fillet adjusting instruction acting on one of the fillet windows, and resetting the fillet size of the fillet window according to the cutting size corresponding to the fillet adjusting instruction;

responding to a size adjusting instruction acting on one of the fillet windows, and resetting the whole size of the fillet window according to the window size corresponding to the size adjusting instruction;

and responding to a position adjusting instruction acting on one of the round-corner windows, and resetting the display position of the round-corner window according to the window position corresponding to the position adjusting instruction.

In some embodiments of the deepening, loading the video pictures of each video stream into the corresponding playing window thereof includes the following steps:

identifying a face region image of a video stream corresponding to a target playing window belonging to a fillet window;

and displaying the face region image in the target playing window.

In some embodiments of the deepening, acquiring multiple paths of video streams participating in video microphone connection includes the following steps:

responding to a video microphone connecting confirmation instruction, switching the current live broadcast room to a video microphone connecting mode, and entering a graphical user interface corresponding to the video microphone connecting mode;

calling a camera unit of the current terminal equipment to acquire a video stream corresponding to a current anchor user participating in a video microphone connecting mode, and uploading the video stream to a media server;

and pulling video streams corresponding to other anchor users participating in the video microphone connecting mode from the media server.

responding to a viewer user entering event or a video microphone connecting starting event of a live broadcast room in a video microphone connecting state, and displaying a graphical user interface in a video microphone connecting mode of the live broadcast room;

and respectively pulling each path of video stream of each anchor user participating in video microphone connection to a media server.

In some embodiments of the deepening method, after the step of loading the video pictures of each video stream into the corresponding playing window, the method includes the following steps:

performing mixed drawing on each video stream according to the layout formed by each playing window to form a single video stream;

and broadcasting the single-channel video stream to a live broadcast room of each anchor user providing each channel of video stream.

One of the purposes of this application and a multichannel live show controlling means that provides that adapts to this application includes: the system comprises a video stream acquisition module, a layout application module, a window generation module and a rendering display module, wherein:

the video stream acquisition module is used for acquiring a plurality of paths of video streams participating in video connection with the wheat;

the layout application module is used for calling a corresponding layout template according to the number of the video streams, the layout template comprises layout information of playing windows corresponding to all paths of video streams, and the layout information comprises cutting sizes used for cutting corners of the corresponding playing windows;

the window generation module is used for creating corresponding playing windows for each path of video stream so that the playing windows present corresponding cutting shapes according to the cutting sizes in the layout information;

and the rendering display module is used for loading the video pictures of the video streams into the corresponding playing windows.

In a further embodiment, the layout application module includes:

the first drawing unit is used for judging whether the cutting size in the layout information of each playing window represents no cutting, if so, the playing window is drawn into a regular rectangular window in the first drawing surface according to the window size and the window position in the layout information;

a second drawing unit configured to draw the play window and the window position as a regular temporary rectangular window according to the window size in the layout information in a second drawing surface if the cutting size of the play window represents an effective cutting size;

and the fillet cutting unit is used for applying the cutting size to the temporary rectangular window to carry out cutting so as to enable the temporary rectangular window to become a fillet window, and the fillet window comprises a perfect circular window or a rectangular window with fillet characteristics.

In some embodiments of the extension, the multi-channel live broadcast display control device of the present application includes any one or any plurality of modules as follows:

the fillet adjusting module is configured to respond to a fillet adjusting instruction acting on one of the fillet windows and reset the fillet size of the fillet window according to the cutting size corresponding to the fillet adjusting instruction;

the area adjusting module is configured to respond to a size adjusting instruction acting on one of the fillet windows and reset the whole size of the fillet window according to the window size corresponding to the size adjusting instruction;

and the position adjusting module is configured to respond to a position adjusting instruction acting on one of the round-corner windows and reset the display position of the round-corner window according to the window position corresponding to the position adjusting instruction.

In some embodiments of the deepening, the rendering and displaying module includes:

the face recognition unit is used for recognizing a face area image of the video stream corresponding to the target playing window belonging to the fillet window;

and the positioning output unit is used for displaying the face region image in the target playing window.

In a further embodiment, the video stream acquiring module includes:

the connecting and switching unit is used for responding to a video connecting and microphone confirming instruction, switching the current live broadcast room to a video connecting and microphone mode and entering a graphical user interface corresponding to the video connecting and microphone mode;

the local pull stream unit is used for calling a camera shooting unit of the current terminal equipment to acquire a video stream corresponding to the current anchor user participating in the video microphone connecting mode and uploading the video stream to the media server;

and the remote stream pulling unit is used for pulling the video streams corresponding to other anchor users participating in the video microphone connecting mode from the media server.

In some embodiments of the deepening, the video stream obtaining module includes:

the audience presentation unit is used for responding to an audience user entering event or a video microphone connecting starting event in a live broadcast room in a video microphone connecting state and displaying a graphical user interface in a video microphone connecting mode of the live broadcast room;

and the respective stream pulling unit is used for pulling each path of video stream of each anchor user participating in video microphone connection to the media server.

In the embodiment of the deepened part, the multi-channel live broadcast display control device of the application further comprises:

the mixed drawing processing module is used for carrying out mixed drawing on each video stream according to the layout formed by each playing window to form a single video stream;

and the broadcast stream pushing module is used for broadcasting the single-channel video stream to the live broadcast rooms of all anchor users providing all the channels of video streams.

The computer device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the steps of the multi-channel live broadcast display control method.

Another object of the present application is to provide a computer-readable storage medium, which stores a computer program implemented according to the method for controlling multiple live presentations in the form of computer-readable instructions, and when the computer program is called by a computer, the computer program executes the steps included in the method.

A computer program product, provided to adapt to another object of the present application, comprises computer programs/instructions which, when executed by a processor, implement the steps of the method described in any of the embodiments of the present application.

Compared with the prior art, the application has the following advantages:

in the environment of online live broadcast of video with wheat, the layout template is adaptively matched according to the number of people participating in the video with wheat, the corresponding playing window is displayed in the video area of a live broadcast room in a playing window form specified in advance through the layout template for correspondingly rendering and displaying each path of video stream, wherein the playing window can be cut according to the specified cutting size of the layout template, and in the process of generating the playing window, the playing window is correspondingly cut, so that the playing window is not limited to be rectangular any more, but can be in shapes such as round-corner rectangle, right circle and the like, therefore, the corner area of the playing window is beneficial to realizing avoiding display with other information contents including other playing windows in a graphical user interface by utilizing the characteristic that part of the corner area is redundant in the cut playing window, so that the playing window of each path of video stream can be more compactly and flexibly arranged, the layout form of the multi-channel video stream during the video microphone connection is enriched, and the effective display area of the information in the graphical user interface is efficiently utilized.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic flowchart of an exemplary embodiment of a multi-channel live broadcast display control method according to the present application;

fig. 2 is a schematic diagram of a network architecture corresponding to a live broadcast room operating environment applied in the present application;

FIG. 3 is a diagram illustrating an exemplary geometric principle for implementing clipping on a playing window by applying a clipping size in the present application;

fig. 4, 5, 6, 7, and 8 are graphical user interfaces of an exemplary live broadcast room of the present application, which respectively show layout relationships of different forms of playing windows, such as a rounded window, and a rectangular window;

FIG. 9 is a flow chart illustrating a process of performing clipping of a play window according to a clipping size according to some embodiments of the present application;

fig. 10 is a schematic flowchart illustrating a process of performing face recognition on a video stream and displaying the video stream to a corresponding play window in some embodiments of the present application;

FIG. 11 is an exemplary live room graphical user interface of the present application wherein a rounded corner window, i.e., a right circular window, is used to display a face region image;

fig. 12 is a flowchart illustrating a process of acquiring multiple video streams when the anchor user side is used as a controller in an embodiment of the present application;

fig. 13 is a schematic block diagram of a multi-channel live broadcast display control apparatus according to the present application;

FIG. 14 is a schematic diagram of a computer device as may be used in the present application;

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant) that may include a radio frequency receiver, a pager, internet/intranet access, web browser, notepad, calendar, and/or GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers can be independent of each other but can be called through an interface, or can be integrated into a physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

One or more technical features of the present application, unless expressly specified otherwise, may be deployed to a server for implementation by a client remotely invoking an online service interface provided by a capture server for access, or may be deployed directly and run on the client for access.

Unless specified in clear text, the neural network model referred to or possibly referred to in the application can be deployed in a remote server and used for remote call at a client, and can also be deployed in a client with qualified equipment capability for direct call.

Various data referred to in the present application may be stored in a server remotely or in a local terminal device unless specified in the clear text, as long as the data is suitable for being called by the technical solution of the present application.

The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.

The embodiments to be disclosed herein can be flexibly constructed by cross-linking related technical features of the embodiments unless the mutual exclusion relationship between the related technical features is stated in the clear text, as long as the combination does not depart from the inventive spirit of the present application and can meet the needs of the prior art or solve the deficiencies of the prior art. Those skilled in the art will appreciate variations therefrom.

The multi-channel live broadcast display control method can be programmed into a computer program product and is realized by being deployed in terminal equipment to operate, so that the method can be executed by accessing an open interface after the computer program product operates and performing man-machine interaction with the process of the computer program product through a graphical user interface.

Referring to fig. 1, in an exemplary embodiment of the present application, a multi-channel live broadcast display control method includes the following steps:

step S1100, acquiring a plurality of paths of video streams participating in video microphone connection:

in a live network application scenario, the implementation is supported by a network architecture as shown in fig. 2, a server group is deployed at a cloud, a live broadcast room service is operated through the server group, and a main broadcast user and audience users are supported to participate in live network activities. The live broadcast room service provides a live broadcast room example for each anchor user, the anchor user pushes the video stream acquired by the camera unit of the anchor user to the live broadcast room of the anchor user through the terminal equipment of the anchor user, and the audience user entering the live broadcast room of the anchor user can acquire the video stream and display the video stream to the video area of the graphical user interface of the terminal equipment of the anchor user. Of course, the anchor user can also preview the video stream of the anchor user in the video area of the live room of the terminal equipment. The server cluster can comprise an application server supporting basic service logic operation of live broadcast room service and a media server specially used for processing video streams of all anchor users, and the video streams pushed to the live broadcast room enter the media server to be processed and then are pushed to terminal equipment of audience users in the live broadcast room.

Based on the technical architecture that a single anchor user carries out live broadcasting, a plurality of anchor users can enter a video microphone connecting mode through interaction in advance, so that video streams of all the anchor users can be displayed in graphical user interfaces of terminal equipment of the anchor users and audience users, and a media server can also obtain corresponding multi-channel video streams at the same time. Finally, the multi-channel video streams participating in the video microphone are shared in each live broadcast room, and audience users in each live broadcast room can also obtain the display of the multi-channel video streams. Therefore, any one of the anchor user, the audience user and the media server can obtain the video stream of each anchor user participating in video live broadcasting, and can be used as a control party for layout display of the live broadcasting room.

The multi-channel live broadcast display control method can be implemented at a main broadcast user side, an audience user side and a media server side to provide various flexible embodiments, and when the different embodiments acquire multi-channel video streams participating in video microphone connection, flexible and adaptive means can be allowed, such as: when the anchor user acquires each path of video stream participating in video microphone connection, the video stream acquired by the camera unit of the terminal equipment of the anchor user can be called for the video stream of the anchor user without repeatedly pulling the video stream uploaded by the anchor user to a media server, and the video stream of other anchor users can be directly pulled from the media server. When the audience user acquires each path of video stream participating in video microphone connection, the audience user directly pulls the video stream uploaded by each main broadcasting user to the media server. And for the media server, according to the inherent service logic of the live broadcast room, the video stream of each main broadcast user participating in video connection with the microphone is uploaded to the media server, so that the multi-channel video stream can be naturally and directly acquired.

Step S1200, a layout template of a video area of a corresponding live broadcast room is called according to the number of the video streams, the layout template comprises layout information of playing windows corresponding to all paths of video streams, and the layout information comprises cutting sizes used for cutting the corresponding playing windows:

the main broadcasting users participating in the video and wheat connection can simultaneously join in a video and wheat connection mode or successively join in, and each main broadcasting user provides one video stream, so that N main broadcasting users correspondingly provide N video streams. It is understood that a change in the number of video streams affects a change in the display condition of the video area in the live broadcast room, and it is necessary to make an adjustment to the display layout of the video streams in the video area in the live broadcast room in accordance with the change in the number of video streams. Therefore, after any video stream is added into the video microphone connecting mode, the service logic of the step can be triggered no matter the video microphone connecting mode is initially established or a new live broadcast room is added in the existing video microphone connecting process to add one video stream.

According to the step, the device where the controller responsible for implementing the layout display of the live broadcast room is located first identifies the number of the video streams participating in the current video microphone connecting activity, namely the total number of the anchor users, then calls the layout template corresponding to the number, creates and arranges corresponding playing windows for the multiple paths of video streams according to the layout template, and controls the display effect of each path of video streams in the video area of the live broadcast room through the layout template.

Generally, when the multiple video streams are presented in each live broadcast room, the presentation of the multiple video streams can be unified by using the same layout template. In some embodiments, when the live broadcasting rooms of different anchor users are allowed to display each path of video stream, a layout template which is different from other live broadcasting rooms and is only unified in the current live broadcasting room can be provided, namely, different styles are allowed corresponding to the same number of layout templates and can be preset by a controller, different live broadcasting rooms can control the unified display of the multiple paths of video streams according to the layout template styles preset in the live broadcasting rooms, and the controller can apply corresponding different layout template styles to different live broadcasting rooms according to the default setting of the anchor users of the live broadcasting rooms or according to the default service logic of the controller.

The layout template mainly describes the arrangement relationship of the playing windows corresponding to each path of video stream in the video area of the live broadcast room to be displayed finally, so that the layout template comprises a plurality of layout information corresponding to the playing windows corresponding to each path of video stream, each layout information is used for correspondingly limiting the geometric attribute of one playing window, each layout information generally comprises the window size and the window position of the playing window, and at least one playing window can further comprise a cutting size for cutting the playing window. The window size may include width and height attributes and corresponding values thereof according to the fact that the playing window is a rectangular window, and the window position generally includes a vertical coordinate attribute and a horizontal coordinate attribute of a coordinate system presented by an angular point or a geometric center point of the playing window relative to a video area of the live broadcast room and corresponding values thereof.

And the cutting size is used for indicating a fillet radius for performing fillet cutting on four corners of the corresponding playing window, and the fillet radius is embodied by the fillet radius attribute and the corresponding numerical value. Referring to fig. 3, according to the geometric principle, if a geometric center of a playing window (rectangular window) is taken as a center, the clipping dimension R can be taken between a half length (0.5W) of a short side (W) of the rectangular window and a length (0.5H) of a long side (H) of the rectangular window, so as to obtain a playing window with a rounded corner feature, i.e. a rounded corner window. In particular, when R is half of the short side of the rectangular window, i.e. 0.5W, the clipping is performed to obtain a perfect circular playing window, i.e. a perfect circular window. Therefore, in the application, the right circular window is a special case of the fillet window, and in a broad sense, the right circular window is also a fillet window and can be controlled by the cutting size. Similarly, when the cutting size is half of the long side, that is, 0.5H, it represents that there is no cutting, and the corresponding playing window is a rectangular window, and when the window size of the playing window is specified to be equal in height and width, the playing window is a square window.

In some embodiments, the correspondence between each video stream and each playing window may be random. In other embodiments, the layout template may also include matching information for defining a correspondence between each video stream and each playing window, for example, a unique rounded window may be specified for displaying a video stream corresponding to a certain anchor user, and the other playing windows are not configured with the cropping size, or although the cropping size is configured, the cropping size actually represents no cropping, so that according to this layout template, as shown in fig. 4, a video stream of an anchor user specified in the video area 60 is correspondingly rendered into a rounded window 61, and video streams of other anchor users are correspondingly rendered into other rectangular windows 62.

Correspondingly, a plurality of layout templates are correspondingly provided for each video stream with different quantity, and the interface display effects of the playing windows specified by the various layout templates are shown in fig. 5 to 8, wherein all the playing windows shown in fig. 5 are right circular windows; FIG. 6 illustrates the layout effect of two rectangular windows and one perfect circular window, wherein the perfect circular window partially overlaps the two rectangular windows; FIG. 7 illustrates the layout effect of a plurality of rounded windows and a plurality of rectangular windows; fig. 8 shows the layout effect of a partially rectangular window, a partially right circular window, and a partially rounded window. As can be seen from the effects shown in fig. 5 to 8, the layout template can flexibly arrange the interface display effect of the playing windows used by multiple paths of video streams, wherein the various playing windows are allowed to overlap with each other, so that the layout of the video area in the live broadcast room is more compact. Moreover, corner spaces reserved for the rounded corner window and the circular arc window in the circular arc transition release more clean areas for the graphical user interface, and the clean areas can be used for displaying other information, so that the efficient utilization of the information display range of the graphical user interface is realized actually.

In the same video continuous-broadcasting activity, when the video stream of one anchor user is designated to use a perfect circle window and the video streams of other anchor users use a rectangular window or a round-corner window, as shown in fig. 6, the method can play a role of remarkably highlighting the identity of the anchor user corresponding to the perfect circle window, and thus can be used for the video stream of the anchor user corresponding to the current live broadcast room or the video stream of a predetermined anchor user.

Step 1300, creating a corresponding playing window for each path of video stream, and enabling the playing window to present a shape which completes corresponding cutting according to the cutting size in the layout information:

after the layout template is determined, each playing window can be created according to the layout information corresponding to each playing window in the layout template, the size of each playing window is determined according to the window size in the layout information, the position of each playing window in the video area of the live broadcast room is determined according to the window position in the layout information, and the round angle of each playing window is modified according to the cutting radius in the layout information.

Taking an Android system as an example, the Android system is provided with two drawing components, namely surfaview and TextureView, which can be used for providing a drawing surface for drawing a playing window, and finally rendering a corresponding video stream into a corresponding playing window.

The SurfaceView is widely applied to video preview and play scenes, and has the advantages that system-level View is provided independently of application, namely drawing surfaces are obtained, refreshing rendering of videos can be independently controlled through the drawing surfaces, the influence of refreshing of other UI components of a graphical user interface is avoided, and unsmooth operation cannot be caused.

The TextureView can provide a drawing surface to support the realization of functions such as animation, translation, zooming and the like and the realization of a fillet window on one hand, and can also internally set a hardware acceleration starting function to enable the whole drawing surface to be synthesized by a GPU rendering scheme provided by the system, so that the TextureView is suitable for video use scenes. However, if the play window in the drawing surface provided by TextureView is to be implemented as a rounded window, it needs to be supported by the ViewOutlineProvider component. The View outlineprovider component is an interface provided by Android and used for performing conversion or clipping of shadows on a drawing surface, the appearance of a playing window in the drawing surface is defined by Outline, Outline is a declared simple graph and is used for defining the boundary of a drawing surface graph area, and the drawing surface provided by TextureView is also a View, so that the interface provided by the View outlineprovider component can be applied.

Therefore, when drawing is carried out according to the layout information of each playing window in the layout template, the regular rectangular window which is not specified in cutting size or is actually not cut in the cutting size representation can be realized by adopting a surfaceView component or a TextureView component; for a perfect circle window or a fillet window with a specified effective cutting size, TextureView can be used for firstly drawing a temporary rectangular window, and then a ViewOutlineviewer component is applied to cut the temporary rectangular window into a desired non-rectangular effect, namely, a perfect circle formed by the cutting size is applied to the temporary rectangular window for cutting, the intersection part of the perfect circle and the temporary rectangular window is reserved, and four corners of the rectangular window are shaped into a circular arc transition to be changed into a desired perfect circle window or a fillet window.

According to the embodiment of the application, the terminal device is used as a part of the control party, the method disclosed above can be applied to draw the playing window in the graphical user interface of the live broadcast room of the terminal device according to the determined layout template, and the expected effect is cut out for the corresponding playing window according to the cutting size corresponding to the playing window in the layout template.

According to some embodiments of the present application, in which the media server is used as a control party, when the media server is responsible for drawing a video stream that is obtained by mixing and drawing each video stream and pushing the video stream to viewers in each live broadcast room, the media server may create each of the playing windows in a virtual canvas corresponding to a video area in the live broadcast room in a manner similar to that disclosed herein, and perform clipping on the corresponding playing window as needed according to a clipping size specified by layout information of each playing window.

Step S1400, loading the video pictures of each video stream into the corresponding playing window:

after finishing the drawing of each playing window according to the layout template and establishing the corresponding relation between each path of video stream and the accumulated playing window, each path of video stream can be loaded into the corresponding playing window, and the difference in processing can be found according to the difference of the control party:

according to the embodiment of the application, the terminal equipment is used as a control party, the media server carries out alignment, corresponding cutting, splicing and other preprocessing on image frames of all paths of video streams according to drawn playing windows, then the image frames are mixed and drawn into a single path of video stream, the single path of video stream is pushed to all live broadcasting rooms to be displayed, and after the single path of video stream is decoded, rendered and displayed, corresponding video pictures can be displayed in a video area of a graphical user interface of the live broadcasting rooms according to the layout of the layout template.

According to some embodiments of the application, in which a media server is used as a control party, after corresponding playing windows are created and cut according to the layout template, the obtained video streams can be directly rendered to the corresponding playing windows respectively, so that the video stream video pictures can be output and displayed in the video area of the graphical user interface of the live broadcast room.

Through the typical embodiment and various modified embodiments of the application, the application can be seen in the environment of network live broadcast of video continuous microphones, the layout template is adaptively matched according to the number of people participating in the video continuous microphones, the playing window form specified in advance through the layout template is used, the corresponding playing window is displayed in the video area of a live broadcast room for correspondingly rendering and displaying each path of video stream, wherein the playing window can be cut according to the specified cutting size of the layout template, in the process of generating the playing window, the playing window is correspondingly cut, so that the playing window is not limited to be rectangular, but can be in shapes such as rounded rectangle, circular and the like, therefore, the corner area of the playing window is beneficial to realizing mutual avoidance display with other information contents including other playing windows in a graphical user interface by utilizing the characteristic that part of the corner area is redundant through the cutting of the playing window, the playing windows of the video streams can be more compactly and flexibly arranged, the arrangement forms of the video streams during video connection are enriched, and the effective information display area in the graphical user interface is efficiently utilized.

Referring to fig. 9, in a deepened partial embodiment, the step S1300 of creating a corresponding playing window for each video stream, so that the playing window presents a shape that is cut according to the cutting size in the layout information, includes the following steps:

step S1310, determining whether the clipping size in the layout information of each playing window represents no clipping, if yes, in the first drawing surface, drawing the playing window into a regular rectangular window according to the window size and the window position in the layout information:

for the layout information corresponding to each playing window in the layout template, some of the layout information is allowed to provide no cropping size, which also indicates that there is no cropping, and some of the provided cropping size indicates that there is no cropping (for example, the aforementioned cropping size is 0.5H), which can be distinguished from the two cases, taking the Android system as an example, a rectangular window and a non-rectangular window (a perfect circle window and/or a round corner window) are respectively presented by applying drawing surfaces provided by different components. Accordingly, for each playing window, whether the clipping size in the layout information of the playing window represents that no clipping exists actually can be judged, if yes, the corresponding playing window is a rectangular window, for the rectangular window, for example, the surface View is used as a first drawing component, a corresponding View is created, a first drawing surface is provided, the playing window is positioned in the first drawing surface according to the window position in the layout information, the frame of the playing window is drawn according to the window size in the layout information, and therefore an uncut and regular rectangular window is obtained on the first drawing surface and is the playing window.

Step S1320, if the clipping size of the playing window represents the effective clipping size, in the second drawing surface, drawing the playing window and the window position as a regular temporary rectangular window according to the window size in the layout information:

if the cropping size in the layout information of a playback window represents an effective cropping size, see, for example, the previous example, which represents an effective cropping size between half of the short side (inclusive) and half of the long side (exclusive) of a rectangular window. Therefore, according to the foregoing embodiment, taking an Android system as an example, TextureView may be used as a second drawing component, a corresponding View is created, a second drawing surface is provided, a playing window is positioned in the second drawing surface according to a window position in the layout information, and a frame of the playing window is drawn according to a window size in the layout information, so that an uncut and regular rectangular window is obtained on the second drawing surface, and the rectangular window cannot be used as a final state of the playing window, and thus can be regarded as a temporary rectangular window.

Step S1330, applying the clipping size to the temporary rectangular window to perform clipping so as to make the temporary rectangular window become a rounded window, where the rounded window includes a perfect circular window or a rectangular window with rounded corner features:

for the temporary rectangular window, according to the principle disclosed in the foregoing embodiment, the interface provided by the ViewOutlineProvider may be called, the clipping size in the layout information corresponding to the temporary rectangular window is applied, and the clipping is performed on the temporary rectangular window, so as to obtain the play window with the corresponding clipping effect. As shown in fig. 5 to 8, the playing window forms a round window under the effect of the cutting size, and the round window may be a perfect round window (R ═ 0.5W), or a rectangular window with round corner features, that is, a round window in a narrow sense in the present application.

In this embodiment, according to the cropping size in the layout information corresponding to each playing window, when the cropping size represents no cropping, the first drawing component is applied to draw a rectangular window in the first drawing surface, and when the cropping size represents an effective cropping size, the second drawing component is applied to draw a perfect circular window or a rounded window in the second drawing surface, so as to realize the integration of the advantages of two different drawing components. Therefore, the implementation of the embodiment can ensure that the display of the multiple video streams is smoother.

In some embodiments of the present invention, when the anchor user or the viewer user is allowed to serve as a controller, the terminal device of the anchor user or the viewer user may perform various adjustments on the broadly rounded corner window constructed in the present application as needed, and therefore, after the step S1400, the step of loading the video frames of the video streams into the corresponding playing windows, the method includes any one or more of the following steps:

step S1501, responding to a fillet adjusting instruction acting on one of the fillet windows, and resetting the fillet size of the fillet window according to the cutting size corresponding to the fillet adjusting instruction:

when a user corresponding to a control party needs to adjust the fillet of a fillet window of a video area in a graphical user interface of a live broadcast room, the user is allowed to position a certain target playing window in the video area through a mouse, the target playing window is provided with a prompt box taking the current cutting size of the target playing window as the radius, the user further determines a new cutting size by adjusting the zoom size of the prompt box, and a fillet adjusting instruction carrying the new cutting size is triggered. And the background process of the live broadcast room responds to the fillet adjusting instruction to obtain the new cutting size, and the cutting radius of the target playing window is reset according to the method disclosed by the embodiment of the application, so that the fillet size of the target playing window is correspondingly changed. It is understood that by adjusting the cutting size, the round window can be adjusted to a round effect corresponding to any radius, or the round window can be restored to a rectangular window determined according to the window size, or the round window can be adjusted to a perfect round window.

Step S1502, in response to a size adjustment instruction applied to one of the fillet windows, resetting the overall size of the fillet window according to the window size corresponding to the size adjustment instruction:

when a user corresponding to a control party needs to adjust the window size of a rounded corner window of a video area in a graphical user interface of a live broadcast room, the user is allowed to position a certain target playing window in the video area through a mouse, the target playing window is provided with a prompt box with the window size consistent with that of the target playing window, the user further determines a new window size by adjusting the zoom size of the prompt box, and a size adjusting instruction carrying the new window size is triggered. And the background process of the live broadcast room responds to the size adjusting instruction to obtain the new window size, and according to the method disclosed by the embodiment of the application, the width and the height of the target playing window are reset, so that the window size of the target playing window is correspondingly changed.

Step S1503, in response to the position adjustment instruction acting on one of the fillet windows, resetting the display position of the fillet window according to the window position corresponding to the position adjustment instruction:

when a user corresponding to a control party needs to adjust the position of a fillet window of a video area in a graphical user interface of a live broadcast room, the user is allowed to position a certain target playing window in the video area through a mouse, the target playing window is provided with a prompt box with the window size consistent with that of the target playing window, the user further determines the corresponding window position according to the new position of the prompt box by translating the prompt box, and particularly obtains corresponding coordinates, and triggers a fillet adjusting instruction carrying the new window position. And the background process of the live broadcast room responds to the fillet adjusting instruction to obtain the new window position, and the position of the target playing window in the video area is reset according to the method disclosed by the embodiment of the application.

According to various embodiments disclosed herein, the rounded windows set by the present application can be opened to an anchor user or a viewer user as a controller for flexible adjustment after being built, allowing the controller to adjust the rounded size, window size, display position, etc. of each rounded window as required, so as to achieve the effect of flexibly adjusting the layout of multiple playing windows in the video area, thereby ensuring that the user can control the reasonable layout of the video area by himself.

Referring to fig. 10, in a detailed embodiment, the step S1400 of loading the video frames of the video streams into the corresponding playing windows includes the following steps:

step S1410, identifying a face region image of the video stream corresponding to the target playing window belonging to the fillet window:

in this embodiment, after the creation of the playing window corresponding to each video stream is completed according to the layout template, in the process of rendering each video stream to its corresponding playing window, a deep learning model trained to a convergence state in advance may be used to perform face recognition on the video stream corresponding to the rounded corner window, where the deep learning model may be implemented based on basic neural network models such as LeNet, Alexnet, DenseNet, and respet, and those skilled in the art may flexibly select any neural network model suitable for performing face image recognition on the video stream. And performing face recognition on the corresponding video stream through the deep learning model, determining a corresponding face image area for a target playing window corresponding to the fillet window, and keeping tracking the face image area all the time in the video microphone connecting process.

Step S1420, displaying the face region image in the target playing window:

for the video stream with the determined face image area, the video stream can be subjected to corresponding preprocessing such as scaling and clipping according to the actual size of the fillet window, so that the video stream is matched with the actual size of the fillet window, and then the center position of the face area image is aligned with the geometric center position of the fillet window, so that the video stream content corresponding to the face area image is rendered into the fillet window, and the fillet window always displays the dynamic face area image corresponding to the video stream.

The embodiment captures the face region image in the video stream corresponding to the fillet window through face recognition tracking, outputs the face region image to the fillet window, enables the fillet window to obviously display the dynamic face image of the anchor user, enables the fillet window to be reduced in size, can still accurately put in the facial expression of the anchor user, avoids the fillet window from effectively displaying the dynamic of the anchor user due to cutting and zooming, and ensures that the layout effect can be effectively obtained. Accordingly, in an embodiment, as shown in fig. 11, the playing window of each anchor user can be minimized, so that the video area in the live broadcast room can accommodate more anchor users participating in video live broadcasting, and thus the total number of anchor users participating in video live broadcasting can be further expanded.

Referring to fig. 12, in a further embodiment, the step S1100 of acquiring multiple video streams participating in video connection includes the following steps:

s1111, responding to a video microphone connecting confirmation instruction, switching the current live broadcast room to a video microphone connecting mode, and entering a graphical user interface corresponding to the video microphone connecting mode;

in a network live broadcast scene, after a current anchor user and other anchor users complete an interaction process of establishing a video connecting mode of each party, all anchor users enter a video connecting state. Each anchor user is associated with a live broadcast room, each live broadcast room is provided with an audience user, and the audience users can receive a single video stream formed by mixing the video streams of all the anchor users so as to watch the video pictures of all the anchor users in a video live-line state. And continuously uploading the video stream of each anchor user to a preset media server for network live broadcast through the terminal equipment of each anchor user so that the subsequent media server can output the video streams in a mixed mode.

For a current anchor user, after the application program process of a live broadcast room operated by the terminal equipment enters a video microphone connecting state, the current live broadcast room is switched to a video microphone connecting mode, and a corresponding video area is provided on a graphical user interface of the live broadcast room.

Step S1112, invoking a camera unit of the current terminal device to obtain a video stream corresponding to the current anchor user participating in the video microphone connecting mode, and uploading the video stream to the media server:

as for the video stream of the current anchor user, recording and acquiring are performed by calling a camera unit of the terminal device by default, and of course, the video stream recorded and acquired by the camera unit is also uploaded to the media server, so that the video stream is pushed to other users by the media server and pushed to a mixed drawing.

Step S1113, pulling the video stream corresponding to the other anchor user participating in the video microphone connecting mode from the media server:

for other anchor users participating in video microphone connection, the current anchor user starts to pull streams to the media server after entering a video microphone connection mode, specifically, video streams corresponding to other anchor users in a video microphone connection state are obtained.

The embodiment further discloses a video stream acquisition process by taking the current anchor user as a control party, on the basis, the control is convenient, the creation of the playing window can be implemented in the terminal equipment of the current anchor user according to the service flow provided by the application, and finally, the corresponding video streams are output to the corresponding playing windows for display. The embodiment opens the freedom for the anchor user to configure the layout template and adjust the uniform layout display of the live broadcast room, and is very flexible.

In a deepened partial embodiment, the step S1100 of acquiring multiple paths of video streams participating in video microphone connection includes the following steps:

step S1121, responding to the viewer user entering the event or the video microphone connection start event in the live broadcast room in the video microphone connection state, and displaying the graphical user interface in the video microphone connection mode of the live broadcast room:

when the audience users are used as the control party, the terminal equipment of the audience users is responsible for respectively pulling the video streams of the various main users participating in the video online. Audience users usually enter a certain live broadcast room in a live broadcast hall in a video microphone connecting state, when the audience users enter the live broadcast room, corresponding user entering events are triggered, a graphical user interface in a video microphone connecting mode of the live broadcast room is displayed in response to the events, and corresponding video areas are provided in the graphical user interface. Similarly, if the audience user enters the live broadcast room and the anchor user confirms to connect with other anchor users to cause the terminal equipment at the audience user side to receive the corresponding video connecting with the microphone starting event, the corresponding service logic can be triggered to display the graphical user interface in the video connecting with the microphone mode.

Step S1122, respectively pulling each video stream of each anchor user participating in video live microphone to the media server:

after entering the graphical user interface in the video microphone connecting mode, the terminal device at the viewer user side starts to pull the video streams corresponding to the anchor users from the media server at the background, so that the service process of the application can be applied according to the video streams, the corresponding playing windows are created according to the layout template, and the video streams are correspondingly rendered and displayed in the playing windows.

The embodiment avoids the pressure of a media server on mixing the multiple paths of video streams participating in the video and the microphone, enables the terminal equipment of each audience user to process the interface display of the multiple paths of video streams according to the layout template, opens the freedom degree of interface control for the audience user, and enables the audience user to realize the layout adjustment of each playing window in the video area of the live broadcast room by configuring the layout template or adjusting the round-corner window, thereby being very flexible.

In a deepened partial embodiment, after the step S1400 of loading the video frames of the video streams into the corresponding playing windows, the method includes the following steps:

step S1500, implementing mixed drawing on each video stream according to the layout formed by each playing window to form a single video stream:

when the media server is used as a control party, the media server acquires a correspondingly set layout template according to the preset service logic and the number of people participating in video microphone connection, completes the creation of a playing window and the rendering of video streams according to the service logic of the application, and then performs mixed drawing on the video streams, thereby forming a single-path video stream.

Step S1600, broadcasting the one-way video stream to the live broadcast rooms of the anchor users providing the video streams:

and the media server further broadcasts the one-way video stream to the live broadcast rooms of all the main broadcasting users participating in video microphone connection, specifically, the one-way video stream is pushed to the terminal equipment of all the audience users in all the live broadcast rooms, and the one-way video stream is rendered to the live broadcast room video area of the graphical user interface of the one-way video stream for display in a single-broadcast window playing mode after the one-way video stream is decoded by the corresponding terminal equipment. It is understood that, since the media server has already performed layout processing on the situation of multiple windows, although the terminal device displays a single video stream through a single play window, window effects corresponding to multiple video streams can still be indicated in the play window.

In the embodiment, the media server is used as a control party, the layout display control is implemented through the media server, the display effects of the terminal devices of all audience users participating in a plurality of live rooms of the video and the live telecast are unified, the order is uniform, the logic is simplified, the deployment is convenient, and the calculation pressure on the terminal device side is reduced.

Referring to fig. 13, a multi-channel live broadcast display control apparatus adapted to one of the purposes of the present application includes: a video stream acquisition module 1100, a layout application module 1200, a window generation module 1300, and a rendering display module 1400, wherein: a video stream acquiring module 1100, configured to acquire multiple video streams participating in video connection; the layout application module 1200 is configured to invoke a corresponding layout template according to the number of the video streams, where the layout template includes layout information of the playing windows corresponding to the video streams, and the layout information includes a clipping size for clipping corners of the playing windows corresponding to the layout information; a window generating module 1300, configured to create a corresponding playing window for each video stream, so that the playing window presents a shape that is cut according to the cutting size in the layout information; and the rendering and displaying module 1400 is configured to load the video pictures of the video streams into the corresponding playing windows.

In some embodiments of the deepening, the layout application module 1200 includes: the first drawing unit is used for judging whether the cutting size in the layout information of each playing window represents no cutting, if so, the playing window is drawn into a regular rectangular window in the first drawing surface according to the window size and the window position in the layout information; a second drawing unit configured to draw the play window and the window position as a regular temporary rectangular window according to the window size in the layout information in a second drawing surface if the cutting size of the play window represents an effective cutting size; and the fillet cutting unit is used for applying the cutting size to the temporary rectangular window to carry out cutting so as to enable the temporary rectangular window to become a fillet window, and the fillet window comprises a perfect circular window or a rectangular window with fillet characteristics.

In some embodiments of the extension, the multi-channel live broadcast display control device of the present application includes any one or any plurality of modules as follows: the fillet adjusting module is configured to respond to a fillet adjusting instruction acting on one of the fillet windows and reset the fillet size of the fillet window according to the cutting size corresponding to the fillet adjusting instruction; the area adjusting module is configured to respond to a size adjusting instruction acting on one of the fillet windows and reset the overall size of the fillet window according to the window size corresponding to the size adjusting instruction; and the position adjusting module is configured to respond to a position adjusting instruction acting on one of the fillet windows and reset the display position of the fillet window according to the window position corresponding to the position adjusting instruction.

In some embodiments of the present invention, the rendering and displaying module 1400 includes: the face recognition unit is used for recognizing a face area image of the video stream corresponding to the target playing window belonging to the fillet window; and the positioning output unit is used for displaying the face region image in the target playing window.

In some embodiments of the deepening, the video stream acquiring module 1100 includes: the connecting and switching unit is used for responding to a video connecting and microphone confirming instruction, switching the current live broadcast room to a video connecting and microphone mode and entering a graphical user interface corresponding to the video connecting and microphone mode; the local pull stream unit is used for calling a camera shooting unit of the current terminal equipment to acquire a video stream corresponding to the current anchor user participating in the video microphone connecting mode and uploading the video stream to the media server; and the remote stream pulling unit is used for pulling the video streams corresponding to other anchor users participating in the video microphone connecting mode from the media server.

In some embodiments of the deepening, the video stream acquiring module 1100 includes: the audience presentation unit is used for responding to an audience user entering event or a video microphone connecting starting event in a live broadcast room in a video microphone connecting state and displaying a graphical user interface in a video microphone connecting mode of the live broadcast room; and the respective stream pulling unit is used for pulling each path of video stream of each anchor user participating in video microphone connection to the media server.

In the embodiment of the deepened part, the multi-channel live broadcast display control device of the application further comprises: the mixed drawing processing module is used for carrying out mixed drawing on each video stream according to the layout formed by each playing window to form a single video stream; and the broadcast stream pushing module is used for broadcasting the single-channel video stream to the live broadcast rooms of all anchor users providing all the channels of video streams.

In order to solve the technical problem, an embodiment of the present application further provides a computer device. As shown in fig. 14, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a computer-readable storage medium, a memory, and a network interface connected by a system bus. The computer readable storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions, when executed by the processor, can enable the processor to realize a multi-channel live broadcast display control method. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may store computer readable instructions, and when the computer readable instructions are executed by the processor, the processor may execute the multi-channel live presentation control method of the present application. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 14 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module and its sub-module in fig. 13, and the memory stores program codes and various data required for executing the modules or sub-modules. The network interface is used for data transmission to and from a user terminal or a server. The storage in this embodiment stores program codes and data required for executing all modules/sub-modules in the multi-channel live broadcast display control device of the present application, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application further provides a storage medium storing computer-readable instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the multi-channel live show control method of any of the embodiments of the present application.

The present application also provides a computer program product comprising computer programs/instructions which, when executed by one or more processors, implement the steps of the method as described in any of the embodiments of the present application.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments of the present application can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when the computer program is executed, the processes of the embodiments of the methods can be included. The storage medium may be a computer-readable storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

In summary, the application realizes displaying the video pictures of the video stream through the fillet window, and can realize reasonable layout of multiple paths of video streams in the video microphone connecting mode in the live webcast scene, thereby realizing efficient utilization of the information expression space of the graphical user interface.

Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A multi-channel live broadcast display control method is characterized by comprising the following steps:

2. The multi-channel live broadcasting display control method according to claim 1, wherein a corresponding playing window is created for each channel of video stream, so that the playing window presents a shape that is cut correspondingly according to the cutting size in the layout information, comprising the steps of:

3. The multi-channel live broadcasting display control method according to claim 2, wherein after the step of loading the video frames of the video streams into the corresponding playing windows, any one or more of the following steps are included:

4. The multi-channel live broadcasting display control method according to claim 1, wherein loading the video pictures of each channel of video stream into its corresponding playing window comprises the steps of:

and displaying the face region image in the target playing window.

5. The multi-channel live broadcasting display control method according to claim 1, wherein the step of obtaining the multi-channel video stream participating in video connection with the microphone comprises the following steps:

6. The multi-channel live broadcasting display control method according to claim 1, wherein the step of obtaining the multi-channel video stream participating in video connection with the microphone comprises the following steps:

7. The multi-channel live broadcasting display control method according to claim 1, wherein after the step of loading the video pictures of each channel of video stream into the corresponding playing window, the method comprises the following steps:

8. A multichannel live broadcast show controlling means which characterized in that includes:

the layout application module is used for calling a corresponding layout template according to the number of the video streams, the layout template comprises layout information of playing windows corresponding to all the video streams, and the layout information comprises cutting sizes used for cutting corners of the playing windows corresponding to the layout information;

9. A computer device comprising a central processing unit and a memory, characterized in that the central processing unit is adapted to invoke the execution of a computer program stored in the memory to perform the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised by the corresponding method.