WO2023160573A1 - 直播画面的展示方法、装置、电子设备及存储介质 - Google Patents

直播画面的展示方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2023160573A1
WO2023160573A1 PCT/CN2023/077603 CN2023077603W WO2023160573A1 WO 2023160573 A1 WO2023160573 A1 WO 2023160573A1 CN 2023077603 W CN2023077603 W CN 2023077603W WO 2023160573 A1 WO2023160573 A1 WO 2023160573A1
Authority
WO
WIPO (PCT)
Prior art keywords
live
video source
video
fusion
image
Prior art date
Application number
PCT/CN2023/077603
Other languages
English (en)
French (fr)
Inventor
陈映宜
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Publication of WO2023160573A1 publication Critical patent/WO2023160573A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • Embodiments of the present disclosure relate to the technical field of image processing, for example, to a display method, device, electronic device, and storage medium of a live image.
  • Embodiments of the present disclosure provide a display method, device, electronic equipment, and storage medium for live images.
  • an embodiment of the present disclosure provides a method for displaying live images, the method including:
  • an image editing interface In response to the received live image editing request, displaying an image editing interface, wherein the image editing interface includes at least two video source windows for displaying live video sources;
  • the embodiment of the present disclosure also provides a display device for live images, the device includes:
  • the picture editing request module is configured to display a picture editing interface in response to the received live picture editing request, wherein the picture editing interface includes at least two video source windows for displaying live video sources;
  • the fusion picture preview module is configured to receive the video fusion operation input for at least two video source windows, and display the preview picture of the fusion live picture corresponding to the video fusion operation in a preset fusion display mode, wherein the fusion live picture
  • the foreground information and background information of the screen come from different Live video feed.
  • an embodiment of the present disclosure further provides an electronic device, which includes:
  • processors one or more processors
  • storage means configured to store one or more programs
  • the one or more processors are made to implement a method for displaying live images provided in any embodiment of the present disclosure.
  • an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, a method for displaying live images provided by any embodiment of the present disclosure is implemented. .
  • FIG. 1 is a schematic flowchart of a method for displaying a live image provided by Embodiment 1 of the present disclosure
  • FIG. 2 is a schematic flowchart of a method for displaying a live image provided by Embodiment 2 of the present disclosure
  • FIG. 3 is a schematic flowchart of a method for displaying live images provided by Embodiment 3 of the present disclosure
  • FIG. 4 is a schematic flowchart of a method for displaying live images provided by Embodiment 4 of the present disclosure
  • FIG. 5 is a schematic flowchart of a method for displaying live images provided by Embodiment 5 of the present disclosure
  • Fig. 6 is a schematic diagram of the screen editing interface of the live screen display method provided by the embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of a display device for live images provided by Embodiment 6 of the present disclosure.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by Embodiment 7 of the present disclosure.
  • the term “comprise” and its variations are open-ended, ie “including but not limited to”.
  • the term “based on” is “based at least in part on”.
  • the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one further embodiment”; the term “some embodiments” means “at least some embodiments.” Relevant definitions of other terms will be given in the description below.
  • Fig. 1 is a schematic flowchart of a method for displaying a live image provided by Embodiment 1 of the present disclosure.
  • This embodiment can be applied to an application scenario of network live broadcast, and the method can be executed by a device for displaying a live image. It can be realized by software and/or hardware, and can be configured in a terminal and/or a server to realize the display method of live images in the embodiments of the present disclosure.
  • the terminal can be a smartphone, or any terminal device with a webcast function such as a laptop or a tablet computer, or a terminal device that can control other webcast devices to display live images, such as a broadcast director.
  • the method of the present embodiment includes:
  • the live image editing request can be understood as a function enabling request for enabling the function of editing the live image.
  • the picture editing interface can be understood as an interactive interface that provides a function of editing live pictures.
  • the picture editing interface may also include controls for editing the live picture, a display area for the edited live picture, and the like.
  • the video source window is the display window used to display the live video source.
  • the video source window can be distinguished according to the application scenario of the live video source, for example, it can be distinguished according to whether the displayed live video source is used to edit the screen foreground information or the screen background information of the live screen.
  • the video source window includes a foreground video source window and a background video source window.
  • the number and layout of video source windows can be set according to actual conditions, and are not limited here. Exemplarily, the number and layout of the video source windows may be determined according to the size of the display screen of the terminal used to execute the display method of the live video and the way of obtaining the live video source.
  • the screen editing interface includes at least two video source windows for displaying live video sources. Screenshots are the basis for editing.
  • the display method of the live video may also include: obtaining the live video source, and displaying the live video source on a display screen for displaying the live video source in the video source window.
  • the live video source may include but not limited to the video data of the local camera, the video data of the external camera, the screen video data of the external device, the network video data, the picture or video data in the target storage space of the local machine, and At least one item of picture or video data in the cloud target storage space.
  • the local machine can be understood as a device for performing the method for displaying the live screen.
  • the local camera can be understood as the camera carried by the local itself.
  • the live video source There are many ways to obtain the live video source. For example, you can access camera video data, camera video data, and external machine video data through the universal serial bus interface set on the machine body; you can also obtain external camera video data through wireless transmission methods such as LAN, WAN, or Bluetooth.
  • wireless transmission methods such as LAN, WAN, or Bluetooth.
  • the screen video data and camera video data of the external mobile phone can access camera video data, camera video data, and external machine video data through the universal serial bus interface set on the machine body; you can also obtain external camera video data through wireless transmission methods such as LAN, WAN, or Bluetooth.
  • obtaining a live video source may include at least one of the following methods:
  • dedicated video source windows are respectively set for live video sources from different sources.
  • a source as a video type, that is, establishing a corresponding relationship between the video source window and the live video source type, and adding the type identifier of the live video source corresponding to the video source window to the video source window.
  • the advantage of this setting is that it is convenient for users to distinguish different types of live video sources.
  • video source addition guide information may be displayed.
  • the video source adding guide information is used to guide the user how to add the live video source, for example, to display the URL input box, or to display the establishment Linked QR codes, etc.
  • the responding to the received live screen edit request may further include: receiving the live screen edit request.
  • receiving the live screen edit request there are multiple ways to generate the live video editing request. Exemplarily, when a start-up operation for the directing device is received, it is determined that a live picture editing request is received; or, when preset voice information for initiating a live picture editing request is received, it is determined that a live picture editing request is received An edit request; or, when a request trigger operation for a preset request control for initiating a live screen edit request is received, it is determined that a live screen edit request has been received.
  • live video source in the embodiments of the present disclosure can be understood as the video associated with the live broadcast, or in other words, the video that supports being used in the live broadcast screen, or in other words, the video that supports being pushed into the live broadcast room video.
  • the "live broadcast" in the live video source is only to illustrate the video involved in the live broadcast scene, but not to limit the content and source of the video.
  • S120 Receive a video fusion operation input for at least two video source windows, and display a preview picture of a fusion live picture corresponding to the video fusion operation in a preset fusion display mode, wherein the picture foreground information and the picture fusion live picture of the fusion live picture
  • the screen background information comes from different live video sources.
  • the video fusion operation can be understood as an operation of triggering two or more live video sources to start fusion. Since the video fusion operation often involves selection and fusion of two or more live video sources, the video fusion operation may be implemented by combining two or more operations.
  • the video fusion operation may include a foreground selection operation and a background selection operation.
  • a video fusion operation When both the foreground selection operation and the background selection operation are completed, it is determined to receive a video fusion operation input from at least two video source windows. For example, when it is detected that the selected number of received video source windows reaches a preset number, it is determined to receive a video fusion operation input for at least two video source windows. For example, when it is detected that the selected number for the foreground video source window reaches the preset foreground number, and when it is detected that the selected number for the background video source window reaches the preset background number, it is determined to receive input for at least two video source windows Video fusion operation.
  • a video fusion operation may include a foreground selection operation and a background selection operation.
  • the video fusion operation may include a fusion trigger operation for a preset video fusion control.
  • the preset video fusion control may be a virtual component set on the screen editing interface, or a physical component set on the execution device for executing the display method of the live screen.
  • the style of the preset video fusion control can be set according to actual requirements, which is not limited here. It can be the button identified as "Screen Preview" on the screen editing interface.
  • the presentation information in different live video sources can be divided into screen foreground information and screen background information for fusion, which enriches the The display method of the live screen.
  • the live video source is composed of a series of image sequences.
  • processing may be performed on each frame of the live video source. Therefore, before displaying the fused live broadcast picture corresponding to the video merging operation, it may also include: acquiring the foreground video source and the background video source corresponding to the video merging operation, and respectively determining the to-be-processed video source of the foreground video source.
  • the foreground image and the background image to be processed of the background video source wherein the time information of the foreground image to be processed and the background image to be processed are the same; determine the image foreground information of the foreground image to be processed and the image to be processed
  • the image background information of the background image using the image foreground information as the picture foreground information of the fused live picture, using the image background information as the picture background information of the fused live picture, and combining the picture foreground information with the picture background information merging to obtain a fused live image corresponding to the video merg
  • the timestamps corresponding to the respective video sources are aligned, and when a video fusion operation input for at least two video source windows is received, image frames at the same time information in the foreground video source and the background video source are respectively used as The to-be-processed foreground image and the to-be-processed background image, and then, through the way of matting, the to-be-processed foreground image and the to-be-processed background image are respectively matted to obtain the image foreground information and the image background information, and the image foreground information and the image background information
  • the fusion is to obtain the fusion live video.
  • the fused live broadcast picture corresponding to the video fusion operation may be a frame of fused live broadcast picture corresponding to the time of the video fusion operation, or may be many hours after the video fusion operation.
  • Frame fusion live video It only needs to use the method in the embodiment of the present disclosure to perform fusion processing on the image frames at different time points in the live video source.
  • a picture editing interface including at least two video source windows for displaying live video sources, providing an interactive function with the user, and responding to the user's live picture
  • the editing appeal provides the user with a screen editing entry; then, receiving a video fusion operation input for at least two video source windows, and displaying a preview screen of the fusion live screen corresponding to the video fusion operation in a preset fusion display mode, and
  • the foreground information and background information of the fusion live screen come from different live video sources, and two or more video sources can be realized
  • the integration of the live video sources corresponding to the window realizes the linkage between two or more live video sources, enriches the display effect of the video, increases the interest of the live broadcast, and avoids the situation that the live screen display form is single and does not support editing , and enables the user to intuitively observe the presentation effect of the integrated live broadcast image, so as to better meet the individual needs of the user and improve the user's live broadcast experience.
  • Fig. 2 is a schematic flow chart of a method for displaying live images provided by Embodiment 2 of the present disclosure. This embodiment is based on any optional embodiment in the embodiments of the present disclosure.
  • the video The fusion operation includes a picture foreground selection operation and a background selection operation
  • the video source window includes a foreground video source window and a background video source window
  • the receiving video fusion operation input for at least two video source windows is preset in a fusion display mode Displaying a preview image of a fusion live image corresponding to the video fusion operation, including: receiving a screen foreground selection operation for at least one foreground video source window, and using the live video source displayed in the selected foreground video source window as the foreground video source; Receive a screen background selection operation for at least one background video source window, and use the live video source displayed in the selected background video source window as the background video source; display the foreground video source and the background video source in a preset fusion display mode
  • the method of this embodiment may include:
  • S220 Receive a screen foreground selection operation for at least one foreground video source window, and use the live video source displayed in the selected foreground video source window as the foreground video source.
  • the foreground video source window can be understood as a window in which a live video source for presentation can be selected as the foreground video source. It should be noted that whether the live video source can be selected as the foreground video source or which live video sources can be selected as the foreground video source can be set according to the actual situation, which is not limited here.
  • the live video source displayed in the video source window includes the first target object
  • the video source window is used as the foreground video source window.
  • the first target object may be a person or an animal.
  • the video source of the live video source displayed in the video source window is the first preset source
  • the video source window is used as the foreground video source window.
  • the preset source may include an acquisition method of the live video source or a provider of the live video source, and the like.
  • the first preset source may be a video captured by a camera on a terminal used for live broadcasting, or a video captured by a local camera used for displaying a fused live broadcast image, or the like.
  • the video source window is used as the foreground video source window.
  • the screen foreground selection operation may include an operation for selecting or deselecting the foreground video source window.
  • the corresponding result of the screen foreground selection operation may be that a certain foreground video source window or multiple foreground video source windows are selected. It can be understood that the live video source displayed in the selected video source window is used as the foreground video source for fusion.
  • the live video sources displayed in the foreground video source window and the background video source window may be the same or different.
  • the video source window is used as the background video source window.
  • the second target object may be mountains, water, buildings, flowers, trees and so on.
  • the video source of the live video source displayed in the video source window is the second preset source
  • the video source window is used as the background video source window.
  • the preset source may include an acquisition method of the live video source or a provider of the live video source, and the like.
  • the video source window is used as the background video source window.
  • the manner of distinguishing the live video source as a static picture or a dynamic video may be determined by comparing the difference of the displayed content in the image frame corresponding to the preset time point.
  • the screen background selection operation may include an operation for selecting or deselecting a background video source window.
  • the corresponding result of the screen background selection operation may be that a certain background video source window or multiple background video source windows are selected. It can be understood that the live video source displayed in the selected video source window is used as the background video source for fusion.
  • S240 Display a preview image of a fused live image corresponding to the foreground video source and the background video source in a preset fused display manner, wherein the image foreground information and image background information of the fused live image come from different live broadcasts video source.
  • the picture foreground information of the fused live picture comes from the foreground video source, and the picture background information of the fused live picture comes from the background video source.
  • the foreground video source window and the background video source window are switched and displayed based on a switching trigger operation acting on a preset video source window switching control.
  • a preset video source window switching control there may be one or two video source window switching controls.
  • the preset video source window switching controls corresponding to the foreground video source window and the background video source window may be the same control or different controls.
  • the video source window switching control may include a foreground video source display control and a background video source display control.
  • the foreground video source display control may be a default video source display control
  • the background video source display control may be a cutout background control.
  • the video source is not The display form of the window switching control is limited, as long as it can be used to realize the switching display of the foreground video source window and the background video source window.
  • the foreground video source according to the received screen foreground selection operation for at least one foreground video source window by selecting the background video source according to the received screen background selection operation for at least one background video source window, it can autonomously Choosing to fuse the foreground information and background information of the live screen can accurately obtain the editing demands of the live screen, so as to ensure accurate response to user needs, realize the targeted integration of the live screen, and improve the user experience.
  • Fig. 3 is a schematic flow chart of a method for displaying live images provided by Embodiment 3 of the present disclosure. This embodiment is based on any optional embodiment in the embodiments of the present disclosure.
  • the The method also includes: receiving a fusion layout trigger operation acting on a preset fusion layout control; and displaying a preview screen of a fusion live image corresponding to the video fusion operation in a preset fusion display mode includes: triggering according to the fusion layout Operate the corresponding preset fusion layout template to display the preview image of the fusion live image, wherein the preset fusion layout template includes the maximum number of live video sources that allow fusion and the display size and display position of each live video source.
  • the method of this embodiment may include:
  • the preset fusion layout control can be understood as a control element used to determine the layout of the fused live image after being triggered.
  • the preset fusion layout control is generally a virtual component set in the screen editing interface.
  • the display forms of the preset fusion layout control can be in various forms, such as text, graphics, or a combination of graphics and text.
  • the preset fused layout control may be displayed with a thumbnail of a layout sample of the fused live image as a control identifier.
  • the integrated layout triggering operation can be understood as an operation that can trigger the preset integrated layout control to determine the layout of the integrated live image after acting on the preset integrated layout control in a preset triggering manner.
  • the manner of acting on the preset fusion layout control may include but not limited to operations such as single click, double click, long press, short press or slide.
  • the preset fusion layout template corresponding to the fusion layout trigger operation in the screen editing interface In the display area used to display the preview screen of the fusion live screen on the screen. So that the user can view the effect of the screen layout.
  • receiving a video fusion operation input for at least two video source windows may be receiving a video source adding operation of adding a live video source to a preset fusion layout template.
  • the live video source can be added to the preset fusion layout template by dragging and dropping the live video source, or the live video source can be added to the preset fusion layout template by acting on the add indicator control in the video source window middle.
  • the adding indication control may be a control for indicating which area in the preset fusion layout template to add the live video source. It is also possible to replace the existing live video source with the new live video source by dragging the new live video source into the position of the existing live video source in the preset fusion layout template.
  • the live video source in the preset integrated layout template needs to be deleted
  • the live video source can be deleted from the preset integrated layout template by dragging the live video source out of the preset integrated layout template.
  • the live video source can also be flipped, for example, the live video source is mirrored; or, acting on the delete indicator control in the video source window, the display information of the live video source in the video source window is deleted , no longer displayed.
  • the preset integration layout template includes the maximum number of live video sources allowed to be integrated and the display size and display position of each live video source.
  • the preset fusion layout template can be understood as a preset template or sample of the display size and display position of each live video source used for video source fusion in the fusion live screen. It can be understood that the number of preset fusion layout templates may be one or more.
  • the style of the preset integrated layout template can be set according to actual needs, and is not limited here. Exemplarily, different preset fusion layout controls may be set according to the maximum number of live video sources to be fused. In an example, for a certain number of live video sources to be fused, different preset fusion layout templates may be set according to the display size and display position of each video source.
  • the correspondence between the preset integrated layout template and the preset integrated layout control may be a one-to-one correspondence or a many-to-one correspondence.
  • the preset fusion layout template corresponding to the preset fusion layout control can be switched through a fusion layout trigger operation acting on the preset fusion layout control.
  • a fusion layout trigger operation acting on a preset fusion layout control for the user
  • the user provides a fusion layout selection function, and displays the preview screen of the fusion live image according to the preset fusion layout template corresponding to the fusion layout trigger operation, and can respond to the fusion layout trigger operation based on the selected preset fusion layout template
  • Displaying integrated live images for users to preview, one-click layout function, simple and convenient operation, and the preset integrated layout template includes the maximum number of live video sources that allow integration and the display size and display position of each live video source, making Users can understand the layout of the integrated live broadcast screen at a glance, thereby improving user experience.
  • Fig. 4 is a schematic flowchart of the method for displaying live images provided by Embodiment 4 of the present disclosure. This embodiment is based on any optional embodiment in the embodiments of the present disclosure.
  • the fusion display mode is set to display the preview screen of the fusion live screen corresponding to the video fusion operation, it also includes: receiving the display adjustment of the fusion live screen or the display information corresponding to at least one live video source in the fusion live screen Operation, adjust the display information, and display the adjusted preview image of the fused live image.
  • the method of this embodiment may include:
  • S420 Receive a video fusion operation input for at least two video source windows, and display a preview picture of a fusion live picture corresponding to the video fusion operation in a preset fusion display mode, wherein the picture foreground information and the picture fusion live picture of the fusion live picture
  • the screen background information comes from different live video sources.
  • the display information of the fused live image can be adjusted, or the fused live image can be adjusted.
  • the display information corresponding to at least one live video source in the screen is adjusted.
  • the display adjustment operation may be understood as an operation for adjusting all or part of the display information in the fused live broadcast screen.
  • displayed information can be understood as user-oriented information, generally information that can be perceived at a visual level or an auditory level.
  • the display information may include, but not limited to, at least one item of display location, display size, display color, display style, and display content.
  • the displayed content may include video source image information and video source sound information in the live video source.
  • At least one live video source can be one live video source, two live video sources video source or two or more live video sources.
  • the receiving display adjustment operation of display information corresponding to at least one live video source in the fused live image includes: receiving a display image corresponding to at least one live video source in the fused live image A layout adjustment operation; and/or, receiving an image beautification adjustment operation input to at least one live video source in the fused live image.
  • the picture layout adjustment operation can be understood as an adjustment operation for the relevant layout information in the fused live picture of each live video source in that live picture.
  • the picture layout adjustment operation may include, but not limited to, the adjustment of the display position and/or display size of each live video source in the fused live picture, the operation of increasing or decreasing the live video source, and increasing or decreasing the preset picture At least one of the operation of props, etc. It can be understood that there may be multiple ways of generating the screen layout adjustment operation.
  • the display position and/or display size of the live video source in the fused live screen can be adjusted by dragging, or the operation of increasing or decreasing the live video source can be increased or decreased by selecting the corresponding control after being triggered by the right button of the input device, etc. .
  • the display information corresponding to at least one live video source in the fused live screen can also be adjusted by triggering a preset screen layout adjustment control in the screen editing interface.
  • the setting position and display form of the screen layout adjustment control can be determined according to actual needs, and are not limited here.
  • the screen layout adjustment control may be a virtual control provided on the display interface.
  • the default display form of the screen layout adjustment control can be displayed or hidden.
  • the transparency of the screen layout adjustment control can be determined according to whether it is triggered.
  • the target triggering operation may be a cursor clicking a preset triggering area, or a cursor hovering operation in the preset triggering area, and the like.
  • the image beautification adjustment operation can be understood as an operation for adjusting and fusing relevant color information in the live image.
  • the image beautification adjustment operation may be an operation acting on a preset beautification adjustment control.
  • the preset beautification adjustment control may be an adjustment for different display angles of the picture. For example, displaying the lake surface style of the live video source as a preset style, performing beauty treatment and/or makeup processing on the target object in the display screen of the live video source, adding preset filters to the display screen of the live video source, and At least one of operations such as increasing or decreasing preset screen props.
  • the picture beautification adjustment operation is also input through the preset picture beautification adjustment control.
  • the number of screen beautification adjustment controls may be one or more.
  • a single screen beautification adjustment control may support only one screen beautification adjustment method, or may support multiple screen color adjustment methods.
  • receiving a display adjustment operation on display information corresponding to the fused live image includes: receiving an image beautification adjustment operation on the fused live image.
  • the adjustment method can be the same as that for the screen beautification adjustment method for the live video source, and will not be repeated here.
  • adjusting the display information includes adjusting the display information of all live video sources in the integrated live image, or adjusting the display information of some live video sources in the integrated live image.
  • the adjustment method is related to the display adjustment operation. For example, when receiving a display adjustment operation on the display information of the fused live screen, adjust the display information of all live video sources in the fused live screen; During the display adjustment operation of the corresponding display information, the display information of the live video source to which the display adjustment operation is applied in the integrated live broadcast screen is adjusted.
  • the fused live broadcast picture after obtaining the fused live broadcast picture, it is supported to adjust part of the display information or all the displayed information in the fused live broadcast picture, adjust the fused live broadcast picture in response to the adjustment operation of the user, and display the adjusted fused live broadcast picture
  • the preview screen fully meets the user's individual needs through interaction with the user, thereby ensuring the final display effect of the live broadcast screen.
  • Fig. 5 is a schematic flow chart of a method for displaying live images provided by Embodiment 5 of the present disclosure.
  • This embodiment provides a method for multiple live video sources on the basis of any optional embodiment in the embodiments of the present disclosure.
  • Another way of displaying live images is provided, that is, combining and displaying two or more live video sources.
  • the method further includes: receiving a video combination operation input for at least two video source windows, and displaying a preview picture of a combined live picture corresponding to the video combination operation in a preset combination presentation manner.
  • the method of this embodiment may include:
  • S520 Receive a video fusion operation input for at least two video source windows, and display a preview picture of a fusion live picture corresponding to the video fusion operation in a preset fusion display manner, wherein the picture foreground information and the picture fusion live picture of the fusion live picture
  • the screen background information comes from different live video sources.
  • S530 Receive a video combination operation input for at least two video source windows, and display the video in a preset combination
  • the preview screen of the combined live screen corresponding to the video combination operation is shown in a demonstration manner.
  • the method for displaying a live image in an embodiment of the present disclosure may further include: receiving a combined layout trigger operation acting on a preset combined layout control; furthermore, displaying the Combine the preview screen of the live screen.
  • the preset combined layout template includes the maximum number of live video sources allowed to be combined and the display size and display position of each live video source.
  • the preset combined layout template can be understood as a preset template or sample of the display size and display position of each live video source used for video source combination in the combined live screen. It can be understood that the number of preset combined layout templates may be one or more.
  • the style of the preset combined layout template can be set according to actual needs, and is not limited here. Exemplarily, different preset combination layout controls may be set according to the maximum number of combined live video sources. For example, according to the number of live video sources to be combined, different preset combination layout templates can be set according to the display size and display position of each video source.
  • the correspondence between the preset combined layout template and the preset combined layout control may be a one-to-one correspondence or a many-to-one correspondence.
  • the preset combined layout template corresponding to the preset combined layout control can be switched through a combined layout trigger operation acting on the preset combined layout control.
  • This embodiment not only supports the fusion of two or more live video sources, but also supports the combination of two or more live video sources, which further enriches the display methods of live images, especially when multiple video sources need to be In the case of display, different video source processing methods can be provided, so as to better meet the individual needs of users and further improve user experience.
  • the method for displaying the live image may further include: pushing the target live image to the target live room, wherein the target live image includes a live video source, a fused live image Or combine live images.
  • the target live broadcast image can be pushed to the target live broadcast room.
  • the target live broadcast image can be determined according to the actual situation. It can be one of the live video sources in at least one video source, or two or more A fused live image obtained by fusing different live video sources or a combined live image obtained by combining two or more live video sources.
  • the advantage of this setting is that it can synchronize the screen between the live broadcast user and the viewing user, and the target The live broadcast screen is displayed to the viewers in the target live broadcast room. While enriching the live broadcast screen, it can better realize the real-time interaction between the live broadcast users and the viewers.
  • FIG. 6 is a schematic diagram of a screen editing interface in a live screen display method provided by an embodiment of the present disclosure.
  • the picture editing interface may include a picture preview area for displaying a preview picture of the live picture (as shown in the large rectangular frame in the upper left of Figure 6), and use It is used to display the video source window of the live video source (such as the 5 small rectangular boxes on the right side) and the screen editing control for editing the live screen.
  • the screen editing control may include a foreground video source display control (such as the "video source” control in Figure 6), a background video source display control (such as the "cutout background” control in Figure 6), a preset streaming control ( As shown in the "Push Flow” control in Figure 6), the preset combined layout control (such as the small rectangular box with the numbers “1” and “12” shown in the row below the large rectangular box on the left) and the preset beautification adjustment Controls ("beauty”, “makeup”, "filter” and “sticker” in Figure 6).
  • a foreground video source display control such as the "video source” control in Figure 6
  • a background video source display control such as the "cutout background” control in Figure 6
  • a preset streaming control As shown in the "Push Flow” control in Figure 6
  • the preset combined layout control such as the small rectangular box with the numbers “1” and “12” shown in the row below the large rectangular box on the left
  • the preset beautification adjustment Controls (“beau
  • a foreground video source is displayed in the video source window corresponding to the video source control, and each video source window identifies the source of the live video source displayed in the video source window.
  • the selected live video source can be displayed in the screen preview area on the left. If the preset combination layout control selects "12", that is, the combination of two pictures, the selected live video source will be displayed in the screen preview area through the preset combination layout template.
  • each preset beautification adjustment control may correspond to one or more preset beautification adjustment templates for selection by the user.
  • the preset beautification adjustment template can only be used to adjust the live video sources in some sub-display areas in the preset combined layout template, for example, only adjust the live video source corresponding to the local camera. It is also possible to adjust all the live video sources in the preset combination layout template.
  • the background video source window is used to display the background video source.
  • the integrated live video can be obtained by selecting the background video source. It is understandable that it is also possible to select the background video source first and then select the foreground video source to obtain a fused live broadcast image.
  • the user's interaction cost is saved as much as possible, the display effect is enriched, and the user experience is improved.
  • Fig. 7 is a schematic structural diagram of a display device for a live image provided in Embodiment 6 of the present disclosure.
  • the display device for a live image provided in this embodiment can be realized by software and/or hardware, and can be configured in a terminal and/or
  • the method for displaying live images in the embodiment of the present disclosure is implemented in the server.
  • the device may include: a picture editing request module 710 and a combined picture preview module 720 .
  • the picture editing request module 710 is configured to display a picture editing interface in response to the received live picture editing request, wherein the picture editing interface includes at least two video source windows for displaying live video sources;
  • Module 720 configured to receive a video fusion operation input for at least two video source windows, and display a preview picture of a fusion live picture corresponding to the video fusion operation in a preset fusion display mode, wherein the picture of the fusion live picture
  • the foreground information and screen background information come from different live video sources.
  • the screen editing request module responds to the received live screen editing request, and displays a screen editing interface including at least two video source windows for displaying live video sources, providing an interactive function with the user, responding
  • the user's request for live video editing provides the user with an entry for screen editing; then, the video fusion operation input for at least two video source windows is received through the fusion screen preview module, and the video fusion operation corresponding to the video fusion operation is displayed in a preset fusion display mode.
  • the preview screen of the fusion live screen, and the screen foreground information and screen background information of the fusion live screen come from different live video sources, which can realize the fusion of live video sources corresponding to two or more video source windows, and realize two Or the linkage between two or more live video sources, enriching the display effect of the video, increasing the fun of the live broadcast, avoiding the situation that the display form of the live broadcast screen is single and does not support editing, and enables users to intuitively observe the integrated live broadcast
  • the rendering effect of the screen can better meet the personalized needs of users and improve the live broadcast experience of users.
  • the video fusion operation includes a screen foreground selection operation and a background selection operation
  • the video source window includes a foreground video A source window and a background video source window
  • the fusion picture preview module includes: a foreground selection unit, a background selection unit and a picture preview unit.
  • the foreground selection unit is set to receive the picture foreground selection operation for at least one foreground video source window, and the live video source shown in the selected foreground video source window is used as the foreground video source;
  • the background selection unit is set to receive at least one foreground video source window
  • the picture background selection operation of the background video source window is to select the live video source displayed in the background video source window as the background video source;
  • the picture preview unit is set to display the foreground video source and the background in a preset fusion display mode The preview screen of the fusion live screen corresponding to the video source.
  • the switching trigger operation of the foreground video source window and the background video source window acts on a preset video source window switching control Make a toggle display.
  • the device further includes:
  • the video source acquisition module is configured to obtain the foreground video source and the background video source corresponding to the video fusion operation before the display of the fusion live picture corresponding to the video fusion operation, and determine the waiting time of the foreground video source respectively. Processing the foreground image and the to-be-processed background image of the background video source, wherein the time information of the to-be-processed foreground image and the to-be-processed background image are the same;
  • the image fusion module is configured to determine the image foreground information of the to-be-processed foreground image and the image background information of the to-be-processed background image, use the image foreground information as the picture foreground information of the fusion live picture, and use the image background information As the picture background information of the fused live picture, the picture foreground information is fused with the picture background information to obtain a fused live picture corresponding to the video fusion operation.
  • the device further includes: a fusion layout triggering module, wherein the fusion layout triggering module is configured to receive and act on a preset fusion layout The fusion layout trigger operation of the control; correspondingly, the fusion screen preview module is also set to: display the preview screen of the fusion live screen according to the preset fusion layout template corresponding to the fusion layout trigger operation, wherein the preset The blended layout template includes the maximum number of live video feeds that are allowed to blend together and the display size and placement of each live video source.
  • the device further includes:
  • the screen display adjustment module is configured to receive a preview of the fusion live screen or the fusion live screen corresponding to the video fusion operation after displaying the preview screen of the fusion live screen corresponding to the video fusion operation in the preset fusion display mode. Integrating the display adjustment operation of display information corresponding to at least one live video source in the live image, adjusting the display information, and displaying a preview image of the adjusted integrated live image.
  • the screen display adjustment module is set to:
  • the device further includes:
  • the video source obtaining module is configured to obtain a live video source, and display the live video source in a video source window for displaying the live video source.
  • the live video source includes video data of the local camera, video data of an external camera, screen video data of an external device, network video At least one of data, picture or video data in the local target storage space, and picture or video data in the cloud target storage space.
  • the device further includes:
  • the video source picture preview module is configured to receive a video display operation input for the video source window, and display a preview picture of the live video source corresponding to the video source window.
  • the device further includes:
  • the combination picture preview module is configured to receive video combination operations input for at least two video source windows, and display a preview picture of the combined live picture corresponding to the video combination operation in a preset combination display mode.
  • the device further includes: a combined layout trigger module.
  • the combined layout triggering module is configured to receive a combined layout triggering operation acting on a preset combined layout control; correspondingly, the combined screen preview module is configured to trigger a preset combined layout according to the combined layout triggering operation
  • the template displays a preview image of the combined live image.
  • the device further includes:
  • the video streaming module is configured to push the target live image to the target live room, wherein the target live image includes a live video source, a fused live image or a combined live image.
  • the above-mentioned live image display device can execute the live image display method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the live image display method.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by Embodiment 7 of the present disclosure.
  • the terminal equipment in the embodiments of the present disclosure may include but not limited to mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, PDA), tablet computers (PAD), portable multimedia players (Portable Media Player , PMP), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital televisions (Television, TV), desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PMP portable multimedia players
  • mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals)
  • fixed terminals such as digital televisions (Television, TV), desktop computers, and the like.
  • the electronic device shown in FIG. 8 is only an example, and should not limit the functions and scope of use of the embodiments of the present disclosure.
  • an electronic device 800 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) Various appropriate actions and processes are performed by programs loaded into random access memory (Random Access Memory, RAM) 803 by 808 . In the RAM 803, various programs and data necessary for the operation of the electronic device 800 are also stored.
  • the processing device 801, ROM 802, and RAM 803 are connected to each other through a bus 805.
  • An edit/output (Input/Output, I/O) interface 804 is also connected to the bus 805 .
  • an input device 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; including, for example, a liquid crystal display (Liquid Crystal Display, LCD) , an output device 807 such as a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809.
  • the communication means 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. While FIG. 8 shows electronic device 800 having various means, it is to be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
  • embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from a network via communication means 809 , or from storage means 808 , or from ROM 802 .
  • the processing device 801 the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.
  • the electronic device provided by the embodiments of the present disclosure and the method for displaying live images provided by the above embodiments belong to the same inventive concept.
  • this embodiment has the same features as the above embodiments. Same beneficial effect.
  • An embodiment of the present disclosure provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for displaying live images provided by the foregoing embodiments is implemented.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two.
  • a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof.
  • Examples of computer readable storage media may include, but are not limited to, electrical connections with one or more conductors, portable computer diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read-only Memory (Erasable Programmable Read-Only Memory, EPROM) or flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above .
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device .
  • the program code contained on the computer readable medium can be transmitted by any appropriate medium, including but not limited to: electric wire, optical cable, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
  • the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium
  • HTTP HyperText Transfer Protocol
  • the communication eg, communication network
  • Examples of communication networks include local area networks (Local Area Network, LAN), wide area networks (Wide Area Network, WAN), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently existing networks that are known or developed in the future.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device:
  • an image editing interface In response to the received live image editing request, displaying an image editing interface, wherein the image editing interface includes at least two video source windows for displaying live video sources;
  • the storage medium may be a non-transitory storage medium.
  • Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider such as AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block in the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by A combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of the unit does not constitute a limitation of the unit itself under certain circumstances, for example, the first obtaining unit may also be described as "a unit for obtaining at least two Internet Protocol addresses".
  • exemplary types of hardware logic components include: Field Programmable Gate Arrays (Field Programmable Gate Arrays, FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (Application Specific Standard Product, ASSP), System on Chip (System on Chip, SOC), Complex Programmable Logic Device (Complex Programmable Logic Device, CPLD) and so on.
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media examples include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM), ) or flash memory, optical fiber, compact disc read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory optical fiber
  • CD-ROM compact disc read only memory
  • magnetic storage device or any suitable combination of the foregoing.
  • Example 1 provides a method for displaying live images, the method including:
  • an image editing interface In response to the received live image editing request, displaying an image editing interface, wherein the image editing interface includes at least two video source windows for displaying live video sources;
  • Example 2 provides a method for displaying live images, and the method further includes:
  • the video fusion operation includes a picture foreground selection operation and a background selection operation, and the video source window
  • the window includes a foreground video source window and a background video source window;
  • a preview image of the fused live image corresponding to the foreground video source and the background video source is displayed in a preset fused display manner.
  • Example 3 provides a method for displaying live images, and the method further includes:
  • the foreground video source window and the background video source window are switched and displayed based on a switching trigger operation acting on a preset video source window switching control.
  • Example 4 provides a method for displaying live images, and the method further includes:
  • Example 5 provides a method for displaying live images, and the method further includes:
  • the display of the preview screen of the fusion live screen corresponding to the video fusion operation in a preset fusion display mode includes:
  • the preset fusion layout template corresponding to the fusion layout trigger operation display the preview image of the fusion live image, wherein the preset fusion layout template includes the maximum number of live video sources that allow fusion and the display of each live video source size and placement.
  • Example 6 provides a method for displaying live images, and the method further includes:
  • the receiving display adjustment operation of display information corresponding to at least one live video source in the fused live broadcast picture includes:
  • Example 7 provides a method for displaying live images, and the method further includes:
  • the receiving display adjustment operation of display information corresponding to at least one live video source in the fused live broadcast picture includes:
  • Example 8 provides a method for displaying a live video, the method further includes: acquiring a live video source, and displaying the live video source on a screen used to display the live video source in the Video Source window.
  • Example 9 provides a method for displaying live images, and the method further includes:
  • the live video source includes video data of the local camera, video data of an external camera, screen video data of an external device, network video data, pictures or video data in the target storage space of the machine, and pictures or video data in the target storage space of the cloud. At least one item of video data.
  • Example 10 provides a method for displaying live images, and the method further includes:
  • a video display operation input for the video source window is received, and a preview image of the live video source corresponding to the video source window is displayed.
  • Example 11 provides a method for displaying live images, and the method further includes:
  • a video combination operation input for at least two video source windows is received, and a preview image of a combined live image corresponding to the video combination operation is displayed in a preset combination presentation manner.
  • Example 12 provides a method for displaying live images, and the method further includes:
  • the display of the preview screen of the combined live screen corresponding to the video combination operation in a preset combination display mode includes:
  • the preview picture of the combined live picture is displayed.
  • Example 13 provides a method for displaying live images, and the method further includes:
  • the target live broadcast image includes a live video source, an integrated live image or a combined live image.
  • Example Fourteen provides an element display device, which includes:
  • the picture editing request module is configured to display a picture editing interface in response to the received live picture editing request, wherein the picture editing interface includes at least two video source windows for displaying live video sources;
  • the fusion picture preview module is configured to receive the video fusion operation input for at least two video source windows, and display the preview picture of the fusion live picture corresponding to the video fusion operation in a preset fusion display mode, wherein the fusion live picture
  • the foreground information and background information of the screen come from different live video sources.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开实施例公开了一种直播画面的展示方法、装置、电子设备及存储介质。其中，该方法包括：响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。

Description

直播画面的展示方法、装置、电子设备及存储介质
本申请要求在2022年02月28日提交中国专利局、申请号为202210188120.3的中国专利申请的优先权，以上申请的全部内容通过引用结合在本申请中。
技术领域
本公开实施例涉及图像处理技术领域，例如涉及一种直播画面的展示方法、装置、电子设备及存储介质。
背景技术
随着互联网的普及以及智能终端的飞速发展，越来越多的信息通过网络进行传播，且信息传播的形式也多种多样，例如，网络直播等。针对每一个网络直播间来说，在直播用户开展网络直播过程中，往往仅为观看用户展示用于开展网络直播的终端的摄像头所采集的画面，且不支持直播用户对直播画面进行编辑，使得直播画面的展示形式较为单一，无法满足直播用户的个性化需求，影响用户体验。
发明内容
本公开实施例提供了一种直播画面的展示方法、装置、电子设备及存储介质。
第一方面，本公开实施例提供了一种直播画面的展示方法，该方法包括：
响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
第二方面，本公开实施例还提供了一种直播画面的展示装置，该装置包括：
画面编辑请求模块，设置为响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
融合画面预览模块，设置为接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的 直播视频源。
第三方面，本公开实施例还提供了一种电子设备，该电子设备包括：
一个或多个处理器；
存储装置，设置为存储一个或多个程序，
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现本公开任意实施例所提供的一种直播画面的展示方法。
第四方面，本公开实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现本公开任意实施例所提供的一种直播画面的展示方法。
附图说明
下面对描述实施例中所需要用到的附图做一简单介绍。所介绍的附图只是本公开所要描述的一部分实施例的附图，而不是全部的附图，对于本领域普通技术人员，在不付出创造性劳动的前提下，还可以根据这些附图得到其他的附图。
图1为本公开实施例一所提供的一种直播画面的展示方法的流程示意图；
图2为本公开实施例二所提供的一种直播画面的展示方法的流程示意图；
图3为本公开实施例三所提供的一种直播画面的展示方法的流程示意图；
图4为本公开实施例四所提供的一种直播画面的展示方法的流程示意图；
图5为本公开实施例五所提供的一种直播画面的展示方法的流程示意图；
图6为本公开实施例提供的直播画面的展示方法的画面编辑界面的示意图
图7为本公开实施例六所提供的一种直播画面的展示装置的结构示意图；
图8为本公开实施例七所提供的一种电子设备的结构示意图。
具体实施方式
虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
实施例一
图1为本公开实施例一所提供的一种直播画面的展示方法的流程示意图，本实施例可应用于网络直播的应用场景，该方法可以由直播画面的展示装置来执行，该装置可以通过软件和/或硬件来实现，可配置于终端和/或服务器中来实现本公开实施例中的直播画面的展示方法。典型地，终端可以是智能手机，也可以是笔记本电脑或者平板电脑等任意具有网络直播功能的终端设备、或者能控制其他网络直播设备展示直播画面的终端设备，如，导播设备等。
如图1所示，本实施例的方法包括：
S110、响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口。
其中，直播画面编辑请求可以理解为用于启动提供对直播画面进行编辑这一功能的功能启用请求。画面编辑界面可以理解为提供对直播画面进行编辑这一功能的交互界面。所述画面编辑界面除了包括至少两个用于展示直播视频源的视频源窗口之外还可以包括用于对直播画面进行编辑的控件以及编辑后的直播画面的展示区域等。视频源窗口即为用于展示直播视频源的展示窗口。所述视频源窗口可以根据直播视频源的应用场景进行区分，比如，可根据所展示的直播视频源用于编辑直播画面的画面前景信息还是画面背景信息进行区分。示例性地，所述视频源窗口包括前景视频源窗口和背景视频源窗口。视频源窗口的数量和布局可以根据实际情况设置，在此并不做限定。示例性地，视频源窗口的数量和布局可以根据用于执行该直播画面的展示方法的终端显示屏幕的尺寸以及直播视频源的获取方式进行确定。
其中，至少两个可以理解为两个或两个以上。在本公开实施例中，画面编辑界面包括至少两个用于展示直播视频源的视频源窗口的好处在于，支持接入两个或两个以上的直播视频源，为基于多个视频源对直播画面进行编辑奠定了基础。
可以理解的是，为了成功实现两个或两个以上直播视频源的融合，直播画面的展示方法还可以包括：获取直播视频源，并将所述直播视频源展示于用于展示直播视频源的视频源窗口中。
示例性地，所述直播视频源可包括但不仅限于本机摄像头的视频数据、外接摄像头的视频数据、外接设备的屏幕视频数据、网络视频数据、本机目标存储空间中的图片或视频数据以及云端目标存储空间中的图片或视频数据中的至少一项。其中，本机可以理解为用于执行该直播画面的展示方法的设备。本机摄像头可以理解为本机自身携带的摄像头。
直播视频源的获取方式可以有多种。例如可以通过设置于本机机身上的通用串行总线接口接入摄像头视频数据、摄像机视频数据以及外机视频数据等；也可以通过局域网、广域网或蓝牙等无线传输方式获取外接摄像机视频数据、外接手机的屏幕视频数据和摄像头视频数据。
在一示例中，获取直播视频源可以包括下述方式中的至少一种：
获取本机自身携带的摄像头采集的视频数据，作为本机摄像头的视频数据；
获取外接摄像头接口传输的视频数据，作为外接摄像头的视频数据；
基于本机外接设备接口获取外接设备的屏幕视频数据；
基于在预设区域内输入的网址信息获取网络视频数据；
根据本机目标存储空间对应的本地存储路径获取本机目标存储空间中的图片或视频数据；
根据云端目标存储空间对应的云端存储路径获取云端目标存储空间中的图片或视频数据。
为了便于用户操作，在一示例中，分别为不同来源的直播视频源设置专用的视频源窗口。将一种来源作为一种视频类型，即，建立视频源窗口与直播视频源类型之间的对应关系，并为视频源窗口添加与所述视频源窗口对应的直播视频源的类型标识。这样设置的好处在于，便于用户能够区分不同类型的直播视频源。为了便于用户手动添加直播视频源，可以当接收到针对视频源窗口输入的视频源添加操作时，展示视频源添加引导信息。其中，视频源添加引导信息用于引导用户如何添加直播视频源，如，展示网址输入框，或者，展示建立 连接的二维码等。
在所述响应于接收到的直播画面编辑请求之前，还可以包括：接收直播画面编辑请求。在一示例中，直播画面编辑请求的生成方式有多种。示例性地，当接收到针对导播设备的启动操作时，确定为接收到直播画面编辑请求；或者，当接收到预先设置的用于发起直播画面编辑请求的语音信息时，确定为接收到直播画面编辑请求；又或者，当接收到针对预先设置的用于发起直播画面编辑请求的请求控件的请求触发操作时，确定为接收到直播画面编辑请求等。
需要说明的是，本公开实施例中的直播视频源可以理解为与直播相关联的视频，或者说，支持被用于直播画面中的视频，又或者说，支持被推流到直播间中的视频。直播视频源中的“直播”仅是为了说明是直播场景中涉及到的视频，而并非对视频内容及来源等信息的限定。
S120、接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
其中，视频融合操作可以理解为触发两个或两个以上直播视频源开始进行融合的操作。由于视频融合操作往往涉及对两个或两个以上直播视频源的选择以及融合，因此，视频融合操作可以是两种或两种以上的操作结合实现的。
示例性地，视频融合操作可以包括前景选择操作和背景选择操作。当前景选择操作和背景选择操作均操作完毕时，则确定为接收针对至少两个视频源窗口输入的视频融合操作。例如，当检测到接收针对视频源窗口的选中数量达到预设数量时，则确定为接收针对至少两个视频源窗口输入的视频融合操作。例如，当检测到针对前景视频源窗口的选中数量达到预设前景数量，且检测到针对背景视频源窗口的选中数量达到预设背景数量时，则确定为接收针对至少两个视频源窗口输入的视频融合操作。例如，视频融合操作可以包括前景选择操作和背景选择操作。
示例性地，视频融合操作可以包括针对预设视频融合控件的融合触发操作。其中，预设视频融合控件可以是设置于画面编辑界面上的虚拟元件，也可以是设置于用于执行该直播画面的展示方法的执行设备上的实体元件。其中，预设的视频融合控件的样式可以根据实际需求设置，在此并不做限定。可以是画面编辑界面上标识为“画面预览”的按钮。
相关直播画面的展示技术中，往往仅展示本机摄像头所采集到的信息，即，只展示一个直播视频源的视频信息，而很难在一个直播间中同时展示两个或两 个以上直播视频源的视频信息。即使通过连麦功能做联合直播，仍然存在，仅支持直播设备摄像头的画面直播，直播画面仍然是各自的直播画面，展示方式仍然相对单一。在本公开实施例中，能够响应于接收到的针对至少两个视频源窗口输入的视频融合操作，将不同直播视频源中的展示信息分为画面前景信息和画面背景信息进行了融合，丰富了直播画面的展示方式。
可以理解的是，直播视频源是由一系列的图像序列组成的。在对直播视频源进行融合处理时，可以针对直播视频源的各帧图像进行处理。因此，在所述展示与所述视频融合操作对应的融合直播画面之前，还可以包括：获取与所述视频融合操作对应的前景视频源和背景视频源，分别确定所述前景视频源的待处理前景图像和所述背景视频源的待处理背景图像，其中，所述待处理前景图像和所述待处理背景图像的时间信息相同；确定所述待处理前景图像的图像前景信息和所述待处理背景图像的图像背景信息，将所述图像前景信息作为融合直播画面的画面前景信息，将所述图像背景信息作为融合直播画面的画面背景信息，将所述画面前景信息与所述画面背景信息进行融合，得到与所述视频融合操作对应的融合直播画面。这样设置的好处在于，能够保证各个直播视频源之间在时间上的同步，贴合直播的实时性。
在一示例中，将各个视频源对应的时间戳对齐，当接收到针对至少两个视频源窗口输入的视频融合操作时，将前景视频源和背景视频源中处于同一时间信息的图像帧分别作为待处理前景图像和待处理背景图像，进而，通过抠图的方式，分别对待处理前景图像和待处理背景图像进行抠图处理，得到图像前景信息和图像背景信息，将图像前景信息和图像背景信息融合即得到了融合直播画面。
需要说明的是，与所述视频融合操作对应的融合直播画面，可以是与所述视频融合操作的时间相对应的一帧融合直播画面，也可以是，时间位于所述视频融合操作之后的很多帧融合直播画面。只要采用本公开实施例中的方法针对直播视频源中不同时间点的图像帧进行融合处理即可。
本实施例，通过响应于接收到的直播画面编辑请求，展示包括至少两个用于展示直播视频源的视频源窗口的画面编辑界面，提供了与用户之间的交互功能，响应用户的直播画面编辑诉求，为用户提供了画面编辑入口；然后，接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，且融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源，能够实现两个或两个以上视频源 窗口对应的直播视频源的融合，实现两个或两个以上直播视频源之间的联动，丰富视频的展示效果，增加直播的趣味性，避免了直播画面的展示形式单一且不支持编辑的状况，且能够使得用户能够直观地观察到融合直播画面的呈现效果，从而能够更好地满足用户的个性化需求，提升用户的直播体验。
实施例二
图2为本公开实施例二所提供的一种直播画面的展示方法的流程示意图，本实施例在本公开实施例中任一可选实施例的基础上，在一实施例中，所述视频融合操作包括画面前景选择操作和背景选择操作，所述视频源窗口包括前景视频源窗口和背景视频源窗口；所述接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，包括：接收针对至少一个前景视频源窗口的画面前景选择操作，将选中的前景视频源窗口中展示的直播视频源作为前景视频源；接收针对至少一个背景视频源窗口的画面背景选择操作，将选中背景视频源窗口中展示的直播视频源作为背景视频源；以预设融合展示方式展示与所述前景视频源和所述背景视频源对应的融合直播画面的预览画面。
其中，与上述实施例相同或者相应的技术术语在此不在赘述。
如图2所示，本实施例的方法可包括：
S210、响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口。
S220、接收针对至少一个前景视频源窗口的画面前景选择操作，将选中的前景视频源窗口中展示的直播视频源作为前景视频源。
其中，前景视频源窗口可以理解为用于展示的直播视频源可以被选为前景视频源的窗口。需要说明的是，直播视频源是否可以被选为前景视频源或者说哪些直播视频源可以被选为前景视频源，可以根据实际情况进行设置，在此并不做限定。例如，当视频源窗口中展示的直播视频源包含有第一目标对象，则将该视频源窗口作为前景视频源窗口。其中，第一目标对象可以是人物或动物等。还可以是，当视频源窗口中展示的直播视频源的视频来源为第一预设来源时，将该视频源窗口作为前景视频源窗口。其中，预设来源可以包括直播视频源的获取方式或者直播视频源的提供方等。示例性地，第一预设来源可以是用于进行直播的终端上的摄像头采集的视频，或者，用于展示融合直播画面的本机摄像头所采集的视频等。还可以是，当视频源窗口中展示的直播视频源为动态视频时，将该视频源窗口作为前景视频源窗口。
其中，画面前景选择操作可以包括用于选择或取消选择前景视频源窗口的操作。画面前景选择操作对应的结果可能是选中了某一个前景视频源窗口或者多个前景视频源窗口。可以理解的是，将选中的视频源窗口中展示的直播视频源作为用于进行融合的前景视频源。
S230、接收针对至少一个背景视频源窗口的画面背景选择操作，将选中背景视频源窗口中展示的直播视频源作为背景视频源。
可以理解的是，所述前景视频源窗口和所述背景视频源窗口中展示的直播视频源可以相同也可以不同。例如，，当视频源窗口中展示的直播视频源的视频为包含有第二目标对象的直播视频源时，将该视频源窗口作为背景视频源窗口。其中，第二目标对象可以是山、水、建筑物及花草树木等。还可以是，当视频源窗口中展示的直播视频源的视频来源为第二预设来源时，将该视频源窗口作为背景视频源窗口。其中，预设来源可以包括直播视频源的获取方式或者直播视频源的提供方等。还可以是，当视频源窗口中展示的直播视频源为静态图片时，将该视频源窗口作为背景视频源窗口。其中，区分直播视频源为静态图片或动态视频的方式可以是通过比较预设时间点对应的图像帧中的展示内容的差异性确定。
其中，画面背景选择操作可以包括用于选择或取消选择背景视频源窗口的操作。画面背景选择操作对应的结果可能是选中了某一个背景视频源窗口或者多个背景视频源窗口。可以理解的是，将选中的视频源窗口中展示的直播视频源作为用于进行融合的背景视频源。
S240、以预设融合展示方式展示与所述前景视频源和所述背景视频源对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
可以理解的是，融合直播画面的画面前景信息来源于前景视频源，融合直播画面的画面背景信息来源于背景视频源。
在一实施例中，所述前景视频源窗口和所述背景视频源窗口基于作用于预设的视频源窗口切换控件的切换触发操作进行切换展示。其中，视频源窗口切换控件可以是一个也可以是两个。换言之，所述前景视频源窗口和所述背景视频源窗口对应的预设的视频源窗口切换控件可以是同一个控件，也可以是不同的控件。示例性地，视频源窗口切换控件可以包括前景视频源展示控件和背景视频源展示控件。其中，前景视频源展示控件可以是默认的视频源展示控件，背景视频源展示控件可以是抠图背景控件。在本公开实施例中，并不对视频源 窗口切换控件的展示形式进行限定，只要能够用于实现所述前景视频源窗口和所述背景视频源窗口的切换展示即可。
本实施例，通过根据接收到的针对至少一个前景视频源窗口的画面前景选择操作选择前景视频源，并根据接收到的针对至少一个背景视频源窗口的画面背景选择操作选择背景视频源，能够自主选择融合直播画面的画面前景信息和画面背景信息，能够准确地获取直播画面的编辑诉求，从而保证能够准确响应于用户需求，实现了直播画面的有针对性地融合，提升了用户体验。
实施例三
图3为本公开实施例三所提供的一种直播画面的展示方法的流程示意图，本实施例在本公开实施例中任一可选实施例案的基础上，在一实施例中，所述方法还包括：接收作用于预设融合布局控件的融合布局触发操作；所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，包括：根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面，其中，所述预设融合布局模板包括允许融合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置。
其中，与上述实施例相同或者相应的技术术语在此不在赘述。
如图3所示，本实施例的方法可包括：
S310、响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口。
S320、接收作用于预设融合布局控件的融合布局触发操作。
其中，所述预设融合布局控件可以理解为触发后用于确定融合后的直播画面的布局的控制元件。预设融合布局控件一般为设置于画面编辑界面中的虚拟元件。预设融合布局控件的展示形式可以有多种，如文字、图形或图文结合等形式。示例性地，预设融合布局控件可以以融合后的直播画面的布局样例缩略图作为控件标识来展示。这样设置的好处在于，能够便于用户根据标识快速选择所需的预设融合布局控件，操作方便，提升交互效率。
其中，融合布局触发操作可以理解为以预设触发方式作用于预设融合布局控件上后，能够触发预设融合布局控件来确定融合后的直播画面的布局的操作。例如，作用于预设融合布局控件的方式可以包括但不仅限于单击、双击、长按、短按或滑动等操作。
在一示例中，在接收作用于预设融合布局控件的融合布局触发操作之后，还包括：将所述融合布局触发操作对应的预设融合布局模板展示于画面编辑界 面中用于展示融合直播画面的预览画面的展示区域中。以便用户查看画面布局效果。
S330、接收针对至少两个视频源窗口输入的视频融合操作。
在一示例中，接收针对至少两个视频源窗口输入的视频融合操作，可以是，接收将直播视频源添加至预设融合布局模板中的视频源添加操作。例如，可以通过拖拽直播视频源的方式将直播视频源添加至预设融合布局模板中，也可以通过作用于视频源窗口中的添加指示控件的方式将直播视频源添加至预设融合布局模板中。其中，添加指示控件可以是用于指示将直播视频源添加至预设融合布局模板中哪个区域的控件。还可以是，通过将新的直播视频源拖入预设融合布局模板中已存在直播视频源的位置的方式，将已存在的直播视频源更换为新的直播视频源。
在一示例中，当需要删除预设融合布局模板中的直播视频源时，可以通过将直播视频源拖出预设融合布局模板的方式，将该直播视频源从预设融合布局模板中删除。
在一示例中，还可以对直播视频源进行翻转，如，将直播视频源进行镜像变换；或者，作用于视频源窗口中的删除指示控件，将视频源窗口中直播视频源的展示信息进行删除，不再展示。
S340、根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面。
其中，所述预设融合布局模板包括允许融合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置。预设融合布局模板可以理解为预先设置的用于进行视频源融合的各个直播视频源在融合直播画面中的展示尺寸和展示位置的模板或样例。可以理解的是，预设融合布局模板的数量可以是一个也可以是多个。预设融合布局模板的样式可以根据实际需求进行设置，在此并不做限定。示例性地，可以根据待融合的直播视频源的最大数量分别设置不同的预设融合布局控件。在一示例中，还可以针对某个待融合的直播视频源的数量，根据各个视频源的展示尺寸和展示位置分别设置不同的预设融合布局模板。
需要说明的是，预设融合布局模板与预设融合布局控件之间对的对应关系可以是一对一的对应关系，也可以是多对一的对应关系。当一个预设融合布局控件对应多个预设融合布局模板时，可以通过作用于该预设融合布局控件的融合布局触发操作切换该预设融合布局控件对应的预设融合布局模板。
本实施例，能够接收作用于预设融合布局控件的融合布局触发操作，为用 户提供了融合布局的选择功能，根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面，能够响应于融合布局触发操作，基于选择的预设融合布局模板来展示融合直播画面，供用户预览，一键式布局功能，操作简单方便，而且所述预设融合布局模板包括允许融合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置，使得用户能够对融合直播画面的布局一目了然，从而提升用户体验。
实施例四
图4为本公开实施例四所提供的直播画面的展示方法的流程示意图，本实施例在本公开实施例中任一可选实施例的基础上，在一实施例中，在所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面之后，还包括：接收对所述融合直播画面或所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，对所述展示信息进行调整，并展示调整后的融合直播画面的预览画面。
其中，与上述实施例相同或者相应的技术术语在此不在赘述。
如图4所示，本实施例的方法可包括：
S410、响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口。
S420、接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
S430、接收对所述融合直播画面或所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作。
在公开实施例中，在所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面之后，可以对融合直播画面的展示信息进行调整，也可以对所述融合直播画面中至少一个直播视频源对应的展示信息进行调整。其中，展示调整操作可以理解为用于对融合直播画面中的全部展示信息或部分展示信息进行调整的操作。需要说明的是，展示信息可以理解为面向用户的信息，一般为视觉层面或者听觉层面可以感知的信息。示例性地，展示信息可以包括但不仅限于展示位置、展示尺寸、展示色彩、展示风格以及展示内容等信息中的至少一项。其中，展示内容可包括直播视频源中的视频源图像信息以及视频源声音信息。
可以理解的是，至少一个直播视频源可以是一个直播视频源、两个直播视 频源或两个以上直播视频源。
在一示例中，所述接收对所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，包括：接收对所述融合直播画面中至少一个直播视频源对应的展示信息的画面布局调整操作；和/或，接收对所述融合直播画面中至少一个直播视频源输入的画面美化调整操作。
其中，画面布局调整操作可以理解为针对那个直播画面中的各个直播视频源在融合直播画面中的相关布局信息的调整操作。示例性地，画面布局调整操作可以包括但不仅限于对各个直播视频源在融合直播画面中的展示位置和/或展示尺寸的调整操作、增加或减少直播视频源的操作以及增加或减少预设画面道具的操作等中至少一项。可以理解的是，画面布局调整操作的生成方式可以有多种。示例性地，可以是通过拖拽的方式调整直播视频源在融合直播画面中的展示位置和/或展示尺寸，也可以通过输入设备右键触发后选择相应控件来增加或减少直播视频源的操作等。
示例性地，还可以通过触发画面编辑界面中的预设的画面布局调整控件来对所述融合直播画面中至少一个直播视频源对应的展示信息进行调整。其中，画面布局调整控件的设置位置和展示形式可以根据实际需求确定，在此不做限定。画面布局调整控件可以是设置于显示界面上的虚拟控件。画面布局调整控件的默认展示形态可以是显示状态也可以隐藏状态，换言之，画面布局调整控件的透明度可以根据是否被触发来确定。例如，当于画面布局调整控件对应的预设触发区域中检测到目标触发操作时，显示所述画面布局调整控件。进而，可以接收所述画面布局调整控件的触发操作。其中，目标触发操作可以是光标点击预设触发区域，或者，光标在预设触发区域中的悬停操作等。
其中，画面美化调整操作可以理解为用于调整融合直播画面中的相关色彩信息的操作。需要说明的是，画面美化调整操作可以是作用于预设美化调整控件的操作。其中，预设美化调整控件可以是针对画面的不同展示角度的调整。例如，将直播视频源的湖面风格展示为预设风格、对直播视频源的展示画面中的目标对象进行美颜处理和/或美妆处理、对直播视频源的展示画面添加预设滤镜以及增加或减少预设画面道具等操作中至少一项。类似地，画面美化调整操作也通过预设的画面美化调整控件输入。需要说明的是，画面美化调整控件的数量可以是一个也可以是多个。换言之，单个画面美化调整控件可以只支持一种画面美化调整方式，也可以支持多种画面色调整方式。当单个画面美化调整控件支持多种画面色调整方式时，可以通过点击或者按压画面美化调整控件的 方式来切换不同的画面美化调整方式。
在一示例中，接收对所述融合直播画面对应的展示信息的展示调整操作，包括：接收对所述融合直播画面的画面美化调整操作。其调整方式可以与针对直播视频源的画面美化调整方式相同，在此不再赘述。
S440、对所述展示信息进行调整，并展示调整后的融合直播画面的预览画面。
可以理解的是，对所述展示信息进行调整包括对融合直播画面中所有直播视频源的展示信息的调整，或者，对融合直播画面中的部分直播视频源的展示信息的调整。调整方式与展示调整操作相关。例如，当接收对所述融合直播画面的展示信息的展示调整操作时，对所述融合直播画面中所有直播视频源的展示信息进行调整；当接收对所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作时，对所述融合直播画面中所述展示调整操作作用的直播视频源的展示信息进行调整。
本实施例，在得到融合直播画面之后，支持对融合直播画面中的部分展示信息或全部展示信息进行调整，响应于用户的调整操作，来调整融合直播画面，并展示调整后的融合直播画面的预览画面，通过与用户的交互，充分满足用户的个性化需求，从而保证直播画面的最终展示效果。
实施例五
图5为本公开实施例五所提供的一种直播画面的展示方法的流程示意图，本实施例在本公开实施例中任一可选实施例的基础上，针对多个直播视频源的情况，提供了另外一种直播画面的展示方式，即，将两个或两个以上的直播视频源进行组合展示。在一实施例中，所述方法还包括：接收针对至少两个视频源窗口输入的视频组合操作，以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面。
其中，与上述实施例相同或者相应的技术术语在此不在赘述。
如图5所示，本实施例的方法可包括：
S510、响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口。
S520、接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
S530、接收针对至少两个视频源窗口输入的视频组合操作，以预设组合展 示方式展示与所述视频组合操作对应的组合直播画面的预览画面。
类似地，本公开实施例的直播画面的展示方法还可以包括：接收作用于预设组合布局控件的组合布局触发操作；进而，根据所述组合布局触发操作对应的预设组合布局模板展示所述组合直播画面的预览画面。
其中，预设组合布局模板包括允许组合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置。预设组合布局模板可以理解为预先设置的用于进行视频源组合的各个直播视频源在组合直播画面中的展示尺寸和展示位置的模板或样例。可以理解的是，预设组合布局模板的数量可以是一个也可以是多个。预设组合布局模板的样式可以根据实际需求进行设置，在此并不做限定。示例性地，可以根据组合的直播视频源的最大数量分别设置不同的预设组合布局控件。例如，还可以针对某个待组合的直播视频源的数量，根据各个视频源的展示尺寸和展示位置分别设置不同的预设组合布局模板。
需要说明的是，预设组合布局模板与预设组合布局控件之间对的对应关系可以是一对一的对应关系，也可以是多对一的对应关系。当一个预设组合布局控件对应多个预设组合布局模板时，可以通过作用于该预设组合布局控件的组合布局触发操作切换该预设组合布局控件对应的预设组合布局模板。
本实施例，不仅支持两个或两个以上直播视频源进行融合，还能够支持两个或两个以上直播视频源进行组合，进一步丰富了直播画面的展示方式，尤其在需要对多个视频源进行展示的情况下，能够提供不同的视频源处理方式，从而更好地满足用户的个性化需求，进一步提升用户体验。
在本公开任一可选实施例的基础上，所述直播画面的展示方法还可以包括：将目标直播画面推流至目标直播间，其中，所述目标直播画面包括直播视频源、融合直播画面或组合直播画面。
为了能够使得观看用户看到编辑后的直播画面，在得到目标直播画面之后，可以将目标直播画面推流至目标直播间。例如，可以接收作用于预设推流控件的推流触发操作，展示推流地址录入框；获取基于所述推流地址录入框录入的目标推流地址，将所述目标直播画面推流至与所述目标推流地址对应的目标直播间。可以理解的是，不同的直播用户对直播画面的诉求不同，因此，目标直播画面可以根据实际情况确定，可以是至少一个视频源中的其中一个直播视频源，也可以由两个或两个以上的直播视视频源进行融合后得到的融合直播画面或由两个或两个以上的直播视视频源进行组合后得到的组合直播画面等。
这样设置的好处在于，能够同步直播用户与观看用户之间的画面，将目标 直播画面展示给目标直播间的观看用户，在丰富直播画面的同时，更好地实现直播用户与观看用户的实时互动。
图6为本公开实施例提供的直播画面的展示方法中的画面编辑界面的示意图。以得到组合直播画面的场景为例进行介绍，如图6所示，画面编辑界面中可以包括用于展示直播画面的预览画面的画面预览区域(如图6中左上方的大矩形框)、用于展示直播视频源的视频源窗口(如右侧位于右侧的5个小矩形框)以及用于对直播画面进行编辑的画面编辑控件。其中，画面编辑控件可以包括前景视频源展示控件(如图6中的“视频源”控件)、背景视频源展示控件(如图6中的“抠图背景”控件)、预设推流控件(如图6中的“推流”控件)、预设组合布局控件(如左侧大矩形框下面一行展示的写有数字“1”和“12”两个的小矩形框)以及预设美化调整控件(如图6中“美颜”“美妆”“过滤”和“贴纸”)。
在本实施例中，视频源控件对应的视频源窗口中展示有前景视频源，且每个视频源窗口均有标识该视频源窗口中所展示的直播视频源的来源。选中其中1个直播视频源时，可以将选中的直播视频源展示于左侧的画面预览区域中。如果预设组合布局控件选择“12”，即两张图片组合，则在画面预览区域中通过该预设组合布局模板展示选中的直播视频源。当需要在预设组合布局模板中添加直播视频源时，可以点击该预设组合布局模板的对应子展示区域添加，也可以是通过点击视频源窗口中右下角处的添加指示控件区域1或区域2在预设组合布局模板的对应子展示区域中添加。还可以通过拖拽直播视频源的方式添加或删除直播视频源。当需要在预设组合布局模板中添加直播视频源时，可以是通过点击视频源窗口中右下角处的“删除”，将视频源窗口中直播视频源的展示信息进行删除，不再展示。
其中，每一个预设美化调整控件都可以对应一个或多个预设美化调整模板，以供用户选择。预设美化调整模板可以仅用于对预设组合布局模板中的部分子展示区域中的直播视频源进行调整，如，只调整本机摄像头对应的直播视频源。也可以对预设组合布局模板中的所有的直播视频源进行调整。
点击背景抠图，可以在当前展示前景视频源窗口的区域，切换展示背景视频源窗口，背景视频源窗口用于展示背景视频源。在选择了前景视频源的前提下，通过选择背景视频源可以得到融合直播画面。可以理解的是，也可以先选择背景视频源再选择前景视频源，来得到融合直播画面。
点击推流，会展示用于输入推流地址的推流地址录入框，将目标直播间的 目标推流地址录入推流地址录入框中，点击“开始推流”，即可将画面预览区域的直播画面推流至目标直播间。需要说明的是，推流地址录入框可以有多个，也就是说，在录入多个推流地址的情况下，可以将同一个直播画面推流至不同的直播间。在一示例中，还设置有“结束推流”控件，点击该控件可以结束画面预览区域的直播画面在直播间的展示。
采用本公开实施例中提供的直播画面的展示方法，在满足用户对直播画面的个性化展示需求的同时，尽可能地节省了用户的交互成本，丰富了展示效果，提升了用户体验。
实施例六
图7为本公开实施例六所提供的一种直播画面的展示装置的结构示意图，本实施例所提供的直播画面的展示装置可以通过软件和/或硬件来实现，可配置于终端和/或服务器中来实现本公开实施例中的直播画面的展示方法。该装置可包括：画面编辑请求模块710和融合画面预览模块720。
其中，画面编辑请求模块710，设置为响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；融合画面预览模块720，设置为接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
本实施例，通过画面编辑请求模块响应于接收到的直播画面编辑请求，展示包括至少两个用于展示直播视频源的视频源窗口的画面编辑界面，提供了与用户之间的交互功能，响应用户的直播画面编辑诉求，为用户提供了画面编辑入口；然后，通过融合画面预览模块接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，且融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源，能够实现两个或两个以上视频源窗口对应的直播视频源的融合，实现两个或两个以上直播视频源之间的联动，丰富视频的展示效果，增加直播的趣味性，避免了直播画面的展示形式单一且不支持编辑的状况，且能够使得用户能够直观地观察到融合直播画面的呈现效果，从而能够更好地满足用户的个性化需求，提升用户的直播体验。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述视频融合操作包括画面前景选择操作和背景选择操作，所述视频源窗口包括前景视频 源窗口和背景视频源窗口；所述融合画面预览模块包括：前景选择单元、背景选择单元和画面预览单元。
其中，前景选择单元，设置为接收针对至少一个前景视频源窗口的画面前景选择操作，将选中的前景视频源窗口中展示的直播视频源作为前景视频源；背景选择单元，设置为接收针对至少一个背景视频源窗口的画面背景选择操作，将选中背景视频源窗口中展示的直播视频源作为背景视频源；画面预览单元，设置为以预设融合展示方式展示与所述前景视频源和所述背景视频源对应的融合直播画面的预览画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述前景视频源窗口和所述背景视频源窗口基于作用于预设的视频源窗口切换控件的切换触发操作进行切换展示。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
视频源获取模块，设置为在所述展示与所述视频融合操作对应的融合直播画面之前，获取与所述视频融合操作对应的前景视频源和背景视频源，分别确定所述前景视频源的待处理前景图像和所述背景视频源的待处理背景图像，其中，所述待处理前景图像和所述待处理背景图像的时间信息相同；
图像融合模块，设置为确定所述待处理前景图像的图像前景信息和所述待处理背景图像的图像背景信息，将所述图像前景信息作为融合直播画面的画面前景信息，将所述图像背景信息作为融合直播画面的画面背景信息，将所述画面前景信息与所述画面背景信息进行融合，得到与所述视频融合操作对应的融合直播画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：融合布局触发模块，其中，所述融合布局触发模块设置为接收作用于预设融合布局控件的融合布局触发操作；相应地，所述融合画面预览模块还设置为：根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面，其中，所述预设融合布局模板包括允许融合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
画面展示调整模块，设置为在所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面之后，接收对所述融合直播画面或所述 融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，对所述展示信息进行调整，并展示调整后的融合直播画面的预览画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述画面展示调整模块设置为：
接收对所述融合直播画面中至少一个直播视频源对应的展示信息的画面布局调整操作；和/或，
接收对所述融合直播画面中至少一个直播视频源输入的画面美化调整操作。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
视频源获取模块，设置为获取直播视频源，并将所述直播视频源展示于用于展示直播视频源的视频源窗口中。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述直播视频源包括本机摄像头的视频数据、外接摄像头的视频数据、外接设备的屏幕视频数据、网络视频数据、本机目标存储空间中的图片或视频数据以及云端目标存储空间中的图片或视频数据中的至少一项。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
视频源画面预览模块，设置为接收针对视频源窗口输入的视频展示操作，展示与所述视频源窗口对应的直播视频源的预览画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
组合画面预览模块，设置为接收针对至少两个视频源窗口输入的视频组合操作，以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：组合布局触发模块。其中，所述组合布局触发模块，设置为接收作用于预设组合布局控件的组合布局触发操作；相应地，所述组合画面预览模块，设置为根据所述组合布局触发操作对应的预设组合布局模板展示所述组合直播画面的预览画面。
在本公开实施例中任一可选实施例的基础上，在一实施例中，所述装置还包括：
视频推流模块，设置为将目标直播画面推流至目标直播间，其中，所述目标直播画面包括直播视频源、融合直播画面或组合直播画面。
上述直播画面的展示装置可执行本公开任意实施例所提供的直播画面的展示方法，具备执行直播画面的展示方法相应的功能模块和有益效果。
值得注意的是，上述装置所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本公开实施例的保护范围。
实施例七
图8为本公开实施例七所提供的一种电子设备的结构示意图。下面参考图8，其示出了适于用来实现本公开实施例的电子设备(例如图8中的终端设备或服务器)800的结构示意图。本公开实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、个人数字助理(Personal Digital Assistant，PDA)、平板电脑(PAD)、便携式多媒体播放器(Portable Media Player，PMP)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字电视(Television，TV)、台式计算机等等的固定终端。图8示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图8所示，电子设备800可以包括处理装置(例如中央处理器、图形处理器等)801，其可以根据存储在只读存储器(Read-Only Memory，ROM)802中的程序或者从存储装置808加载到随机访问存储器(Random Access Memory，RAM)803中的程序而执行各种适当的动作和处理。在RAM 803中，还存储有电子设备800操作所需的各种程序和数据。处理装置801、ROM 802以及RAM803通过总线805彼此相连。编辑/输出(Input/Output，I/O)接口804也连接至总线805。
通常，以下装置可以连接至I/O接口804：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置806；包括例如液晶显示器(Liquid Crystal Display，LCD)、扬声器、振动器等的输出装置807；包括例如磁带、硬盘等的存储装置808；以及通信装置809。通信装置809可以允许电子设备800与其他设备进行无线或有线通信以交换数据。虽然图8示出了具有各种装置的电子设备800，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为 计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置809从网络上被下载和安装，或者从存储装置808被安装，或者从ROM 802被安装。在该计算机程序被处理装置801执行时，执行本公开实施例的方法中限定的上述功能。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
本公开实施例提供的电子设备与上述实施例提供的直播画面的展示方法属于同一发明构思，未在本实施例中详尽描述的技术细节可参见上述实施例，并且本实施例与上述实施例具有相同的有益效果。
实施例八
本公开实施例提供了一种计算机存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述实施例所提供的直播画面的展示方法。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(Erasable Programmable Read-Only Memory，EPROM)或闪存、光纤、便携式紧凑磁盘只读存储器(Compact Disc Read-Only Memory，CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、射频(Radio Frequency，RF)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(Local Area Network，LAN)，广域网(Wide Area Network，WAN)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备：
响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
存储介质可以是非暂态(non-transitory)存储介质。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的 是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定，例如，第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(Field Programmable Gate Array，FPGA)、专用集成电路(Application Specific Integrated Circuit，ASIC)、专用标准产品(Application Specific Standard Product，ASSP)、片上系统(System on Chip，SOC)、复杂可编程逻辑设备(Complex Programmable Logic Device，CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)或快闪存储器、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的一个或多个实施例，【示例一】提供了一种直播画面的展示方法，该方法包括：
响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
根据本公开的一个或多个实施例，【示例二】提供了一种直播画面的展示方法，该方法，还包括：
所述视频融合操作包括画面前景选择操作和背景选择操作，所述视频源窗 口包括前景视频源窗口和背景视频源窗口；
所述接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，包括：
接收针对至少一个前景视频源窗口的画面前景选择操作，将选中的前景视频源窗口中展示的直播视频源作为前景视频源；
接收针对至少一个背景视频源窗口的画面背景选择操作，将选中背景视频源窗口中展示的直播视频源作为背景视频源；
以预设融合展示方式展示与所述前景视频源和所述背景视频源对应的融合直播画面的预览画面。
根据本公开的一个或多个实施例，【示例三】提供了一种直播画面的展示方法，该方法，还包括：
所述前景视频源窗口和所述背景视频源窗口基于作用于预设的视频源窗口切换控件的切换触发操作进行切换展示。
根据本公开的一个或多个实施例，【示例四】提供了一种直播画面的展示方法，该方法，还包括：
获取与所述视频融合操作对应的前景视频源和背景视频源，分别确定所述前景视频源的待处理前景图像和所述背景视频源的待处理背景图像，其中，所述待处理前景图像和所述待处理背景图像的时间信息相同；
确定所述待处理前景图像的图像前景信息和所述待处理背景图像的图像背景信息，将所述图像前景信息作为融合直播画面的画面前景信息，将所述图像背景信息作为融合直播画面的画面背景信息，将所述画面前景信息与所述画面背景信息进行融合，得到与所述视频融合操作对应的融合直播画面。
根据本公开的一个或多个实施例，【示例五】提供了一种直播画面的展示方法，该方法，还包括：
接收作用于预设融合布局控件的融合布局触发操作；
所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，包括：
根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面，其中，所述预设融合布局模板包括允许融合的直播视频源的最大数量以及各个直播视频源的展示尺寸和展示位置。
根据本公开的一个或多个实施例，【示例六】提供了一种直播画面的展示方法，该方法，还包括：
所述接收对所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，包括：
接收对所述融合直播画面中至少一个直播视频源对应的展示信息的画面布局调整操作；和/或，
接收对所述融合直播画面中至少一个直播视频源输入的画面美化调整操作
根据本公开的一个或多个实施例，【示例七】提供了一种直播画面的展示方法，该方法，还包括：
所述接收对所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，包括：
接收对所述融合直播画面中至少一个直播视频源对应的展示信息的画面布局调整操作；和/或，
接收对所述融合直播画面中至少一个直播视频源输入的画面美化调整操作。
根据本公开的一个或多个实施例，【示例八】提供了一种直播画面的展示方法，该方法，还包括：获取直播视频源，并将所述直播视频源展示于用于展示直播视频源的视频源窗口中。
根据本公开的一个或多个实施例，【示例九】提供了一种直播画面的展示方法，该方法，还包括：
所述直播视频源包括本机摄像头的视频数据、外接摄像头的视频数据、外接设备的屏幕视频数据、网络视频数据、本机目标存储空间中的图片或视频数据以及云端目标存储空间中的图片或视频数据中的至少一项。
根据本公开的一个或多个实施例，【示例十】提供了一种直播画面的展示方法，该方法，还包括：
接收针对视频源窗口输入的视频展示操作，展示与所述视频源窗口对应的直播视频源的预览画面。
根据本公开的一个或多个实施例，【示例十一】提供了一种直播画面的展示方法，该方法，还包括：
接收针对至少两个视频源窗口输入的视频组合操作，以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面。
根据本公开的一个或多个实施例，【示例十二】提供了一种直播画面的展示方法，该方法，还包括：
接收作用于预设组合布局控件的组合布局触发操作；
所述以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面，包括：
根据所述组合布局触发操作对应的预设组合布局模板展示所述组合直播画面的预览画面。
根据本公开的一个或多个实施例，【示例十三】提供了一种直播画面的展示方法，该方法，还包括：
将目标直播画面推流至目标直播间，其中，所述目标直播画面包括直播视频源、融合直播画面或组合直播画面。
根据本公开的一个或多个实施例，【示例十四】提供了一种元素展示装置，该装置，包括：
画面编辑请求模块，设置为响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
融合画面预览模块，设置为接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的实施例，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它实施例。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的实施例。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了如果干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (16)

  1. 一种直播画面的展示方法，包括：
    响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
    接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
  2. 根据权利要求1所述的方法，其中，所述视频融合操作包括画面前景选择操作和背景选择操作，所述至少两个视频源窗口包括前景视频源窗口和背景视频源窗口；
    所述接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，包括：
    接收针对至少一个前景视频源窗口的画面前景选择操作，将选中的前景视频源窗口中展示的直播视频源作为前景视频源；
    接收针对至少一个背景视频源窗口的画面背景选择操作，将选中背景视频源窗口中展示的直播视频源作为背景视频源；
    以预设融合展示方式展示与所述前景视频源和所述背景视频源对应的融合直播画面的预览画面。
  3. 根据权利要求2所述的方法，其中，所述前景视频源窗口和所述背景视频源窗口基于作用于预设的视频源窗口切换控件的切换触发操作进行切换展示。
  4. 根据权利要求1所述的方法，在所述展示与所述视频融合操作对应的融合直播画面之前，还包括：
    获取与所述视频融合操作对应的前景视频源和背景视频源，分别确定所述前景视频源的待处理前景图像和所述背景视频源的待处理背景图像，其中，所述待处理前景图像和所述待处理背景图像的时间信息相同；
    确定所述待处理前景图像的图像前景信息和所述待处理背景图像的图像背景信息，将所述图像前景信息作为融合直播画面的画面前景信息，将所述图像背景信息作为融合直播画面的画面背景信息，将所述画面前景信息与所述画面背景信息进行融合，得到与所述视频融合操作对应的融合直播画面。
  5. 根据权利要求1所述的方法，还包括：
    接收作用于预设融合布局控件的融合布局触发操作；
    所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的 预览画面，包括：
    根据所述融合布局触发操作对应的预设融合布局模板展示所述融合直播画面的预览画面，其中，所述预设融合布局模板包括允许融合的直播视频源的最大数量以及直播视频源的展示尺寸和展示位置。
  6. 根据权利要求1所述的方法，在所述以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面之后，还包括：
    接收对所述融合直播画面或所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，对所述展示信息进行调整，并展示调整后的融合直播画面的预览画面。
  7. 根据权利要求6所述的方法，其中，所述接收对所述融合直播画面中至少一个直播视频源对应的展示信息的展示调整操作，包括以下中的至少一个：
    接收对所述融合直播画面中至少一个直播视频源对应的展示信息的画面布局调整操作；或，
    接收对所述融合直播画面中至少一个直播视频源输入的画面美化调整操作。
  8. 根据权利要求1所述的方法，还包括：
    获取直播视频源，并将所述直播视频源展示于用于展示直播视频源的视频源窗口中。
  9. 根据权利要求8所述的方法，其中，所述直播视频源包括本机摄像头的视频数据、外接摄像头的视频数据、外接设备的屏幕视频数据、网络视频数据、本机目标存储空间中的图片或视频数据以及云端目标存储空间中的图片或视频数据中的至少一项。
  10. 根据权利要求1所述的方法，还包括：
    接收针对视频源窗口输入的视频展示操作，展示与所述视频源窗口对应的直播视频源的预览画面。
  11. 根据权利要求1所述的方法，还包括：
    接收针对至少两个视频源窗口输入的视频组合操作，以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面。
  12. 根据权利要求11所述的方法，还包括：
    接收作用于预设组合布局控件的组合布局触发操作；
    所述以预设组合展示方式展示与所述视频组合操作对应的组合直播画面的预览画面，包括：
    根据所述组合布局触发操作对应的预设组合布局模板展示所述组合直播画面的预览画面。
  13. 根据权利要求1、6或7中任一项所述的方法，还包括：
    将目标直播画面推流至目标直播间，其中，所述目标直播画面包括直播视频源、融合直播画面或组合直播画面。
  14. 一种直播画面的展示装置，包括：
    画面编辑请求模块，设置为响应于接收到的直播画面编辑请求，展示画面编辑界面，其中，所述画面编辑界面包括至少两个用于展示直播视频源的视频源窗口；
    融合画面预览模块，设置为接收针对至少两个视频源窗口输入的视频融合操作，以预设融合展示方式展示与所述视频融合操作对应的融合直播画面的预览画面，其中，所述融合直播画面的画面前景信息和画面背景信息源于不同的直播视频源。
  15. 一种电子设备，包括：
    一个或多个处理器；
    存储装置，设置为存储一个或多个程序，
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-13中任一所述的直播画面的展示方法。
  16. 一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1-13中任一所述的直播画面的展示方法。
PCT/CN2023/077603 2022-02-28 2023-02-22 直播画面的展示方法、装置、电子设备及存储介质 WO2023160573A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210188120.3 2022-02-28
CN202210188120.3A CN114584797A (zh) 2022-02-28 2022-02-28 直播画面的展示方法、装置、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2023160573A1 true WO2023160573A1 (zh) 2023-08-31

Family

ID=81776087

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/077603 WO2023160573A1 (zh) 2022-02-28 2023-02-22 直播画面的展示方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN114584797A (zh)
WO (1) WO2023160573A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114584797A (zh) * 2022-02-28 2022-06-03 北京字节跳动网络技术有限公司 直播画面的展示方法、装置、电子设备及存储介质
CN115174983A (zh) * 2022-07-01 2022-10-11 北京达佳互联信息技术有限公司 直播处理方法、装置、电子设备和存储介质
CN115515006B (zh) * 2022-08-19 2023-10-17 北京达佳互联信息技术有限公司 视频处理方法、装置、电子设备及存储介质
CN115830224A (zh) * 2022-11-15 2023-03-21 北京字跳网络技术有限公司 多媒体数据的编辑方法、装置、电子设备及存储介质
CN116069221A (zh) * 2022-12-27 2023-05-05 北京字跳网络技术有限公司 媒体内容的展示方法、装置、电子设备和存储介质
CN117729340A (zh) * 2023-03-27 2024-03-19 书行科技(北京)有限公司 直播画面的显示方法、装置、电子设备和可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160057363A1 (en) * 2014-08-25 2016-02-25 John G. Posa Portable electronic devices with integrated image/video compositing
CN111432235A (zh) * 2020-04-01 2020-07-17 网易（杭州）网络有限公司 直播视频生成方法、装置、计算机可读介质及电子设备
CN113873272A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种控制直播视频的背景图像的方法、装置及存储介质
CN113873311A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种直播控制方法、装置及存储介质
CN113873273A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种生成直播视频的方法、装置以及存储介质
CN113989173A (zh) * 2021-10-25 2022-01-28 北京字节跳动网络技术有限公司 视频融合方法、装置、电子设备及存储介质
CN114584797A (zh) * 2022-02-28 2022-06-03 北京字节跳动网络技术有限公司 直播画面的展示方法、装置、电子设备及存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3068401A1 (en) * 2017-06-27 2019-01-03 Pixellot Ltd. Method and system for fusing user specific content into a video production
CN207150751U (zh) * 2017-07-23 2018-03-27 供求世界科技有限公司 一种用于网络直播的ar系统
US20200186887A1 (en) * 2018-12-07 2020-06-11 Starship Vending-Machine Corp. Real-time broadcast editing system and method
CN109618177B (zh) * 2018-12-26 2020-02-28 北京微播视界科技有限公司 视频处理方法、装置、电子设备及计算机可读存储介质
CN112822542A (zh) * 2020-08-27 2021-05-18 腾讯科技（深圳）有限公司 视频合成方法、装置、计算机设备和存储介质
US11962858B2 (en) * 2020-10-28 2024-04-16 Bigo Technology Pte. Ltd. Video playback method, video playback terminal, and non-volatile computer-readable storage medium
CN112702615B (zh) * 2020-11-27 2023-08-08 深圳市创成微电子有限公司 一种网络直播音视频处理方法及系统
CN112637614B (zh) * 2020-11-27 2023-04-21 深圳市创成微电子有限公司 网络直播音视频处理方法、处理器、装置及可读存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160057363A1 (en) * 2014-08-25 2016-02-25 John G. Posa Portable electronic devices with integrated image/video compositing
CN111432235A (zh) * 2020-04-01 2020-07-17 网易（杭州）网络有限公司 直播视频生成方法、装置、计算机可读介质及电子设备
CN113873272A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种控制直播视频的背景图像的方法、装置及存储介质
CN113873311A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种直播控制方法、装置及存储介质
CN113873273A (zh) * 2021-09-09 2021-12-31 北京都是科技有限公司 一种生成直播视频的方法、装置以及存储介质
CN113989173A (zh) * 2021-10-25 2022-01-28 北京字节跳动网络技术有限公司 视频融合方法、装置、电子设备及存储介质
CN114584797A (zh) * 2022-02-28 2022-06-03 北京字节跳动网络技术有限公司 直播画面的展示方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN114584797A (zh) 2022-06-03

Similar Documents

Publication Publication Date Title
WO2023160573A1 (zh) 直播画面的展示方法、装置、电子设备及存储介质
EP4333439A1 (en) Video sharing method and apparatus, device, and medium
US20230007065A1 (en) Video sharing method, apparatus, device and medium
WO2017096817A1 (zh) 一种多机位视频同步播放的实现方法及装置
WO2022077996A1 (zh) 一种多媒体数据处理方法、装置、电子设备和存储介质
EP2934017A1 (en) Display apparatus and control method thereof
WO2022095840A1 (zh) 直播间创建方法、装置、电子设备及存储介质
WO2022237571A1 (zh) 图像融合方法、装置、电子设备和存储介质
WO2021129157A1 (zh) 基于视频的交互实现方法、装置、设备及介质
WO2022242497A1 (zh) 视频拍摄方法、装置、电子设备和存储介质
JP2023528958A (ja) ビデオ複合撮影方法、装置、電子機器及びコンピュータ可読媒体
WO2024078486A1 (zh) 内容展示方法、装置、设备及存储介质
US12019669B2 (en) Method, apparatus, device, readable storage medium and product for media content processing
WO2023116479A1 (zh) 视频的发布方法、装置、电子设备、存储介质和程序产品
WO2024198947A1 (zh) 虚拟场景处理方法、装置、电子设备及存储介质
US20240028189A1 (en) Interaction method and apparatus, electronic device and computer readable medium
WO2023116480A1 (zh) 多媒体内容的发布方法、装置、设备、介质和程序产品
CN115474085A (zh) 媒体内容播放方法、装置、设备、存储介质和程序产品
WO2024104333A1 (zh) 演播画面的处理方法、装置、电子设备及存储介质
WO2024041556A1 (zh) 一种连麦展示方法、装置、电子设备、计算机可读介质
CN114125358A (zh) 云会议字幕显示方法、系统、装置、电子设备和存储介质
JP2023538825A (ja) ピクチャのビデオへの変換の方法、装置、機器および記憶媒体
WO2024012058A1 (zh) 一种表情图片预览方法、装置、设备及介质
WO2023155708A1 (zh) 视角的切换方法、装置、电子设备、存储介质和程序产品
EP4344191A1 (en) Method and apparatus for editing multimedia resource scene, device, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23759198

Country of ref document: EP

Kind code of ref document: A1