WO2023045651A1 - Livestreaming voice chat method and apparatus, electronic device, medium, and program product - Google Patents

Livestreaming voice chat method and apparatus, electronic device, medium, and program product Download PDF

Info

Publication number
WO2023045651A1
WO2023045651A1 PCT/CN2022/113548 CN2022113548W WO2023045651A1 WO 2023045651 A1 WO2023045651 A1 WO 2023045651A1 CN 2022113548 W CN2022113548 W CN 2022113548W WO 2023045651 A1 WO2023045651 A1 WO 2023045651A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
anchor
picture
live
image
Prior art date
Application number
PCT/CN2022/113548
Other languages
French (fr)
Chinese (zh)
Inventor
龙凡
Original Assignee
北京字跳网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字跳网络技术有限公司 filed Critical 北京字跳网络技术有限公司
Publication of WO2023045651A1 publication Critical patent/WO2023045651A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration

Definitions

  • the present application relates to the field of live broadcasting technology, and in particular to a method, device, electronic equipment, media and program product for connecting wheat to live broadcasting.
  • the two anchors can interact through Lianmai. Viewers can see the live broadcast of the two anchors at the same time when they enter the Lianmai live broadcast room. That is, the live streams of two hosts can be merged and displayed on the audience side. Since the resolutions of the terminal devices used by different viewers are different, it is necessary to crop the merged picture. In the related art, the display effect of the cropped image is poor.
  • the present application provides a method, device, electronic equipment, media, and program products for live broadcasting with connected microphones.
  • a live broadcast method with connected wheat including:
  • the second anchor is a host that is linked with the first anchor
  • the first target screen and the second target screen are displayed.
  • cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture including:
  • cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture including:
  • a second target image including the second anchor is cut out from the copied image.
  • the displaying the first target screen and the second target screen includes:
  • the first target image and the second target image are spliced and displayed according to a preset spliced display manner.
  • cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture including:
  • a second target frame containing the second anchor and having an image aspect ratio equal to the second aspect ratio is cut out from the copied image.
  • copy the live image in the target live stream to obtain the copied image corresponding to the live image including:
  • a Lianmai live broadcast device including:
  • the target live stream acquisition module is used to acquire the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is linked with the first anchor anchor;
  • a picture copying module configured to copy the live picture in the target live stream to obtain the copied picture corresponding to the live picture
  • a target picture cutting module configured to cut out a first target picture including the first anchor from the live picture, and cut out a second target picture including the second anchor from the copied picture;
  • a target screen display module configured to display the first target screen and the second target screen.
  • the target picture cutting module is specifically configured to cut out the first target picture from the live broadcast picture so that the first anchor is displayed in the center; cut out the second target picture from the copied picture The second target screen displayed in the center.
  • the target screen cutting module is specifically configured to, based on the first position information of the first anchor in the live screen, cut out the first target including the first anchor from the live screen.
  • a picture based on the second position information of the second anchor in the live picture, cutting out a second target picture including the second anchor from the copied picture.
  • the target picture display module is specifically configured to splice and display the first target picture and the second target picture according to a preset splicing display manner.
  • the target picture cropping module is specifically configured to determine the first aspect ratio and the second aspect ratio based on its own screen resolution and the preset splicing display mode; A first target picture containing the first anchor and having an image aspect ratio of the first aspect ratio; cutting out a first target picture containing the second anchor and having an image aspect ratio of the first aspect ratio from the copied picture The second target screen for the second aspect ratio.
  • the picture copying module is specifically configured to copy the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
  • an electronic device including: a processor, the processor is configured to execute a computer program stored in a memory, and when the computer program is executed by the processor, the method described in the first aspect is implemented .
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
  • a computer program product which causes the computer to execute the method described in the first aspect when the computer program product is run on a computer.
  • Figure 1 is a schematic diagram of the merging of live streams in the process of live broadcasting
  • FIG. 2 is a schematic diagram of cutting live images in the related art
  • FIG. 3 shows a schematic diagram of the system architecture of an exemplary application environment where the method for live broadcasting with connected microphones according to the embodiment of the present application can be applied;
  • Fig. 4 is a flow chart of the live broadcast method of Lianmai in the embodiment of the present application.
  • Fig. 5 is a schematic diagram of duplicating live images in the embodiment of the present application.
  • FIG. 6 is a schematic diagram showing a first target screen and a second target screen in an embodiment of the present application
  • Fig. 7 is a schematic structural diagram of a wheat-connecting live broadcast device in an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an electronic device in an embodiment of the present application.
  • Lianmai refers to two anchors connecting to each other, opening audio and video for interaction, and combining the two live streams for viewers to watch.
  • Convergence refers to merging multiple live streams according to the set layout through the live stream merging service to synthesize one live stream.
  • Figure 1 is a schematic diagram of the merging of live streams in the process of live broadcasting.
  • the live room includes anchor A and anchor B.
  • the anchor end where anchor A is located and the anchor end where anchor B is located generate respectively Live stream A and live stream B are merged on the server side to generate live stream C, and live stream C is displayed on the viewer side.
  • the live broadcast images seen by the viewer include the images of anchor A and the images of anchor B, and the images of anchor A and anchor B are displayed on the left and right sides of the screen.
  • FIG. 2 is a schematic diagram of cutting live images in the related art. It can be seen that during the cutting process, the edge area of the entire live image is cut, and the middle area of the entire live image is retained. In this way, for a single anchor, the anchor is not in the middle of the area where the anchor is located. For example, anchor A is on the left half of the entire screen, but anchor A is not in the middle of the left half, and anchor B is on the right half of the entire screen , while anchor A is not in the middle of the right half. Therefore, the display effect of the clipped picture is poor, which affects the user's live broadcast experience.
  • embodiments of the present application provide a live broadcast method, device, electronic equipment, media and program products, which can improve the display effect of cropped images.
  • Fig. 3 shows a schematic diagram of a system architecture of an exemplary application environment to which the method for live broadcasting with connected microphones according to the embodiment of the present application can be applied.
  • the system architecture 100 may include one or more of the host terminal 101 , the host terminal 102 , the audience terminal 111 , the audience terminal 112 , and the audience terminal 113 , a network 120 and a server 130 .
  • the network 120 is used as a medium for providing communication links between the viewer 111 , the viewer 112 , the viewer 113 and the server 130 .
  • Network 120 may include various connection types, such as wires, wireless communication links, or fiber optic cables, among others.
  • the viewer terminal 111, the viewer terminal 112, and the viewer terminal 113 may be various electronic devices with display screens, including but not limited to desktop computers, portable computers, smart phones, and tablet computers. It should be understood that the numbers of hosts, viewers, networks and servers in FIG. 1 are only illustrative, and there may be any number of hosts, viewers, networks and servers according to implementation requirements.
  • the server 130 may be a server cluster composed of multiple servers.
  • the mic-connected live broadcast method provided in the embodiment of the present application is generally executed by the viewer terminal 111 , 112 , and 113 .
  • the anchor terminal 101 and the anchor terminal 102 respectively generate the first live stream of the first anchor and the second live stream of the second anchor, and after the server 130 obtains the first live stream and the second live stream, The two live streams are merged to generate a target live stream, and the target live stream is sent to the audience terminal 111 , the audience terminal 112 , and the audience terminal 113 .
  • the live screen of the target live stream is cut out through the live broadcast method provided by the embodiment of the present application to obtain the first target screen and the second live stream. Two target screens, and display the first target screen and the second target screen.
  • Fig. 4 is a flow chart of the live broadcast method of Lianmai in the embodiment of the present application, which may include the following steps:
  • Step S410 acquiring a target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is a host that is co-hosted with the first anchor.
  • Step S420 copying the live image in the target live stream to obtain the copied image corresponding to the live image.
  • Step S430 cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture.
  • Step S440 displaying the first target screen and the second target screen.
  • the live screen in the target live stream can be copied , get the copy screen.
  • This application cuts out the first target picture and the second target picture from the live picture and the copied picture respectively as the final picture, instead of directly cutting the final picture from the live picture, so that in addition to cutting out the edge position of the whole live picture In addition, other edge positions other than the first anchor and the second anchor can also be trimmed. It can be seen that the present application can more flexibly cut out the images containing the first anchor and the second anchor, thereby improving the final display effect.
  • step S410 the target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor is acquired; the second anchor is a host that is linked with the first anchor.
  • the first anchor and the second anchor are anchors who perform co-hosting in the same live broadcast room. If the first anchor is the anchor of the connected host, and the second anchor is the host of the linked host, the number of the second anchor can be one or more. That is, multiple users can connect with the host in the live broadcast room at the same time.
  • the first host terminal where the first host is located can generate the first live stream during the live broadcast process, that is, the video stream containing the first host
  • the second host terminal where the second host is located can generate the second live stream during the live broadcast process, namely Contains the video stream of the second host.
  • the first live stream and the second live stream are respectively uploaded to the server by the first live stream and the second live stream.
  • the server merges the first live stream and the second live stream, it generates the target live stream and sends the target live stream to to the audience. It can be seen that the target live stream obtained by the viewer is generated by merging the first live stream and the second live stream.
  • step S420 the live picture in the target live stream is copied to obtain the copied picture corresponding to the live picture.
  • the target live stream includes a plurality of video frames, and each video frame displays a live image.
  • This application processes each live image in the same way.
  • a live image is taken as an example for illustration.
  • the live images of the target video stream may include the images of the first anchor and the images of the second anchor at the same time.
  • this application can edit the live broadcast picture Duplicate to get the duplicated screen that is exactly the same as the live screen.
  • Fig. 5 is a schematic diagram of duplicating a live image in the embodiment of the present application. It can be seen that the live image and the copied image are in two different display layers, and the live image and the copied image are exactly the same.
  • step S430 a first target frame including the first host is cut out from the live screen, and a second target frame including the second host is cut out from the duplicated screen.
  • the first live stream uploaded by the first anchor end and the second live stream uploaded by the second anchor end may carry SEI (Supplemental Enhancement Information, Supplemental Enhancement Information), that is, the first anchor end generates the second live stream
  • SEI Supplemental Enhancement Information
  • the SEI information may include: encoder parameters, video copyright information, information related to live images (such as location information of the anchor), and the like.
  • the first target image containing the first anchor can be cut out from the live image, and based on the second position information of the second anchor in the live image information, and cut out the second target screen containing the second anchor from the copied screen.
  • image recognition may also be performed on the live images to identify the first target image containing the first anchor and the second target image containing the second anchor.
  • the first target picture and the second target picture may not contain redundant edge areas other than the first anchor and the second anchor, that is, increase the first anchor in the first target picture to increase the proportion of the second anchor in the second target screen. In this way, the viewing experience during the live broadcast can be improved.
  • the first target picture with the first anchor displayed in the center can also be cut out from the live picture, and the second target picture with the second anchor displayed in the center can be cut out from the copied picture. That is, if the first anchor is positioned in the middle of the first target screen and the second anchor is positioned in the middle of the second target screen, the centered display described in this application can be a relatively centered display, that is, it does not need to be completely centered.
  • the first target picture and the second target picture matching different viewer terminals may also be cut out.
  • the viewer terminal may determine the first aspect ratio and the second aspect ratio based on its own screen resolution and a preset splicing display mode.
  • the screen aspect ratio can be determined based on the screen resolution
  • the first aspect ratio and the second aspect ratio can be determined based on the screen aspect ratio and the preset splicing display mode.
  • the first aspect ratio may be the aspect ratio of the first target picture
  • the second aspect ratio may be the aspect ratio of the second target picture. Assume that the first target picture and the second target picture are spliced and displayed left and right, the first target picture and the second target picture each occupy half of the screen, and the first aspect ratio and the second aspect ratio are equal.
  • the first target screen containing the first host and having the first aspect ratio can be cut out from the live screen
  • the second target screen containing the second host and having the second aspect ratio can be cut out from the copied screen. aspect ratio of the second target screen.
  • Figure 6 is a schematic diagram showing the first target screen and the second target screen in the embodiment of the present application, the first target screen (the left half of the gray area) and the second target screen where anchor A and anchor B are located
  • the screen (the right half of the gray area) is spliced left and right. It can be seen that the final picture after splicing matches the screen resolution.
  • anchor A is centered and displayed in the left half area
  • anchor B is centered and displayed in the right half area, which has a better display effect, so it can improve the live broadcast experience.
  • step S440 the first target screen and the second target screen are displayed.
  • displaying the first target screen and the second target screen refers to simultaneously displaying the first target screen and the second target screen.
  • the first target picture and the second target picture can be displayed in the form of large and small windows, that is, one of the first target picture and the second target picture is displayed in a large window (the largest display window of the live picture) Display, other screens are displayed in small windows, and when viewers click on different screens, they can switch between large and small windows. For example, if the number of second anchors is 2, then the number of second target images is also 2.
  • the second target screen will be switched from a small window to a large window, and the second target screen will be switched from a small window to a large window.
  • a target screen will be switched from a large window to a small window.
  • the first target frame and the second target frame may be spliced and displayed according to a preset spliced display manner.
  • the preset spliced display mode is determined based on the total number of the first target picture and the second target picture, that is, determined based on the total number of the first anchor and the second anchor. For example, if the quantity of the first target picture is 1, and the quantity of the second target picture is also 1, the first target picture and the second target picture can be spliced and displayed left and right; if the quantity of the first target picture is 1, The number of the second target screen is 2, and the first target screen and the second target screen can be spliced and displayed in the manner of top, bottom left, bottom right and so on.
  • the live screen in the target live stream can be copied , get the copy screen.
  • the live screen in the target live stream can be copied , get the copy screen.
  • the live broadcast image Based on the first position information of the first anchor in the live broadcast image, cut out from the live broadcast image a first target image that is displayed in the center of the first anchor and matches the screen resolution of the viewer, and based on the second anchor’s position in the live broadcast image
  • the second position information of the copied screen is cut out to make the second target screen displayed in the center of the second anchor and match the screen resolution, and the first target screen and the second target screen are spliced and displayed.
  • This application respectively cuts out the first target picture centered by the first anchor and the second target picture displayed centered by the second anchor from the live broadcast picture and the copied picture as the final picture, and is compatible with viewers with different screen resolutions Matching, which can improve the final display effect.
  • the embodiment of the present application also provides a wheat-connected live broadcast device, as shown in FIG. 7 , the wheat-connected live broadcast device 700 includes:
  • the target live stream acquisition module 710 is used to obtain the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is an anchor connected with the first anchor;
  • the picture copy module 720 is used to copy the live picture in the target live stream to obtain the copied picture corresponding to the live picture;
  • the target picture cutting module 730 is used to cut out the first target picture comprising the first anchor from the live picture, and cut out the second target picture comprising the second anchor from the copied picture;
  • a target screen display module 740 configured to display the first target screen and the second target screen.
  • the target picture cropping module 730 is specifically configured to cut out the first target picture that makes the first anchor displayed in the center from the live picture; cuts out the second target picture that makes the second anchor show in the center from the copied picture .
  • the target picture cropping module 730 is specifically configured to cut out the first target picture containing the first anchor from the live picture based on the first position information of the first anchor in the live picture; The second position information in the live image is used to cut out the second target image including the second anchor from the copied image.
  • the target screen display module 740 is specifically configured to splice and display the first target screen and the second target screen according to a preset splicing display manner.
  • the target picture cropping module 730 is specifically configured to determine the first aspect ratio and the second aspect ratio based on its own screen resolution and preset splicing display mode; A first target frame with an anchor and an image aspect ratio of the first aspect ratio; a second target image including a second anchor and an image aspect ratio of a second aspect ratio is cut out from the copied image.
  • the picture copying module 720 is specifically configured to copy the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
  • an electronic device including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the above-mentioned Lianmai live broadcast in this exemplary embodiment method.
  • FIG. 8 is a schematic structural diagram of an electronic device in an embodiment of the present application. It should be noted that the electronic device 800 shown in FIG. 8 is only an example, and should not limit the functions and scope of use of this embodiment of the present application.
  • an electronic device 800 includes a central processing unit (CPU) 801, which can operate according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage section 808 into a random access memory (RAM) 803 Instead, various appropriate actions and processes are performed.
  • ROM read-only memory
  • RAM random access memory
  • various programs and data necessary for system operation are also stored.
  • the central processing unit 801, ROM 802, and RAM 803 are connected to each other through a bus 804.
  • An input/output (I/O) interface 805 is also connected to the bus 804 .
  • the following components are connected to the I/O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 808 including a hard disk, etc. and a communication section 809 including a network interface card such as a local area network (LAN) card, a modem, or the like.
  • the communication section 809 performs communication processing via a network such as the Internet.
  • a drive 810 is also connected to the I/O interface 805 as needed.
  • a removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 810 as necessary so that a computer program read therefrom is installed into the storage section 808 as necessary.
  • the processes described above with reference to the flowcharts can be implemented as computer software programs.
  • the embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts.
  • the computer program may be downloaded and installed from a network via communication portion 809 and/or installed from removable media 811 .
  • the central processing unit 801 When the computer program is executed by the central processing unit 801, various functions defined in the apparatus of the present application are performed.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned method for live broadcasting with connected microphones is realized.
  • the computer-readable storage medium described in this application may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more conductors, portable computer diskettes, hard disks, random access memory, read-only memory, erasable programmable read-only memory (EPROM) or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • Program code contained on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wires, optical cables, radio frequency, etc., or any suitable combination of the above.
  • a computer program product is also provided.
  • the computer program product is run on a computer, the computer is made to execute the above-mentioned method for live broadcasting with connected microphones.

Abstract

The present application relates to a livestreaming voice chat method and apparatus, an electronic device, a medium, and a program product. The method comprises: obtaining a target livestream generated by merging a first livestream based on a first live streamer and a second livestream based on a second live streamer, the second live streamer being a live streamer having a voice chat with the first live streamer; copying a livestreaming picture in the target livestream to obtain a copied picture corresponding to the livestreaming picture; and cropping a first target picture comprising the first live streamer from the livestreaming picture, cropping a second target picture comprising the second live streamer from the copied picture, and displaying the first target picture and the second target picture.

Description

连麦直播方法、装置、电子设备、介质及程序产品Lianmai live broadcast method, device, electronic equipment, medium and program product
本申请要求于2021年09月26日提交的,申请名称为“连麦直播方法、装置、电子设备、介质及程序产品”的、中国专利申请号为“202111130158.7”的优先权,该中国专利申请的全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application number "202111130158.7" filed on September 26, 2021, the application name is "Lianmai live broadcast method, device, electronic equipment, medium and program product", the Chinese patent application The entire contents of are incorporated by reference in this application.
技术领域technical field
本申请涉及直播技术领域,尤其涉及一种连麦直播方法、装置、电子设备、介质及程序产品。The present application relates to the field of live broadcasting technology, and in particular to a method, device, electronic equipment, media and program product for connecting wheat to live broadcasting.
背景技术Background technique
在直播过程中,两个主播可以通过连麦的方式进行互动,观众进入连麦的直播间,可以同时看到两个主播的直播画面。即,两个主播的直播流可以经过合流后显示在观众端。由于不同观众所使用的终端设备的分辨率不同,因此,需要对合流后的画面进行裁剪。相关技术中,裁剪后得到的画面显示效果较差。During the live broadcast, the two anchors can interact through Lianmai. Viewers can see the live broadcast of the two anchors at the same time when they enter the Lianmai live broadcast room. That is, the live streams of two hosts can be merged and displayed on the audience side. Since the resolutions of the terminal devices used by different viewers are different, it is necessary to crop the merged picture. In the related art, the display effect of the cropped image is poor.
发明内容Contents of the invention
为了解决上述技术问题或者至少部分地解决上述技术问题,本申请提供了一种连麦直播方法、装置、电子设备、介质及程序产品。In order to solve the above-mentioned technical problems or at least partially solve the above-mentioned technical problems, the present application provides a method, device, electronic equipment, media, and program products for live broadcasting with connected microphones.
根据本申请的第一方面,提供了一种连麦直播方法,包括:According to the first aspect of the present application, there is provided a live broadcast method with connected wheat, including:
获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;所述第二主播是与所述第一主播连麦的主播;Obtaining a target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is a host that is linked with the first anchor;
对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面;Copying the live image in the target live stream to obtain the copied image corresponding to the live image;
从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面;Cutting out a first target picture including the first anchor from the live picture, and cutting out a second target picture including the second anchor from the copied picture;
显示所述第一目标画面和所述第二目标画面。The first target screen and the second target screen are displayed.
可选的,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:Optionally, cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture, including:
从所述直播画面中裁剪出使所述第一主播居中显示的第一目标画面;Cutting out a first target picture for centering display of the first anchor from the live picture;
从所述复制画面中裁剪出使所述第二主播居中显示的第二目标画面。Cutting out a second target picture for centering the second anchor and displaying it from the copied picture.
可选的,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:Optionally, cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture, including:
基于所述第一主播在所述直播画面中的第一位置信息,从所述直播画面中裁剪出包含所述第一主播的第一目标画面;Based on the first position information of the first anchor in the live image, cutting out a first target image including the first anchor from the live image;
基于所述第二主播在所述直播画面中的第二位置信息,从所述复制画面中裁剪出包含所述第二主播的第二目标画面。Based on the second position information of the second anchor in the live image, a second target image including the second anchor is cut out from the copied image.
可选的,所述显示所述第一目标画面和所述第二目标画面,包括:Optionally, the displaying the first target screen and the second target screen includes:
按照预设拼接显示方式,将所述第一目标画面和所述第二目标画面进行拼接显示。The first target image and the second target image are spliced and displayed according to a preset spliced display manner.
可选的,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:Optionally, cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture, including:
基于自身的屏幕分辨率和所述预设拼接显示方式,确定第一宽高比和第二宽高比;Determine the first aspect ratio and the second aspect ratio based on its own screen resolution and the preset splicing display mode;
从所述直播画面中裁剪出包含所述第一主播、且图像宽高比为所述第一宽高比的第一目标画面;Cutting out a first target picture containing the first anchor and having an image aspect ratio equal to the first aspect ratio from the live broadcast picture;
从所述复制画面中裁剪出包含所述第二主播、且图像宽高比为所述第二宽高比的的第二目标画面。A second target frame containing the second anchor and having an image aspect ratio equal to the second aspect ratio is cut out from the copied image.
可选的,对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面,包括:Optionally, copy the live image in the target live stream to obtain the copied image corresponding to the live image, including:
将位于第一显示层的所述目标直播流中的直播画面复制到第二显示层,得到位于第二显示层中的复制画面。Copying the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
根据本申请的第二方面,提供了一种连麦直播装置,包括:According to the second aspect of the present application, a Lianmai live broadcast device is provided, including:
目标直播流获取模块,用于获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;所述第二主播是与所述第一主播连麦的主播;The target live stream acquisition module is used to acquire the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is linked with the first anchor anchor;
画面复制模块,用于对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面;A picture copying module, configured to copy the live picture in the target live stream to obtain the copied picture corresponding to the live picture;
目标画面裁剪模块,用于从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面;A target picture cutting module, configured to cut out a first target picture including the first anchor from the live picture, and cut out a second target picture including the second anchor from the copied picture;
目标画面显示模块,用于显示所述第一目标画面和所述第二目标画面。A target screen display module, configured to display the first target screen and the second target screen.
可选的,所述目标画面裁剪模块,具体用于从所述直播画面中裁剪出使所述第一主播居中显示的第一目标画面;从所述复制画面中裁剪出使所述第二主播居中显示的第二目标画面。Optionally, the target picture cutting module is specifically configured to cut out the first target picture from the live broadcast picture so that the first anchor is displayed in the center; cut out the second target picture from the copied picture The second target screen displayed in the center.
可选的,所述目标画面裁剪模块,具体用于基于所述第一主播在所述直播画面中的第一位置信息,从所述直播画面中裁剪出包含所述第一主播的第一目标画面;基于所述第二主播在所述直播画面中的第二位置信息,从所述复制画面中裁剪出包含所述第二主播的第二目标画面。Optionally, the target screen cutting module is specifically configured to, based on the first position information of the first anchor in the live screen, cut out the first target including the first anchor from the live screen. A picture; based on the second position information of the second anchor in the live picture, cutting out a second target picture including the second anchor from the copied picture.
可选的,所述目标画面显示模块,具体用于按照预设拼接显示方式,将所述第一目标画面和所述第二目标画面进行拼接显示。Optionally, the target picture display module is specifically configured to splice and display the first target picture and the second target picture according to a preset splicing display manner.
可选的,所述目标画面裁剪模块,具体用于基于自身的屏幕分辨率和所述预设拼接显示方式,确定第一宽高比和第二宽高比;从所述直播画面中裁剪出包含所述第一主播、且图像 宽高比为所述第一宽高比的第一目标画面;从所述复制画面中裁剪出包含所述第二主播、且图像宽高比为所述第二宽高比的的第二目标画面。Optionally, the target picture cropping module is specifically configured to determine the first aspect ratio and the second aspect ratio based on its own screen resolution and the preset splicing display mode; A first target picture containing the first anchor and having an image aspect ratio of the first aspect ratio; cutting out a first target picture containing the second anchor and having an image aspect ratio of the first aspect ratio from the copied picture The second target screen for the second aspect ratio.
可选的,所述画面复制模块,具体用于将位于第一显示层的所述目标直播流中的直播画面复制到第二显示层,得到位于第二显示层中的复制画面。Optionally, the picture copying module is specifically configured to copy the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
根据本申请的第三方面,提供了一种电子设备,包括:处理器,所述处理器用于执行存储于存储器的计算机程序,所述计算机程序被处理器执行时实现第一方面所述的方法。According to a third aspect of the present application, an electronic device is provided, including: a processor, the processor is configured to execute a computer program stored in a memory, and when the computer program is executed by the processor, the method described in the first aspect is implemented .
根据本申请的第四方面,提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现第一方面所述的方法。According to a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
根据本申请的第五方面,提供了一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行第一方面所述的方法。According to a fifth aspect of the present application, a computer program product is provided, which causes the computer to execute the method described in the first aspect when the computer program product is run on a computer.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本申请的实施例,并与说明书一起用于解释本申请的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.
为了更清楚地说明本申请实施例或相关技术中的技术方案,下面将对实施例或相关技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings that need to be used in the descriptions of the embodiments or related technologies. Obviously, for those of ordinary skill in the art, Other drawings can also be obtained from these drawings without any creative effort.
图1为直播连麦过程中直播流合流的一种示意图;Figure 1 is a schematic diagram of the merging of live streams in the process of live broadcasting;
图2为相关技术中对直播画面进行裁剪的一种示意图;FIG. 2 is a schematic diagram of cutting live images in the related art;
图3示出了可以应用本申请实施例的连麦直播方法的示例性应用环境的系统架构的示意图;FIG. 3 shows a schematic diagram of the system architecture of an exemplary application environment where the method for live broadcasting with connected microphones according to the embodiment of the present application can be applied;
图4为本申请实施例中连麦直播方法的一种流程图;Fig. 4 is a flow chart of the live broadcast method of Lianmai in the embodiment of the present application;
图5为本申请实施例中对直播画面进行复制的一种示意图;Fig. 5 is a schematic diagram of duplicating live images in the embodiment of the present application;
图6为本申请实施例中显示第一目标画面和第二目标画面的一种示意图;FIG. 6 is a schematic diagram showing a first target screen and a second target screen in an embodiment of the present application;
图7为本申请实施例中连麦直播装置的一种结构示意图;Fig. 7 is a schematic structural diagram of a wheat-connecting live broadcast device in an embodiment of the present application;
图8为本申请实施例中电子设备的一种结构示意图。FIG. 8 is a schematic structural diagram of an electronic device in an embodiment of the present application.
具体实施方式Detailed ways
为了能够更清楚地理解本申请的上述目的、特征和优点,下面将对本申请的方案进行进一步描述。需要说明的是,在不冲突的情况下,本申请的实施例及实施例中的特征可以相互组合。In order to better understand the above purpose, features and advantages of the present application, the solution of the present application will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.
在下面的描述中阐述了很多具体细节以便于充分理解本申请,但本申请还可以采用其他不同于在此描述的方式来实施;显然,说明书中的实施例只是本申请的一部分实施例,而不 是全部的实施例。In the following description, a lot of specific details have been set forth in order to fully understand the present application, but the present application can also be implemented in other ways different from those described here; obviously, the embodiments in the description are only a part of the present application, and Not all examples.
在直播过程中,用户可以通过连麦的方式与主播进行交流,以增加直播的趣味性。连麦指的是两个主播通过连线的方式,打开音视频进行交互,把两个直播流合流后提供给观众观看。合流即通过直播合流服务将多个直播流按照设置的布局进行合流,以合成一路直播流。During the live broadcast, users can communicate with the anchor through the way of Lianmai to increase the fun of the live broadcast. Lianmai refers to two anchors connecting to each other, opening audio and video for interaction, and combining the two live streams for viewers to watch. Convergence refers to merging multiple live streams according to the set layout through the live stream merging service to synthesize one live stream.
参见图1,图1为直播连麦过程中直播流合流的一种示意图,该直播间包括主播A和主播B,在直播过程中,主播A所在的主播端和主播B所在的主播端分别生成直播流A和直播流B,通过在服务端将直播流A和直播流B进行合流,生成直播流C,并将直播流C显示在观众端。可以看出,观众端看到的直播画面,即包括主播A的画面也包括主播B的画面,主播A的画面和主播B的画面在屏幕中左右显示。See Figure 1. Figure 1 is a schematic diagram of the merging of live streams in the process of live broadcasting. The live room includes anchor A and anchor B. During the live broadcast, the anchor end where anchor A is located and the anchor end where anchor B is located generate respectively Live stream A and live stream B are merged on the server side to generate live stream C, and live stream C is displayed on the viewer side. It can be seen that the live broadcast images seen by the viewer include the images of anchor A and the images of anchor B, and the images of anchor A and anchor B are displayed on the left and right sides of the screen.
由于不同观众端的屏幕分辨率各不相同,观众端在接收到直播流C后,为了与观众端的屏幕进行适配,可以对直播画面进行裁剪。参见图2,图2为相关技术中对直播画面进行裁剪的一种示意图,可以看出,在裁剪过程中,将整个直播画面的边缘区域裁减掉,保留整个直播画面的中间区域。这样,对于单个主播而言,该主播未在该主播所在区域的中间位置,例如,主播A在整个画面的左半边,而主播A未在左半边的中间位置,主播B在整个画面的右半边,而主播A未在右半边的中间位置。因此,裁剪后画面的显示效果较差,影响用户的直播体验。Since the screen resolutions of different viewers are different, after receiving the live stream C, the viewer can cut the live image to adapt to the screen of the viewer. Referring to FIG. 2, FIG. 2 is a schematic diagram of cutting live images in the related art. It can be seen that during the cutting process, the edge area of the entire live image is cut, and the middle area of the entire live image is retained. In this way, for a single anchor, the anchor is not in the middle of the area where the anchor is located. For example, anchor A is on the left half of the entire screen, but anchor A is not in the middle of the left half, and anchor B is on the right half of the entire screen , while anchor A is not in the middle of the right half. Therefore, the display effect of the clipped picture is poor, which affects the user's live broadcast experience.
为了解决上述问题,本申请实施例提供了一种连麦直播方法、装置、电子设备、介质及程序产品,可以提升裁剪后画面的显示效果。In order to solve the above problems, embodiments of the present application provide a live broadcast method, device, electronic equipment, media and program products, which can improve the display effect of cropped images.
图3示出了可以应用本申请实施例的连麦直播方法的示例性应用环境的系统架构的示意图。Fig. 3 shows a schematic diagram of a system architecture of an exemplary application environment to which the method for live broadcasting with connected microphones according to the embodiment of the present application can be applied.
如图3所示,系统架构100可以包括主播端101、主播端102、观众端111、观众端112、观众端113中的一个或多个,网络120和服务器130。网络120用以在观众端111、观众端112、观众端113和服务器130之间提供通信链路的介质。网络120可以包括各种连接类型,例如有线、无线通信链路或者光纤电缆等等。观众端111、观众端112、观众端113可以是具有显示屏的各种电子设备,包括但不限于台式计算机、便携式计算机、智能手机和平板电脑等等。应该理解,图1中的主播端、观众端、网络和服务器的数量仅仅是示意性的,根据实现需要,可以具有任意数量的主播端、观众端、网络和服务器。比如服务器130可以是多个服务器组成的服务器集群等。As shown in FIG. 3 , the system architecture 100 may include one or more of the host terminal 101 , the host terminal 102 , the audience terminal 111 , the audience terminal 112 , and the audience terminal 113 , a network 120 and a server 130 . The network 120 is used as a medium for providing communication links between the viewer 111 , the viewer 112 , the viewer 113 and the server 130 . Network 120 may include various connection types, such as wires, wireless communication links, or fiber optic cables, among others. The viewer terminal 111, the viewer terminal 112, and the viewer terminal 113 may be various electronic devices with display screens, including but not limited to desktop computers, portable computers, smart phones, and tablet computers. It should be understood that the numbers of hosts, viewers, networks and servers in FIG. 1 are only illustrative, and there may be any number of hosts, viewers, networks and servers according to implementation requirements. For example, the server 130 may be a server cluster composed of multiple servers.
本申请实施例所提供的连麦直播方法一般由观众端111、观众端112、观众端113执行,相应地,连麦直播装置可以设置于观众端111、观众端112、观众端113中。举例而言,在直播过程中,主播端101、主播端102分别生成第一主播的第一直播流和第二主播的第二直播流,服务器130获取第一直播流和第二直播流后,将该两个直播流进 行合流,生成目标直播流,并将目标直播流发送至观众端111、观众端112、观众端113。观众端111、观众端112、观众端113从服务器130获取到目标直播流后,通过本申请实施例所提供的连麦直播方法对目标直播流的直播画面进行裁剪,得到第一目标画面和第二目标画面,并显示第一目标画面和第二目标画面。The mic-connected live broadcast method provided in the embodiment of the present application is generally executed by the viewer terminal 111 , 112 , and 113 . For example, during the live broadcast, the anchor terminal 101 and the anchor terminal 102 respectively generate the first live stream of the first anchor and the second live stream of the second anchor, and after the server 130 obtains the first live stream and the second live stream, The two live streams are merged to generate a target live stream, and the target live stream is sent to the audience terminal 111 , the audience terminal 112 , and the audience terminal 113 . After the viewer terminal 111, the viewer terminal 112, and the viewer terminal 113 obtain the target live stream from the server 130, the live screen of the target live stream is cut out through the live broadcast method provided by the embodiment of the present application to obtain the first target screen and the second live stream. Two target screens, and display the first target screen and the second target screen.
参见图4,图4为本申请实施例中连麦直播方法的一种流程图,可以包括以下步骤:Referring to Fig. 4, Fig. 4 is a flow chart of the live broadcast method of Lianmai in the embodiment of the present application, which may include the following steps:
步骤S410,获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;第二主播是与第一主播连麦的主播。Step S410, acquiring a target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is a host that is co-hosted with the first anchor.
步骤S420,对目标直播流中的直播画面进行复制,得到直播画面对应的复制画面。Step S420, copying the live image in the target live stream to obtain the copied image corresponding to the live image.
步骤S430,从直播画面中裁剪出包含第一主播的第一目标画面,从复制画面中裁剪出包含第二主播的第二目标画面。Step S430, cutting out the first target picture including the first anchor from the live broadcast picture, and cutting out the second target picture including the second anchor from the copied picture.
步骤S440,显示第一目标画面和第二目标画面。Step S440, displaying the first target screen and the second target screen.
本申请实施例的连麦直播方法,在获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流后,可以对目标直播流中的直播画面进行复制,得到复制画面。从直播画面中裁剪出包含第一主播的第一目标画面,从复制画面中裁剪出包含第二主播的第二目标画面,并同时显示第一目标画面和第二目标画面。本申请分别从直播画面和复制画面中裁剪出第一目标画面和第二目标画面作为最终的画面,而不是直接从直播画面中裁剪最终的画面,这样,除了可以裁减掉整个直播画面的边缘位置之外,还可以裁减掉第一主播、第二主播之外的其他边缘位置。可见,本申请可以更灵活地裁剪出包含第一主播和第二主播的画面,从而提升最终的显示效果。In the live broadcast method of the embodiment of the present application, after obtaining the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor, the live screen in the target live stream can be copied , get the copy screen. Cutting out the first target picture including the first anchor from the live picture, cutting out the second target picture including the second anchor from the copied picture, and displaying the first target picture and the second target picture at the same time. This application cuts out the first target picture and the second target picture from the live picture and the copied picture respectively as the final picture, instead of directly cutting the final picture from the live picture, so that in addition to cutting out the edge position of the whole live picture In addition, other edge positions other than the first anchor and the second anchor can also be trimmed. It can be seen that the present application can more flexibly cut out the images containing the first anchor and the second anchor, thereby improving the final display effect.
以下对本申请实施例的技术方案进行详细介绍:The technical scheme of the embodiment of the present application is described in detail below:
在步骤S410中,获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;第二主播是与第一主播连麦的主播。In step S410, the target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor is acquired; the second anchor is a host that is linked with the first anchor.
本申请实施例中,第一主播和第二主播是在同一直播间进行连麦的主播。如果第一主播为被连麦主播,第二主播为连麦主播,第二主播的数量可以为一个或多个。也就是,可以同时有多个用户与直播间的主播进行连麦。In this embodiment of the application, the first anchor and the second anchor are anchors who perform co-hosting in the same live broadcast room. If the first anchor is the anchor of the connected host, and the second anchor is the host of the linked host, the number of the second anchor can be one or more. That is, multiple users can connect with the host in the live broadcast room at the same time.
第一主播所在的第一主播端在直播过程中可以生成第一直播流,即包含第一主播的视频流,第二主播所在的第二主播端在直播过程中可以生成第二直播流,即包含第二主播的视频流。第一主播端和第二主播端分别将第一直播流和第二直播流上传至服务器,服务器将第一直播流和第二直播流进行合流之后,生成目标直播流,并将目标直播流发送至观众端。可见,观众端获取到的目标直播流是将第一直播流和第二直播流进行合流生成的。The first host terminal where the first host is located can generate the first live stream during the live broadcast process, that is, the video stream containing the first host, and the second host terminal where the second host is located can generate the second live stream during the live broadcast process, namely Contains the video stream of the second host. The first live stream and the second live stream are respectively uploaded to the server by the first live stream and the second live stream. After the server merges the first live stream and the second live stream, it generates the target live stream and sends the target live stream to to the audience. It can be seen that the target live stream obtained by the viewer is generated by merging the first live stream and the second live stream.
在步骤S420中,对目标直播流中的直播画面进行复制,得到直播画面对应的复制 画面。In step S420, the live picture in the target live stream is copied to obtain the copied picture corresponding to the live picture.
目标直播流中包括多个视频帧,每个视频帧中显示有直播画面,本申请对每个直播画面的处理方式相同,在此以一个直播画面为例进行说明。可以理解的是,目标视频流的直播画面中可以同时包括第一主播的画面和第二主播的画面。为了能够分别裁剪出包含第一主播的画面和包含第二主播的画面,即分别裁剪两个画面,而不是一次直接裁剪得到包含第一主播和第二主播的一个画面,本申请可以对直播画面进行复制,得到与直播画面完全相同的复制画面。The target live stream includes a plurality of video frames, and each video frame displays a live image. This application processes each live image in the same way. Here, a live image is taken as an example for illustration. It can be understood that the live images of the target video stream may include the images of the first anchor and the images of the second anchor at the same time. In order to be able to cut out the picture containing the first anchor and the picture containing the second anchor respectively, that is, to cut two pictures respectively, instead of directly cutting out one picture containing the first anchor and the second anchor at one time, this application can edit the live broadcast picture Duplicate to get the duplicated screen that is exactly the same as the live screen.
由于直播画面通常在显示层(例如View)中进行显示,如果直播画面位于第一显示层,可以将位于第一显示层的目标直播流中的直播画面复制到第二显示层,得到位于第二显示层中的复制画面。图5为本申请实施例中对直播画面进行复制的一种示意图,可以看出,直播画面和复制画面分别在两个不同的显示层,且直播画面和复制画面完全相同。Since the live image is usually displayed in the display layer (such as View), if the live image is located in the first display layer, the live image in the target live stream located in the first display layer can be copied to the second display layer to obtain the live image in the second display layer. Displays the copied screen in the layer. Fig. 5 is a schematic diagram of duplicating a live image in the embodiment of the present application. It can be seen that the live image and the copied image are in two different display layers, and the live image and the copied image are exactly the same.
在步骤S430中,从直播画面中裁剪出包含第一主播的第一目标画面,从复制画面中裁剪出包含第二主播的第二目标画面。In step S430, a first target frame including the first host is cut out from the live screen, and a second target frame including the second host is cut out from the duplicated screen.
本申请实施例中,第一主播端上传的第一直播流和第二主播端上传的第二直播流中可以携带有SEI(Supplemental Enhancement Information,补充增强信息),即第一主播端在生成第一直播流以及第二主播端在生成第二直播流时可以分别在第一直播流和第二直播流中添加SEI信息。SEI信息中可以包括:编码器参数、视频版权信息、直播画面相关的信息(例如主播的位置信息)等等。在一些实施方式中,可以基于第一主播在直播画面中的第一位置信息,从直播画面中裁剪出包含第一主播的第一目标画面,以及基于第二主播在直播画面中的第二位置信息,从复制画面中裁剪出包含第二主播的第二目标画面。In the embodiment of the present application, the first live stream uploaded by the first anchor end and the second live stream uploaded by the second anchor end may carry SEI (Supplemental Enhancement Information, Supplemental Enhancement Information), that is, the first anchor end generates the second live stream When generating the second live stream, the first live stream and the second live stream can add SEI information to the first live stream and the second live stream respectively. The SEI information may include: encoder parameters, video copyright information, information related to live images (such as location information of the anchor), and the like. In some implementations, based on the first position information of the first anchor in the live image, the first target image containing the first anchor can be cut out from the live image, and based on the second position information of the second anchor in the live image information, and cut out the second target screen containing the second anchor from the copied screen.
在又一些实施方式中,还可以对直播画面进行图像识别,识别出包含第一主播的第一目标画面和包含第二主播的第二目标画面。In still some implementation manners, image recognition may also be performed on the live images to identify the first target image containing the first anchor and the second target image containing the second anchor.
可以理解的是,与裁剪之前相比,第一目标画面和第二目标画面中可以不包含第一主播和第二主播之外多余的边缘区域,也就是增加第一主播在第一目标画面中的占比,增加第二主播在第二目标画面的占比。这样,可以提升直播过程中的观看体验。It can be understood that, compared with before cropping, the first target picture and the second target picture may not contain redundant edge areas other than the first anchor and the second anchor, that is, increase the first anchor in the first target picture to increase the proportion of the second anchor in the second target screen. In this way, the viewing experience during the live broadcast can be improved.
另外,为了提升第一主播和第二主播在最终画面中的显示效果,避免第一主播出现在第一目标画面的边缘位置,避免第二主播出现在第二目标画面的边缘位置,例如图2所示的情况,在裁剪时,还可以从直播画面中裁剪出使第一主播居中显示的第一目标画面,从复制画面中裁剪出使第二主播居中显示的第二目标画面。也就是,使第一主播位于第一目标画面的中间,使第二主播位于第二目标画面的中间,本申请所述的居中显示 可以是相对居中显示,即可以不用完全居中显示。In addition, in order to improve the display effect of the first anchor and the second anchor in the final screen, avoid the first anchor appearing at the edge of the first target screen, and prevent the second anchor from appearing at the edge of the second target screen, as shown in Figure 2 In the situation shown, when cropping, the first target picture with the first anchor displayed in the center can also be cut out from the live picture, and the second target picture with the second anchor displayed in the center can be cut out from the copied picture. That is, if the first anchor is positioned in the middle of the first target screen and the second anchor is positioned in the middle of the second target screen, the centered display described in this application can be a relatively centered display, that is, it does not need to be completely centered.
本申请实施例中,还可以裁剪出与不同观众端匹配的第一目标画面和第二目标画面。具体的,观众端可以基于自身的屏幕分辨率和预设拼接显示方式,确定第一宽高比和第二宽高比。基于屏幕分辨率可以确定屏幕宽高比,基于屏幕宽高比和预设拼接显示方式可以确定第一宽高比和第二宽高比。其中,第一宽高比可以是第一目标画面的宽高比,第二宽高比可以是第二目标画面的宽高比。假设第一目标画面和第二目标画面左右拼接显示,第一目标画面和第二目标画面各占屏幕的一半,第一宽高比和第二宽高比相等。In the embodiment of the present application, the first target picture and the second target picture matching different viewer terminals may also be cut out. Specifically, the viewer terminal may determine the first aspect ratio and the second aspect ratio based on its own screen resolution and a preset splicing display mode. The screen aspect ratio can be determined based on the screen resolution, and the first aspect ratio and the second aspect ratio can be determined based on the screen aspect ratio and the preset splicing display mode. Wherein, the first aspect ratio may be the aspect ratio of the first target picture, and the second aspect ratio may be the aspect ratio of the second target picture. Assume that the first target picture and the second target picture are spliced and displayed left and right, the first target picture and the second target picture each occupy half of the screen, and the first aspect ratio and the second aspect ratio are equal.
之后,可以从直播画面中裁剪出包含第一主播、且图像宽高比为第一宽高比的第一目标画面,从复制画面中裁剪出包含第二主播、且图像宽高比为第二宽高比的第二目标画面。Afterwards, the first target screen containing the first host and having the first aspect ratio can be cut out from the live screen, and the second target screen containing the second host and having the second aspect ratio can be cut out from the copied screen. aspect ratio of the second target screen.
参见图6,图6为本申请实施例中显示第一目标画面和第二目标画面的一种示意图,主播A和主播B所在的第一目标画面(灰色区域的左半区域)和第二目标画面(灰色区域的右半区域)左右拼接显示。可以看出,拼接之后的最终画面与屏幕分辨率相匹配。并且,主播A居中显示在左半区域,主播B居中显示在右半区域,具有较好的显示效果,因此,可以提升直播体验。Referring to Figure 6, Figure 6 is a schematic diagram showing the first target screen and the second target screen in the embodiment of the present application, the first target screen (the left half of the gray area) and the second target screen where anchor A and anchor B are located The screen (the right half of the gray area) is spliced left and right. It can be seen that the final picture after splicing matches the screen resolution. In addition, anchor A is centered and displayed in the left half area, and anchor B is centered and displayed in the right half area, which has a better display effect, so it can improve the live broadcast experience.
在步骤S440中,显示第一目标画面和第二目标画面。In step S440, the first target screen and the second target screen are displayed.
本申请实施例中,显示第一目标画面和第二目标画面,指的是同时显示第一目标画面和第二目标画面。在一些实施方式中,可以将第一目标画面和第二目标画面按照大小窗的方式进行显示,即第一目标画面和第二目标画面中的一个画面以大窗口(直播画面的最大显示窗口)显示,其他画面以小窗口显示,观众点击不同的画面时,可以对大小窗口进行切换。例如,第二主播的数量为2个,那么第二目标画面的数量也为2个。如果将第一目标画面按照大窗口进行显示,两个第二目标画面按照小窗口进行显示,那么观众点击其中一个第二目标画面后,该第二目标画面将由小窗口切换为大窗口,而第一目标画面将由大窗口切换为小窗口。In this embodiment of the present application, displaying the first target screen and the second target screen refers to simultaneously displaying the first target screen and the second target screen. In some implementations, the first target picture and the second target picture can be displayed in the form of large and small windows, that is, one of the first target picture and the second target picture is displayed in a large window (the largest display window of the live picture) Display, other screens are displayed in small windows, and when viewers click on different screens, they can switch between large and small windows. For example, if the number of second anchors is 2, then the number of second target images is also 2. If the first target screen is displayed as a large window, and the two second target screens are displayed as small windows, then after the viewer clicks one of the second target screens, the second target screen will be switched from a small window to a large window, and the second target screen will be switched from a small window to a large window. A target screen will be switched from a large window to a small window.
在又一些实施方式中,可以按照预设拼接显示方式,将第一目标画面和第二目标画面进行拼接显示。其中,预设拼接显示方式基于第一目标画面和第二目标画面的总数量确定,也就是基于第一主播和第二主播的总数量确定。例如,如果第一目标画面的数量为1个,第二目标画面的数量也为1个,可以将第一目标画面和第二目标画面左右拼接显示;如果第一目标画面的数量为1个,第二目标画面的数量为2个,可以将第一目标画面和第二目标画面按上、下左、下右方式进行拼接显示等等。In still some implementation manners, the first target frame and the second target frame may be spliced and displayed according to a preset spliced display manner. Wherein, the preset spliced display mode is determined based on the total number of the first target picture and the second target picture, that is, determined based on the total number of the first anchor and the second anchor. For example, if the quantity of the first target picture is 1, and the quantity of the second target picture is also 1, the first target picture and the second target picture can be spliced and displayed left and right; if the quantity of the first target picture is 1, The number of the second target screen is 2, and the first target screen and the second target screen can be spliced and displayed in the manner of top, bottom left, bottom right and so on.
本申请实施例的连麦直播方法,在获取基于第一主播的第一直播流以及第二主播的 第二直播流合流而生成的目标直播流后,可以对目标直播流中的直播画面进行复制,得到复制画面。基于第一主播在直播画面中的第一位置信息,从直播画面中裁剪出使第一主播居中显示的、且与观众端的屏幕分辨率匹配的第一目标画面,基于第二主播在直播画面中的第二位置信息,从复制画面中裁剪出使第二主播居中显示的、与屏幕分辨率匹配的第二目标画面,并对第一目标画面和第二目标画面进行拼接显示。本申请分别从直播画面和复制画面中裁剪出使第一主播居中显示的第一目标画面和使第二主播居中显示的第二目标画面作为最终的画面,并且,和不同屏幕分辨率的观众端相匹配,从而可以提升最终的显示效果。In the live broadcast method of the embodiment of the present application, after obtaining the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor, the live screen in the target live stream can be copied , get the copy screen. Based on the first position information of the first anchor in the live broadcast image, cut out from the live broadcast image a first target image that is displayed in the center of the first anchor and matches the screen resolution of the viewer, and based on the second anchor’s position in the live broadcast image The second position information of the copied screen is cut out to make the second target screen displayed in the center of the second anchor and match the screen resolution, and the first target screen and the second target screen are spliced and displayed. This application respectively cuts out the first target picture centered by the first anchor and the second target picture displayed centered by the second anchor from the live broadcast picture and the copied picture as the final picture, and is compatible with viewers with different screen resolutions Matching, which can improve the final display effect.
相应于上述方法实施例,本申请实施例还提供了一种连麦直播装置,参见图7,该连麦直播装置700包括:Corresponding to the above-mentioned method embodiment, the embodiment of the present application also provides a wheat-connected live broadcast device, as shown in FIG. 7 , the wheat-connected live broadcast device 700 includes:
目标直播流获取模块710,用于获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;第二主播是与第一主播连麦的主播;The target live stream acquisition module 710 is used to obtain the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is an anchor connected with the first anchor;
画面复制模块720,用于对目标直播流中的直播画面进行复制,得到直播画面对应的复制画面;The picture copy module 720 is used to copy the live picture in the target live stream to obtain the copied picture corresponding to the live picture;
目标画面裁剪模块730,用于从直播画面中裁剪出包含第一主播的第一目标画面,从复制画面中裁剪出包含第二主播的第二目标画面;The target picture cutting module 730 is used to cut out the first target picture comprising the first anchor from the live picture, and cut out the second target picture comprising the second anchor from the copied picture;
目标画面显示模块740,用于显示第一目标画面和第二目标画面。A target screen display module 740, configured to display the first target screen and the second target screen.
在一些实施方式中,目标画面裁剪模块730,具体用于从直播画面中裁剪出使第一主播居中显示的第一目标画面;从复制画面中裁剪出使第二主播居中显示的第二目标画面。In some implementations, the target picture cropping module 730 is specifically configured to cut out the first target picture that makes the first anchor displayed in the center from the live picture; cuts out the second target picture that makes the second anchor show in the center from the copied picture .
在一些实施方式中,目标画面裁剪模块730,具体用于基于第一主播在直播画面中的第一位置信息,从直播画面中裁剪出包含第一主播的第一目标画面;基于第二主播在直播画面中的第二位置信息,从复制画面中裁剪出包含第二主播的第二目标画面。In some implementations, the target picture cropping module 730 is specifically configured to cut out the first target picture containing the first anchor from the live picture based on the first position information of the first anchor in the live picture; The second position information in the live image is used to cut out the second target image including the second anchor from the copied image.
在一些实施方式中,目标画面显示模块740,具体用于按照预设拼接显示方式,将第一目标画面和第二目标画面进行拼接显示。In some implementations, the target screen display module 740 is specifically configured to splice and display the first target screen and the second target screen according to a preset splicing display manner.
在一些实施方式中,目标画面裁剪模块730,具体用于基于自身的屏幕分辨率和预设拼接显示方式,确定第一宽高比和第二宽高比;从直播画面中裁剪出包含第一主播、且图像宽高比为第一宽高比的第一目标画面;从复制画面中裁剪出包含第二主播、且图像宽高比为第二宽高比的第二目标画面。In some implementations, the target picture cropping module 730 is specifically configured to determine the first aspect ratio and the second aspect ratio based on its own screen resolution and preset splicing display mode; A first target frame with an anchor and an image aspect ratio of the first aspect ratio; a second target image including a second anchor and an image aspect ratio of a second aspect ratio is cut out from the copied image.
在一些实施方式中,画面复制模块720,具体用于将位于第一显示层的目标直播流中的直播画面复制到第二显示层,得到位于第二显示层中的复制画面。In some implementations, the picture copying module 720 is specifically configured to copy the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
上述装置中各模块或单元的具体细节已经在对应的方法中进行了详细的描述,因此 此处不再赘述。The specific details of each module or unit in the above device have been described in detail in the corresponding method, so they will not be repeated here.
应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元,但是这种划分并非强制性的。实际上,根据本申请的实施方式,上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之,上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. Actually, according to the embodiment of the present application, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units.
在本申请的示例性实施例中,还提供一种电子设备,包括:处理器;用于存储处理器可执行指令的存储器;其中,处理器被配置为执行本示例实施方式中上述连麦直播方法。In an exemplary embodiment of the present application, there is also provided an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the above-mentioned Lianmai live broadcast in this exemplary embodiment method.
图8为本申请实施例中电子设备的一种结构示意图。需要说明的是,图8示出的电子设备800仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。FIG. 8 is a schematic structural diagram of an electronic device in an embodiment of the present application. It should be noted that the electronic device 800 shown in FIG. 8 is only an example, and should not limit the functions and scope of use of this embodiment of the present application.
如图8所示,电子设备800包括中央处理单元(CPU)801,其可以根据存储在只读存储器(ROM)802中的程序或者从存储部分808加载到随机访问存储器(RAM)803中的程序而执行各种适当的动作和处理。在RAM 803中,还存储有系统操作所需的各种程序和数据。中央处理单元801、ROM 802以及RAM 803通过总线804彼此相连。输入/输出(I/O)接口805也连接至总线804。As shown in FIG. 8 , an electronic device 800 includes a central processing unit (CPU) 801, which can operate according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage section 808 into a random access memory (RAM) 803 Instead, various appropriate actions and processes are performed. In RAM 803, various programs and data necessary for system operation are also stored. The central processing unit 801, ROM 802, and RAM 803 are connected to each other through a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804 .
以下部件连接至I/O接口805:包括键盘、鼠标等的输入部分806;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分807;包括硬盘等的存储部分808;以及包括诸如局域网(LAN)卡、调制解调器等的网络接口卡的通信部分809。通信部分809经由诸如因特网的网络执行通信处理。驱动器810也根据需要连接至I/O接口805。可拆卸介质811,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器810上,以便于从其上读出的计算机程序根据需要被安装入存储部分808。The following components are connected to the I/O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 808 including a hard disk, etc. and a communication section 809 including a network interface card such as a local area network (LAN) card, a modem, or the like. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I/O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 810 as necessary so that a computer program read therefrom is installed into the storage section 808 as necessary.
特别地,根据本申请的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本申请的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分809从网络上被下载和安装,和/或从可拆卸介质811被安装。在该计算机程序被中央处理单元801执行时,执行本申请的装置中限定的各种功能。In particular, according to the embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication portion 809 and/or installed from removable media 811 . When the computer program is executed by the central processing unit 801, various functions defined in the apparatus of the present application are performed.
本申请实施例中,还提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述连麦直播方法。In the embodiment of the present application, there is also provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned method for live broadcasting with connected microphones is realized.
需要说明的是,本申请所示的计算机可读存储介质例如可以是—但不限于—电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读 存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器、只读存储器、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本申请中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。计算机可读存储介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:无线、电线、光缆、射频等等,或者上述的任意合适的组合。It should be noted that the computer-readable storage medium described in this application may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more conductors, portable computer diskettes, hard disks, random access memory, read-only memory, erasable programmable read-only memory (EPROM) or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Program code contained on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wires, optical cables, radio frequency, etc., or any suitable combination of the above.
本申请实施例中,还提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述连麦直播方法。In the embodiment of the present application, a computer program product is also provided. When the computer program product is run on a computer, the computer is made to execute the above-mentioned method for live broadcasting with connected microphones.
需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relative terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these No such actual relationship or order exists between entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
以上所述仅是本申请的具体实施方式,使本领域技术人员能够理解或实现本申请。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本申请的精神或范围的情况下,在其它实施例中实现。因此,本申请将不会被限制于本文所述的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above descriptions are only specific implementation manners of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the present application will not be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

  1. 一种连麦直播方法,包括:A live broadcast method for connecting wheat, comprising:
    获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;所述第二主播是与所述第一主播连麦的主播;Obtaining a target live stream generated based on the merging of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is a host that is linked with the first anchor;
    对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面;Copying the live image in the target live stream to obtain the copied image corresponding to the live image;
    从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面;Cutting out a first target picture including the first anchor from the live picture, and cutting out a second target picture including the second anchor from the copied picture;
    显示所述第一目标画面和所述第二目标画面。The first target screen and the second target screen are displayed.
  2. 根据权利要求1所述的方法,其中,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:The method according to claim 1, wherein the first target picture including the first anchor is cut out from the live picture, and the second target picture including the second anchor is cut out from the copied picture ,include:
    从所述直播画面中裁剪出使所述第一主播居中显示的第一目标画面,从所述复制画面中裁剪出使所述第二主播居中显示的第二目标画面。Cutting out a first target picture for displaying the first anchor in the center from the live picture, and cutting out a second target picture for displaying the second anchor in the center from the copied picture.
  3. 根据权利要求1所述的方法,其中,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:The method according to claim 1, wherein the first target picture including the first anchor is cut out from the live picture, and the second target picture including the second anchor is cut out from the copied picture ,include:
    基于所述第一主播在所述直播画面中的第一位置信息,从所述直播画面中裁剪出包含所述第一主播的第一目标画面;Based on the first position information of the first anchor in the live image, cutting out a first target image including the first anchor from the live image;
    基于所述第二主播在所述直播画面中的第二位置信息,从所述复制画面中裁剪出包含所述第二主播的第二目标画面。Based on the second position information of the second anchor in the live image, a second target image including the second anchor is cut out from the copied image.
  4. 根据权利要求1所述的方法,其中,所述显示所述第一目标画面和所述第二目标画面,包括:The method according to claim 1, wherein the displaying the first target screen and the second target screen comprises:
    按照预设拼接显示方式,将所述第一目标画面和所述第二目标画面进行拼接显示。The first target image and the second target image are spliced and displayed according to a preset spliced display manner.
  5. 根据权利要求4所述的方法,其中,从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面,包括:The method according to claim 4, wherein the first target picture including the first anchor is cut out from the live picture, and the second target picture including the second anchor is cut out from the copied picture ,include:
    基于自身的屏幕分辨率和所述预设拼接显示方式,确定第一宽高比和第二宽高比;Determine the first aspect ratio and the second aspect ratio based on its own screen resolution and the preset splicing display mode;
    从所述直播画面中裁剪出包含所述第一主播、且图像宽高比为所述第一宽高比的第一目标画面;Cutting out a first target picture containing the first anchor and having an image aspect ratio equal to the first aspect ratio from the live broadcast picture;
    从所述复制画面中裁剪出包含所述第二主播、且图像宽高比为所述第二宽高比的第二目标画面。A second target frame containing the second anchor and having an image aspect ratio equal to the second aspect ratio is cut out from the copied image.
  6. 根据权利要求1所述的方法,其中,对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面,包括:The method according to claim 1, wherein copying the live image in the target live stream to obtain the copied image corresponding to the live image includes:
    将位于第一显示层的所述目标直播流中的直播画面复制到第二显示层,得到位于第二显示层中的复制画面。Copying the live picture in the target live stream on the first display layer to the second display layer to obtain the copied picture on the second display layer.
  7. 一种连麦直播装置,包括:A live broadcast device with connected wheat, comprising:
    目标直播流获取模块,用于获取基于第一主播的第一直播流以及第二主播的第二直播流合流而生成的目标直播流;所述第二主播是与所述第一主播连麦的主播;The target live stream acquisition module is used to acquire the target live stream generated based on the confluence of the first live stream of the first anchor and the second live stream of the second anchor; the second anchor is linked with the first anchor anchor;
    画面复制模块,用于对所述目标直播流中的直播画面进行复制,得到所述直播画面对应的复制画面;A picture copying module, configured to copy the live picture in the target live stream to obtain the copied picture corresponding to the live picture;
    目标画面裁剪模块,用于从所述直播画面中裁剪出包含所述第一主播的第一目标画面,从所述复制画面中裁剪出包含所述第二主播的第二目标画面;A target picture cutting module, configured to cut out a first target picture including the first anchor from the live picture, and cut out a second target picture including the second anchor from the copied picture;
    目标画面显示模块,用于显示所述第一目标画面和所述第二目标画面。A target screen display module, configured to display the first target screen and the second target screen.
  8. 一种电子设备,包括:处理器,所述处理器用于执行存储于存储器的计算机程序,所述计算机程序被处理器执行时实现权利要求1-6任一项所述的方法的步骤。An electronic device, comprising: a processor, the processor is configured to execute a computer program stored in a memory, and when the computer program is executed by the processor, the steps of the method described in any one of claims 1-6 are realized.
  9. 一种计算机可读存储介质,其上存储有计算机程序,其中,所述计算机程序被处理器执行时实现权利要求1-6任一项所述的方法的步骤。A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the steps of the method according to any one of claims 1-6 are implemented.
  10. 一种计算机程序产品,其中,当所述计算机程序产品在计算机上运行时,使得所述计算机执行权利要求1-6任一项所述的方法的步骤。A computer program product, wherein, when the computer program product is run on a computer, the computer is made to execute the steps of the method according to any one of claims 1-6.
PCT/CN2022/113548 2021-09-26 2022-08-19 Livestreaming voice chat method and apparatus, electronic device, medium, and program product WO2023045651A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111130158.7 2021-09-26
CN202111130158.7A CN115883856A (en) 2021-09-26 2021-09-26 Live wheat-connecting method and device, electronic equipment, medium and program product

Publications (1)

Publication Number Publication Date
WO2023045651A1 true WO2023045651A1 (en) 2023-03-30

Family

ID=85720019

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/113548 WO2023045651A1 (en) 2021-09-26 2022-08-19 Livestreaming voice chat method and apparatus, electronic device, medium, and program product

Country Status (2)

Country Link
CN (1) CN115883856A (en)
WO (1) WO2023045651A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180192080A1 (en) * 2016-12-30 2018-07-05 Facebook, Inc. Presentation of composite streams to users
CN109151497A (en) * 2018-08-06 2019-01-04 广州虎牙信息科技有限公司 A kind of even wheat live broadcasting method, device, electronic equipment and storage medium
CN110798697A (en) * 2019-11-22 2020-02-14 广州华多网络科技有限公司 Video display method, device and system and electronic equipment
CN113038220A (en) * 2019-12-25 2021-06-25 中国电信股份有限公司 Program directing method, program directing system, program directing apparatus, and computer-readable storage medium
CN113225577A (en) * 2021-05-07 2021-08-06 北京百度网讯科技有限公司 Live stream processing method, device and system, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180192080A1 (en) * 2016-12-30 2018-07-05 Facebook, Inc. Presentation of composite streams to users
CN109151497A (en) * 2018-08-06 2019-01-04 广州虎牙信息科技有限公司 A kind of even wheat live broadcasting method, device, electronic equipment and storage medium
CN110798697A (en) * 2019-11-22 2020-02-14 广州华多网络科技有限公司 Video display method, device and system and electronic equipment
CN113038220A (en) * 2019-12-25 2021-06-25 中国电信股份有限公司 Program directing method, program directing system, program directing apparatus, and computer-readable storage medium
CN113225577A (en) * 2021-05-07 2021-08-06 北京百度网讯科技有限公司 Live stream processing method, device and system, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN115883856A (en) 2023-03-31

Similar Documents

Publication Publication Date Title
WO2021068558A1 (en) Simultaneous subtitle translation method, smart television, and storage medium
KR100955082B1 (en) The Electronic Bulletin Board with multi-display apparatus using Layer screen
US9584761B2 (en) Videoconference terminal, secondary-stream data accessing method, and computer storage medium
WO2019227429A1 (en) Method, device, apparatus, terminal, server for generating multimedia content
CN113778360B (en) Screen projection method and electronic equipment
WO2017080175A1 (en) Multi-camera used video player, playing system and playing method
US10547663B2 (en) System and method for web conferencing presentation pre-staging
US20180249213A1 (en) Cognitive image obstruction
CN113225577A (en) Live stream processing method, device and system, electronic equipment and storage medium
CN113992926B (en) Interface display method, device, electronic equipment and storage medium
JP7471510B2 (en) Method, device, equipment and storage medium for picture to video conversion - Patents.com
CN112017264B (en) Display control method and device for virtual studio, storage medium and electronic equipment
WO2023045651A1 (en) Livestreaming voice chat method and apparatus, electronic device, medium, and program product
CN109948082B (en) Live broadcast information processing method and device, electronic equipment and storage medium
US10616559B1 (en) Virtual stereo device redirection for virtual desktops
CN107680038B (en) Picture processing method, medium and related device
US11711408B2 (en) Content appearance conversion for remote application sharing
CN115396684A (en) Connecting wheat display method and device, electronic equipment and computer readable medium
CN116347140A (en) Video synchronous playing method and device, storage medium and electronic equipment
CN112004100B (en) Driving method for integrating multiple audio and video sources into single audio and video source
CN113411636A (en) Live wheat-connecting method and device, electronic equipment and computer-readable storage medium
CN112672089B (en) Conference control and conference participation method, conference control and conference participation device, server, terminal and storage medium
CN111294628A (en) Multi-channel immersive video and audio control system
WO2023036275A1 (en) Video processing method and apparatus, electronic device, medium, and program product
CN110990109A (en) Spliced screen redisplay method, terminal, system and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22871707

Country of ref document: EP

Kind code of ref document: A1