WO2021204139A1 - Video displaying method, device, equipment, and storage medium - Google Patents

Video displaying method, device, equipment, and storage medium Download PDF

Info

Publication number
WO2021204139A1
WO2021204139A1 PCT/CN2021/085776 CN2021085776W WO2021204139A1 WO 2021204139 A1 WO2021204139 A1 WO 2021204139A1 CN 2021085776 W CN2021085776 W CN 2021085776W WO 2021204139 A1 WO2021204139 A1 WO 2021204139A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
area
display
viewers
live
Prior art date
Application number
PCT/CN2021/085776
Other languages
French (fr)
Chinese (zh)
Inventor
陈航
王程
张腊梅
童晓俊
Original Assignee
钉钉控股（开曼）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 钉钉控股（开曼）有限公司 filed Critical 钉钉控股（开曼）有限公司
Publication of WO2021204139A1 publication Critical patent/WO2021204139A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543—Billing, e.g. for subscription services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the present invention relates to the field of Internet technology, and in particular to a video display method, device, equipment and storage medium.
  • the live video mode has become a common interactive mode in people's entertainment and work.
  • anchor In the live video scene, there are mainly two user roles involved: anchor and audience.
  • the host refers to the party who publishes the video, and the audience is the party who watches the video.
  • viewers At present, in the process of watching live video, viewers usually interact with the anchor by sending barrage, leaving a message, and giving gifts.
  • the interactive mode between the host and the audience also needs to be expanded to meet the needs of different application scenarios.
  • the embodiments of the present invention provide a video display method, device, equipment, and storage medium, which can expand the interactive mode in the live video scene.
  • an embodiment of the present invention provides a video display method, the method including:
  • the second video corresponding to each of the multiple viewers is displayed in the second area of the live broadcast interface.
  • an embodiment of the present invention provides a video display device, which includes:
  • An acquiring module configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
  • the display module is configured to display the first video in the first area of the live broadcast interface; and display the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
  • an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the first aspect.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium that stores executable code on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the first aspect.
  • an embodiment of the present invention provides a video display method, the method including:
  • the 3D live broadcast image is sent to the 3D video viewing device corresponding to each of the multiple viewers.
  • an embodiment of the present invention provides a video display device, which includes:
  • the acquiring module is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers.
  • the second video is a video obtained by shooting a corresponding viewer during watching the first video.
  • the video and the second video corresponding to each of the plurality of viewers are 2D videos;
  • the generating module is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the image corresponding to the first video Corresponding 3D video pictures, in the second area of the 3D live pictures, used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
  • the sending module is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
  • an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the fifth aspect.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the fifth aspect.
  • the anchor when an anchor is conducting a live broadcast, in order to allow the anchor to watch the behavior of the viewer during watching his live video, in the live broadcast interface, in addition to displaying the first video corresponding to the anchor, The second video corresponding to each of multiple viewers can be displayed. Based on this, the video images of the anchor and the viewer can be viewed at the same time through the live broadcast interface, and each other's behavior can be sensed to facilitate more forms of interaction.
  • FIG. 1 is a schematic diagram of a network architecture of a live broadcast scene provided by an embodiment of the present invention
  • FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of the principle of a method for performing video display according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a display effect of a live broadcast interface provided by an embodiment of the present invention.
  • Figure 5 is a schematic diagram of a video decoding process provided by an embodiment of the present invention.
  • FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of the display effect of another live broadcast interface provided by an embodiment of the present invention.
  • FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a display effect of another live broadcast interface provided by an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of another display effect of a live broadcast interface provided by an embodiment of the present invention.
  • FIG. 11 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 12;
  • FIG. 14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 14.
  • the words “if” and “if” as used herein can be interpreted as “when” or “when” or “in response to determination” or “in response to detection”.
  • the phrase “if determined” or “if detected (statement or event)” can be interpreted as “when determined” or “in response to determination” or “when detected (statement or event) )” or “in response to detection (statement or event)”.
  • the video display method provided by the embodiment of the present invention can be applied to a live broadcast scene.
  • a typical network architecture is shown in Figure 1.
  • the network architecture includes a terminal device 1, one or more servers 2. And the terminal device 3, where the terminal device 1 is the terminal device of the host, and the terminal device 3 is the terminal device of any viewer watching the live video.
  • the anchor shoots the live video through the terminal device 1, and transmits the live video to the server 2, and the viewer's terminal device 3 pulls the live video from the server 2 for the viewer to watch.
  • an application program (APP) supporting the live broadcast function may be run in the above-mentioned terminal device 1, the server 2, and the terminal device 3.
  • This application includes but is not limited to instant messaging applications.
  • the application programs running in the terminal devices such as the terminal device 1 and the terminal device 3 are called client programs, and the application programs running in the server 2 are called server programs.
  • the host In order to conduct live broadcast, the host will register an account in the server 2 by operating the corresponding client program. It can be considered that the account corresponds to a live broadcast room. Therefore, when the host logs in to the account to start live broadcast, the live video will be displayed in the live broadcast. The viewer can use the client program in the terminal device 3 to trigger a viewing request to watch the live room corresponding to the account to the server 2 to watch the live video.
  • the terminal device 1 should be understood as a general term for all the terminal devices that the host needs to use for live broadcast.
  • the terminal device 1 may include a camera for shooting live video, and terminal devices such as a PC, a notebook computer, a tablet computer, and a mobile phone that can watch the live video.
  • terminal device 1 may also be a terminal device that has both video shooting and access to the live room to watch the live video, such as a laptop computer, a tablet computer, a mobile phone, and so on.
  • the live video uploaded by the terminal device 1 to the server 2 is generally a video that has undergone encoding processing. Through the encoding processing, the transmission data volume of the live video can be reduced.
  • the live video pulled by the terminal device 3 from the server 2 is also an encoded video, and the decoded live video is displayed after the terminal device 3 performs local decoding processing.
  • the server 2 receives the encoded live video uploaded by the terminal device 1, it can decode the live video as needed, and then perform some processing on the decoded live video, and the processed live video will be encoded again Processing, for the terminal device 3 to pull.
  • the foregoing briefly describes the network architecture to which the video display method provided by the embodiment of the present invention is applicable.
  • the video display method provided by the embodiment of the present invention can be executed by the server 2 described above.
  • the server 2 can use The above-mentioned server-side program is running to execute the method.
  • FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
  • the host in order for the host to be able to see the viewer’s situation in the process of watching his own live video—the first video—he needs to obtain the second video of the viewer while watching the first video, and the second video reflects the corresponding viewer.
  • the status during watching the first video that is, whether you are watching the first video seriously. Therefore, in the live interface that presents the first video of the host (that is, the interface of the corresponding live room), the second video corresponding to each of the multiple viewers is also displayed.
  • the anchor activates the live broadcast function by operating the APP in the terminal device 1, collects the anchor's live video, the first video, through the terminal device 1, and uploads the first video to the server 2.
  • the server 2 displays the anchor's first video in the live broadcast interface 401, and may deliver the live broadcast interface 401 to the terminal device 1 for display.
  • the live interface 401 is also presented on the screen of 3.
  • the live broadcast interface 401 may be divided into different areas, and different areas display different content. As shown in FIG. 4, it can be considered that the live broadcast interface 401 includes two major areas: a video display area A and an interactive message display area B. In the initial situation, when only the first video of the host needs to be displayed, only the first video is displayed in the video display area A.
  • the interactive message display area B is used to display various interactive messages between the viewer and the anchor.
  • the above steps are started.
  • the viewer’s video screen can be collected through its corresponding terminal device 3, which is called the second video, and the second video Upload to server 2.
  • the server 2 will render the second video of the viewer in the live broadcast interface.
  • the above condition may be: when a viewer triggers a viewing request for the first video, the second video corresponding to the viewer is acquired. Specifically, the viewer triggers a viewing request for the first video, which may be considered to have triggered the viewing request when the viewer accesses the host’s live broadcast room.
  • the server 2 delivers the video shooting to the terminal device 3 corresponding to the viewer. Instructed, the terminal device 3 turns on the video shooting function to shoot the second video corresponding to the viewer, and transmits the captured second video to the server 2 in real time.
  • the above condition may also be: the anchor triggers a preset operation. That is, based on the preset operation triggered by the anchor, the second video corresponding to each of the multiple viewers currently watching the first video is obtained.
  • the live mode interface 401 may include a button illustrated in the figure: live mode 402.
  • live mode 402. When the anchor clicks on the live mode 402, it is considered that the anchor has triggered the aforementioned preset operation.
  • the server 2 issues a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video, and each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and The captured second video is transmitted to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of a plurality of viewers.
  • the above condition may also be: if the number of multiple viewers watching the first video reaches a set threshold, then the second video corresponding to each of the multiple viewers is acquired. Assuming that the threshold is 100 people, when the number of viewers accessing the live broadcast room reaches 100, the server 2 will issue a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video. Each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and transmits the captured second video to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of the multiple viewers. video.
  • the above conditions may also include: clicking on the live mode 402, and the number of multiple viewers watching the first video reaches a set threshold.
  • the server 2 may generate a live broadcast interface 403 as shown in FIG. 4.
  • the video display area A is divided into two areas: a first area A1 and a second area A2.
  • the first video of the host is displayed in the first area A1, and the second videos of the above seven viewers are displayed in the second area A2.
  • the first area A1 is located in the middle area of the video display area A, and the second area A2 is arranged to surround the first area A1.
  • the setting positions of the first area A1 and the second area A2 are not limited to this.
  • the first area A1 and the second area A2 present a vertical position relationship: the upper half of the video display area A is used as the first Area A1, the lower half is regarded as the second area A2.
  • each second video in the second area A2 multiple sub-areas can be determined in the second area A2, and one sub-area is used to display a second video, so that the resolution of the second video is related to the sub-areas.
  • the size of the area matches.
  • a target sub-region corresponding to a certain second video may be randomly determined among multiple sub-regions, so as to display the second video in the target sub-region.
  • the configuration information of the anchor for multiple viewers can also be obtained to determine the display position of the second video corresponding to each of the multiple viewers in the second area A2, that is, which sub-area should be displayed in accordance with the configuration information.
  • the host s configuration information for multiple viewers can reflect which viewers the host wants to focus on (the host can create a list of viewers that need to be focused on). Therefore, assuming that the host sets viewers 1 and 2 to focus on, you can change The second videos of the two viewers are displayed at a relatively prominent position in the second area A2, such as the position illustrated in FIG. 4.
  • the host can trigger a hiding operation on the interactive message display area B, so that it can be hidden
  • the interactive message display area B, and the boundary of the second area A2 is extended to the interactive message display area B, thereby forming a live interface 404.
  • the second videos of viewers 8 and 9 are also included: S8 and S9 .
  • the interactive message display area B can be implemented as a card (or panel) that can be expanded and collapsed, and the card is collapsed to achieve a hidden effect.
  • the terminal device 1 of the host will encode the first video collected, and then transmit the encoded first video to the server 2.
  • the second video corresponding to each of the above-mentioned multiple viewers may also be an encoded video, that is, after the corresponding terminal device 3 collects the second video, after encoding the second video, the encoded second video is transmitted To server 2. Since the server 2 needs to generate the live broadcast interface 403 as shown in FIG. 4 based on the received encoded first video and each second video, in the process of generating the live broadcast interface 403, it is necessary to compare the encoded first video and each second video.
  • the second video is decoded, so that each decoded video is rendered according to the display area set in the live broadcast interface 403.
  • the above-mentioned decoding process performed by the server 2 generally does not cause a large delay.
  • the server 2 performs the above-mentioned decoding process. This may cause a relatively large delay. For this reason, the embodiment of the present invention provides the following solutions:
  • the server 2 distributes the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each.
  • the server 2 receives the decoded second video respectively sent by the at least two devices, and displays the decoded second video in the second area.
  • the above at least two devices are assumed to be device A, device B, and device C.
  • the number of the above-mentioned multiple viewers is 50, and assume that these 50 viewers are all connected to the live broadcast room at very close times.
  • the terminal devices corresponding to the 50 viewers send the second video collected by each to the server 2 after being encoded, and the server 2 allocates 20 second videos to device A, and the other 20 second videos Allocate to device B, and the remaining 10 second videos are allocated to device C, so that the three devices can decode the received second videos in parallel.
  • the server 2 renders the decoded second video to the corresponding position in the second area of the live interface.
  • FIG. 5 does not illustrate the decoding and display process of the first video of the host, it is consistent with the principle of the decoding and display process of the second video.
  • the anchor when an anchor is conducting a live broadcast, in the live interface, in addition to the first video corresponding to the anchor, the second video corresponding to multiple viewers can also be displayed, so that the anchor can watch each audience Behavior during watching its live video. Based on the perception of each viewer's behavior during watching the live video, the anchor can interact with the viewer in a variety of ways.
  • FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 6, the video display method may include the following steps:
  • multiple sub-regions may be determined in the first area, so that the first video and the second video corresponding to at least one viewer selected by the host are displayed in the multiple sub-regions in a one-to-one correspondence.
  • the display result of the first video and the multiple second videos in step 602 is the live broadcast interface 403 illustrated in FIG. 4.
  • the anchor selects viewer 1 and viewer 2 from the 7 viewers indicated in the live interface 403, at this time, as shown in FIG. 7, the second videos S1 and S2 corresponding to viewer 1 and viewer 2 will be from the second area A2.
  • the three sub-areas illustrated in FIG. 7 may be divided into the first area A1, which are respectively used to display the first video and the second video S1 and S2.
  • the first area can be divided into N equal parts to obtain multiple sub-areas, and each sub-areas is used to display a video.
  • N-1 is the number of odd viewers selected for the host.
  • the second video corresponding to each of multiple viewers is displayed in the second area of the live broadcast interface, in order to ensure the listening effect of the viewers, the second video is muted, that is, there are only pictures and no sound.
  • the anchor selects at least one of the above-mentioned viewers and moves the second video of the at least one viewer to the first area for display
  • the voice call function corresponding to the at least one viewer can be activated. That is to say, previously, the voice call function (such as the microphone) of each viewer was turned off.
  • the voice call function of the selected viewer is turned on, so that the selected viewer can talk to the host. Interaction, optionally, the content of the voice interaction can also be heard by other viewers.
  • FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 8, the video display method may include the following steps:
  • the display result of the first video and the multiple second videos in step 802 is the live broadcast interface 901 illustrated in FIG. 9.
  • the live broadcast interface 901 the first video of the host is displayed in the first area Q1
  • the second video of the 7 viewers assumed in the foregoing embodiment is displayed in the second area Q2.
  • the host triggers a screen sharing operation in the live interface 901 based on actual needs, he can shoot or obtain the third video containing the host’s terminal device screen by other means, that is, the third video contains the terminal device The content of the data displayed on the screen.
  • the first video is mainly obtained by shooting the anchor itself.
  • the third video is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 902 at this time.
  • the third video can be displayed in the first area Q1 originally used to display the first video, and Move the first video to another location (called the third area) for display.
  • the third area is the second area Q2.
  • the third area may also be another area different from the second area Q2.
  • the screen size of the first video of the host may be larger than the screen size of the second video.
  • the display result of the first video and the multiple second videos in step 802 is the live interface 403 illustrated in FIG. 10, in which the second area A2 of the second videos of multiple viewers is displayed Surround the first area A1 of the first video of the host.
  • the host triggers a screen sharing operation in the live broadcast interface 403
  • the third video containing the data content displayed on the host's terminal device screen is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 1001 at this time.
  • the display area of the third video covers at least the first area A1, that is, the third video is displayed in the first area A1, and the original display and the first video in the first area A1 are transferred to the third area Inside display.
  • the third area may be located in the second area A2, or may be another location area in the live broadcast interface, for example, the area A3 located in the interactive message display area B.
  • the entire video display area A may also be used to display the third video.
  • the second video corresponding to each of the multiple viewers may be moved from the second area A2 to the fourth area of the live interface 1001 for display, so as to expand the display area of the third video.
  • the fourth area may be, for example, area A4 located in the interactive message display area B. Since the video display area A is composed of the above-mentioned first area A1 and the second area A2, the purpose of displaying the third video in the video display area A can be achieved through the above-mentioned process.
  • the interactive message display area B can be hidden in the live interface 1001 at this time.
  • the interactive message display area B can also be moved to other location areas for display.
  • the existing interactive messages such as barrage can be configured to be displayed in the live broadcast interface in a set form, for example, in the video display area according to a certain set Way to display.
  • the anchor is based on the display of the second video of a certain viewer, and when it is found that the viewer is not watching the first video seriously, it sends a targeted reminder to the viewer Voice or text message.
  • the anchor can interact with the audience in more forms, expanding the interactive form.
  • the video display method provided by the above embodiments of the present invention can be used in practical application scenarios such as a teacher's network teaching, a company's network conference, and the like.
  • the teacher can give lectures through live broadcast. If the teacher cannot see the student’s listening status and does not know whether the student is listening carefully, it is likely that some students’ poor self-consciousness will lead to ineffective teaching. good. For this reason, when the teacher conducts live teaching in the live broadcast room, the video pictures of the teacher and each student are displayed in the live broadcast interface at the same time, so that the teacher can clearly perceive the students' listening status, so as to timely find the students who are not listening carefully. Reminders can also realize the teaching interaction with students.
  • the first video in the foregoing embodiment may be the teacher's image
  • the third video may be the PPT courseware displayed on the teacher's computer terminal.
  • the company director can organize the meeting through live broadcast, that is, the company director starts the live broadcast, and the company staff access the live room to participate in the meeting.
  • the video screen of each participant can also be displayed in the live broadcast interface.
  • FIG. 11 is a flowchart of yet another video display method provided by an embodiment of the present invention.
  • the video display method may be executed by the server mentioned above. As shown in FIG. 11, the video display method may include the following steps:
  • the second video is a video obtained by shooting the corresponding viewer while watching the first video.
  • the first video and the second video corresponding to each of the multiple viewers The second video is a 2D video.
  • the videos in the foregoing other embodiments are all 2D videos, that is, the live broadcast interface viewed by the audience is a 2D picture.
  • a 3D live broadcast image may be provided to the audience.
  • the above-mentioned first video is captured by a camera set in the space where the host is located.
  • the second video corresponding to a viewer is also captured by a camera set in the space where the viewer is located.
  • Both the first video and the second video may be 2D videos.
  • the first video can also include the surrounding environment images of the host, and the second video is also the same.
  • a 3D live broadcast image can be generated according to the first video and the second video corresponding to each of the multiple viewers.
  • the existing related technology of converting 2D video to 3D video can be used to convert the first video and each second video into corresponding 3D video pictures, and then all the obtained 3D video pictures are laid out according to a certain layout method. , In order to get the 3D live broadcast picture.
  • the viewer watches the 3D live broadcast through a 3D video viewing device, he can watch the 3D video corresponding to the host in the first area of the 3D live broadcast, and in the second area of the 3D live broadcast. Watched 3D video images corresponding to multiple viewers.
  • the first area may be the central area of the 3D live broadcast picture
  • the second area may be the surrounding area of the 3D live broadcast picture.
  • the 3D video viewing device may be a virtual reality (Virtual Reality, VR for short) device, such as a VR helmet and VR glasses.
  • the 3D video viewing device may also be an augmented reality (Augmented Reality, AR for short) device, such as an AR helmet and AR glasses.
  • AR Augmented Reality
  • the 3D video viewing device may also be other wearable devices or non-wearable devices that support 3D video viewing capabilities.
  • the above-mentioned video display method may further include the following step: in response to a selection operation of at least one of the plurality of viewers by the host, moving the 3D video images corresponding to each of the selected at least one viewer into the first area.
  • the audience can watch the 3D video of the anchor and the selected audience in the first area.
  • the voice call function of the at least one viewer is enabled. At this time, any viewer can not only see the host and the 3D video images of each viewer, but also listen to it. The voice signal of the host and the selected at least one viewer.
  • the voice signal of the host and the voice signal of the at least one selected audience may have different sound source effects.
  • the voice signal of the host can be set to have the sound effect transmitted from the front of the audience to the audience, while the voice signals of other selected audiences have the sound effect transmitted from the left or right side of the audience to the audience, so as to enhance the user’s experience. Immersive viewing experience.
  • video display device of one or more embodiments of the present invention will be described in detail. Those skilled in the art can understand that these video display devices can all be configured by using commercially available hardware components through the steps taught in this solution.
  • FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention.
  • the video display device may be located in the server mentioned in the foregoing embodiment. As shown in FIG. 12, the device includes: an acquisition module 11 and a display module 12.
  • the acquiring module 11 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video.
  • the display module 12 is configured to display the first video in a first area of the live broadcast interface; and display a second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
  • the obtaining module 11 may be specifically configured to: in response to a preset operation triggered by the anchor, obtain the second video corresponding to each of the multiple viewers.
  • the acquiring module 11 may be specifically configured to: if the number of the multiple viewers reaches a set threshold, acquire the second video corresponding to each of the multiple viewers.
  • the device further includes: a determining module, configured to obtain configuration information of the anchor for the multiple viewers; and determine, according to the configuration information, that the second video corresponding to each of the multiple viewers is in the first video. The display position in the second area.
  • a determining module configured to obtain configuration information of the anchor for the multiple viewers; and determine, according to the configuration information, that the second video corresponding to each of the multiple viewers is in the first video. The display position in the second area.
  • the second video corresponding to each of the multiple viewers is an encoded video.
  • the display module 12 may be specifically configured to: distribute the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each; Receiving the decoded second video respectively sent by the at least two devices, and displaying the decoded second video in the second area.
  • the display module 12 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, display the second video corresponding to each of the at least one viewer in the first area Inside.
  • the display module 12 may be specifically configured to: determine a plurality of sub-areas in the first area; display the first video and the second video corresponding to the at least one viewer in a one-to-one correspondence. Multiple sub-regions.
  • the device further includes: a control module configured to enable a voice call function corresponding to the at least one viewer.
  • the live broadcast interface further includes: an interactive message display area.
  • the display module 12 may also be used to: in response to a hiding operation triggered on the interactive message display area, hide the interactive message display area, and extend the boundary of the second area to the interactive message display area.
  • the display module 12 may be further configured to: in response to a screen sharing operation triggered by the host, display a third video corresponding to the host in the first area, and move the first video to the It is displayed in the third area of the live broadcast interface, where the third video is obtained by shooting the screen of the host's terminal device.
  • the second area surrounds the first area.
  • the display module 12 may also be used to move the second video corresponding to each of the multiple viewers to the fourth area of the live broadcast interface for display, so as to expand the display area of the third video.
  • the display module 12 may also be used to: hide the interactive message display area in the live broadcast interface; and generate the third area and the fourth area at positions corresponding to the interactive message display area.
  • the device shown in FIG. 12 can execute the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10.
  • the structure of the video display device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a first processor 21 and a first memory 22.
  • executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the functions provided in the embodiments shown in FIGS. 1 to 10 above.
  • Video display method is described in a possible design, the structure of the video display device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a first processor 21 and a first memory 22.
  • executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the functions provided in the embodiments shown in FIGS. 1 to 10 above.
  • Video display method is described in a possible design, the structure of the video display device shown in FIG. 12 may be implemented as an electronic
  • the electronic device may also include a first communication interface 23 for communicating with other devices.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10.
  • FIG. 14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention.
  • the video display device may be located in the server mentioned in the foregoing embodiment.
  • the device includes: an acquiring module 31, a generating module 32, and a sending module 33.
  • the acquiring module 31 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers.
  • the second video is a video obtained by shooting a corresponding viewer while watching the first video.
  • a video and a second video corresponding to each of the plurality of viewers are 2D videos.
  • the generating module 32 is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the second video corresponding to the first video.
  • the second area of the 3D live picture is used to display the 3D video picture corresponding to the second video corresponding to each of the plurality of viewers.
  • the sending module 33 is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
  • the generating module 32 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, move the 3D video images corresponding to each of the at least one viewer to the first area Inside.
  • the device shown in FIG. 14 can execute the video display method provided in the embodiment shown in FIG. 11, and the detailed execution process and technical effects can be referred to the description in the foregoing embodiment, which will not be repeated here.
  • the structure of the video display device shown in FIG. 14 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a second processor 41, a second memory 42, and a second communication interface 43.
  • executable code is stored on the second memory 42.
  • the second processor 41 can at least realize the video display provided in the embodiment shown in FIG. method.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the embodiment shown in FIG. 11.
  • each implementation manner can be implemented by adding a necessary general hardware platform, and of course, it can also be implemented by a combination of hardware and software.
  • the above technical solution essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present invention can be used in one or more computer usable storage containing computer usable program codes.
  • the form of a computer program product implemented on a medium including but not limited to disk storage, CD-ROM, optical storage, etc.).
  • the video display method provided by the embodiment of the present invention can be executed by a certain program/software, and the program/software can be provided by the network side.
  • the electronic device mentioned in the foregoing embodiment can download the program/software to a local non-easy
  • the program/software is read into the memory by the CPU, and the program/software is executed by the CPU to implement the video display method provided in the foregoing embodiment.
  • the execution process please refer to the schematic diagrams in Figures 1 to 11 described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Provided in the embodiments of the present invention are a video displaying method, a device, equipment, and a storage medium. The method comprises: acquiring a first video corresponding to an anchor and second videos corresponding respectively to multiple viewers, the second videos being videos produced by recording the corresponding viewers while viewing the first video; displaying the first video in a first area of a livestreaming interface, and displaying the second videos corresponding respectively to the multiple viewers in a second area of the livestreaming interface. On such basis, video images of the anchor and of the viewers can be viewed simultaneously via the livestreaming interface, and actions of each other can be perceived, thus facilitating increased forms of interactions.

Description

视频显示方法、装置、设备和存储介质Video display method, device, equipment and storage medium 技术领域Technical field
本发明涉及互联网技术领域，尤其涉及一种视频显示方法、装置、设备和存储介质。The present invention relates to the field of Internet technology, and in particular to a video display method, device, equipment and storage medium.
背景技术Background technique
目前，视频直播方式已经成为人们娱乐、工作中一种常见的交互方式。At present, the live video mode has become a common interactive mode in people's entertainment and work.
在视频直播场景中，主要涉及两种用户角色：主播和观众。主播是指发布视频的一方，而观众是观看视频的一方。而目前，观众在观看直播视频的过程中，与主播的交互方式一般是发弹幕、留言、总礼物等方式。In the live video scene, there are mainly two user roles involved: anchor and audience. The host refers to the party who publishes the video, and the audience is the party who watches the video. At present, in the process of watching live video, viewers usually interact with the anchor by sending barrage, leaving a message, and giving gifts.
随着视频直播方式在越来越多的应用场景中被使用，主播与观众的互动方式也需要进行扩展，以满足不同应用场景的需求。As the live video mode is used in more and more application scenarios, the interactive mode between the host and the audience also needs to be expanded to meet the needs of different application scenarios.
发明内容Summary of the invention
本发明实施例提供一种视频显示方法、装置、设备和存储介质，可以扩展视频直播场景中的互动方式。The embodiments of the present invention provide a video display method, device, equipment, and storage medium, which can expand the interactive mode in the live video scene.
第一方面，本发明实施例提供一种视频显示方法，该方法包括：In a first aspect, an embodiment of the present invention provides a video display method, the method including:
获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频；Acquiring a first video corresponding to the anchor and a second video corresponding to each of the multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
在直播界面的第一区域内显示所述第一视频；Displaying the first video in the first area of the live broadcast interface;
在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频。The second video corresponding to each of the multiple viewers is displayed in the second area of the live broadcast interface.
第二方面，本发明实施例提供一种视频显示装置，该装置包括：In a second aspect, an embodiment of the present invention provides a video display device, which includes:
获取模块，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频；An acquiring module, configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
显示模块，用于在直播界面的第一区域内显示所述第一视频；在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频。The display module is configured to display the first video in the first area of the live broadcast interface; and display the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
第三方面，本发明实施例提供一种电子设备，包括：存储器、处理器；其中，所述存储器上存储有可执行代码，当所述可执行代码被所述处理器执行时，使所述处理器至少可以实现如第一方面所述的视频显示方法。In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the first aspect.
第四方面，本发明实施例提供了一种非暂时性机器可读存储介质，所述非暂时性机器可读存储介质上存储有可执行代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器至少可以实现如第一方面所述的视频显示方法。In a fourth aspect, an embodiment of the present invention provides a non-transitory machine-readable storage medium that stores executable code on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the first aspect.
第五方面，本发明实施例提供一种视频显示方法，该方法包括：In a fifth aspect, an embodiment of the present invention provides a video display method, the method including:
获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频，所述第一视频和所述多个观众各自对应的第二视频为2D视频；Acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting the corresponding viewer while watching the first video, and the first video and the multiple The second video corresponding to each viewer is a 2D video;
根据所述第一视频和所述多个观众各自对应的第二视频，生成3D直播画面，其中，所述3D直播画面的第一区域用于显示与所述第一视频相对应的3D视频画面，所述3D直播画面的第二区域内用于显示与所述多个观众各自对应的第二视频相对应的3D视频画面；Generate a 3D live screen according to the first video and the second video corresponding to each of the multiple viewers, wherein the first area of the 3D live screen is used to display a 3D video screen corresponding to the first video , The second area of the 3D live broadcast picture is used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
将所述3D直播画面发送至所述多个观众各自对应的3D视频观看设 备。The 3D live broadcast image is sent to the 3D video viewing device corresponding to each of the multiple viewers.
第六方面，本发明实施例提供一种视频显示装置，该装置包括：In a sixth aspect, an embodiment of the present invention provides a video display device, which includes:
获取模块，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频，所述第一视频和所述多个观众各自对应的第二视频为2D视频；The acquiring module is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers. The second video is a video obtained by shooting a corresponding viewer during watching the first video. The video and the second video corresponding to each of the plurality of viewers are 2D videos;
生成模块，用于根据所述第一视频和所述多个观众各自对应的第二视频，生成3D直播画面，其中，所述3D直播画面的第一区域用于显示与所述第一视频相对应的3D视频画面，所述3D直播画面的第二区域内用于显示与所述多个观众各自对应的第二视频相对应的3D视频画面；The generating module is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the image corresponding to the first video Corresponding 3D video pictures, in the second area of the 3D live pictures, used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
发送模块，用于将所述3D直播画面发送至所述多个观众各自对应的3D视频观看设备。The sending module is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
第七方面，本发明实施例提供一种电子设备，包括：存储器、处理器；其中，所述存储器上存储有可执行代码，当所述可执行代码被所述处理器执行时，使所述处理器至少可以实现如第五方面所述的视频显示方法。In a seventh aspect, an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the fifth aspect.
第八方面，本发明实施例提供了一种非暂时性机器可读存储介质，所述非暂时性机器可读存储介质上存储有可执行代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器至少可以实现如第五方面所述的视频显示方法。In an eighth aspect, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the fifth aspect.
在本发明实施例中，当某主播在进行直播的时候，为了让主播能够观看到观众在观看其直播视频期间的行为，在直播界面中，除了可以显示有主播对应的第一视频外，还可以显示多个观众各自对应的第二视频，基于此，通过直播界面可以同时看到主播以及观众的视频影像，感知彼此的行为，以便于进行更多形式的互动。In the embodiment of the present invention, when an anchor is conducting a live broadcast, in order to allow the anchor to watch the behavior of the viewer during watching his live video, in the live broadcast interface, in addition to displaying the first video corresponding to the anchor, The second video corresponding to each of multiple viewers can be displayed. Based on this, the video images of the anchor and the viewer can be viewed at the same time through the live broadcast interface, and each other's behavior can be sensed to facilitate more forms of interaction.
附图说明Description of the drawings
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to explain the technical solutions in the embodiments of the present invention more clearly, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1为本发明实施例提供的一种直播场景的网络架构示意图；FIG. 1 is a schematic diagram of a network architecture of a live broadcast scene provided by an embodiment of the present invention;
图2为本发明实施例提供的一种视频显示方法的流程图；FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention;
图3为本发明实施例提供的一种执行视频显示方法的原理示意图；FIG. 3 is a schematic diagram of the principle of a method for performing video display according to an embodiment of the present invention;
图4为本发明实施例提供的一种直播界面的显示效果示意图；4 is a schematic diagram of a display effect of a live broadcast interface provided by an embodiment of the present invention;
图5为本发明实施例提供的一种视频解码过程的示意图；Figure 5 is a schematic diagram of a video decoding process provided by an embodiment of the present invention;
图6为本发明实施例提供的另一种视频显示方法的流程图；FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention;
图7为本发明实施例提供的另一种直播界面的显示效果示意图；FIG. 7 is a schematic diagram of the display effect of another live broadcast interface provided by an embodiment of the present invention;
图8为本发明实施例提供的又一种视频显示方法的流程图；FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention;
图9为本发明实施例提供的又一种直播界面的显示效果示意图；FIG. 9 is a schematic diagram of a display effect of another live broadcast interface provided by an embodiment of the present invention;
图10为本发明实施例提供的又一种直播界面的显示效果示意图；FIG. 10 is a schematic diagram of another display effect of a live broadcast interface provided by an embodiment of the present invention;
图11为本发明实施例提供的又一种视频显示方法的流程图；FIG. 11 is a flowchart of another video display method provided by an embodiment of the present invention;
图12为本发明实施例提供的一种视频显示装置的结构示意图；FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention;
图13为与图12所示实施例提供的视频显示装置对应的电子设备的结构示意图；FIG. 13 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 12;
图14为本发明实施例提供的另一种视频显示装置的结构示意图；14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention;
图15为与图14所示实施例提供的视频显示装置对应的电子设备的结构示意图。FIG. 15 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 14.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
在本发明实施例中使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本发明。在本发明实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义，“多种”一般包含至少两种。The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, "multiple" Generally contains at least two types.
取决于语境，如在此所使用的词语“如果”、“若”可以被解释成为“在……时”或“当……时”或“响应于确定”或“响应于检测”。类似地，取决于语境，短语“如果确定”或“如果检测(陈述的条件或事件)”可以被解释成为“当确定时”或“响应于确定”或“当检测(陈述的条件或事件)时”或“响应于检测(陈述的条件或事件)”。Depending on the context, the words "if" and "if" as used herein can be interpreted as "when" or "when" or "in response to determination" or "in response to detection". Similarly, depending on the context, the phrase "if determined" or "if detected (statement or event)" can be interpreted as "when determined" or "in response to determination" or "when detected (statement or event) )" or "in response to detection (statement or event)".
另外，下述各方法实施例中的步骤时序仅为一种举例，而非严格限定。In addition, the sequence of steps in the following method embodiments is only an example, and is not strictly limited.
本发明实施例提供的视频显示方法可以适用于直播场景中，在直播场景中，一种典型的网络架构如图1所示，在该网络架构中，包括终端设备1、一个或多个服务器2以及终端设备3，其中，终端设备1是主播的终端设备，终端设备3是观看直播视频的任一观众的终端设备。主播通过终端设备1拍摄直播视频，将直播视频传输到服务器2中，观众的终端设备3从服务器2中拉取直播视频以供观众观看。The video display method provided by the embodiment of the present invention can be applied to a live broadcast scene. In the live broadcast scene, a typical network architecture is shown in Figure 1. The network architecture includes a terminal device 1, one or more servers 2. And the terminal device 3, where the terminal device 1 is the terminal device of the host, and the terminal device 3 is the terminal device of any viewer watching the live video. The anchor shoots the live video through the terminal device 1, and transmits the live video to the server 2, and the viewer's terminal device 3 pulls the live video from the server 2 for the viewer to watch.
为了实现直播应用，在上述终端设备1、服务器2、终端设备3中可以运行有支持直播功能的应用程序(APP)。该应用程序包括但不限于即时通讯应用程序。In order to realize the live broadcast application, an application program (APP) supporting the live broadcast function may be run in the above-mentioned terminal device 1, the server 2, and the terminal device 3. This application includes but is not limited to instant messaging applications.
通常，将终端设备1和终端设备3这些终端设备中运行的应用程序称为客户端程序，将服务器2中运行的应用程序称为服务端程序。Generally, the application programs running in the terminal devices such as the terminal device 1 and the terminal device 3 are called client programs, and the application programs running in the server 2 are called server programs.
为进行直播，主播会通过操作相应客户端程序在服务器2中进行账号注册，可以认为该账号即对应于一个直播间，从而，当主播登录该账号开始进行直播的时候，直播视频会在该直播间进行展示，观众通过终端设备3中的客户端程序向服务器2触发观看该账号对应的直播间的观看请求，便可以观看到直播视频。In order to conduct live broadcast, the host will register an account in the server 2 by operating the corresponding client program. It can be considered that the account corresponds to a live broadcast room. Therefore, when the host logs in to the account to start live broadcast, the live video will be displayed in the live broadcast. The viewer can use the client program in the terminal device 3 to trigger a viewing request to watch the live room corresponding to the account to the server 2 to watch the live video.
另外，实际应用中，主播往往也需要看到直播视频的画面，在一些实施例中，上述终端设备1应该理解为是主播侧用于进行直播所需要使用的全部终端设备的统称，实际上，该终端设备1可以包括：用于拍摄直播视频的摄像机以及诸如PC机、笔记本电脑、平板电脑、手机等可以观看直播视频的终端设备。当然，终端设备1也可以是同时具有视频拍摄以及访问直播间以观看直播视频的终端设备，比如笔记本电脑、平板电脑、手机等。In addition, in practical applications, the host often needs to see the live video screen. In some embodiments, the above-mentioned terminal device 1 should be understood as a general term for all the terminal devices that the host needs to use for live broadcast. In fact, The terminal device 1 may include a camera for shooting live video, and terminal devices such as a PC, a notebook computer, a tablet computer, and a mobile phone that can watch the live video. Of course, the terminal device 1 may also be a terminal device that has both video shooting and access to the live room to watch the live video, such as a laptop computer, a tablet computer, a mobile phone, and so on.
实际应用中，终端设备1向服务器2上传的直播视频一般是经过编码处理的视频，通过编码处理，可以降低直播视频的传输数据量。相应地，终端设备3从服务器2拉取的直播视频也是经过编码的视频，在终端设备3本地进行解码处理后，显示解码后的直播视频。当然，服务器2接收到终端设备1上传的编码后的直播视频后，可以根据需要对该直播视频进行解码处理，对解码后的直播视频再进行某些处理，处理后的直播视频会再进行编码处理，以供终端设备3拉取。In practical applications, the live video uploaded by the terminal device 1 to the server 2 is generally a video that has undergone encoding processing. Through the encoding processing, the transmission data volume of the live video can be reduced. Correspondingly, the live video pulled by the terminal device 3 from the server 2 is also an encoded video, and the decoded live video is displayed after the terminal device 3 performs local decoding processing. Of course, after the server 2 receives the encoded live video uploaded by the terminal device 1, it can decode the live video as needed, and then perform some processing on the decoded live video, and the processed live video will be encoded again Processing, for the terminal device 3 to pull.
以上对本发明实施例提供的视频显示方法所适用于的网络架构进行了简单说明，在上述网络架构下，本发明实施例提供的视频显示方法可以由上述服务器2执行，具体地，服务器2可以通过运行的上述服务端程序来执行该方法。The foregoing briefly describes the network architecture to which the video display method provided by the embodiment of the present invention is applicable. Under the foregoing network architecture, the video display method provided by the embodiment of the present invention can be executed by the server 2 described above. Specifically, the server 2 can use The above-mentioned server-side program is running to execute the method.
下面结合以下实施例介绍本发明实施例提供的视频显示方法的执行过程。The following describes the execution process of the video display method provided by the embodiments of the present invention with reference to the following embodiments.
图2为本发明实施例提供的一种视频显示方法的流程图，如图2所示，该方法包括如下步骤：FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
201、获取主播对应的第一视频以及多个观众各自对应的第二视频，第二视频是在观看第一视频期间对相应观众进行拍摄得到的视频。201. Acquire a first video corresponding to an anchor and a second video corresponding to each of a plurality of viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video.
202、在直播界面的第一区域内显示主播对应的第一视频。202. Display the first video corresponding to the anchor in the first area of the live broadcast interface.
203、在直播界面的第二区域内显示多个观众各自对应的第二视频。203. Display the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
本实施例中，为了让主播能够看到观众在观看自己的直播视频——第一视频的过程中的状况，需要获取观众在观看第一视频期间的第二视频，第二视频反映了相应观众在观看第一视频期间的状态，即是否在认真观看第一视频。从而，在呈现主播的第一视频的直播界面(即相应直播间的界面)中，也显示出多个观众各自对应的第二视频。In this embodiment, in order for the host to be able to see the viewer’s situation in the process of watching his own live video—the first video, he needs to obtain the second video of the viewer while watching the first video, and the second video reflects the corresponding viewer. The status during watching the first video, that is, whether you are watching the first video seriously. Therefore, in the live interface that presents the first video of the host (that is, the interface of the corresponding live room), the second video corresponding to each of the multiple viewers is also displayed.
基于图1所示网络架构，下面结合图3和图4示例性说明下在实际应用中执行上述步骤的一种可选实现方式。Based on the network architecture shown in FIG. 1, an optional implementation manner of performing the above steps in actual applications will be exemplarily described below in conjunction with FIG. 3 and FIG. 4.
实际应用中，主播通过操作终端设备1中的APP开启直播功能后，通过终端设备1采集主播的直播视频——第一视频，并将第一视频上传到服务器2中。此时，如图4所示，服务器2在直播界面401中显示主播的第一视频，并且可以将该直播界面401下发到终端设备1进行显示。另外，可以理解的是，如果此时某个观众通过接入该主播的直播间而触发了观看该直播视频的请求，则在不执行本实施例提供的方法的情况下，该观众的终端设备3的屏幕上呈现的也是直播界面401。In actual applications, after the anchor activates the live broadcast function by operating the APP in the terminal device 1, collects the anchor's live video, the first video, through the terminal device 1, and uploads the first video to the server 2. At this time, as shown in FIG. 4, the server 2 displays the anchor's first video in the live broadcast interface 401, and may deliver the live broadcast interface 401 to the terminal device 1 for display. In addition, it is understandable that if a viewer triggers a request to watch the live video by accessing the live broadcast room of the host, the viewer’s terminal device will not execute the method provided in this embodiment. The live interface 401 is also presented on the screen of 3.
在本文中，按照需求，可以将直播界面401划分为不同的区域，不同的区域显示不同的内容。如图4中所示，可以认为直播界面401中包括两大区域：视频显示区域A以及交互消息显示区域B。初始情况下，当 仅需要显示主播的第一视频时，在视频显示区域A中仅显示第一视频。交互消息显示区域B用于显示观众与主播的各种交互消息。In this article, according to requirements, the live broadcast interface 401 may be divided into different areas, and different areas display different content. As shown in FIG. 4, it can be considered that the live broadcast interface 401 includes two major areas: a video display area A and an interactive message display area B. In the initial situation, when only the first video of the host needs to be displayed, only the first video is displayed in the video display area A. The interactive message display area B is used to display various interactive messages between the viewer and the anchor.
实际上，当满足执行本实施例提供的视频显示方法的条件时，开始执行上述步骤。在执行过程中，如图3所示，针对接入主播的直播间的某观众来说，可以通过其对应的终端设备3采集该观众的视频画面，称为第二视频，并将第二视频上传到服务器2。服务器2会将该观众的第二视频渲染在直播界面中。In fact, when the conditions for executing the video display method provided in this embodiment are met, the above steps are started. During the execution process, as shown in Figure 3, for a viewer who accesses the live broadcast room of the host, the viewer’s video screen can be collected through its corresponding terminal device 3, which is called the second video, and the second video Upload to server 2. The server 2 will render the second video of the viewer in the live broadcast interface.
其中，可选地，上述条件可以是：当有观众触发对第一视频的观看请求时，即获取该观众对应的第二视频。具体地，观众触发对第一视频的观看请求，可以是当观众接入主播的直播间即认为触发了该观看请求，基于该观看请求，服务器2向该观众对应的终端设备3下发视频拍摄指令，终端设备3开启视频拍摄功能以拍摄该观众对应的第二视频，并将拍摄的第二视频实时地传输至服务器2。Optionally, the above condition may be: when a viewer triggers a viewing request for the first video, the second video corresponding to the viewer is acquired. Specifically, the viewer triggers a viewing request for the first video, which may be considered to have triggered the viewing request when the viewer accesses the host’s live broadcast room. Based on the viewing request, the server 2 delivers the video shooting to the terminal device 3 corresponding to the viewer. Instructed, the terminal device 3 turns on the video shooting function to shoot the second video corresponding to the viewer, and transmits the captured second video to the server 2 in real time.
可选地，上述条件还可以是：主播触发了预设操作。也就是说，基于主播触发的预设操作，获取当前在观看第一视频的多个观众各自对应的第二视频。Optionally, the above condition may also be: the anchor triggers a preset operation. That is, based on the preset operation triggered by the anchor, the second video corresponding to each of the multiple viewers currently watching the first video is obtained.
如图4中所示，在直播界面401中可以包括图中示意的按钮：现场模式402。当主播点击该现场模式402时，认为主播触发了上述预设操作。此时，服务器2向在观看第一视频的各个观众所对应的终端设备3下发视频拍摄指令，接收到该指令的各终端设备3开启视频拍摄功能以拍摄该相应观众的第二视频，并将拍摄的第二视频实时地传输至服务器2，从而，服务器2获得多个观众各自对应的第二视频。As shown in FIG. 4, the live mode interface 401 may include a button illustrated in the figure: live mode 402. When the anchor clicks on the live mode 402, it is considered that the anchor has triggered the aforementioned preset operation. At this time, the server 2 issues a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video, and each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and The captured second video is transmitted to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of a plurality of viewers.
可选地，上述条件还可以是：若观看第一视频的多个观众的人数达到设定阈值，则获取这多个观众各自对应的第二视频。假设该阈值为100人，从而，当接入直播间的观众人数达到100人时，服务器2才会向在 观看第一视频的各个观众所对应的终端设备3下发视频拍摄指令。接收到该指令的各终端设备3开启视频拍摄功能以拍摄该相应观众的第二视频，并将拍摄的第二视频实时地传输至服务器2，从而，服务器2获得多个观众各自对应的第二视频。Optionally, the above condition may also be: if the number of multiple viewers watching the first video reaches a set threshold, then the second video corresponding to each of the multiple viewers is acquired. Assuming that the threshold is 100 people, when the number of viewers accessing the live broadcast room reaches 100, the server 2 will issue a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video. Each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and transmits the captured second video to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of the multiple viewers. video.
可选地，上述条件也可以同时包括：点击现场模式402，以及观看第一视频的多个观众的人数达到设定阈值。Optionally, the above conditions may also include: clicking on the live mode 402, and the number of multiple viewers watching the first video reaches a set threshold.
为便于描述，在图4中，假设当前正在观看第一视频(即接入直播间)的观众包括：观众1、观众2、观众3、观众4、观众5、观众6、观众7，并且，假设这7个观众对应的第二视频分别表示为：S1、S2、S3、S4、S5、S6、S7。基于主播的第一视频以及上述7个观众的第二视频的获取结果，服务器2可以生成如图4中所示意的直播界面403。在直播界面403中，视频显示区域A被划分为两个区域：第一区域A1以及第二区域A2。其中，主播的第一视频显示在第一区域A1内，上述7个观众的第二视频显示在第二区域A2中。For ease of description, in Figure 4, it is assumed that the audience currently watching the first video (ie accessing the live broadcast room) includes: audience 1, audience 2, audience 3, audience 4, audience 5, audience 6, audience 7, and, Assume that the second videos corresponding to these 7 viewers are respectively represented as: S1, S2, S3, S4, S5, S6, S7. Based on the results of the first video of the host and the second video of the above-mentioned 7 viewers, the server 2 may generate a live broadcast interface 403 as shown in FIG. 4. In the live broadcast interface 403, the video display area A is divided into two areas: a first area A1 and a second area A2. The first video of the host is displayed in the first area A1, and the second videos of the above seven viewers are displayed in the second area A2.
在图4中，第一区域A1位于视频显示区域A的中间区域，第二区域A2包围第一区域A1而设置。但是，实际上，第一区域A1以及第二区域A2的设置位置不以此为限，比如第一区域A1与第二区域A2呈现上下的位置关系：视频显示区域A的上半部分作为第一区域A1，下半部分作为第二区域A2。In FIG. 4, the first area A1 is located in the middle area of the video display area A, and the second area A2 is arranged to surround the first area A1. However, in fact, the setting positions of the first area A1 and the second area A2 are not limited to this. For example, the first area A1 and the second area A2 present a vertical position relationship: the upper half of the video display area A is used as the first Area A1, the lower half is regarded as the second area A2.
可以理解的是，对比直播界面401和直播界面403可知，第一视频的显示区域变小，意味着服务器2可以对第一视频进行分辨率变换处理，以匹配于第一视频的显示区域的变化。It is understandable that comparing the live interface 401 and the live interface 403, it can be seen that the display area of the first video becomes smaller, which means that the server 2 can perform resolution conversion processing on the first video to match the change in the display area of the first video. .
另外，针对第二区域A2内各个第二视频的显示，可以在第二区域A2内确定出多个子区域，一个子区域用于显示一个第二视频，从而，第二视频的分辨率与该子区域的尺寸匹配。In addition, for the display of each second video in the second area A2, multiple sub-areas can be determined in the second area A2, and one sub-area is used to display a second video, so that the resolution of the second video is related to the sub-areas. The size of the area matches.
可选地，可以在多个子区域中随机地确定与某第二视频对应的目标子区域，以将该第二视频显示在该目标子区域内。Optionally, a target sub-region corresponding to a certain second video may be randomly determined among multiple sub-regions, so as to display the second video in the target sub-region.
可选地，也可以根据预先设定的接入顺序与多个子区域的对应关系，根据各个观众接入直播间的顺序确定各观众对应的第二视频应该显示在哪个子区域内。Optionally, it is also possible to determine in which sub-region the second video corresponding to each viewer should be displayed according to the sequence of each viewer's access to the live broadcast room according to the preset corresponding relationship between the access sequence and the multiple sub-areas.
可选地，还可以获取主播对多个观众的配置信息，以根据配置信息确定多个观众各自对应的第二视频在第二区域A2内的显示位置，即应该显示在哪个子区域内。其中，主播对多个观众的配置信息可以反映出主播希望重点关注哪几个观众(主播可以创建需要重点关注的观众列表)，从而，假设主播设置观众1和观众2需要重点关注，则可以将这两个观众的第二视频显示在第二区域A2中的比较突出的位置处，比如图4中示意的位置处。Optionally, the configuration information of the anchor for multiple viewers can also be obtained to determine the display position of the second video corresponding to each of the multiple viewers in the second area A2, that is, which sub-area should be displayed in accordance with the configuration information. Among them, the host’s configuration information for multiple viewers can reflect which viewers the host wants to focus on (the host can create a list of viewers that need to be focused on). Therefore, assuming that the host sets viewers 1 and 2 to focus on, you can change The second videos of the two viewers are displayed at a relatively prominent position in the second area A2, such as the position illustrated in FIG. 4.
实际应用中，当接入直播间的观众的数量众多时，为了能更加清晰地观看到众多观众的第二视频，可选地，主播可以对交互消息显示区域B触发隐藏操作，从而，可以隐藏交互消息显示区域B，以及将第二区域A2的边界扩展至交互消息显示区域B，从而形成直播界面404，在直播界面404中，假设还包含观众8和观众9的第二视频：S8和S9。其中，交互消息显示区域B可以实现为可以展开和收起的卡片(或面板)，通过收起该卡片以实现隐藏的效果。In practical applications, when there are a large number of viewers accessing the live broadcast room, in order to be able to watch the second video of the large number of viewers more clearly, optionally, the host can trigger a hiding operation on the interactive message display area B, so that it can be hidden The interactive message display area B, and the boundary of the second area A2 is extended to the interactive message display area B, thereby forming a live interface 404. In the live interface 404, it is assumed that the second videos of viewers 8 and 9 are also included: S8 and S9 . Wherein, the interactive message display area B can be implemented as a card (or panel) that can be expanded and collapsed, and the card is collapsed to achieve a hidden effect.
如前文所述，实际应用中，为降低终端设备与服务器之间的数据传输量，主播的终端设备1会对采集的第一视频进行编码后，将编码后的第一视频传输到服务器2。同理，上述多个观众各自对应的第二视频也可以是经过编码的视频，即相应的终端设备3采集到第二视频后，对第二视频进行编码后，将编码后的第二视频传输至服务器2。由于服务器2要基于接收到的编码后的第一视频和各第二视频生成如图4中示意的直播 界面403，在生成该直播界面403的过程中，需要对编码后的第一视频和各第二视频进行解码，以便将解码后的各视频按照直播界面403中设定的显示区域进行渲染。当上述多个观众的数量较少的时候，由服务器2执行上述解码的过程一般不会导致较大的延时，但是，当观众的数量较多的时候，由服务器2执行上述解码的过程便会导致较大的延时，为此，本发明实施例提供了如下的解决方案：As mentioned above, in actual applications, in order to reduce the amount of data transmission between the terminal device and the server, the terminal device 1 of the host will encode the first video collected, and then transmit the encoded first video to the server 2. In the same way, the second video corresponding to each of the above-mentioned multiple viewers may also be an encoded video, that is, after the corresponding terminal device 3 collects the second video, after encoding the second video, the encoded second video is transmitted To server 2. Since the server 2 needs to generate the live broadcast interface 403 as shown in FIG. 4 based on the received encoded first video and each second video, in the process of generating the live broadcast interface 403, it is necessary to compare the encoded first video and each second video. The second video is decoded, so that each decoded video is rendered according to the display area set in the live broadcast interface 403. When the number of the above-mentioned multiple viewers is small, the above-mentioned decoding process performed by the server 2 generally does not cause a large delay. However, when the number of viewers is large, the server 2 performs the above-mentioned decoding process. This may cause a relatively large delay. For this reason, the embodiment of the present invention provides the following solutions:
服务器2将经过编码的多个观众各自对应的第二视频分配到至少两个设备，由该至少两个设备对各自接收到的第二视频进行解码。服务器2接收该至少两个设备分别发送的解码后的第二视频，将解码后的第二视频显示在第二区域内。The server 2 distributes the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each. The server 2 receives the decoded second video respectively sent by the at least two devices, and displays the decoded second video in the second area.
为便于理解上述过程，结合图5进行示例性说明。在图5中，上述至少两个设备假设为设备A、设备B、设备C。假设上述多个观众的数量为50个，并且假设这50个观众在非常接近的时间都接入直播间。如图5中所示，这50个观众对应的终端设备将各自采集的第二视频经编码后发送至服务器2，服务器2将其中20个第二视频分配给设备A，另外20个第二视频分配给设备B，剩下的10个第二视频分配给设备C，以由这三个设备并行地对接收到的第二视频进行解码处理。每当其中的一个设备解码出一个第二视频后，便将解码后的第二视频发送至服务器2，由服务器2将解码后的第二视频渲染到直播界面中第二区域内的相应位置。In order to facilitate the understanding of the foregoing process, an exemplary description is given in conjunction with FIG. 5. In Figure 5, the above at least two devices are assumed to be device A, device B, and device C. Assume that the number of the above-mentioned multiple viewers is 50, and assume that these 50 viewers are all connected to the live broadcast room at very close times. As shown in Figure 5, the terminal devices corresponding to the 50 viewers send the second video collected by each to the server 2 after being encoded, and the server 2 allocates 20 second videos to device A, and the other 20 second videos Allocate to device B, and the remaining 10 second videos are allocated to device C, so that the three devices can decode the received second videos in parallel. Whenever one of the devices decodes a second video, it sends the decoded second video to the server 2, and the server 2 renders the decoded second video to the corresponding position in the second area of the live interface.
值得说明的是，前文中所说的分辨率的变换处理也可以在上述三个设备中执行，以降低服务器2的计算压力。另外，虽然图5中并未示意主播的第一视频的解码和显示过程，但是其与第二视频的解码和显示过程原理一致。It is worth noting that the resolution conversion processing mentioned in the foregoing can also be executed in the above three devices to reduce the calculation pressure of the server 2. In addition, although FIG. 5 does not illustrate the decoding and display process of the first video of the host, it is consistent with the principle of the decoding and display process of the second video.
综上，当某主播在进行直播的时候，在直播界面中，除了可以显示有主播对应的第一视频外，还可以显示多个观众各自对应的第二视频， 可以使得主播能够观看到各观众在观看其直播视频期间的行为。基于对各观众观看直播视频期间的行为的感知，主播可以与观众进行多样性的互动。In summary, when an anchor is conducting a live broadcast, in the live interface, in addition to the first video corresponding to the anchor, the second video corresponding to multiple viewers can also be displayed, so that the anchor can watch each audience Behavior during watching its live video. Based on the perception of each viewer's behavior during watching the live video, the anchor can interact with the viewer in a variety of ways.
下面结合以下实施例对可以进行的互动形式进行示例性说明。Hereinafter, an exemplary description of possible interaction forms will be given in conjunction with the following embodiments.
图6为本发明实施例提供的另一种视频显示方法的流程图，如图6所示，该视频显示方法可以包括如下步骤：FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 6, the video display method may include the following steps:
601、获取主播对应的第一视频以及多个观众各自对应的第二视频，第二视频是在观看第一视频期间对相应观众进行拍摄得到的视频。601. Acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video.
602、在直播界面的第一区域内显示第一视频，在直播界面的第二区域内显示多个观众各自对应的第二视频。602. Display a first video in a first area of the live broadcast interface, and display a second video corresponding to each of multiple viewers in a second area of the live broadcast interface.
603、响应于主播对多个观众中至少一个观众的选择操作，将至少一个观众各自对应的第二视频显示在第一区域内。603. In response to a selection operation of the anchor on at least one of the multiple viewers, display the second video corresponding to each of the at least one viewer in the first area.
具体地，可以在第一区域内确定多个子区域，以将第一视频和主播选择的至少一个观众各自对应的第二视频一一对应的显示在这多个子区域内。Specifically, multiple sub-regions may be determined in the first area, so that the first video and the second video corresponding to at least one viewer selected by the host are displayed in the multiple sub-regions in a one-to-one correspondence.
结合图7对本实施例提供的方案的实施过程进行示例性说明。The implementation process of the solution provided in this embodiment is exemplarily described in conjunction with FIG. 7.
假设步骤602中第一视频以及多个第二视频的显示结果为图4中示意的直播界面403。假设主播在直播界面403中示意的7个观众中选择了观众1和观众2，则此时，如图7所示，观众1和观众2对应的第二视频S1和S2将从第二区域A2移动到第一区域A1内显示。可选地，可以在第一区域A1内划分出图7中示意的三个子区域，分别用于显示第一视频以及第二视频S1和S2。It is assumed that the display result of the first video and the multiple second videos in step 602 is the live broadcast interface 403 illustrated in FIG. 4. Assuming that the anchor selects viewer 1 and viewer 2 from the 7 viewers indicated in the live interface 403, at this time, as shown in FIG. 7, the second videos S1 and S2 corresponding to viewer 1 and viewer 2 will be from the second area A2. Move to the first area A1 to display. Optionally, the three sub-areas illustrated in FIG. 7 may be divided into the first area A1, which are respectively used to display the first video and the second video S1 and S2.
实际应用中，当主播选中的观众数量为奇数时，可以对第一区域进行N等分，从而得到多个子区域，每个子区域用于显示一路视频。其中，N-1为主播选中的奇数个观众的数量。In practical applications, when the number of viewers selected by the anchor is an odd number, the first area can be divided into N equal parts to obtain multiple sub-areas, and each sub-areas is used to display a video. Among them, N-1 is the number of odd viewers selected for the host.
实际上，上述多个子区域的位置和尺寸可以自定义，不以上述举例为限。In fact, the positions and sizes of the above multiple sub-regions can be customized, and are not limited to the above examples.
另外，实际应用中，虽然多个观众各自对应的第二视频被显示在直播界面的第二区域内，但是，为保证观众的收听效果，第二视频为静音的效果，即仅有画面而没有声音。当主播选中上述至少一个观众，并将这至少一个观众的第二视频移动到第一区域内显示时，可以开启该至少一个观众对应的语音通话功能。也即是说，此前，各个观众的语音通话功能(比如麦克风)被关闭，当某个观众被主播选择后，开启被选择的观众的语音通话功能，从而，被选的观众可以与主播进行语音交互，可选地，该语音交互的内容也可以被其他观众收听到。In addition, in practical applications, although the second video corresponding to each of multiple viewers is displayed in the second area of the live broadcast interface, in order to ensure the listening effect of the viewers, the second video is muted, that is, there are only pictures and no sound. When the anchor selects at least one of the above-mentioned viewers and moves the second video of the at least one viewer to the first area for display, the voice call function corresponding to the at least one viewer can be activated. That is to say, previously, the voice call function (such as the microphone) of each viewer was turned off. When a viewer is selected by the host, the voice call function of the selected viewer is turned on, so that the selected viewer can talk to the host. Interaction, optionally, the content of the voice interaction can also be heard by other viewers.
图8为本发明实施例提供的又一种视频显示方法的流程图，如图8所示，该视频显示方法可以包括如下步骤：FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 8, the video display method may include the following steps:
801、获取主播对应的第一视频以及多个观众各自对应的第二视频，第二视频是在观看第一视频期间对相应观众进行拍摄得到的视频。801. Acquire a first video corresponding to the anchor and a second video corresponding to each of the multiple viewers, where the second video is a video obtained by shooting the corresponding viewer while watching the first video.
802、在直播界面的第一区域内显示所述第一视频，在直播界面的第二区域内显示多个观众各自对应的第二视频。802. Display the first video in a first area of the live broadcast interface, and display a second video corresponding to each of multiple viewers in a second area of the live broadcast interface.
803、响应于主播触发的屏幕分享操作，在第一区域内显示主播对应的第三视频，以及将第一视频移动到直播界面的第三区域内显示，其中，第三视频是对主播的终端设备的屏幕进行拍摄得到的。803. In response to the screen sharing operation triggered by the anchor, display the third video corresponding to the anchor in the first area, and move the first video to the third area of the live broadcast interface for display, where the third video is for the anchor’s terminal The screen of the device was captured.
下面结合图9和图10对本实施例提供的方案的实施过程进行示例性说明。The implementation process of the solution provided in this embodiment will be exemplarily described below in conjunction with FIG. 9 and FIG. 10.
可选地，假设步骤802中第一视频以及多个第二视频的显示结果为图9中示意的直播界面901。在直播界面901中，主播的第一视频显示在第一区域Q1内，前述实施例中假设的7个观众的第二视频显示在第二区域Q2内。当主播基于实际需求，在直播界面901中触发了屏幕分享操作 时，可以拍摄或者通过其他手段获取包含主播的终端设备的屏幕的第三视频，也就是说，第三视频中包含有该终端设备屏幕上显示的数据内容。与上述第一视频相比，第一视频主要是对主播本身进行拍摄得到的。第三视频被传输到服务器2中，服务器2此时可以生成新的直播界面902，在直播界面902中，可以将第三视频显示在原来用于显示第一视频的第一区域Q1内，而将第一视频移动到其他位置(称为第三区域)进行显示。在图9中，假设第三区域即为第二区域Q2，当然，第三区域也可以是不同于第二区域Q2的其他区域。在第二区域Q2中，为了与观众的第二视频相区别，可选地，如图9中所示意的，主播的第一视频的画面尺寸可以比第二视频的画面尺寸大。Optionally, it is assumed that the display result of the first video and the multiple second videos in step 802 is the live broadcast interface 901 illustrated in FIG. 9. In the live broadcast interface 901, the first video of the host is displayed in the first area Q1, and the second video of the 7 viewers assumed in the foregoing embodiment is displayed in the second area Q2. When the host triggers a screen sharing operation in the live interface 901 based on actual needs, he can shoot or obtain the third video containing the host’s terminal device screen by other means, that is, the third video contains the terminal device The content of the data displayed on the screen. Compared with the above-mentioned first video, the first video is mainly obtained by shooting the anchor itself. The third video is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 902 at this time. In the live broadcast interface 902, the third video can be displayed in the first area Q1 originally used to display the first video, and Move the first video to another location (called the third area) for display. In FIG. 9, it is assumed that the third area is the second area Q2. Of course, the third area may also be another area different from the second area Q2. In the second area Q2, in order to be distinguished from the second video of the viewer, optionally, as shown in FIG. 9, the screen size of the first video of the host may be larger than the screen size of the second video.
可选地，假设步骤802中第一视频以及多个第二视频的显示结果为图10中示意的直播界面403，在该直播界面403中，显示多个观众的第二视频的第二区域A2包围显示主播的第一视频的第一区域A1。当主播在直播界面403中触发了屏幕分享操作时，包含有主播的终端设备屏幕上显示的数据内容的第三视频被传输到服务器2中，服务器2此时可以生成新的直播界面1001。在直播界面1001中，第三视频的显示区域至少覆盖第一区域A1，即在第一区域A1内显示第三视频，而将原本显示与第一区域A1内的第一视频转移到第三区域内显示。可选地，第三区域可以位于第二区域A2内，也可以是直播界面中的其他位置区域，比如是位于交互消息显示区域B内的区域A3。Optionally, it is assumed that the display result of the first video and the multiple second videos in step 802 is the live interface 403 illustrated in FIG. 10, in which the second area A2 of the second videos of multiple viewers is displayed Surround the first area A1 of the first video of the host. When the host triggers a screen sharing operation in the live broadcast interface 403, the third video containing the data content displayed on the host's terminal device screen is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 1001 at this time. In the live interface 1001, the display area of the third video covers at least the first area A1, that is, the third video is displayed in the first area A1, and the original display and the first video in the first area A1 are transferred to the third area Inside display. Optionally, the third area may be located in the second area A2, or may be another location area in the live broadcast interface, for example, the area A3 located in the interactive message display area B.
另外，为了进一步扩大第三视频的显示区域，可选地，也可以将整个视频显示区域A都用于显示第三视频。为实现该目的，可以将多个观众各自对应的第二视频从第二区域A2中移动到直播界面1001的第四区域内显示，以扩大第三视频的显示区域。其中，第四区域比如可以是位于交互消息显示区域B内的区域A4。由于视频显示区域A是由上述第一 区域A1和第二区域A2构成的，因此，通过上述过程，即可实现将第三视频显示在视频显示区域A内的目的。此时，由于直播界面1001的尺寸有限，相比于交互消息，上述第一视频和第二视频更为重要，因此，可选地，此时可以在直播界面1001中隐藏交互消息显示区域B。以便在原本该交互消息显示区域B对应的位置生成上述第三区域A3和第四区域A4。当然，可选地，实际应用中，也可以将交互消息显示区域B移开到其他位置区域进行显示。In addition, in order to further expand the display area of the third video, optionally, the entire video display area A may also be used to display the third video. To achieve this, the second video corresponding to each of the multiple viewers may be moved from the second area A2 to the fourth area of the live interface 1001 for display, so as to expand the display area of the third video. Wherein, the fourth area may be, for example, area A4 located in the interactive message display area B. Since the video display area A is composed of the above-mentioned first area A1 and the second area A2, the purpose of displaying the third video in the video display area A can be achieved through the above-mentioned process. At this time, due to the limited size of the live interface 1001, the above-mentioned first video and the second video are more important than the interactive message. Therefore, optionally, the interactive message display area B can be hidden in the live interface 1001 at this time. In order to generate the aforementioned third area A3 and fourth area A4 at the position corresponding to the original interactive message display area B. Of course, optionally, in practical applications, the interactive message display area B can also be moved to other location areas for display.
另外，虽然交互消息显示区域B被隐藏，但是，其中已经存在的诸如弹幕等交互消息可以被配置为以设定的形式在直播界面中显示，比如在视频显示区域内按照某种设定的方式进行显示。In addition, although the interactive message display area B is hidden, the existing interactive messages such as barrage can be configured to be displayed in the live broadcast interface in a set form, for example, in the video display area according to a certain set Way to display.
除了以上的互动形式外，实际应用中，还可以包括如下互动形式：主播基于某观众的第二视频的显示，当发现该观众没有在认真观看第一视频时，对该观众发送针对性的提示语音或文字消息。In addition to the above interactive forms, practical applications can also include the following interactive forms: the anchor is based on the display of the second video of a certain viewer, and when it is found that the viewer is not watching the first video seriously, it sends a targeted reminder to the viewer Voice or text message.
综上，基于将观众的视频显示于直播界面中，主播可以与观众进行更多形式的互动，扩展了互动形式。In summary, based on displaying the audience's video in the live broadcast interface, the anchor can interact with the audience in more forms, expanding the interactive form.
以上本发明实施例提供的视频显示方法，可以在诸如老师网络授课、公司进行网络会议等实际应用场景中。The video display method provided by the above embodiments of the present invention can be used in practical application scenarios such as a teacher's network teaching, a company's network conference, and the like.
在老师网络授课的应用场景中，老师可以通过直播的方式来讲课，如果老师无法看到学生的听课状态，不了解学生是否有认真听课，很有可能因为一些学生的自觉性差而导致授课效果不佳。为此，当老师在直播间进行直播授课时，在直播界面中同时显示老师和各个学生的视频画面，可以让老师清楚地感知到学生们的听课状态，以便及时地发现未认真听课的学生，对其进行提醒，还可以实现与学生的教学互动。在该场景中，前述实施例中的第一视频可以是老师的影像，第三视频可以是老师的电脑终端上显示的PPT课件。In the application scenario of the teacher’s online teaching, the teacher can give lectures through live broadcast. If the teacher cannot see the student’s listening status and does not know whether the student is listening carefully, it is likely that some students’ poor self-consciousness will lead to ineffective teaching. good. For this reason, when the teacher conducts live teaching in the live broadcast room, the video pictures of the teacher and each student are displayed in the live broadcast interface at the same time, so that the teacher can clearly perceive the students' listening status, so as to timely find the students who are not listening carefully. Reminders can also realize the teaching interaction with students. In this scenario, the first video in the foregoing embodiment may be the teacher's image, and the third video may be the PPT courseware displayed on the teacher's computer terminal.
在公司进行网络会议的应用场景中，公司主管可以通过直播的方式组织会议，即公司主管开启直播，公司职员接入直播间以参与会议。为了能够清楚地看到各个与会者的状态，基于本实施例提供的方案，可以将各个与会者的视频画面也展示在直播界面中。另外，当需要就某个事情与其中的几个参会者讨论的时候，还可以将这几个参会者的视频画面与公司主管的视频画面集中显示在直播界面的中间区域，以增强互动效果。In the application scenario of the company’s web conference, the company director can organize the meeting through live broadcast, that is, the company director starts the live broadcast, and the company staff access the live room to participate in the meeting. In order to be able to clearly see the status of each participant, based on the solution provided in this embodiment, the video screen of each participant can also be displayed in the live broadcast interface. In addition, when you need to discuss something with several participants, you can also display the video pictures of these participants and the video pictures of the company director in the middle area of the live broadcast interface to enhance interaction Effect.
图11为本发明实施例提供的又一种视频显示方法的流程图，该视频显示方法可以由前文中提及的服务器来执行。如图11所示，该视频显示方法可以包括如下步骤：FIG. 11 is a flowchart of yet another video display method provided by an embodiment of the present invention. The video display method may be executed by the server mentioned above. As shown in FIG. 11, the video display method may include the following steps:
1101、获取主播对应的第一视频以及多个观众各自对应的第二视频，第二视频是在观看第一视频期间对相应观众进行拍摄得到的视频，第一视频和多个观众各自对应的第二视频为2D视频。1101. Obtain a first video corresponding to the anchor and a second video corresponding to each of multiple viewers. The second video is a video obtained by shooting the corresponding viewer while watching the first video. The first video and the second video corresponding to each of the multiple viewers The second video is a 2D video.
1102、根据第一视频和多个观众各自对应的第二视频，生成3D直播画面，其中，3D直播画面的第一区域用于显示与第一视频相对应的3D视频画面，3D直播画面的第二区域内用于显示与多个观众各自对应的第二视频相对应的3D视频画面。1102. Generate a 3D live screen according to the first video and the second video corresponding to each of the multiple viewers, where the first area of the 3D live screen is used to display the 3D video screen corresponding to the first video, and the second video of the 3D live screen is The second area is used to display 3D video images corresponding to the second videos respectively corresponding to multiple viewers.
1103、将3D直播画面发送至多个观众各自对应的3D视频观看设备。1103. Send the 3D live broadcast screen to 3D video viewing devices corresponding to each of the multiple viewers.
前述其他实施例中的视频都为2D视频，也就是说，观众观看到的直播界面为2D画面。本实施例中，为了让观众获得沉浸式的视觉体验，可以为观众提供3D的直播画面。The videos in the foregoing other embodiments are all 2D videos, that is, the live broadcast interface viewed by the audience is a 2D picture. In this embodiment, in order to allow the audience to obtain an immersive visual experience, a 3D live broadcast image may be provided to the audience.
本实施例中，上述第一视频是通过主播所处空间处设置的摄像头拍摄得到的，同样地，某观众对应的第二视频也是通过该观众所处空间处设置的摄像头拍摄得到的。第一视频和第二视频都可以是2D视频。第一视频中除了包含有主播的影像外，还可以包含主播周围的环境影像，第 二视频亦然。In this embodiment, the above-mentioned first video is captured by a camera set in the space where the host is located. Similarly, the second video corresponding to a viewer is also captured by a camera set in the space where the viewer is located. Both the first video and the second video may be 2D videos. In addition to the host's image, the first video can also include the surrounding environment images of the host, and the second video is also the same.
在得到主播的第一视频以及多个观众各自对应的第二视频后，可以根据第一视频和多个观众各自对应的第二视频，生成3D直播画面。After the first video of the host and the second video corresponding to each of the multiple viewers are obtained, a 3D live broadcast image can be generated according to the first video and the second video corresponding to each of the multiple viewers.
可选地，可以采用现有的2D视频转换为3D视频的相关技术将第一视频和各第二视频转换为对应的3D视频画面，再将得到的全部3D视频画面按照某种布局方式进行布局，以得到3D直播画面。Optionally, the existing related technology of converting 2D video to 3D video can be used to convert the first video and each second video into corresponding 3D video pictures, and then all the obtained 3D video pictures are laid out according to a certain layout method. , In order to get the 3D live broadcast picture.
从观众的视角来说，某观众通过3D视频观看设备观看该3D直播画面时，可以在3D直播画面的第一区域内观看到与主播对应的3D视频画面，在3D直播画面的第二区域内观看到与多个观众对应的3D视频画面。其中，第一区域可以是3D直播画面的中心区域，第二区域可以是3D直播画面的四周区域。From the viewer’s perspective, when a viewer watches the 3D live broadcast through a 3D video viewing device, he can watch the 3D video corresponding to the host in the first area of the 3D live broadcast, and in the second area of the 3D live broadcast. Watched 3D video images corresponding to multiple viewers. Wherein, the first area may be the central area of the 3D live broadcast picture, and the second area may be the surrounding area of the 3D live broadcast picture.
3D视频观看设备可以是虚拟现实(Virtual Reality,简称VR)设备，比如VR头盔、VR眼镜。3D视频观看设备也可以是增强现实(Augmented Reality，简称AR))设备，比如AR头盔、AR眼镜。当然，3D视频观看设备还可以是其他支持3D视频观看能力的可穿戴设备或非可穿戴设备。The 3D video viewing device may be a virtual reality (Virtual Reality, VR for short) device, such as a VR helmet and VR glasses. The 3D video viewing device may also be an augmented reality (Augmented Reality, AR for short) device, such as an AR helmet and AR glasses. Of course, the 3D video viewing device may also be other wearable devices or non-wearable devices that support 3D video viewing capabilities.
可选地，上述视频显示方法还可以包括如下步骤：响应于主播对多个观众中至少一个观众的选择操作，将被选择的该至少一个观众各自对应的3D视频画面移动到第一区域内。也就是说，观众在第一区域内可以观看到主播以及被选择的观众的3D影像。Optionally, the above-mentioned video display method may further include the following step: in response to a selection operation of at least one of the plurality of viewers by the host, moving the 3D video images corresponding to each of the selected at least one viewer into the first area. In other words, the audience can watch the 3D video of the anchor and the selected audience in the first area.
另外，如前文所述，当上述至少一个观众被选择后，该至少一个观众的语音通话功能被开启，此时，任一观众不仅可以看到主播以及各个观众的3D视频画面，还可以收听到主播以及上述被选择的至少一个观众的语音信号。In addition, as mentioned above, when at least one viewer is selected, the voice call function of the at least one viewer is enabled. At this time, any viewer can not only see the host and the 3D video images of each viewer, but also listen to it. The voice signal of the host and the selected at least one viewer.
可选地，主播的语音信号与上述被选择的至少一个观众的语音信号可以具有不同的声源效果。举例来说，可以设置主播的语音信号具有从 观众的正前方传输至观众的声效，而其他被选择的观众的语音信号具有从观众的左侧或右侧传输至观众的声效，以增强用户的沉浸式观看体验。Optionally, the voice signal of the host and the voice signal of the at least one selected audience may have different sound source effects. For example, the voice signal of the host can be set to have the sound effect transmitted from the front of the audience to the audience, while the voice signals of other selected audiences have the sound effect transmitted from the left or right side of the audience to the audience, so as to enhance the user’s experience. Immersive viewing experience.
以下将详细描述本发明的一个或多个实施例的视频显示装置。本领域技术人员可以理解，这些视频显示装置均可使用市售的硬件组件通过本方案所教导的步骤进行配置来构成。Hereinafter, the video display device of one or more embodiments of the present invention will be described in detail. Those skilled in the art can understand that these video display devices can all be configured by using commercially available hardware components through the steps taught in this solution.
图12为本发明实施例提供的一种视频显示装置的结构示意图，该视频显示装置可以位于前述实施例提及的服务器中。如图12所示，该装置包括：获取模块11、显示模块12。FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention. The video display device may be located in the server mentioned in the foregoing embodiment. As shown in FIG. 12, the device includes: an acquisition module 11 and a display module 12.
获取模块11，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频。The acquiring module 11 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video.
显示模块12，用于在直播界面的第一区域内显示所述第一视频；在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频。The display module 12 is configured to display the first video in a first area of the live broadcast interface; and display a second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
可选地，获取模块11具体可以用于：响应于所述主播触发的预设操作，获取所述多个观众各自对应的第二视频。Optionally, the obtaining module 11 may be specifically configured to: in response to a preset operation triggered by the anchor, obtain the second video corresponding to each of the multiple viewers.
可选地，获取模块11具体可以用于：若所述多个观众的人数达到设定阈值，则获取所述多个观众各自对应的第二视频。Optionally, the acquiring module 11 may be specifically configured to: if the number of the multiple viewers reaches a set threshold, acquire the second video corresponding to each of the multiple viewers.
可选地，所述装置还包括：确定模块，用于获取所述主播对所述多个观众的配置信息；根据所述配置信息确定所述多个观众各自对应的第二视频在所述第二区域内的显示位置。Optionally, the device further includes: a determining module, configured to obtain configuration information of the anchor for the multiple viewers; and determine, according to the configuration information, that the second video corresponding to each of the multiple viewers is in the first video. The display position in the second area.
可选地，所述多个观众各自对应的第二视频是经过编码的视频。所述显示模块12具体可以用于：将经过编码的所述多个观众各自对应的第二视频分配到至少两个设备，由所述至少两个设备对各自接收到的第二视频进行解码；接收所述至少两个设备分别发送的解码后的第二视频，将解码后的第二视频显示在所述第二区域内。Optionally, the second video corresponding to each of the multiple viewers is an encoded video. The display module 12 may be specifically configured to: distribute the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each; Receiving the decoded second video respectively sent by the at least two devices, and displaying the decoded second video in the second area.
可选地，显示模块12还可以用于：响应于所述主播对所述多个观众中至少一个观众的选择操作，将所述至少一个观众各自对应的第二视频显示在所述第一区域内。Optionally, the display module 12 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, display the second video corresponding to each of the at least one viewer in the first area Inside.
可选地，显示模块12具体可以用于：在所述第一区域内确定多个子区域；将所述第一视频和所述至少一个观众各自对应的第二视频一一对应的显示在所述多个子区域内。Optionally, the display module 12 may be specifically configured to: determine a plurality of sub-areas in the first area; display the first video and the second video corresponding to the at least one viewer in a one-to-one correspondence. Multiple sub-regions.
可选地，所述装置还包括：控制模块，用于开启所述至少一个观众对应的语音通话功能。Optionally, the device further includes: a control module configured to enable a voice call function corresponding to the at least one viewer.
可选地，所述直播界面中还包括：交互消息显示区域。显示模块12还可以用于：响应于对所述交互消息显示区域触发的隐藏操作，隐藏所述交互消息显示区域，以及将所述第二区域的边界扩展至所述交互消息显示区域。Optionally, the live broadcast interface further includes: an interactive message display area. The display module 12 may also be used to: in response to a hiding operation triggered on the interactive message display area, hide the interactive message display area, and extend the boundary of the second area to the interactive message display area.
可选地，显示模块12还可以用于：响应于所述主播触发的屏幕分享操作，在所述第一区域内显示所述主播对应的第三视频，以及将所述第一视频移动到所述直播界面的第三区域内显示，其中，所述第三视频是对所述主播的终端设备的屏幕进行拍摄得到的。Optionally, the display module 12 may be further configured to: in response to a screen sharing operation triggered by the host, display a third video corresponding to the host in the first area, and move the first video to the It is displayed in the third area of the live broadcast interface, where the third video is obtained by shooting the screen of the host's terminal device.
可选地，所述第二区域包围所述第一区域。显示模块12还可以用于：将所述多个观众各自对应的第二视频移动到所述直播界面的第四区域内显示，以扩大所述第三视频的显示区域。Optionally, the second area surrounds the first area. The display module 12 may also be used to move the second video corresponding to each of the multiple viewers to the fourth area of the live broadcast interface for display, so as to expand the display area of the third video.
可选地，显示模块12还可以用于：隐藏所述直播界面中的交互消息显示区域；在所述交互消息显示区域对应的位置生成所述第三区域和所述第四区域。Optionally, the display module 12 may also be used to: hide the interactive message display area in the live broadcast interface; and generate the third area and the fourth area at positions corresponding to the interactive message display area.
图12所示装置可以执行前述图1至图10所示实施例中提供的视频显示方法，详细的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。The device shown in FIG. 12 can execute the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10. For detailed execution process and technical effects, refer to the description in the foregoing embodiment, and details are not described herein again.
在一个可能的设计中，上述图12所示视频显示装置的结构可实现为一电子设备，该电子设备可以是前述实施例中的服务器。如图13所示，该电子设备可以包括：第一处理器21、第一存储器22。其中，第一存储器22上存储有可执行代码，当所述可执行代码被第一处理器21执行时，使第一处理器21至少可以实现如前述图1至图10所示实施例中提供的视频显示方法。In a possible design, the structure of the video display device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment. As shown in FIG. 13, the electronic device may include: a first processor 21 and a first memory 22. Wherein, executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the functions provided in the embodiments shown in FIGS. 1 to 10 above. Video display method.
可选地，该电子设备中还可以包括第一通信接口23，用于与其他设备进行通信。Optionally, the electronic device may also include a first communication interface 23 for communicating with other devices.
另外，本发明实施例提供了一种非暂时性机器可读存储介质，所述非暂时性机器可读存储介质上存储有可执行代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器至少可以实现如前述图1至图10所示实施例中提供的视频显示方法。In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10.
图14为本发明实施例提供的另一种视频显示装置的结构示意图，该视频显示装置可以位于前述实施例提及的服务器中。如图14所示，该装置包括：获取模块31、生成模块32、发送模块33。FIG. 14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention. The video display device may be located in the server mentioned in the foregoing embodiment. As shown in FIG. 14, the device includes: an acquiring module 31, a generating module 32, and a sending module 33.
获取模块31，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频，所述第一视频和所述多个观众各自对应的第二视频为2D视频。The acquiring module 31 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers. The second video is a video obtained by shooting a corresponding viewer while watching the first video. A video and a second video corresponding to each of the plurality of viewers are 2D videos.
生成模块32，用于根据所述第一视频和所述多个观众各自对应的第二视频，生成3D直播画面，其中，所述3D直播画面的第一区域用于显示与所述第一视频相对应的3D视频画面，所述3D直播画面的第二区域内用于显示与所述多个观众各自对应的第二视频相对应的3D视频画面。The generating module 32 is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the second video corresponding to the first video. Corresponding to the 3D video picture, the second area of the 3D live picture is used to display the 3D video picture corresponding to the second video corresponding to each of the plurality of viewers.
发送模块33，用于将所述3D直播画面发送至所述多个观众各自对应的3D视频观看设备。The sending module 33 is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
可选地，生成模块32还可以用于：响应于所述主播对所述多个观众中至少一个观众的选择操作，将所述至少一个观众各自对应的3D视频画面移动到所述第一区域内。Optionally, the generating module 32 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, move the 3D video images corresponding to each of the at least one viewer to the first area Inside.
图14所示装置可以执行前述图11所示实施例中提供的视频显示方法，详细的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。The device shown in FIG. 14 can execute the video display method provided in the embodiment shown in FIG. 11, and the detailed execution process and technical effects can be referred to the description in the foregoing embodiment, which will not be repeated here.
在一个可能的设计中，上述图14所示视频显示装置的结构可实现为一电子设备，该电子设备可以是前述实施例中的服务器。如图15所示，该电子设备可以包括：第二处理器41、第二存储器42、第二通信接口43。其中，第二存储器42上存储有可执行代码，当所述可执行代码被第二处理器41执行时，使第二处理器41至少可以实现如前述图11所示实施例中提供的视频显示方法。In a possible design, the structure of the video display device shown in FIG. 14 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment. As shown in FIG. 15, the electronic device may include: a second processor 41, a second memory 42, and a second communication interface 43. Wherein, executable code is stored on the second memory 42. When the executable code is executed by the second processor 41, the second processor 41 can at least realize the video display provided in the embodiment shown in FIG. method.
另外，本发明实施例提供了一种非暂时性机器可读存储介质，所述非暂时性机器可读存储介质上存储有可执行代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器至少可以实现如前述图11所示实施例中提供的视频显示方法。In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the embodiment shown in FIG. 11.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助加必需的通用硬件平台的方式来实现，当然也可以通过硬件和软件结合的方式来实现。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以计算机产品的形式体现出来，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Through the description of the above implementation manners, those skilled in the art can clearly understand that each implementation manner can be implemented by adding a necessary general hardware platform, and of course, it can also be implemented by a combination of hardware and software. Based on this understanding, the above technical solution essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present invention can be used in one or more computer usable storage containing computer usable program codes. The form of a computer program product implemented on a medium (including but not limited to disk storage, CD-ROM, optical storage, etc.).
本发明实施例提供的视频显示方法可以由某种程序/软件来执行，该程序/软件可以由网络侧提供，前述实施例中提及的电子设备可以将该程 序/软件下载到本地的非易失性存储介质中，并在其需要执行前述视频显示方法时，通过CPU将该程序/软件读取到内存中，进而由CPU执行该程序/软件以实现前述实施例中所提供的视频显示方法，执行过程可以参见前述图1至图11中的示意。The video display method provided by the embodiment of the present invention can be executed by a certain program/software, and the program/software can be provided by the network side. The electronic device mentioned in the foregoing embodiment can download the program/software to a local non-easy When it needs to execute the foregoing video display method, the program/software is read into the memory by the CPU, and the program/software is executed by the CPU to implement the video display method provided in the foregoing embodiment. For the execution process, please refer to the schematic diagrams in Figures 1 to 11 described above.
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (20)

  1. 一种视频显示方法，其特征在于，包括：A video display method, characterized in that it comprises:
    获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频；Acquiring a first video corresponding to the anchor and a second video corresponding to each of the multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
    在直播界面的第一区域内显示所述第一视频；Displaying the first video in the first area of the live broadcast interface;
    在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频。The second video corresponding to each of the multiple viewers is displayed in the second area of the live broadcast interface.
  2. 根据权利要求1所述的方法，其特征在于，所述获取多个观众各自对应的第二视频，包括：The method according to claim 1, wherein said acquiring the second video corresponding to each of a plurality of viewers comprises:
    响应于所述主播触发的预设操作，获取所述多个观众各自对应的第二视频。In response to a preset operation triggered by the anchor, a second video corresponding to each of the multiple viewers is acquired.
  3. 根据权利要求1所述的方法，其特征在于，所述获取多个观众各自对应的第二视频，包括：The method according to claim 1, wherein said acquiring the second video corresponding to each of a plurality of viewers comprises:
    若所述多个观众的人数达到设定阈值，则获取所述多个观众各自对应的第二视频。If the number of the plurality of viewers reaches the set threshold, the second video corresponding to each of the plurality of viewers is acquired.
  4. 根据权利要求1所述的方法，其特征在于，所述方法还包括：The method according to claim 1, wherein the method further comprises:
    获取所述主播对所述多个观众的配置信息；Acquiring configuration information of the anchor for the multiple viewers;
    根据所述配置信息确定所述多个观众各自对应的第二视频在所述第二区域内的显示位置。The display position of the second video corresponding to each of the multiple viewers in the second area is determined according to the configuration information.
  5. 根据权利要求1所述的方法，其特征在于，所述多个观众各自对应的第二视频是经过编码的视频；The method according to claim 1, wherein the second video corresponding to each of the plurality of viewers is an encoded video;
    所述在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频，包括：The displaying the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface includes:
    将经过编码的所述多个观众各自对应的第二视频分配到至少两个设备，由所述至少两个设备对各自接收到的第二视频进行解码；Distributing the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each;
    接收所述至少两个设备分别发送的解码后的第二视频，将解码后的 第二视频显示在所述第二区域内。Receiving the decoded second video respectively sent by the at least two devices, and displaying the decoded second video in the second area.
  6. 根据权利要求1至5中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1 to 5, wherein the method further comprises:
    响应于所述主播对所述多个观众中至少一个观众的选择操作，将所述至少一个观众各自对应的第二视频显示在所述第一区域内。In response to the selection operation of at least one viewer of the plurality of viewers by the anchor, the second video corresponding to each of the at least one viewer is displayed in the first area.
  7. 根据权利要求6所述的方法，其特征在于，所述将所述至少一个观众各自对应的第二视频显示在所述第一区域内，包括：The method according to claim 6, wherein the displaying the second video corresponding to each of the at least one viewer in the first area comprises:
    在所述第一区域内确定多个子区域；Determine multiple sub-areas in the first area;
    将所述第一视频和所述至少一个观众各自对应的第二视频一一对应的显示在所述多个子区域内。The first video and the second video corresponding to each of the at least one viewer are displayed in the multiple sub-regions in a one-to-one correspondence.
  8. 根据权利要求6所述的方法，其特征在于，所述方法还包括：The method according to claim 6, wherein the method further comprises:
    开启所述至少一个观众对应的语音通话功能。Turn on the voice call function corresponding to the at least one viewer.
  9. 根据权利要求1所述的方法，其特征在于，所述直播界面中还包括：交互消息显示区域；The method according to claim 1, wherein the live interface further comprises: an interactive message display area;
    所述方法还包括：The method also includes:
    响应于对所述交互消息显示区域触发的隐藏操作，隐藏所述交互消息显示区域，以及将所述第二区域的边界扩展至所述交互消息显示区域。In response to a hiding operation triggered on the interactive message display area, hide the interactive message display area, and extend the boundary of the second area to the interactive message display area.
  10. 根据权利要求1所述的方法，其特征在于，所述方法还包括：The method according to claim 1, wherein the method further comprises:
    响应于所述主播触发的屏幕分享操作，在所述第一区域内显示所述主播对应的第三视频，以及将所述第一视频移动到所述直播界面的第三区域内显示，其中，所述第三视频是对所述主播的终端设备的屏幕进行拍摄得到的。In response to the screen sharing operation triggered by the anchor, display the third video corresponding to the anchor in the first area, and move the first video to the third area of the live interface for display, wherein, The third video is obtained by shooting the screen of the host's terminal device.
  11. 根据权利要求10所述的方法，其特征在于，所述第二区域包围所述第一区域；The method according to claim 10, wherein the second area surrounds the first area;
    所述方法还包括：The method also includes:
    将所述多个观众各自对应的第二视频移动到所述直播界面的第四区域内显示，以扩大所述第三视频的显示区域。The second video corresponding to each of the multiple viewers is moved to the fourth area of the live interface for display, so as to expand the display area of the third video.
  12. 根据权利要求11所述的方法，其特征在于，所述方法还包括：The method according to claim 11, wherein the method further comprises:
    隐藏所述直播界面中的交互消息显示区域；Hide the interactive message display area in the live broadcast interface;
    在所述交互消息显示区域对应的位置生成所述第三区域和所述第四区域。The third area and the fourth area are generated at positions corresponding to the interactive message display area.
  13. 一种视频显示装置，其特征在于，包括：A video display device, characterized by comprising:
    获取模块，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频；An acquiring module, configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
    显示模块，用于在直播界面的第一区域内显示所述第一视频；在所述直播界面的第二区域内显示所述多个观众各自对应的第二视频。The display module is configured to display the first video in the first area of the live broadcast interface; and display the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
  14. 一种电子设备，其特征在于，包括：存储器、处理器；其中，所述存储器上存储有可执行代码，当所述可执行代码被所述处理器执行时，使所述处理器执行如权利要求1至12中任一项所述的视频显示方法。An electronic device, characterized by comprising: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the processor is caused to execute The video display method described in any one of 1 to 12 is required.
  15. 一种非暂时性机器可读存储介质，其特征在于，所述非暂时性机器可读存储介质上存储有可执代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器执行如权利要求1至12中任一项所述的视频显示方法。A non-transitory machine-readable storage medium, characterized in that executable code is stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device, the The processor executes the video display method according to any one of claims 1 to 12.
  16. 一种视频显示方法，其特征在于，包括：A video display method, characterized in that it comprises:
    获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频，所述第一视频和所述多个观众各自对应的第二视频为2D视频；Acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting the corresponding viewer while watching the first video, and the first video and the multiple The second video corresponding to each viewer is a 2D video;
    根据所述第一视频和所述多个观众各自对应的第二视频，生成3D直播画面，其中，所述3D直播画面的第一区域用于显示与所述第一视频相对应的3D视频画面，所述3D直播画面的第二区域内用于显示与所述多个观众各自对应的第二视频相对应的3D视频画面；Generate a 3D live screen according to the first video and the second video corresponding to each of the multiple viewers, wherein the first area of the 3D live screen is used to display a 3D video screen corresponding to the first video , The second area of the 3D live broadcast picture is used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
    将所述3D直播画面发送至所述多个观众各自对应的3D视频观看设备。The 3D live broadcast picture is sent to a 3D video viewing device corresponding to each of the multiple viewers.
  17. 根据权利要求16所述的方法，其特征在于，所述方法还包括：The method according to claim 16, wherein the method further comprises:
    响应于所述主播对所述多个观众中至少一个观众的选择操作，将所述至少一个观众各自对应的3D视频画面移动到所述第一区域内。In response to the selection operation of the anchor on at least one of the plurality of viewers, the 3D video images corresponding to each of the at least one viewers are moved into the first area.
  18. 一种视频显示装置，其特征在于，包括：A video display device, characterized by comprising:
    获取模块，用于获取主播对应的第一视频以及多个观众各自对应的第二视频，所述第二视频是在观看所述第一视频期间对相应观众进行拍摄得到的视频，所述第一视频和所述多个观众各自对应的第二视频为2D视频；The acquiring module is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers. The second video is a video obtained by shooting a corresponding viewer during watching the first video. The video and the second video corresponding to each of the plurality of viewers are 2D videos;
    生成模块，用于根据所述第一视频和所述多个观众各自对应的第二视频，生成3D直播画面，其中，所述3D直播画面的第一区域用于显示与所述第一视频相对应的3D视频画面，所述3D直播画面的第二区域内用于显示与所述多个观众各自对应的第二视频相对应的3D视频画面；The generating module is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the image corresponding to the first video Corresponding 3D video pictures, in the second area of the 3D live pictures, used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
    发送模块，用于将所述3D直播画面发送至所述多个观众各自对应的3D视频观看设备。The sending module is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
  19. 一种电子设备，其特征在于，包括：存储器、处理器；其中，所述存储器上存储有可执行代码，当所述可执行代码被所述处理器执行时，使所述处理器执行如权利要求16或17所述的视频显示方法。An electronic device, characterized by comprising: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the processor is caused to execute The video display method described in 16 or 17 is required.
  20. 一种非暂时性机器可读存储介质，其特征在于，所述非暂时性机器可读存储介质上存储有可执代码，当所述可执行代码被电子设备的处理器执行时，使所述处理器执行如权利要求16或17所述的视频显示方法。A non-transitory machine-readable storage medium, characterized in that executable code is stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device, the The processor executes the video display method according to claim 16 or 17.
PCT/CN2021/085776 2020-04-10 2021-04-07 Video displaying method, device, equipment, and storage medium WO2021204139A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010280799.X 2020-04-10
CN202010280799 2020-04-10

Publications (1)

Publication Number Publication Date
WO2021204139A1 true WO2021204139A1 (en) 2021-10-14

Family

ID=78022968

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/085776 WO2021204139A1 (en) 2020-04-10 2021-04-07 Video displaying method, device, equipment, and storage medium

Country Status (2)

Country Link
CN (1) CN113518232B (en)
WO (1) WO2021204139A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114173068A (en) * 2021-10-29 2022-03-11 北京中联合超高清协同技术中心有限公司 System for audience and rebroadcasting site remote interaction
CN114598906A (en) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN115334331A (en) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 Communication method, equipment and storage medium for teaching live broadcast
CN115412739A (en) * 2022-08-15 2022-11-29 北京达佳互联信息技术有限公司 Live broadcast room interaction method and device, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115933921A (en) * 2022-11-29 2023-04-07 北京字跳网络技术有限公司 Media content display method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN107591049A (en) * 2017-10-26 2018-01-16 华蓥市双河第三小学 The teaching method given lessons using video
CN109640191A (en) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 A kind of method and apparatus of even wheat live streaming
CN110570698A (en) * 2019-08-21 2019-12-13 北京大米科技有限公司 Online teaching control method and device, storage medium and terminal
CN110568984A (en) * 2019-08-22 2019-12-13 北京大米科技有限公司 Online teaching method and device, storage medium and electronic equipment

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572370B (en) * 2011-01-04 2014-06-11 华为终端有限公司 Video conference control method and conference terminal
CN103763113B (en) * 2013-12-31 2017-03-22 广州华多网络科技有限公司 Live network broadcast method and device and server
CN106803966B (en) * 2016-12-31 2020-06-23 北京星辰美豆文化传播有限公司 Multi-user network live broadcast method and device and electronic equipment thereof
CN110087021B (en) * 2019-05-13 2021-02-26 上海黑驴影视传播有限公司 Online video method and device and video terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN109640191A (en) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 A kind of method and apparatus of even wheat live streaming
CN107591049A (en) * 2017-10-26 2018-01-16 华蓥市双河第三小学 The teaching method given lessons using video
CN110570698A (en) * 2019-08-21 2019-12-13 北京大米科技有限公司 Online teaching control method and device, storage medium and terminal
CN110568984A (en) * 2019-08-22 2019-12-13 北京大米科技有限公司 Online teaching method and device, storage medium and electronic equipment

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114173068A (en) * 2021-10-29 2022-03-11 北京中联合超高清协同技术中心有限公司 System for audience and rebroadcasting site remote interaction
CN114598906A (en) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN114598906B (en) * 2022-02-23 2023-08-22 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN115412739A (en) * 2022-08-15 2022-11-29 北京达佳互联信息技术有限公司 Live broadcast room interaction method and device, electronic equipment and storage medium
CN115334331A (en) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 Communication method, equipment and storage medium for teaching live broadcast
CN115334331B (en) * 2022-08-23 2023-09-22 苏州青颖飞帆软件科技股份有限公司 Communication method, equipment and storage medium for teaching live broadcast

Also Published As

Publication number Publication date
CN113518232A (en) 2021-10-19
CN113518232B (en) 2024-03-01

Similar Documents

Publication Publication Date Title
WO2021204139A1 (en) Video displaying method, device, equipment, and storage medium
US10567448B2 (en) Participation queue system and method for online video conferencing
US20190052473A1 (en) Synchronized Accessibility for Client Devices in an Online Conference Collaboration
CN112235530B (en) Method and device for realizing teleconference, electronic device and storage medium
Prins et al. TogetherVR: A framework for photorealistic shared media experiences in 360-degree VR
JP6455138B2 (en) CONFERENCE SYSTEM AND CONTROL METHOD
US20170171509A1 (en) Method and electronic apparatus for realizing two-person simultaneous live video
CN112788276A (en) Video stream display method, transmission method, device, terminal, server and medium
Chen Conveying conversational cues through video
WO2023098011A1 (en) Video playing method and electronic device
US11240469B1 (en) Systems and methods for audience interactions in real-time multimedia applications
JP7408506B2 (en) Content distribution system, content distribution method, and content distribution program
US11825170B2 (en) Apparatus and associated methods for presentation of comments
CN116847116A (en) Video processing system, method, device and storage medium
US20220083306A1 (en) Information processing device, non-transitory recording medium, and information processing system
EP2629512A1 (en) Method and arrangement for generating and updating A composed video conversation
TW202236845A (en) Video display method, device, equipment, and storage medium to see the video images of the host and the audience at the same time and perceive each other's behavior for facilitating more forms of interaction
CN112672089A (en) Conference control and conferencing method, device, server, terminal and storage medium
KR20200080041A (en) Method and apparatus for generating multi channel images using mobile terminal
JP7419529B2 (en) Immersive teleconference and telepresence interactive overlay processing for remote terminals
JP2023154820A (en) Information processing device and program
CN115243064A (en) Live broadcast control method, device, equipment and storage medium
CN115904159A (en) Display method and device in virtual scene, client device and storage medium
JP2024512904A (en) Techniques for Signaling Multiple Audio Mixing Gains for Teleconference and Telepresence for Remote Terminals Using RTCP Feedback

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21784288

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21784288

Country of ref document: EP

Kind code of ref document: A1