WO2021204139A1 - Procédé d'affichage vidéo, dispositif, équipement et support de stockage - Google Patents

Procédé d'affichage vidéo, dispositif, équipement et support de stockage Download PDF

Info

Publication number
WO2021204139A1
WO2021204139A1 PCT/CN2021/085776 CN2021085776W WO2021204139A1 WO 2021204139 A1 WO2021204139 A1 WO 2021204139A1 CN 2021085776 W CN2021085776 W CN 2021085776W WO 2021204139 A1 WO2021204139 A1 WO 2021204139A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
area
display
viewers
live
Prior art date
Application number
PCT/CN2021/085776
Other languages
English (en)
Chinese (zh)
Inventor
陈航
王程
张腊梅
童晓俊
Original Assignee
钉钉控股（开曼）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 钉钉控股（开曼）有限公司 filed Critical 钉钉控股（开曼）有限公司
Publication of WO2021204139A1 publication Critical patent/WO2021204139A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543—Billing, e.g. for subscription services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the present invention relates to the field of Internet technology, and in particular to a video display method, device, equipment and storage medium.
  • the live video mode has become a common interactive mode in people's entertainment and work.
  • anchor In the live video scene, there are mainly two user roles involved: anchor and audience.
  • the host refers to the party who publishes the video, and the audience is the party who watches the video.
  • viewers At present, in the process of watching live video, viewers usually interact with the anchor by sending barrage, leaving a message, and giving gifts.
  • the interactive mode between the host and the audience also needs to be expanded to meet the needs of different application scenarios.
  • the embodiments of the present invention provide a video display method, device, equipment, and storage medium, which can expand the interactive mode in the live video scene.
  • an embodiment of the present invention provides a video display method, the method including:
  • the second video corresponding to each of the multiple viewers is displayed in the second area of the live broadcast interface.
  • an embodiment of the present invention provides a video display device, which includes:
  • An acquiring module configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video;
  • the display module is configured to display the first video in the first area of the live broadcast interface; and display the second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
  • an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the first aspect.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium that stores executable code on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the first aspect.
  • an embodiment of the present invention provides a video display method, the method including:
  • the 3D live broadcast image is sent to the 3D video viewing device corresponding to each of the multiple viewers.
  • an embodiment of the present invention provides a video display device, which includes:
  • the acquiring module is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers.
  • the second video is a video obtained by shooting a corresponding viewer during watching the first video.
  • the video and the second video corresponding to each of the plurality of viewers are 2D videos;
  • the generating module is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the image corresponding to the first video Corresponding 3D video pictures, in the second area of the 3D live pictures, used to display 3D video pictures corresponding to the second videos respectively corresponding to the plurality of viewers;
  • the sending module is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
  • an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the The processor can at least implement the video display method as described in the fifth aspect.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is used by the processor of the electronic device When executed, the processor can at least implement the video display method as described in the fifth aspect.
  • the anchor when an anchor is conducting a live broadcast, in order to allow the anchor to watch the behavior of the viewer during watching his live video, in the live broadcast interface, in addition to displaying the first video corresponding to the anchor, The second video corresponding to each of multiple viewers can be displayed. Based on this, the video images of the anchor and the viewer can be viewed at the same time through the live broadcast interface, and each other's behavior can be sensed to facilitate more forms of interaction.
  • FIG. 1 is a schematic diagram of a network architecture of a live broadcast scene provided by an embodiment of the present invention
  • FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of the principle of a method for performing video display according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a display effect of a live broadcast interface provided by an embodiment of the present invention.
  • Figure 5 is a schematic diagram of a video decoding process provided by an embodiment of the present invention.
  • FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of the display effect of another live broadcast interface provided by an embodiment of the present invention.
  • FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a display effect of another live broadcast interface provided by an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of another display effect of a live broadcast interface provided by an embodiment of the present invention.
  • FIG. 11 is a flowchart of another video display method provided by an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 12;
  • FIG. 14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of an electronic device corresponding to the video display device provided by the embodiment shown in FIG. 14.
  • the words “if” and “if” as used herein can be interpreted as “when” or “when” or “in response to determination” or “in response to detection”.
  • the phrase “if determined” or “if detected (statement or event)” can be interpreted as “when determined” or “in response to determination” or “when detected (statement or event) )” or “in response to detection (statement or event)”.
  • the video display method provided by the embodiment of the present invention can be applied to a live broadcast scene.
  • a typical network architecture is shown in Figure 1.
  • the network architecture includes a terminal device 1, one or more servers 2. And the terminal device 3, where the terminal device 1 is the terminal device of the host, and the terminal device 3 is the terminal device of any viewer watching the live video.
  • the anchor shoots the live video through the terminal device 1, and transmits the live video to the server 2, and the viewer's terminal device 3 pulls the live video from the server 2 for the viewer to watch.
  • an application program (APP) supporting the live broadcast function may be run in the above-mentioned terminal device 1, the server 2, and the terminal device 3.
  • This application includes but is not limited to instant messaging applications.
  • the application programs running in the terminal devices such as the terminal device 1 and the terminal device 3 are called client programs, and the application programs running in the server 2 are called server programs.
  • the host In order to conduct live broadcast, the host will register an account in the server 2 by operating the corresponding client program. It can be considered that the account corresponds to a live broadcast room. Therefore, when the host logs in to the account to start live broadcast, the live video will be displayed in the live broadcast. The viewer can use the client program in the terminal device 3 to trigger a viewing request to watch the live room corresponding to the account to the server 2 to watch the live video.
  • the terminal device 1 should be understood as a general term for all the terminal devices that the host needs to use for live broadcast.
  • the terminal device 1 may include a camera for shooting live video, and terminal devices such as a PC, a notebook computer, a tablet computer, and a mobile phone that can watch the live video.
  • terminal device 1 may also be a terminal device that has both video shooting and access to the live room to watch the live video, such as a laptop computer, a tablet computer, a mobile phone, and so on.
  • the live video uploaded by the terminal device 1 to the server 2 is generally a video that has undergone encoding processing. Through the encoding processing, the transmission data volume of the live video can be reduced.
  • the live video pulled by the terminal device 3 from the server 2 is also an encoded video, and the decoded live video is displayed after the terminal device 3 performs local decoding processing.
  • the server 2 receives the encoded live video uploaded by the terminal device 1, it can decode the live video as needed, and then perform some processing on the decoded live video, and the processed live video will be encoded again Processing, for the terminal device 3 to pull.
  • the foregoing briefly describes the network architecture to which the video display method provided by the embodiment of the present invention is applicable.
  • the video display method provided by the embodiment of the present invention can be executed by the server 2 described above.
  • the server 2 can use The above-mentioned server-side program is running to execute the method.
  • FIG. 2 is a flowchart of a video display method provided by an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
  • the host in order for the host to be able to see the viewer’s situation in the process of watching his own live video—the first video—he needs to obtain the second video of the viewer while watching the first video, and the second video reflects the corresponding viewer.
  • the status during watching the first video that is, whether you are watching the first video seriously. Therefore, in the live interface that presents the first video of the host (that is, the interface of the corresponding live room), the second video corresponding to each of the multiple viewers is also displayed.
  • the anchor activates the live broadcast function by operating the APP in the terminal device 1, collects the anchor's live video, the first video, through the terminal device 1, and uploads the first video to the server 2.
  • the server 2 displays the anchor's first video in the live broadcast interface 401, and may deliver the live broadcast interface 401 to the terminal device 1 for display.
  • the live interface 401 is also presented on the screen of 3.
  • the live broadcast interface 401 may be divided into different areas, and different areas display different content. As shown in FIG. 4, it can be considered that the live broadcast interface 401 includes two major areas: a video display area A and an interactive message display area B. In the initial situation, when only the first video of the host needs to be displayed, only the first video is displayed in the video display area A.
  • the interactive message display area B is used to display various interactive messages between the viewer and the anchor.
  • the above steps are started.
  • the viewer’s video screen can be collected through its corresponding terminal device 3, which is called the second video, and the second video Upload to server 2.
  • the server 2 will render the second video of the viewer in the live broadcast interface.
  • the above condition may be: when a viewer triggers a viewing request for the first video, the second video corresponding to the viewer is acquired. Specifically, the viewer triggers a viewing request for the first video, which may be considered to have triggered the viewing request when the viewer accesses the host’s live broadcast room.
  • the server 2 delivers the video shooting to the terminal device 3 corresponding to the viewer. Instructed, the terminal device 3 turns on the video shooting function to shoot the second video corresponding to the viewer, and transmits the captured second video to the server 2 in real time.
  • the above condition may also be: the anchor triggers a preset operation. That is, based on the preset operation triggered by the anchor, the second video corresponding to each of the multiple viewers currently watching the first video is obtained.
  • the live mode interface 401 may include a button illustrated in the figure: live mode 402.
  • live mode 402. When the anchor clicks on the live mode 402, it is considered that the anchor has triggered the aforementioned preset operation.
  • the server 2 issues a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video, and each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and The captured second video is transmitted to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of a plurality of viewers.
  • the above condition may also be: if the number of multiple viewers watching the first video reaches a set threshold, then the second video corresponding to each of the multiple viewers is acquired. Assuming that the threshold is 100 people, when the number of viewers accessing the live broadcast room reaches 100, the server 2 will issue a video shooting instruction to the terminal device 3 corresponding to each viewer watching the first video. Each terminal device 3 that receives the instruction turns on the video shooting function to shoot the second video of the corresponding viewer, and transmits the captured second video to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of the multiple viewers. video.
  • the above conditions may also include: clicking on the live mode 402, and the number of multiple viewers watching the first video reaches a set threshold.
  • the server 2 may generate a live broadcast interface 403 as shown in FIG. 4.
  • the video display area A is divided into two areas: a first area A1 and a second area A2.
  • the first video of the host is displayed in the first area A1, and the second videos of the above seven viewers are displayed in the second area A2.
  • the first area A1 is located in the middle area of the video display area A, and the second area A2 is arranged to surround the first area A1.
  • the setting positions of the first area A1 and the second area A2 are not limited to this.
  • the first area A1 and the second area A2 present a vertical position relationship: the upper half of the video display area A is used as the first Area A1, the lower half is regarded as the second area A2.
  • each second video in the second area A2 multiple sub-areas can be determined in the second area A2, and one sub-area is used to display a second video, so that the resolution of the second video is related to the sub-areas.
  • the size of the area matches.
  • a target sub-region corresponding to a certain second video may be randomly determined among multiple sub-regions, so as to display the second video in the target sub-region.
  • the configuration information of the anchor for multiple viewers can also be obtained to determine the display position of the second video corresponding to each of the multiple viewers in the second area A2, that is, which sub-area should be displayed in accordance with the configuration information.
  • the host s configuration information for multiple viewers can reflect which viewers the host wants to focus on (the host can create a list of viewers that need to be focused on). Therefore, assuming that the host sets viewers 1 and 2 to focus on, you can change The second videos of the two viewers are displayed at a relatively prominent position in the second area A2, such as the position illustrated in FIG. 4.
  • the host can trigger a hiding operation on the interactive message display area B, so that it can be hidden
  • the interactive message display area B, and the boundary of the second area A2 is extended to the interactive message display area B, thereby forming a live interface 404.
  • the second videos of viewers 8 and 9 are also included: S8 and S9 .
  • the interactive message display area B can be implemented as a card (or panel) that can be expanded and collapsed, and the card is collapsed to achieve a hidden effect.
  • the terminal device 1 of the host will encode the first video collected, and then transmit the encoded first video to the server 2.
  • the second video corresponding to each of the above-mentioned multiple viewers may also be an encoded video, that is, after the corresponding terminal device 3 collects the second video, after encoding the second video, the encoded second video is transmitted To server 2. Since the server 2 needs to generate the live broadcast interface 403 as shown in FIG. 4 based on the received encoded first video and each second video, in the process of generating the live broadcast interface 403, it is necessary to compare the encoded first video and each second video.
  • the second video is decoded, so that each decoded video is rendered according to the display area set in the live broadcast interface 403.
  • the above-mentioned decoding process performed by the server 2 generally does not cause a large delay.
  • the server 2 performs the above-mentioned decoding process. This may cause a relatively large delay. For this reason, the embodiment of the present invention provides the following solutions:
  • the server 2 distributes the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each.
  • the server 2 receives the decoded second video respectively sent by the at least two devices, and displays the decoded second video in the second area.
  • the above at least two devices are assumed to be device A, device B, and device C.
  • the number of the above-mentioned multiple viewers is 50, and assume that these 50 viewers are all connected to the live broadcast room at very close times.
  • the terminal devices corresponding to the 50 viewers send the second video collected by each to the server 2 after being encoded, and the server 2 allocates 20 second videos to device A, and the other 20 second videos Allocate to device B, and the remaining 10 second videos are allocated to device C, so that the three devices can decode the received second videos in parallel.
  • the server 2 renders the decoded second video to the corresponding position in the second area of the live interface.
  • FIG. 5 does not illustrate the decoding and display process of the first video of the host, it is consistent with the principle of the decoding and display process of the second video.
  • the anchor when an anchor is conducting a live broadcast, in the live interface, in addition to the first video corresponding to the anchor, the second video corresponding to multiple viewers can also be displayed, so that the anchor can watch each audience Behavior during watching its live video. Based on the perception of each viewer's behavior during watching the live video, the anchor can interact with the viewer in a variety of ways.
  • FIG. 6 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 6, the video display method may include the following steps:
  • multiple sub-regions may be determined in the first area, so that the first video and the second video corresponding to at least one viewer selected by the host are displayed in the multiple sub-regions in a one-to-one correspondence.
  • the display result of the first video and the multiple second videos in step 602 is the live broadcast interface 403 illustrated in FIG. 4.
  • the anchor selects viewer 1 and viewer 2 from the 7 viewers indicated in the live interface 403, at this time, as shown in FIG. 7, the second videos S1 and S2 corresponding to viewer 1 and viewer 2 will be from the second area A2.
  • the three sub-areas illustrated in FIG. 7 may be divided into the first area A1, which are respectively used to display the first video and the second video S1 and S2.
  • the first area can be divided into N equal parts to obtain multiple sub-areas, and each sub-areas is used to display a video.
  • N-1 is the number of odd viewers selected for the host.
  • the second video corresponding to each of multiple viewers is displayed in the second area of the live broadcast interface, in order to ensure the listening effect of the viewers, the second video is muted, that is, there are only pictures and no sound.
  • the anchor selects at least one of the above-mentioned viewers and moves the second video of the at least one viewer to the first area for display
  • the voice call function corresponding to the at least one viewer can be activated. That is to say, previously, the voice call function (such as the microphone) of each viewer was turned off.
  • the voice call function of the selected viewer is turned on, so that the selected viewer can talk to the host. Interaction, optionally, the content of the voice interaction can also be heard by other viewers.
  • FIG. 8 is a flowchart of another video display method provided by an embodiment of the present invention. As shown in FIG. 8, the video display method may include the following steps:
  • the display result of the first video and the multiple second videos in step 802 is the live broadcast interface 901 illustrated in FIG. 9.
  • the live broadcast interface 901 the first video of the host is displayed in the first area Q1
  • the second video of the 7 viewers assumed in the foregoing embodiment is displayed in the second area Q2.
  • the host triggers a screen sharing operation in the live interface 901 based on actual needs, he can shoot or obtain the third video containing the host’s terminal device screen by other means, that is, the third video contains the terminal device The content of the data displayed on the screen.
  • the first video is mainly obtained by shooting the anchor itself.
  • the third video is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 902 at this time.
  • the third video can be displayed in the first area Q1 originally used to display the first video, and Move the first video to another location (called the third area) for display.
  • the third area is the second area Q2.
  • the third area may also be another area different from the second area Q2.
  • the screen size of the first video of the host may be larger than the screen size of the second video.
  • the display result of the first video and the multiple second videos in step 802 is the live interface 403 illustrated in FIG. 10, in which the second area A2 of the second videos of multiple viewers is displayed Surround the first area A1 of the first video of the host.
  • the host triggers a screen sharing operation in the live broadcast interface 403
  • the third video containing the data content displayed on the host's terminal device screen is transmitted to the server 2, and the server 2 can generate a new live broadcast interface 1001 at this time.
  • the display area of the third video covers at least the first area A1, that is, the third video is displayed in the first area A1, and the original display and the first video in the first area A1 are transferred to the third area Inside display.
  • the third area may be located in the second area A2, or may be another location area in the live broadcast interface, for example, the area A3 located in the interactive message display area B.
  • the entire video display area A may also be used to display the third video.
  • the second video corresponding to each of the multiple viewers may be moved from the second area A2 to the fourth area of the live interface 1001 for display, so as to expand the display area of the third video.
  • the fourth area may be, for example, area A4 located in the interactive message display area B. Since the video display area A is composed of the above-mentioned first area A1 and the second area A2, the purpose of displaying the third video in the video display area A can be achieved through the above-mentioned process.
  • the interactive message display area B can be hidden in the live interface 1001 at this time.
  • the interactive message display area B can also be moved to other location areas for display.
  • the existing interactive messages such as barrage can be configured to be displayed in the live broadcast interface in a set form, for example, in the video display area according to a certain set Way to display.
  • the anchor is based on the display of the second video of a certain viewer, and when it is found that the viewer is not watching the first video seriously, it sends a targeted reminder to the viewer Voice or text message.
  • the anchor can interact with the audience in more forms, expanding the interactive form.
  • the video display method provided by the above embodiments of the present invention can be used in practical application scenarios such as a teacher's network teaching, a company's network conference, and the like.
  • the teacher can give lectures through live broadcast. If the teacher cannot see the student’s listening status and does not know whether the student is listening carefully, it is likely that some students’ poor self-consciousness will lead to ineffective teaching. good. For this reason, when the teacher conducts live teaching in the live broadcast room, the video pictures of the teacher and each student are displayed in the live broadcast interface at the same time, so that the teacher can clearly perceive the students' listening status, so as to timely find the students who are not listening carefully. Reminders can also realize the teaching interaction with students.
  • the first video in the foregoing embodiment may be the teacher's image
  • the third video may be the PPT courseware displayed on the teacher's computer terminal.
  • the company director can organize the meeting through live broadcast, that is, the company director starts the live broadcast, and the company staff access the live room to participate in the meeting.
  • the video screen of each participant can also be displayed in the live broadcast interface.
  • FIG. 11 is a flowchart of yet another video display method provided by an embodiment of the present invention.
  • the video display method may be executed by the server mentioned above. As shown in FIG. 11, the video display method may include the following steps:
  • the second video is a video obtained by shooting the corresponding viewer while watching the first video.
  • the first video and the second video corresponding to each of the multiple viewers The second video is a 2D video.
  • the videos in the foregoing other embodiments are all 2D videos, that is, the live broadcast interface viewed by the audience is a 2D picture.
  • a 3D live broadcast image may be provided to the audience.
  • the above-mentioned first video is captured by a camera set in the space where the host is located.
  • the second video corresponding to a viewer is also captured by a camera set in the space where the viewer is located.
  • Both the first video and the second video may be 2D videos.
  • the first video can also include the surrounding environment images of the host, and the second video is also the same.
  • a 3D live broadcast image can be generated according to the first video and the second video corresponding to each of the multiple viewers.
  • the existing related technology of converting 2D video to 3D video can be used to convert the first video and each second video into corresponding 3D video pictures, and then all the obtained 3D video pictures are laid out according to a certain layout method. , In order to get the 3D live broadcast picture.
  • the viewer watches the 3D live broadcast through a 3D video viewing device, he can watch the 3D video corresponding to the host in the first area of the 3D live broadcast, and in the second area of the 3D live broadcast. Watched 3D video images corresponding to multiple viewers.
  • the first area may be the central area of the 3D live broadcast picture
  • the second area may be the surrounding area of the 3D live broadcast picture.
  • the 3D video viewing device may be a virtual reality (Virtual Reality, VR for short) device, such as a VR helmet and VR glasses.
  • the 3D video viewing device may also be an augmented reality (Augmented Reality, AR for short) device, such as an AR helmet and AR glasses.
  • AR Augmented Reality
  • the 3D video viewing device may also be other wearable devices or non-wearable devices that support 3D video viewing capabilities.
  • the above-mentioned video display method may further include the following step: in response to a selection operation of at least one of the plurality of viewers by the host, moving the 3D video images corresponding to each of the selected at least one viewer into the first area.
  • the audience can watch the 3D video of the anchor and the selected audience in the first area.
  • the voice call function of the at least one viewer is enabled. At this time, any viewer can not only see the host and the 3D video images of each viewer, but also listen to it. The voice signal of the host and the selected at least one viewer.
  • the voice signal of the host and the voice signal of the at least one selected audience may have different sound source effects.
  • the voice signal of the host can be set to have the sound effect transmitted from the front of the audience to the audience, while the voice signals of other selected audiences have the sound effect transmitted from the left or right side of the audience to the audience, so as to enhance the user’s experience. Immersive viewing experience.
  • video display device of one or more embodiments of the present invention will be described in detail. Those skilled in the art can understand that these video display devices can all be configured by using commercially available hardware components through the steps taught in this solution.
  • FIG. 12 is a schematic structural diagram of a video display device provided by an embodiment of the present invention.
  • the video display device may be located in the server mentioned in the foregoing embodiment. As shown in FIG. 12, the device includes: an acquisition module 11 and a display module 12.
  • the acquiring module 11 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers, where the second video is a video obtained by shooting a corresponding viewer while watching the first video.
  • the display module 12 is configured to display the first video in a first area of the live broadcast interface; and display a second video corresponding to each of the multiple viewers in the second area of the live broadcast interface.
  • the obtaining module 11 may be specifically configured to: in response to a preset operation triggered by the anchor, obtain the second video corresponding to each of the multiple viewers.
  • the acquiring module 11 may be specifically configured to: if the number of the multiple viewers reaches a set threshold, acquire the second video corresponding to each of the multiple viewers.
  • the device further includes: a determining module, configured to obtain configuration information of the anchor for the multiple viewers; and determine, according to the configuration information, that the second video corresponding to each of the multiple viewers is in the first video. The display position in the second area.
  • a determining module configured to obtain configuration information of the anchor for the multiple viewers; and determine, according to the configuration information, that the second video corresponding to each of the multiple viewers is in the first video. The display position in the second area.
  • the second video corresponding to each of the multiple viewers is an encoded video.
  • the display module 12 may be specifically configured to: distribute the encoded second video corresponding to each of the multiple viewers to at least two devices, and the at least two devices decode the second video received by each; Receiving the decoded second video respectively sent by the at least two devices, and displaying the decoded second video in the second area.
  • the display module 12 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, display the second video corresponding to each of the at least one viewer in the first area Inside.
  • the display module 12 may be specifically configured to: determine a plurality of sub-areas in the first area; display the first video and the second video corresponding to the at least one viewer in a one-to-one correspondence. Multiple sub-regions.
  • the device further includes: a control module configured to enable a voice call function corresponding to the at least one viewer.
  • the live broadcast interface further includes: an interactive message display area.
  • the display module 12 may also be used to: in response to a hiding operation triggered on the interactive message display area, hide the interactive message display area, and extend the boundary of the second area to the interactive message display area.
  • the display module 12 may be further configured to: in response to a screen sharing operation triggered by the host, display a third video corresponding to the host in the first area, and move the first video to the It is displayed in the third area of the live broadcast interface, where the third video is obtained by shooting the screen of the host's terminal device.
  • the second area surrounds the first area.
  • the display module 12 may also be used to move the second video corresponding to each of the multiple viewers to the fourth area of the live broadcast interface for display, so as to expand the display area of the third video.
  • the display module 12 may also be used to: hide the interactive message display area in the live broadcast interface; and generate the third area and the fourth area at positions corresponding to the interactive message display area.
  • the device shown in FIG. 12 can execute the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10.
  • the structure of the video display device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a first processor 21 and a first memory 22.
  • executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the functions provided in the embodiments shown in FIGS. 1 to 10 above.
  • Video display method is described in a possible design, the structure of the video display device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a first processor 21 and a first memory 22.
  • executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the functions provided in the embodiments shown in FIGS. 1 to 10 above.
  • Video display method is described in a possible design, the structure of the video display device shown in FIG. 12 may be implemented as an electronic
  • the electronic device may also include a first communication interface 23 for communicating with other devices.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the foregoing embodiments shown in FIG. 1 to FIG. 10.
  • FIG. 14 is a schematic structural diagram of another video display device provided by an embodiment of the present invention.
  • the video display device may be located in the server mentioned in the foregoing embodiment.
  • the device includes: an acquiring module 31, a generating module 32, and a sending module 33.
  • the acquiring module 31 is configured to acquire a first video corresponding to the anchor and a second video corresponding to each of multiple viewers.
  • the second video is a video obtained by shooting a corresponding viewer while watching the first video.
  • a video and a second video corresponding to each of the plurality of viewers are 2D videos.
  • the generating module 32 is configured to generate a 3D live screen according to the first video and the second video corresponding to each of the plurality of viewers, wherein the first area of the 3D live screen is used to display the second video corresponding to the first video.
  • the second area of the 3D live picture is used to display the 3D video picture corresponding to the second video corresponding to each of the plurality of viewers.
  • the sending module 33 is configured to send the 3D live broadcast image to the 3D video viewing device corresponding to each of the multiple viewers.
  • the generating module 32 may be further configured to: in response to a selection operation of at least one viewer of the plurality of viewers by the anchor, move the 3D video images corresponding to each of the at least one viewer to the first area Inside.
  • the device shown in FIG. 14 can execute the video display method provided in the embodiment shown in FIG. 11, and the detailed execution process and technical effects can be referred to the description in the foregoing embodiment, which will not be repeated here.
  • the structure of the video display device shown in FIG. 14 may be implemented as an electronic device, and the electronic device may be the server in the foregoing embodiment.
  • the electronic device may include: a second processor 41, a second memory 42, and a second communication interface 43.
  • executable code is stored on the second memory 42.
  • the second processor 41 can at least realize the video display provided in the embodiment shown in FIG. method.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device , So that the processor can at least implement the video display method provided in the embodiment shown in FIG. 11.
  • each implementation manner can be implemented by adding a necessary general hardware platform, and of course, it can also be implemented by a combination of hardware and software.
  • the above technical solution essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present invention can be used in one or more computer usable storage containing computer usable program codes.
  • the form of a computer program product implemented on a medium including but not limited to disk storage, CD-ROM, optical storage, etc.).
  • the video display method provided by the embodiment of the present invention can be executed by a certain program/software, and the program/software can be provided by the network side.
  • the electronic device mentioned in the foregoing embodiment can download the program/software to a local non-easy
  • the program/software is read into the memory by the CPU, and the program/software is executed by the CPU to implement the video display method provided in the foregoing embodiment.
  • the execution process please refer to the schematic diagrams in Figures 1 to 11 described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Les modes de réalisation de la présente invention concernent un procédé d'affichage vidéo, un dispositif, un équipement et un support de stockage. Le procédé consiste : à acquérir une première vidéo correspondant à un présentateur et des secondes vidéos correspondant respectivement à de multiples spectateurs, les secondes vidéos étant des vidéos produites par l'enregistrement des spectateurs correspondants alors qu'ils visualisent la première vidéo ; à afficher la première vidéo dans une première zone d'une interface de diffusion en continu en direct, et à afficher les secondes vidéos correspondant respectivement aux multiples spectateurs dans une seconde zone de l'interface de diffusion en continu en direct. Sur cette base, des images vidéo du présentateur et des spectateurs peuvent être visualisées simultanément par l'intermédiaire de l'interface de diffusion en continu en direct, et des actions de chacun d'eux peuvent être perçues, ce qui facilite ainsi des formes d'interactions accrues.
PCT/CN2021/085776 2020-04-10 2021-04-07 Procédé d'affichage vidéo, dispositif, équipement et support de stockage WO2021204139A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010280799.X 2020-04-10
CN202010280799 2020-04-10

Publications (1)

Publication Number Publication Date
WO2021204139A1 true WO2021204139A1 (fr) 2021-10-14

Family

ID=78022968

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/085776 WO2021204139A1 (fr) 2020-04-10 2021-04-07 Procédé d'affichage vidéo, dispositif, équipement et support de stockage

Country Status (2)

Country Link
CN (1) CN113518232B (fr)
WO (1) WO2021204139A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114173068A (zh) * 2021-10-29 2022-03-11 北京中联合超高清协同技术中心有限公司 观众与转播现场远程互动的系统
CN114598906A (zh) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 教学直播方法、介质和计算机设备
CN115334331A (zh) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 一种教学直播的通讯方法、设备及存储介质
CN115412739A (zh) * 2022-08-15 2022-11-29 北京达佳互联信息技术有限公司 一种直播间交互方法、装置、电子设备及存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115933921A (zh) * 2022-11-29 2023-04-07 北京字跳网络技术有限公司 媒体内容的展示方法、装置、电子设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN107591049A (zh) * 2017-10-26 2018-01-16 华蓥市双河第三小学 采用视频授课的教学方法
CN109640191A (zh) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 一种连麦直播的方法和装置
CN110568984A (zh) * 2019-08-22 2019-12-13 北京大米科技有限公司 在线教学方法、装置、存储介质及电子设备
CN110570698A (zh) * 2019-08-21 2019-12-13 北京大米科技有限公司 一种在线教学控制方法、装置、存储介质以及终端

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572370B (zh) * 2011-01-04 2014-06-11 华为终端有限公司 视频会议的控制方法和会议终端
CN103763113B (zh) * 2013-12-31 2017-03-22 广州华多网络科技有限公司 网络直播方法、装置及服务器
CN106803966B (zh) * 2016-12-31 2020-06-23 北京星辰美豆文化传播有限公司 一种多人网络直播方法、装置及其电子设备
CN110087021B (zh) * 2019-05-13 2021-02-26 上海黑驴影视传播有限公司 在线视频方法、装置及视频终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN109640191A (zh) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 一种连麦直播的方法和装置
CN107591049A (zh) * 2017-10-26 2018-01-16 华蓥市双河第三小学 采用视频授课的教学方法
CN110570698A (zh) * 2019-08-21 2019-12-13 北京大米科技有限公司 一种在线教学控制方法、装置、存储介质以及终端
CN110568984A (zh) * 2019-08-22 2019-12-13 北京大米科技有限公司 在线教学方法、装置、存储介质及电子设备

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114173068A (zh) * 2021-10-29 2022-03-11 北京中联合超高清协同技术中心有限公司 观众与转播现场远程互动的系统
CN114598906A (zh) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 教学直播方法、介质和计算机设备
CN114598906B (zh) * 2022-02-23 2023-08-22 北京碧云数创科技有限公司 教学直播方法、介质和计算机设备
CN115412739A (zh) * 2022-08-15 2022-11-29 北京达佳互联信息技术有限公司 一种直播间交互方法、装置、电子设备及存储介质
CN115334331A (zh) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 一种教学直播的通讯方法、设备及存储介质
CN115334331B (zh) * 2022-08-23 2023-09-22 苏州青颖飞帆软件科技股份有限公司 一种教学直播的通讯方法、设备及存储介质

Also Published As

Publication number Publication date
CN113518232A (zh) 2021-10-19
CN113518232B (zh) 2024-03-01

Similar Documents

Publication Publication Date Title
WO2021204139A1 (fr) Procédé d'affichage vidéo, dispositif, équipement et support de stockage
US10567448B2 (en) Participation queue system and method for online video conferencing
US20190052473A1 (en) Synchronized Accessibility for Client Devices in an Online Conference Collaboration
CN112235530B (zh) 远程会议的实现方法及装置、电子设备、存储介质
Prins et al. TogetherVR: A framework for photorealistic shared media experiences in 360-degree VR
JP6455138B2 (ja) 会議システム、及び制御方法
US20170171509A1 (en) Method and electronic apparatus for realizing two-person simultaneous live video
US11240469B1 (en) Systems and methods for audience interactions in real-time multimedia applications
CN112788276A (zh) 视频流显示方法、发送方法、装置、终端、服务器及介质
Chen Conveying conversational cues through video
CN112055252A (zh) 多屏互动方法、装置、计算机可读介质及电子设备
WO2023098011A1 (fr) Procédé de lecture vidéo et dispositif électronique
JP7408506B2 (ja) コンテンツ配信システム、コンテンツ配信方法、およびコンテンツ配信プログラム
US11825170B2 (en) Apparatus and associated methods for presentation of comments
CN116847116A (zh) 一种视频处理系统、方法、装置及存储介质
CN113676690A (zh) 一种视频会议的实现方法、设备及存储介质
US20220083306A1 (en) Information processing device, non-transitory recording medium, and information processing system
EP2629512A1 (fr) Procédé et agencement pour générer et mettre à jour une conversation vidéo composée
TW202236845A (zh) 視頻顯示方法、裝置、設備和儲存媒體
KR20200080041A (ko) 모바일 단말을 이용한 다채널 영상 생성 방법 및 장치
JP7419529B2 (ja) 遠隔端末のための没入型テレカンファレンス及びテレプレゼンスのインタラクティブオーバーレイ処理
JP2023154820A (ja) 情報処理装置及びプログラム
CN115243064A (zh) 一种直播控制方法、装置、设备和存储介质
JP2024512904A (ja) Ｒｔｃｐフィードバックを使用したリモート端末のためのテレコンファレンス及びリモートターミナルのためのテレプレゼンスのための複数のオーディオミキシングゲインをシグナリングするための技術

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21784288

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21784288

Country of ref document: EP

Kind code of ref document: A1