CN113518232A - Video display method, device, equipment and storage medium - Google Patents

Video display method, device, equipment and storage medium Download PDF

Info

Publication number
CN113518232A
CN113518232A CN202010413380.7A CN202010413380A CN113518232A CN 113518232 A CN113518232 A CN 113518232A CN 202010413380 A CN202010413380 A CN 202010413380A CN 113518232 A CN113518232 A CN 113518232A
Authority
CN
China
Prior art keywords
video
area
viewer
display
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010413380.7A
Other languages
Chinese (zh)
Other versions
CN113518232B (en
Inventor
杨博宇
刘典
陈朴
闾金涛
胡洪卫
李琛
张黎黎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nail Holding Cayman Co ltd
Original Assignee
Nail Holding Cayman Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nail Holding Cayman Co ltd filed Critical Nail Holding Cayman Co ltd
Publication of CN113518232A publication Critical patent/CN113518232A/en
Application granted granted Critical
Publication of CN113518232B publication Critical patent/CN113518232B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543—Billing, e.g. for subscription services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a video display method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video; and displaying a first video in a first area of the live interface, and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface. Based on this, the video images of the anchor and the audience can be seen simultaneously through the live interface, and the behaviors of the anchor and the audience are sensed, so that more forms of interaction can be performed conveniently.

Description

Video display method, device, equipment and storage medium
Cross-referencing
The present application is incorporated by reference in its entirety into the present application, chinese patent application No. 202010280799, X entitled "video display method, apparatus, device and storage medium", filed 04/10/2020.
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a video display method, apparatus, device, and storage medium.
Background
At present, a video live broadcast mode becomes a common interaction mode in people's entertainment and work.
In a video live broadcast scene, two user roles are mainly involved: a main cast and a viewer. The anchor refers to the party that distributes the video, while the viewer is the party that watches the video. At present, in the process of watching live video, the interaction mode of audience with the main broadcast is generally the modes of bullet screen launching, message leaving, total gift, etc.
As the video live broadcast mode is used in more and more application scenes, the interactive mode between the anchor and the audience needs to be expanded to meet the requirements of different application scenes.
Disclosure of Invention
The embodiment of the invention provides a video display method, a video display device, video display equipment and a storage medium, which can expand an interaction mode in a video live broadcast scene.
In a first aspect, an embodiment of the present invention provides a video display method, where the method includes:
the method comprises the steps of obtaining a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video;
displaying the first video in a first area of a live interface;
and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
In a second aspect, an embodiment of the present invention provides a video display apparatus, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, and the second video is a video obtained by shooting the corresponding audiences during watching the first video;
the display module is used for displaying the first video in a first area of a live broadcast interface; and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to implement at least the video display method of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to implement at least the video display method according to the first aspect.
In a fifth aspect, an embodiment of the present invention provides a video display method, where the method includes:
acquiring a first video corresponding to a main broadcast and second videos corresponding to a plurality of audiences respectively, wherein the second videos are videos obtained by shooting corresponding audiences during watching the first video, and the first videos and the second videos corresponding to the audiences respectively are 2D videos;
generating a 3D live broadcast picture according to the first video and a second video corresponding to the plurality of audiences, wherein a first area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the second video corresponding to the plurality of audiences;
and sending the 3D live broadcast picture to the 3D video watching equipment corresponding to the plurality of audiences.
In a sixth aspect, an embodiment of the present invention provides a video display apparatus, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences, the second video is obtained by shooting the corresponding audiences during watching the first video, and the first video and the second video corresponding to the audiences are 2D videos;
a generating module, configured to generate a 3D live broadcast picture according to the first video and a second video corresponding to each of the multiple viewers, where a first area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the second video corresponding to each of the multiple viewers;
and the sending module is used for sending the 3D live broadcast picture to the 3D video watching equipment corresponding to the plurality of audiences.
In a seventh aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to implement at least the video display method of the fifth aspect.
In an eighth aspect, the present invention provides a non-transitory machine-readable storage medium, on which an executable code is stored, and when the executable code is executed by a processor of an electronic device, the processor is enabled to implement at least the video display method according to the fifth aspect.
In the embodiment of the invention, when a certain anchor is in live broadcasting, in order to enable the anchor to watch the behavior of the audience during watching the live video, in the live broadcasting interface, besides the first video corresponding to the anchor, the second video corresponding to a plurality of audiences can be displayed, and based on the fact that the video images of the anchor and the audiences can be simultaneously seen through the live broadcasting interface, the behaviors of the anchor and the audiences are sensed, so that more forms of interaction can be conveniently carried out.
In a ninth aspect, an embodiment of the present invention provides a video display method, where the method includes:
responding to a watching request of a viewer for a first video corresponding to a main broadcast, and if the viewer has the permission of watching the first video, acquiring a second video corresponding to the viewer;
displaying a first direct-playing interface in the terminal equipment of the audience, wherein the first video is displayed in a first area of the first direct-playing interface, and the second video is displayed in a second area of the first direct-playing interface.
In a tenth aspect, an embodiment of the present invention provides a video display apparatus, including:
the acquisition module is used for responding to a watching request of a viewer for a first video corresponding to a main broadcast, and acquiring a second video corresponding to the viewer if the viewer has the permission to watch the first video;
and the display module is used for displaying a first direct-playing interface in the terminal equipment of the audience, wherein the first video is displayed in a first area of the first direct-playing interface, and the second video is displayed in a second area of the first direct-playing interface.
In an eleventh aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to implement at least the video display method of the ninth aspect.
In a twelfth aspect, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a processor of an electronic device, causes the processor to implement at least the video display method according to the ninth aspect.
In the solutions provided in the ninth to twelfth aspects, when a certain anchor is performing live broadcasting, if a certain user wants to view a first video of the anchor live broadcasting, the user needs to be authenticated for the viewing right, and if the user has the viewing right, on one hand, a live interface including the first video corresponding to the anchor live broadcasting can be provided for the user to view, and on the other hand, a video of the audience, which is called a second video, can be obtained and also displayed in the live interface, so that the audience and the anchor can see video pictures of each other and perceive behaviors of each other, so as to perform more forms of interaction.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a schematic diagram of a network architecture of a live broadcast scenario according to an embodiment of the present invention;
fig. 2 is a flowchart of a video display method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating a method for performing video display according to an embodiment of the present invention;
fig. 4 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a video decoding process according to an embodiment of the present invention;
FIG. 6 is a flow chart of another video display method according to an embodiment of the present invention;
fig. 7 is a schematic view of a display effect of another live interface according to an embodiment of the present invention;
FIG. 8 is a flowchart illustrating a further video display method according to an embodiment of the present invention;
fig. 9 is a schematic view of a display effect of another live interface according to an embodiment of the present invention;
fig. 10 is a schematic view illustrating a display effect of another live interface according to an embodiment of the present invention;
FIG. 11 is a flowchart illustrating a further video display method according to an embodiment of the present invention;
fig. 12 is a schematic structural diagram of a video display apparatus according to an embodiment of the present invention;
fig. 13 is a schematic structural diagram of an electronic device corresponding to the video display apparatus provided in the embodiment shown in fig. 12;
FIG. 14 is a schematic structural diagram of another video display apparatus according to an embodiment of the present invention;
fig. 15 is a schematic structural diagram of an electronic device corresponding to the video display apparatus provided in the embodiment shown in fig. 14;
fig. 16 is a flowchart of a video display method according to an embodiment of the present invention;
fig. 17 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 18 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 19 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 20 is a schematic view illustrating a display effect of a live interface according to an embodiment of the present invention;
fig. 21 is a flowchart of a video display method according to an embodiment of the present invention;
fig. 22 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 23 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 24 is a schematic view of a display effect of a live interface according to an embodiment of the present invention;
fig. 25 is a schematic structural diagram of a video display apparatus according to an embodiment of the present invention;
fig. 26 is a schematic structural diagram of an electronic device corresponding to the video display apparatus provided in the embodiment shown in fig. 25.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a plurality" typically includes at least two.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
The video display method provided by the embodiment of the invention can be applied to a live scene, wherein a typical network architecture is shown in fig. 1 in the live scene, and the network architecture comprises a terminal device 1, one or more servers 2 and a terminal device 3, wherein the terminal device 1 is a terminal device of a main broadcast, and the terminal device 3 is a terminal device of any audience watching a live video. The anchor shoots the live video through terminal equipment 1, and with live video transmission to server 2 in, spectator's terminal equipment 3 draws the live video from server 2 for spectator watches.
In order to implement live applications, an application program (APP) supporting a live function may be run in the terminal device 1, the server 2, and the terminal device 3. The application includes, but is not limited to, an instant messaging application.
In general, an application program running in the terminal devices, i.e., the terminal device 1 and the terminal device 3, is referred to as a client program, and an application program running in the server 2 is referred to as a server program.
For live broadcasting, the anchor will register an account in the server 2 by operating a corresponding client program, and the account can be considered to correspond to a live broadcasting room, so that when the anchor logs in the account to start live broadcasting, live broadcasting video can be displayed in the live broadcasting room, and a viewer can watch live broadcasting video by triggering a watching request of watching the live broadcasting room corresponding to the account to the server 2 through the client program in the terminal device 3.
In addition, in practical applications, the anchor often needs to see the picture of the live video, in some embodiments, the terminal device 1 is to be understood as a generic term of all terminal devices that are required by the anchor for live broadcasting, and actually, the terminal device 1 may include: the system comprises a camera for shooting live video and terminal equipment such as a PC (personal computer), a notebook computer, a tablet personal computer, a mobile phone and the like which can watch the live video. Of course, the terminal device 1 may also be a terminal device having both video shooting and accessing a live broadcast room to watch live video, such as a notebook computer, a tablet computer, a mobile phone, and the like.
In practical application, the live video uploaded to the server 2 by the terminal device 1 is generally a video subjected to encoding processing, and the transmission data volume of the live video can be reduced through the encoding processing. Correspondingly, the live video pulled by the terminal device 3 from the server 2 is also a coded video, and after the terminal device 3 locally performs decoding processing, the decoded live video is displayed. Of course, after receiving the encoded live video uploaded by the terminal device 1, the server 2 can decode the live video as needed, and then perform some processing on the decoded live video, and then encode the processed live video for the terminal device 3 to pull.
In the foregoing, a network architecture to which the video display method provided in the embodiment of the present invention is applied is briefly described, and under the network architecture, the video display method provided in the embodiment of the present invention may be executed by the server 2, and specifically, the server 2 may execute the method through the running server program.
The following describes an implementation procedure of a video display method according to an embodiment of the present invention with reference to the following embodiments.
Fig. 2 is a flowchart of a video display method according to an embodiment of the present invention, and as shown in fig. 2, the method includes the following steps:
201. the method comprises the steps of obtaining a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video.
202. And displaying a first video corresponding to the main broadcast in a first area of the live broadcast interface.
203. And displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
In this embodiment, in order for the anchor to see the condition of the viewer in the process of watching the first video, which is a live video of the anchor, it is necessary to obtain a second video during the process of watching the first video by the viewer, where the second video reflects the state of the corresponding viewer during the process of watching the first video, that is, whether the viewer is watching the first video carefully. Thus, in the live interface (i.e., the interface of the corresponding live room) in which the first video of the anchor is presented, the second video corresponding to each of the plurality of viewers is also displayed.
Based on the network architecture shown in fig. 1, an alternative implementation of the above steps in practical applications is described below with reference to fig. 3 and 4.
In practical application, after the anchor starts the live broadcast function by operating the APP in the terminal device 1, the live broadcast video, i.e., the first video, of the anchor is acquired by the terminal device 1, and the first video is uploaded to the server 2. At this time, as shown in fig. 4, the server 2 displays the first video of the anchor in the live interface 401, and may issue the live interface 401 to the terminal device 1 for display. In addition, it can be understood that, if a certain viewer triggers a request to view the live video by accessing the live room of the anchor at this time, the live interface 401 is also presented on the screen of the terminal device 3 of the viewer without executing the method provided in this embodiment.
In this context, the live interface 401 may be divided into different regions, as desired, with different regions displaying different content. As shown in fig. 4, the live interface 401 may be considered to include two large areas: a video display area a and an interactive message display area B. Initially, when only the first video of the anchor needs to be displayed, only the first video is displayed in the video display area a. The interactive message display area B is used to display various interactive messages of the viewer with the anchor.
In fact, when the conditions for executing the video display method provided by the present embodiment are satisfied, the above steps are started to be executed. In the execution process, as shown in fig. 3, for a certain viewer accessing the live broadcast room of the anchor, a video picture of the viewer, called as a second video, may be collected by the corresponding terminal device 3, and the second video is uploaded to the server 2. The server 2 will render the second video of the viewer in the live interface.
Wherein, optionally, the condition may be: when a viewer triggers a viewing request of the first video, a second video corresponding to the viewer is obtained. Specifically, the triggering of the viewing request for the first video by the viewer may be that the viewing request is considered to be triggered when the viewer accesses a live broadcast room of the anchor, based on the viewing request, the server 2 issues a video shooting instruction to the terminal device 3 corresponding to the viewer, and the terminal device 3 starts a video shooting function to shoot the second video corresponding to the viewer, and transmits the shot second video to the server 2 in real time.
Alternatively, the above condition may be: the anchor triggers a preset operation. That is to say, the second video corresponding to each of the multiple viewers watching the first video is acquired based on the preset operation triggered by the anchor.
As shown in fig. 4, buttons illustrated in the figure may be included in the live interface 401: a field mode 402. When the anchor clicks on the live mode 402, the anchor is considered to trigger the preset operation described above. At this time, the server 2 issues a video shooting instruction to the terminal devices 3 corresponding to the respective viewers watching the first video, each terminal device 3 receiving the instruction starts a video shooting function to shoot the second video of the corresponding viewer, and transmits the shot second video to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of the multiple viewers.
Alternatively, the above condition may be: and if the number of the audiences watching the first video reaches a set threshold value, acquiring the second video corresponding to the audiences. The threshold is assumed to be 100 people, so that when the number of the audiences accessing the live broadcast room reaches 100 people, the server 2 will issue a video shooting instruction to the terminal device 3 corresponding to each audience watching the first video. Each terminal device 3 that receives the instruction starts a video shooting function to shoot the second video of the corresponding viewer, and transmits the shot second video to the server 2 in real time, so that the server 2 obtains the second video corresponding to each of the plurality of viewers.
Optionally, the above conditions may also include: click on live mode 402 and the number of viewers watching the first video reaches a set threshold.
For convenience of description, in fig. 4, it is assumed that the viewer who is currently watching the first video (i.e., accessing the live room) includes: viewer 1, viewer 2, viewer 3, viewer 4, viewer 5, viewer 6, and viewer 7, and it is assumed that the second videos corresponding to these 7 viewers are respectively represented as: s1, S2, S3, S4, S5, S6, S7. Based on the acquisition results of the first video of the anchor and the second videos of the above-mentioned 7 viewers, the server 2 may generate a live interface 403 as illustrated in fig. 4. In the live interface 403, the video display area a is divided into two areas: a first region a1 and a second region a 2. Here, the first video of the main broadcast is displayed in the first area a1, and the second video of the 7 viewers is displayed in the second area a 2.
In fig. 4, the first region a1 is located in the middle of the video display region a, and the second region a2 is provided so as to surround the first region a 1. However, in practice, the positions of the first region a1 and the second region a2 are not limited to this, and for example, the first region a1 and the second region a2 are in an up-down positional relationship: the upper half of the video display area a serves as a first area a1, and the lower half serves as a second area a 2.
It is understood that, as compared with the live interface 401 and the live interface 403, the display area of the first video becomes smaller, which means that the server 2 can perform resolution conversion processing on the first video to match the change in the display area of the first video.
In addition, for the display of the respective second videos in the second area a2, a plurality of sub-areas, one for displaying one second video, may be determined in the second area a2, so that the resolution of the second video matches the size of the sub-area.
Alternatively, a target sub-area corresponding to a certain second video may be randomly determined among a plurality of sub-areas to display the second video within the target sub-area.
Alternatively, the sub-area in which the second video corresponding to each viewer should be displayed may be determined according to the order in which each viewer accesses the live broadcast room, according to the correspondence between the preset access order and the plurality of sub-areas.
Optionally, configuration information of the anchor for a plurality of viewers may also be obtained to determine, according to the configuration information, a display position of the second video in the second area a2, that is, a sub-area in which the second video corresponding to each of the plurality of viewers should be displayed. Where the configuration information of the anchor for multiple viewers may reflect which viewers the anchor wishes to focus on (the anchor may create a list of viewers that require focus), the second video of viewer 1 and viewer 2 may be displayed in a more prominent position in second area a2, such as the position illustrated in fig. 4, assuming that the anchor sets that both viewers require focus.
In practical applications, when the number of viewers accessing the live broadcast room is large, in order to more clearly view the second video of the large number of viewers, optionally, the anchor may trigger a hiding operation on the interactive message display area B, so that the interactive message display area B may be hidden, and the boundary of the second area a2 may be extended to the interactive message display area B, so as to form the live broadcast interface 404, in the live broadcast interface 404, it is assumed that the second video of the viewers 8 and 9 is also included: s8 and S9. Here, the interactive message display area B may be implemented as a card (or a panel) that can be expanded and contracted, and the card is contracted to implement a hidden effect.
As described above, in practical applications, in order to reduce the data transmission amount between the terminal device and the server, the terminal device 1 of the anchor encodes the collected first video and transmits the encoded first video to the server 2. Similarly, the second video corresponding to each of the multiple viewers may also be an encoded video, that is, after the corresponding terminal device 3 acquires the second video, the second video is encoded, and then the encoded second video is transmitted to the server 2. Since the server 2 is to generate a live interface 403 as illustrated in fig. 4 based on the received encoded first video and the received second videos, in the process of generating the live interface 403, the encoded first video and the encoded second videos need to be decoded, so that the decoded videos are rendered according to a display area set in the live interface 403. The process of decoding performed by the server 2 generally does not result in a larger delay when the number of the plurality of viewers is smaller, but the process of decoding performed by the server 2 generally results in a larger delay when the number of viewers is larger, and therefore, the following solutions are provided in the embodiments of the present invention:
the server 2 distributes the second video corresponding to each of the plurality of encoded viewers to at least two devices, and decodes the second video received by each of the at least two devices. The server 2 receives the decoded second videos respectively sent by the at least two devices, and displays the decoded second videos in the second area.
To facilitate understanding of the above process, an exemplary description is given in conjunction with fig. 5. In fig. 5, the at least two devices are assumed to be a device a, a device B, and a device C. Assume that the number of viewers is 50 and that the 50 viewers all access the live room at very close times. As shown in fig. 5, the terminal devices corresponding to the 50 viewers transmit the encoded second videos to the server 2, the server 2 allocates 20 second videos to the device a, another 20 second videos to the device B, and the remaining 10 second videos to the device C, so that the three devices decode the received second videos in parallel. And when one of the devices decodes one second video, the decoded second video is sent to the server 2, and the server 2 renders the decoded second video to a corresponding position in a second area in the live interface.
It should be noted that the resolution conversion process described above may be performed in the three devices to reduce the computational load on the server 2. In addition, although the decoding and display process of the first video of the anchor is not illustrated in fig. 5, it is consistent with the decoding and display process principle of the second video.
In summary, when a certain anchor is performing live broadcasting, in the live broadcasting interface, in addition to the first video corresponding to the anchor, a second video corresponding to each of a plurality of viewers may be displayed, so that the anchor can watch the behavior of each viewer during watching the live video. Based on the perception of the behavior of each viewer during viewing of the live video, the anchor can interact with the viewers in a variety of ways.
The following examples are provided to illustrate the types of interactions that can be performed.
Fig. 6 is a flowchart of another video display method according to an embodiment of the present invention, and as shown in fig. 6, the video display method may include the following steps:
601. the method comprises the steps of obtaining a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video.
602. And displaying a first video in a first area of the live interface, and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
603. And in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, displaying a second video corresponding to each viewer in the first area.
Specifically, a plurality of sub-areas may be determined within the first area to display the first video and the second video corresponding to each of the at least one viewer selected by the anchor in a one-to-one correspondence within the plurality of sub-areas.
The implementation process of the scheme provided by the embodiment is exemplarily described with reference to fig. 7.
Assume that the display results of the first video and the plurality of second videos in step 602 are the live interface 403 illustrated in fig. 4. Assuming that the anchor selects viewer 1 and viewer 2 among the 7 viewers illustrated in the live interface 403, at this time, as shown in fig. 7, the second videos S1 and S2 corresponding to viewer 1 and viewer 2 will be moved from the second area a2 to be displayed within the first area a 1. Alternatively, three sub-areas illustrated in fig. 7 may be divided within the first area a1 for displaying the first and second videos S1 and S2, respectively.
In practical application, when the number of viewers in the anchor program is odd, the first region may be divided by N to obtain a plurality of sub-regions, and each sub-region is used for displaying one path of video. Where N-1 is the number of odd viewers selected in the main cast.
In fact, the positions and sizes of the plurality of sub-regions may be customized, and are not limited to the above examples.
In addition, in practical application, although the second video corresponding to each of the multiple viewers is displayed in the second area of the live interface, in order to ensure the listening effect of the viewers, the second video has a silent effect, i.e. only has a picture and no sound. When the anchor selects the at least one audience and moves the second video of the at least one audience to the first area for displaying, the voice call function corresponding to the at least one audience can be started. That is, before that, the voice call function (such as a microphone) of each viewer is turned off, and after a certain viewer is selected by the anchor, the voice call function of the selected viewer is turned on, so that the selected viewer can perform voice interaction with the anchor, and optionally, the content of the voice interaction can also be heard by other viewers.
Fig. 8 is a flowchart of another video display method according to an embodiment of the present invention, and as shown in fig. 8, the video display method may include the following steps:
801. the method comprises the steps of obtaining a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video.
802. And displaying the first video in a first area of a live interface, and displaying second videos corresponding to a plurality of audiences in a second area of the live interface.
803. And responding to a screen sharing operation triggered by the anchor, displaying a third video corresponding to the anchor in the first area, and moving the first video to a third area of the live interface for displaying, wherein the third video is obtained by shooting a screen of the terminal equipment of the anchor.
The implementation process of the scheme provided by the present embodiment is exemplarily described below with reference to fig. 9 and 10.
Alternatively, it is assumed that the display results of the first video and the plurality of second videos in step 802 are a live interface 901 illustrated in fig. 9. In the live interface 901, the first video of the anchor is displayed in the first area Q1, and the second video of the assumed 7 viewers in the foregoing embodiment is displayed in the second area Q2. When the anchor is based on actual needs and a screen sharing operation is triggered in the live interface 901, a third video including a screen of the terminal device of the anchor may be shot or acquired by other means, that is, the third video includes data content displayed on the screen of the terminal device. Compared with the first video, the first video is mainly obtained by shooting the main broadcast. The third video is transmitted to the server 2, and the server 2 may generate a new live interface 902 at this time, and in the live interface 902, the third video may be displayed in the first area Q1 originally used to display the first video, and the first video may be moved to another location (referred to as a third area) to be displayed. In fig. 9, the third region is assumed to be the second region Q2, but of course, the third region may be a region other than the second region Q2. In the second region Q2, in order to be distinguished from the second video of the viewer, alternatively, as illustrated in fig. 9, the screen size of the anchor first video may be larger than that of the second video.
Alternatively, it is assumed that the display result of the first video and the plurality of second videos in step 802 is the live interface 403 illustrated in fig. 10, and in this live interface 403, the second area a2 in which the second videos of the plurality of viewers are displayed surrounds the first area a1 in which the first video of the main broadcast is displayed. When the anchor triggers a screen sharing operation in the live interface 403, a third video including data content displayed on the screen of the terminal device of the anchor is transmitted to the server 2, and the server 2 may generate a new live interface 1001 at this time. In the live interface 1001, the display area of the third video at least overlaps the first area a1, i.e., the third video is displayed in the first area a1, and the original display and the first video in the first area a1 are shifted to the third area for display. Optionally, the third area may be located in the second area a2, or may be an area located elsewhere in the live interface, such as an area A3 located in the interactive message display area B.
In addition, in order to further enlarge the display area of the third video image, alternatively, the entire video image display area a may be used to display the third video image. To this end, the second video corresponding to each of the multiple viewers may be moved from the second area a2 to the fourth area of the live interface 1001 for display, so as to enlarge the display area of the third video. The fourth area may be, for example, an area a4 located within the interactive message display area B. Since the video display area a is formed of the first area a1 and the second area a2, the third video can be displayed in the video display area a through the above-described process. At this time, since the size of the live interface 1001 is limited, the above-described first video and second video are more important than the interactive message, and therefore, the interactive message display area B may be optionally hidden in the live interface 1001 at this time. So that the third area A3 and the fourth area a4 are generated at the position corresponding to the interactive message display area B. Of course, in practical applications, the interactive message display area B may be moved to another location area for displaying.
In addition, although the interactive message display area B is hidden, the interactive messages such as barrage that already exist therein may be configured to be displayed in a set form in the live interface, such as in a certain set manner within the video display area.
Besides the above interaction forms, in practical applications, the following interaction forms can be included: the anchor transmits a targeted alert voice or text message to a viewer when the viewer is found not to be watching the first video seriously based on the display of a second video of the viewer.
In conclusion, based on the fact that the video of the audience is displayed in the live interface, the anchor can interact with the audience in more forms, and the interaction forms are expanded.
The video display method provided by the embodiment of the invention can be applied to practical application scenes such as teacher online lectures and company online conferences.
In the application scene of teacher's network teaching, the teacher can give lessons through the live mode, if the teacher can't see student's state of listening to lessons, has not understood whether the student has carefully to listen to lessons, probably because some students' subjective nature is poor and lead to giving lessons the effect not good. Therefore, when the teacher gives lessons in the live broadcasting room, the video pictures of the teacher and all students are displayed in the live broadcasting interface at the same time, so that the teacher can clearly perceive the lesson listening state of the students, the students who do not listen to lessons seriously can be found in time and reminded, and the teaching interaction with the students can be realized. In this scenario, the first video in the foregoing embodiment may be an image of a teacher, and the third video may be a PPT courseware displayed on the computer terminal of the teacher.
In the application scene of the network conference of the company, the company supervisor can organize the conference in a live broadcast mode, namely the company supervisor starts the live broadcast, and company employees access to a live broadcast room to participate in the conference. In order to clearly see the status of each participant, based on the solution provided in this embodiment, the video pictures of each participant can also be displayed in the live interface. In addition, when a certain thing needs to be discussed with several participants, the video pictures of the several participants and the video pictures of the company supervisor can be displayed in the middle area of the live interface in a centralized manner, so that the interactive effect is enhanced.
Fig. 11 is a flowchart of another video display method according to an embodiment of the present invention, which can be executed by the server mentioned above. As shown in fig. 11, the video display method may include the steps of:
1101. the method comprises the steps of obtaining a first video corresponding to a main broadcast and second videos corresponding to a plurality of audiences, wherein the second videos are videos obtained by shooting the corresponding audiences during watching of the first video, and the second videos corresponding to the first video and the audiences are 2D videos.
1102. And generating a 3D live broadcast picture according to the first video and a second video corresponding to a plurality of audiences, wherein a first area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the second video corresponding to the audiences.
1103. And sending the 3D live broadcast picture to a plurality of 3D video watching devices corresponding to the audiences respectively.
In the foregoing other embodiments, the video is 2D video, that is, the live interface viewed by the viewer is a 2D picture. In this embodiment, in order to enable the audience to obtain an immersive visual experience, a 3D live view may be provided for the audience.
In this embodiment, the first video is obtained by shooting through a camera provided in a space where the main broadcast is located, and similarly, the second video corresponding to a certain audience is also obtained by shooting through a camera provided in a space where the certain audience is located. Both the first video and the second video may be 2D videos. The first video may include an ambient image around the anchor in addition to the image of the anchor, and the second video may also include the image of the anchor.
After the first video of the main broadcast and the second videos corresponding to the multiple audiences are obtained, a 3D live broadcast picture can be generated according to the first video and the second videos corresponding to the multiple audiences.
Optionally, the existing technology related to converting 2D video into 3D video may be adopted to convert the first video and each second video into corresponding 3D video pictures, and then all the obtained 3D video pictures are laid out according to a certain layout mode to obtain 3D live broadcast pictures.
From the perspective of the viewer, when the viewer views the 3D live broadcast image through the 3D video viewing device, the viewer can view the 3D video image corresponding to the main broadcast in the first region of the 3D live broadcast image, and view the 3D video images corresponding to the multiple viewers in the second region of the 3D live broadcast image. The first area may be a central area of the 3D live view, and the second area may be a peripheral area of the 3D live view.
The 3D video viewing device may be a virtual reality (Vi rtua l real i ty, VR for short) device, such as a VR headset, VR glasses. The 3D video viewing device may also be an Augmented Reality (AR) device, such as an AR helmet, AR glasses. Of course, the 3D video viewing device may also be other wearable or non-wearable devices that support 3D video viewing capabilities.
Optionally, the video display method may further include the following steps: and in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, moving the 3D video picture corresponding to the selected at least one viewer into the first area. That is, the viewer can view the 3D image of the anchor and the selected viewer in the first region.
In addition, as described above, when the at least one viewer is selected, the voice call function of the at least one viewer is turned on, and at this time, any viewer can not only view the main broadcast and the 3D video images of the respective viewers, but also listen to the main broadcast and the voice signal of the selected at least one viewer.
Alternatively, the voice signal of the anchor and the voice signal of the selected at least one viewer may have different sound source effects. For example, the anchor's voice signal may be set to have a sound effect transmitted to the viewer from directly in front of the viewer, while the other selected viewers ' voice signals have a sound effect transmitted to the viewer from the left or right side of the viewer, to enhance the user's immersive viewing experience.
The video display apparatus of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that these video display devices can each be constructed using commercially available hardware components configured through the steps taught by the present solution.
Fig. 12 is a schematic structural diagram of a video display apparatus according to an embodiment of the present invention, where the video display apparatus may be located in the server according to the foregoing embodiment. As shown in fig. 12, the apparatus includes: the device comprises an acquisition module 11 and a display module 12.
The acquisition module 11 is configured to acquire a first video corresponding to a main broadcast and a second video corresponding to each of a plurality of viewers, where the second video is a video obtained by shooting the corresponding viewer during watching the first video.
The display module 12 is configured to display the first video in a first area of a live interface; and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
Optionally, the obtaining module 11 may be specifically configured to: and responding to preset operation triggered by the anchor, and acquiring second videos corresponding to the multiple audiences.
Optionally, the obtaining module 11 may be specifically configured to: and if the number of the audiences reaches a set threshold value, acquiring a second video corresponding to each of the audiences.
Optionally, the apparatus further comprises: a determining module, configured to obtain configuration information of the anchor for the plurality of viewers; and determining the display position of the second video corresponding to each of the plurality of audiences in the second area according to the configuration information.
Optionally, the second video corresponding to each of the plurality of viewers is an encoded video. The display module 12 may be specifically configured to: distributing the encoded second video corresponding to each of the plurality of viewers to at least two devices, and decoding the respectively received second video by the at least two devices; and receiving the decoded second videos respectively sent by the at least two devices, and displaying the decoded second videos in the second area.
Optionally, the display module 12 may also be configured to: and in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, displaying a second video corresponding to each viewer in the first area.
Optionally, the display module 12 may be specifically configured to: determining a plurality of sub-regions within the first region; and displaying the first video and the second video corresponding to the at least one viewer in a one-to-one correspondence mode in the plurality of sub-areas.
Optionally, the apparatus further comprises: and the control module is used for starting the voice call function corresponding to the at least one audience.
Optionally, the live interface further includes: an interactive message display area. The display module 12 may also be used to: hiding the interactive message display area in response to a hiding operation triggered on the interactive message display area, and expanding a boundary of the second area to the interactive message display area.
Optionally, the display module 12 may also be configured to: responding to a screen sharing operation triggered by the anchor, displaying a third video corresponding to the anchor in the first area, and moving the first video to a third area of the live interface for displaying, wherein the third video is obtained by shooting a screen of terminal equipment of the anchor.
Optionally, the second region surrounds the first region. The display module 12 may also be used to: and moving the second video corresponding to each of the plurality of audiences to a fourth area of the live interface to be displayed so as to enlarge the display area of the third video.
Optionally, the display module 12 may also be configured to: hiding an interactive message display area in the live interface; and generating the third area and the fourth area at the position corresponding to the interactive message display area.
The apparatus shown in fig. 12 can execute the video display method provided in the embodiments shown in fig. 1 to fig. 10, and the detailed execution process and technical effect are described in the embodiments, which are not repeated herein.
In one possible design, the structure of the video display apparatus shown in fig. 12 may be implemented as an electronic device, which may be the server in the foregoing embodiment. As shown in fig. 13, the electronic device may include: a first processor 21, a first memory 22. Wherein the first memory 22 has stored thereon executable code which, when executed by the first processor 21, makes the first processor 21 at least to implement the video display method as provided in the embodiments of fig. 1 to 10 described above.
Optionally, the electronic device may further include a first communication interface 23 for communicating with other devices.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which, when executed by a processor of an electronic device, causes the processor to implement at least the video display method provided in the foregoing embodiments of fig. 1 to 10.
Fig. 14 is a schematic structural diagram of another video display apparatus according to an embodiment of the present invention, where the video display apparatus may be located in the server according to the foregoing embodiment. As shown in fig. 14, the apparatus includes: an acquisition module 31, a generation module 32, and a transmission module 33.
The acquiring module 31 is configured to acquire a first video corresponding to a main broadcast and a second video corresponding to a plurality of viewers, where the second video is a video obtained by shooting the corresponding viewers during watching the first video, and the second video corresponding to the first video and the plurality of viewers is a 2D video.
A generating module 32, configured to generate a 3D live broadcast picture according to the first video and the second video corresponding to each of the multiple viewers, where a first area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the second video corresponding to each of the multiple viewers.
A sending module 33, configured to send the 3D live broadcast picture to the respective 3D video viewing devices corresponding to the multiple viewers.
Optionally, the generating module 32 may be further configured to: and in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, moving the 3D video picture corresponding to each viewer into the first area.
The apparatus shown in fig. 14 may perform the video display method provided in the foregoing embodiment shown in fig. 11, and for detailed implementation processes and technical effects, reference is made to the description in the foregoing embodiment, and details are not repeated here.
In one possible design, the structure of the video display apparatus shown in fig. 14 may be implemented as an electronic device, which may be the server in the foregoing embodiment. As shown in fig. 15, the electronic device may include: a second processor 41, a second memory 42, a second communication interface 43. Wherein the second memory 42 has stored thereon executable code which, when executed by the second processor 41, causes the second processor 41 to at least implement the video display method as provided in the previously described embodiment of fig. 11.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium, on which executable code is stored, and when the executable code is executed by a processor of an electronic device, the processor is enabled to implement at least the video display method provided in the foregoing embodiment shown in fig. 11.
Fig. 16 is a flowchart of a video display method according to an embodiment of the present invention, and as shown in fig. 16, the video display method may include the following steps:
1601. responding to a watching request of a viewer to a first video corresponding to a main broadcast, and if the viewer has the permission to watch the first video, acquiring a second video corresponding to the viewer.
1602. And displaying a first direct-playing interface in the terminal equipment of the audience, wherein a first video is displayed in a first area of the first direct-playing interface, and a second video is displayed in a second area of the first direct-playing interface.
The video display method provided by the embodiment can be applied to the scenes of teacher online lecture and online meeting mentioned in the foregoing embodiments, and can also be applied to scenes such as on-line singers and concerts. Based on the video display method provided by the embodiment, the effect of opening the concert online can be close to the scene of the concert offline as much as possible, so that when the concert cannot be opened online for some reasons, the effect can be realized by opening the concert online. In the scene of a concert, the anchor mainly refers to a singer who starts the concert.
The same video display method as described in the other embodiments described above is: the first video of the anchor and the second video of the audience can be displayed on the same live interface, so that the anchor and the audience can see the video pictures of the other party.
Unlike the video display methods described in the other embodiments described above, the video display method provided in the present embodiment additionally emphasizes two points: first, the live video of the anchor is not necessarily viewable by all viewers, and therefore, when a viewer wants to view the live video of the anchor, i.e., the first video, the viewer needs to be authenticated for viewing permission; secondly, because the audience who watches the live video of the main broadcast may be many, for example, there may be thousands of people, if the videos of these thousands of people are all displayed on the same live interface, the live interface will display in a particularly messy manner, and the visual effect is very poor, so, the videos of many audiences can be born in a multi-screen manner, so-called multi-screen, can be understood as generating a plurality of live interfaces, and the core difference of different live interfaces lies in: videos of a plurality of audiences are displayed on different live broadcast interfaces in groups.
The following description will be made for each of the above two points.
In practical applications, when a certain viewer (hereinafter referred to as viewer X for convenience of description) wants to view a first video corresponding to a main broadcast, a corresponding viewing request is triggered by accessing a live interface of the main broadcast, at this time, the server may authenticate a viewing right of the viewer X to determine whether the viewer X has the viewing right to view the first video of the main broadcast, and if so, may obtain a second video of the viewer X, and send a first live interface including the second video and the first video of the main broadcast to a terminal device of the viewer X for display.
Alternatively, whether the viewer X has the right to view the first video may be determined according to the service type corresponding to the first video. In practical applications, live video can be divided into two service types, namely a free service type and a charged service type. The free service type is a type that can be viewed without paying a fee, and the charged service type is a type that can be viewed with paying a fee. For example, some public service concerts, performances, etc. are of the free service type, while some singers' personal concerts are often of the fee service type. Before the live broadcast, registration of live broadcast information may be performed in the server in advance, and the registration information may include the service type and other related information.
It can be understood that if a certain live video is of a fee-based service type, a corresponding notification message can be pushed to a large audience in advance, so that the large audience can complete payment processing in advance, and a payment record of the audience is stored in a server.
Based on this, when the viewer X triggers the viewing request for the first video of the anchor, if the service type corresponding to the first video is a free service type, it is directly determined that the viewer X has the right to view the first video, because the free service type means that all people can view the first video. If the service type corresponding to the first video is a charged service type, it is further determined whether the viewer X has the right to watch the first video in combination with the payment record of the viewer X. And if the payment record of the audience X for the first video is acquired, determining that the audience X has the permission to watch the first video.
In addition to the authentication of the viewing authority of the viewer based on the above service type, optionally, the server may receive and store in advance configuration information containing target group information having an authority to view the first video, so as to authenticate the viewer X who triggered the viewing request based on the configuration information. That is, if the viewer X matches the target demographic information, it is determined that the viewer X has the right to view the first video.
For understanding, for example, it is assumed that a company holds a performance event and invites a plurality of guests to perform the program, and at this time, the anchor is each guest of the performance program. The show event is charged, however, the company provides benefits to employees who may view the program for free. The manager of the company may configure the employee information of the company to the server so that it is directly determined that the employee of the company has the viewing right when it triggers the viewing request.
In case of such a scenario, the server in the foregoing runs some instant messaging application, and the above live broadcast function is implemented by the instant messaging application, and the viewer needs to use the instant messaging application to watch the live video. In addition, it is assumed that the company uses the instant messaging application as a communication tool of the company, the instant messaging application includes an address book of the company, and the address book includes employee information, so that a manager of the company can configure employees in the address book to view the first video. Based on this, when a certain employee in the company triggers a viewing request for the first video through the instant messaging application program, the viewing request may carry related information of the employee, and the server may determine that the employee has the authority to view the first video according to the configuration result of the address book.
To summarize the authentication method illustrated by the above example is: the aforementioned target crowd information may include: the method comprises the steps that contact information in an instant messaging application program is obtained, a watching request triggered by a viewer X is sent by the viewer X through the instant messaging application program, and the watching request comprises user information registered by the viewer X in the instant messaging application program. Thus, if the user information of viewer X matches the configured contact information (e.g., viewer X is one of the configured contacts), then viewer X is determined to have permission to view the first video.
Of course, in practical applications, there may be a case where: the company only configures employees in a certain department to have the right to view the first video, and in this case, the target crowd information may include: and the communication group corresponding to the department in the instant communication application program. Based on this, if the viewer X is a member within the communication group, it is determined that the viewer X has the right to view the first video.
The authentication process is introduced above, and the generation process of different live broadcast interfaces is described below.
To facilitate understanding of the similarities and differences between the different live interfaces, the following is illustrated in conjunction with fig. 17.
Two live interfaces, live interface 1701 and live interface 1702, are illustrated in FIG. 17. Two areas are defined in this live interface: a first region a1 and a second region a 2. The first video of the anchor is displayed in the first area a 1. Assume that the second area a2 of each live interface is preset to accommodate N viewers' second videos, N > 1. Taking N as an example of 7, assuming that 13 people are currently watching the first video, since each live interface can accommodate videos of 7 viewers, two live interfaces, such as those illustrated in fig. 17, need to be generated. Within second region a2 of live interface 1701, second videos are displayed for 7 viewers, viewer 1, viewer 2, viewer 3, viewer 4, viewer 5, viewer 6, and viewer 7, respectively represented as: s1, S2, S3, S4, S5, S6, S7. Within second region a2 of live interface 1702 are displayed second videos of 6 viewers, viewer 8, viewer 9, viewer 10, viewer 11, viewer 12, and viewer 13, respectively represented as: s8, S9, S10, S11, S12 and S13.
For each of the 13 viewers, each viewer can actually see the two live interfaces, only when a viewer initially triggers a viewing request, the server can set that live interface containing the second video of the viewer to be preferentially presented on the screen of the terminal device of the viewer, and the other live interfaces can be switched and displayed based on the live interface switching operation triggered by the user.
As illustrated in fig. 17, taking viewer 9 as an example, although the server transmits both live interface 1701 and live interface 1702 to the terminal device of viewer 9 for display, the server may mark live interface 1702 containing second video S9 of viewer 9, so that the terminal device first displays live interface 1702 based on the mark, and then viewer 9 triggers a live interface switching operation to switch from live interface 1702 to live interface 1701 on the screen of the terminal device. The live interface switching operation may be implemented as an operation of sliding the screen left and right, or the like.
Based on the introduction of the similarities and differences of the different live broadcast interfaces, in practical applications, taking the audience X as an example, when the audience X triggers a viewing request for the first video and determines that the audience X has a viewing right, a second video corresponding to the audience X is obtained, and then it is required to determine in which live broadcast interface the second video of the audience X needs to be displayed. Specifically, assuming that the first direct-playing interface is a first direct-playing interface generated by the server, if it is determined that the number of the videos existing in the second area of the first direct-playing interface does not reach the set threshold, displaying a second video of the viewer X in the second area of the first direct-playing interface, where the videos correspond to different viewers. And if the number of the plurality of videos existing in the second area of the first live broadcast interface reaches the set threshold value, displaying the first video in the first area of the second live broadcast interface, and displaying the second video of the audience X in the second area of the second live broadcast interface, wherein the second live broadcast interface is preferentially displayed in the terminal equipment of the audience X. That is to say, the maximum number N of viewers that can be accommodated in each live interface is preset, and if the first generated live interface already contains the second videos of the N viewers, the second video of the viewer X cannot be displayed in the first live interface any more, and it is necessary to generate the second live interface and display the second video of the viewer X in the second area of the second live interface.
It should be noted that in practical applications, a large number of viewers will typically trigger a viewing request for the first video in a short time, for example, within a few minutes before the anchor starts to live. In order to improve the generation efficiency and complexity of the live interface, the server may merge the N second videos and the first video of the anchor into one video stream after obtaining the N second videos of the viewers, and display the one video stream in one live interface.
The presentation of the live interface to the viewer is described above. In fact, in order to enhance interactivity, the anchor and the viewer may also trigger a variety of interactive behaviors on the live interface, such as some interactive behaviors that can be triggered and the execution process of the interactive behaviors.
Optionally, the interaction process may include: and in response to the selection operation of the main broadcast on the audiences, moving the second video corresponding to the selected audiences to the first area for displaying. Similar to the description of the other embodiments above, the anchor may trigger an interaction with one or more viewers, which is mainly embodied as: the anchor pulls one audience to the center of the stage-the first area corresponding to the live interface, so that other audiences can view the interaction of the anchor and the selected audience through the first area. For example, if the anchor invites a viewer to chorus a song with the anchor, other viewers will see a chorus video of the anchor and the selected viewer through the first area of the live interface.
In addition to the above-described interactive behavior initiated by the anchor, the viewer may also initiate a plurality of interactive behaviors, and the following description will take viewer X as an example, where viewer X is any viewer who watches the first video of the anchor.
Optionally, the interaction process may further include: responding to preset operation triggered by a viewer X aiming at the anchor, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects; and responding to the selection operation of the viewer X on the target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
The viewer X may trigger the preset operation in the first area to display the interactive interface, for example, trigger a click operation in a touch screen manner or with a mouse in the first area, and the like. In addition, a certain button can be displayed in the live broadcast interface, and the viewer X clicks the button to display the interactive interface.
The virtual objects included in the interactive interface respectively represent various interactive behaviors that the audience can interact with the anchor, such as applause, love, praise, present delivery, a glow stick, and the like.
When the viewer X selects a virtual object from the live broadcast interface, the dynamic effect corresponding to the selected target virtual object is displayed. It will be appreciated that the display of the animation is synchronized to the terminal devices of all viewers, i.e. all viewers can see the interactive effects. The dynamic effect corresponding to each virtual object can be preset, and when the viewer X selects a target virtual object, the dynamic effect of the target virtual object is rendered.
The corresponding dynamic effects of two different virtual objects are illustrated below in connection with fig. 18 and 19.
The dynamic effects of the target virtual object illustrated in fig. 18 are: and moving the target virtual object to the first area of the anchor according to the set moving track from the display position of the second video of the audience X.
In fig. 18, it is assumed that the display position of the second video Sx corresponding to the viewer X in the live interface is as shown in fig. 18, and the first video of the anchor is displayed in the first area of the live interface. Assuming that the target virtual object selected by the viewer X is "barycenter", at this time, as shown in fig. 18, a moving effect that the heart-shaped pattern is moved from a position corresponding to the viewer X (i.e., a display position of the second video Sx thereof) to a position corresponding to the anchor (i.e., a display position of the first video thereof) according to a certain movement trajectory may be rendered in the live interface to represent that the viewer X is barycenter toward the anchor. Target virtual objects such as praise, applause, present, etc. may have similar animation.
The dynamic effects of the target virtual object illustrated in fig. 19 are: and displaying the dynamic effect corresponding to the target virtual object at the display position of the second video of the audience X, and controlling the dynamic effect of the target virtual object existing in the same live broadcast interface to be synchronously displayed.
In fig. 19, it is assumed that the display position of the second video Sx corresponding to the viewer X in the live interface is as shown in fig. 19, and the first video of the anchor is displayed in the first area of the live interface. Assuming that the target virtual object selected by the viewer X is a "glow stick," the animation of waving the glow stick may be displayed. As shown in fig. 19, the position corresponding to the viewer X (i.e., the display position of the second video Sx thereof) may display the animation of the right-left waving of the glow stick. As shown in fig. 19, the second video of another viewer is also included in the live view interface, and only the second video Sy of the viewer Y is taken as an example, and it is assumed that the viewer Y has also selected the "glow stick" so far, and the effect of waving the glow stick is also displayed in the second video Sy of the viewer Y. In order to obtain better visual experience, the movement effect of waving the glow stick triggered by different audiences on the same live broadcast interface can be controlled to keep synchronous: at the same time, the corresponding glow stick of each viewer maintains the same posture.
Optionally, the interaction process may further include: responding to the selection operation triggered by the audience X to another audience Y, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects; and responding to the selection operation of the viewer X on the target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
Similar to the viewer-anchor interaction process exemplified above, a viewer may also interact with another viewer. A viewer X may select another viewer Y by clicking on the second video of that viewer Y. The interactive interface corresponding to the interaction between the audiences can be the same as or different from the interactive interface displayed when the audiences interact with the anchor. In the interaction situation between the viewers, reference may be made to the examples in fig. 18 and fig. 19 for the dynamic effect corresponding to the target virtual object, which is similar to the examples and will not be described again.
In addition, under the condition that the audience X interacts with the audience Y, the interactive interface may further include an option for viewing the user information of the audience Y, so that the audience X can view the user information of the audience Y. Similarly, the viewer may view the user information of the anchor, as well as the situation where the viewer interacts with the anchor.
Optionally, the interaction process may include: responding to the bullet screen sending operation triggered by the audience X, and displaying a bullet screen control at the display position of the second video corresponding to the audience X, wherein bullet screen information is displayed in the bullet screen control.
The bullet screen control is a control for bearing bullet screen information, and can be a text box with a preset shape and size.
A live interface may include a plurality of second videos of viewers, for example, as shown in fig. 20, a viewer X and a viewer Y are taken as examples, assuming that the second video of the viewer X is adjacent to the display position of the second video of the viewer Y, the viewer X and the viewer Y both send out a barrage, assuming that the barrage control corresponding to the viewer X is Dx and the barrage control corresponding to the viewer Y is Dy, because the size of the live interface is limited, the display positions of the second videos of the viewer X and the viewer Y are adjacent to each other, and therefore, as shown in fig. 20, the barrage control Dx may be displayed overlapping with the barrage control Dy.
In addition to the various forms of interaction illustrated above, a wide variety of other forms of interaction may be extended. In addition, in order to enable the audience to obtain the experience of targeted image quality and sound effect according to the self requirement, options of the image quality and the sound effect can be set in the live broadcast interface, so that the audience can select the required image quality and sound effect according to the requirement.
Fig. 21 is a flowchart of a video display method according to an embodiment of the present invention, and as shown in fig. 21, the video display method may include the following steps:
2101. in response to a viewer's viewing request for a first video corresponding to a main broadcast, it is determined that the viewer has permission to view the first video.
2102. And according to the user characteristics corresponding to the audience, if the audience is determined to have the display permission for displaying the second video corresponding to the audience, acquiring the second video corresponding to the audience.
2103. And displaying a first direct-playing interface in the terminal equipment of the audience, wherein a first video is displayed in a first area of the first direct-playing interface, and a second video is displayed in a second area of the first direct-playing interface according to the display permission.
The assumed situation in this embodiment is: viewers with the authority to view the first video of the anchor may not all have the authority to display their corresponding second video on the live interface. In particular, it is necessary to determine whether the viewer has the display right to present his second video on the live interface, and what the display right is specifically, according to the user characteristics of the viewer.
In practical applications, the display authority can be measured by a display position and/or a display duration, wherein the display position may include two position attributes: one is in which live interface is displayed in the case where there are a plurality of live interfaces as described above, and the other is in a display position within the second area of the live interface.
Based on this, it is assumed that the viewer in the above step is a viewer X, and in this embodiment, it is assumed that the second video of the viewer X needs to be displayed in the first direct playing interface. Where viewer X is any viewer that has the right to view the first video and has the right to display its corresponding second video.
In practical applications, as mentioned above, the first live interface may be determined according to the number of already included viewers, that is, assuming that the first live interface is a first generated live interface including the first video, and the number of already included viewers on the first live interface does not reach the set number, it is determined that the second video of the viewer X should be displayed in the first live interface.
And the display position and the display time length of the second video of the audience X in the second area in the first direct playing interface are determined according to the user characteristics of the audience X.
Optionally, the user characteristics include at least one of: identity type, geographic area, gender, payment amount. In fact, the user characteristics are not limited to the examples herein.
For identity types, the identity types can be divided into: advertisement/content providers and general viewers. In practice, one or more display locations corresponding to the advertisement/content provider may be defined in the second area, with the remaining area being available to the general audience. Note that the display position described in the present embodiment should be understood as having an attribute of a position range. Based on this, viewers of different identity types may have display areas of different sizes, such as one advertisement provider occupying a display area of a size larger than the size of a display area occupied by an average viewer.
It is worth noting that in this context, a viewer may be understood as any user that may be displayed on a live interface in addition to the anchor.
For ease of understanding, this is exemplified in connection with fig. 22. In fig. 22, it is assumed that there are two viewers: an advertising provider G1 and a general viewer G2. In addition, it is assumed that the second video corresponding to the advertisement provider G1 is denoted as F1, and the second video corresponding to the general viewer G2 is denoted as F2. In practical applications, the second video F1 may be an advertisement video produced by an advertisement provider G1, and the second video F2 may be a video obtained by a general viewer G2 shooting a video of the viewer. It may be preset that the second video corresponding to the advertisement provider occupies a more important location area in the second area, which is mainly embodied as a location area that is more eye-catching, i.e. a location area that is more focused by the viewer. As shown in fig. 22, the second video F1 of the advertisement provider G1 is displayed in a location area L1, the second video F2 of the general viewer G2 is displayed in a location area L2, the size of the location area L1 is larger than that of the location area L2, and the location area L1 is located in an area closer to the visual focus.
The above illustrates a case where the display position of the second video in the second area can be determined according to the identity types of different viewers, and actually, the display duration of the second video in the second area can also be determined according to the identity types of different viewers. Specifically, optionally, the correspondence between different identity types and different display durations may be preset, for example, the second video F2 of the advertisement provider G1 may be displayed for 40 minutes, and the second video F1 of the general viewer G2 may be displayed for 5 minutes. The setting of the display time period may be set based on the time period of the entire live broadcast.
In practical applications, the second video F2 may support user interaction operations, for example, after a certain viewer sees the second video F2, a click operation is triggered in the display area L1 of the second video F2, and at this time, a corresponding interaction interface, such as a commodity details and payment interface, may pop up.
When the display right of the viewer is determined based on the geographic area corresponding to the viewer, for example, the display position of the second video of the viewer in the second area may be determined according to the geographic area corresponding to the viewer. Wherein the geographic region may be a city to which the viewer belongs. For example, assuming a singer is conducting a concert in a certain region W, the second video from viewers in region W may be displayed closer to the first region, while the second video from viewers in other regions may be displayed further from the first region.
When the display right of the viewer is determined based on the gender of the viewer, the display position of the second video of the viewer in the second region may be determined, for example, according to the gender of the viewer. For example, as shown in fig. 23, a first area displaying a first video of a main broadcast is located at the center of a live interface, and a second area is provided around the first area. The second region may be divided into two left and right sub-regions: a left region L and a right region R. The left region L may be set to display the second video of the female viewer and the right region R may be set to display the second video of the male viewer. Of course, in practice, the second area is not limited to be divided into two left and right sub-areas, but may also be divided into two upper and lower sub-areas, or other division manners may be adopted, so that the purpose of displaying the second video of audiences of different genders in different position areas can be achieved.
When the display right of the viewer is determined based on the payment amount of the viewer, for example, the display duration and the display position of the second video of the viewer in the second area may be determined according to the payment amount of the viewer. Such as: the second area can be divided into sub-areas, and the payment amount ranges corresponding to the sub-areas are different, so that the sub-area in which the second video of the audience can be displayed is determined according to the actual payment amount of the audience. For another example: different payment amount ranges may correspond to different display durations, and the display duration of the viewer's second video may be determined based on the actual payment amount of the viewer.
By way of example in conjunction with fig. 24, the viewer may be prompted for a correspondence between different display durations, different display locations, and different payment amounts so that the viewer may pay for the display right to purchase his second video. Assume that the second video S1 of the viewer 1 can be displayed at the position L1 within the second area for a period of 1 minute, determined based on the payment amount M1 of the viewer 1. Assume that the second video S1 of the viewer 2 can be displayed at the position L2 within the second area for a display time of 10 minutes, determined based on the payment amount M2 of the viewer 2. Wherein M2> M1, position L2 is closer to the first region than position L1. After the second video S1 of viewer 1 has been displayed for 1 minute, it may be determined that the second video S3 of viewer 3, which is displayed for 1 minute, is to be displayed next at the position L1 according to the payment amount of other viewers.
The display authority (such as the display position and the display duration) of the second video in the second area of the live interface can be determined according to the user characteristics of the audience. Optionally, if the user characteristics of a certain viewer meet the set conditions, the second video of the viewer can be displayed in the first area of the live interface.
In practical application, the server can screen audiences with user characteristics meeting set conditions from the majority of audiences at set time, display the second video of the audiences in the first area, and enable other audiences to see the second video of the audiences through the first area.
For example, the viewers who satisfy the setting condition may be: and the audience meeting the requirements of setting the geographic area, the payment amount and the identity type. When the number of audiences meeting the set condition is larger, audiences not exceeding the set number can be further selected based on a certain screening mechanism, and the second video of the finally screened audiences is displayed in the first area.
Fig. 25 is a schematic structural diagram of a video display apparatus according to an embodiment of the present invention, where the video display apparatus may be located in the server according to the foregoing embodiment. As shown in fig. 25, the apparatus includes: an acquisition module 51 and a display module 52.
The obtaining module 51 is configured to, in response to a viewing request of a viewer for a first video corresponding to a main broadcast, obtain a second video corresponding to the viewer if the viewer has an authority to view the first video.
A display module 52, configured to display a first direct-view interface in the terminal device of the viewer, where the first video is displayed in a first area of the first direct-view interface, and the second video is displayed in a second area of the first direct-view interface.
Optionally, the display module 52 may be specifically configured to: if the number of the videos existing in the second area of the first direct-playing interface is determined not to reach a set threshold value, displaying the second video in the second area of the first direct-playing interface, wherein the videos correspond to different audiences.
Optionally, the display module 52 may be further configured to: and if the number of the videos existing in the second area of the first live broadcast interface reaches a set threshold value, displaying a second live broadcast interface in the terminal equipment of the audience, wherein the first video is displayed in the first area of the second live broadcast interface, and the second video is displayed in the second area of the second live broadcast interface.
Optionally, the display module 52 may be further configured to: responding to the live interface switching operation triggered by the audience, and switching to display the first live interface from the second live interface in the terminal equipment of the audience according to the live interface switching operation.
Optionally, the apparatus may further include: and the authentication module is used for determining whether the audience has the authority of watching the first video according to the service type corresponding to the first video.
Optionally, the authentication module may be specifically configured to: and if the service type corresponding to the first video is a free service type, determining that the audience has the permission to watch the first video.
Optionally, the authentication module may be specifically configured to: and if the service type corresponding to the first video is a charging service type and the payment record of the viewer for the first video is acquired, determining that the viewer has the permission to watch the first video.
Optionally, the authentication module may be further configured to: receiving configuration information, wherein the configuration information comprises target crowd information with the permission of watching the first video; and if the audience is matched with the target crowd information, determining that the audience has the permission to watch the first video.
Optionally, the target population information includes: contact information contained in the instant messaging application program; the viewing request is sent by the viewer through the instant messaging application program, and the viewing request comprises user information registered in the instant messaging application program by the viewer. Based on this, the authentication module may specifically be configured to: and if the user information is matched with the contact person information, determining that the audience has the permission to watch the first video.
Optionally, the display module 52 may be further configured to: and moving a second video corresponding to the audience to the first area for displaying in response to the selection operation of the anchor on the audience.
Optionally, the display module 52 may be further configured to: responding to preset operation triggered by the audience aiming at the anchor, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects; and responding to the selection operation of the audience on a target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
Optionally, the display module 52 may be specifically configured to: and moving the target virtual object to the first area from the display position of the second video according to a set movement track.
Optionally, the display module 52 may be specifically configured to: and displaying the dynamic effect corresponding to the target virtual object at the display position of the second video, and controlling the dynamic effect of the target virtual object existing in the first live interface to be synchronously displayed.
Additionally, optionally, the display module 52 may be further configured to: responding to a selection operation triggered by the audience to another audience, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects; and responding to the selection operation of the audience on a target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
Optionally, the display module 52 may be further configured to: responding to the bullet screen sending operation triggered by the audience, and displaying a bullet screen control at the display position of the second video, wherein bullet screen information is displayed in the bullet screen control.
The apparatus shown in fig. 25 can execute the video display method provided in the foregoing embodiments shown in fig. 16 to fig. 24, and for detailed execution processes and technical effects, reference is made to the description in the foregoing embodiments, which is not repeated herein.
In one possible design, the structure of the video display apparatus shown in fig. 25 may be implemented as an electronic device, which may be the server in the foregoing embodiment. As shown in fig. 26, the electronic device may include: a third processor 61, a third memory 62, and a third communication interface 63. Wherein the third memory 62 has stored thereon executable code which, when executed by the third processor 61, makes the third processor 61 at least implement the video display method as provided in the embodiments illustrated in the foregoing fig. 16 to 24.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which, when executed by a processor of an electronic device, causes the processor to implement at least the video display method provided in the foregoing embodiments shown in fig. 16 to 24.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described aspects and portions of the present technology which contribute substantially or in part to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including without limitation disk storage, CD-ROM, optical storage, and the like.
The video display method provided by the embodiment of the present invention may be executed by a certain program/software, the program/software may be provided by a network side, the electronic device mentioned in the foregoing embodiment may download the program/software into a local nonvolatile storage medium, and when it needs to execute the video display method, the program/software is read into a memory by a CPU, and then the CPU executes the program/software to implement the video display method provided in the foregoing embodiment, and the execution process may refer to the schematic diagrams in fig. 1 to 11.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (42)

1. A video display method, comprising:
the method comprises the steps of obtaining a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, wherein the second video is a video obtained by shooting the corresponding audiences during watching the first video;
displaying the first video in a first area of a live interface;
and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
2. The method of claim 1, wherein obtaining a second video corresponding to each of the plurality of viewers comprises:
and responding to preset operation triggered by the anchor, and acquiring second videos corresponding to the multiple audiences.
3. The method of claim 1, wherein obtaining a second video corresponding to each of the plurality of viewers comprises:
and if the number of the audiences reaches a set threshold value, acquiring a second video corresponding to each of the audiences.
4. The method of claim 1, further comprising:
acquiring configuration information of the anchor on the plurality of audiences;
and determining the display position of the second video corresponding to each of the plurality of audiences in the second area according to the configuration information.
5. The method of claim 1, wherein the second video corresponding to each of the plurality of viewers is an encoded video;
the displaying, in a second area of the live interface, a second video corresponding to each of the plurality of viewers includes:
distributing the encoded second video corresponding to each of the plurality of viewers to at least two devices, and decoding the respectively received second video by the at least two devices;
and receiving the decoded second videos respectively sent by the at least two devices, and displaying the decoded second videos in the second area.
6. The method according to any one of claims 1 to 5, further comprising:
and in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, displaying a second video corresponding to each viewer in the first area.
7. The method of claim 6, wherein displaying the second video corresponding to each of the at least one viewer in the first region comprises:
determining a plurality of sub-regions within the first region;
and displaying the first video and the second video corresponding to the at least one viewer in a one-to-one correspondence mode in the plurality of sub-areas.
8. The method of claim 6, further comprising:
and starting a voice call function corresponding to the at least one audience.
9. The method of claim 1, wherein the live interface further comprises: an interactive message display area;
the method further comprises the following steps:
hiding the interactive message display area in response to a hiding operation triggered on the interactive message display area, and expanding a boundary of the second area to the interactive message display area.
10. The method of claim 1, further comprising:
responding to a screen sharing operation triggered by the anchor, displaying a third video corresponding to the anchor in the first area, and moving the first video to a third area of the live interface for displaying, wherein the third video is obtained by shooting a screen of terminal equipment of the anchor.
11. The method of claim 10, wherein the second region surrounds the first region;
the method further comprises the following steps:
and moving the second video corresponding to each of the plurality of audiences to a fourth area of the live interface to be displayed so as to enlarge the display area of the third video.
12. The method of claim 11, further comprising:
hiding an interactive message display area in the live interface;
and generating the third area and the fourth area at the position corresponding to the interactive message display area.
13. A video display apparatus, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences respectively, and the second video is a video obtained by shooting the corresponding audiences during watching the first video;
the display module is used for displaying the first video in a first area of a live broadcast interface; and displaying a second video corresponding to each of the plurality of audiences in a second area of the live interface.
14. An electronic device, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the video display method of any one of claims 1 to 12.
15. A non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a processor of an electronic device, causes the processor to perform the video display method of any of claims 1-12.
16. A video display method, comprising:
acquiring a first video corresponding to a main broadcast and second videos corresponding to a plurality of audiences respectively, wherein the second videos are videos obtained by shooting corresponding audiences during watching the first video, and the first videos and the second videos corresponding to the audiences respectively are 2D videos;
generating a 3D live broadcast picture according to the first video and a second video corresponding to the plurality of audiences, wherein a first area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used for displaying the 3D video picture corresponding to the second video corresponding to the plurality of audiences;
and sending the 3D live broadcast picture to the 3D video watching equipment corresponding to the plurality of audiences.
17. The method of claim 16, further comprising:
and in response to the selection operation of the anchor on at least one viewer in the plurality of viewers, moving the 3D video picture corresponding to each viewer into the first area.
18. A video display apparatus, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first video corresponding to a main broadcast and a second video corresponding to a plurality of audiences, the second video is obtained by shooting the corresponding audiences during watching the first video, and the first video and the second video corresponding to the audiences are 2D videos;
a generating module, configured to generate a 3D live broadcast picture according to the first video and a second video corresponding to each of the multiple viewers, where a first area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the first video, and a second area of the 3D live broadcast picture is used to display a 3D video picture corresponding to the second video corresponding to each of the multiple viewers;
and the sending module is used for sending the 3D live broadcast picture to the 3D video watching equipment corresponding to the plurality of audiences.
19. An electronic device, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the video display method of claim 16 or 17.
20. A non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a processor of an electronic device, causes the processor to perform the video display method of claim 16 or 17.
21. A video display method, comprising:
responding to a watching request of a viewer for a first video corresponding to a main broadcast, and if the viewer has the permission of watching the first video, acquiring a second video corresponding to the viewer;
displaying a first direct-playing interface in the terminal equipment of the audience, wherein the first video is displayed in a first area of the first direct-playing interface, and the second video is displayed in a second area of the first direct-playing interface.
22. The method of claim 21, wherein displaying the second video in the second area of the first direct play interface comprises:
if the number of the videos existing in the second area of the first direct-playing interface is determined not to reach a set threshold value, displaying the second video in the second area of the first direct-playing interface, wherein the videos correspond to different audiences.
23. The method of claim 22, further comprising:
and if the number of the videos existing in the second area of the first live broadcast interface reaches a set threshold value, displaying a second live broadcast interface in the terminal equipment of the audience, wherein the first video is displayed in the first area of the second live broadcast interface, and the second video is displayed in the second area of the second live broadcast interface.
24. The method of claim 23, further comprising:
responding to the live interface switching operation triggered by the audience, and switching to display the first live interface from the second live interface in the terminal equipment of the audience according to the live interface switching operation.
25. The method of claim 21, further comprising:
and determining whether the audience has the permission to watch the first video according to the service type corresponding to the first video.
26. The method of claim 25, wherein said determining whether the viewer has permission to view the first video according to the service type corresponding to the first video comprises:
and if the service type corresponding to the first video is a free service type, determining that the audience has the permission to watch the first video.
27. The method of claim 25, wherein said determining whether the viewer has permission to view the first video according to the service type corresponding to the first video comprises:
and if the service type corresponding to the first video is a charging service type and the payment record of the viewer for the first video is acquired, determining that the viewer has the permission to watch the first video.
28. The method of claim 21, further comprising:
receiving configuration information, wherein the configuration information comprises target crowd information with the permission of watching the first video;
and if the audience is matched with the target crowd information, determining that the audience has the permission to watch the first video.
29. The method of claim 28, wherein the target demographic information comprises: contact information contained in the instant messaging application program;
the viewing request is sent by the audience through the instant messaging application program, and the viewing request comprises user information registered by the audience in the instant messaging application program;
if the audience is matched with the target crowd information, determining that the audience has the right to watch the first video, including:
and if the user information is matched with the contact person information, determining that the audience has the permission to watch the first video.
30. The method of claim 21, wherein obtaining the second video corresponding to the viewer comprises:
according to the user characteristics corresponding to the audience, if the audience is determined to have the display permission for displaying the second video, acquiring the second video;
the displaying the second video in the second area of the first live interface comprises:
and displaying the second video in the second area according to the display permission.
31. The method of claim 30, wherein the displaying the rights comprises: display position and/or display duration;
the displaying the second video in the second area according to the display permission comprises:
and displaying the second video in the second area according to the display position and/or the display duration.
32. The method of claim 30, wherein the user characteristics comprise at least one of:
identity type, geographic area, gender, payment amount.
33. The method of claim 30, further comprising:
and if the user characteristics corresponding to the audience accord with set conditions, displaying the second video in the first area.
34. The method of claim 21, further comprising:
and moving a second video corresponding to the audience to the first area for displaying in response to the selection operation of the anchor on the audience.
35. The method of claim 21, further comprising:
responding to preset operation triggered by the audience aiming at the anchor, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects;
and responding to the selection operation of the audience on a target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
36. The method of claim 35, wherein the displaying the corresponding dynamic effect of the target virtual object comprises:
and moving the target virtual object to the first area from the display position of the second video according to a set movement track.
37. The method of claim 35, wherein the displaying the corresponding dynamic effect of the target virtual object comprises:
and displaying the dynamic effect corresponding to the target virtual object at the display position of the second video, and controlling the dynamic effect of the target virtual object existing in the first live interface to be synchronously displayed.
38. The method of claim 21, further comprising:
responding to a selection operation triggered by the audience to another audience, and displaying an interactive interface, wherein the interactive interface comprises a plurality of virtual objects;
and responding to the selection operation of the audience on a target virtual object in the plurality of virtual objects, and displaying the dynamic effect corresponding to the target virtual object.
39. The method of claim 21, further comprising:
responding to the bullet screen sending operation triggered by the audience, and displaying a bullet screen control at the display position of the second video, wherein bullet screen information is displayed in the bullet screen control.
40. A video display apparatus, comprising:
the acquisition module is used for responding to a watching request of a viewer for a first video corresponding to a main broadcast, and acquiring a second video corresponding to the viewer if the viewer has the permission to watch the first video;
and the display module is used for displaying a first direct-playing interface in the terminal equipment of the audience, wherein the first video is displayed in a first area of the first direct-playing interface, and the second video is displayed in a second area of the first direct-playing interface.
41. An electronic device, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the video display method of any of claims 21 to 39.
42. A non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a processor of an electronic device, causes the processor to perform the video display method of any of claims 21 to 39.
CN202010413380.7A 2020-04-10 2020-05-15 Video display method, device, equipment and storage medium Active CN113518232B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010280799X 2020-04-10
CN202010280799 2020-04-10

Publications (2)

Publication Number Publication Date
CN113518232A true CN113518232A (en) 2021-10-19
CN113518232B CN113518232B (en) 2024-03-01

Family

ID=78022968

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010413380.7A Active CN113518232B (en) 2020-04-10 2020-05-15 Video display method, device, equipment and storage medium

Country Status (2)

Country Link
CN (1) CN113518232B (en)
WO (1) WO2021204139A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598906A (en) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN115334331A (en) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 Communication method, equipment and storage medium for teaching live broadcast
CN115933921A (en) * 2022-11-29 2023-04-07 北京字跳网络技术有限公司 Media content display method and device, electronic equipment and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114173068A (en) * 2021-10-29 2022-03-11 北京中联合超高清协同技术中心有限公司 System for audience and rebroadcasting site remote interaction
CN115412739A (en) * 2022-08-15 2022-11-29 北京达佳互联信息技术有限公司 Live broadcast room interaction method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN102572370A (en) * 2011-01-04 2012-07-11 华为终端有限公司 Video conference control method and conference terminal
CN103763113A (en) * 2013-12-31 2014-04-30 广州华多网络科技有限公司 Live network broadcast method and device and server
CN106803966A (en) * 2016-12-31 2017-06-06 北京星辰美豆文化传播有限公司 A kind of many people's live network broadcast methods, device and its electronic equipment
CN110087021A (en) * 2019-05-13 2019-08-02 湖北潘多拉网络科技有限公司 Online Video method, apparatus and video terminal
CN110570698A (en) * 2019-08-21 2019-12-13 北京大米科技有限公司 Online teaching control method and device, storage medium and terminal

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640191A (en) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 A kind of method and apparatus of even wheat live streaming
CN107591049A (en) * 2017-10-26 2018-01-16 华蓥市双河第三小学 The teaching method given lessons using video
CN110568984A (en) * 2019-08-22 2019-12-13 北京大米科技有限公司 Online teaching method and device, storage medium and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040226047A1 (en) * 2003-05-05 2004-11-11 Jyh-Bor Lin Live broadcasting method and its system for SNG webcasting studio
CN102572370A (en) * 2011-01-04 2012-07-11 华为终端有限公司 Video conference control method and conference terminal
CN103763113A (en) * 2013-12-31 2014-04-30 广州华多网络科技有限公司 Live network broadcast method and device and server
CN106803966A (en) * 2016-12-31 2017-06-06 北京星辰美豆文化传播有限公司 A kind of many people's live network broadcast methods, device and its electronic equipment
CN110087021A (en) * 2019-05-13 2019-08-02 湖北潘多拉网络科技有限公司 Online Video method, apparatus and video terminal
CN110570698A (en) * 2019-08-21 2019-12-13 北京大米科技有限公司 Online teaching control method and device, storage medium and terminal

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598906A (en) * 2022-02-23 2022-06-07 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN114598906B (en) * 2022-02-23 2023-08-22 北京碧云数创科技有限公司 Teaching live broadcast method, medium and computer equipment
CN115334331A (en) * 2022-08-23 2022-11-11 苏州青颖飞帆软件科技有限公司 Communication method, equipment and storage medium for teaching live broadcast
CN115334331B (en) * 2022-08-23 2023-09-22 苏州青颖飞帆软件科技股份有限公司 Communication method, equipment and storage medium for teaching live broadcast
CN115933921A (en) * 2022-11-29 2023-04-07 北京字跳网络技术有限公司 Media content display method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113518232B (en) 2024-03-01
WO2021204139A1 (en) 2021-10-14

Similar Documents

Publication Publication Date Title
CN113518232B (en) Video display method, device, equipment and storage medium
US11201754B2 (en) Synchronized accessibility for client devices in an online conference collaboration
US9826277B2 (en) Method and system for collaborative and scalable information presentation
JP5301425B2 (en) Group content presentation and system and method for organizing group communications during group content presentation
CN112637622A (en) Live broadcasting singing method, device, equipment and medium
US9654813B2 (en) Method and system for synchronized multi-venue experience and production
Prins et al. TogetherVR: A framework for photorealistic shared media experiences in 360-degree VR
CN112235530B (en) Method and device for realizing teleconference, electronic device and storage medium
Barkhuus et al. Watching the footwork: Second screen interaction at a dance and music performance
JP6473262B1 (en) Distribution server, distribution program, and terminal
CN109754275B (en) Data object information providing method and device and electronic equipment
JP2024019361A (en) Information processing apparatus
TW201917556A (en) Multi-screen interaction method and apparatus, and electronic device
CN112601110B (en) Method and apparatus for content recording and sharing
KR20170085781A (en) System for providing and booking virtual reality video based on wire and wireless communication network
CN114846808A (en) Content distribution system, content distribution method, and content distribution program
CN112672089A (en) Conference control and conferencing method, device, server, terminal and storage medium
TW202236845A (en) Video display method, device, equipment, and storage medium to see the video images of the host and the audience at the same time and perceive each other's behavior for facilitating more forms of interaction
US11715270B2 (en) Methods and systems for customizing augmentation of a presentation of primary content
Hahn et al. The Evolution of Advanced Digital Literacy
JP7152778B2 (en) Information processing system
CN115277650B (en) Screen-throwing display control method, electronic equipment and related device
US20230297218A1 (en) Terminal and method
US20210320959A1 (en) System and method for real-time massive multiplayer online interaction on remote events
JP2007243367A (en) Moving image distribution system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant