CN115190321A - Switching method and device of live broadcast room and electronic equipment - Google Patents
Switching method and device of live broadcast room and electronic equipment Download PDFInfo
- Publication number
- CN115190321A CN115190321A CN202210522301.5A CN202210522301A CN115190321A CN 115190321 A CN115190321 A CN 115190321A CN 202210522301 A CN202210522301 A CN 202210522301A CN 115190321 A CN115190321 A CN 115190321A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- data
- scene
- broadcast room
- room
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 127
- 230000002452 interceptive effect Effects 0.000 claims abstract description 269
- 230000003993 interaction Effects 0.000 claims abstract description 105
- 238000009877 rendering Methods 0.000 claims description 131
- 230000004927 fusion Effects 0.000 claims description 103
- 238000004040 coloring Methods 0.000 claims description 27
- 238000005286 illumination Methods 0.000 claims description 22
- 230000004044 response Effects 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 14
- 238000007781 pre-processing Methods 0.000 claims description 11
- 238000007499 fusion processing Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000012805 post-processing Methods 0.000 claims description 5
- 230000000875 corresponding effect Effects 0.000 description 33
- 230000006870 function Effects 0.000 description 28
- 230000000694 effects Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 17
- 230000000717 retained effect Effects 0.000 description 9
- 230000008901 benefit Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000002245 particle Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007921 spray Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a switching method and device of a live broadcast room and electronic equipment, which are used for receiving target interactive data from a live broadcast audience terminal and reserving a current live broadcast room after switching to a previous live broadcast room; responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interaction data; and sending the second live broadcast picture to a live broadcast audience, so that the live broadcast audience switches the displayed first live broadcast picture in the last live broadcast room into the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience end, the live broadcast anchor end corresponding to the switched current live broadcast room can reserve and display target interactive data in the last live broadcast room into a live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that a current function carrying link is not influenced, and the interactive experience of a user is improved.
Description
Technical Field
The present invention relates to the field of live broadcast technologies, and in particular, to a method and an apparatus for switching a live broadcast room, and an electronic device.
Background
The live broadcast room is an important content carrier and a user stay space of a live broadcast platform and bears a full-flow functional scene from activity to payment conversion of a user. After a user enters a live broadcast room, if the user is not interested in the current live broadcast content, the user can switch the live broadcast room in a mode that the finger slides up and down when the user wants to switch to other live broadcast rooms. In the correlation technique, the live broadcast platform client side adopts the mode that the page slides upwards or downwards to switch the live broadcast room, namely, directly switches the display page of the current live broadcast room into the display page of the next live broadcast room, if the user is carrying out interactive operation in the current live broadcast room, after the live broadcast room is switched, the interactive information displayed in the current live broadcast room can also stop displaying along with the switching of the live broadcast room, and the interactive behavior of the current live broadcast room is stopped at the same time, so that the interactive experience of the user is poor.
Disclosure of Invention
In view of this, an object of the present invention is to provide a method, an apparatus, and an electronic device for switching a live broadcasting room, so that data corresponding to a part of interactive operations in a previous live broadcasting room can be retained in the switched live broadcasting room, and live broadcasting interactive experience of a user is improved.
In a first aspect, an embodiment of the present invention provides a method for switching a live broadcast room, where the method is applied to a live broadcast anchor, and the method includes: receiving target interactive data from a live audience; the target interactive data is generated by a live broadcast audience end responding to interactive operation aiming at a previous live broadcast room, and the target interactive data is used for reserving a current live broadcast room after switching to the previous live broadcast room; responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interaction data; and sending the second live broadcast picture to a live broadcast audience through a live broadcast server, so that the live broadcast audience switches the displayed first live broadcast picture of the last live broadcast room into a second live broadcast picture of the current live broadcast room.
Further, in response to receiving a switching instruction for a last live broadcast room from a live broadcast viewer, generating a second live broadcast picture of a current live broadcast room based on target interactive data, including: acquiring second scene rendering data of the current live broadcast room, and constructing a second virtual live broadcast scene of the current live broadcast room according to the second scene rendering data; setting a scene model corresponding to the target interactive data in a second virtual live broadcast scene; and shooting a range containing target interaction data in a second virtual live broadcast scene through the virtual camera to obtain a second live broadcast picture, wherein the virtual camera is arranged in the second virtual live broadcast scene.
Further, before the step of generating a second live broadcast picture of the current live broadcast room based on the target interactive data in response to receiving a switching instruction for the last live broadcast room from the live broadcast viewer, the method further includes: acquiring first scene rendering data of a previous live broadcast room and second scene rendering data of a current live broadcast room; generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data and the target interaction data; the fusion virtual scene comprises target interaction data.
Further, after the step of responding to the receiving of the switching instruction for the last live room from the live audience, the method further comprises the following steps: shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
Further, the step of generating a fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data includes: performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fusion virtual scene; and rendering the target interaction data to the initial fusion virtual scene to obtain the fusion virtual scene.
Further, the step of performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fusion virtual scene includes: acquiring target scene rendering data of a target virtual scene with similarity greater than a first preset threshold value in a first virtual live broadcast scene of a last live broadcast room and a second virtual live broadcast scene of a current live broadcast room from first scene rendering data and second scene rendering data; wherein the target scene rendering data comprises: scene element information, scene terrain information, scene illumination information, and post-processing information of the scene; and constructing an initial fusion virtual scene according to the target scene rendering data.
Further, the step of rendering the target interaction data to the initial fusion virtual scene to obtain the fusion virtual scene includes: analyzing the state information of the current target interactive data in the previous live broadcast room; wherein the state information at least comprises: the data type of the target interactive data and the position of the target interactive data in the virtual live broadcast scene; and setting a scene model corresponding to the target interactive data in the initial fusion virtual scene according to the state information to obtain a fusion virtual scene, so that the state of the target interactive data in the fusion virtual scene is consistent with the state of the target interactive data in the current live broadcast room.
Further, after the step of generating the fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data, the method further includes: sending the fused virtual scene to a live broadcast server, processing the specified information in the fused virtual scene through the live broadcast server to obtain processed specified information, and sending the processed specified information to a live broadcast audience; wherein the specifying information includes: target interaction data, scene terrain information, and scene lighting information.
Further, the step of processing the specified data in the merged virtual scene through the live broadcast service end to obtain the processed specified data includes: the method comprises the steps that display information in a last direct broadcasting room in the current state is obtained through a direct broadcasting server, first data which are the same as the display information are determined from target interactive data, and the first data are marked; wherein the first data is for: at a live broadcast audience, responding to the switching operation aiming at the previous live broadcast room, and hiding the first data displayed in the previous live broadcast room; converting scene terrain information and scene illumination information into coloring data; wherein the shading data is for: and at the live broadcast audience, responding to the switching operation aiming at the last live broadcast room, and coloring the first virtual live broadcast scene of the last live broadcast room.
Further, the target interaction data is determined by: the method comprises the steps that first interactive data from a live audience are received through a live broadcast server, target interactive data are determined from the first interactive data according to the data type of the first interactive data, and the target interactive data are sent to a live broadcast anchor.
Further, the step of determining the target interactive data from the first interactive data according to the data type of the first interactive data includes: determining data with a data type capable of being rendered in the first interactive data as target interactive data; determining data matched with a preset template in the first interactive data as target interactive data according to the preset template; the preset template is used for extracting data reserved to the current live broadcast room.
Further, the current live broadcast room is determined by: through a live broadcast server, responding to a received preprocessing instruction from a live broadcast audience, acquiring live broadcast room data of a last live broadcast room, and determining a current live broadcast room after the last live broadcast room is switched according to the live broadcast room data of the last live broadcast room; wherein the preprocessing instruction is generated by the live audience end in response to the target user entering the last live room.
Further, the step of determining the current live broadcast room to be distributed after the last live broadcast room is switched according to the live broadcast room data of the last live broadcast room comprises the following steps: acquiring live broadcast room data of a live broadcast room to be distributed in a live broadcast state; and determining a target live broadcast room matched with the previous live broadcast room from the live broadcast rooms to be distributed according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast rooms to be distributed, and determining the target live broadcast room as the current live broadcast room.
Further, the live room data of the upper live room includes: scene identification of a virtual live broadcast scene in a previous live broadcast room; live broadcast room data of a live broadcast room to be distributed comprises the following steps: scene identification of a virtual live broadcast scene of a live broadcast room to be distributed; the method comprises the following steps of determining a target live broadcast room matched with a previous live broadcast room from the live broadcast room to be distributed according to live broadcast room data of the previous live broadcast room and live broadcast room data of a live broadcast room to be distributed, wherein the steps comprise: and according to the scene identification, determining a target live broadcast room matched with the virtual live broadcast scene in the last live broadcast room from the live broadcast rooms to be distributed.
Further, the target live broadcast room comprises a plurality of target live broadcast rooms; live broadcast room data of a live broadcast room to be distributed comprises the following steps: live broadcast duration and audience data; the method further comprises the following steps: calculating a recommendation score of a target live broadcast room according to a preset calculation formula, and live broadcast duration and audience data of a to-be-distributed live broadcast room; and determining the target live broadcast room with the recommendation score meeting a second preset threshold as the current live broadcast room.
In a second aspect, an embodiment of the present invention provides a method for switching a live broadcast room, where the method is applied to a live broadcast viewer, and the method includes: responding to the interactive operation aiming at the last live broadcast room, generating target interactive data, sending the target interactive data to a live broadcast anchor terminal, and generating a second live broadcast picture of the current live broadcast room after the last live broadcast room is switched on the basis of the target interactive data through the live broadcast anchor terminal; responding to the switching operation aiming at the last live broadcasting room, and receiving a second live broadcasting picture from a live broadcasting anchor end; the second live broadcast picture comprises target interactive data; and switching the displayed first live broadcast picture of the last live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture.
Further, after the step of responding to the switching operation for the last multicast, the method further comprises: receiving a switching picture aiming at the current live broadcast room from a live broadcast anchor terminal; wherein the switching picture is determined by: acquiring first scene rendering data of a previous live broadcast room and second scene rendering data of a current live broadcast room through a live broadcast anchor; generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data and the target interaction data; the fusion virtual scene comprises target interaction data; shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
Further, the step of switching the displayed first live view of the last live view into the second live view of the current live view based on the second live view includes: switching a first live-action picture of the last live-action to a switching picture in response to a switching start operation for the last live-action; the switching picture comprises target interaction data; and responding to the switching ending operation aiming at the last live broadcasting room, and switching the switching picture to a second live broadcasting picture.
Further, before the step of responding to the switching operation between the last multicast, the method further includes: receiving first data and shader data of a fusion virtual scene from a live broadcast server; the fusion virtual scene is generated through a live broadcast anchor terminal based on first scene rendering data of a previous live broadcast room, second scene rendering data of a current live broadcast room and target interaction data; the first data is generated by acquiring display information in a last direct broadcasting room in the current state through a direct broadcasting server, determining first data which is the same as the display information from target interactive data and marking the first data; the coloring data is generated by converting scene terrain information and scene illumination information into coloring data through a live broadcast server.
Further, after the step of responding to the switching operation between the last direct broadcasting, the method further comprises: hiding the first data displayed in the previous live broadcast room; and according to the coloring data, coloring the virtual live broadcast scene in the previous live broadcast room.
In a third aspect, an embodiment of the present invention provides a device for switching between live broadcasts, where the device is disposed at a live broadcaster end, and the device includes: the data receiving module is used for receiving target interactive data from a live audience; the target interactive data is generated by the response of a live audience to the interactive operation of the last live broadcast room, and the target interactive data is used for reserving the current live broadcast room after the switching of the last live broadcast room; the live broadcast picture generation module is used for responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience terminal and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interactive data; and the live broadcast picture sending module is used for sending the second live broadcast picture to a live broadcast audience through the live broadcast server, so that the live broadcast audience switches the displayed first live broadcast picture in the last live broadcast room into the second live broadcast picture in the current live broadcast room.
In a fourth aspect, an embodiment of the present invention provides a device for switching between live broadcasting rooms, where the device is disposed at a live broadcasting audience, and the device includes: the data sending module is used for responding to the interactive operation aiming at the last live broadcast room, generating target interactive data, sending the target interactive data to the live broadcast anchor terminal, and generating a second live broadcast picture of the current live broadcast room after the last live broadcast room is switched on the basis of the target interactive data through the live broadcast anchor terminal; the live broadcast picture receiving module is used for responding to the switching operation aiming at the previous live broadcast room and receiving a second live broadcast picture from a live broadcast anchor terminal; the second live broadcast picture comprises target interaction data; and the live broadcast picture switching module is used for switching the displayed first live broadcast picture of the last live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture.
In a fifth aspect, an embodiment of the present invention provides an electronic device, which includes a processor and a memory, where the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the method for switching between live broadcasts of any one of the first aspect or the method for switching between live broadcasts of any one of the second aspect.
In a sixth aspect, embodiments of the present invention provide a computer-readable storage medium storing computer-executable instructions that, when invoked and executed by a processor, cause the processor to implement the live room switching method of any one of the first aspect or the live room switching method of any one of the second aspect.
The embodiment of the invention has the following beneficial effects:
the invention provides a switching method and a device of a live broadcast room and electronic equipment, which are used for receiving target interactive data from a live broadcast audience end and reserving a current live broadcast room after switching to a previous live broadcast room; responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interaction data; and sending the second live broadcast picture to a live broadcast audience, so that the live broadcast audience switches the displayed first live broadcast picture in the last live broadcast room into the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience terminal, the live broadcast anchor terminal corresponding to the switched current live broadcast room can reserve and display the target interactive data in the last live broadcast room into the live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that the current function carrying link is not influenced, and the interactive experience of a user is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a method for switching a live broadcast room according to an embodiment of the present invention;
fig. 2 is a flowchart of another live broadcast switching method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a switching device of a live broadcast room according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of another switching device of a live broadcast room according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention; .
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The live broadcast room (including a plurality of video streams, barrage interaction information, activity function playing methods and the like) is an important content carrier and user staying space of a live broadcast platform and bears a full-flow function scene of the user from activity to payment conversion. After a user enters a live broadcast room, if the user is not interested in the current live broadcast content and wants to switch to other live broadcast rooms, the live broadcast room can be switched in a mode of sliding a finger up and down. In the correlation technique, the live broadcast platform client side adopts the mode that the page slides upwards or downwards to switch the live broadcast room, namely, directly switches the display page of the current live broadcast room into the display page of the next live broadcast room, if the user is carrying out interactive operation in the current live broadcast room, after the live broadcast room is switched, the interactive information displayed in the current live broadcast room can also stop displaying along with the switching of the live broadcast room, and the interactive behavior of the current live broadcast room is stopped at the same time, so that the interactive experience of the user is poor. Based on this, the technology can be applied to the client device and the server device of the live broadcast platform.
To facilitate understanding of the embodiment, a detailed description is first given of a switching method of a live broadcast room disclosed in the embodiment of the present invention, where the method is applied to a live broadcast anchor, the anchor is an anchor corresponding to the switched live broadcast room, and a phantom Engine (UE) is disposed in a device of the anchor and is used to complete virtual live broadcast of an anchor. As shown in fig. 1, the method comprises the steps of:
step S102, receiving target interactive data from a live audience; the target interactive data is generated by the response of a live audience to the interactive operation of the last live broadcast room, and the target interactive data is used for reserving the current live broadcast room after the switching of the last live broadcast room;
the live audience can be terminal equipment such as a mobile phone and a tablet personal computer. Usually, the target user corresponding to the live audience end can use various functions of the live platform in addition to watching live content after entering the live room, the functions can be functions for the live room, such as sending a barrage, sending a gift, drawing a lottery and the like in the live room, and can also be functions for the target user, such as raising a pet in a live interface, opening a certain play page in a display interface of the live room, suspending functions and the like. When the target user carries out interactive operation aiming at the display interface of the live broadcast room, interactive data (namely the target interactive data) can be generated, and the generated interactive data is sent to the live broadcast server side in real time. When the server receives target interactive data of a target user in a live broadcast room from a live broadcast audience, the target interactive data is sent to a live broadcast anchor end corresponding to the live broadcast room to be distributed after the live broadcast room is switched.
Generally, the live broadcast server determines in advance the live broadcast room that is possibly displayed if the live broadcast room currently displayed by the live broadcast viewer is switched, so that the live broadcast anchor corresponding to the live broadcast room that is possibly displayed receives the target interactive data from the live broadcast viewer, and the target interactive data is retained in the live broadcast picture of the live broadcast room (i.e. the current live broadcast room) corresponding to the live broadcast anchor.
Step S104, responding to a switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interactive data;
when the target user wants to switch the previous live broadcast room, the distribution interaction behavior between the live broadcast rooms can be triggered through up-down sliding or other interaction gestures. Then, the live audience generates a switching instruction of the previous live room and sends the switching instruction to the live service end. And determining the live broadcasting room to be distributed after the switching of the previous live broadcasting room (namely the current live broadcasting room) through the live broadcasting service end, and then sending a switching instruction to the live broadcasting anchor end. And when the live broadcast anchor terminal receives the switching instruction, a second live broadcast picture of the current live broadcast room is immediately generated according to the target interactive data.
The target interaction data may include some barrage information, a functional play page and other information, and the information is displayed in a graphical user interface of a live broadcast platform displayed by a viewer at any time. Therefore, in actual implementation, the target interaction data can be rendered into a second live broadcast picture of the current live broadcast room through the illusion engine, the target interaction data can be rendered into a virtual live broadcast scene of the current live broadcast room, the target interaction data can also be suspended on the virtual live broadcast scene of the current live broadcast room in a patch mode, and a model corresponding to the target interaction data can also be directly set on the virtual live broadcast scene of the current live broadcast room. The specific determination can be based on the target interaction data.
In addition, the display forms of the target interactive data are different, for example, the displayed bullet screen information needs to be moved, the information needs to be displayed at a fixed position, and the displayed effect information needs to be delayed. Therefore, it is further required to determine a position and a display form of the target interactive data in the virtual live broadcast scene of the current live broadcast room, and render the target interactive data to the virtual live broadcast scene of the current live broadcast room according to the position and the display form of the target interactive data in the virtual live broadcast scene of the current live broadcast room, so as to generate a second live broadcast picture.
The specific generation mode is usually a virtual live broadcast mode, which is exemplified by a live scene of a character in a virtual scene, an anchor character image of a live broadcast anchor end can be acquired through an internal or external camera of the anchor end, the anchor character image of the live broadcast anchor end is sent to an anchor end device, and the character in the character image is deducted through modes such as image matting and the like through the anchor end device. And then, the character taken out is arranged in a virtual live broadcast scene obtained by rendering of the anchor terminal equipment, and finally, a live broadcast picture of the virtual live broadcast scene is obtained through a virtual camera. It should be noted that the camera acquires a live broadcast picture of the virtual live broadcast scene as a video stream.
And step S106, sending the second live broadcast picture to a live broadcast audience through the live broadcast server, so that the live broadcast audience switches the displayed first live broadcast picture of the last live broadcast room into the second live broadcast picture of the current live broadcast room.
In actual implementation, the second live broadcast picture is sent to the live broadcast server, then the second live broadcast picture is sent to the live broadcast viewer through the live broadcast server, and when the live broadcast viewer receives the second live broadcast picture, the live broadcast picture of the live broadcast room (namely, the first live broadcast picture of the previous live broadcast room) which is being displayed can be switched to the second live broadcast picture of the current live broadcast room. In the switching process, the mode of specifically displaying the second live broadcast picture may be direct display or display in a transitional mode, for example, the live broadcast picture in the last live broadcast room is gradually canceled and then the second live broadcast picture is gradually displayed.
The embodiment of the invention provides a switching method of a live broadcast room, which is used for receiving target interactive data from a live broadcast audience terminal and reserving a current live broadcast room after switching to a previous live broadcast room; responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interaction data; and sending the second live broadcast picture to a live broadcast audience, so that the live broadcast audience switches the displayed first live broadcast picture in the last live broadcast room into the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience terminal, the live broadcast anchor terminal corresponding to the switched current live broadcast room can reserve and display the target interactive data in the last live broadcast room into the live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that the current function carrying link is not influenced, and the interactive experience of a user is improved.
In addition, the live broadcast room is a live broadcast room which is virtually played; the virtual broadcasting means that the anchor is in front of a green screen, and the background behind the anchor is actually a virtual scene rendered by an engine of the UE, so that the advantage is that the scene is changeable (only art assets need to be changed), and elements in the scene are theoretically interactive (as being virtual, can be triggered by different logic events). The specific virtual broadcasting mode can be that the anchor completes the virtual broadcasting through the existing virtual broadcasting function of the live broadcast platform, wherein, the game virtual broadcasting flow is different from the conventional virtual broadcasting; the scene can be played virtually by the authorities (such as live programs with goods) on line and is in a virtual playing state.
In response to receiving a switching instruction from a live viewer for a previous live video, generating a second live video of a current live video based on target interactive data, a possible implementation manner is as follows:
acquiring second scene rendering data of the current live broadcast room, and constructing a second virtual live broadcast scene of the current live broadcast room according to the second scene rendering data; setting a scene model corresponding to the target interactive data in a second virtual live broadcast scene; and shooting a range containing target interaction data in a second virtual live broadcast scene through the virtual camera to obtain a second live broadcast picture, wherein the virtual camera is arranged in the second virtual live broadcast scene.
The second scene rendering data may be a shader, and the second virtual live broadcast scene in the current live broadcast room may be rendered according to the second scene rendering data, and then set in the second virtual live broadcast scene according to a scene model corresponding to the target interaction data. The scene model can be a user interface patch, a front page, a page element, a pet and the like. The specific setting mode can be set at the corresponding position of the second virtual live broadcast scene and displayed according to the position and the display mode of the target interactive data in the last live broadcast room. After a second virtual live broadcast scene of the current live broadcast room is built, shooting the whole range of the second virtual live broadcast scene through a virtual camera in the second virtual live broadcast scene, or shooting the range containing target interactive data in the second virtual live broadcast scene, and finally obtaining a second live broadcast picture containing the target interactive data in the second virtual live broadcast scene.
In the above manner, when the second virtual live broadcast scene is generated, the scene model corresponding to the target interaction data is set in the second virtual live broadcast scene, so that the second live broadcast picture includes the interaction information displayed in the previous live broadcast room, and the live broadcast interaction experience of the user is improved.
In order to further improve the live interaction experience of the user, before the step of generating a second live frame of the current live broadcast room based on the target interaction data in response to receiving a switching instruction aiming at the last live broadcast room from the live broadcast audience, the method further comprises the following steps of:
step 11, acquiring first scene rendering data of a previous live broadcast room and second scene rendering data of a current live broadcast room;
specifically, after target interaction data is received, first scene rendering data of a last live broadcast room can be obtained through a live broadcast server, wherein the first scene rendering data is used for rendering and generating a first virtual live broadcast scene of the last live broadcast room. And the second scene rendering data is used for rendering and generating a second virtual live broadcast scene of the current live broadcast room.
Step 12, generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data and the target interaction data; the fusion virtual scene comprises target interaction data.
When a user switches the previous live broadcasting room to the next live broadcasting room, in order to further improve the immersive interactive experience in the switching process, the live broadcasting anchor end can generate a fusion virtual scene in advance, so that a transition picture can be formed during the switching of the live broadcasting rooms. Specifically, a scene of the last live broadcast may be fused with a scene of the current live broadcast, and in addition, in order to keep the target interaction data of the last live broadcast to the fused virtual scene, a scene model corresponding to the target interaction data needs to be set in the fused virtual scene.
In actual implementation, whether the first virtual live broadcast scene is consistent with the second virtual live broadcast scene or not may be determined according to the first scene rendering data and the second scene rendering data (which may be determined according to the scene ID), and if so, the fusion virtual scene may be generated directly according to the second scene rendering data and the target interaction data, or the fusion virtual scene does not need to be generated.
If the first scene rendering data and the second scene rendering data are inconsistent, third scene rendering data of the fusion virtual scene are determined according to the first scene rendering data and the second scene rendering data, then the fusion virtual scene is formed through rendering according to the third scene rendering data, and then the scene model corresponding to the target interaction data is arranged in the fusion virtual scene.
In the above manner, according to the first virtual live broadcast scene of the previous live broadcast room, the second virtual live broadcast scene of the current live broadcast room and the target interaction data, the fusion virtual scene containing the target interaction data is determined, so that transition can be performed with the fusion virtual scene during switching of the live broadcast rooms, and the immersive interaction experience in the switching process is improved.
In the case of generating the merged virtual scene, after the step of receiving a switching instruction for a last live room from a live audience, in order to further improve the interactive experience of the user, the method further includes:
shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
After the fused virtual scene is generated, after a switching instruction aiming at the last live broadcast room from a live broadcast audience is received, firstly, the fused virtual scene is shot through a virtual camera arranged in the fused virtual scene, a switching picture aiming at the current live broadcast room is obtained, and then the switching picture is sent from the live broadcast audience, so that the live broadcast audience can firstly display the first live broadcast picture of the last live broadcast room as the switching picture and then switch and display the switching picture as a second live broadcast picture.
In step 12, a step of generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data, in which one possible implementation manner is as follows:
step 121, performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fusion virtual scene;
similar scene elements in the first virtual live broadcast scene and the second virtual live broadcast scene, such as having similar terrain and illumination, may be fused. The initial fusion virtual scene may be generated by rendering based on rendering data corresponding to the same scene element, and it can be understood that different elements in the first virtual live broadcast scene and the second virtual live broadcast scene are removed from the initial fusion virtual scene.
One possible implementation: acquiring target scene rendering data of a target virtual scene with similarity greater than a first preset threshold value in a first virtual live broadcast scene of a last live broadcast room and a second virtual live broadcast scene of a current live broadcast room from first scene rendering data and second scene rendering data; wherein the target scene rendering data comprises: scene element information, scene terrain information, scene illumination information, and post-processing information of the scene; and constructing an initial fusion virtual scene according to the rendering data of the target scene.
The first preset threshold value can be set according to actual needs, or can be set according to actual live scenes. Specifically, a target virtual scene with a similarity greater than a first preset threshold may be determined according to scene elements of a first virtual live broadcast scene and a second virtual live broadcast scene, or according to first scene rendering data and second scene rendering data, where the scene element information may be element information of trees, buildings, sky, and the like in the scene. Target scene rendering data of the target virtual scene is then obtained from the first scene rendering data and the second scene rendering data. And constructing an initial fusion virtual scene according to the rendering data of the target scene and performing smooth transition processing through an algorithm.
In the mode, the initial fusion virtual scene is generated through the similar virtual scenes in the first virtual live scene and the second virtual live scene, the display effect of the initial fusion virtual scene is improved, and the immersive interactive experience of the user in the live broadcast room switching process is further improved.
And step 122, rendering the target interaction data to the initial fusion virtual scene to obtain the fusion virtual scene.
One possible implementation: analyzing the state information of the current target interactive data in the previous live broadcast room; wherein the state information at least comprises: the data type of the target interactive data and the position of the target interactive data in the virtual live broadcast scene; and setting a scene model corresponding to the target interactive data in the initial fusion virtual scene according to the state information to obtain the fusion virtual scene, so that the state of the target interactive data in the fusion virtual scene is consistent with the state of the target interactive data in the current live broadcasting room.
The target interaction data types generally include data of a character type, data of a front-end page type, and data of a special effect type, where the data of the character type is, for example, a barrage text, the data of the front-end page type is, for example, a play function page, a floating pet, and the like, and the data of the special effect type is, for example, a special effect of a result generated by a play, a special effect generated by a barrage except characters, a special effect generated by an operation function, and the like.
Explaining by taking the example that the target interaction data comprises interaction data, play function page data and play result data, the process from rendering of the interaction data to initial fusion of the virtual scene is as follows: analyzing the state information of the bullet screen text sent by the user in the current state in the last live broadcast room, converting the state information into a UI (user interface) patch in the UE, then acquiring the motion track coordinates for placing the current UI patch in the initial fusion virtual scene, rendering the bullet screen text at the corresponding coordinate position, and performing uniform destruction motion in the given direction until the bullet screen text is naturally destroyed after being moved out of the scene.
Rendering the data of the play function page to an initial fusion virtual scene process: analyzing the number of playing pages in the current state and the corresponding awakening state (judging whether the playing pages are opened or not), if the playing pages are opened, rendering the front end dimension of H5 on the pages, then acquiring element plane data for placing the current-size pages in an initial fusion virtual scene, and placing the element plane data at a given position in the scene; if the plane cannot be found, the patches of the play page are convoluted (the patches of the two-dimensional page are bent and folded to form a three-dimensional object), and are randomly placed in the scene space.
And rendering the playing result data to the initial fusion virtual scene: analyzing result data generated by a user side through an operation function and a playing method in the current state, matching and searching the playing method template-reward effect, and if a matching corresponding relation exists (such as a user draws a lottery to obtain a high-value reward and sprays firework particles), delaying rendering the special effect of the playing method result particles in the corresponding virtual scene in the initial fusion virtual scene so as to achieve the effect of carrying.
In addition, illumination data and post-processing data in a scene can be acquired, illumination distribution area analysis is carried out, and a plurality of illuminations in the same area are combined (a color temperature mean value, a position mean value and an illumination angle mean value are taken); and finally, putting all the data into a newly generated initial fusion virtual scene to obtain a fusion virtual scene.
In addition, the live broadcast anchor end can also receive target interactive data in real time or dynamically monitor the target interactive data sent back by the live broadcast service end, and dynamically update and fuse the virtual scene and the corresponding element information. In the mode, the pre-rendering of the fusion virtual scene is generated through the live broadcast anchor terminal, so that the switching process between the live broadcast rooms can be transited and carried through the fusion virtual scene, and the immersive experience of a user is improved.
In order to further improve the immersive experience of the user when switching the frames of the live broadcast room, in step 12, after generating the fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data, the method further includes:
sending the fused virtual scene to a live broadcast server, processing the specified information in the fused virtual scene through the live broadcast server to obtain processed specified information, and sending the processed specified information to a live broadcast audience; wherein the specifying information includes: target interaction data, scene terrain information, and scene lighting information.
Specifically, the target interaction data in the designated information may be determined according to information displayed in the last direct broadcasting session, wherein the scene terrain information and the scene illumination information may be directly obtained, and the specific processing manner may be to mark the target interaction data, perform data conversion processing on the scene terrain information and the scene illumination information, and the like. The purpose of sending the fused virtual scene to the live broadcast server is that when a live broadcast audience performs live broadcast room switching, an immersive switching process exists between a previous live broadcast room and a current live broadcast room, and the situation that when a user triggers a display interface of the previous live broadcast room, a live broadcast picture has no effect is avoided.
The step of processing the specific information in the merged virtual scene through the live broadcast service end to obtain the processed specific information includes one possible implementation manner:
the method comprises the steps that display information in a last direct broadcasting room in the current state is obtained through a direct broadcasting server, first data which are the same as the display information are determined from target interactive data, and the first data are marked; wherein the first data is for: at a live broadcast audience, responding to the switching operation aiming at the previous live broadcast room, and hiding the first data displayed in the previous live broadcast room; converting scene terrain information and scene illumination information into coloring data; wherein the shading data is for: and at the live broadcast audience, responding to the switching operation aiming at the last live broadcast room, and coloring the first virtual live broadcast scene of the last live broadcast room.
In this embodiment, the interactive data in the target interactive data is mainly processed. Specifically, after the live broadcast server receives the fusion virtual scene, the target interactive data in the fusion virtual scene is judged, and if the display information in the last live broadcast room in the current state is the same as the first data in the target interactive data, the first data in the target interactive data is marked. And then extracting the terrain and illumination information in the scene, converting the terrain and illumination information into UI style layer coloring data required by a live broadcast seed-changing audience, and sending the first data and the coloring data to the live broadcast audience.
When a user side is in a live broadcast room and a distribution interaction behavior between the live broadcast rooms is triggered through up-down sliding or other interaction gestures, a live broadcast audience temporarily hides first data in an upper direct broadcast room displayed by the live broadcast audience according to the first data and coloring data returned by a server; other parts which are not influenced by the virtual scene in the last live broadcasting room and displayed by the live broadcasting audience are colored, so that the effect that the virtual live broadcasting scene is out of the frame and extends to the whole live broadcasting room is created, and the switching effect of the live broadcasting room and the interaction experience of a user are further improved.
In the above mode, the scene data and the target interaction data in the fusion virtual scene are processed, so that the transition effect of switching between live broadcasting rooms is ensured, and the immersive live broadcasting switching process of the user is further improved.
Usually, a target user can perform various interactions in a live broadcast room, such as barrage interaction, activity function playing and the like, but interactive data of the live broadcast room cannot be completely reserved in the live broadcast room after next switching, and some data are only related to the previous live broadcast room and cannot be reserved in the live broadcast room after next switching, so that before the live broadcast room is switched, the target interactive data in the interactive data of the previous live broadcast room can be reserved in the current live broadcast room, and the target interactive data needs to be determined from the first interactive data in advance. Further, the target interaction data is determined by:
the method comprises the steps that first interactive data from a live audience are received through a live broadcast server, target interactive data are determined from the first interactive data according to the data type of the first interactive data, and the target interactive data are sent to a live broadcast anchor.
When the target user enters the last live broadcast room, besides watching live broadcast content, various functions of the live broadcast platform can be used, the functions can be functions aiming at the last live broadcast room, such as sending a barrage, sending a gift, drawing a lottery and the like in the live broadcast room, and the functions can also be functions aiming at the target user, such as raising a pet on a live broadcast page, opening a play page on the live broadcast page, suspending functions and the like. When the target user carries out interactive operation on the page of the last live broadcast, interactive data (namely the first interactive data) is generated, and the generated interactive data is sent to the live broadcast server in real time. When the live broadcast server receives first interactive data of a target user in a live broadcast room from a live broadcast audience, the target interactive data is determined from the first interactive data, wherein the target interactive data refers to interactive data related to the target user, and when the target user is switched to a next live broadcast room, the target interactive data in the previous live broadcast room is also reserved to the next live broadcast room, so that the interactive experience of the user is improved.
In actual implementation, the target interactive data, such as special lottery play data, can be determined according to the data type of the first interactive data, and can be played only in the current live broadcast room and cannot be reserved; also, for example, a gift given by a user cannot be retained because it is strongly correlated with the current anchor; for another example, the scene ID is also used, and if the element cannot be rendered, the element cannot be retained; as another example, a flyover page for the user that the user opens needs to be retained.
In the step of determining the target interactive data from the first interactive data according to the data type of the first interactive data, a possible implementation manner is as follows:
determining data with a data type capable of being rendered in the first interactive data as target interactive data; determining data matched with a preset template in the first interactive data as target interactive data according to the preset template; the preset template is used for extracting data reserved to the current live broadcast room.
The renderable data may be understood as data that may be rendered to a virtual scene. The preset template generally includes a logic judgment structure and a mapping relationship, and is used for filtering target interaction data that can be retained. It can be understood that a plurality of data types are set in the preset template, and data belonging to the data types of the preset template are determined as target interaction data. The data types of the first interactive data comprise barrage data, pet data, page data and the like.
In actual implementation, a preset template may be combined to determine whether each piece of data in the first interactive data belongs to data that can be reserved to a subsequent switching distribution process (for example, a user sends a certain bullet screen, which function can be reserved in the template), and if so, the piece of data is reserved, and if not, the piece of data is not reserved. For example, the special lottery play data can only be played in the current live broadcast room and cannot be reserved; the gift given by the user cannot be reserved because it is strongly related to the current anchor; the scene ID is also used for the same purpose, and cannot be retained if the element cannot be rendered; a flyover page for the user, which the user opens, needs to be retained.
It is to be understood that the target interactive data is generally data strongly related to the target user, and the first interactive data that is not retained is data strongly related to the last direct inter-cast. In addition, in order to ensure the real-time performance of the data, the first interactive data and the target interactive data are updated in real time according to the real-time operation of the user.
In the above manner, the live broadcast server determines that the target interactive data in the first interactive data is allowed to be reserved to the current live broadcast room, so that the accuracy of the target interactive data is improved, and the interactive experience of the user is further improved.
In addition, in order to improve the distribution efficiency of the live broadcast room, the current live broadcast room is determined by the following method:
through a live broadcast server, responding to a received preprocessing instruction from a live broadcast audience, acquiring live broadcast room data of a last live broadcast room, and determining a current live broadcast room after the last live broadcast room is switched according to the live broadcast room data of the last live broadcast room; wherein the preprocessing instruction is generated by the live audience end in response to the target user entering the last live room.
The last live broadcast room is a live broadcast room watched by a target user at a live viewer end, and the current live broadcast room is a live broadcast room to be distributed after the current watching live broadcast room of the target user is switched. The current live broadcast room usually requires a server, which is predetermined according to the relevant data of the live broadcast room. The live broadcast room data of the last live broadcast room includes a room identifier (also referred to as a room ID) of the last live broadcast room, a scene identifier (also referred to as a scene ID) of the last live broadcast room, a play duration of the last live broadcast room, the number of viewers, the number of active people, the number of paid people, and the like.
Specifically, when a target user enters the live content of the previous live broadcast room for watching in the previous live broadcast room at the live broadcast audience, the live broadcast audience generates a preprocessing instruction for enabling the server to obtain the data of the live broadcast room of the previous live broadcast room. And then sending the preprocessing instruction to a server, responding to the received preprocessing instruction sent by the live audience, and acquiring the live room data of the previous live room, including data such as a room ID, a broadcasting scene ID, broadcasting duration, the number of people watched and the like. And then acquiring a current live broadcast room matched with the live broadcast room data of the last live broadcast room from the live broadcast room in the live broadcast platform according to the live broadcast room data of the last live broadcast room, specifically acquiring a target live broadcast room with the same scene ID as the last live broadcast room from the live broadcast room in the live broadcast platform according to the scene ID in the live broadcast room data of the last live broadcast room, and then acquiring the current live broadcast room for a target user from the target live broadcast room according to the broadcasting start time, the watching number and the like of the target live broadcast room. The current live broadcast room is generally referred to as a live broadcast room related to the last live broadcast room, and may also be a live broadcast room in which a live broadcast platform is being promoted.
In addition, the purpose of determining the current live broadcast room is to determine the next interested live broadcast room for the target user in advance, so that the target user can immediately display the current live broadcast room when switching to the previous live broadcast room.
In the above manner, the live broadcast server determines the to-be-distributed live broadcast room after the live broadcast room displayed by the live broadcast viewer is switched, so that the live broadcast server can send the received target interactive data to the corresponding live broadcast anchor, and the switching efficiency of the live broadcast switching process is improved.
The step of determining the current live broadcast room to be distributed after the last live broadcast room is switched according to the live broadcast room data of the last live broadcast room is a possible implementation manner:
(1) Acquiring live broadcast room data of a live broadcast room to be distributed in a live broadcast state;
the live broadcast room data of the live broadcast room to be distributed is the same as the live broadcast room data of the first direct broadcast room, and the live broadcast room data comprises a room ID, a scene ID, a broadcasting starting time, the number of watching people, the number of active people, the number of paying people and the like of the live broadcast room. Specifically, after the live broadcast server side obtains the live broadcast room data of the first live broadcast room, all live broadcast rooms in a live broadcast state in the live broadcast platform, namely the live broadcast room to be distributed, need to be obtained at the same time.
(2) And according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast room to be distributed, determining a target live broadcast room matched with the previous live broadcast room from the live broadcast room to be distributed, and determining the target live broadcast room as the current live broadcast room.
Specifically, a target live broadcasting room which is the same as the scene ID of the last live broadcasting room can be determined from the live broadcasting rooms to be distributed according to the scene ID; if the live broadcasting room to be distributed which is the same as the scene ID of the last live broadcasting room does not exist, the live broadcasting room to be distributed which is close to the scene ID of the last live broadcasting room can be determined as a target live broadcasting room; or determining the hottest target live broadcast room according to the watching number in the live broadcast room data of the second live broadcast room. And determining the target live broadcast room as the current live broadcast room. Wherein, the target live broadcast room comprises one or more.
In the above manner, the live broadcast service end can acquire the live broadcast room data of the live broadcast room to be distributed, which is currently in the virtual broadcast, and determine the subsequent distribution logic of the live broadcast room through the live broadcast room data, so that the distribution efficiency of the live broadcast room is improved, and the interaction experience of the user is further improved.
The live broadcast room data of the previous live broadcast room includes: scene identification of a virtual live broadcast scene in a previous live broadcast room; live broadcast room data of a live broadcast room to be distributed comprises the following steps: scene identification of a virtual live broadcast scene of a live broadcast room to be distributed; the above determining, from the live broadcast room to be distributed, a target live broadcast room matched with the previous live broadcast room according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast room to be distributed, is a possible implementation manner: and determining a target live broadcast room matched with the virtual live broadcast scene of the last live broadcast room from the live broadcast rooms to be distributed according to the scene identification.
In actual implementation, live broadcasting rooms in the same broadcasting scene ID can be divided into a group, but if a plurality of scenes with the same scene ID do not exist at present, a plurality of most similar scenes are obtained through a scene matching degree mapping table (a numerical value preset in scene making) and are divided into a group; and then determining the live broadcasting room which is the same as or similar to the scene ID of the first live broadcasting room in the group as a target live broadcasting room. In the method, the target live broadcast room matched with the live broadcast scene of the previous live broadcast room is obtained from the live broadcast room which is currently played in the live broadcast platform, so that the distribution efficiency and the distribution accuracy of the live broadcast room are further improved, and the watching experience of a user is further improved.
If the number of the target live broadcast rooms is one, the target live broadcast room can be directly determined as the current live broadcast room, and if the number of the target live broadcast rooms is more than one; live broadcast room data of a live broadcast room to be distributed comprises the following steps: live broadcast duration and audience data;
the method further comprises the following steps: calculating a recommendation score of a target live broadcast room according to a preset calculation formula, and live broadcast duration and audience data of a to-be-distributed live broadcast room; and determining the target live broadcast room with the recommendation score meeting a second preset threshold as the current live broadcast room.
The preset calculation formula is as follows: the recommendation score = a + b + number of viewers + c + number of paid persons + d + number of active persons; wherein a, b, c and d are coefficients of a formula; the sum of the broadcasting duration, the number of watching people, the number of paying people and the number of active people are the live broadcasting room data of the target live broadcasting room. The second preset threshold may be set according to actual needs, or the recommendation score at the second name may be determined as the preset threshold according to the calculated recommendation score, so that the recommendation score of the current live broadcast room that is determined last is the highest. Specifically calculating the recommendation score of each target live broadcast room, then obtaining 2 or a current live broadcast room with the highest score, and placing the score with the highest score at a first position and placing the score with the highest score at a second position; or directly determining the recommendation score of the first name as a preset threshold value, and directly obtaining the current live broadcast room of the first name.
And finally, after the current live broadcast room is determined, the live broadcast room data of the current live broadcast room can be bound with the target user information for subsequent processes. In the method, the current live broadcast room is determined from the target live broadcast room through the live broadcast room data, so that the distribution efficiency of the live broadcast room is improved, and the interaction experience of a user is further improved.
In addition, it should be noted that, because the live broadcast room is live broadcast in real time, the target user may perform an interactive operation in the live broadcast room in real time, and therefore, when responding to the interactive operation performed by the target user for the live broadcast room, the live broadcast viewer side needs to send the interactive data to the live broadcast server side in real time, so as to ensure the real-time property of the target interactive data rendered to the next live broadcast room after the live broadcast room is switched. Specifically, the method comprises the following steps: the live broadcast server responds to the first interactive data of the target user from the live broadcast audience in the previous live broadcast room, and if the first interactive data of the target user from the live broadcast audience in the previous live broadcast room is received, the first interactive data received again is updated to the first interactive data received in history according to the preset data volume; the data volume of the first interactive data stored by the live broadcast server is smaller than the preset data volume; if the data volume of the first interactive data stored by the live broadcast server is greater than the preset data volume after the live broadcast server stores the first interactive data received again into the first interactive data received in history, the first interactive data received again needs to be updated into the first interactive data received in history, that is, the earliest received interactive data in the first interactive data received in history is deleted.
The live broadcast server receives interactive data sent by a live broadcast audience in real time, when the data volume of the first interactive data received by the server does not reach the preset data volume, the first interactive data is stored and received in real time, but when the data volume of the first interactive data received by the server reaches the preset data volume and the first interactive data is received again, the earliest received interactive data in the first interactive data needs to be deleted to ensure that the first interactive data stored by the server is smaller than or equal to the preset data volume. The preset data volume can be set according to actual needs. In addition, the server may also analyze the interactive data, and when the interactive operation of the target user is a certain function or a termination operation of the play (e.g., ending the lottery and closing the play page), the server may automatically discard all the interactive data associated with the interactive operation. And finally, obtaining the updated first interactive data, and secondly, determining target interactive data from the updated first interactive data.
In the above manner, the real-time property of the first interactive data is ensured by updating the first interactive data in real time, and meanwhile, the real-time property of the target interactive data is ensured, so that the interactive experience of the user is further improved.
An embodiment of the present invention further provides a method for switching a live broadcast room, where the method is applied to a live broadcast viewer, and as shown in fig. 2, the method includes:
step S202, responding to interactive operation aiming at the last live broadcast, generating target interactive data, sending the target interactive data to a live broadcast anchor terminal, and generating a second live broadcast picture of the current live broadcast after the last live broadcast is switched on the basis of the target interactive data through the live broadcast anchor terminal;
step S204, responding to the switching operation aiming at the previous live broadcasting room, and receiving a second live broadcasting picture from a live broadcasting anchor terminal; the second live broadcast picture comprises target interactive data;
step S206, based on the second live broadcast picture, the first live broadcast picture of the displayed last live broadcast room is switched to the second live broadcast picture of the current live broadcast room.
The embodiment of the invention provides a switching method of a live broadcast room, which is characterized in that target interactive data are generated in response to interactive operation aiming at a last live broadcast room, the target interactive data are sent to a live broadcast anchor terminal, and a second live broadcast picture of the current live broadcast room after the last live broadcast room is switched is generated through the live broadcast anchor terminal based on the target interactive data; responding to the switching operation aiming at the last live broadcast room, and receiving a second live broadcast picture from a live broadcast anchor terminal; the second live broadcast picture comprises target interactive data; and switching the displayed first live broadcast picture of the last live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience terminal, the live broadcast anchor terminal corresponding to the switched current live broadcast room can reserve and display the target interactive data in the last live broadcast room into the live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that the current function carrying link is not influenced, and the interactive experience of a user is improved.
After the step of responding to the switching operation between the last multicast, the method further includes: receiving a switching picture aiming at the current live broadcast room from a live broadcast anchor terminal; wherein the switching picture is determined by: acquiring first scene rendering data of a last live broadcast room and second scene rendering data of a current live broadcast room through a live broadcast anchor; generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data and the target interaction data; the fusion virtual scene comprises target interaction data; shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
In the above step of switching the displayed first live view of the last live view into the second live view of the current live view based on the second live view, a possible implementation manner is:
switching a first live-action picture of the last live-action to a switching picture in response to a switching start operation for the last live-action; the switching picture comprises target interactive data; and responding to the switching ending operation aiming at the last live broadcast, and switching the switching picture to a second live broadcast picture.
The switching start operation and the switching end operation need the live broadcast audience end to correspondingly control the process of playing the animation according to the completion degree of the user operation, and determine different switching states until the user completes the final switching; such as: sliding 50px is considered to be the final handover, if the user slides 25px, i.e. 1/2, and if the sliding threshold (e.g. 25 px) is exceeded, the final handover is considered to be completed.
In the above manner, through the switching operation of the user, at different switching times or positions, the first live broadcast picture of the previous live broadcast room is correspondingly and gradually switched to the switching picture, and then switched to the second scene picture, so that the effect of switching from the previous live broadcast room to the switching picture and then switching to the current live broadcast room is realized, and the immersive switching experience of the user is further improved.
Before the step of responding to the switching operation between the last-live broadcast, the method further includes:
receiving first data and shader data of a fusion virtual scene from a live broadcast server; the fusion virtual scene is generated through a live broadcast anchor terminal based on first scene rendering data of a previous live broadcast room, second scene rendering data of a current live broadcast room and target interaction data; the first data is generated by acquiring display information in a last direct broadcasting room in the current state through a direct broadcasting server, determining first data which is the same as the display information from target interactive data and marking the first data; the coloring data is generated by converting scene terrain information and scene illumination information into coloring data through a live broadcast server.
After the step of responding to the switching operation between the last direct broadcasting in the case that the first data and the shader data are received, the method further includes: hiding the first data displayed in the previous live broadcast room; and according to the coloring data, coloring the virtual live broadcast scene in the previous live broadcast room.
The implementation process of the above steps is the same as the implementation process described above with the live broadcast anchor as the execution subject, and is not described here again.
Corresponding to the above method embodiment, an embodiment of the present invention provides a switching device for a live broadcast room, where the device is disposed at a live broadcast anchor, and as shown in fig. 3, the device includes:
a data receiving module 31, configured to receive target interaction data from a live viewer; the target interactive data is generated by a live broadcast audience end responding to interactive operation aiming at a previous live broadcast room, and the target interactive data is used for reserving a current live broadcast room after switching to the previous live broadcast room;
a live broadcast picture generating module 32, configured to generate a second live broadcast picture of the current live broadcast room based on the target interactive data in response to receiving a switching instruction for the last live broadcast room from a live broadcast viewer; the second live broadcast picture comprises target interactive data;
and the live broadcast picture sending module 33 is configured to send the second live broadcast picture to the live broadcast viewer through the live broadcast server, so that the live broadcast viewer switches the displayed first live broadcast picture in the last live broadcast room to the second live broadcast picture in the current live broadcast room.
The embodiment of the invention provides a switching device of a live broadcast room, which receives target interactive data from a live broadcast audience end and is used for reserving a current live broadcast room after switching to a previous live broadcast room; responding to a received switching instruction aiming at the last live broadcast room from a live broadcast audience, and generating a second live broadcast picture of the current live broadcast room based on target interactive data; the second live broadcast picture comprises target interaction data; and sending the second live broadcast picture to a live broadcast audience, so that the live broadcast audience switches the displayed first live broadcast picture in the last live broadcast room into the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience end, the live broadcast anchor end corresponding to the switched current live broadcast room can reserve and display target interactive data in the last live broadcast room into a live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that a current function carrying link is not influenced, and the interactive experience of a user is improved.
The live broadcast picture generation module is further configured to: acquiring second scene rendering data of the current live broadcast room, and constructing a second virtual live broadcast scene of the current live broadcast room according to the second scene rendering data; setting a scene model corresponding to the target interactive data in a second virtual live broadcast scene; and shooting a range containing target interaction data in a second virtual live broadcast scene through the virtual camera to obtain a second live broadcast picture, wherein the virtual camera is arranged in the second virtual live broadcast scene.
The above-mentioned device still includes: the system comprises a fusion scene generation module, a live broadcast room generation module and a fusion scene generation module, wherein the fusion scene generation module is used for acquiring first scene rendering data of the last live broadcast room and second scene rendering data of the current live broadcast room; generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data and the target interaction data; the fusion virtual scene comprises target interaction data.
The above-mentioned device still includes: and the switching picture acquisition module is used for shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
The generation module of the fusion scene is further configured to: performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fusion virtual scene; and rendering the target interaction data to the initial fusion virtual scene to obtain the fusion virtual scene.
The generation module of the fusion scene is further configured to: acquiring target scene rendering data of a target virtual scene with similarity greater than a first preset threshold value in a first virtual live broadcast scene of a last live broadcast room and a second virtual live broadcast scene of a current live broadcast room from first scene rendering data and second scene rendering data; wherein the target scene rendering data comprises: scene element information, scene terrain information, scene illumination information, and post-processing information of the scene; and constructing an initial fusion virtual scene according to the target scene rendering data.
The generation module of the fusion scene is further configured to: analyzing the state information of the current target interactive data in the last live broadcasting room; wherein the state information at least comprises: the data type of the target interactive data and the position of the target interactive data in the virtual live broadcast scene; and setting a scene model corresponding to the target interactive data in the initial fusion virtual scene according to the state information to obtain a fusion virtual scene, so that the state of the target interactive data in the fusion virtual scene is consistent with the state of the target interactive data in the current live broadcast room.
The above-mentioned device still includes: a fused scene sending module, configured to: sending the fused virtual scene to a live broadcast server, processing the specified information in the fused virtual scene through the live broadcast server to obtain processed specified information, and sending the processed specified information to a live broadcast audience; wherein the specifying information includes: target interaction data, scene terrain information, and scene lighting information.
The sending module of the fusion scene is further configured to: the method comprises the steps that display information in a last direct broadcasting room in the current state is obtained through a direct broadcasting server, first data which are the same as the display information are determined from target interactive data, and the first data are marked; wherein the first data is for: at a live broadcast audience, responding to the switching operation aiming at the previous live broadcast room, and hiding the first data displayed in the previous live broadcast room; converting scene terrain information and scene illumination information into coloring data; wherein the shading data is for: and at the live broadcast audience, responding to the switching operation aiming at the last live broadcast room, and coloring the first virtual live broadcast scene of the last live broadcast room.
The target interactive data is determined by the following method: the method comprises the steps that first interactive data from a live audience terminal are received through a data determining module of a live broadcast server terminal, target interactive data are determined from the first interactive data according to the data type of the first interactive data, and the target interactive data are sent to a live broadcast anchor terminal.
The data determining module of the live broadcast server is further configured to: determining data with a data type capable of being rendered in the first interactive data as target interactive data; determining data matched with a preset template in the first interactive data as target interactive data according to the preset template; the preset template is used for extracting data reserved to the current live broadcast room.
The current live broadcast room is determined by the following method: responding to a received preprocessing instruction from a live audience end through a live broadcasting room determining module of a live broadcasting service end, acquiring live broadcasting room data of a last live broadcasting room, and determining a current live broadcasting room after the last live broadcasting room is switched according to the live broadcasting room data of the last live broadcasting room; wherein the preprocessing instruction is generated by the live audience end in response to the target user entering the last live room.
The live broadcasting room determining module of the live broadcasting server is further configured to: acquiring live broadcast room data of a live broadcast room to be distributed in a live broadcast state; and determining a target live broadcast room matched with the previous live broadcast room from the live broadcast rooms to be distributed according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast rooms to be distributed, and determining the target live broadcast room as the current live broadcast room.
The live broadcast room data of the previous live broadcast room includes: scene identification of a virtual live broadcast scene in a previous live broadcast room; live broadcast room data of a live broadcast room to be distributed comprises the following steps: scene identification of a virtual live broadcast scene of a live broadcast room to be distributed; the live broadcasting room determining module of the live broadcasting server is further configured to: and determining a target live broadcast room matched with the virtual live broadcast scene of the last live broadcast room from the live broadcast rooms to be distributed according to the scene identification.
The target live broadcast rooms comprise a plurality of target live broadcast rooms; live broadcast room data of a live broadcast room to be distributed comprises the following steps: live broadcast duration and audience data; the live broadcast room determining module of the live broadcast server is further configured to: calculating a recommendation score of a target live broadcast room according to a preset calculation formula, and live broadcast duration and audience data of a to-be-distributed live broadcast room; and determining the target live broadcast room with the recommendation score meeting a second preset threshold as the current live broadcast room.
Corresponding to the above method embodiment, an embodiment of the present invention provides a switching device for a live broadcast room, where the device is disposed at a live broadcast viewer end, and as shown in fig. 4, the device includes:
a data sending module 41, configured to respond to an interactive operation for a last live broadcast room, generate target interactive data, send the target interactive data to a live broadcast anchor, and generate, through the live broadcast anchor and based on the target interactive data, a second live broadcast picture of a current live broadcast room after the last live broadcast room is switched;
a live frame receiving module 42, configured to receive a second live frame from the live anchor in response to a switching operation for the last live room; the second live broadcast picture comprises target interactive data;
and a live broadcast picture switching module 43, configured to switch the displayed first live broadcast picture in the last live broadcast room to a second live broadcast picture in the current live broadcast room based on the second live broadcast picture.
The embodiment of the invention provides a switching device of a live broadcast room, which responds to the interactive operation aiming at the last live broadcast room, generates target interactive data, sends the target interactive data to a live broadcast anchor terminal, and generates a second live broadcast picture of the current live broadcast room after the last live broadcast room is switched on the basis of the target interactive data through the live broadcast anchor terminal; responding to the switching operation aiming at the last live broadcast room, and receiving a second live broadcast picture from a live broadcast anchor terminal; the second live broadcast picture comprises target interactive data; and switching the displayed first live broadcast picture of the last live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture. In the mode, when the switching operation is carried out on the last live broadcast room displayed by the audience terminal, the live broadcast anchor terminal corresponding to the switched current live broadcast room can reserve and display the target interactive data in the last live broadcast room into the live broadcast picture of the current live broadcast room, so that the switching of the immersive live broadcast room is completed under the condition that the current function carrying link is not influenced, and the interactive experience of a user is improved.
The device further comprises a receiving module for switching pictures, and is used for: receiving a switching picture aiming at a current live broadcast room from a live broadcast anchor terminal; wherein the switching picture is determined by: acquiring first scene rendering data of a last live broadcast room and second scene rendering data of a current live broadcast room through a live broadcast anchor; generating a fusion virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data; the fusion virtual scene comprises target interaction data; shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene to acquire a switching picture aiming at the current live broadcast room.
The switching module of the live broadcast picture is further configured to: switching a first live-action picture of the last live-action to a switching picture in response to a switching start operation for the last live-action; the switching picture comprises target interaction data; and responding to the switching ending operation aiming at the last live broadcast, and switching the switching picture to a second live broadcast picture.
The apparatus further comprises a data receiving module configured to: receiving first data and shader data of a fusion virtual scene from a live broadcast server; the fusion virtual scene is generated through a live broadcast anchor terminal based on first scene rendering data of a previous live broadcast room, second scene rendering data of a current live broadcast room and target interaction data; the first data are generated by acquiring display information in a last live broadcasting room in a current state through a live broadcasting server, determining first data which are the same as the display information from target interactive data and marking the first data; the coloring data is generated by converting scene terrain information and scene illumination information into coloring data through a live broadcast server.
The apparatus further comprises a data processing module configured to: hiding the first data displayed in the previous live broadcast room; and according to the coloring data, coloring the virtual live broadcast scene in the previous live broadcast room.
The switching device of the live broadcast room provided by the embodiment has the same technical characteristics as the switching method of the live broadcast room provided by the embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.
The embodiment also provides an electronic device, which comprises a processor and a memory, wherein the memory stores computer-executable instructions capable of being executed by the processor, and the processor executes the computer-executable instructions to implement the method for switching the live broadcast. The electronic device may be a server or a terminal device.
Referring to fig. 5, the electronic device includes a processor 100 and a memory 101, where the memory 101 stores computer-executable instructions capable of being executed by the processor 100, and the processor 100 executes the computer-executable instructions to implement the above-mentioned live broadcast switching method.
Further, the electronic device shown in fig. 5 further includes a bus 102 and a communication interface 103, and the processor 100, the communication interface 103 and the memory 101 are connected through the bus 102.
The Memory 101 may include a high-speed Random Access Memory (RAM) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 103 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used. The bus 102 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 5, but this does not indicate only one bus or one type of bus.
The present embodiments also provide a computer-readable storage medium storing computer-executable instructions that, when invoked and executed by a processor, cause the processor to implement the above-described live room switching method.
The method, apparatus, electronic device, and computer program product for switching a live broadcast provided in the embodiments of the present invention include a computer-readable storage medium storing program codes, where instructions included in the program codes may be used to execute the method described in the foregoing method embodiments, and specific implementation may refer to the method embodiments, which are not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as being fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in a specific case to those skilled in the art.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplification of description, but do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that the following embodiments are merely illustrative of the present invention, and not restrictive, and the scope of the present invention is not limited thereto: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (24)
1. A switching method of a live broadcast room is characterized in that the method is applied to a live broadcast anchor terminal, and the method comprises the following steps:
receiving target interactive data from a live audience; the target interactive data is generated by the live broadcast audience end responding to interactive operation aiming at a last live broadcast room, and the target interactive data is used for reserving the current live broadcast room after being switched to the last live broadcast room;
in response to receiving a switching instruction aiming at the previous live broadcast room from the live broadcast audience, generating a second live broadcast picture of the current live broadcast room based on the target interaction data; wherein the second live broadcast picture comprises the target interaction data;
and sending the second live broadcast picture to the live broadcast audience through a live broadcast server, so that the live broadcast audience switches the displayed first live broadcast picture of the previous live broadcast room into a second live broadcast picture of the current live broadcast room.
2. The method of claim 1, wherein the step of generating a second live view of the current live view based on the target interaction data in response to receiving a switch instruction from the live viewer for the previous live view comprises:
acquiring second scene rendering data of the current live broadcast room, and constructing a second virtual live broadcast scene of the current live broadcast room according to the second scene rendering data;
setting a scene model corresponding to the target interaction data in the second virtual live broadcast scene;
shooting a range containing the target interaction data in the second virtual live broadcast scene through a virtual camera to obtain a second live broadcast picture, wherein the virtual camera is arranged in the second virtual live broadcast scene.
3. The method as claimed in claim 1, wherein prior to the step of generating a second live view of the current live room based on the target interaction data in response to receiving a switch instruction from the live viewer for the last live room, the method further comprises:
acquiring first scene rendering data of the previous live broadcast room and second scene rendering data of the current live broadcast room;
generating a fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data; and the fusion virtual scene comprises the target interaction data.
4. The method of claim 3, wherein after the step of responding to receiving the switching instruction for the last live broadcast room from the live viewer, the method further comprises:
shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene, and acquiring a switching picture aiming at the current live broadcast room.
5. The method of claim 3, wherein generating a fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data comprises:
performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fusion virtual scene;
rendering the target interaction data to the initial fusion virtual scene to obtain the fusion virtual scene.
6. The method according to claim 5, wherein the step of performing fusion processing on the first scene rendering data and the second scene rendering data to generate an initial fused virtual scene comprises:
acquiring target scene rendering data of a target virtual scene with similarity greater than a first preset threshold in a first virtual live broadcast scene of the last live broadcast room and a second virtual live broadcast scene of the current live broadcast room from the first scene rendering data and the second scene rendering data; wherein the target scene rendering data comprises: scene element information, scene terrain information, scene illumination information, and post-processing information of the scene;
and constructing the initial fusion virtual scene according to the target scene rendering data.
7. The method of claim 5, wherein the step of rendering the target interaction data into the initial fused virtual scene to obtain the fused virtual scene comprises:
analyzing the state information of the current target interactive data in the last direct broadcasting room; wherein the status information at least comprises: the data type of the target interactive data and the position of the target interactive data in a virtual live broadcast scene;
and setting a scene model corresponding to the target interactive data in the initial fusion virtual scene according to the state information to obtain the fusion virtual scene, so that the state of the target interactive data in the fusion virtual scene is consistent with the state of the target interactive data in the current live broadcast room.
8. The method of claim 3, wherein after the step of generating a fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data, the method further comprises:
sending the fused virtual scene to a live broadcast server, processing the specified information in the fused virtual scene through the live broadcast server to obtain the processed specified information, and sending the processed specified information to the live broadcast audience; wherein the specifying information includes: the target interaction data, scene terrain information and scene illumination information.
9. The method as claimed in claim 8, wherein the step of processing the specified data in the merged virtual scene by the live broadcast service end to obtain the processed specified data includes:
acquiring display information in the previous live broadcast room in the current state through the live broadcast server, determining first data which are the same as the display information from the target interactive data, and marking the first data; wherein the first data is to: at the live viewer end, responding to the switching operation aiming at the previous live broadcast room, and hiding the first data displayed in the previous live broadcast room;
converting the scene terrain information and the scene illumination information into coloring data; wherein the shading data is for: and at the live broadcasting audience end, responding to the switching operation aiming at the last live broadcasting room, and performing coloring processing on the first virtual live broadcasting scene of the last live broadcasting room.
10. The method of claim 1, wherein the target interaction data is determined by:
receiving first interactive data from a live audience through the live broadcast server, determining target interactive data from the first interactive data according to the data type of the first interactive data, and sending the target interactive data to the live broadcast anchor.
11. The method of claim 10, wherein the step of determining the target interaction data from the first interaction data according to the data type of the first interaction data comprises:
determining data of which the data type is renderable in the first interaction data as the target interaction data;
determining data matched with a preset template in the first interactive data as the target interactive data according to the preset template; the preset template is used for extracting data reserved to the current live broadcast room.
12. The method of claim 1, wherein the current live room is determined by:
through the live broadcast server, responding to a received preprocessing instruction from a live broadcast audience, acquiring live broadcast room data of the previous live broadcast room, and determining the current live broadcast room after the previous live broadcast room is switched according to the live broadcast room data of the previous live broadcast room; wherein the pre-processing instructions are generated by the live viewer in response to a target user entering the last live room.
13. The method of claim 12, wherein the step of determining the current live room to be distributed after the last live room switch according to the live room data of the last live room comprises:
acquiring live broadcast room data of a live broadcast room to be distributed in a live broadcast state;
and according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast room to be distributed, determining a target live broadcast room matched with the previous live broadcast room from the live broadcast room to be distributed, and determining the target live broadcast room as the current live broadcast room.
14. The method of claim 13, wherein the live-room data of the last live room comprises: scene identification of the virtual live broadcast scene in the previous live broadcast room; the live broadcast room data of the live broadcast room to be distributed comprises the following steps: scene identification of the virtual live broadcast scene of the live broadcast room to be distributed;
according to the live broadcast room data of the previous live broadcast room and the live broadcast room data of the live broadcast room to be distributed, determining a target live broadcast room matched with the previous live broadcast room from the live broadcast room to be distributed, wherein the step comprises the following steps:
and determining a target live broadcast room matched with the virtual live broadcast scene of the previous live broadcast room from the live broadcast rooms to be distributed according to the scene identification.
15. The method of claim 13, wherein the target live broadcast room comprises a plurality of; the live broadcast room data of the live broadcast room to be distributed comprises the following steps: live broadcast duration and audience data;
the method further comprises the following steps:
calculating a recommendation score of the target live broadcast room according to a preset calculation formula, the live broadcast duration of the live broadcast room to be distributed and audience data; and determining the target live broadcast room with the recommendation score meeting a second preset threshold as the current live broadcast room.
16. A switching method of a live broadcast room is characterized in that the method is applied to a live broadcast audience, and the method comprises the following steps:
responding to interactive operation aiming at a previous live broadcast room, generating target interactive data, sending the target interactive data to a live broadcast anchor terminal, and generating a second live broadcast picture of the current live broadcast room after the previous live broadcast room is switched based on the target interactive data through the live broadcast anchor terminal;
responding to the switching operation aiming at the last live broadcast room, and receiving a second live broadcast picture from the live broadcast anchor terminal; wherein the second live broadcast picture comprises the target interaction data;
and switching the displayed first live broadcast picture of the previous live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture.
17. The method of claim 16, wherein after the step of responding to the switch operation for the last live broadcast, the method further comprises:
receiving a switching picture aiming at the current live broadcast room from the live broadcast anchor terminal; wherein the switching picture is determined by:
acquiring first scene rendering data of the last live broadcast room and second scene rendering data of the current live broadcast room through the live broadcast anchor terminal; generating a fused virtual scene based on the first scene rendering data, the second scene rendering data, and the target interaction data; the fusion virtual scene comprises the target interaction data; shooting the fusion virtual scene through a virtual camera arranged in the fusion virtual scene, and acquiring a switching picture aiming at the current live broadcast room.
18. The method of claim 17, wherein switching the displayed first live view of the previous live view to the second live view of the current live view based on the second live view comprises:
responding to the switching starting operation aiming at the previous live broadcast room, and switching the first live broadcast picture of the previous live broadcast room into the switching picture; the switching picture comprises the target interactive data;
and responding to the switching ending operation aiming at the last live broadcast room, and switching the switching picture to the second live broadcast picture.
19. The method of claim 16, wherein prior to the step of responding to the inter-unicast handover operation, the method further comprises:
receiving first data and shader data of a fusion virtual scene from a live broadcast server;
the fusion virtual scene is generated through the live broadcast anchor terminal based on first scene rendering data of the previous live broadcast room, second scene rendering data of the current live broadcast room and the target interaction data;
the first data are generated by acquiring display information in the last live broadcast room in the current state through the live broadcast server, determining first data which are the same as the display information from the target interactive data and marking the first data; and the coloring data is generated by converting the scene terrain information and the scene illumination information into coloring data through the live broadcast server.
20. The method of claim 19, wherein after the step of responding to the inter-unicast handover operation, the method further comprises:
hiding the first data displayed in the last live broadcast room; and according to the coloring data, coloring the virtual live broadcast scene of the last live broadcast room.
21. A switching device of a live broadcasting room, wherein the device is arranged at a live broadcasting anchor end, the device comprises:
the data receiving module is used for receiving target interactive data from a live audience; the target interactive data is generated by the live broadcast audience end responding to interactive operation aiming at a last live broadcast room, and the target interactive data is used for reserving the current live broadcast room after being switched to the last live broadcast room;
a live broadcast picture generation module, configured to generate a second live broadcast picture of the current live broadcast room based on the target interaction data in response to receiving a switching instruction for the previous live broadcast room from the live broadcast viewer; wherein the second live broadcast picture comprises the target interaction data;
and the live broadcast picture sending module is used for sending the second live broadcast picture to the live broadcast audience through the live broadcast server, so that the live broadcast audience switches the displayed first live broadcast picture of the previous live broadcast room into the second live broadcast picture of the current live broadcast room.
22. A switching device of a live broadcast room, wherein the device is arranged at a live broadcast audience, the device comprises:
the data sending module is used for responding to interactive operation aiming at a previous live broadcast room, generating target interactive data, sending the target interactive data to a live broadcast anchor terminal, and generating a second live broadcast picture of the current live broadcast room after the previous live broadcast room is switched through the live broadcast anchor terminal based on the target interactive data;
a live broadcast picture receiving module, configured to receive a second live broadcast picture from the live broadcast anchor terminal in response to a switching operation for the previous live broadcast room; wherein the second live view comprises the target interaction data;
and the live broadcast picture switching module is used for switching the displayed first live broadcast picture of the previous live broadcast room into a second live broadcast picture of the current live broadcast room based on the second live broadcast picture.
23. An electronic device comprising a processor and a memory, the memory storing computer-executable instructions executable by the processor, the processor executing the computer-executable instructions to implement the method of switching between live broadcasts of any of claims 1-15 or to implement the method of switching between live broadcasts of any of claims 16-20.
24. A computer-readable storage medium having computer-executable instructions stored thereon, which when invoked and executed by a processor, cause the processor to implement the method of switching between live broadcasts of any of claims 1-15, or to implement the method of switching between live broadcasts of any of claims 16-20.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210522301.5A CN115190321B (en) | 2022-05-13 | 2022-05-13 | Live broadcast room switching method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210522301.5A CN115190321B (en) | 2022-05-13 | 2022-05-13 | Live broadcast room switching method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115190321A true CN115190321A (en) | 2022-10-14 |
| CN115190321B CN115190321B (en) | 2024-06-04 |
Family
ID=83513892
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210522301.5A Active CN115190321B (en) | 2022-05-13 | 2022-05-13 | Live broadcast room switching method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115190321B (en) |
Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101183276A (en) * | 2007-12-13 | 2008-05-21 | 上海交通大学 | Interactive system based on CCD camera porjector technology |
| CN106293355A (en) * | 2015-05-11 | 2017-01-04 | 腾讯科技（深圳）有限公司 | The method and apparatus that instant messaging window shows |
| CN106371834A (en) * | 2016-08-30 | 2017-02-01 | 广州新博庭网络信息科技股份有限公司 | Method and device for displaying bullet screen data |
| CN107135146A (en) * | 2017-04-27 | 2017-09-05 | 腾讯科技（深圳）有限公司 | The display methods and device of information |
| CN109754454A (en) * | 2019-01-30 | 2019-05-14 | 腾讯科技（深圳）有限公司 | Rendering method, device, storage medium and the equipment of object model |
| CN109982096A (en) * | 2017-12-27 | 2019-07-05 | 艾迪普（北京）文化科技股份有限公司 | 360 ° of VR content broadcast control systems of one kind and method |
| CN110162371A (en) * | 2019-05-24 | 2019-08-23 | 网易（杭州）网络有限公司 | Display control method and device, electronic equipment and storage medium |
| CN110391969A (en) * | 2019-06-06 | 2019-10-29 | 浙江口碑网络技术有限公司 | Based on multimedia chat method and device, storage medium, electronic device |
| CN111162992A (en) * | 2019-12-25 | 2020-05-15 | 广州市百果园信息技术有限公司 | Interactive mode switching method, device, equipment and storage medium |
| CN111447457A (en) * | 2020-03-25 | 2020-07-24 | 咪咕文化科技有限公司 | Live video processing method and device and storage medium |
| CN111464818A (en) * | 2020-03-20 | 2020-07-28 | 新之航传媒集团有限公司 | Online live broadcast exhibition hall system |
| CN111541932A (en) * | 2020-04-30 | 2020-08-14 | 广州华多网络科技有限公司 | User image display method, device, equipment and storage medium for live broadcast room |
| CN111866539A (en) * | 2020-07-31 | 2020-10-30 | 广州繁星互娱信息科技有限公司 | Live broadcast interface switching method and device, terminal and storage medium |
| CN112312223A (en) * | 2020-04-30 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN112533002A (en) * | 2020-11-17 | 2021-03-19 | 南京邮电大学 | Dynamic image fusion method and system for VR panoramic live broadcast |
| CN112738633A (en) * | 2020-12-25 | 2021-04-30 | 广州繁星互娱信息科技有限公司 | Video playing method, device, equipment and readable storage medium |
| CN112866627A (en) * | 2019-11-28 | 2021-05-28 | 上海华为技术有限公司 | Three-dimensional video monitoring method and related equipment |
| CN113422986A (en) * | 2021-06-17 | 2021-09-21 | 北京百度网讯科技有限公司 | Method, apparatus, device, medium, and program product for live room recommendation |
| CN113781660A (en) * | 2021-09-04 | 2021-12-10 | 上海白兔网络科技有限公司 | Method and device for rendering and processing virtual scene on line in live broadcast room |
| CN113873274A (en) * | 2021-09-08 | 2021-12-31 | 深圳市尤珂网络技术有限公司 | Live broadcast heat prediction method, device, equipment and storage medium |
| CN114202576A (en) * | 2021-12-13 | 2022-03-18 | 广州博冠信息科技有限公司 | Virtual scene processing method and device, storage medium and electronic equipment |
-
2022
- 2022-05-13 CN CN202210522301.5A patent/CN115190321B/en active Active
Patent Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101183276A (en) * | 2007-12-13 | 2008-05-21 | 上海交通大学 | Interactive system based on CCD camera porjector technology |
| CN106293355A (en) * | 2015-05-11 | 2017-01-04 | 腾讯科技（深圳）有限公司 | The method and apparatus that instant messaging window shows |
| CN106371834A (en) * | 2016-08-30 | 2017-02-01 | 广州新博庭网络信息科技股份有限公司 | Method and device for displaying bullet screen data |
| CN107135146A (en) * | 2017-04-27 | 2017-09-05 | 腾讯科技（深圳）有限公司 | The display methods and device of information |
| CN109982096A (en) * | 2017-12-27 | 2019-07-05 | 艾迪普（北京）文化科技股份有限公司 | 360 ° of VR content broadcast control systems of one kind and method |
| CN109754454A (en) * | 2019-01-30 | 2019-05-14 | 腾讯科技（深圳）有限公司 | Rendering method, device, storage medium and the equipment of object model |
| CN110162371A (en) * | 2019-05-24 | 2019-08-23 | 网易（杭州）网络有限公司 | Display control method and device, electronic equipment and storage medium |
| CN110391969A (en) * | 2019-06-06 | 2019-10-29 | 浙江口碑网络技术有限公司 | Based on multimedia chat method and device, storage medium, electronic device |
| CN112866627A (en) * | 2019-11-28 | 2021-05-28 | 上海华为技术有限公司 | Three-dimensional video monitoring method and related equipment |
| CN111162992A (en) * | 2019-12-25 | 2020-05-15 | 广州市百果园信息技术有限公司 | Interactive mode switching method, device, equipment and storage medium |
| CN111464818A (en) * | 2020-03-20 | 2020-07-28 | 新之航传媒集团有限公司 | Online live broadcast exhibition hall system |
| CN111447457A (en) * | 2020-03-25 | 2020-07-24 | 咪咕文化科技有限公司 | Live video processing method and device and storage medium |
| CN111541932A (en) * | 2020-04-30 | 2020-08-14 | 广州华多网络科技有限公司 | User image display method, device, equipment and storage medium for live broadcast room |
| CN112312223A (en) * | 2020-04-30 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN111866539A (en) * | 2020-07-31 | 2020-10-30 | 广州繁星互娱信息科技有限公司 | Live broadcast interface switching method and device, terminal and storage medium |
| CN112533002A (en) * | 2020-11-17 | 2021-03-19 | 南京邮电大学 | Dynamic image fusion method and system for VR panoramic live broadcast |
| CN112738633A (en) * | 2020-12-25 | 2021-04-30 | 广州繁星互娱信息科技有限公司 | Video playing method, device, equipment and readable storage medium |
| CN113422986A (en) * | 2021-06-17 | 2021-09-21 | 北京百度网讯科技有限公司 | Method, apparatus, device, medium, and program product for live room recommendation |
| CN113781660A (en) * | 2021-09-04 | 2021-12-10 | 上海白兔网络科技有限公司 | Method and device for rendering and processing virtual scene on line in live broadcast room |
| CN113873274A (en) * | 2021-09-08 | 2021-12-31 | 深圳市尤珂网络技术有限公司 | Live broadcast heat prediction method, device, equipment and storage medium |
| CN114202576A (en) * | 2021-12-13 | 2022-03-18 | 广州博冠信息科技有限公司 | Virtual scene processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115190321B (en) | 2024-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110602554B (en) | Cover image determining method, device and equipment | |
| CN106303354B (en) | Face special effect recommendation method and electronic equipment | |
| CN108737882B (en) | Image display method, image display device, storage medium and electronic device | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| CN111246232A (en) | Live broadcast interaction method and device, electronic equipment and storage medium | |
| CN111970532B (en) | Video playing method, device and equipment | |
| CN108134945B (en) | AR service processing method, AR service processing device and terminal | |
| CN108109161B (en) | Video data real-time processing method and device based on self-adaptive threshold segmentation | |
| CN110288534B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN112752116A (en) | Display method, device, terminal and storage medium of live video picture | |
| CN110266955B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| CN114095744B (en) | Video live broadcast method and device, electronic equipment and readable storage medium | |
| CN108111911B (en) | Video data real-time processing method and device based on self-adaptive tracking frame segmentation | |
| US12034996B2 (en) | Video playing method, apparatus and device, storage medium, and program product | |
| US11141665B2 (en) | Method of determining exciting moments in a game video and method of playing a game video | |
| CN113840049A (en) | Image processing method, video flow scene switching method, device, equipment and medium | |
| CN115225923B (en) | Method and device for rendering gift special effects, electronic equipment and live broadcast server | |
| CN106161988A (en) | A kind of augmented reality video generation method | |
| CN112843735B (en) | Game picture shooting method, device, equipment and storage medium | |
| CN109660714A (en) | Image processing method, device, equipment and storage medium based on AR | |
| CN114390193B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN113473207A (en) | Live broadcast method and device, storage medium and electronic equipment | |
| CN112422844A (en) | Method, device and equipment for adding special effect in video and readable storage medium | |
| CN113573090A (en) | Content display method, device and system in game live broadcast and storage medium | |
| CN114598919B (en) | Video processing method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |