CN112153409B - Live broadcast method and device, live broadcast receiving end and storage medium - Google Patents
Live broadcast method and device, live broadcast receiving end and storage medium Download PDFInfo
- Publication number
- CN112153409B CN112153409B CN202011054315.6A CN202011054315A CN112153409B CN 112153409 B CN112153409 B CN 112153409B CN 202011054315 A CN202011054315 A CN 202011054315A CN 112153409 B CN112153409 B CN 112153409B
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- target
- receiving end
- live
- broadcast receiving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
Abstract
The application provides a live broadcast method, a live broadcast device, a live broadcast receiving end and a storage medium, and relates to the technical field of internet. The live broadcast receiving end responds to the received small window playing request to extract a target live broadcast object in the live broadcast code stream and displays the target live broadcast object on a display interface of the live broadcast receiving end, so that the live broadcast receiving end only displays the target live broadcast object on the display interface of the live broadcast receiving end in the process of executing the small window playing mode, other contents except the target live broadcast object in the live broadcast code stream are not displayed, the picture area occupied by the live broadcast content of the live broadcast receiving end in the display interface in the small window playing mode is reduced, and the area for user operation is increased.
Description
Technical Field
The application relates to the technical field of internet, in particular to a live broadcast method and device, a live broadcast receiving end and a storage medium.
Background
In a scene such as network live broadcast, a user can utilize a live broadcast mode such as small window broadcast, and a terminal interface at the user side displays a live broadcast picture in a small window broadcast area by setting a small window broadcast area. Therefore, even if the terminal interface of the user side is switched to other display interfaces from the live broadcast interface, the live broadcast can be normally watched.
However, in a scene such as displaying a live view using a small window playing area, a region with more display interfaces of the terminal needs to be occupied, which reduces the region of the display interface available for user operation.
Disclosure of Invention
The application aims to provide a live broadcast method, a live broadcast device, a live broadcast receiving end and a storage medium, which can reduce the picture area occupied by the live broadcast content of the live broadcast receiving end in a display interface in a small window playing mode, thereby increasing the area available for user operation.
In order to achieve the purpose, the technical scheme adopted by the application is as follows:
in a first aspect, the present application provides a live broadcasting method, which is applied to a live broadcasting receiving end; the method comprises the following steps:
responding to a received small window playing request, and extracting a target live broadcasting object in a live broadcasting code stream;
and displaying the target live broadcast object on a display interface of the live broadcast receiving end.
In a second aspect, the present application provides a live broadcasting apparatus, which is applied to a live broadcasting receiving end; the device comprises:
the processing module is used for responding to the received small window playing request and extracting a target live broadcast object in the live broadcast code stream;
and the display module is used for displaying the target live broadcast object on a display interface of the live broadcast receiving end.
In a third aspect, the present application provides a live broadcast receiving end, where the live broadcast receiving end includes a memory for storing one or more programs; a processor; the one or more programs, when executed by the processor, implement the live method described above.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the live method described above.
According to the live broadcast method, the device, the live broadcast receiving end and the storage medium, the live broadcast receiving end extracts a target live broadcast object in a live broadcast code stream by responding to a received small window play request, and displays the target live broadcast object on a display interface of the live broadcast receiving end, so that the live broadcast receiving end only displays the target live broadcast object on the display interface of the live broadcast receiving end in the process of executing a small window play mode, other contents except the target live broadcast object in the live broadcast code stream are not displayed, the picture area occupied by the live broadcast content of the live broadcast receiving end in the display interface in the small window play mode is reduced, and therefore the area for user operation is increased.
In order to make the aforementioned objects, features and advantages of the present application comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly explain the technical solutions of the present application, the drawings needed for the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also derive other related drawings from these drawings without inventive effort.
Fig. 1 is a schematic view illustrating an interactive scene of a live broadcast system provided in the present application;
FIG. 2 is a diagram illustrating a small window play mode;
fig. 3 shows a schematic structural block diagram of a live broadcast receiving end provided in the present application;
FIG. 4 illustrates an exemplary flow chart of a live method provided by the present application;
FIG. 5 is a diagram illustrating another widget playback mode;
FIG. 6 illustrates another exemplary flow chart of a live method provided herein;
fig. 7 is a schematic diagram illustrating an operation performed on a target live object according to a target operation instruction;
fig. 8 shows an exemplary structural block diagram of a live device provided by the present application.
In the figure: 100-a live broadcast receiving end; 101-a memory; 102-a processor; 103-a memory controller; 104-peripheral interfaces; 105-a radio frequency unit; 106-communication bus/signal line; 107-a display unit; 300-a live device; 301-a processing module; 302-display module.
Detailed Description
To make the objects, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described clearly and completely in the following with reference to the accompanying drawings in some embodiments of the present application, and it is obvious that the described embodiments are some, but not all embodiments of the present application. The components of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, as presented in the figures, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. Based on the embodiments in this application, all other embodiments that can be obtained by a person skilled in the art without making any creative effort belong to the protection scope of this application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments and features of the embodiments described below can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic view illustrating an interactive scene of a live broadcast system provided in the present application, which may be a live broadcast platform for live broadcast such as internet in some embodiments. The live broadcast system can comprise a server, a live broadcast initiating terminal and a live broadcast receiving terminal, wherein the server can be communicated with the live broadcast receiving terminal and the live broadcast initiating terminal respectively, and the server can provide live broadcast service for the live broadcast receiving terminal and the live broadcast initiating terminal. For example, the anchor may provide a live stream online in real time to the viewer through the live initiator and transmit the live stream to the server, and the live receiver may pull the live stream from the server for online viewing or playback.
In some implementations, the live receiver and the live initiator may be used interchangeably. For example, a anchor of a live originator may use the live originator to provide live video services to viewers, or as viewers to view live video provided by other anchors. For another example, a viewer at a live receiver may also use the live receiver to watch live video provided by a concerned anchor, or serve as the anchor to provide live video services to other viewers.
In some embodiments, the live receiver and the live initiator may include, but are not limited to, a mobile device, a tablet computer, a laptop computer, or any combination of two or more thereof. In some embodiments, the mobile device may include, but is not limited to, a wearable device, a smart mobile device, an augmented reality device, and the like, or any combination thereof. In some embodiments, the smart mobile device may include, but is not limited to, a smartphone, a Personal Digital Assistant (PDA), a gaming device, a navigation device, or a point of sale (POS) device, or the like, or any combination thereof.
In addition, in some possible embodiments, there may be zero, one, or more live receivers and live initiators, only one of which is shown in fig. 1, accessing the server. The live broadcast receiving end and the live broadcast initiating end can be provided with internet products for providing internet live broadcast services, for example, the internet products can be application programs APP, Web webpages, applets and the like used in a computer or a smart phone and related to the internet live broadcast services.
In some embodiments, the server may be a single physical server or a server group consisting of a plurality of physical servers for performing different data processing functions. The set of servers can be centralized or distributed (e.g., the servers can be a distributed system). In some possible embodiments, such as where the server employs a single physical server, the physical server may be assigned different logical server components based on different live service functions.
It will be appreciated that the live system shown in fig. 1 is only one possible example, and that in other possible embodiments of the present application, the live system may also include only some of the components shown in fig. 1 or may also include other components.
In a live broadcast scene shown in fig. 1, for example, a user at a live broadcast receiving end may input a small window play request to a live broadcast receiving end and select a small window play mode to watch live broadcast in combination with some live broadcast requirements in a process of watching the live broadcast; correspondingly, when receiving a small window playing request input by a user, the live broadcast receiving end can create a small window playing area as illustrated in fig. 2 in a display interface of the live broadcast receiving end, and play a live broadcast code stream in the small window playing area; therefore, even if a user operates the live broadcast receiving end, the display interface of the live broadcast receiving end is switched to other interfaces from the live broadcast interface, for example, the display interface is switched to a live broadcast room selection interface or interfaces of other application programs, the live broadcast receiving end can also play live broadcast code streams through the set small window playing area, and the user can watch live broadcast in the process of flexibly switching the content of the display interface.
In the above live broadcast scheme, for example, when a live broadcast receiving end performs live broadcast by using a set small window broadcast area, a live broadcast picture in a live broadcast code stream is generally displayed completely; taking live character broadcasting as an example, the content in the small window playing area may include not only the character portrait of the anchor broadcast, but also other content such as live background, which results in occupying a region with more display interfaces at the live broadcast receiving end in the process of playing the live broadcast code stream by using the small window playing area, and thus reducing the region of the display interfaces for user operation.
For this reason, based on some defects of the foregoing implementation, some possible implementations provided by the present application are: the live broadcast receiving end extracts a target live broadcast object in a live broadcast code stream by responding to a received small window play request and displays the target live broadcast object on a display interface of the live broadcast receiving end, so that the live broadcast receiving end only displays the target live broadcast object on the display interface of the live broadcast receiving end in the process of executing a small window play mode and does not display other contents except the target live broadcast object in the live broadcast code stream.
Referring to fig. 3, fig. 3 is a schematic block diagram illustrating a direct broadcast receiving end 100 provided in the present application, and in an embodiment, the direct broadcast receiving end 100 may be, but is not limited to, a smart phone, a Personal Computer (PC), a tablet computer, a Personal Digital Assistant (PDA), and the like.
In some embodiments, the live receiver 100 may include a memory 101, one or more (only one shown) processors 102, a memory controller 103, a peripheral interface 104, a radio unit 105, a display unit 107, and the like. These components communicate with one another via one or more communication buses/signal lines 106.
The memory 101 may be configured to store software programs and modules, such as program instructions/modules corresponding to the live broadcast apparatus provided in the present application, and the processor 102 executes various functional applications and image processing by operating the software programs and modules stored in the memory 101, so as to implement the live broadcast method provided in the present application.
The Memory 101 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), and the like.
The processor 102 may be an integrated circuit chip having signal processing capabilities. The Processor 102 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), a voice Processor, a video Processor, and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The various methods, steps, and logic blocks disclosed in some embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor 102 may be any conventional processor or the like.
The peripheral interface 104 may couple various input/output devices to the processor 102 as well as to the memory 101. In some embodiments, peripheral interface 104, processor 102, and memory controller 103 may be implemented in a single chip. In other embodiments of the present application, they may be implemented by separate chips.
The rf unit 105 may be configured to receive and transmit electromagnetic waves, so as to achieve interconversion between the electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices.
The display unit 107 may be configured to provide a graphical output interface for a user to display image information for the user to view a live view.
It is to be understood that the structure shown in fig. 3 is merely illustrative, and the live receiver 100 may also include more or fewer components than shown in fig. 3, or have a different configuration than shown in fig. 3. The components shown in fig. 3 may be implemented in hardware, software, or a combination thereof.
The live broadcast receiving end 100 shown in fig. 3 is taken as an exemplary execution subject to exemplarily explain the live broadcast method provided by the present application.
Referring to fig. 4, fig. 4 shows an exemplary flowchart of a live broadcasting method provided by the present application, and in some embodiments, the live broadcasting method may include the following steps:
And 203, displaying the target live broadcast object on a display interface of a live broadcast receiving end.
In some embodiments, during the process of watching the live broadcast by using the live broadcast receiving terminal, the user may send a small window play request to the live broadcast receiving terminal, where the small window play request may be used to instruct the live broadcast receiving terminal to play the received live broadcast code stream in a small window play mode.
In the implementation scheme of the above example, when the live broadcast receiving end receives the widget play request, the scheme shown in fig. 2 may be adopted, for example, to play the live broadcast code stream in the created widget play area; however, as shown in fig. 2, in the process that the live broadcast receiving end plays the live broadcast code stream by using the small window playing area, the live broadcast receiving end may display all live broadcast contents in the live broadcast code stream, so that the display interface of the live broadcast receiving end is occupied in a large area.
Therefore, in some implementation schemes provided by the application, when the live broadcast receiving end receives the small window play request, the live broadcast receiving end can extract a target live broadcast object in the live broadcast code stream for the currently received live broadcast code stream.
The target live broadcast object can be selected in a live broadcast picture through an input selection instruction by a user, and can also be a selection object configured for a live broadcast receiving end in advance.
For example, in some embodiments, taking the live broadcast of the character as an example, when the live broadcast receiving end plays a live broadcast code stream, a display interface of the live broadcast receiving end may be configured with some operation controls, where the operation controls may include selectable contents such as "portrait live broadcast", "background live broadcast", and the like; the live broadcast receiving end can determine a target live broadcast object in the live broadcast code stream by receiving an operation instruction of a user for the operation control; for example, assuming that the user selects "portrait live broadcast" through the operation control, the live broadcast receiving end may use a character object in the live broadcast code stream as a target live broadcast object; assuming that the user selects "background live broadcast" through the operation control, the live broadcast receiving end can use the background area in the live broadcast code stream as a target live broadcast object.
It can be understood that the above is only an example, and the description is made for the selection of the target live broadcast object, in some other possible embodiments of the present application, the live broadcast receiving end may also determine the target live broadcast object through some other manners, and the present application does not limit the determination manner of the target live broadcast object; for example, when a display interface of the live broadcast receiving end is in the process of displaying the video frames in the live broadcast stream, the live broadcast receiving end can receive the target live broadcast object selected by the user in the displayed video frames.
Next, the live broadcast receiving end may display the target live broadcast object on a live broadcast interface of the live broadcast receiving end based on the extracted target live broadcast object, for example, display the target live broadcast object in a preset area in a display interface of the live broadcast receiving end, or select a display area on the display interface of the live broadcast receiving end by a user, so as to display the target live broadcast object in the display area, and display the live broadcast content on the display interface of the live broadcast receiving end as shown in fig. 5.
Therefore, based on the above design, in the live broadcast method provided by the application, the live broadcast receiving end extracts the target live broadcast object in the live broadcast code stream by responding to the received small window play request, and displays the target live broadcast object on the display interface of the live broadcast receiving end, so that the live broadcast receiving end only displays the target live broadcast object on the display interface of the live broadcast receiving end in the process of executing the small window play mode, but does not display other contents except the target live broadcast object in the live broadcast code stream, the picture area occupied by the live broadcast content of the live broadcast receiving end in the display interface in the small window play mode is reduced, and the area available for user operation is increased.
In combination with the live broadcast system shown in fig. 1, based on the real-time characteristics of live broadcast, when a live broadcast receiving end receives a small window broadcast request, the live broadcast receiving end can send an object extraction request to a server; then, the server responds to the object extraction request, and aiming at receiving the live broadcast code stream sent by the live broadcast receiving end, object mask (mask) data corresponding to each live broadcast picture data in the live broadcast code stream is extracted, wherein the object mask data can be used for indicating an area where a target live broadcast object is located in the live broadcast picture data; moreover, when the server acquires the object mask data corresponding to each live broadcast picture data, the server may encapsulate the object mask data together with the live broadcast picture data, for example, store the object mask data corresponding to each live broadcast picture data in the respective extension information data of each live broadcast picture data, and then send the live broadcast picture data and the corresponding object mask data together to the live broadcast receiving end through the live broadcast code stream.
Accordingly, as a possible implementation manner, the live broadcast receiving end may extract live broadcast picture data and object mask data in the live broadcast code stream according to the received live broadcast code stream in the process of executing step 201.
Then, based on the extracted live view data and object mask data, the live view receiving end may mix the live view data and the object mask data by using a tool such as OpenGL (Open Graphics Library) to obtain a target live view object in the live view data.
In some embodiments, in the process of mixing live broadcast picture data and object mask data, the live broadcast receiving end may generate a mask contour image of the target live broadcast object according to the object mask data, where the mask contour image may be used to indicate contour information of the target live broadcast object in a live broadcast picture.
And the live broadcast receiving end can decode live broadcast picture data in the live broadcast code stream to obtain a current live broadcast picture.
Then, the live broadcast receiving end can mix the mask outline image with the current live broadcast picture, so as to extract and obtain a target live broadcast object in the current live broadcast picture.
The process that the live broadcast receiving end generates the mask outline image and decodes to obtain the current live broadcast picture has no execution sequence, and the live broadcast receiving end can firstly generate the mask outline image and then decode to obtain the current live broadcast picture; or decoding to obtain the current live broadcast picture and then generating a mask outline image; or, the live broadcast receiving end may simultaneously perform a step of decoding to obtain a current live broadcast image and a step of generating a mask outline image.
In addition, in other embodiments of the present application, the live broadcast receiving end may also use other manners to extract a target live broadcast object in the live broadcast code stream by using the object mask data; for example, the live broadcast receiving end can obtain the coordinate point positions of the target live broadcast objects in the live broadcast picture by using the object mask data; and then, the live broadcast receiving end decodes the obtained coordinate point to obtain a current live broadcast picture and extracts a target live broadcast object.
In other possible scenes, the server does not package and send the object mask data and the live broadcast picture data to the live broadcast receiving end together in the process of sending the object mask data to the live broadcast receiving end, but marks the same identification information, such as the same time tag, on the object mask data as the corresponding live broadcast picture data, and sends all the object mask data to the live broadcast receiving end in a unified way; in contrast, after receiving the live broadcast picture data and the object mask data, the live broadcast receiving end aligns the live broadcast picture data and the object mask data through identification information included in the live broadcast picture data and the object mask data, so that a target live broadcast object is extracted from the live broadcast picture data by using the object mask data corresponding to each live broadcast picture data.
In addition, as described above, in some possible embodiments of the present application, during the process that the live broadcast receiving end performs step 203, for example, in the manner described above, the extracted target live broadcast object may be displayed in an area preset in a display interface of the live broadcast receiving end, for example, an area selected by a user or a display area configured by default.
As another possible implementation manner, in the process of executing the live broadcasting method provided by the present application, when the live broadcasting receiving end receives a small window playing request, the live broadcasting receiving end may create a small window playing area on a display interface of the live broadcasting receiving end, where the small window playing area may be a part of a display area in the display interface of the live broadcasting receiving end.
Of course, it can be understood that, in the process of creating the small window playing area, the live broadcast receiving end may create a pre-configured area in the display interface of the live broadcast receiving end according to the pre-configured size of the small window playing area; the live broadcast receiving end can also create a small window playing area in a pre-configured area in a display interface of the live broadcast receiving end according to the size of the received size; or according to the received size, creating a small window playing area in a display interface of the live broadcast receiving end, wherein the area is selected by the user.
In addition, in some embodiments, when the live broadcast receiving end creates the small window playing area, a transparency parameter may be configured for the small window playing area, so that when the small window playing area does not play the live broadcast code stream, the small window playing area is in a transparent state.
Based on this, the live broadcast receiving end may render the target live broadcast object in the small window playing area created in response to the small window playing request in the process of executing step 203; for example, referring to fig. 2 and fig. 5, compared with some other small window playing modes, the live broadcasting scheme of the present application only displays a target live broadcasting object in a small window playing area created on a display interface of a live broadcasting receiving end, and does not display contents such as a background area, so that a picture area occupied by live broadcasting contents in the display interface is reduced, and more operable space is saved for a user.
In a scene shown in fig. 5, for example, after the live broadcast receiving end displays the target live broadcast object on the display interface of the live broadcast receiving end, the user may also adjust the display size, the display position, the display special effect, and the like of the target live broadcast object on the display interface.
Based on this, on the basis of fig. 4, please refer to fig. 6, fig. 6 shows another exemplary flowchart of the live broadcasting method provided by the present application, and as a possible implementation, the live broadcasting method may further include the following steps:
and step 205, responding to a target operation instruction for the target live broadcast object, and operating the target live broadcast object according to target operation parameters in the target operation instruction.
In some embodiments, for a target live broadcast object displayed on a display interface of a live broadcast receiving end, a user may input some target operation instructions to the live broadcast receiving end to control a display manner of the target live broadcast object on the display interface.
In contrast, when the live broadcast receiving end receives a target operation instruction for a target live broadcast object, the live broadcast receiving end can operate the target live broadcast object according to target operation parameters in the target operation instruction, so that the target live broadcast object can be configured on a display interface of the live broadcast receiving end in an individualized manner, and the playability of live broadcast content is improved.
For example, in some possible scenarios, the target operation instruction may be a moving operation instruction for the target live object, and the target operation parameter may be a moving operation track in the moving operation instruction.
Based on this, as shown in fig. 7A, in the process of executing step 205, the live broadcast receiving end may move the target live broadcast object according to the moving operation track in the moving operation instruction; namely: the live broadcast receiving end can control a target live broadcast object and move on a display interface according to the received moving operation track.
For another example, in some other possible scenarios, the target operation instruction may also be a zoom operation instruction for a target live object; accordingly, the target operation parameter may be a zoom parameter in the zoom operation instruction, for example, the target operation parameter may include a zoom center point and a zoom multiple.
Based on this, as shown in fig. 7B, in the process of executing step 205, the live broadcast receiving end may zoom the target live broadcast object according to the zoom parameter in the zoom operation instruction; namely: the live broadcast receiving end can control the target live broadcast object and carry out zooming on the display interface according to the received zooming parameters.
Of course, it can be understood that in some possible scenarios, the zoom center point and the zoom multiple in the zoom parameter may be configured individually by the user, so that when the live broadcast receiving end zooms the target live broadcast object according to the received zoom parameter, the target live broadcast object may partially exceed the display interface of the live broadcast receiving end after zooming, and the target live broadcast object may not be displayed completely on the display interface; based on this, the live broadcast receiving end can also detect the target live broadcast object after zooming the target live broadcast object so as to judge whether the target live broadcast object exceeds the display interface of the live broadcast receiving end, and when judging that the target live broadcast object exceeds the display interface of the live broadcast receiving end, the display area of the target live broadcast object on the display interface is moved so that the moved target live broadcast object can be completely displayed on the display interface.
In addition, based on the same inventive concept of the above live broadcasting method provided by the present application, please refer to fig. 8, and fig. 8 shows an exemplary structural block diagram of a live broadcasting device 300 provided by the present application, where the live broadcasting device 300 may include a processing module 301 and a display module 302.
The processing module 301 is configured to extract a target live broadcast object in a live broadcast code stream in response to a received widget play request;
the display module 302 is configured to display the target live broadcast object on a display interface of the live broadcast receiving end.
Optionally, as a possible implementation manner, the display module 302 may be specifically configured to:
and rendering the target live broadcast object in a small window playing area created by the live broadcast receiving end in response to the small window playing request, wherein the small window playing area is a part of a display area in a display interface of the live broadcast receiving end.
Optionally, as a possible implementation manner, the processing module 301 may be further configured to, in response to a target operation instruction for the target live object, operate the target live object according to a target operation parameter in the target operation instruction.
Optionally, as a possible implementation manner, the target operation instruction is a move operation instruction for the target live broadcast object, and the target operation parameter is a move operation track in the move operation instruction.
When the processing module 301 operates the target live broadcast object according to the target operation parameter in the target operation instruction, the processing module may specifically be configured to:
and moving the target live broadcast object according to the moving operation track in the moving operation instruction.
Optionally, as a possible implementation manner, the target operation instruction is a zoom operation instruction for the target live broadcast object, and the target operation parameter is a zoom parameter in the zoom operation instruction.
When the processing module 301 operates the target live broadcast object according to the target operation parameter in the target operation instruction, it may specifically be configured to:
and zooming the target live broadcast object according to the zooming parameter in the zooming operation instruction.
Optionally, as a possible implementation manner, when extracting a target live broadcast object in a live broadcast code stream, the processing module 301 may specifically be configured to:
extracting live broadcast picture data and object mask data in the live broadcast code stream; the object mask data is used for indicating the area of the target live broadcast object in the live broadcast picture data;
and mixing the live broadcast picture data and the object mask data to obtain a target live broadcast object in the live broadcast picture data.
Optionally, as a possible implementation manner, when blending the live picture data and the object mask data to obtain the target live object in the live picture data, the processing module 301 may specifically be configured to:
generating a mask outline image of a target live broadcast object according to the object mask data;
decoding the live broadcast picture data to obtain a current live broadcast picture;
and mixing the mask outline image with the current live broadcast picture to obtain a target live broadcast object.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to some embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in some embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method according to some embodiments of the present application. And the aforementioned storage medium includes: u disk, removable hard disk, read only memory, random access memory, magnetic disk or optical disk, etc. for storing program codes.
The above description is only a few examples of the present application and is not intended to limit the present application, and those skilled in the art will appreciate that various modifications and variations can be made in the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (10)
1. A live broadcast method is characterized in that the method is applied to a live broadcast receiving end; the method comprises the following steps:
responding to a received small window playing request, and extracting a target live broadcasting object in a live broadcasting code stream;
and in the process of executing a small window playing mode at the live broadcast receiving end, displaying the target live broadcast object on a display interface of the live broadcast receiving end, and not displaying other contents except the target live broadcast object in a live broadcast code stream.
2. The method of claim 1, wherein the displaying the target live object at the display interface of the live receiver comprises:
rendering the target live broadcast object in a small window playing area created by the live broadcast receiving end in response to the small window playing request, wherein the small window playing area is a part of a display area in a display interface of the live broadcast receiving end.
3. The method of claim 1 or 2, wherein the method further comprises:
responding to a target operation instruction aiming at the target live broadcast object, and operating the target live broadcast object according to target operation parameters in the target operation instruction.
4. The method of claim 3, wherein the target operation instruction is a moving operation instruction for the target live object, and the target operation parameter is a moving operation track in the moving operation instruction;
the operating the target live broadcast object according to the target operation parameters in the target operation instruction includes:
and moving the target live broadcast object according to the moving operation track in the moving operation instruction.
5. The method of claim 3, wherein the target operation instruction is a zoom operation instruction for the target live object, and the target operation parameter is a zoom parameter in the zoom operation instruction;
the operating the target live broadcast object according to the target operation parameters in the target operation instruction comprises the following steps:
and zooming the target live broadcast object according to the zooming parameter in the zooming operation instruction.
6. The method of claim 1, wherein the extracting the target live object in the live code stream comprises:
extracting live broadcast picture data and object mask data in the live broadcast code stream; the object mask data is used for indicating the area of a target live broadcast object in the live broadcast picture data;
and mixing the live broadcast picture data with the object mask data to obtain a target live broadcast object in the live broadcast picture data.
7. The method of claim 6, wherein the blending the live-view data with the object mask data to obtain a target live-view object in the live-view data comprises:
generating a mask outline image of the target live broadcast object according to the object mask data;
decoding the live broadcast picture data to obtain a current live broadcast picture;
and mixing the mask outline image with the current live broadcast picture to obtain the target live broadcast object.
8. A live broadcast device is characterized by being applied to a live broadcast receiving end; the device comprises:
the processing module is used for responding to the received small window playing request and extracting a target live broadcasting object in the live broadcasting code stream;
and the display module is used for displaying the target live broadcast object on a display interface of the live broadcast receiving end in the process of executing the small window play mode at the live broadcast receiving end, and not displaying other contents except the target live broadcast object in a live broadcast code stream.
9. A live broadcast receiving end, comprising:
a memory for storing one or more programs;
a processor;
the one or more programs, when executed by the processor, implement the method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011054315.6A CN112153409B (en) | 2020-09-29 | 2020-09-29 | Live broadcast method and device, live broadcast receiving end and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011054315.6A CN112153409B (en) | 2020-09-29 | 2020-09-29 | Live broadcast method and device, live broadcast receiving end and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112153409A CN112153409A (en) | 2020-12-29 |
| CN112153409B true CN112153409B (en) | 2022-08-19 |
Family
ID=73894454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011054315.6A Active CN112153409B (en) | 2020-09-29 | 2020-09-29 | Live broadcast method and device, live broadcast receiving end and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112153409B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115022683A (en) * | 2022-05-27 | 2022-09-06 | 咪咕文化科技有限公司 | Video processing method, device, equipment and readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713988A (en) * | 2016-12-09 | 2017-05-24 | 福建星网视易信息系统有限公司 | Beautifying method and system for virtual scene live |
| CN106993214A (en) * | 2017-03-20 | 2017-07-28 | 北京潘达互娱科技有限公司 | Live network broadcast method and device |
| CN108093290A (en) * | 2017-12-13 | 2018-05-29 | 广州虎牙信息科技有限公司 | Image content switching methods of exhibiting, storage device and computer equipment is broadcast live |
| WO2018113405A1 (en) * | 2016-12-19 | 2018-06-28 | 广州虎牙信息科技有限公司 | Live broadcast interaction method based on video stream, and corresponding apparatus thereof |
| CN109104619A (en) * | 2018-09-28 | 2018-12-28 | 联想(北京)有限公司 | Image processing method and device for live streaming |
| CN109151489A (en) * | 2018-08-14 | 2019-01-04 | 广州虎牙信息科技有限公司 | live video image processing method, device, storage medium and computer equipment |
| CN109246466A (en) * | 2018-10-30 | 2019-01-18 | 北京达佳互联信息技术有限公司 | Video broadcasting method, device and electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867762A (en) * | 2015-12-31 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Method and apparatus for displaying video being played |
| CN107690072B (en) * | 2017-04-19 | 2019-02-26 | 腾讯科技（深圳）有限公司 | Video broadcasting method and device |
| CN110324693A (en) * | 2018-03-30 | 2019-10-11 | 武汉斗鱼网络科技有限公司 | The direct broadcasting room processing method and processing device of video is played for realizing how small window |
-
2020
- 2020-09-29 CN CN202011054315.6A patent/CN112153409B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713988A (en) * | 2016-12-09 | 2017-05-24 | 福建星网视易信息系统有限公司 | Beautifying method and system for virtual scene live |
| WO2018113405A1 (en) * | 2016-12-19 | 2018-06-28 | 广州虎牙信息科技有限公司 | Live broadcast interaction method based on video stream, and corresponding apparatus thereof |
| CN106993214A (en) * | 2017-03-20 | 2017-07-28 | 北京潘达互娱科技有限公司 | Live network broadcast method and device |
| CN108093290A (en) * | 2017-12-13 | 2018-05-29 | 广州虎牙信息科技有限公司 | Image content switching methods of exhibiting, storage device and computer equipment is broadcast live |
| CN109151489A (en) * | 2018-08-14 | 2019-01-04 | 广州虎牙信息科技有限公司 | live video image processing method, device, storage medium and computer equipment |
| CN109104619A (en) * | 2018-09-28 | 2018-12-28 | 联想(北京)有限公司 | Image processing method and device for live streaming |
| CN109246466A (en) * | 2018-10-30 | 2019-01-18 | 北京达佳互联信息技术有限公司 | Video broadcasting method, device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112153409A (en) | 2020-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102463304B1 (en) | Video processing method and device, electronic device, computer-readable storage medium and computer program | |
| CN112333474B (en) | Screen projection method, system, equipment and storage medium | |
| CN111541930B (en) | Live broadcast picture display method and device, terminal and storage medium | |
| CN112929678B (en) | Live broadcast method, live broadcast device, server side and computer readable storage medium | |
| CN103297855B (en) | Application display method and terminal | |
| CN111970527B (en) | Live broadcast data processing method and device | |
| CN114077375B (en) | Target object display method and device, electronic equipment and storage medium | |
| CN112218108B (en) | Live broadcast rendering method and device, electronic equipment and storage medium | |
| CN112243137A (en) | Live broadcast interface updating method, device, server and system | |
| CN110856005B (en) | Live stream display method and device, electronic equipment and readable storage medium | |
| CN113965809A (en) | Method and device for simultaneous interactive live broadcast based on single terminal and multiple platforms | |
| CN112215936A (en) | Image rendering method and device, electronic equipment and storage medium | |
| CN112153409B (en) | Live broadcast method and device, live broadcast receiving end and storage medium | |
| US11750876B2 (en) | Method and apparatus for determining object adding mode, electronic device and medium | |
| CN115209222B (en) | Video playing method and device, electronic equipment and readable storage medium | |
| CN112153408B (en) | Live broadcast rendering method and device, electronic equipment and storage medium | |
| WO2021088973A1 (en) | Live stream display method and apparatus, electronic device, and readable storage medium | |
| CN112188269B (en) | Video playing method and device and video generating method and device | |
| CN114095772A (en) | Virtual object display method and system under live microphone connection and computer equipment | |
| CN113395565A (en) | Display method of virtual gift and related device and equipment | |
| CN114066547A (en) | Resource display method and device, electronic equipment and medium | |
| CN111782100A (en) | Method, device, terminal and storage medium for previewing background picture | |
| CN109600558B (en) | Method and apparatus for generating information | |
| US20230208785A1 (en) | Method and device for providing chatbot participating chat service | |
| CN111213133B (en) | Command processing server, program, system, command execution program, and command processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |