CN112672154A - Live video playing method and device, server and computer readable storage medium - Google Patents
Live video playing method and device, server and computer readable storage medium Download PDFInfo
- Publication number
- CN112672154A CN112672154A CN202011482526.XA CN202011482526A CN112672154A CN 112672154 A CN112672154 A CN 112672154A CN 202011482526 A CN202011482526 A CN 202011482526A CN 112672154 A CN112672154 A CN 112672154A
- Authority
- CN
- China
- Prior art keywords
- unit
- dynamic
- units
- static
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000003068 static effect Effects 0.000 claims abstract description 154
- 230000006835 compression Effects 0.000 claims abstract description 24
- 238000007906 compression Methods 0.000 claims abstract description 24
- 230000005540 biological transmission Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 8
- 230000008859 change Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 208000003028 Stuttering Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a live video playing method, a live video playing device, a server and a computer readable storage medium, and relates to the technical field of live broadcasting, wherein the live video playing method comprises the steps of dividing each video image frame of an acquired live video into a plurality of image units; each divided image unit comprises a static unit and a dynamic unit; determining relative position information of the dynamic unit relative to the video image frame; respectively encoding and compressing the static unit and the dynamic unit; transmitting and decoding the static units and the dynamic units after the coding compression according to a preset sequence; the method and the device have the advantages that the unit position restoration is carried out on the decoded static unit and dynamic unit based on the relative position information, and the video playing is carried out through the live broadcast platform.
Description
Technical Field
The present invention relates to the field of live broadcast technologies, and in particular, to a live broadcast video playing method, apparatus, server, and computer-readable storage medium.
Background
Live broadcast is a social contact mode emerging in the internet at present, and various live broadcast platforms are generated at the same time. The users who watch live broadcast mostly adopt cell phones, computers or tablet computers, when the online user number of live broadcast platform is too many, often can surpass its bandwidth configuration, can lead to the broadcast card to pause because of the video definition height at live broadcast in-process. The prior art generally adopts two modes for solving the problem of direct broadcast blockage, wherein the two modes are that the online number of users is limited, and more bandwidths are configured. However, the former is liable to cause poor experience of live broadcast users, and the latter has high demand for bandwidth configuration, which is liable to cause continuous increase of operation cost of live broadcast platform due to unlimited increase of demand for bandwidth configuration, and once bandwidth configuration cannot keep up with live broadcast platform, live broadcast is stuck.
In summary, the existing live video transmission technology affects the online watching experience of the user under the condition of limited bandwidth, and the invention provides a new method for internet live video coding under the condition of limited bandwidth, so as to effectively solve the problem of high-definition video playing blockage.
Disclosure of Invention
The invention aims to provide a live video playing method, a live video playing device, a server and a computer readable storage medium, which can effectively solve the problem of stuttering of internet high-definition live video playing under the condition of limited bandwidth and effectively improve the watching experience of a user.
In a first aspect, the present invention provides a method for playing a live video, including: dividing each video image frame of the obtained live video into a plurality of image units; each divided image unit comprises a static unit and a dynamic unit; determining relative position information of the dynamic unit relative to the video image frame; respectively encoding and compressing the static unit and the dynamic unit; transmitting and decoding the static units and the dynamic units after the coding compression according to a preset sequence; and performing unit position restoration on the decoded static unit and dynamic unit based on the relative position information, and performing video playing through a live broadcast platform.
In an alternative embodiment, before dividing each video image frame of the acquired live video into a plurality of image units, the method further comprises: collecting a live video stream; converting a live video stream into a continuous sequence of image frames; wherein the image frame sequence comprises a plurality of video image frames.
In an alternative embodiment, the step of dividing each video image frame into a plurality of image units comprises: identifying live broadcast static background and live broadcast dynamic personnel of each video image frame; dividing live broadcast static backgrounds and live broadcast dynamic personnel respectively, and determining a plurality of static units and a plurality of dynamic units; each static element and each dynamic element carries a corresponding identity.
In an alternative embodiment, the step of separately performing encoding compression on the static unit and the dynamic unit includes: respectively encoding and compressing a static unit and a dynamic unit aiming at a first frame of a video image frame; for each image frame following the first frame of the video image frames, only the dynamic cells are encoded.
In an alternative embodiment, the step of encoding only the dynamic unit for each image frame following the first frame of the video image frames comprises: when the dynamic unit changes, the static unit which changes correspondingly is identified; determining an updated dynamic unit based on the changed static unit and the changed dynamic unit; and encoding the updated dynamic unit.
In an optional embodiment, the step of transmitting the encoded and compressed static units and dynamic units according to a preset order includes: when the number of the static units is the same as that of the dynamic units, the static units and the dynamic units are transmitted and decoded in a combined mode based on the identification sequence; and when the static units and the dynamic units are different in quantity, the static units and the dynamic units are transmitted in a combined mode based on the identification sequence, and the static units or the rest non-transmission units of the dynamic units with large quantity are transmitted in sequence.
In an optional embodiment, the step of decoding the encoded and compressed static units and dynamic units according to a preset order includes: and decoding the static units once, and decoding the dynamic units one by one according to the carried label sequence.
In a second aspect, the present invention provides a live video playing apparatus, including: the dividing module is used for dividing each video image frame of the acquired live video into a plurality of image units; each divided image unit comprises a static unit and a dynamic unit; the determining module is used for determining the relative position information of the dynamic unit relative to the video image frame; the coding compression module is used for respectively coding and compressing the static unit and the dynamic unit; the transmission and decoding module is used for transmitting and decoding the static units and the dynamic units after the coding compression according to a preset sequence; and the unit position restoration module is used for restoring the unit positions of the decoded static units and dynamic units based on the relative position information and playing videos through the live broadcast platform.
In a third aspect, the present invention provides a server comprising a processor and a memory; the memory has stored thereon a computer program which, when executed by the processor, performs the method according to any of the preceding embodiments.
In a fourth aspect, the present invention provides a computer readable storage medium for storing computer software instructions for a method according to any one of the preceding embodiments.
The method comprises the steps of dividing each video image frame of an acquired live video into a plurality of image units, wherein each divided image unit comprises a static unit and a dynamic unit, then determining the relative position information of the dynamic unit relative to the video image frame, further respectively carrying out coding compression on the static unit and the dynamic unit, transmitting and decoding the static unit and the dynamic unit after the coding compression according to a preset sequence, finally carrying out unit position restoration on the static unit and the dynamic unit after the decoding based on the relative position information, and carrying out video playing through a live platform. According to the method, the divided static units and dynamic units are coded and transmitted and decoded according to the preset sequence, so that the problem of stuttering of playing of high-definition live video of the internet can be effectively solved under the condition of limited bandwidth, and meanwhile, the watching experience of a user is effectively improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flow chart of a live video playing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a static cell and a dynamic cell after being divided according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a coding unit transmission and decoding process according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of another live video playing method according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an apparatus for the method of FIG. 4 according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a live video playing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
Some embodiments of the invention are described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
For convenience of understanding, a live video playing method provided in an embodiment of the present invention is first described in detail, where the method is executed by a server, and in this embodiment, the server is a live server, and referring to a flowchart of a live video playing method shown in fig. 1, the method mainly includes the following steps S102 to S110:
step S102, dividing each video image frame of the acquired live video into a plurality of image units; wherein, each divided image unit comprises a static unit and a dynamic unit.
In an implementation mode, the live video can be acquired in a server acquisition mode, and the live video can be the live video recorded by the user terminal in real time, so that the live video of the user can be processed in real time, and video blockage can be effectively prevented. Live video may be divided into a sequence of frames consisting of a plurality of video image frames in order to process each video image frame of the sequence of frames. It can be understood that, in a live broadcast process video, a lot of contents in two frames of images before and after a user are the same and do not change dynamically, such as background, display and the like, most of which generally change live broadcast personnel, display products and the like, so that each video image frame is divided into a plurality of image units, and each video image frame of two frames before and after, several adjacent frames and even the whole image frame sequence may have an image unit which is not changed all the time, so that the divided image units can be further divided into a static unit and a dynamic unit, wherein the static unit is an image unit in which the image contents do not change dynamically in at least two frames of images before and after; the dynamic unit is an image unit except the static unit in the video image frame.
In step S104, the relative position information of the dynamic unit with respect to the video image frame is determined.
In the live broadcasting process, the position or the form of the content (such as live broadcasting personnel with dynamic change, display products and the like) of the dynamic unit obtained by division can be changed, so that in order to know the dynamic change of the dynamic unit, the relative position information of the dynamic unit relative to the video image frame needs to be determined, and the dynamic change can be determined according to the comparison of the front frame and the back frame. For example, there may be a situation where a static unit of a previous frame is converted into a dynamic unit, for example, when the position of a live person changes, the live person may block the background previously divided into static units, and an image unit originally divided into static units in a video image frame of the background will cover the original static unit into a dynamic unit after the dynamic unit changes dynamically.
And step S106, respectively encoding and compressing the static unit and the dynamic unit.
In order to ensure the transmission reliability of the static unit and the dynamic unit, the optimal coding modes for the static unit and the dynamic unit can be respectively selected from a self-defined coding mode group preset by a server, and corresponding coding is respectively carried out. In this embodiment, the still unit only needs to perform one encoding compression because the content of the still unit does not change in the preceding and following several frames of the video image frame. The content of the dynamic cell changes in each frame, so the dynamic cell can be encoded in each frame to adapt to the dynamic change of the content of the dynamic cell.
And step S108, transmitting the static units and the dynamic units after the coding compression according to a preset sequence and decoding.
The static units and the dynamic units after the coding compression are transmitted in sequence rather than at one time, for example, the static units and the dynamic units can be transmitted in a combined form of one static unit and one dynamic unit, if the number of the static units is more than that of the dynamic units, the more static units are sequentially transmitted in sequence after the transmission in the combined form is finished; if the number of the static units is less than that of the dynamic units, the excessive dynamic units are sequentially transmitted after the transmission according to the combination form is finished. After the transmission is completed, the static unit and the dynamic unit are decoded, and in one embodiment, a one-time decoding of the static unit and a one-by-one decoding of the dynamic unit may be adopted.
And step S110, performing unit position restoration on the decoded static unit and dynamic unit based on the relative position information, and performing video playing through a live broadcast platform.
For each frame of video image frame, after the relative position information of the dynamic unit in each frame is determined, after transmission and decoding, the static unit and the dynamic unit are subjected to unit position restoration according to the relative position information, so that the decoded video image frame is generated, and then the decoded video image frame can be sequentially played through a live broadcast platform, and the live broadcast video playing without blockage is realized.
The live video playing method provided by the embodiment of the invention comprises the steps of firstly dividing each video image frame of an obtained live video into a plurality of image units, wherein each divided image unit comprises a static unit and a dynamic unit, then determining the relative position information of the dynamic unit relative to the video image frame, further respectively carrying out coding compression on the static unit and the dynamic unit, transmitting and decoding the static unit and the dynamic unit which are subjected to coding compression according to a preset sequence, finally carrying out unit position restoration on the static unit and the dynamic unit which are decoded based on the relative position information, and carrying out video playing through a live platform. Through the coding of the static units and the dynamic units after the division and the transmission and decoding according to the preset sequence, the problem that the playing of the internet high-definition live video is blocked can be effectively solved under the condition of limited bandwidth, and meanwhile, the watching experience of a user is effectively improved.
In an embodiment, before dividing each video image frame of the obtained live video into a plurality of image units, the server first collects a live video stream and converts the collected live video stream into a continuous image frame sequence, where the conversion may be performed by any conversion application, such as video clip software, and the converted image frame sequence includes a plurality of video image frames, and it is understood that each of the plurality of video image frames corresponds to a corresponding identifier, such as a serial number corresponding to a sequence of the video image frames, so as to ensure continuity of playing of the live video.
In one embodiment, when each video image frame is divided into a plurality of image units, the live static background and live dynamic person of each video image frame are first identified, such as by using an object recognition model. Then, dividing the live broadcast static background and live broadcast dynamic personnel obtained by identification respectively, and determining a plurality of static units and a plurality of dynamic units; each static element and each dynamic element carry a corresponding identifier, which may be further labeled, such as static 1, static 2, dynamic 1, dynamic 2, etc.
In another embodiment, when dividing each video image frame into a plurality of image units, the video image frame may be divided first, such as into 8 × 8, 16 × 16, etc. image units, and further, each image unit is subject to target recognition, resulting in a plurality of static units and dynamic units.
The method for dividing a plurality of image units may be selected according to actual situations, and for easy understanding, fig. 2 shows a schematic diagram of a divided static unit and dynamic unit, wherein the whole image based on the X-axis and the Y-axis is an image frame 1, an image frame 2, and an image frame 3, each image frame is divided into 6 × 8 image units, and it can be seen from fig. 2 that when a dynamic unit changes, a covered static unit may exist, and at this time, the changed static unit is updated to a dynamic unit by comparing the two frames before and after the change.
After the static unit and the dynamic unit are obtained through division, the static unit and the dynamic unit are respectively coded and compressed, because the content of the static unit basically does not change, only the static unit of the first frame needs to be coded and compressed, meanwhile, each frame of the dynamic unit is coded and compressed, namely, the static unit and the dynamic unit are respectively coded and compressed aiming at the first frame of the video image frame, and only the dynamic unit is coded aiming at each image frame after the first frame of the video image frame, at the moment, the dynamic unit also comprises an image unit which is updated into the dynamic unit by the static unit, namely, the video image frame except the first frame, and the dynamic unit is the updated dynamic unit. Specifically, starting from the second frame of the video image frame, when the dynamic unit changes, the static unit which changes correspondingly is identified, and the corresponding change is determined by comparing the image units of the two frames before and after. And then determining an updated dynamic unit based on the changed static unit and the changed dynamic unit, and recoding the updated dynamic unit. In this embodiment, the encoding compression method may be selected according to the image quality conditions of the static unit and the dynamic unit, and the encoding compression method selected by the static unit may be the same as or different from the encoding compression method selected by the dynamic unit, which is not specifically limited herein.
In the actual live broadcast process, the numbers of static units and dynamic units obtained by dividing video image frames obtained by dividing live broadcast videos may be the same or different, so that when the numbers of the static units and the dynamic units are the same, the static units and the dynamic units are transmitted and decoded in a combination mode of a single static unit and a single dynamic unit based on the identification sequence until all the static units and the dynamic units are transmitted completely; and when the number of the static units is different from that of the dynamic units, the static units and the dynamic units are transmitted in a combined mode based on the identification sequence, and when the transmission of fewer image units is finished, the rest untransmitted units of the static units or the dynamic units with large number are transmitted in sequence. For the sake of understanding, refer to a schematic diagram of the transmission and decoding process of coding unit shown in fig. 3, that is, the static unit 1+ the dynamic unit 1 is used for transmission until the static unit 9+ the dynamic unit 9 (not shown in the figure), and at this time, the static unit 10, the static unit 11 … …, the static unit n-1, and the static unit n are transmitted in sequence.
Moreover, since the static units do not change the content, when the static units and the dynamic units after the coding compression are decoded according to a preset sequence, the static units are decoded at one time, and for the dynamic units, the static units are decoded one by one according to the sequence of the labels carried by the dynamic units. In one embodiment, the decoding method may be: first, dynamic unit 1 and dynamic unit 2 … … are decoded, where n is 9 in fig. 3, and then the decoding operation is completed for the static unit once after the static unit completes all sequential transmissions.
The present embodiment also provides a flow diagram of another live video playing method, as shown in fig. 4, and a structural diagram of an apparatus for executing the method is shown in fig. 5, where the method mainly includes the following steps S402 to S410:
step S402, collecting image frames in the current video, and dividing the current video into a plurality of frame images.
Step S404, dividing the video image frame into a plurality of units, dividing the units into static units and dynamic units according to whether the content in the front frame and the back frame of the video image changes, and recording the relative positions of the image frames to which the units belong.
Step S406, respectively selecting an optimal coding mode for the static unit and the dynamic unit in the self-defined coding mode group for coding, and only once coding compression is needed for the static unit.
Step S408, a single static coding unit and a single dynamic coding unit are transmitted to the decoding module at the same time, and the coding units are transmitted in sequence and are not transmitted at one time.
Step S410, the image position restoration operation of the decoding unit is carried out by the combination unit relative to the image frame position, and a decoded video image frame is generated.
The method adopted by the embodiment distinguishes the static unit and the dynamic unit by combining the change of the content of the video image frame, has different encoding and decoding processing modes for the static unit and the dynamic unit, adopts one-time encoding and decoding operation for the static encoding unit, and adopts sequential encoding and decoding operation for the dynamic encoding unit, thereby improving the encoding and decoding efficiency; by simultaneously and respectively transmitting the single static coding unit and the single dynamic coding unit to the decoding module, the transmission time and the occupied bandwidth are saved, and the phenomenon of blockage in the live broadcast process is solved.
The invention provides a live video playing device, which mainly comprises the following parts:
a dividing module 602, configured to divide each video image frame of the obtained live video into a plurality of image units; each divided image unit comprises a static unit and a dynamic unit;
a determining module 604 for determining relative position information of the dynamic unit with respect to the video image frame;
a coding compression module 606, configured to perform coding compression on the static unit and the dynamic unit respectively;
a transmission and decoding module 608, configured to transmit and decode the encoded and compressed static units and dynamic units according to a preset order;
and a unit position restoration module 610, configured to perform unit position restoration on the decoded static unit and dynamic unit based on the relative position information, and perform video playing through the live broadcast platform.
The live video playing device provided by the embodiment of the invention divides each video image frame of the obtained live video into a plurality of image units (including static units and dynamic units) through a dividing module, then determines the relative position information of the dynamic units relative to the video image frames through a determining module, further respectively encodes and compresses the static units and the dynamic units through an encoding and compressing module, transmits and decodes the encoded and compressed static units and dynamic units according to a preset sequence through a transmitting and decoding module, and finally performs unit position restoration on the decoded static units and dynamic units based on the relative position information through a unit position restoring module and plays the video through a live platform. Through the coding of the static units and the dynamic units after the division and the transmission and decoding according to the preset sequence, the problem that the playing of the internet high-definition live video is blocked can be effectively solved under the condition of limited bandwidth, and meanwhile, the watching experience of a user is effectively improved.
In one embodiment, before dividing each video image frame of the acquired live video into a plurality of image units, the apparatus further comprises: the conversion module is used for acquiring a live video stream; converting the live video stream into a continuous sequence of image frames; wherein the image frame sequence comprises a plurality of video image frames.
In an embodiment, the dividing module 602 is further configured to identify a live static background and a live dynamic person of each video image frame; dividing live broadcast static backgrounds and live broadcast dynamic personnel respectively, and determining a plurality of static units and a plurality of dynamic units; each static unit and each dynamic unit carry a corresponding identifier.
In an embodiment, the encoding and compressing module 606 is further configured to perform encoding and compressing on the static unit and the dynamic unit, respectively, for a first frame of the video image frame; encoding only the dynamic cell for each image frame subsequent to a first frame of the video image frames.
In an embodiment, the encoding compression module 606 is further configured to identify a corresponding static unit that changes when the dynamic unit changes; determining an updated dynamic cell based on the changed static cell and the dynamic cell; and encoding the updated dynamic unit.
In an embodiment, the transmitting and decoding module 608 is further configured to transmit and decode according to a combination of a single static unit and a single dynamic unit based on the identification order when the static units and the dynamic units are the same in number; and when the static units and the dynamic units are different in quantity, transmitting the static units and the dynamic units in a combined mode based on the identification sequence, and sequentially transmitting the static units or the rest non-transmission units of the dynamic units with a large quantity.
The device provided by the embodiment of the present invention has the same implementation principle and technical effect as the method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the method embodiments without reference to the device embodiments.
The embodiment of the invention provides a server, which particularly comprises a processor and a storage device; the storage means has stored thereon a computer program which, when executed by the processor, performs the method of any of the above described embodiments.
Fig. 7 is a schematic structural diagram of a server according to an embodiment of the present invention, where the server 100 includes: a processor 70, a memory 71, a bus 72 and a communication interface 73, wherein the processor 70, the communication interface 73 and the memory 71 are connected through the bus 72; the processor 70 is arranged to execute executable modules, such as computer programs, stored in the memory 71.
The memory 71 may include a high-speed Random Access Memory (RAM) and may further include a non-volatile memory (non-volatile memory), such as at least one disk memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 73 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.
The bus 72 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 7, but this does not indicate only one bus or one type of bus.
The memory 71 is configured to store a program, and the processor 70 executes the program after receiving an execution instruction, and the method executed by the apparatus defined by the flow process disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 70, or implemented by the processor 70.
The processor 70 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 70. The Processor 70 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory 71, and the processor 70 reads the information in the memory 71 and completes the steps of the method in combination with the hardware thereof.
The live video playing method, apparatus, server, and computer program product of the computer-readable storage medium according to the embodiments of the present invention include a computer-readable storage medium storing a nonvolatile program code executable by a processor, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor, the method described in the foregoing method embodiments is executed.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the system described above may refer to the corresponding process in the foregoing embodiments, and is not described herein again.
The computer program product of the readable storage medium provided in the embodiment of the present invention includes a computer readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A live video playing method is characterized by comprising the following steps:
dividing each video image frame of the obtained live video into a plurality of image units; wherein each divided image unit comprises a static unit and a dynamic unit;
determining relative position information of the dynamic unit relative to the video image frame;
respectively carrying out coding compression on the static unit and the dynamic unit;
transmitting and decoding the static units and the dynamic units after the coding compression according to a preset sequence;
and performing unit position restoration on the static unit and the dynamic unit after decoding based on the relative position information, and performing video playing through a live broadcast platform.
2. The live video playback method of claim 1, wherein prior to dividing each video image frame of the captured live video into a plurality of image units, the method further comprises:
collecting a live video stream;
converting the live video stream into a continuous sequence of image frames; wherein the image frame sequence comprises a plurality of video image frames.
3. The live video playback method of claim 1, wherein the step of dividing each of the video image frames into a plurality of image units comprises:
identifying live static background and live dynamic personnel of each video image frame;
dividing live broadcast static backgrounds and live broadcast dynamic personnel respectively, and determining a plurality of static units and a plurality of dynamic units; each static unit and each dynamic unit carry a corresponding identifier.
4. The live video playing method according to claim 1, wherein the step of separately encoding and compressing the static unit and the dynamic unit comprises:
respectively encoding and compressing the static unit and the dynamic unit aiming at the first frame of the video image frame;
encoding only the dynamic cell for each image frame subsequent to a first frame of the video image frames.
5. The live video playing method according to claim 4, wherein the step of encoding only the dynamic unit for each image frame subsequent to the first frame of the video image frames comprises:
when the dynamic unit changes, identifying the corresponding static unit which changes;
determining an updated dynamic cell based on the changed static cell and the dynamic cell;
and encoding the updated dynamic unit.
6. The live video playing method according to claim 3, wherein the step of transmitting the encoded and compressed static units and dynamic units in a predetermined order comprises:
when the number of the static units and the number of the dynamic units are the same, transmitting and decoding according to a combination mode of a single static unit and a single dynamic unit based on the identification sequence;
and when the static units and the dynamic units are different in number, transmitting the static units and the dynamic units in a combined mode based on the identification sequence, and sequentially transmitting the static units or the rest non-transmission units of the dynamic units with a large number.
7. The live video playing method according to claim 1, wherein the step of decoding the encoded and compressed static units and dynamic units in a preset order comprises:
and decoding the static units once, and decoding the dynamic units one by one according to the carried label sequence.
8. A live video playback apparatus, the apparatus comprising:
the dividing module is used for dividing each video image frame of the acquired live video into a plurality of image units; wherein each divided image unit comprises a static unit and a dynamic unit;
a determining module for determining relative position information of the dynamic unit with respect to the video image frame;
the coding compression module is used for respectively coding and compressing the static unit and the dynamic unit;
the transmission and decoding module is used for transmitting and decoding the static units and the dynamic units after the coding compression according to a preset sequence;
and the unit position restoration module is used for restoring the unit positions of the static unit and the dynamic unit after decoding based on the relative position information and playing videos through a live broadcast platform.
9. A server, comprising a processor and a memory;
the memory has stored thereon a computer program which, when executed by the processor, performs a live video playback method as claimed in any one of claims 1 to 7.
10. A computer readable storage medium storing computer software instructions for a live video playback method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011482526.XA CN112672154A (en) | 2020-12-15 | 2020-12-15 | Live video playing method and device, server and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011482526.XA CN112672154A (en) | 2020-12-15 | 2020-12-15 | Live video playing method and device, server and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112672154A true CN112672154A (en) | 2021-04-16 |
Family
ID=75405253
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011482526.XA Pending CN112672154A (en) | 2020-12-15 | 2020-12-15 | Live video playing method and device, server and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112672154A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115250361A (en) * | 2021-04-27 | 2022-10-28 | 安徽清研通信设备有限公司 | Live broadcast data processing method and device |
| CN115396696A (en) * | 2022-08-22 | 2022-11-25 | 网易（杭州）网络有限公司 | Video data transmission method, system, processing device and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281698A1 (en) * | 2014-03-26 | 2015-10-01 | Vixs Systems, Inc. | Video processing with static and dynamic regions and method for use therewith |
| CN106254873A (en) * | 2016-08-31 | 2016-12-21 | 广州市百果园网络科技有限公司 | A kind of method for video coding and video coding apparatus |
| WO2018086527A1 (en) * | 2016-11-08 | 2018-05-17 | 中兴通讯股份有限公司 | Video processing method and device |
| CN108171189A (en) * | 2018-01-05 | 2018-06-15 | 广东小天才科技有限公司 | A kind of method for video coding, video coding apparatus and electronic equipment |
| CN108471540A (en) * | 2018-03-21 | 2018-08-31 | 美澳视界（厦门）智能科技有限公司 | HD video smoothness live broadcasting method and device based on ultralow code stream |
| CN112004114A (en) * | 2020-08-31 | 2020-11-27 | 广州市百果园信息技术有限公司 | Video processing method, system, device, readable storage medium and electronic equipment |
-
2020
- 2020-12-15 CN CN202011482526.XA patent/CN112672154A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281698A1 (en) * | 2014-03-26 | 2015-10-01 | Vixs Systems, Inc. | Video processing with static and dynamic regions and method for use therewith |
| CN106254873A (en) * | 2016-08-31 | 2016-12-21 | 广州市百果园网络科技有限公司 | A kind of method for video coding and video coding apparatus |
| WO2018086527A1 (en) * | 2016-11-08 | 2018-05-17 | 中兴通讯股份有限公司 | Video processing method and device |
| CN108171189A (en) * | 2018-01-05 | 2018-06-15 | 广东小天才科技有限公司 | A kind of method for video coding, video coding apparatus and electronic equipment |
| CN108471540A (en) * | 2018-03-21 | 2018-08-31 | 美澳视界（厦门）智能科技有限公司 | HD video smoothness live broadcasting method and device based on ultralow code stream |
| CN112004114A (en) * | 2020-08-31 | 2020-11-27 | 广州市百果园信息技术有限公司 | Video processing method, system, device, readable storage medium and electronic equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115250361A (en) * | 2021-04-27 | 2022-10-28 | 安徽清研通信设备有限公司 | Live broadcast data processing method and device |
| CN115396696A (en) * | 2022-08-22 | 2022-11-25 | 网易（杭州）网络有限公司 | Video data transmission method, system, processing device and storage medium |
| CN115396696B (en) * | 2022-08-22 | 2024-04-12 | 网易（杭州）网络有限公司 | Video data transmission method, system, processing device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108200447B (en) | Live broadcast data transmission method and device, electronic equipment, server and storage medium | |
| CN110636294B (en) | Video decoding method and device, and video encoding method and device | |
| CN104702976A (en) | Video playing method and equipment | |
| CN112672154A (en) | Live video playing method and device, server and computer readable storage medium | |
| CN105430534B (en) | method and system for reporting data by intelligent equipment | |
| CN110784718B (en) | Video data encoding method, apparatus, device and storage medium | |
| CN111669577A (en) | Hardware decoding detection method and device, electronic equipment and storage medium | |
| CN108419041B (en) | Video data processing method and device | |
| CN110519607B (en) | Video decoding method and device, and video encoding method and device | |
| CN110650357B (en) | Video decoding method and device | |
| CN109982091B (en) | Image processing method and device | |
| CN110636334A (en) | Data transmission method and system | |
| US8681860B2 (en) | Moving picture compression apparatus and method of controlling operation of same | |
| CN106937127B (en) | Display method and system for intelligent search preparation | |
| CN110958468B (en) | Adaptation method and device of coder and decoder, computer readable medium and equipment | |
| CN112492233A (en) | Method and device for adapting resolution of transmitting end and receiving end of image transmission system | |
| CN111447451A (en) | Image coding and decoding method and device | |
| CN110677692B (en) | Video decoding method and device and video encoding method and device | |
| CN113099270B (en) | File storage method, decoding method, device, storage medium and electronic device | |
| CN110545431B (en) | Video decoding method and device, video encoding method and device | |
| CN112929706A (en) | Video data playback method, device, storage medium, and electronic device | |
| CN113315969A (en) | Data processing method, system and storage medium suitable for image transmission | |
| CN109982067B (en) | Video processing method and device | |
| CN110855619A (en) | Processing method and device for playing audio and video data, storage medium and terminal equipment | |
| CN115243101B (en) | Video dynamic and static ratio identification method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210416 |