CN110519598A - Video encoding/decoding method, device and equipment - Google Patents

Video encoding/decoding method, device and equipment Download PDF

Info

Publication number
CN110519598A
CN110519598A CN201910781418.3A CN201910781418A CN110519598A CN 110519598 A CN110519598 A CN 110519598A CN 201910781418 A CN201910781418 A CN 201910781418A CN 110519598 A CN110519598 A CN 110519598A
Authority
CN
China
Prior art keywords
frame
packet loss
video
video frame
key
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910781418.3A
Other languages
Chinese (zh)
Inventor
陈策
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuomi Private Ltd
Original Assignee
Hong Kong LiveMe Corp ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hong Kong LiveMe Corp ltd filed Critical Hong Kong LiveMe Corp ltd
Priority to CN201910781418.3A priority Critical patent/CN110519598A/en
Publication of CN110519598A publication Critical patent/CN110519598A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk

Abstract

A kind of video encoding/decoding method, device and equipment provided in an embodiment of the present invention.Wherein, a kind of video encoding/decoding method, be applied to video receiver, receive video sending end transmission video frame when, detect the video frame whether packet loss;When detecting the video frame packet loss, using the associated frame of the video frame of packet loss and the video frame of the packet loss as packet loss frame;The associated frame of the video frame of the packet loss is the decoded video frame of video frame using the packet loss;Processing is decoded to the video frame in addition to the packet loss frame.This programme can reduce the exception of video pictures caused by video data packet loss.

Description

Video encoding/decoding method, device and equipment
Technical field
The present invention relates to video decoding techniques fields, more particularly to a kind of video encoding/decoding method, device and equipment.
Background technique
With the development of internet technology, it is used widely using the Internet transmission data.The Internet transmission data Basic unit is data packet, therefore, using the partial data of the Internet transmission, such as the video data of a certain live streaming, often by It is divided into multiple data packets.
But during partial data is divided into multiple data packet transmission, it is likely that the feelings of data-bag lost occur Condition, i.e. " packet loss ".Especially for the video data encoded as unit of frame, if packet loss occurs in transmission process, There is shortage of data in video frame where will cause lost data packet, causes after being decoded to the video frame received, The video frame is shielded because flower occurs in shortage of data, and/or, the problem of the pictures exception such as Caton.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of video encoding/decoding method, device and equipment, to realize reduction video The effect of the exception of video pictures caused by data packetloss.Specific technical solution is as follows:
In a first aspect, being applied to video receiver, this method packet the embodiment of the invention provides a kind of video encoding/decoding method It includes:
Receive video sending end transmission video frame when, detect the video frame whether packet loss;
When detecting the video frame packet loss, using the associated frame of the video frame of packet loss and the video frame of the packet loss as Packet loss frame;The associated frame of the video frame of the packet loss is the decoded video frame of video frame using the packet loss;
Processing is decoded to the video frame in addition to the packet loss frame.
Optionally, described when detecting the video frame packet loss, by the video of the video frame of packet loss and the packet loss Before the associated frame of frame is as packet loss frame, the method also includes:
Whether the communication quality for detecting the video receiver and the video sending end meets preset weak net condition;
If it is satisfied, executing described using the associated frame of the video frame of packet loss and the video frame of the packet loss as packet loss frame.
Optionally, the type of the received video frame of the video receiver includes: key frame and non-key frame;The key Frame is to utilize the decoded video frame of video frame itself;The non-key frame is the associated frame of the key frame, and play time is stabbed After corresponding key frame;
It is described when detecting the video frame packet loss, by the associated frame of the video frame of packet loss and the video frame of the packet loss As packet loss frame, comprising:
When detecting the video frame packet loss, the type of the video frame of packet loss is identified;
When the type of the video frame of the packet loss is key frame, video frame and the packet loss to the packet loss The non-key frame of video frame carries out discard processing.
Optionally, for each key frame, in the corresponding multiple non-key frames of the key frame, the first non-key frame is second The associated frame of non-key frame;Wherein, the play time of first non-key frame is stabbed in the broadcasting of second non-key frame Between stab after;
Described when detecting the video frame packet loss, after the type for identifying the video frame of packet loss, the method is also Include:
When the type of the video frame of the packet loss is non-key frame, if the non-key frame of the packet loss is second non-key Frame, corresponding first non-key frame of the second non-key frame of the second non-key frame and the packet loss to the packet loss, is lost Abandoning processing.
Optionally, the video sending end includes: to transmit frame by frame to the transmission form of video frame;
It is described when the type of the video frame of the packet loss is key frame, video frame to the packet loss and described lose The non-key frame of the video frame of packet carries out discard processing, comprising:
When the type of the video frame of the packet loss be key frame when, abandon the packet loss video frame and the packet loss Video frame non-key frame in, received video frame;
The video sending end is notified to stop sending in the non-key frame of the video frame of the packet loss, not sent is non-key Frame, and since next key frame of the corresponding key frame of the packet loss frame, carry out the transmission of video frame.
Second aspect, the embodiment of the invention provides a kind of video decoders, are applied to video receiver, the device packet It includes:
Detection module, for receive video sending end transmission video frame when, detect the video frame whether packet loss;
Packet loss frame determining module, for when detecting the video frame packet loss, by the video frame of packet loss and the packet loss Video frame associated frame as packet loss frame;The associated frame of the video frame of the packet loss is the video frame decoding using the packet loss Video frame;
Decoder module, for being decoded processing to the video frame in addition to the packet loss frame.
Optionally, the detection module, is also used to:
It is described when detecting the video frame packet loss, the video frame of packet loss is related to the video frame of the packet loss Before frame is as packet loss frame, detect the video receiver and the video sending end communication quality whether meet it is preset weak Net condition;If it is satisfied, triggering the packet loss frame determining module executes the video by the video frame of packet loss and the packet loss The associated frame of frame is as packet loss frame.
Optionally, the type of the received video frame of the video receiver includes: key frame and non-key frame;The key Frame is to utilize the decoded video frame of video frame itself;The non-key frame is the associated frame of the key frame, and play time is stabbed After corresponding key frame;
The packet loss frame determining module, is specifically used for:
When the detection module detects the video frame packet loss, the type of the video frame of packet loss is identified;It is lost when described When the type of the video frame of packet is key frame, the non-key frame of the video frame of video frame and the packet loss to the packet loss Carry out discard processing.
Optionally, for each key frame, in the corresponding multiple non-key frames of the key frame, the first non-key frame is second The associated frame of non-key frame;Wherein, the play time of first non-key frame is stabbed in the broadcasting of second non-key frame Between stab after;
The packet loss frame determining module is also used to when the type of the video frame of the packet loss is non-key frame, if should The non-key frame of packet loss is the second non-key frame, and second of the second non-key frame and the packet loss to the packet loss is non-key Corresponding first non-key frame of frame carries out discard processing.
Optionally, the video sending end includes: to transmit frame by frame to the transmission form of video frame;
The packet loss frame determining module, is specifically used for:
When the type of the video frame of the packet loss be key frame when, abandon the packet loss video frame and the packet loss Video frame non-key frame in, received video frame;
The video sending end is notified to stop sending in the non-key frame of the video frame of the packet loss, not sent is non-key Frame, and since next key frame of the corresponding key frame of the packet loss frame, carry out the transmission of video frame.
The third aspect, the embodiment of the invention provides a kind of electronic equipment, which includes:
Processor, communication interface, memory and communication bus, wherein processor, communication interface, memory pass through bus Complete mutual communication;Memory, for storing computer program;Processor, for executing the journey stored on memory Sequence, the step of realizing the video encoding/decoding method that above-mentioned first aspect provides.
Fourth aspect is stored in the storage medium the embodiment of the invention provides a kind of computer readable storage medium Computer program, the computer program realize the step for the video encoding/decoding method that above-mentioned first aspect provides when being executed by processor Suddenly.
In scheme provided in an embodiment of the present invention, video receiver when received video frame packet loss, will be lost detecting The associated frame of the video frame of the video frame and packet loss of packet is decoded as packet loss frame, and then to the video frame in addition to packet loss frame Processing.Also, the associated frame of the video frame of packet loss is the video frame being decoded using the video frame of packet loss, in addition to packet loss frame Video frame there is no packet loss, be not present shortage of data.Therefore, processing is decoded to the video frame in addition to packet loss frame, it can be with When avoiding being decoded processing to packet loss frame, flower screen caused by the shortage of data of packet loss frame, and/or, the pictures such as Caton are abnormal The problem of.As it can be seen that the exception of video pictures caused by video data packet loss can be reduced by this programme.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described.
Fig. 1 is the flow diagram for the video encoding/decoding method that one embodiment of the invention provides;
Fig. 2 be another embodiment of the present invention provides video encoding/decoding method flow diagram;
Fig. 3 be another embodiment of the present invention provides video encoding/decoding method in, the topology example figure of video data;
Fig. 4 is the structural schematic diagram for the video decoder that one embodiment of the invention provides;
Fig. 5 is the structural schematic diagram for the electronic equipment that one embodiment of the invention provides.
Specific embodiment
In order to make those skilled in the art more fully understand the technical solution in the present invention, implement below in conjunction with the present invention Attached drawing in example, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment Only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, the common skill in this field Art personnel every other embodiment obtained without creative efforts belongs to the model that the present invention protects It encloses.
The video encoding/decoding method of one embodiment of the invention is introduced first below.
Video encoding/decoding method provided in an embodiment of the present invention can be applied to video receiver, in a particular application, video Receiving end can be a variety of.Illustratively, video receiver specifically can be the relevant App of video (Application answered With program), for example, it can be live streaming client, video playing client and social client etc..Alternatively, installation There is the electronic equipment of the relevant App of video, alternatively, electronic equipment.For the convenience of description, subsequent equal video receiver indicates.
Wherein, the electronic equipment or electronic equipment of the relevant App of video are installed, can specifically include desk-top calculating Machine, portable computer, internet television, intelligent mobile terminal, server and wearable intelligent terminal etc., herein not It limits, any electronic equipment that the embodiment of the present invention may be implemented belongs to the protection scope of the embodiment of the present invention.
As shown in Figure 1, the process of the video encoding/decoding method of one embodiment of the invention, this method may include:
S101, when receiving the video frame of video sending end transmission, the received video frame of detection institute whether packet loss.
In a particular application, video receiver detection received video frame whether the mode of packet loss, can be a variety of. Illustratively, video receiver may determine that the data packet of received video frame identify whether it is continuous, if discontinuously, inspection Measure the received video frame packet loss of institute.For example, the data packet of received video frame mark be followed successively by D1, D2 and D4 lacks D3, and there are packet losses for the video frame.Alternatively, illustrative, video receiver may determine that the weight of the data packet of video frame Pass number, if be greater than preset number of retransmissions threshold value, if it does, and newest primary re-transmissions failure, detect it is received Video frame packet loss.For example, the data packet D1 of received video frame retransmitted 3 times, and third time retransmits failure, the video There are packet losses for frame.
For any video receiver when receiving the video frame of video sending end transmission, whether the received video frame of detection institute The mode of packet loss, is used equally for the present invention, the present embodiment to this with no restriction.
In addition, video sending end can be it is a variety of.Illustratively, it is relevant specifically to can be video for video sending end App (Application, application program) for example can be live streaming client, video playing client and social visitor Family end etc..Alternatively, the electronic equipment of the relevant App of video is installed, alternatively, electronic equipment, alternatively, relevant to video The corresponding server of App, such as the corresponding server of live streaming client.For the convenience of description, subsequent equal video receiver indicates. Wherein, the electronic equipment or electronic equipment of the relevant App of video are installed, can specifically include desktop computer, portable Computer, internet television, intelligent mobile terminal, server and wearable intelligent terminal etc., are not limited thereto, and appoint The electronic equipment of the embodiment of the present invention may be implemented in what, belongs to the protection scope of the embodiment of the present invention.
S102 is related to the video frame of packet loss by the video frame of packet loss when detecting when received video frame packet loss Frame is as packet loss frame.Wherein, the associated frame of the video frame of packet loss is the decoded video frame of video frame using packet loss.
It is understood that the video frame is because data packet lacks, the meeting in decoding process when institute's received video frame packet loss There is flower screen, and/or, the problem of the pictures exception such as Caton.Therefore, in order to reduce colored screen, and/or, the pictures such as Caton are different Often, when detecting when received video frame packet loss, can using the associated frame of the video frame of packet loss and the video frame of packet loss as Packet loss frame, to be decoded processing to the video frame in addition to packet loss frame in subsequent step S103, to packet loss frame without Decoding.
Wherein, for any video frame, the associated frame of the video frame is to utilize the decoded video frame of the video frame.Citing and Speech, when the image information that a certain video frame includes is the different information different from the image information of another video frame, the video frame In addition to utilizing self-contained image information when decoding, it is also necessary to the image information for including using another video frame, to obtain Decoded video image comprising complete image information.At this point, the video frame is the associated frame of another video frame.
It in a particular application, can be according to whether the decoded difference of other video frames be utilized, by the Type division of video frame For key frame and non-key frame.On this basis, above-mentioned steps S102 can correspond to the different type of the video frame of packet loss, into The different specific processing of row.In order to facilitate understanding and rationally, subsequent specifically to be retouched in Fig. 2 embodiment and alternative embodiment It states.
S103 is decoded processing to the video frame in addition to packet loss frame.
Wherein, packet loss frame includes the associated frame of the video frame of packet loss and the video frame of packet loss, also, the video frame of packet loss Associated frame utilizes the video frame decoding of packet loss, the video requency frame data packet loss of packet loss.In this regard, if view to packet loss frame and packet loss The associated frame of frequency frame is decoded processing, and the associated frame appearance that will lead to the video frame of packet loss and the video frame of packet loss is lacked by data Flower screen caused by losing, and/or, the exception of picture Caton.Therefore, place can be decoded to the video frame in addition to packet loss frame Reason, correspondingly, to packet loss frame without decoding, so that the flower screen for the video that decoding obtains is reduced, and/or, the pictures such as Caton It is abnormal.
In a particular application, when being decoded processing to the video frame in addition to packet loss frame, to not decoding for packet loss frame Processing can be a variety of.Illustratively, discard processing can be carried out to packet loss frame, alternatively, not abandoning packet loss frame, and to packet loss Frame alternatively, carrying out not decoding process to associated frame received in packet loss frame, and notifies video sending end without decoding process Stop the transmission to the associated frame in not sent packet loss frame.
The not decoding process of any pair of packet loss frame is used equally for the present invention, the present embodiment to this with no restriction.
In scheme provided in an embodiment of the present invention, video receiver when received video frame packet loss, will be lost detecting The associated frame of the video frame of the video frame and packet loss of packet is decoded as packet loss frame, and then to the video frame in addition to packet loss frame Processing.Also, the associated frame of the video frame of packet loss is the video frame being decoded using the video frame of packet loss, in addition to packet loss frame Video frame there is no packet loss, be not present shortage of data.Therefore, processing is decoded to the video frame in addition to packet loss frame, it can be with When avoiding being decoded processing to packet loss frame, flower screen caused by the shortage of data of packet loss frame, and/or, the pictures such as Caton are abnormal The problem of.As it can be seen that the exception of video pictures caused by video data packet loss can be reduced by this programme.
Optionally, above-mentioned when detecting the video frame packet loss, by the video of the video frame of packet loss and the packet loss Before the associated frame of frame is as packet loss frame, video encoding/decoding method provided in an embodiment of the present invention can also include the following steps:
Whether detection video receiver and the communication quality of video sending end meet preset weak net condition;
If it is satisfied, executing above-mentioned using the associated frame of the video frame of packet loss and the video frame of packet loss as packet loss frame.
In a particular application, preset weak net condition is for judging the communication between video receiver and video sending end Whether network occurs the condition of congestion, which can be a variety of.Illustratively, when video sending end is to the data packet of loss When being retransmitted, the number of retransmissions that preset weak net condition can be the data packet of loss is more than or equal to preset number threshold Value.Alternatively, preset weak net condition can be video receiver and the message transmission rate of video sending end is less than preset biography Defeated rate-valve value.Any item that can be judged the communication network between video receiver and video sending end and congestion whether occurs Part, can be used as preset weak net condition, the present embodiment to this with no restriction.
When the communication quality of video receiver and video sending end meets preset weak net condition, show video reception at this time End is in contrast poor with the communication quality of video sending end, is easy to happen a large amount of packet losses.Therefore, at this point it is possible to execute above-mentioned Using the associated frame of the video frame of packet loss and the video frame of packet loss as packet loss frame, to reduce net caused by the multiple re-transmission of packet loss frame The occupancy of network bandwidth and the increase of time cost, and/or, the multiple decoding of the video frame abnormal to shortage of data decoding causes Decoding increased costs improve decoding efficiency to alleviate network congestion.
As shown in Fig. 2, the process of the video encoding/decoding method of another embodiment of the present invention, this method may include:
S201, when receiving the video frame of video sending end transmission, the received video frame of detection institute whether packet loss.Its In, the type of the received video frame of video receiver includes: key frame and non-key frame;Key frame is to be solved using video frame itself The video frame of code;Non-key frame is the associated frame of key frame, and play time stamp is after corresponding key frame.
In a particular application, the picture of video frame is often continuous, and there are one for the image information of multiple successive video frames Fixed similitude.Therefore, in order to reduce the coding and decoding cost of video frame, and the data volume of video is reduced, it can be according to view The difference for the image information that frequency frame includes, encodes video, obtains comprising video frame itself all images information, Ke Yili With the decoded key frame of video frame itself, and it is contained in the different differential image information of other video frames, at least needs to utilize The decoded non-key frame of key frame.Also, in order to correspond to the continuity of video frame picture, the play time of non-key frame is stabbed in phase After the key frame answered.
Correspondingly, step S201 and the difference of the step S101 of Fig. 1 embodiment of the present invention are, video-frequency band in step S201 The difference for the image information that received video frame includes according to video frame, encodes video, so that obtained video frame Type includes key frame and non-key frame, to need to identify the type of the video frame of packet loss in subsequent step S202.For Details are not described herein for same section, is detailed in the description of aforementioned present invention Fig. 1 embodiment.
S202 when detecting when received video frame packet loss, identifies the type of the video frame of packet loss.
Illustratively, as shown in figure 3, in the video encoding/decoding method of another embodiment of the present invention, the structure of video data, packet It includes: key frame I1 is decoded non-using key frame I2 using key frame I1 decoded non-key frame P11 to P13, key frame I2 Key frame P21 to P22.When detecting when received video frame packet loss, video receiver can be according to the type mark of video frame Know the type of the video frame of " I " and " P " identification packet loss.When being identified as " I ", the type of video frame is key frame, when being identified as " P ", the type of video frame are non-key frame.
S203, when the type of the video frame of packet loss is key frame, the video frame of video frame and packet loss to packet loss Non-key frame carries out discard processing.
In a particular application, non-key frame is at least with corresponding crucial frame decoding, comprising: any non-key frame can benefit With the non-key frame itself and corresponding crucial frame decoding, alternatively, any non-key frame can use the non-key frame itself, broadcast Put other non-key frames and corresponding crucial frame decoding of time shaft before the non-key frame.It is understood that the two Difference be, when a certain non-key frame also utilize other non-key frames decode when, need for packet loss video frame be non-pass The case where key frame, is handled, and when the video frame of packet loss is key frame, processing mode is identical.In order to facilitate understanding and describe, Other non-key frames and corresponding key frame solution of play time axis before the non-key frame are utilized with non-key frame below It is illustrated for code.Illustratively, as shown in table 1 below:
According to table 1, it if key frame packet loss, can all be decoded using the decoded non-key frame of the key frame different Often.For example, key frame I1, non-key frame P11, P12 and P13 can have shortage of data if key frame I1 packet loss, decoding It is abnormal.If I2 packet loss, there is decoding exception in P21 and P22.Also, key frame I1 is not the corresponding of non-key frame P21 and P22 Key frame, key frame I1 packet loss will not influence the decoding of non-key frame P21 and P22.
It on this basis, can video frame and packet loss to packet loss when the type of the video frame of packet loss is key frame Video frame non-key frame carry out discard processing.For example, key frame I1 packet loss, it can be to the non-of key frame I1 and key frame I1 Key frame P11, P12 and P13 carry out discard processing.
S204 is decoded processing to the video frame in addition to packet loss frame.
Above-mentioned S204 is identical step with the S103 of Fig. 1 embodiment of the present invention, and details are not described herein, is detailed in above-mentioned hair The description of bright Fig. 1 embodiment.
In above-mentioned Fig. 2 embodiment, when key frame packet loss, the video frame of video frame and packet loss to packet loss it is non- Key frame carries out discard processing, to guarantee only to be decoded processing, Ke Yi to the video frame in addition to packet loss frame when decoding Flower screen caused by the shortage of data of packet loss frame is reduced, and/or, while the picture abnormal problem of picture Caton, reduction is not lost Packet loss frame is abandoned, but stores the waste of storage resource caused by packet loss frame.
Optionally, for each key frame, in the corresponding multiple non-key frames of the key frame, the first non-key frame is second The associated frame of non-key frame;Wherein, the play time stamp of the first non-key frame is after the play time stamp of the second non-key frame;
Above-mentioned when detecting the video frame packet loss, after the type for identifying the video frame of packet loss, the present invention is implemented The video encoding/decoding method that example provides, can also include the following steps:
When the type of the video frame of packet loss is non-key frame, if the non-key frame of the packet loss is the second non-key frame, Corresponding first non-key frame of the second non-key frame of the second non-key frame and packet loss to the packet loss carries out discard processing.
In a particular application, in the corresponding multiple non-key frames of any key frame, it is understood that there may be utilize other non-key frames Decoded non-key frame, at this point, multiple non-key frames can be divided into the first non-key frame and the second non-key frame, and the first non-pass Key frame is the associated frame of the second non-key frame.Also, due in the corresponding whole image informations of the first non-key frame, existing and the The similar information of the image information that two non-key frames include, therefore, the first non-key frame and the second non-key frame are continuous, and first is non- The play time stamp of key frame is after the play time stamp of the second non-key frame.Correspondingly, the type of the video frame when packet loss When for non-key frame, if the non-key frame of packet loss is the second non-key frame, can to the second non-key frame of the packet loss, and Non-key corresponding first non-key frame of the second of the packet loss carries out discard processing.Illustratively, referring to above-mentioned table 1, if Two non-key frame P11 packet losses, not only the second non-key frame P11 meeting shortage of data, decodes exception, and the P11 of the second non-key frame Corresponding first non-key frame P12 and P13 can have shortage of data, and decoding is abnormal.Similar, if non-key frame P21 loses Packet, non-key frame P22 decoding are also abnormal.It therefore, can be to the second non-key frame P11 and phase when the second non-key frame P11 packet loss The the first non-key frame P12 answered carries out discard processing.
In this alternative embodiment, when the type of the video frame of packet loss is non-key frame, since the video frame of packet loss is deposited In corresponding first non-key frame, crucial frame decoding of first non-key frame in addition to being utilized as packet loss also utilizes the non-of packet loss Crucial frame decoding, therefore, it is necessary to corresponding first non-key frames of the video frame of video frame and packet loss to packet loss, are lost Abandoning processing.To cope with the non-packet loss of key frame, non-key frame packet loss, and the video frame for needing to abandon and discarding when key frame packet loss The different situation of video frame, the scope of application to packet drop can be expanded.
Optionally, above-mentioned video sending end may include: to transmit frame by frame to the transmission form of video frame;
Correspondingly, above-mentioned when the type of the video frame of packet loss is key frame, the view of video frame and packet loss to packet loss The non-key frame of frequency frame carries out discard processing, may include steps of:
When the type of the video frame of packet loss is key frame, the non-of the video frame of packet loss and the video frame of packet loss is abandoned In key frame, received video frame;
Video sending end is notified to stop sending in the non-key frame of the video frame of packet loss, not sent non-key frame, and from Next key frame of the corresponding key frame of packet loss frame starts, and carries out the transmission of video frame.
In a particular application, if video frame transmitting terminal transmits video frame frame by frame, it is likely that the view of packet loss occur In the non-key frame of frequency frame, video frame receiving end is partially had transmitted to, the case where partially not yet transmission.At this point, video reception End can abandon in the non-key frame of the video frame of packet loss and the video frame of packet loss, received video frame;And then notify view The sending end that takes place frequently stops sending in the non-key frame of the video frame of packet loss, not sent non-key frame, and from the corresponding pass of packet loss frame Next key frame of key frame starts, and carries out the transmission of video frame.
It illustratively, can be to key frame I1 and received key frame if key frame I1 packet loss referring to above-mentioned table 1 The non-key frame P11 to P12 of I1 carries out discard processing.And video sending end is notified to stop sending not sent non-key frame P13, And directly carry out since next key frame I2 of the corresponding key frame I1 of packet loss frame, carry out the transmission of video frame.Certainly, such as The non-key frame of the key frame of fruit packet loss is all sent, and video receiver is when receiving the notice, due to losing without sending The non-key frame of the key frame of packet can be sent without the stopping of not sent non-key frame, but directly from packet loss frame pair The next key frame for the key frame answered starts, and carries out the transmission of video frame.
In this alternative embodiment, stop sending in the non-key frame of the video frame of packet loss by notice video sending end, Not sent non-key frame, and since next key frame of the corresponding key frame of packet loss frame, the transmission of video frame is carried out, it can To avoid to bandwidth waste caused by the transmission for necessarily decoding abnormal non-key frame, also, send frame by frame and Batch sending It compares, it is possible to reduce network congestion reduces packet loss.
Similar, when the type of the video frame of packet loss is non-key frame, and there are corresponding first non-passes for the non-key frame When key frame, in corresponding first non-key frame of the video frame of video frame and packet loss that packet loss can be abandoned, received video Frame;Video sending end is notified to stop sending in corresponding first non-key frame of video frame of packet loss, not sent first is non-key Frame, and since next key frame of the corresponding key frame of packet loss frame, carry out the transmission of video frame.
Corresponding to above method embodiment, one embodiment of the invention additionally provides video decoder.
As shown in figure 4, the video decoder of one embodiment of the invention, is applied to video receiver, which be can wrap It includes:
Detection module 401, for detecting whether the video frame loses when receiving the video frame of video sending end transmission Packet;
Packet loss frame determining module 402 by the video frame of packet loss and described is lost for when detecting the video frame packet loss The associated frame of the video frame of packet is as packet loss frame;The associated frame of the video frame of the packet loss is the video frame solution using the packet loss The video frame of code;
Decoder module 403, for being decoded processing to the video frame in addition to the packet loss frame.
In scheme provided in an embodiment of the present invention, video receiver when received video frame packet loss, will be lost detecting The associated frame of the video frame of the video frame and packet loss of packet is decoded as packet loss frame, and then to the video frame in addition to packet loss frame Processing.Also, the associated frame of the video frame of packet loss is the video frame being decoded using the video frame of packet loss, in addition to packet loss frame Video frame there is no packet loss, be not present shortage of data.Therefore, processing is decoded to the video frame in addition to packet loss frame, it can be with When avoiding being decoded processing to packet loss frame, flower screen caused by the shortage of data of packet loss frame, and/or, the pictures such as Caton are abnormal The problem of.As it can be seen that the exception of video pictures caused by video data packet loss can be reduced by this programme.
Optionally, the detection module 401, is also used to:
It is described when detecting the video frame packet loss, the video frame of packet loss is related to the video frame of the packet loss Before frame is as packet loss frame, detect the video receiver and the video sending end communication quality whether meet it is preset weak Net condition;If it is satisfied, triggering the packet loss frame determining module executes the video by the video frame of packet loss and the packet loss The associated frame of frame is as packet loss frame.
Optionally, the type of the received video frame of the video receiver includes: key frame and non-key frame;The key Frame is to utilize the decoded video frame of video frame itself;The non-key frame is the associated frame of the key frame, and play time is stabbed After corresponding key frame;
The packet loss frame determining module 402, is specifically used for:
When the detection module 401 detects the video frame packet loss, the type of the video frame of packet loss is identified;When described The type of the video frame of packet loss be key frame when, the video frame of video frame and the packet loss to the packet loss it is non-key Frame carries out discard processing.
Optionally, for each key frame, in the corresponding multiple non-key frames of the key frame, the first non-key frame is second The associated frame of non-key frame;Wherein, the play time of first non-key frame is stabbed in the broadcasting of second non-key frame Between stab after;
The packet loss frame determining module 402 is also used to when the type of the video frame of the packet loss is non-key frame, if The non-key frame of the packet loss is the second non-key frame, the second non-pass of the second non-key frame and the packet loss to the packet loss Corresponding first non-key frame of key frame carries out discard processing.
Optionally, the video sending end includes: to transmit frame by frame to the transmission form of video frame;
The packet loss frame determining module 402, is specifically used for:
When the type of the video frame of the packet loss be key frame when, abandon the packet loss video frame and the packet loss Video frame non-key frame in, received video frame;
The video sending end is notified to stop sending in the non-key frame of the video frame of the packet loss, not sent is non-key Frame, and since next key frame of the corresponding key frame of the packet loss frame, carry out the transmission of video frame.
Corresponding to above-described embodiment, the embodiment of the invention also provides a kind of electronic equipment, as shown in figure 5, the equipment can To include:
Processor 501, communication interface 502, memory 503 and communication bus 504, wherein processor 501, communication interface 502, memory logical 503 crosses communication bus 504 and completes mutual communication;
Memory 503, for storing computer program;
Processor 501 when for executing the computer program stored on above-mentioned memory 503, realizes above-described embodiment In any video encoding/decoding method the step of.
It is understood that in a particular application, the electronic equipment in the present embodiment is video receiver.
In scheme provided in an embodiment of the present invention, video receiver when received video frame packet loss, will be lost detecting The associated frame of the video frame of the video frame and packet loss of packet is decoded as packet loss frame, and then to the video frame in addition to packet loss frame Processing.Also, the associated frame of the video frame of packet loss is the video frame being decoded using the video frame of packet loss, in addition to packet loss frame Video frame there is no packet loss, be not present shortage of data.Therefore, processing is decoded to the video frame in addition to packet loss frame, it can be with When avoiding being decoded processing to packet loss frame, flower screen caused by the shortage of data of packet loss frame, and/or, the pictures such as Caton are abnormal The problem of.As it can be seen that the exception of video pictures caused by video data packet loss can be reduced by this programme.
Above-mentioned memory may include RAM (Random Access Memory, random access memory), also may include NVM (Non-Volatile Memory, nonvolatile memory), for example, at least a magnetic disk storage.Optionally, memory It can also be that at least one is located away from the storage device of above-mentioned processor.
Above-mentioned processor can be general processor, including CPU (Central Processing Unit, central processing Device), NP (Network Processor, network processing unit) etc.;Can also be DSP (Digital Signal Processor, Digital signal processor), ASIC (Application Specific Integrated Circuit, specific integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device are divided Vertical door or transistor logic, discrete hardware components.
The computer readable storage medium that one embodiment of the invention provides, is contained in electronic equipment, this is computer-readable to deposit It is stored with computer program in storage media, when which is executed by processor, realizes any video in above-described embodiment The step of coding/decoding method.
In scheme provided in an embodiment of the present invention, video receiver when received video frame packet loss, will be lost detecting The associated frame of the video frame of the video frame and packet loss of packet is decoded as packet loss frame, and then to the video frame in addition to packet loss frame Processing.Also, the associated frame of the video frame of packet loss is the video frame being decoded using the video frame of packet loss, in addition to packet loss frame Video frame there is no packet loss, be not present shortage of data.Therefore, processing is decoded to the video frame in addition to packet loss frame, it can be with When avoiding being decoded processing to packet loss frame, flower screen caused by the shortage of data of packet loss frame, and/or, the pictures such as Caton are abnormal The problem of.As it can be seen that the exception of video pictures caused by video data packet loss can be reduced by this programme.
In another embodiment provided by the invention, a kind of computer program product comprising instruction is additionally provided, when it When running on computers, so that computer executes any video encoding/decoding method in above-described embodiment.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or It partly generates according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated meter Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer Instruction can pass through wired (such as coaxial cable, optical fiber, DSL from a web-site, computer, server or data center (Digital Subscriber Line, digital operation maintenance personnel line) or wireless (such as: infrared ray, radio, microwave etc.) mode It is transmitted to another web-site, computer, server or data center.The computer readable storage medium can be Any usable medium that computer can access either includes the integrated server of one or more usable mediums, data center Equal data storage devices.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (such as: DVD (Digital Versatile Disc, digital versatile disc)) or semiconductor medium (such as: SSD (Solid State Disk, solid state hard disk)) etc..
Herein, relational terms such as first and second and the like be used merely to by an entity or operation with it is another One entity or operation distinguish, and without necessarily requiring or implying between these entities or operation, there are any this reality Relationship or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device and For electronic equipment embodiment, since it is substantially similar to the method embodiment, so be described relatively simple, related place referring to The part of embodiment of the method illustrates.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention It is interior.

Claims (10)

1. a kind of video encoding/decoding method, which is characterized in that be applied to video receiver, which comprises
Receive video sending end transmission video frame when, detect the video frame whether packet loss;
When detecting the video frame packet loss, using the associated frame of the video frame of packet loss and the video frame of the packet loss as packet loss Frame;The associated frame of the video frame of the packet loss is the decoded video frame of video frame using the packet loss;
Processing is decoded to the video frame in addition to the packet loss frame.
2. the method according to claim 1, wherein will be lost described when detecting the video frame packet loss Before the associated frame of the video frame of packet and the video frame of the packet loss is as packet loss frame, the method also includes:
Whether the communication quality for detecting the video receiver and the video sending end meets preset weak net condition;
If it is satisfied, executing described using the associated frame of the video frame of packet loss and the video frame of the packet loss as packet loss frame.
3. according to claim 1 to 2 described in any item methods, which is characterized in that the received video frame of video receiver Type include: key frame and non-key frame;The key frame is to utilize the decoded video frame of video frame itself;It is described non-key Frame is the associated frame of the key frame, and play time stamp is after corresponding key frame;
It is described when detecting the video frame packet loss, using the associated frame of the video frame of packet loss and the video frame of the packet loss as Packet loss frame, comprising:
When detecting the video frame packet loss, the type of the video frame of packet loss is identified;
When the type of the video frame of the packet loss is key frame, the video of video frame and the packet loss to the packet loss The non-key frame of frame carries out discard processing.
4. according to the method described in claim 3, the key frame is corresponding multiple non-it is characterized in that, being directed to each key frame In key frame, the first non-key frame is the associated frame of the second non-key frame;Wherein, the play time stamp of first non-key frame After the play time stamp of second non-key frame;
Described when detecting the video frame packet loss, after the type for identifying the video frame of packet loss, the method also includes:
When the type of the video frame of the packet loss is non-key frame, if the non-key frame of the packet loss is the second non-key frame, Corresponding first non-key frame of the second non-key frame of the second non-key frame and the packet loss to the packet loss, is abandoned Processing.
5. according to the method described in claim 3, it is characterized in that, the video sending end is to the transmission form packet of video frame It includes: transmitting frame by frame;
It is described when the type of the video frame of the packet loss is key frame, video frame and the packet loss to the packet loss The non-key frame of video frame carries out discard processing, comprising:
When the type of the video frame of the packet loss is key frame, the video frame of the packet loss and the view of the packet loss are abandoned In the non-key frame of frequency frame, received video frame;
The video sending end is notified to stop sending in the non-key frame of the video frame of the packet loss, not sent non-key frame, And since next key frame of the corresponding key frame of the packet loss frame, the transmission of video frame is carried out.
6. a kind of video decoder, which is characterized in that be applied to video receiver, described device includes:
Detection module, for receive video sending end transmission video frame when, detect the video frame whether packet loss;
Packet loss frame determining module, for when detecting the video frame packet loss, by the view of the video frame of packet loss and the packet loss The associated frame of frequency frame is as packet loss frame;The associated frame of the video frame of the packet loss is the decoded view of video frame using the packet loss Frequency frame;
Decoder module, for being decoded processing to the video frame in addition to the packet loss frame.
7. device according to claim 6, which is characterized in that the detection module is also used to:
Described when detecting the video frame packet loss, the associated frame of the video frame of packet loss and the video frame of the packet loss is made Before packet loss frame, whether the communication quality for detecting the video receiver and the video sending end meets preset weak net item Part;If it is satisfied, trigger the packet loss frame determining module execute it is described by the video frame of packet loss and the video frame of the packet loss Associated frame is as packet loss frame.
8. according to the described in any item devices of claim 6 to 7, which is characterized in that the received video frame of video receiver Type include: key frame and non-key frame;The key frame is to utilize the decoded video frame of video frame itself;It is described non-key Frame is the associated frame of the key frame, and play time stamp is after corresponding key frame;
The packet loss frame determining module, is specifically used for:
When the detection module detects the video frame packet loss, the type of the video frame of packet loss is identified;When the packet loss When the type of video frame is key frame, the non-key frame of the video frame of video frame and the packet loss to the packet loss is carried out Discard processing.
9. a kind of electronic equipment, which is characterized in that including processor, communication interface, memory and communication bus, wherein described Processor, the communication interface, the memory complete mutual communication by bus;The memory, based on storing Calculation machine program;The processor is realized for executing the program stored on the memory such as any institute of claim 1-5 The method and step stated.
10. a kind of computer readable storage medium, which is characterized in that computer program is stored in the storage medium, it is described Method and step a method as claimed in any one of claims 1 to 5 is realized when computer program is executed by processor.
CN201910781418.3A 2019-08-23 2019-08-23 Video encoding/decoding method, device and equipment Pending CN110519598A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910781418.3A CN110519598A (en) 2019-08-23 2019-08-23 Video encoding/decoding method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910781418.3A CN110519598A (en) 2019-08-23 2019-08-23 Video encoding/decoding method, device and equipment

Publications (1)

Publication Number Publication Date
CN110519598A true CN110519598A (en) 2019-11-29

Family

ID=68626253

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910781418.3A Pending CN110519598A (en) 2019-08-23 2019-08-23 Video encoding/decoding method, device and equipment

Country Status (1)

Country Link
CN (1) CN110519598A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114465993A (en) * 2022-01-24 2022-05-10 杭州网易智企科技有限公司 Video encoding method, video decoding method and apparatus, medium, and computing device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533387A (en) * 2013-10-21 2014-01-22 腾讯科技(深圳)有限公司 Live video control method, equipment and system
CN104703053A (en) * 2015-03-11 2015-06-10 青岛海尔智能家电科技有限公司 Packet loss processing method, device and system of video transmission process
CN105357592A (en) * 2015-10-26 2016-02-24 山东大学苏州研究院 Selective frame dropping method for streaming media adaptive transmission
CN105933319A (en) * 2016-05-30 2016-09-07 贵阳朗玛信息技术股份有限公司 Method and device for transmitting and receiving video data packets
CN106303693A (en) * 2015-05-25 2017-01-04 北京视联动力国际信息技术有限公司 A kind of method and device of video data decoding
US20180034594A1 (en) * 2013-08-19 2018-02-01 Zoom Video Communications, Inc. Error Resilience for Interactive Real-Time Multimedia Application
CN108924574A (en) * 2018-08-01 2018-11-30 广州视源电子科技股份有限公司 Loss treating method, device, equipment and storage medium in recording and broadcasting system
CN108965308A (en) * 2018-07-26 2018-12-07 西安万像电子科技有限公司 Transmit the methods, devices and systems of data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180034594A1 (en) * 2013-08-19 2018-02-01 Zoom Video Communications, Inc. Error Resilience for Interactive Real-Time Multimedia Application
CN103533387A (en) * 2013-10-21 2014-01-22 腾讯科技(深圳)有限公司 Live video control method, equipment and system
CN104703053A (en) * 2015-03-11 2015-06-10 青岛海尔智能家电科技有限公司 Packet loss processing method, device and system of video transmission process
CN106303693A (en) * 2015-05-25 2017-01-04 北京视联动力国际信息技术有限公司 A kind of method and device of video data decoding
CN105357592A (en) * 2015-10-26 2016-02-24 山东大学苏州研究院 Selective frame dropping method for streaming media adaptive transmission
CN105933319A (en) * 2016-05-30 2016-09-07 贵阳朗玛信息技术股份有限公司 Method and device for transmitting and receiving video data packets
CN108965308A (en) * 2018-07-26 2018-12-07 西安万像电子科技有限公司 Transmit the methods, devices and systems of data
CN108924574A (en) * 2018-08-01 2018-11-30 广州视源电子科技股份有限公司 Loss treating method, device, equipment and storage medium in recording and broadcasting system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114465993A (en) * 2022-01-24 2022-05-10 杭州网易智企科技有限公司 Video encoding method, video decoding method and apparatus, medium, and computing device
CN114465993B (en) * 2022-01-24 2023-11-10 杭州网易智企科技有限公司 Video encoding method, video decoding method and device, medium and computing device

Similar Documents

Publication Publication Date Title
US7984342B2 (en) System and method for MPEG CRC error based video network fault detection
CN110312147B (en) Method, system and storage medium for service data transmission
MX2015004596A (en) Method and apparatus for media data delivery control.
CN105308916A (en) Method and apparatus for controlling media delivery in multimedia transport network
CN101026555A (en) Discarded packet indicator
US20190342723A1 (en) Wireless communication apparatus, wireless communication method, and program for using a threshold to control multicast retransmission
CN104320669A (en) Video transmission method and apparatus
EP3254491B1 (en) Centralized application level multicasting with peer-assisted application level feedback for scalable multimedia data distribution in wifi miracast
CN110169030A (en) For sending the method and its equipment of content on heterogeneous network
EP3254490B1 (en) Unified service discovery with peer-assisted resource management for service mediation and addressing control in wifi-miracast
CN110300278A (en) Video transmission method and equipment
CN110519598A (en) Video encoding/decoding method, device and equipment
CN103929682A (en) Method and device for setting key frames in video live broadcast system
CN108540273B (en) Method and device for retransmitting data packet
CN109996088A (en) A kind of live data processing method and processing device
EP1802120B1 (en) Information presentation system, device and methods
CN106162375A (en) Image player and image playing method
CN104904170A (en) Method and apparatus for efficiently prioritizing elements in a video stream for low-bandwidth transmission
US20150149593A1 (en) Virtual desktop infrastructure server, computer implemented video streaming method, and non-transitory computer readable storage medium thereof
CN112055174B (en) Video transmission method and device and computer readable storage medium
US10291545B2 (en) Method and apparatus for setting communicating session
US20180213271A1 (en) Location-based system and method for controlling content distribution to a set top box
CN114466397B (en) TCP communication quality evaluation method and device and electronic equipment
US20080031133A1 (en) Transmission of time-dependant data
CN110248257A (en) Data transmission method, device, network access equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210525

Address after: 25, 5th floor, shuangjingfang office building, 3 frisha street, Singapore

Applicant after: Zhuomi Private Ltd.

Address before: Room 1101, Santai Commercial Building, 139 Connaught Road, Hong Kong, China

Applicant before: HONG KONG LIVE.ME Corp.,Ltd.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20191129

RJ01 Rejection of invention patent application after publication