CN102316360A - Video refreshing method, device and system - Google Patents
Video refreshing method, device and system Download PDFInfo
- Publication number
- CN102316360A CN102316360A CN2010102223595A CN201010222359A CN102316360A CN 102316360 A CN102316360 A CN 102316360A CN 2010102223595 A CN2010102223595 A CN 2010102223595A CN 201010222359 A CN201010222359 A CN 201010222359A CN 102316360 A CN102316360 A CN 102316360A
- Authority
- CN
- China
- Prior art keywords
- video
- message
- critical data
- packet loss
- control protocol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
Abstract
The embodiment of the invention discloses a video refreshing method, a video refreshing device and a video refreshing system, which relate to the technical field of video communication and solve the problems of relatively more data to be transmitted in I frame refreshing and relatively higher load in a bandwidth. The video refreshing method provided by the embodiment of the invention comprises the following steps of: receiving a key data application message from video code stream receiving equipment, wherein the key data application message comprises layer information corresponding to an applied data packet; performing key data coding on a layer represented by the layer information and a layer required to be decoded according to the layer represented by the layer information in a video image; and transmitting coded key data to the video code stream receiving equipment. The embodiment of the invention is mainly applied in the technical field of video communication, such as a video conference system, a video call technology and the like.
Description
Technical field
The present invention relates to the video communication technology field, relate in particular to video method for refreshing, Apparatus and system.
Background technology
In the normal video coding framework, the method that present frame carries out predictive coding with reference to other frame of video is called inter prediction encoding, has used the coded frame of inter prediction encoding to be called the P frame; The coding method with reference to any other frame of video is not called intraframe predictive coding, and the Zone Full in the two field picture has only used the coded frame of intraframe predictive coding to be called the I frame.
Inter prediction encoding can effectively reduce the time redundancy between the video image, improves encoding compression efficient.But inter prediction encoding also can be introduced the problem of error diffusion simultaneously, and for example: behind a certain frame generation packet loss, this packet corresponding codes frame of losing can't pass through correct decoding and obtain reconstructed image, causes having occurred erroneous frame; And the subsequent P two field picture can't be realized normal decoder equally owing to be referenced to this erroneous frame; So, the mistake that packet loss causes begins to be diffused into all follow-up P frames from the packet loss frame, till running into the I frame always.Say that in a sense the I frame belongs to a kind of of key frame.
In the prior art; Local transmitting apparatus is sending video code flow in the remote receiver process; Under the situation of video code flow generation packet loss or mistake; General at first is to be found through the mode of decoding or inspection bag sequence number by remote receiver, then by remote receiver through the specified command passage, will about " video refreshes " perhaps the message of " image packet loss " send to local transmitting apparatus.After local transmitting apparatus receives this message, just carry out the I frame and refresh, the coding output that packet loss or erroneous video frame carry out IDR (Instantaneous decoding refresh, decoding refreshes immediately) frame to taking place in the operation encoder in the video code flow.The IDR frame is called refresh frame immediately, a kind of for the I frame.After the decoder of remote receiver receives the IDR frame, all reference frames in packet loss or wrong pairing parameter set and the reference frame lists can take place to be set to invalidly, and utilize the IDR frame to correct the mistake that packet loss causes.
State in realization in the process that the I frame refreshes; The inventor finds to exist at least in the prior art following problem: if adopt hierarchical coding that video is encoded; Encode video into a basic layer and several enhancement layers; In this case, since " video refreshes " that the far-end transmitting apparatus sends perhaps " image packet loss " message can not carry any hierarchical information about the packet loss code stream.Therefore; Under the situation of hierarchical coding; Local transmitting apparatus still can't know it is which layer bit stream generation packet loss; Can only carry out the I frame to all layerings (comprising basic layer and all enhancement layers) simultaneously and refresh, this I frame refreshes mode and causes the data that need transmit bigger, and bandwidth is brought bigger load.
Summary of the invention
Embodiments of the invention provide a kind of video method for refreshing, Apparatus and system, reduce the data that need transmit when the video critical data refreshes, reduce the load that bandwidth is brought.
For achieving the above object, embodiments of the invention adopt following technical scheme:
A kind of video method for refreshing comprises:
The critical data solicitation message that receiver, video code stream receiving equipment sends comprises the packet hierarchical information of being applied in the said critical data solicitation message;
The critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded;
The critical data that said coding is obtained sends to said video code flow receiving equipment.
A kind of video refreshing apparatus is characterized in that, comprising:
Receiving element is used for the critical data solicitation message that receiver, video code stream receiving equipment sends, and comprises the packet hierarchical information of being applied in the said critical data solicitation message;
Coding unit, the layering that the layering that layering that is used for hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded carry out the critical data coding;
Transmitting element is used for the critical data that said coding obtains is sent to said video code flow receiving equipment.
A kind of video method for refreshing is characterized in that, comprising:
Generate the critical data solicitation message, comprise the packet hierarchical information of being applied in the said critical data solicitation message;
Send said critical data solicitation message to the video code flow transmitting apparatus, resend critical data with instruction video code stream transmitting apparatus.
A kind of video refreshing apparatus is characterized in that, comprising:
Generation unit is used to generate the critical data solicitation message, comprises the packet hierarchical information of being applied in the said critical data solicitation message;
Transmitting element is used for sending said critical data solicitation message to the video code flow transmitting apparatus, resends critical data with instruction video code stream transmitting apparatus.
A kind of video updating system is characterized in that, comprising:
The video code flow receiving equipment is used for the video code flow that receiver, video code stream transmitting apparatus sends, and generates the critical data solicitation message, comprises the packet hierarchical information of being applied in the said critical data solicitation message; And send said critical data solicitation message to the video code flow transmitting apparatus;
The video code flow transmitting apparatus is used to receive said critical data solicitation message, and the critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded; And said coding is obtained critical data send to said video code flow receiving equipment.
Video method for refreshing, Apparatus and system that the embodiment of the invention provides; Owing in the critical data solicitation message, comprised hierarchical information; So; Carry out the critical data coding carrying out the layering that layering that layering that the I frame can be only when refreshing representes said hierarchical information and needs represent according to said hierarchical information decodes, encode and need carry out critical data to all layerings in the prior art; So; The video method for refreshing, the Apparatus and system that adopt the embodiment of the invention to provide; Can lack than prior art so that need carry out the layering number of plies of critical data coding; Can to refresh the IDR frame data amount of time output less so that carry out the I frame, and then reduce the data that need transmit when the video critical data refreshes, reduce the load that bandwidth is brought.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is a video method for refreshing flow chart in the embodiment of the invention;
Fig. 2 is a video refreshing apparatus block diagram in the embodiment of the invention;
Fig. 3 is another video method for refreshing flow chart in the embodiment of the invention;
Fig. 4 is another video refreshing apparatus block diagram in the embodiment of the invention;
Fig. 5 is a video updating system schematic diagram in the embodiment of the invention;
Fig. 6 is the video updating system topological diagram of concrete utilization in the embodiment of the invention;
Fig. 7 is the command decode sketch map after one expansion of employing method in the embodiment of the invention 1;
Fig. 8 is the command decode sketch map that adopts in the embodiment of the invention 1 after method two is expanded;
Fig. 9 is a video method for refreshing flow chart in the embodiment of the invention 1;
Figure 10 is the command decode sketch map after one expansion of employing method in the embodiment of the invention 2;
Figure 11 is the command decode sketch map that adopts in the embodiment of the invention 2 after method two is expanded.
Embodiment
Hierarchical coding is meant and encodes video into a basic layer and several enhancement layers.Basic layer can independently be decoded, and is used to provide a basic still acceptable video quality; The decoding of enhancement layer generally depends on basic layer, and enhancement layer can provide than the better video quality of basic layer.Hierarchical coding mainly comprises following three types of hierarchical approaches:
(1) frame per second classification: basic layer uses original image, encodes with lower output frame rate, obtains lower fluency.Enhancement layer does not then carry out the image encoded frame to basic layer encodes, and on the basis of basic layer decoder image, improves its display frame rate.
(2) resolution classification: basic layer use encoded by the image that original image carries out sub-sampling gained low resolution, obtains lower resolution.Enhancement layer then carries out predictive coding by the original resolution image, on the basis of basic layer decoder image, improves its resolution.The coding of enhancement layer can with reference to the interpolation image of basic layer reconstructed image, also can be with reference to the motion vector of basic layer macro block, rebuild residual error coefficient.
(3) quality grading: basic layer uses original image, encodes with higher compression ratio (promptly bigger quantization step, lower encoded bandwidth), obtains lower definition; Enhancement layer then with reference to the reconstructed image of basic layer, is encoded with higher picture quality (being less quantization step, higher encoded bandwidth), on the basis of basic layer decoder image, improves its definition.
For the video communication scheme that adopts hierarchical coding, in order to reduce the data that need transmit when the video critical data refreshes, reduce the load that bandwidth is brought, the embodiment of the invention provides a kind of video method for refreshing, and is as shown in Figure 1, and said method comprises:
101, the video code flow receiving equipment sends a critical data solicitation message, in said critical data solicitation message, comprises the corresponding hierarchical information of being applied for of packet.
102, the video code flow transmitting apparatus in the embodiment of the invention is after receiving said critical data solicitation message; The critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded, and other are not needed then not carry out the critical data coding according to the layering that layerings that said hierarchical information is represented are decoded.
103, the resulting critical data of will encoding sends to said video code flow receiving equipment, so that the video code flow receiving equipment carries out handled according to this critical data.
The embodiment of the invention also provides a kind of video refreshing apparatus, and is as shown in Figure 2, and said device comprises: receiving element 21, coding unit 22, transmitting element 23.
Wherein, receiving element 21 is used for the critical data solicitation message that receiver, video code stream receiving equipment sends, and comprises the corresponding hierarchical information of being applied for of packet in the said critical data solicitation message; Coding unit 22 is used for according to said hierarchical information; The critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded, and other are not needed then not carry out the critical data coding according to the layering that layerings that said hierarchical information is represented are decoded; Transmitting element 23 is used for the resulting critical data of coding is sent to said video code flow receiving equipment, so that the video code flow receiving equipment carries out handled according to this critical data.
In order can accurately to encode to corresponding layering, coding unit described in the embodiment of the invention 22 also is used for obtaining the layering that said hierarchical information is represented from received critical data solicitation message.
Hierarchical information in the embodiment of the invention can be different according to concrete hierarchical coding mode difference; As: video image can carry out layering according to frame per second classification, resolution classification or quality grading, and its corresponding hierarchical information can be respectively: the layering of the layering of different frame per second, the layering of different resolution, different quality.
The critical data solicitation message that said receiving element 21 receives is: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
In order to carry above-mentioned critical data solicitation message, the embodiment of the invention can adopt multimedia control protocol or video communication feedback information agreement or RTCP Real-time Transport Control Protocol to carry, and specifically comprises following three kinds of implementations:
The first, carry said critical data solicitation message through the parameter of original message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back.
The second, carry said critical data solicitation message through the reservation message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back.
Three, through the said critical data solicitation message of message bearing in newly-increased multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol.
The embodiment of the invention also provides a kind of video method for refreshing, and is as shown in Figure 5, comprising:
301, when needs request video code flow transmitting apparatus resends critical data; Generate the critical data solicitation message; Comprise the packet hierarchical information of being applied in the said critical data solicitation message, the hierarchical information here mainly is meant the corresponding layering of data that need resend.
Generally speaking, detecting packet loss or error code or when out of order, incorrect phenomenon has appearred in the expression critical data, need send said critical data solicitation message this moment to the video code flow transmitting apparatus; Perhaps periodically send said critical data solicitation message to the video code flow transmitting apparatus.
302, send the critical data solicitation message to the video code flow transmitting apparatus, resend critical data with instruction video code stream transmitting apparatus.
The implementation of the solicitation message of critical data described in the embodiment of the invention includes but not limited to following mode: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
The embodiment of the invention also provides a kind of video refreshing apparatus, and is as shown in Figure 4, and said video refreshing apparatus comprises generation unit 41 and transmitting element 42.
When needs request video code flow transmitting apparatus resend critical data, generation unit 41 was used to generate the critical data solicitation message, comprised the packet hierarchical information of being applied in the said critical data solicitation message; The hierarchical information here mainly is meant the corresponding layering of data that need resend.Transmitting element 42 is used for sending said critical data solicitation message to the video code flow transmitting apparatus, resends critical data with instruction video code stream transmitting apparatus.
The critical data solicitation message that transmitting element described in the embodiment of the invention 42 sends can adopt but be not limited to following mode: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
In different communication systems, because the communication protocol that adopts is different, the critical data solicitation message can adopt different protocol to carry, as: multimedia control protocol or video communication feedback information agreement or RTCP Real-time Transport Control Protocol etc.Particularly, include but not limited to following bearing mode:
The first, carry said critical data solicitation message through the parameter of original message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back.
The second, carry said critical data solicitation message through the reservation message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back.
Three, through the said critical data solicitation message of message bearing in newly-increased multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol.
The embodiment of the invention also provides a kind of video updating system, and is as shown in Figure 5, and said system comprises: video code flow transmitting apparatus 51, video code flow receiving equipment 52.
Wherein, video code flow transmitting apparatus 51 video code flow that will transmit sends to video code flow receiving equipment 52; Said video code flow receiving equipment 52 is used for the video code flow that receiver, video code stream transmitting apparatus 51 sends; And generate the critical data solicitation message under certain condition and send the critical data solicitation message to video code flow transmitting apparatus 51, comprise the corresponding hierarchical information of being applied for of packet in the said critical data solicitation message.The certain condition that sends the critical data solicitation message in the embodiment of the invention can include but not limited to following condition: detect packet loss or error code or out of order; Perhaps can periodically generate in the embodiment of the invention and send said critical data solicitation message to the video code flow transmitting apparatus.
Said video code flow transmitting apparatus 51 is used to receive said critical data solicitation message, and the critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded; And the resulting critical data of will encoding sends to said video code flow receiving equipment 52, so that video code flow receiving equipment 52 carries out handled according to this critical data.
Particularly, above-mentioned video code flow receiving equipment 52 can be found to have packet loss in the video code flow through decoding or inspection bag sequence number.
Video method for refreshing, Apparatus and system that the embodiment of the invention provides; Owing in the critical data solicitation message, comprised the corresponding hierarchical information of being applied for of packet; So; Carry out the critical data coding carrying out the layering that layering that layering that the I frame can be only when refreshing representes said hierarchical information and needs represent according to said hierarchical information decodes, encode and need carry out critical data to all layerings in the prior art; So; Method for refreshing, the Apparatus and system of the video critical data that the employing embodiment of the invention provides; Can lack than prior art so that need carry out the layering number of plies of critical data coding; Can to refresh the data volume of IDR frame of time output less so that carry out the I frame, and then reduce the data that need transmit when the video critical data refreshes, reduce the load that bandwidth is brought.
The application scenarios of the embodiment of the invention specifically can be as shown in Figure 6, supposes that local terminal T0 (video code flow transmitting apparatus) and distance terminal T1, T2, T3 (video code flow receiving equipment) carry out video conference; And local terminal T0 specifically comprises this layer of roadbed Layer1 and two-way enhancement layer Layer2, Layer3 to the scheme of local image employing hierarchical coding; The referring-to relation of each layer be Layer2 with reference to Layer1, Layer3 is with reference to Layer2.
Local terminal T0 transmits required separately layered code stream through MCU (Multipoint control unit, multipoint control unit) to T1, T2, T3, and is as shown in Figure 6.Suppose that distance terminal T3 finds that packet loss appears in Layer2; Adopt being treated to that the method that provides of the present invention carries out: distance terminal T3 sends the critical data solicitation message to local terminal T0, and in the critical data solicitation message, feeds back to local terminal T0 to the hierarchical information of Layer2; T0 is according to the decoding dependence between Layer1, Layer2, the Layer3; Carry out the critical data coding to Layer2, Layer3; And the critical data that coding obtains is sent to distance terminal T3, refresh, do not carry out any operation for Layer1 so that carry out the I frame.
Certainly; In particular cases; If packet loss occurs in the code stream that hierarchical coding is transcoded onto non-layered coding the code stream that is transcoded onto AVC (Advanced videocoding, advanced video coding) like SVC (Scalable video coding, scalable video coding); Because decoder can't obtain hierarchical information, the local terminal need all be carried out the I frame to all layers and refreshed this moment.
Through method provided by the invention, under the situation of indivedual layering generation packet losses, decoding end can be given coding side with the feedback information of which figure layer generation packet loss; Other layerings that coding side can be only relies on the packet loss layering to packet loss layering and decoding are carried out the I frame and are refreshed, and avoid refreshing to cause and needing the data volume of transmission excessive because of all layerings being carried out the I frame, can reduce the load that bandwidth is brought; And under band-limited situation, effectively avoid the serious problem that descends of quality of coded picture; The method that the embodiment of the invention provides did not have the layered code stream of packet loss can not produce any influence for those originally.
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
Embodiment 1:
The application scenarios of the embodiment of the invention is: communicate through the message of agreement H.245 between video code flow transmitting apparatus and the video code flow receiving equipment, wherein H.245 be multimedia control protocol (Controlprotocol for multimedia communication).In the suggestion that ITU-T (International Telecommunication Association) announces; H.323 protocol suite is the most important standard of next generation multimedia conferencing technology and equipment, the audio frequency of the device end that it has stipulated different vendor on LAN (local area network (LAN)), Internet (the Internet) etc., video and the various combining forms of the data desired mode of operation of communicating by letter each other T.120.Comprising H.225, H.245 wait.It wherein H.245 is the control command agreement in the multimedia communication system H.323.
The superiors system control message of MultimediaSystemControlMessage for defining in the agreement H.245, this message specifically sees the following form in the prior art:
Can find out that through last table RequestMessage (request message), ResponseMessage (response message), CommandMessage (command messages) and IndicationMessage (Indication message) are one of options of MultimediaSystemControlMessage.
Wherein, One of option of above-mentioned CommandMessage comprises MiscellaneousCommand (mixing order); Can realize as issuing orders through MiscellaneousCommand: videoFastUpdatePicture (the quick refresh command of video), videoFastUpdateGOB (the quick refresh command of macro block group), videoFastUpdateMB (the quick refresh command of macro block), videoBadMBs (macro block packet loss message), lostPicture (visual packet loss message), lostPartialPicture (image is packet loss message in detail); Above-mentioned each order can be used as under the environment of packet loss, carries out the message of I frame application.But above order, or can not carry parameter, or can only carry the frame number of packet loss, the relevant parameter of image-region, all do not carry the hierarchical information of packet loss code stream.Therefore, H.245 standard commands message can't be fed back the hierarchical information of packet loss code stream.
For communicating situation through the command messages of agreement H.245 between video code flow transmitting apparatus and the video code flow receiving equipment; For the command messages that makes the video code flow receiving equipment return can carry hierarchical information; H.245 the embodiment of the invention at first need be expanded, so that the indication hierarchical information.
The expansion to H.245 of the embodiment of the invention includes but not limited to following method:
Method one: on the basis of original command messages that can be used for the application of I frame H.245, carry out parameter expanding.Particularly be on original MiscellaneousCommand message basis, to add following parameter: dependency_id (the resolution hierarchical level of figure layer), quality_id (the quality grading progression of figure layer), temporal_id (the frame per second hierarchical level of figure layer).The embodiment of the invention is that example describes with the wherein six kinds of message in the MiscellaneousCommand message; They are respectively: videoFastUpdatePicture (the quick refresh command of video), videoFastUpdateGOB (the quick refresh command of macro block group), videoFastUpdateMB (the quick refresh command of macro block), videoBadMBs (macro block packet loss message), lostPicture (visual packet loss message), lostPartialPicture (image is packet loss message in detail), and MiscellaneousCommand table specific as follows after the expansion:
The parameter that underscore marks in the last table is the newly-increased parameter in expansion back; Its corresponding resolving is as shown in Figure 7; At first need carry out the judgement of type of message to MiscellaneousCommand message; Can be respectively after drawing type in the table the various message of MiscellaneousCommand message resolve, as can be seen from Figure 7 in the end all comprise resolution hierarchical level or quality grading progression or frame per second hierarchical level in the analysis result.
Method two: use nonstandard message (being equivalent to reservation message) H.245; Carry out the expansion of type of message; Add " the quick refresh command of video " or " visual packet loss message ", carrying him in " the quick refresh command of video " that is added or " the visual packet loss message " has correlation diagram layer hierarchical information parameter.Concrete hierarchical information parameter can comprise dependency_id (the resolution hierarchical level of figure layer) or quality_id (the quality grading progression of figure layer) or temporal_id (the frame per second hierarchical level of figure layer).
In the system control message MultimediaSystemControlMessage of the superiors H.245, include NonStandardMessage (nonstandard message) in the option of RequestMessage (request message), ResponseMessage (response message), CommandMessage (command messages), IndicationMessage (Indication message).Therefore, can use NonStandardMessage to expand corresponding type of message respectively, NonStandardMessage defines like following table in the existing H.245 agreement:
NonStandardParameter defines like following table:
The NonStandardIdentifier that is comprised among wherein above-mentioned NonStandardParameter and the NonStandardMessage is used to identify the message of expansion; And OCTET STRING is used to fill concrete message content.
Present embodiment uses the control messages that is used for hierarchical coding of CommandMessage_SVC sign expansion; Be that command.nonStandar.nonStandardData.nonStandardIdentifier equals CommandMessage_SVC, command.nonStandar.nonStandardData.data is used to fill the message content of CommandMessage_SVC.The concrete definition as follows:
VideoFastUpdatePicture_SVC is " to the video fast update instruction of layered code stream " in the last table, and lostPicture_SVC is " to the image packet loss message of layered code stream ", has all comprised the hierarchical information of correlation diagram layer.Its corresponding resolving is as shown in Figure 8; At first need carry out the judgement of type of message to the command messages of hierarchical coding; Can be respectively after drawing type in the table the various message of the command messages of hierarchical coding resolve, two kinds of message that as can be seen from Figure 8 go up in the table in the end all comprise resolution hierarchical level or quality grading progression or frame per second hierarchical level in the analysis result.
Except above-mentioned two kinds the method, can also be in newly-increased message in the agreement H.245, and in newly-increased message, resolution hierarchical level or quality grading progression or frame per second hierarchical level are set, so that carry hierarchical information.
To after H.245 agreement is expanded, the video method for refreshing that the embodiment of the invention provides, as shown in Figure 9, said method comprises:
901, the video code flow receiving equipment generates the critical data solicitation message, comprises the corresponding hierarchical information of being applied for of packet in the said critical data solicitation message.Critical data solicitation message in the present embodiment is the message after the above-mentioned H.245 protocol extension; So that carry hierarchical information; Particularly can be chosen on original message basis and expand; Also can also can increase H.245 protocol message newly, so that the message after the expansion comprises resolution hierarchical level or quality grading progression or frame per second hierarchical level to nonstandard extension of message H.245.
902, the video code flow receiving equipment sends said critical data solicitation message to the video code flow transmitting apparatus.
The embodiment of the invention does not limit the condition of sending the critical data solicitation message; During practical implementation; The video code flow receiving equipment can periodically send said critical data solicitation message to the video code flow transmitting apparatus, as every at a distance from 5 minutes, perhaps sent a critical data solicitation message in 10 minutes; Also can send said critical data solicitation message in unusual detecting critical data, as: detect packet loss or error code or when out of order, send said critical data solicitation message to the video code flow transmitting apparatus.
903, after the video code flow transmitting apparatus then receives said critical data solicitation message, need carry out the layering of critical data coding according to the hierarchical information affirmation in the said critical data solicitation message.
904, the critical data coding is carried out in the layering represented according to said hierarchical information of layering that hierarchical information described in the video image is represented of video code flow transmitting apparatus and the needs layering of decoding, and other are not needed then not carry out the critical data coding according to the layering that layerings that said hierarchical information is represented are decoded.
905, the video code flow transmitting apparatus resulting critical data of will encoding sends to said video code flow receiving equipment, carries out the I frame and refreshes, so that the video code flow receiving equipment carries out handled according to this critical data.The handled of present embodiment comprises the error correcting of critical data, timing renewal of critical data or the like.
Embodiment 2:
The application scenarios of the embodiment of the invention is: communicate through the message of agreement H.271 between video code flow transmitting apparatus and the video code flow receiving equipment; H.271 agreement wherein is video communication feedback information agreement (H.Video back-channel messages for conveyance of status informationand requests from a video receiver to a video sender); Be specifically designed to video reception apparatus through the feedback information passage; To video transmitting apparatus transferring status data and command request, can be used for H.261, H.263, video protocols H.264.
H.271 the type of message that can realize and corresponding load type, as shown in the table.
| payloadType | Message/instruction |
| 0 | One frame or multiframe do not have the image of detected |
| 1 | The image that one frame or multiframe are lost wholly or in |
| 2 | One group of macro block (belonging to same two field picture) of losing wholly or in |
| 3 | The CRC check sign indicating number of a parameter set |
| 4 | The CRC check sign indicating number of all parameter sets of same type |
| 5 | The code stream buffer memory of replacement code stream transmitting apparatus |
| ＞5 | Reservation is used by ITU-T in the future |
Comprise following two kinds in the concrete packet loss message of existing H.271 syntactic structure:
(1) image packet loss message (payload=1) can be passed through start image frame number, totalframes that parameter ref_pic_id, delta_ref_pic_id obtain to take place packet loss.
(2) macro block group packet loss message (payload=2) can be passed through image frame number, image-region that parameter ref_pic_id, first_blk_lost, num_blks_lost_minus1, top_left_blk, bottom_right_blk obtain to take place packet loss.
More than two kinds of message all can be used as the message of under the environment of packet loss, carrying out the application of I frame.But above these feedback messages all do not carry the hierarchical information that parameter is indicated the packet loss code stream, and therefore, standard message type H.271 can't be fed back the hierarchical information of packet loss code stream equally.
For communicating situation through the message of agreement H.271 between video code flow transmitting apparatus and the video code flow receiving equipment; For the message that makes the video code flow receiving equipment return can be carried hierarchical information; H.271 the embodiment of the invention at first need be expanded, so that the indication hierarchical information.
The expansion to H.271 of the embodiment of the invention includes but not limited to following method:
Method one: on the basis of original feedback message that can be used for the application of I frame H.271, carry out parameter expanding.Just be that image packet loss message (payload=1) and macro block group packet loss message (payload=2) are carried out the parameter expansion, parameter d ependency_id on adding at the message end (the resolution hierarchical level of figure layer), quality_id (scheming the quality grading progression of layer), temporal_id (the frame per second hierarchical level of figure layer).
Through the message syntax structure H.271 after the parameter expansion, as shown in the table:
| msg_payload(payloadType，payloadSize){ | Descriptor |
| if(payloadType＜＝4) | |
| ?ref_pic_id | u(32) |
| if(payloadType＝＝0){ | |
| ?num_ref_pics_minus1 | ue(v) |
| ?for(i＝1；i＜＝num_ref_pics_minus1；i++) | |
| good_ref_pi?c_id[i] | u(32) |
| }elseif(payloadType＝＝1) | |
| delta_ref_pic_id | ue(v) |
| else?if(payloadType＝＝2){ | |
| ?data_partition_idc | ue(v) |
| ?run_length_flag | u(1) |
| ?if(run_length_flag){ | |
| first_blk_lost | ue(v) |
| num_blks_lost_minus1 | ue(v) |
| ?}else{ | |
| ?top_left_blk | ue(v) |
| ?bottom_right_blk | ue(v) |
| ?} | |
| }else?if((payloadType＝＝3)||(payloadType＝＝4)){ | |
| param_set_type | ue(v) |
| param_set_crc | u(16) |
| if(payloadType＝＝3) | |
| ?param_set_id | ue(v) |
| ?} | |
| The new grammer parameter of adding of/*, be used to indicate the hierarchical information * of packet loss code stream/ | |
| if((payloadType＝＝1)||(payloadType＝＝2)){ | |
| Lost_layer_info_idc/* whether in code stream, write the hierarchical information * of packet loss/ | u(1) |
| ?if(lost_layer_info_idc){ | |
| The figure number of plies that packet loss takes place lost_layers_minus1/* subtract 1*/ | ue(v) |
| ?for(i＝1；i＜＝lost_layers_minus1；i++){ | |
| The resolution hierarchical level * of dependency_id [i]/* packet loss figure layer/ | ue(v) |
| The quality grading progression * of quality_id [i]/* packet loss figure layer/ | ue(v) |
| The frame per second hierarchical level * of temporal_id [i]/* packet loss figure layer/ | ue(v) |
| ?} | |
| } | |
| ?} | |
| ?stop_one_bit/*equal?to?1*/ | f(1) |
| ?while(！byte_aligned()) | |
| alignment_zero_bit/*equal?to?0*/ | f(1) |
| } |
The newly-increased parameter in expansion back comprises dependency_id or quality_id or temporal_id; Its corresponding resolving is shown in figure 10; At first need carry out the judgement of type of message; After obtaining type of message, can resolve this message, concrete various message in the end analysis result all comprises resolution hierarchical level or quality grading progression or frame per second hierarchical level referring to Figure 10 in analysis result.
Method two: use reservation message H.271, carry out the expansion of feedback message type, add " visual packet loss message " and carry correlation diagram layer hierarchical information parameter in this " visual packet loss message ".Concrete hierarchical information parameter comprises dependency_id (the resolution hierarchical level of figure layer) or quality_id (the quality grading progression of figure layer) or temporal_id (the frame per second hierarchical level of figure layer).
H.271 the type of message for (payloadType＞5) in all is to keep and do not do to use; Below to use payloadType=6 to be example; Explain how to pass through the reservation message type, " the visual packet loss message " of correlation diagram layer hierarchical information parameter is carried in expansion.Through the message syntax structure H.271 after the type of message expansion, as shown in the table.
| msg_payload(payloadType，payloadSize){ | Descriptor |
| if((payloadType＜＝4)||(payloadType＝＝6)) | |
| ?ref_pic_id | u(32) |
| if(payloadType＝＝0){ | |
| ?num_ref_pics_minus1 | ue(v) |
| ?for(i＝1；i＜＝num_ref_pics_minus1；i++) | |
| good_ref_pic_id[i] | u(32) |
| ?}else?if(payloadType＝＝1) | |
| ?delta_ref_pic_id | ue(v) |
| ?else?if(payloadType＝＝2){ | |
| data_partition_idc | ue(v) |
| run_length_flag | u(1) |
| if(run_length_flag){ | |
| ?first_blk_lost | ue(v) |
| ?num_blks_lost_minus1 | ue(v) |
| }else{ | |
| top_left_blk | ue(v) |
| bottom_right_blk | ue(v) |
| } | |
| }else?if((payloadType＝＝3)||(payloadType＝＝4)){ | |
| ?param_set_type | ue(v) |
| ?param_set_crc | u(16) |
| ?if(payloadType＝＝3) | |
| param_set_id | ue(v) |
| } | |
| The new grammer parameter of adding of/*, be used to indicate the hierarchical information * of packet loss code stream/ | |
| if(payloadType＝＝6){ | |
| The figure number of plies that packet loss takes place lost_layers_minus1/* subtract 1*/ | ue(v) |
| ?for(i＝1；i＜＝lost_layers_minus1；i++){ | |
| The resolution hierarchical level * of dependency_id [i]/* packet loss figure layer/ | ue(v) |
| The quality grading progression * of quality_id [i]/* packet loss figure layer/ | ue(v) |
| The frame per second hierarchical level * of temporal_id [i]/* packet loss figure layer/ | ue(v) |
| ?} | |
| } | |
| stop_one_bit/*equal?to?1*/ | f(1) |
| while(！byt?e_aligned()) | |
| ?alignment_zero_bit/*equal?to?0*/ | f(1) |
| } |
The newly-increased parameter in reservation message expansion back for payloadType=6 comprises dependency_id or quality_id or temporal_id; Its corresponding resolving is shown in figure 11; At first need judge type of message; After drawing type of message, message is resolved, as can be seen from Figure 11 various dissimilar message in the end all comprise resolution hierarchical level or quality grading progression or frame per second hierarchical level in the analysis result.
Except above-mentioned two kinds the method, can also be in newly-increased message in the agreement H.271, and in newly-increased message, resolution hierarchical level or quality grading progression or frame per second hierarchical level are set, so that carry hierarchical information.
To after H.271 agreement is expanded; Video method for refreshing that the embodiment of the invention provides and the similar process of Fig. 9; Difference is that the critical data solicitation message in the embodiment of the invention is the message after the above-mentioned H.271 protocol extension; So that carry hierarchical information, particularly can be chosen on original message basis and expand, also can be to reservation message expansion H.271; Also can increase H.271 protocol message newly, so that the message after the expansion comprises resolution hierarchical level or quality grading progression or frame per second hierarchical level.
Embodiment 3:
The application scenarios of the embodiment of the invention is: pass through RTCP Real-time Transport Control Protocol (RTCP between video code flow transmitting apparatus and the video code flow receiving equipment; Realtime transport control protocol) message communicates; Wherein RTCP Real-time Transport Control Protocol is in charge of transmission quality, exchange of control information between the current application process.Between RTP (Realtime transport protocol, RTP) session, each participant periodically transmits the RTCP bag, contains the quantity of data packets of having sent, the statistical informations such as quantity of data packets of losing in the bag.
According to the RFC4585 definition, RTCP provides the feedback information type of following several kinds of load layers and application layer.
| FMT | Message |
| 0 | |
| 1 | Image |
| 2 | Slice |
| 3 | The correct decode messages of image (indicating available reference frame) |
| 4-14 | Keep |
| 15 | The application layer feedback message |
| 16-30 | Keep |
| 31 | Keep expansion as sequence number |
Wherein, image packet loss message (FMT=1) is not carry parameter, and promptly FCI (feedback message content) is empty; The frame number that Slice (band) packet loss message (FMT=2) has been carried relevant parameter indication packet loss and image-region (the initial macro block of generation packet loss number and macroblock number), the structure of FCI is following.
Image packet loss message (FMT=1) and Slice packet loss message (FMT=2) all can be used as the message of under the environment of packet loss, carrying out the application of I frame.But above these feedback messages all do not carry the hierarchical information that parameter is indicated the packet loss code stream, and therefore, the standard message type of RTCP can't be fed back the hierarchical information of packet loss code stream equally.
Communicate situation for the message through rtcp protocol between video code flow transmitting apparatus and the video code flow receiving equipment; For the message that makes the video code flow receiving equipment return can be carried hierarchical information; The embodiment of the invention at first need be expanded RTCP, so that the indication hierarchical information.
The expansion to RTCP of the embodiment of the invention includes but not limited to following method:
Method one: on the basis of the original feedback message type that can be used for the application of I frame of RTCP, carry out parameter expanding.Just be that image packet loss message (FMT=1) and Slice packet loss message (FMT=2) are carried out the parameter expansion, parameter d ependency_id (the resolution hierarchical level of figure layer) or quality_id (scheming the quality grading progression of layer) or temporal_id (the frame per second hierarchical level of figure layer) on adding at the end of original FCI.
FCI structure through the image packet loss message (FMT=1) after the parameter expansion is as follows.
FCI structure through the Slice packet loss message (FMT=2) after the parameter expansion is as follows.
Method two: use the RTCP reservation message, carry out the expansion of message, add " visual packet loss message ", should carry correlation diagram layer hierarchical information parameter in " visual packet loss message ".Particularly, the hierarchical information parameter comprises dependency_id (the resolution hierarchical level of figure layer) or quality_id (the quality grading progression of figure layer) or temporal_id (the frame per second hierarchical level of figure layer).
For the load layer feedback message type of (FMT=4-14) scope, all be to keep and do not do to use among the RTCP.To use (FMT=14) to be example, explain and how to pass through the feedback message type that RTCP keeps, " the visual packet loss message " of correlation diagram layer hierarchical information parameter is carried in expansion below.The FCI structure of new image expanding packet loss message (FMT=14), as follows.
Except above-mentioned two kinds the method, can also in rtcp protocol, increase message newly, and in newly-increased message, resolution hierarchical level or quality grading progression or frame per second hierarchical level are set, so that carry hierarchical information.
After rtcp protocol is expanded; Video method for refreshing that the embodiment of the invention provides and the similar process of Fig. 9; Difference is that the critical data solicitation message in the embodiment of the invention is the message after the above-mentioned rtcp protocol expansion; So that carry hierarchical information, particularly can be chosen on original message basis and expand, also can be to the reservation message expansion of RTCP; Also can increase rtcp protocol message newly, so that the message after the expansion comprises resolution hierarchical level or quality grading progression or frame per second hierarchical level.
The embodiment of the invention is mainly used in the video communication technology field, for example video conferencing system, video calling technology or the like.
Through the description of above execution mode, the those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential common hardware, can certainly pass through hardware, but the former is better execution mode under a lot of situation.Based on such understanding; The part that technical scheme of the present invention contributes to prior art in essence in other words can be come out with the embodied of software product, and this computer software product is stored in the storage medium that can read, like the floppy disk of computer; Hard disk or CD etc.; Comprise some instructions with so that computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
The above; Be merely embodiment of the present invention, but protection scope of the present invention is not limited thereto, any technical staff who is familiar with the present technique field is in the technical scope that the present invention discloses; Can expect easily changing or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by said protection range with claim.
Claims (19)
1. a video method for refreshing is characterized in that, comprising:
The critical data solicitation message that receiver, video code stream receiving equipment sends comprises the packet hierarchical information of being applied in the said critical data solicitation message;
The critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded;
The critical data that said coding is obtained sends to said video code flow receiving equipment.
2. video method for refreshing according to claim 1 is characterized in that, said video image carries out layering according to frame per second classification, resolution classification or quality grading.
3. video method for refreshing according to claim 1; It is characterized in that said critical data solicitation message is: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
4. video method for refreshing according to claim 1; It is characterized in that, carry said critical data solicitation message through the parameter of original message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps carry said critical data solicitation message through the reservation message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps through the said critical data solicitation message of message bearing in newly-increased multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol.
5. video method for refreshing according to claim 1 is characterized in that, the critical data that said coding obtains comprises: crucial coded data, or crucial macroblock coding data, or crucial hierarchical coding data.
6. a video refreshing apparatus is characterized in that, comprising:
Receiving element is used for the critical data solicitation message that receiver, video code stream receiving equipment sends, and comprises the packet hierarchical information of being applied in the said critical data solicitation message;
Coding unit, the layering that the layering that layering that is used for hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded carry out the critical data coding;
Transmitting element is used for the critical data that said coding obtains is sent to said video code flow receiving equipment.
7. video refreshing apparatus according to claim 6 is characterized in that, said video image carries out layering according to frame per second classification, resolution classification or quality grading.
8. video refreshing apparatus according to claim 6 is characterized in that, said coding unit also is used for obtaining the layering that said hierarchical information is represented from received critical data solicitation message.
9. video refreshing apparatus according to claim 6 is characterized in that, the critical data that said transmitting element sends comprises: crucial coded data, or crucial macroblock coding data, or crucial hierarchical coding data.
10. a video method for refreshing is characterized in that, comprising:
Generate the critical data solicitation message, comprise the packet hierarchical information of being applied in the said critical data solicitation message;
Send said critical data solicitation message to the video code flow transmitting apparatus, resend critical data with instruction video code stream transmitting apparatus.
11. according to the said video method for refreshing of claim 10; It is characterized in that; Said generation critical data solicitation message is: detecting packet loss or error code or generating said critical data solicitation message when out of order, perhaps periodically generate said critical data solicitation message.
12. according to the said video method for refreshing of claim 10; It is characterized in that said critical data solicitation message is: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
13. according to the said video method for refreshing of claim 10; It is characterized in that, carry said critical data solicitation message through the parameter of original message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps carry said critical data solicitation message through the reservation message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps through the said critical data solicitation message of message bearing in newly-increased multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol.
14. a video refreshing apparatus is characterized in that, comprising:
Generation unit is used to generate the critical data solicitation message, comprises the packet hierarchical information of being applied in the said critical data solicitation message;
Transmitting element is used for sending said critical data solicitation message to the video code flow transmitting apparatus, resends critical data with instruction video code stream transmitting apparatus.
15. video refreshing apparatus according to claim 14 is characterized in that, said generation unit is detecting packet loss or error code or is generating said critical data solicitation message when out of order, perhaps periodically generates and said critical data solicitation message.
16. video refreshing apparatus according to claim 14; It is characterized in that the critical data solicitation message that said generation unit generates is: quick refresh command of the video in the multimedia control protocol or the quick refresh command of macro block group or the quick refresh command of macro block or macro block packet loss message or visual packet loss message or image be packet loss message in detail; Perhaps image packet loss message in the video communication feedback information agreement or macro block group packet loss message; Perhaps image packet loss message in the RTCP Real-time Transport Control Protocol or band packet loss message.
17. video refreshing apparatus according to claim 14; It is characterized in that the critical data solicitation message that said generation unit generates is: carry said critical data solicitation message through the parameter of original message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps carry said critical data solicitation message through the reservation message in multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol being expanded the back; Perhaps through the said critical data solicitation message of message bearing in newly-increased multimedia control protocol or video communication feedback information agreement or the RTCP Real-time Transport Control Protocol.
18. a video updating system is characterized in that, comprising:
The video code flow receiving equipment is used for the video code flow that receiver, video code stream transmitting apparatus sends, and generates the critical data solicitation message, comprises the packet hierarchical information of being applied in the said critical data solicitation message; And send said critical data solicitation message to the video code flow transmitting apparatus;
The video code flow transmitting apparatus is used to receive said critical data solicitation message, and the critical data coding is carried out in the layering that the layering that layering that hierarchical information described in the video image is represented and needs are represented according to said hierarchical information is decoded; And said coding is obtained critical data send to said video code flow receiving equipment.
19. video updating system according to claim 18; It is characterized in that; Said video code flow receiving equipment detects packet loss or error code or generates when out of order and send said critical data solicitation message to the video code flow transmitting apparatus, perhaps periodically generates and sends said critical data solicitation message to the video code flow transmitting apparatus.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010222359.5A CN102316360B (en) | 2010-07-09 | 2010-07-09 | Video refreshing method, Apparatus and system |
| PCT/CN2011/077015 WO2012003808A1 (en) | 2010-07-09 | 2011-07-09 | Method, device, and system for video refresh |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010222359.5A CN102316360B (en) | 2010-07-09 | 2010-07-09 | Video refreshing method, Apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102316360A true CN102316360A (en) | 2012-01-11 |
| CN102316360B CN102316360B (en) | 2015-11-25 |
Family
ID=45429120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010222359.5A Expired - Fee Related CN102316360B (en) | 2010-07-09 | 2010-07-09 | Video refreshing method, Apparatus and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102316360B (en) |
| WO (1) | WO2012003808A1 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103647923A (en) * | 2013-12-06 | 2014-03-19 | 广东欧珀移动通信有限公司 | Image displaying method in video calling |
| CN106713924A (en) * | 2017-01-24 | 2017-05-24 | 钟炎培 | Layered compression method and device for characters |
| CN107018423A (en) * | 2015-09-17 | 2017-08-04 | 联发科技股份有限公司 | Method for video coding and video coding apparatus |
| CN111149365A (en) * | 2017-12-19 | 2020-05-12 | 西部数据技术公司 | Hybrid technology for content distribution using edge devices |
| WO2021004239A1 (en) * | 2019-07-10 | 2021-01-14 | 华为技术有限公司 | Data processing method and device |
| CN112637635A (en) * | 2020-12-15 | 2021-04-09 | 西安万像电子科技有限公司 | File security method and system, computer readable storage medium and processor |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1599308A (en) * | 2003-09-05 | 2005-03-23 | 三菱电机株式会社 | Method for transmitting data including an error control mechanism designated for unreliable networks and error resilience applications |
| CN101001132A (en) * | 2006-01-10 | 2007-07-18 | 英业达股份有限公司 | Data radio transmission system |
| CN101155311A (en) * | 2006-09-27 | 2008-04-02 | 中兴通讯股份有限公司 | Video code stream error detecting and processing method in video communication |
| CN101166270A (en) * | 2006-10-16 | 2008-04-23 | 华为技术有限公司 | Multimedia video communication method and system |
| CN101193312A (en) * | 2006-11-22 | 2008-06-04 | 中兴通讯股份有限公司 | Self-adapted error recovery device, video communication system and method based on feedback |
| CN101370144A (en) * | 2007-08-16 | 2009-02-18 | 大唐移动通信设备有限公司 | Transmission method and system for video data, and its transmitting and receiving method and apparatus |
| CN101394556A (en) * | 2008-10-29 | 2009-03-25 | 清华大学 | Image transmission method, sending device and receiving device for deep space communication |
| US20090290648A1 (en) * | 2008-05-20 | 2009-11-26 | Canon Kabushiki Kaisha | Method and a device for transmitting image data |
-
2010
- 2010-07-09 CN CN201010222359.5A patent/CN102316360B/en not_active Expired - Fee Related
-
2011
- 2011-07-09 WO PCT/CN2011/077015 patent/WO2012003808A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1599308A (en) * | 2003-09-05 | 2005-03-23 | 三菱电机株式会社 | Method for transmitting data including an error control mechanism designated for unreliable networks and error resilience applications |
| CN101001132A (en) * | 2006-01-10 | 2007-07-18 | 英业达股份有限公司 | Data radio transmission system |
| CN101155311A (en) * | 2006-09-27 | 2008-04-02 | 中兴通讯股份有限公司 | Video code stream error detecting and processing method in video communication |
| CN101166270A (en) * | 2006-10-16 | 2008-04-23 | 华为技术有限公司 | Multimedia video communication method and system |
| CN101193312A (en) * | 2006-11-22 | 2008-06-04 | 中兴通讯股份有限公司 | Self-adapted error recovery device, video communication system and method based on feedback |
| CN101370144A (en) * | 2007-08-16 | 2009-02-18 | 大唐移动通信设备有限公司 | Transmission method and system for video data, and its transmitting and receiving method and apparatus |
| US20090290648A1 (en) * | 2008-05-20 | 2009-11-26 | Canon Kabushiki Kaisha | Method and a device for transmitting image data |
| CN101394556A (en) * | 2008-10-29 | 2009-03-25 | 清华大学 | Image transmission method, sending device and receiving device for deep space communication |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103647923A (en) * | 2013-12-06 | 2014-03-19 | 广东欧珀移动通信有限公司 | Image displaying method in video calling |
| CN103647923B (en) * | 2013-12-06 | 2016-08-31 | 广东欧珀移动通信有限公司 | A kind of method for displaying image in video calling |
| CN107018423A (en) * | 2015-09-17 | 2017-08-04 | 联发科技股份有限公司 | Method for video coding and video coding apparatus |
| CN106713924A (en) * | 2017-01-24 | 2017-05-24 | 钟炎培 | Layered compression method and device for characters |
| CN106713924B (en) * | 2017-01-24 | 2019-06-07 | 西安万像电子科技有限公司 | For text layered compression method and device |
| CN111149365A (en) * | 2017-12-19 | 2020-05-12 | 西部数据技术公司 | Hybrid technology for content distribution using edge devices |
| CN111149365B (en) * | 2017-12-19 | 2021-12-28 | 西部数据技术公司 | Apparatus, system and method for transmitting data |
| WO2021004239A1 (en) * | 2019-07-10 | 2021-01-14 | 华为技术有限公司 | Data processing method and device |
| CN112637635A (en) * | 2020-12-15 | 2021-04-09 | 西安万像电子科技有限公司 | File security method and system, computer readable storage medium and processor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102316360B (en) | 2015-11-25 |
| WO2012003808A1 (en) | 2012-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zhu | RTP payload format for H. 263 video streams | |
| CN101175213B (en) | Video source coding method and device, method and device for decoding video source | |
| KR101091792B1 (en) | Feedback based scalable video coding | |
| US20220030039A1 (en) | Methods and apparatus for use of compact concurrent codecs in multimedia communications | |
| Turletti et al. | RTP payload format for H. 261 video streams | |
| CN1910926B (en) | Method and apparatus for handling video communication errors | |
| US20100034293A1 (en) | Method and apparatus of multi-view coding and decoding | |
| CN102316360B (en) | Video refreshing method, Apparatus and system | |
| CN101573883A (en) | Systems and methods for signaling and performing temporal level switching in scalable video coding | |
| US7627184B2 (en) | Content distribution/reception device, content transmission/reception method, and content distribution/reception program | |
| WO2012075968A1 (en) | Method, system and device for acquiring parameter set value of video code stream in transcoding service | |
| US7454692B2 (en) | Encoder based error resilience method in a video codec | |
| CN101312536A (en) | Video coding method and apparatus for video transmission error control | |
| US11265583B2 (en) | Long-term reference for error recovery in video conferencing system | |
| US20070121532A1 (en) | Application specific encoding of content | |
| CN114827669B (en) | Video data transmission method, device, medium and equipment | |
| US7702994B2 (en) | Method of determining a corruption indication of a sequence of encoded data frames | |
| Zhu | Rfc2190: Rtp payload format for h. 263 video streams | |
| WO2015174893A1 (en) | Methods, decoder and encoder for selection of reference pictures to be used during encoding | |
| Turletti et al. | RFC2032: RTP payload format for H. 261 video streams | |
| KR100543607B1 (en) | Method for decoding of moving picture | |
| KR100557047B1 (en) | Method for moving picture decoding | |
| KR20040046539A (en) | Method for moving picture decoding | |
| KR20040046540A (en) | Method for moving picture decoding | |
| KR20060124359A (en) | Multiple real-time encoding method for multi-media service and server apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170825 Address after: 201, room 1, building A, No. 518053, front Bay Road, Qianhai, Shenzhen Shenzhen cooperation zone, Guangdong, China Patentee after: Shenzhen Zhitong World Technology Service Co. Ltd. Address before: 518129 Longgang District, Guangdong, Bantian HUAWEI base B District, building 2, building No. Patentee before: Huawei Device Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180104 Address after: 518053 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation area before Bay Street, Qianhai road at the Shenzhen Hong Kong Cooperation Area Management Bureau office building A Building Room 201 Patentee after: Shenzhen Qianhai TengXiang science and Technology Information Co., Ltd. Address before: 201, room 1, building A, No. 518053, front Bay Road, Qianhai, Shenzhen Shenzhen cooperation zone, Guangdong, China Patentee before: Shenzhen Zhitong World Technology Service Co. Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20151125 Termination date: 20190709 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |