WO2012003808A1 - Procédé, dispositif et système pour rafraîchissement vidéo - Google Patents

Procédé, dispositif et système pour rafraîchissement vidéo Download PDF

Info

Publication number
WO2012003808A1
WO2012003808A1 PCT/CN2011/077015 CN2011077015W WO2012003808A1 WO 2012003808 A1 WO2012003808 A1 WO 2012003808A1 CN 2011077015 W CN2011077015 W CN 2011077015W WO 2012003808 A1 WO2012003808 A1 WO 2012003808A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
message
key data
packet loss
request message
Prior art date
Application number
PCT/CN2011/077015
Other languages
English (en)
Chinese (zh)
Inventor
龙彦波
伍文华
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Publication of WO2012003808A1 publication Critical patent/WO2012003808A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164—Feedback from the receiver or from the transmission channel

Definitions

  • Video refreshing method device and system
  • the present invention relates to the field of video communication technologies, and in particular, to a video refresh method, apparatus, and system.
  • a method in which a current frame is subjected to predictive coding with reference to other video frames is referred to as interframe predictive coding, and an encoded frame using interframe predictive coding is referred to as a P frame;
  • an encoding method without reference to any other video frame Called intra-prediction coding, an encoded frame in which only intra-prediction coding is used for all regions within a frame of an image is called an I-frame.
  • Interframe predictive coding can effectively reduce temporal redundancy between video images and improve coding compression efficiency.
  • inter-prediction coding also introduces the problem of error diffusion. For example, when a frame is lost, the encoded frame corresponding to the lost packet cannot be decoded correctly to obtain a reconstructed image, resulting in an error frame. Subsequent P-frame images cannot be normally decoded due to the reference to the error frame. In this way, the error caused by packet loss always spreads from the packet loss frame to all subsequent P frames until the I frame is encountered. In a sense, an I frame is one of the key frames.
  • the remote receiving device in the process of transmitting a video code stream to a remote receiving device, when a video code stream is lost or incorrect, the remote receiving device generally first decodes or checks the packet sequence number. By way of discovery, the remote receiving device then sends a message about "video refresh" or "image loss" to the local transmitting device by specifying a command channel. After receiving the message, the local sending device performs an I frame refresh, and operates the encoder to output a coded packet of a lost packet or an erroneous video frame in the video stream.
  • An IDR frame is called an immediate refresh frame and is a type of I frame.
  • the inventors have found that at least the following problems exist in the prior art: If the video is encoded by layered coding, the video is encoded into a basic layer and several enhancement layers, in this case, The "video refresh" or "image loss” message sent by the remote sending device cannot carry any layered information about the packet loss stream. Therefore, in the case of hierarchical coding, the local transmitting device still cannot know which layer of the stream is lost, and can only perform I frame refresh for all layers (including the base layer and all enhancement layers). The frame refresh mode causes a large amount of data to be transmitted, which imposes a large load on the bandwidth.
  • Embodiments of the present invention provide a video refreshing method, apparatus, and system, which reduce data to be transmitted when video key data is refreshed, and reduce load on bandwidth.
  • a video refreshing method includes:
  • Key data encoding is performed on the layering of the layered information representation in the video image and the layering that needs to be decoded according to the layer represented by the layered information;
  • a video refreshing device comprising:
  • a receiving unit configured to receive a key data application message sent by the video stream receiving device, where the key data request message includes the requested data packet layering information
  • a coding unit configured to perform layered data representation on the layered information representation in the video image, and a layer that needs to be decoded according to the layer represented by the layered information
  • a sending unit configured to send the encoded key data to the video stream receiving Equipment.
  • a video refreshing method comprising:
  • the key data request message is sent to the video code stream transmitting device to instruct the video code stream transmitting device to resend the key data.
  • a video refreshing device comprising:
  • a generating unit configured to generate a key data request message, where the key data request message includes the requested data packet layering information
  • a sending unit configured to send the key data request message to the video code stream sending device, to instruct the video code stream sending device to resend the key data.
  • a video refreshing system comprising:
  • a video stream receiving device configured to receive a video code stream sent by the video code stream sending device, to generate a key data request message, where the key data application message includes the requested data packet layer information; and send the device to the video code stream Sending the key data request message;
  • a video stream sending device configured to receive the key data request message, perform layering on the layered information representation in the video image, and perform layered data on a layer that needs to be decoded according to the layer represented by the layered information. Encoding and transmitting the encoded key data to the video stream receiving device.
  • the video refreshing method, device and system provided by the embodiment of the present invention, because the hierarchical data information is included in the key data application message, so that only the layered information representation layer can be expressed when the I frame refresh is performed. And performing key data coding according to the layered decoding layer of the layered information representation, and the key data coding is required for all layers in the prior art; therefore, the video refresh provided by the embodiment of the present invention is adopted.
  • the method, the device and the system can make the number of layered layers requiring key data encoding less than the prior art, and can reduce the amount of IDR frame data output when the I frame is refreshed, thereby reducing the transmission of the key data when the video is refreshed. Data, reducing the load on bandwidth.
  • FIG. 1 is a flowchart of a video refreshing method according to an embodiment of the present invention
  • FIG. 2 is a block diagram of a video refreshing apparatus according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of another video refreshing method according to an embodiment of the present invention.
  • FIG. 4 is a block diagram of another video refreshing apparatus according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a video refresh system according to an embodiment of the present invention.
  • FIG. 6 is a top view of a video refresh system specifically used in an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of command decoding after using method 1 in an embodiment of the present invention
  • FIG. 8 is a schematic diagram of command decoding after using method 2 in an embodiment of the present invention
  • FIG. 9 is a video refreshing method according to an embodiment of the present invention
  • FIG. 10 is a schematic diagram of command decoding after using Method 1 in another embodiment of the present invention
  • FIG. 11 is a schematic diagram of command decoding after using Method 2 in another embodiment of the present invention.
  • Layered coding refers to encoding a video into a base layer and several enhancement layers.
  • the base layer can be decoded independently to provide a basic but acceptable video quality; the decoding of the enhancement layer generally depends on the base layer, which provides better video quality than the base layer.
  • Hierarchical coding mainly includes the following three types of classification:
  • Frame rate grading The base layer uses the original image and encodes at a lower output frame rate for lower fluency.
  • the enhancement layer encodes the image frame that is not encoded in the base layer, and improves the display frame rate based on the base layer decoded image.
  • Resolution classification The base layer encodes a lower resolution image obtained by subsampling the original image to obtain a lower resolution.
  • the enhancement layer is predictively encoded by the original resolution image, and the resolution is improved based on the base layer decoded image.
  • the coding of the enhancement layer may refer to the interpolated image of the base layer reconstructed image, the motion vector of the base layer macroblock, and the reconstruction residual coefficient.
  • the base layer uses the original image to encode at a higher compression ratio (ie, a larger quantization step size and a lower coding bandwidth) to obtain lower resolution; and the enhancement layer refers to the base layer.
  • the reconstructed image is encoded with a higher image quality (i.e., a smaller quantization step size, a higher encoding bandwidth), and the sharpness is improved based on the decoded image of the base layer.
  • the embodiment of the present invention provides a video refreshing method, as shown in FIG. Includes:
  • the video stream receiving device sends a key data request message, where the key data request message includes hierarchical information corresponding to the applied data packet.
  • the video code stream sending device in the embodiment of the present invention receives the key data request message, layering the layered information in the video image, and layering according to the hierarchical information representation
  • the layered decoding performs key data encoding, while the other layers that do not need to be decoded according to the layered information representation do not perform key data encoding.
  • the embodiment of the present invention further provides a video refreshing apparatus.
  • the apparatus includes: a receiving unit 21, an encoding unit 22, and a sending unit 23.
  • the receiving unit 21 is configured to receive a key data request message sent by the video code stream receiving device, where the key data request message includes hierarchical information corresponding to the applied data packet; and the encoding unit 22 is configured to use the hierarchical information according to the layer information. And performing key data encoding on the layered representation of the hierarchical information in the video image and the layer that needs to be decoded according to the layer represented by the hierarchical information, and the other is not required to be represented according to the hierarchical information.
  • Hierarchical decoding for stratification does not advance
  • the encoding unit 22 in the embodiment of the present invention is further configured to obtain the layered layer represented by the layered information from the received key data request message.
  • the layered information in the embodiment of the present invention may be different according to a specific layered coding manner, for example, the video image may be layered according to frame rate classification, resolution classification, or quality classification, and the corresponding hierarchical information may be They are: layering with different frame rates, layering with different resolutions, and layering with different qualities.
  • the key data request message received by the receiving unit 21 is: a video fast refresh command in the multimedia control protocol, or a macroblock group fast refresh command, or a macroblock fast refresh command, or a macroblock packet loss message, or an image lost message.
  • the embodiment of the present invention may be carried by using a multimedia control protocol, or a video communication feedback information protocol, or a real-time transmission control protocol, and the following three implementation manners are specifically included:
  • the key data application message is carried by extending the parameters of the multimedia control protocol, or the video communication feedback information protocol, or the original message in the real-time transmission control protocol.
  • the key data application message is carried by extending the multimedia control protocol, or the video communication feedback information protocol, or the reserved message in the real-time transmission control protocol.
  • the key data application message is carried by a new multimedia control protocol, or a video communication feedback information protocol, or a message in a real-time transmission control protocol.
  • the embodiment of the invention further provides a video refreshing method, as shown in FIG. 5, including:
  • a video stream sending device needs to be requested to resend key data, generate a key data request message, where the key data request message includes the requested data packet layer information.
  • the hierarchical information in the main information refers to the layer corresponding to the data that needs to be resent.
  • the key data request message needs to be sent to the video code stream sending device; or periodically.
  • the key data request message is sent to the video code stream transmitting device.
  • the implementation manner of the key data request message in the embodiment of the present invention includes, but is not limited to, the following: a video fast refresh command in a multimedia control protocol, or a macroblock group fast refresh command, or a macroblock fast refresh command, or a macroblock loss Packet message, or image packet loss message, or image detailed packet loss message; or image packet loss message in the video communication feedback information protocol, or macroblock group packet loss message; or image packet loss message in real-time transmission control protocol , or stripe packet loss message.
  • the embodiment of the present invention further provides a video refreshing apparatus.
  • the video refreshing apparatus includes a generating unit 41 and a sending unit 42.
  • the generating unit 41 is configured to generate a key data request message, where the key data request message includes the requested data packet layering information; where the hierarchical information mainly refers to the data packet sending device that needs to request the video code stream sending device to resend the key data.
  • the sending unit 42 is configured to send the key data request message to the video code stream sending device to instruct the video stream sending device to resend the key data.
  • the key data request message sent by the sending unit 42 in the embodiment of the present invention may be, but is not limited to, the following: a video fast refresh command in the multimedia control protocol, or a macroblock group fast refresh command, or a macroblock fast refresh command, or Macroblock packet loss message, or image packet loss message, or image detailed packet loss message; or image packet loss message in the video communication feedback information protocol, or macroblock packet loss message; or image in real-time transmission control protocol Packet loss message, or stripe packet loss message.
  • the key data application messages can be carried by different protocols, such as: multimedia control protocol, or video communication feedback information protocol, or real-time transmission control protocol.
  • multimedia control protocol or video communication feedback information protocol
  • real-time transmission control protocol or real-time transmission control protocol.
  • the key data application message is carried by extending the parameters of the multimedia control protocol, or the video communication feedback information protocol, or the original message in the real-time transmission control protocol.
  • the key data application message is carried by extending the multimedia control protocol, or the video communication feedback information protocol, or the reserved message in the real-time transmission control protocol.
  • the key data application message is carried by a new multimedia control protocol, or a video communication feedback information protocol, or a message in a real-time transmission control protocol.
  • the embodiment of the present invention further provides a video refreshing system.
  • the system includes: a video code stream sending device 51 and a video stream receiving device 52.
  • the video code stream transmitting device 51 sends the video code stream that needs to be transmitted to the video code stream receiving device 52.
  • the video code stream receiving device 52 is configured to receive the video code stream sent by the video code stream sending device 51, and
  • the key data request message is generated and sent to the video code stream sending device 51, where the key data request message includes the hierarchical information corresponding to the applied data packet.
  • Certain conditions for transmitting the key data request message in the embodiment of the present invention may include, but are not limited to, the following conditions: packet loss, or error, or out-of-order is detected; or the video stream may be generated periodically and in the embodiment of the present invention.
  • the sending device sends the key data request message.
  • the video code stream sending device 51 is configured to receive the key data request message, perform layering on the hierarchical information representation in the video image, and perform layering that needs to be decoded according to the layer represented by the layered information.
  • the key data is encoded; and the key data obtained by the encoding is sent to the video stream receiving device 52, so that the video stream receiving device 52 performs corresponding processing according to the key data.
  • the video stream receiving device 52 can detect that there is a packet loss in the video stream by decoding or checking the packet sequence number.
  • the video refreshing method, device and system provided by the embodiment of the present invention, because the key data application message includes the hierarchical information corresponding to the applied data packet, so that the I frame is performed.
  • the key data application message includes the hierarchical information corresponding to the applied data packet, so that the I frame is performed.
  • refreshing only the layered representation of the hierarchical information and the layer that needs to be decoded according to the layer represented by the hierarchical information may be used for key data encoding, and in the prior art, all layers need to be performed.
  • the method, device and system for refreshing video key data provided by the embodiments of the present invention can make the number of layered layers requiring key data coding less than that of the prior art, and can make the I frame refresh
  • the output IDR frame has a small amount of data, thereby reducing the data that needs to be transmitted when the video key data is refreshed, and reducing the load on the bandwidth.
  • the application scenario of the embodiment of the present invention may be specifically as shown in FIG. 6. It is assumed that the local terminal TO (video stream sending device) performs video conference with the remote terminals T1, ⁇ 2, ⁇ 3 (video stream receiving device); and the local terminal TO A layered coding scheme is adopted for the local image, specifically including a basic layer Layerl and two enhancement layers Layer2 and Layer3; the reference relationship of each layer is Layer2 reference Layerl, and Layer 3 refers to Layer2.
  • the local terminal TO forwards the respective layered code streams required by the MCU (Mul t i point cont rol uni t, multipoint control unit) to T1, ⁇ 2, ⁇ 3, as shown in FIG. 6. H does not have the remote terminal ⁇ 3 and finds that the Layer 2 packet loss occurs.
  • the processing performed by the method provided by the present invention is:
  • the remote terminal T3 sends a key data request message to the local terminal TO, and layer Layer 2 in the key data request message.
  • the information is fed back to the local terminal TO; the TO performs key data encoding for Layer 2 and Layer 3 according to the decoding dependency relationship between Layer 1, Layer 2 and Layer 3, and sends the encoded key data to the remote terminal T3 for I. Frame refresh, do nothing for Layer l.
  • the decoding end can feed back information about which layers are lost to the encoding end; the encoding end can only rely on packet loss for layering and decoding of packet loss.
  • Layered other layers for I-frame refreshing avoiding the excessive amount of data that needs to be sent due to I-frame refreshing for all layers, reducing the load on the bandwidth;
  • the problem that the quality of the encoded image is seriously degraded is effectively avoided when the width is limited; the method provided by the embodiment of the present invention does not have any influence on the layered code stream that does not have packet loss.
  • H.245 is a multimedia control protocol (Control protocol f or mul t imedia communicat ion ).
  • ITU-T ITU-T
  • the H.323 protocol family is the most important standard for next-generation multimedia conferencing technologies and devices. It specifies device terminals from different vendors on the LAN (Local Area Network), Internet (Internet). The working modes required for the various combinations of audio, video, and T.120 data to communicate with each other. These include H.225, H.245, etc.
  • H.245 is the control command protocol in the H.323 multimedia communication system.
  • Mul timediaSystemControlMes sage is the top-level system control message defined in the H.245 protocol. In the prior art, the message is as follows:
  • RequestMessage (i green message), ResponseMessage (response message), CommandMessage (command message), and Indicat ionMessage (refers to Show message) is one of the options of MultimediaSystemControlMessage.
  • one of the above CommandMessage options includes Miscel laneousCommand
  • the following commands can be implemented by Miscel laneousCommand: videoFastUpdatePicture, videoFas tUpdateGOB, macroFastUpdateBm lostPicture (image packet loss message), lostPartialPicture (image detailed packet loss message), the above commands can be used as a message to perform I frame request in the environment of packet loss.
  • the above commands cannot carry parameters, or can only carry the frame number of the lost packet and the related parameters of the image area, and do not carry the hierarchical information of the packet loss stream. Therefore, the standard command message of H.245 cannot feed back the hierarchical information of the packet loss stream.
  • the embodiment of the present invention first needs to be extended. H.245, to indicate hierarchical information.
  • the extension to H.245 of the embodiment of the present invention includes but is not limited to the following methods:
  • Method 1 Based on the command message that H.245 can be used for I frame application, the parameter expansion is performed. Specifically, the parameters of the original Mi seel laneousCommand message are added to the following parameters: dependency-id (resolution resolution level of the layer), quality_id (quality level of the layer), Temporal-id (the frame rate of the layer).
  • VideoFastUpdatePicture VideoFastUpdateGOB, videoFastUpdateB, videoBadMBs (macroblock) Packet loss message), lostPicture (image packet loss message), lostPartialPicture (image detail packet loss message), after expansion
  • the parameters indicated by the underline in the above table are the newly added parameters.
  • the corresponding parsing process is shown in Figure ,.
  • the message type of the MiscellaneousCommand message needs to be judged. After the type is obtained, the M in the above table can be respectively determined.
  • the various messages of the ce 11 aneou s Command message are parsed. It can be seen from FIG. 7 that the final analysis result includes the resolution grading level, or the quality grading level, or the frame rate grading level.
  • Method 2 Use H.245 non-standard message (equivalent to reserved message), extend the message type, add "video fast refresh command” or “image packet loss message”, add "video fast refresh command” or
  • the "Image Loss Packet Message” carries the parameters of the layer layer information of the relevant layer.
  • the specific hierarchical information parameters may include a dependency-id (the resolution level of the layer), or a quality-id (quality level of the layer), or a temporal-id (the frame rate of the layer) .
  • NonStandardMessage (non-standard) Message. Therefore, you can use the NonStandardMessage to extend the corresponding message type separately, in the existing H.245 protocol.
  • NonStandardMessage is defined as follows:
  • the NonStandardParameter is defined as follows:
  • NonStandardldentifier is used to identify extended messages; OCTET STRING is used to populate specific message content.
  • This embodiment uses the CommandMessage_SVC identifier to extend the control message for layered encoding, ie command. nonStandar. nonStandardData. nonStandardldent if ier is equal to CommandMe s s a ge _ SVC , command. nonStandar. nonStandardData. data is used to populate the message content of CommandMessage_SVC.
  • the specific definition is as follows:
  • videoFas tUpda tePi ture_SVC is "video fast update command for layered stream”
  • los tP i cture_SVC is "image packet loss message for layered stream", which contains hierarchical information of related layers.
  • Figure 8 the message type of the layered coded command message needs to be judged. After the type is obtained, the different messages of the layered coded command message in the above table can be separately performed. Analyze, it can be seen from Figure 8 that the two messages in the above table contain the resolution grading level, or the quality grading level, or the frame rate grading level in the final analysis result.
  • a message may be added in the H.245 protocol, and the resolution grading level, or the quality grading level, or the frame rate grading level may be set in the newly added message to carry the layering. information.
  • the video refreshing method is provided in the embodiment of the present invention. As shown in FIG. 9, the method includes:
  • the video stream receiving device generates a key data request message, where the key data request message includes hierarchical information corresponding to the applied data packet.
  • the key data application message in this embodiment is the extended message of the above H.245 protocol, so as to carry the layered information, specifically, may be extended on the basis of the original message, or may be extended to the non-standard message of H.245.
  • the H.245 protocol message may also be added, so that the extended message includes the resolution level, the quality level, or the frame rate level.
  • the video stream receiving device sends the key data request message to the video code stream sending device.
  • the embodiment of the present invention does not limit the conditions for issuing the key data request message.
  • the video stream receiving device may periodically send the key data request message to the video code stream sending device, such as every 5 minutes, or A key data request message is sent out in 10 minutes; the key data request message can also be issued when a critical data abnormality is detected, such as: When the packet is lost, or is mis-coded, or is out of order, the key data request message is sent to the video code stream transmitting device.
  • the video code stream sending device After receiving the key data request message, the video code stream sending device confirms that layering of key data coding is required according to the layered information in the key data application message.
  • the video stream sending device performs key data encoding on the layered representation of the layered information in the video image, and the layer that needs to be decoded according to the layer represented by the layered information, and does not need to be based on other
  • the layered decoding layer represented by the hierarchical information does not perform key data encoding.
  • the video stream sending device sends the encoded key data to the video stream receiving device, and performs I frame refreshing, so that the video stream receiving device performs corresponding processing according to the key data.
  • the corresponding processing of this embodiment includes error correction of key data, timing update of key data, and the like.
  • Another application scenario of the embodiment of the present invention may be: a video code stream sending device and a video stream stream receiving device communicate through a message of the H.271 protocol, wherein the H.271 protocol is a video communication feedback information protocol (H. Vi deo back-channe l mes sages for conveyance of s ta tus informat ion and reques ts from a video rece iver to a video sender ), specifically for the video receiving device to transmit status information and instructions to the video transmitting device via the feedback information channel It can be used for H. 261, H. 263, H. 264 video protocols.
  • H. 261, H. 263, H. 264 video protocols can be used for H. 261, H. 263, H. 264 video protocols.
  • the specific packet loss messages in the existing H.271 syntax structure include the following two types:
  • Both of the above messages can be used as messages for performing an I frame request in a packet loss environment.
  • none of the above feedback messages carry the layered information indicating the packet loss stream. Therefore, the standard message type of H.271 cannot also feed back the layered information of the packet loss stream.
  • the embodiment of the present invention first needs to be extended. 271, to indicate hierarchical information.
  • the extension to H.271 of the embodiment of the present invention includes but is not limited to the following methods:
  • the parameters added after the extension include the dependency_id, or the quality-id, or the temporal-id.
  • the corresponding parsing process is as shown in Figure 10.
  • the message type needs to be judged. After the message type is obtained, the message can be used.
  • the final analysis results of various different messages are shown in FIG. 10. In the analysis result, the resolution grading level, or the quality grading level, or the frame rate grading level is included.
  • Method 2 Using the H.271 reserved message, the extension of the feedback message type, adding an "image packet loss message” and carrying the layer layer information parameter of the relevant layer in the "image packet loss message".
  • Specific hierarchical information parameters include dependency_id (the resolution level of the layer), or quality-id (the quality level of the layer), or temporal-id (the frame rate of the layer).
  • H.271 the message type (payloadType > 5) is reserved and not used.
  • payloadType 6 as an example to illustrate how to extend the message carrying the layer layer information of the relevant layer by retaining the message type. Like the packet loss message.”
  • the message syntax structure of H.271 after message type extension is shown in the following table.
  • the new parameters include dependency. id, or qual i ty_id, or temporal_id.
  • the corresponding parsing process is shown in Figure 11.
  • the message type needs to be determined. After the message type is obtained, The message is parsed. It can be seen from FIG. 11 that various types of messages include the resolution level, the quality level, or the frame rate level in the final analysis result.
  • the video refreshing method provided by the embodiment of the present invention is similar to the process of FIG. 9, except that the key data request message in the embodiment of the present invention is the extended message of the H.271 protocol.
  • the key data request message in the embodiment of the present invention is the extended message of the H.271 protocol.
  • it may be extended on the basis of the original message, or the reserved message of H.271 may be extended, or the H.271 protocol message may be added, so that the extended message includes resolution.
  • a video code stream sending device and a video stream receiving device communicate through a message of a Real Time Transport Control Protocol (RTCP), wherein the real-time transmission control protocol is responsible for managing the transmission. Quality, which exchanges control information between current application processes.
  • RTCP Real Time Transport Control Protocol
  • each participant periodically transmits an RTCP packet containing statistics on the number of transmitted packets and the number of lost packets.
  • RTCP provides the following types of feedback information for the load and application layers.
  • FMT 1
  • none of the above feedback messages carry the layered information indicating the packet loss stream. Therefore, the standard message type of RTCP cannot feed back the layered information of the packet loss stream.
  • the number of resolution grading levels, or quality grading levels, or frame rate grading levels is set in the message to carry hierarchical information.
  • the extended message of the RTCP protocol so as to carry the layered information, specifically, may be extended on the basis of the original message, or may be extended to the reserved message of the RTCP, or the RTCP protocol message may be added, so that the extended message includes The resolution grading level, or the quality grading level, or the frame rate grading level.
  • the embodiments of the present invention are mainly used in the field of video communication technologies, such as a video conference system, a video call technology, and the like.
  • the storage medium can include: RAM, disk or CD, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Conformément à des modes de réalisation, la présente invention se rapporte au domaine technique des communications vidéo. L'invention porte sur un procédé, un dispositif et un système pour rafraîchissement vidéo, résolvant un problème d'un rafraîchissement de trame I où l'encombrement comparatif de données à transférer conduit à une charge comparativement lourde pour la bande passante. Le procédé de rafraîchissement vidéo des modes de réalisation de la présente invention comprend : la réception d'informations d'application de données clés, envoyées par un équipement de réception de flux vidéo, les informations d'application de données clés contenant des informations de couche correspondant au paquet de données demandé ; le codage de données clés d'une couche d'image vidéo exprimée par les informations de couche, et d'une couche à décoder sur la base de la couche exprimée par les informations de couche ; l'envoi des données clés codées à l'équipement de réception de flux vidéo. Les modes de réalisation de la présente invention sont principalement destinés à une utilisation dans le domaine technique des communications vidéo, telles que des systèmes de conférence vidéo, des technologies d'appel vidéo, etc.
PCT/CN2011/077015 2010-07-09 2011-07-09 Procédé, dispositif et système pour rafraîchissement vidéo WO2012003808A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010222359.5A CN102316360B (zh) 2010-07-09 2010-07-09 视频刷新方法、装置及系统
CN201010222359.5 2010-07-09

Publications (1)

Publication Number Publication Date
WO2012003808A1 true WO2012003808A1 (fr) 2012-01-12

Family

ID=45429120

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/077015 WO2012003808A1 (fr) 2010-07-09 2011-07-09 Procédé, dispositif et système pour rafraîchissement vidéo

Country Status (2)

Country Link
CN (1) CN102316360B (fr)
WO (1) WO2012003808A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3145187A1 (fr) * 2015-09-17 2017-03-22 MediaTek Inc. Procédé et appareil de réponse d'informations de rétroaction pendant un appel vidéo

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103647923B (zh) * 2013-12-06 2016-08-31 广东欧珀移动通信有限公司 一种视频通话中的图像显示方法
CN106713924B (zh) * 2017-01-24 2019-06-07 西安万像电子科技有限公司 用于文字分层压缩方法和装置
US20190191191A1 (en) * 2017-12-19 2019-06-20 Western Digital Technologies, Inc. Hybrid techniques for content distribution with edge devices
CN112217598B (zh) * 2019-07-10 2022-10-18 华为技术有限公司 数据处理方法及装置
CN112637635B (zh) * 2020-12-15 2023-07-04 西安万像电子科技有限公司 文件保密方法及系统、计算机可读存储介质及处理器

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1599308A (zh) * 2003-09-05 2005-03-23 三菱电机株式会社 包括差错控制机制和差错恢复应用的数据发送方法
CN101166270A (zh) * 2006-10-16 2008-04-23 华为技术有限公司 多媒体视频通信方法及系统
CN101370144A (zh) * 2007-08-16 2009-02-18 大唐移动通信设备有限公司 视频数据的传输方法、系统以及发送和接收的方法、装置
US20090290648A1 (en) * 2008-05-20 2009-11-26 Canon Kabushiki Kaisha Method and a device for transmitting image data

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101001132A (zh) * 2006-01-10 2007-07-18 英业达股份有限公司 数据无线传输系统
CN101155311B (zh) * 2006-09-27 2012-09-05 中兴通讯股份有限公司 一种视频通信中的视频码流错误检测和处理方法
CN101193312B (zh) * 2006-11-22 2011-01-05 中兴通讯股份有限公司 基于反馈的自适应错误恢复装置、视频通信系统和方法
CN101394556B (zh) * 2008-10-29 2010-12-22 清华大学 用于深空通信的图像传输方法、发送装置、接收装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1599308A (zh) * 2003-09-05 2005-03-23 三菱电机株式会社 包括差错控制机制和差错恢复应用的数据发送方法
CN101166270A (zh) * 2006-10-16 2008-04-23 华为技术有限公司 多媒体视频通信方法及系统
CN101370144A (zh) * 2007-08-16 2009-02-18 大唐移动通信设备有限公司 视频数据的传输方法、系统以及发送和接收的方法、装置
US20090290648A1 (en) * 2008-05-20 2009-11-26 Canon Kabushiki Kaisha Method and a device for transmitting image data

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3145187A1 (fr) * 2015-09-17 2017-03-22 MediaTek Inc. Procédé et appareil de réponse d'informations de rétroaction pendant un appel vidéo
US10200694B2 (en) 2015-09-17 2019-02-05 Mediatek Inc. Method and apparatus for response of feedback information during video call

Also Published As

Publication number Publication date
CN102316360A (zh) 2012-01-11
CN102316360B (zh) 2015-11-25

Similar Documents

Publication Publication Date Title
AU2022209216B2 (en) Methods and apparatus for use of compact concurrent codecs in multimedia communications
AU2006321552B2 (en) Systems and methods for error resilience and random access in video communication systems
US8462856B2 (en) Systems and methods for error resilience in video communication systems
WO2012003808A1 (fr) Procédé, dispositif et système pour rafraîchissement vidéo
CN104270594A (zh) 数据包发送与接收的方法及设备
US11265583B2 (en) Long-term reference for error recovery in video conferencing system
US20230061442A1 (en) Method, An Apparatus and A Computer Program Product for Video Encoding and Video Decoding
WO2010115376A1 (fr) Procédé, dispositif et système de commutation de flux multimédia
AU2012216587B2 (en) Systems and methods for error resilience and random access in video communication systems
US20240007619A1 (en) Method, an apparatus and a computer program product for implementing gradual decoding refresh
AU2012201576A1 (en) Improved systems and methods for error resilience in video communication systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11803161

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11803161

Country of ref document: EP

Kind code of ref document: A1