WO2015074380A1 - 视频信息处理方法及设备 - Google Patents

视频信息处理方法及设备 Download PDF

Info

Publication number
WO2015074380A1
WO2015074380A1 PCT/CN2014/076218 CN2014076218W WO2015074380A1 WO 2015074380 A1 WO2015074380 A1 WO 2015074380A1 CN 2014076218 W CN2014076218 W CN 2014076218W WO 2015074380 A1 WO2015074380 A1 WO 2015074380A1
Authority
WO
WIPO (PCT)
Prior art keywords
post
decoder
interface form
information processing
video
Prior art date
Application number
PCT/CN2014/076218
Other languages
English (en)
French (fr)
Inventor
周海林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP14811750.0A priority Critical patent/EP2890132A4/en
Priority to US14/586,302 priority patent/US20150147052A1/en
Publication of WO2015074380A1 publication Critical patent/WO2015074380A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Definitions

  • the present application claims priority to Chinese Patent Application No. 201310601757.1, the entire disclosure of which is incorporated herein by reference.
  • the present invention relates to communication technologies, and in particular, to a video information processing method and apparatus. Background
  • the media processing system generally includes components such as a player, a media source processing unit, a decoding unit, a display unit, and the like.
  • the general process of processing the video information by the media processing system is: the player reads the media file from the network or the local storage module. Specifically, the media source processing unit parses the media file, separates the compressed code stream, and inputs To the player; the player 4 bar compressed code stream is sent to the decoding unit, the decoding unit converts the compressed code stream into a video frame, and inputs it to the player; the video frame is sent to the display unit for display after being synchronized by the audio and video . In the above process, after the video frame is decoded, it is directly sent to the display unit for display.
  • FIG. 1 is a schematic structural diagram of a media processing system in the prior art.
  • the video frame is decoded and sent directly to the display unit for display, which has problems in image quality.
  • video compression causes image quality loss, mainly as a phenomenon of "blockiness” and "ringing effect". These phenomena can be post-processed by video after decoding, such as deblocking. The effect of deblocking, deringing, etc. is effectively alleviated.
  • the subjective image quality cannot be improved after decoding, and the subjective image quality can be effectively improved by video post-processing, such as color enhancement, contrast enhancement, and sharpness enhancement, after decoding.
  • the video source in the media processing system shown in FIG. 1, if the video source is interlaced, it means the "top field” and “bottom field” of the video frame (the 0th, 2nd, 4th, 6th lines of the video frame). Combined together called “top field”, the first, third, fifth, ... lines of video frames are combined together called “bottom field”)
  • top field the first, third, fifth, ... lines of video frames are combined together called “bottom field”
  • the video post-processing function needs to be integrated with some components in the existing media processing system, for example, the video post-processing function can be integrated into the display controller of the display unit in FIG. 1, or the video post-processing function can be implemented.
  • the implementation is integrated into the player of FIG. 1, but this implementation requires modification of some components in the existing media processing system, and the implementation cost, time, and the like of modifying the media processing system are relatively costly. Summary of the invention
  • the embodiments of the present invention provide a video information processing method and device, which are used to implement post-processing of video frames without reducing the cost and time of video post-processing.
  • the first aspect provides a video information processing method, including:
  • the video information processing device receives the compressed code stream transmitted by the player
  • the video information processing device transmits the compressed code stream to a decoder
  • the video information processing device transmits the video frame decoded by the decoder to a post-processing unit, the processed video frame, and the post-processed video frame is transmitted to the display unit for display by the player. .
  • the video information processing apparatus when receiving the compressed code stream that is transmitted by the player, includes:
  • the video information processing apparatus receives the compressed code stream that is transmitted by the player in a first interface form, where the first interface form is an interface form supported by the player;
  • the video information processing apparatus transmits the compressed code stream to a decoder, including:
  • the video information processing apparatus uses an interface form for transmitting the compressed code stream from the first
  • the interface form is switched to the second interface form, and the compressed code stream is transmitted to the decoder in the form of the second interface, where the second interface form is an interface form supported by the decoder.
  • the video information processing apparatus transmits the compressed code stream to the decoder in a second interface form After that, it also includes:
  • the video information processing apparatus receives a first notification message that is transmitted by the decoder in the form of the second interface;
  • the video information processing apparatus switches an interface form for transmitting the first notification message from the second interface form to the first interface form, and the first notification message is in the first interface form Transmitted to the player; wherein the first notification message is used to indicate that decoding is complete.
  • the video information processing apparatus Transmitting the decoded video frame to the post-processing unit includes:
  • the video information processing apparatus receives the video frame output by the decoder, and receives memory description information transmitted by the player;
  • the video information processing apparatus transmits the video frame and the memory description information to the post-processing unit; the processed video frame includes:
  • the post-processing unit performs post-processing on the video frame and stores the post-processed video frame into a memory indicated by the memory description information, wherein the post-processed video frame is from the memory by the player Read in.
  • the video information processing apparatus After the unit, it also includes:
  • the video information processing device receives the second notification message transmitted by the post-processing unit in the form of a third interface, where the third interface form is an interface form supported by the post-processing unit;
  • the video information processing apparatus switches an interface form for transmitting the second notification message from the third interface form to the first interface form, and uses the first interface form to send the second notification message Transmitted to the player; wherein the second notification message is used to indicate that the post-processing is completed.
  • the first interface is in the form of a standard decoder interface
  • the second interface is in the form of a private decoder interface.
  • a second aspect provides a video decoding apparatus, including: a video information processing apparatus, a decoder, and a post-processing unit;
  • the video information processing apparatus is configured to receive a compressed code stream transmitted by a player, transmit the compressed code stream to the decoder, receive a video frame decoded by the decoder from the decoder, and Transmitting the video frame to the post-processing unit;
  • the decoder is configured to decode the compressed code stream, obtain the video frame, and provide the video frame to the video information processing apparatus;
  • the post-processing unit is configured to post-process the video frame transmitted by the video information processing apparatus and provide a post-processed video frame to the player, where the post-processed video frame passes the playing
  • the device is transferred to the display unit for display.
  • the video information processing apparatus is specifically configured to receive the compressed code stream that is transmitted by the player in a first interface manner, where the first The interface form is an interface form supported by the player;
  • the video information processing apparatus is further configured to switch an interface form for transmitting the compressed code stream from the first interface form to a second interface form, where the second interface form is supported by the decoder Interface form
  • the video information processing apparatus is specifically configured to transmit the compressed code stream to the decoder in the form of the second interface.
  • the video information processing apparatus is further configured to: After being streamed to the decoder, receiving a first notification message that is transmitted by the decoder in the second interface form, and switching an interface form for transmitting the first notification message from the second interface form to The first interface is configured to transmit the first notification message to the player in the first interface form, where the first notification message is used to indicate that decoding is complete.
  • the video information processing apparatus is further used Receiving the memory description information transmitted by the player, and transmitting the memory description information to the post-processing unit before transmitting the video frame decoded by the decoder to the post-processing unit; In the memory indicated by the memory description information, the post-processed video frame is read by the player from the memory.
  • the video information processing apparatus is further configured to transmit the video frame and the memory description information After the post-processing unit is received, the second processing message transmitted by the post-processing unit in the form of the third interface is received, and the interface form for transmitting the second notification message is switched from the third interface form to the
  • the first interface is configured to transmit the second notification message to the player in the form of the first interface, where the third interface format is an interface form supported by the post-processing unit, The second notification message is used to indicate that the post-processing is completed.
  • the first interface is in the form of a standard decoder interface
  • the second interface is in the form of a private decoder interface.
  • the video information processing device receives the compressed code stream transmitted by the player, and transmits the compressed code stream to the decoder for decoding by the decoder to obtain a video frame, and then decoding the decoder.
  • the video frame is transmitted to the post-processing unit for post-processing, and the post-processing unit provides the post-processed video frame to the player.
  • the analysis shows that the video post-processing device changes the direction of the decoded video frame, so that the decoded video frame is sent to the post-processing unit after the decoder, and can be decoded by the post-processing unit pair after the decoder.
  • the post-processing of the video frame is equivalent to integrating the decoder and the post-processing unit, so that the post-processing is transparent to the player, so that the player and the decoder are not modified, and the media processing system is not affected.
  • Other components implement post-processing of video frames without extensive modification of the media processing system, which reduces the cost, time, and the like of video post-processing.
  • FIG. 1 is a schematic structural diagram of a media processing system in the prior art
  • FIG. 2 is a schematic structural diagram of a media processing system according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a video decoding device according to an embodiment of the present disclosure.
  • FIG. 4a is a flowchart of a video information processing method according to an embodiment of the present invention.
  • FIG. 4b is a flowchart of another video information processing method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of still another video information processing method according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of information interaction between a video decoding device and a player based on an OpenMax IL interface according to an embodiment of the present invention
  • FIG. 7 is a schematic structural diagram of another video decoding device according to an embodiment of the present invention. detailed description
  • the embodiment of the present invention provides a new media processing system.
  • the structure of the media processing system is as shown in FIG. 2, and mainly includes: a player 21, a media source processing unit 22, and a video decoding device 23. And display unit 24.
  • the video decoding device 23 is mainly integrated with a decoder and a post-processing unit, and completes decoding of the compressed code stream on the one hand, and completes the decoded video on the other hand in an optional implementation manner, as shown in FIG. 3,
  • the implementation structure of the video decoding device 23 includes: a video information processing device 231, a decoder 232, and a post-processing unit 233.
  • the decoder 232 mainly implements the decoding of the compressed code stream
  • the post-processing unit 233 mainly implements the decoded video post-processing function
  • the video information processing device 231 is mainly used to overcome the existing technology for implementing the video post-processing function.
  • Various problems The connection relationship between the player 21, the media source processing unit 22, the video information processing device 231, the decoder 232, the post-processing unit 233, and the display unit 24 is as shown in FIG.
  • the following embodiments of the present invention provide a video information processing method.
  • the video information processing method includes:
  • the video information processing device receives the compressed code stream transmitted by the player.
  • the video information processing device transmits the compressed code stream to the decoder.
  • the decoder decodes the compressed code stream to obtain a video frame and provides the video frame to the video information processing apparatus.
  • the video information processing device transmits the video frame decoded by the decoder to the post-processing unit.
  • the post-processing unit post-processes the video frame and provides the post-processed video frame to the player, and the post-processed video frame is transmitted to the display unit through the player for display.
  • the video information processing device is located between the player and the decoder, and is mainly responsible for information transmission between the player and the decoder. Specifically, the video information processing device provides the compressed code stream from the player to the decoding.
  • the decoder decodes the compressed code stream provided by the video information processing device, and provides the video frame decoded by the decoder to the video information processing device; the video information processing device transmits the video frame decoded by the decoder to the post-processing Unit; the post-processing unit provides post processing to the video frame and provides it to the player.
  • the video frame is directly sent to the player after being output from the decoder, and the video processing device sends the video frame to the post-processing unit after the decoder to implement post-processing of the video frame.
  • the post-processing unit then provides the post-processed video frame to the player, which is equivalent to integrating the decoder and the post-processing unit, so that the post-processing is transparent to the player, so that the player and the decoder are not modified. It also does not affect other components in the media processing system, and realizes post-processing of video frames without greatly modifying the media processing system, thereby reducing the cost and time of video post-processing.
  • FIG. 4b another video information processing method is provided, as shown in FIG. 4b.
  • the method includes the following:
  • the video information processing apparatus receives a compressed code stream that is transmitted by the player in a first interface format; wherein the first interface form is an interface form supported by the player.
  • the video information processing device switches the interface form for transmitting the compressed code stream from the first interface form to the second interface form, and transmits the compressed code stream to the decoder in a second interface form, where the second interface form It is the interface form supported by the decoder.
  • the decoder decodes the compressed code stream transmitted by the video information processing apparatus in the form of the second interface, obtains a video frame, and provides the video frame to the video information processing apparatus. 404.
  • the video information processing apparatus transmits the video frame decoded by the decoder to the post-processing unit.
  • the post-processing unit performs post-processing on the video frame and provides the post-processed video frame to the player, and the post-processed video frame is transmitted to the display unit through the player for display.
  • the compressed code stream transmitted by the player is transmitted in the form of an interface supported by the player (that is, the compressed code stream is transmitted in the form of a first interface), and the compressed code stream is not in the prior art.
  • the video information processing device After receiving the compressed code stream transmitted by the player in the form of an interface supported by the player, the video information processing device switches the interface form for transmitting the compressed code stream, and switches to an interface form supported by the decoder, that is, the second interface. form. Then, the video information processing apparatus transmits the compressed code stream to the decoder in the form of a second interface.
  • the video information processing device switches the interface form for transmitting the compressed code stream between the player and the decoder.
  • the player and the decoder can each use the interface form supported by them, and the player and the decoder need not be modified due to different supported interface forms.
  • the interface form supported by the player is in the form of a standard decoder interface
  • the interface form supported by the decoder is generally in the form of a private decoder interface.
  • the video information processing device switches the interface format between the player and the decoder, which is equivalent to providing a unified standard decoder interface, which makes the player and the decoder do not need to be modified for post-processing. It is described herein that the switching of the interface format belongs to the prior art, and the video information processing apparatus can implement the switching of the interface format according to the corresponding switching mode in the prior art according to the interface form supported by the player and the decoder.
  • the decoder receives the compressed code stream transmitted by the video information processing device in the form of the second interface, decodes the received compressed code stream, obtains a video frame, and transmits the decoded video frame to the video information processing device, and then the video The information processing device transmits the video frame to the post-processing unit.
  • the post-processing unit After receiving the video frame transmitted by the video information processing device, the post-processing unit performs post-processing on the video frame and provides the post-processed video frame to the player to implement post-processing of the video frame.
  • post processing the processing performed on the video frame after decoding is called post processing.
  • the post-processing operations of the post-processing unit on the video frame include, but are not limited to, at least one of the following operations: deblocking effect, de-ringing effect, color enhancement, contrast enhancement, sharpness enhancement, and deinterlacing processing.
  • the embodiment of the present invention actually adds a video information processing device between the player and the decoder, and on the other hand, converts the interface form between the player and the decoder for transmitting the compressed code stream, and provides externally.
  • Standard decoder interface by changing the video frame decoded by the decoder
  • the direction is such that the video frame is sent to the post-processing unit after the decoder to implement post-processing, and the post-processed video frame is provided to the player, which is equivalent to integrating the video post-processing function and the decoder, so that
  • the video post-processing is transparent to the player, which eliminates the need to modify the player and the decoder, and solves the problem that the modification required by the media processing system must be open source, and at the same time reduces the cost, time and the like for implementing video post-processing.
  • FIG. 5 is a flowchart of still another video information processing method according to an embodiment of the present invention. As shown in FIG. 5, the video information processing method includes:
  • the video information processing device receives a compressed code stream transmitted by the player in the form of a first interface; wherein the first interface form is an interface form supported by the player.
  • the video information processing device switches the interface form for transmitting the compressed code stream from the first interface form to the second interface form, and transmits the compressed code stream to the decoder in a second interface form. It is the interface form supported by the decoder.
  • the decoder receives the compressed code stream transmitted by the video information processing device in the form of the second interface and decodes the video frame, and provides the video frame to the video information processing device.
  • the video information processing device receives the first notification message that is transmitted by the decoder in the form of the second interface, and switches the interface form for transmitting the first communication message from the second interface form to the first interface form, and is in the form of the first interface. Transmitting the first notification message to the player; wherein the first notification message is used to indicate that the decoding is completed.
  • the video information processing apparatus transmits the video frame decoded by the decoder to the post-processing unit. 506.
  • the post-processing unit performs post-processing on the video frame and provides the post-processed video frame to the player, and the post-processed video frame is transmitted to the display unit through the player for display.
  • steps 501, 502, 503, 505, and 506 can be referred to the description of the steps 401-405, and details are not described herein again.
  • the order of steps 504 and 505 may not be limited to that shown in FIG. 5.
  • the decoder after the video information processing apparatus transmits the compressed code stream to the decoder in the form of the second interface, the decoder performs decoding processing on the received compressed code stream, and after the decoding process ends, the decoder passes the video.
  • the information processing device notifies the player of the decoded message. Specifically, the decoder transmits the first notification message to the video information processing apparatus in the form of the second interface supported by the decoder, and the video information processing apparatus switches the interface form for transmitting the first notification message, and switches to the player. The first interface form supported. Then, the video information processing device sends the first notification message to the player in the form of the first interface supported by the player, so that the player can obtain the first notification message based on the first notification message.
  • the decoder decodes the current compressed code stream.
  • the subsequent compressed code stream may be continuously provided to the decoder by the video information processing device after receiving the first notification message.
  • the first notification message here is actually a notification message.
  • the first message is preceded by a "first”, and the "first" is neither sequential. There is no limit to the number of restrictions.
  • the video information processing apparatus transmits the video frame decoded by the decoder to the post-processing unit, including:
  • the video information processing device receives the video frame output by the decoder and receives the memory description information transmitted by the player; and transmits the video frame and the memory description information to the post-processing unit.
  • the post-processing unit post-processes the video frame and provides the post-processed video frame to the player, including:
  • the post-processing unit post-processes the video frame and stores the post-processed video frame into a memory indicated by the memory description information, the post-processed video frame being read by the player from the memory.
  • the interface form for transmitting the memory description information is switched, and the interface form supported by the player is switched to the interface supported by the post-processing unit.
  • Form and then transfer the memory description information to the post-processing unit in the form of the switched interface.
  • the player in addition to providing the compressed code stream to the decoder, the player provides memory description information for indicating the storage of the post-processed video frame to the post-processing unit. Similarly, the player does not communicate directly with the post-processing unit, but rather through the video information processing device.
  • the video information processing device receives the memory description information provided by the player, and supplies the memory description information to the post-processing unit, and the post-processing unit determines a memory space for storing the post-processed video frame based on the memory description information.
  • the post-processing unit receives the video frame and the memory description information transmitted by the video information processing device, and performs post-processing on the video frame on the one hand, and determines the memory for storing the post-processed video frame according to the memory description information, and then passes the post-processing unit.
  • the processed video frame is stored in the determined memory so that the player can read the post-processed video frame from the memory indicated by the memory description information and play it.
  • the process in which the video information processing apparatus provides the video frame decoded by the decoder to the post processing unit, and the process of providing the memory description information to the backward processing unit may be in the same process or in different processes. Further, if the video information processing device provides the video decoded by the decoder to the post processing unit The process of the frame and the process of providing the memory description information to the backward processing unit are in different processes, and the order of the two processes is not limited.
  • the video processing device may further receive the second notification message that is transmitted by the post-processing unit in the form of the third interface, and then The interface form for transmitting the second notification message is switched from the third interface form to the first interface form, and the second notification message is transmitted to the player in the form of the first interface supported by the player, where the second notification message is used. After the instructions are processed.
  • the post-processing unit performs post-processing on the received video frame, and after the post-processing ends, the post-processing unit passes the video.
  • the information processing device notifies the player of the post-processed message.
  • the third interface format supported by the post-processing unit and the processing unit transmits a second notification message to the video information processing apparatus, and the video information processing apparatus switches the interface form for transmitting the second notification message, and switches to the player.
  • the video information processing device sends the second notification message to the player in the form of the first interface supported by the player, so that the player knows that the post-processing unit completes the post-processing of the current video frame based on the second notification message.
  • the player can read the post-processed video frame in the memory indicated by the memory description information after receiving the second notification message.
  • the second notification message here is actually a notification message.
  • the second message is preceded by the notification message, and the "second" here is neither sequential. There is no limit to the number of restrictions.
  • the interface form supported by the player, the interface form supported by the decoder, and the interface form supported by the post-processing unit are not limited.
  • the form of the interface supported by the player is in the form of a standard decoder interface
  • the form of the interface supported by the decoder is the private decoder interface form.
  • the interface format supported by the player is different from the interface supported by the decoder.
  • the technical solution of the present invention is also applicable to an application scenario in which the interface supported by the player and the decoder is the same.
  • An implementation manner of the interface in the embodiment of the present invention may be an open multimedia acceleration layer.
  • OpenMax Open Media Acceleration
  • OpenMax is an Application Programming Interface (API) developed by the Khronos Group. Players and decoders based on the OpenMax interface can be quickly docked.
  • the OpenMax interface has become the industry standard, and a large number of media processing systems support access to the decoder with the OpenMax interface.
  • OpenMax defines a three-layer API interface, which is Application Level (abbreviation).
  • the AL interface, the Integration Level (IL) interface, and the Development Level (DL) interface are the most commonly used in the industry.
  • the following embodiment will exemplify the technical solution of the present invention by taking the form of the OpenMax IL interface supported by both the player and the decoder as an example. It is explained here that the problem of interface form switching is not involved in this embodiment.
  • the information interaction between the video decoding device and the player in the embodiment of the present invention can be classified into four categories, as shown in Figure 1-4:
  • the video post-processing and the video decoder are packaged together to form a video decoding device, and the OpenMax IL interface is provided externally, and the behavior mode of the OpenMax IL decoder is completely maintained.
  • the implementation structure of the video decoding device is shown in FIG. 3.
  • the process of processing the video information by the video decoding device is as follows: The player prepares the compressed code stream, and calls the OMX- EmptyThisBuffer() provided by the player to transmit the compressed code stream to the video information processing device.
  • the video information processing device calls the OMX provided by the decoder - EmptyThisBuffer() to transmit the compressed code stream to the decoder;
  • the player transmits the idle memory description information for storing the post-processed video frame to the video information processing device by calling OMX-FillThisBuffer(), and the video information processing device records the player every time through the OMX-fillThisBuffer() Memory description information transmitted;
  • the decoder decodes the received compressed code stream, and after the decoding is completed, notifies the video information processing device, and the video information processing device notifies the player that the decoding is completed by calling the EmptyBufferDone() provided by the player;
  • the decoder decodes the video frame and outputs it to the video information processing device.
  • the video information processing device acquires a corresponding memory description information from the recorded memory description information, and then decodes the video frame and the decoder through the interface of the post-processing unit.
  • the obtained memory description information is transmitted to the post-processing unit, To start the post processing unit.
  • the post-processing unit performs post-processing on the video frame, and stores the post-processed video frame in the memory supported by the memory description information, and then advertises to the video information processing device, and the video information processing device provides the FillBufferDone provided by the player.
  • the () interface notifies the player that the processing is completed, so that the player reads the post-processed video frame and performs subsequent processing, and the subsequent processing generally refers to audio and video synchronization and display.
  • the video information processing apparatus sends the post-processing unit after the decoder to the post-processing unit after the decoder by changing the direction of the video frame decoded by the decoder, after the decoder
  • the processing unit performs post-processing on the decoded video frame, implements a post-processing process on the video frame, and then provides the post-processed video frame to the player, so that the post-processing of the video is transparent to the player, so Under the premise of modifying the media processing system, the post-processing of the video frame is realized, which reduces the cost, time and the like of the video post-processing.
  • the interface form of the decoder is determined by the specific vendor and can take various forms.
  • a common form of decoder interface is: DecodeFrame (decoded stream, decoded state).
  • An application (such as a particular player) keeps calling the DecodeFrameO function, and the number of streams consumed each time and whether there is a frame output is reported in the "decoding state". In this way, the application continuously sends the code stream, takes away the decoded frame, and realizes the function of video decoding.
  • the video information processing device needs to switch the interface format between the private interface form and the OpenMax IL interface form, and the video information processing device pairs
  • the process of processing video information can be described as follows:
  • the player calls OMX - EmptyThisBufferO sends a compressed code stream to the video information processing device, and provides a memory description information for storing the decoded frame to the video information processing device through OMX-FillThisBufferO; wherein, OMX - EmptyThisBufferO and OMX - FillThisBufferO are equivalent The first interface format supported by the player;
  • the video information processing apparatus switches the interface form for transmitting the compressed code stream and the memory description information to DecodeFrameO, and decodes the compressed code stream sent by the OMX-EmployThisBufferO by calling DecodeFmme(); wherein, DecodeFrameO is equivalent to the decoder
  • the video information processing apparatus performs the following according to the returned result. Operation: If the "decode status" returned by DecodeFrameO reports that the compressed stream has been decoded, return the OMX_EmptyThisBufferDone() event to the player, notifying the player that the compressed stream has been processed; if DecodeFrameO returns "decoding" The status "reports that the decoded video frame can be output, and the video frame decoded by the decoder and the acquired memory description information are transmitted to the post-processing unit through the interface of the post-processing unit to start the post-processing unit, and the post-processing unit After processing, the OMX-fillThisBufferDoneO event is sent to the player, and the player is notified to decode the frame output;
  • FIG. 7 is a schematic structural diagram of another video decoding device according to an embodiment of the present invention.
  • the video decoding apparatus includes: a video information processing device 71, a decoder 74, and a post-processing unit 75.
  • the video information processing device 71 is configured to receive the compressed code stream transmitted by the player, transmit the compressed code stream to the decoder 74, receive the video frame decoded by the decoder 74 from the decoder 74, and decode the video decoded by the decoder 74.
  • the frame is transmitted to the post-processing unit 75.
  • the decoder 74 is configured to decode the compressed code stream transmitted by the video information processing device 71, obtain a video frame, and provide the video frame to the video information processing device 71.
  • the post-processing unit 75 is configured to post-process the video frame transmitted by the video information processing device 71 and provide the post-processed video frame to the player, and the post-processed video frame is transmitted to the display unit for display by the player. .
  • the video information processing apparatus 71 is specifically configured to receive the compressed code stream transmitted by the player in the form of a first interface, where the first interface form is an interface form supported by the player.
  • the video information processing device 71 is further configured to switch the interface form for transmitting the compressed code stream from the first interface form to the second interface form.
  • the second interface form is an interface form supported by the decoder 74.
  • the video information processing device 71 is specifically configured to transmit the compressed code stream to the decoder 74 in the form of a second interface.
  • the video information processing apparatus 71 is further configured to: after transmitting the compressed code stream to the decoder in the form of the second interface, receive the first notification message transmitted by the decoder in the form of the second interface, The interface of the first notification message is switched from the second interface to the first interface, and the first notification message is transmitted to the player in the form of the first interface.
  • the first notification message is used to indicate that the decoding is complete.
  • the video information processing apparatus 71 is further configured to decode the decoder 74. Before the video frame is transmitted to the post-processing unit 75, the memory description information transmitted by the player is received, and the memory description information is transmitted to the post-processing unit 75. Stored in the memory indicated by the memory description information, the post-processed video frame is read by the player from the memory indicated by the memory description information.
  • the video information processing apparatus 71 is further configured to: after transmitting the video frame and the memory description information to the post-processing unit 75, receive the second notification message that is transmitted by the post-processing unit 75 in the form of the third interface, The interface form for transmitting the second notification message is switched from the third interface form to the first interface form, and the second notification message is transmitted to the player in the form of the first interface.
  • the third interface form is an interface form supported by the post-processing unit.
  • the second notification message is used to indicate that the post-processing is completed.
  • the first interface form used by the player may be in the form of a standard decoder interface, for example, may be in the form of an OpenMax IL interface, but is not limited thereto.
  • the second interface form used by the decoder is typically in the form of a private decoder interface.
  • the video decoding device provided in this embodiment may be used to perform the process of the foregoing method embodiments, and the working principles of the internal components thereof are not described again. For details, refer to the description of the method embodiments.
  • the video information processing device 71, the decoder 74, and the post-processing unit 75 can be implemented by a logic integrated circuit. Specifically, the entire functions of the video information processing device 71, the decoder 74, and the post-processing unit 75 can be implemented entirely by hardware, that is, entirely by an algorithm executed by the logic integrated circuit. Alternatively, all functions of the video information processing device 71, the decoder 74, and the post-processing unit 75 may also be implemented by a combination of software and hardware, that is, the logic integrated circuit may perform an operation under the driving of the driver software to complete the operation. Description of the function.
  • the video decoding device performs the interface switching between the player and the decoder on the one hand, and provides a unified interface form on the other hand.
  • the video frame is made.
  • the post-processing unit sent to the decoder implements post-processing and provides the post-processed video frame to the player, which is equivalent to integrating the decoder and the post-processing unit, so that the post-processing is transparent to the player,
  • the player and the decoder need to be modified, and the other components in the media processing system are not affected.
  • the post-processing of the video frame is realized without modifying the media processing system, thereby reducing the implementation cost and time of the video post-processing. And so on.
  • the aforementioned program can be stored in a computer readable In the storage medium.
  • the steps including the foregoing method embodiments are performed; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种视频信息处理方法及设备。该视频信息处理方法包括：视频信息处理装置接收播放器传输的压缩码流，将压缩码流传输给解码器；解码器进行解码，并将解码出的视频帧传输给视频信息处理装置；视频信息处理装置将视频帧传输给后处理单元，后处理单元进行后处理并向播放器提供经过后处理的视频帧。本技术方案可以在不大量修改媒体处理系统的前提下实现对视频帧的后处理，降低视频后处理的实现成本、时间等代价。

Description

视频信息处理方法及设备
本申请要求于 2013年 11月 22 日 提交中 国专利局、 申请号为 201310601757.1 , 发明名称为 "视频信息处理方法及设备" 的中国专利申请的 优先权， 其全部内容通过引用结合在本申请中。 挾术领域 本发明涉及通信技术， 尤其涉及一种视频信息处理方法及设备。 背景挾术
媒体处理系统一般包括播放器、媒体源处理单元、 解码单元、 显示单元等 组件。媒体处理系统处理视频信息的一般过程是： 播放器从网络或本地存储模 块中读入媒体文件， 具体地， 由媒体源处理单元对媒体文件进行解析， 把其中 的压缩码流分离出来， 并输入到播放器； 播放器 4巴压缩码流送到解码单元， 由 解码单元将压缩码流转换为视频帧， 并输入到播放器； 视频帧经过音视频同步 之后被播放器送到显示单元进行显示。在上述过程中，视频帧被解码出来之后 直接被送到显示单元进行显示， 这在画质方面存在问题， 例如无法弥补视频压 缩造成的画质损失， 无法实施画质提升处理， 因此， 从画质的角度来看视频帧 被解码出来之后不宜立即进行显示， 需要对它进行一定的处理， 这种在解码后 对视频帧所 ^1的处理即为 "视频后处理" 。
图 1为现有技术中一种媒体处理系统的结构示意图。在图 1所示媒体处理系 统中，视频帧被解码出来之后直接被送到显示单元进行显示， 这在画质方面存 在问题。 例如， 在图 1所示媒体处理系统中， 视频压缩会造成画质损失， 主要 体现为 "块效应" 、 "振铃效应" 等现象， 这些现象可以在解码后通过视频后 处理， 例如去块效应 （deblocking ) 、 去振铃效应 （ deringing )等有效地得到 緩解。 又例如， 在图 1所示媒体处理系统中， 解码之后无法提升主观画质， 实 际上在解码之后可以通过视频后处理， 例如颜色增强、 对比度增强、 清晰度增 强等有效地提升主观画质。 又例如， 在图 1所示媒体处理系统中， 如果视频源 是隔行的， 意味着视频帧的 "顶场" 和 "底场" （视频帧的第 0,2,4,6...行组合 在一起称为 "顶场" ， 视频帧的第 1,3,5,…行组合在一起称为 "底场" )之间 存在时间差， 这样的两场所组成的视频帧，在运动物体的边缘会呈现大量的横 线， 从播放效果来看仿佛两个物体部分重叠， 即直接播放会出现 "重影" ， 而 在解码之后通过视频后处理， 例如做去隔行（de-interlace )处理， 可以解决该 问题。
通常，视频后处理功能需要与现有媒体处理系统中的部分组件集成在一起 实现， 例如可以将视频后处理功能集成到图 1中的显示单元的显示控制器中实 现， 或者将视频后处理功能集成到图 1的播放器内实现， 但是这种实现方式需 要对现有媒体处理系统中的部分组件进行修改， 修改媒体处理系统的实现成 本、 时间等代价较大。 发明内容
本发明实施例提供一种视频信息处理方法及设备，用以在不大量修改媒体 处理系统的前提下实现对视频帧的后处理， 降低视频后处理的实现成本、 时间 等代价。
第一方面提供一种视频信息处理方法， 包括：
视频信息处理装置接收播放器传输的压缩码流；
所述视频信息处理装置将所述压缩码流传输给解码器；
所述解码器对所述压缩码流进行解码得到视频帧并将所述视频帧提供给 所述视频信息处理装置；
所述视频信息处理装置将所述解码器解码出的所述视频帧传输给后处理 单元； 理的视频帧 ,所述经过后处理的视频帧经过所述播放器被传输至显示单元以做 显示。
结合第一方面，在第一方面的第一种可能的实现方式中， 所述视频信息处 理装置接收播放器传输的压缩码流， 包括：
所述视频信息处理装置接收所述播放器以第一接口形式传输的所述压缩 码流， 所述第一接口形式是所述播放器所支持的接口形式；
所述视频信息处理装置将所述压缩码流传输给解码器， 包括：
所述视频信息处理装置将用于传输所述压缩码流的接口形式从所述第一 接口形式切换为第二接口形式，并以所述第二接口形式将所述压缩码流传输给 所述解码器， 所述第二接口形式是所述解码器所支持的接口形式。
结合第一方面的第一种可能的实现方式，在第一方面的第二种可能的实现 方式中，所述视频信息处理装置以第二接口形式将所述压缩码流传输给所述解 码器之后， 还包括：
所述视频信息处理装置接收所述解码器以所述第二接口形式传输的第一 通知消息；
所述视频信息处理装置将用于传输所述第一通知消息的接口形式从所述 第二接口形式切换为所述第一接口形式，并以所述第一接口形式将所述第一通 知消息传输给所述播放器； 其中， 所述第一通知消息用于指示解码完毕。
结合第一方面的第一种可能的实现方式或第一方面的第二种可能的实现 方式，在第一方面的第三种可能的实现方式中， 所述视频信息处理装置将所述 解码器解码出的所述视频帧传输给后处理单元包括：
所述视频信息处理装置接收所述解码器输出的所述视频帧，并接收所述播 放器传输的内存描述信息；
所述视频信息处理装置将所述视频帧和所述内存描述信息传输给所述后 处理单元； 理的视频帧包括：
所述后处理单元对所述视频帧进行后处理并将经过后处理的视频帧存储 到所述内存描述信息指示的内存中，所述经过后处理的视频帧由所述播放器从 所述内存中读取。
结合第一方面的第三种可能的实现方式，在第一方面的第四种可能的实现 方式中，所述视频信息处理装置将所述视频帧和所述内存描述信息传输给所述 后处理单元之后， 还包括：
所述视频信息处理装置接收所述后处理单元传以第三接口形式传输的第 二通知消息， 所述第三接口形式是所述后处理单元所支持的接口形式；
所述视频信息处理装置将用于传输所述第二通知消息的接口形式从所述 第三接口形式切换为所述第一接口形式，并以所述第一接口形式将所述第二通 知消息传输给所述播放器； 其中， 所述第二通知消息用于指示后处理完毕。 结合第一方面的第一种可能的实现方式或第一方面的第二种可能的实现 方式或第一方面的第三种可能的实现方式或第一方面的第四种可能的实现方 式，在第一方面的第五种可能的实现方式中， 所述第一接口形式为标准解码器 接口形式， 所述第二接口形式为私有解码器接口形式。
第二方面提供一种视频解码设备， 包括： 视频信息处理装置、 解码器和后 处理单元；
所述视频信息处理装置， 用于接收播放器传输的压缩码流，将所述压缩码 流传输给所述解码器，从所述解码器接收所述解码器解码出的视频帧， 并将所 述视频帧传输给所述后处理单元；
所述解码器， 用于对所述压缩码流进行解码， 获得所述视频帧， 并将所述 视频帧提供给所述视频信息处理装置；
所述后处理单元，用于对所述视频信息处理装置传输的所述视频帧进行后 处理并向所述播放器提供经过后处理的视频帧，所述经过后处理的视频帧经过 所述播放器被传输至显示单元以做显示。
结合第二方面，在第二方面的第一种可能的实现方式中， 所述视频信息处 理装置具体用于接收所述播放器以第一接口形式传输的所述压缩码流，所述第 一接口形式是所述播放器所支持的接口形式；
所述视频信息处理装置，还用于将用于传输所述压缩码流的接口形式从所 述第一接口形式切换为第二接口形式，所述第二接口形式是所述解码器所支持 的接口形式；
所述视频信息处理装置具体用于以所述第二接口形式将所述压缩码流传 输给所述解码器。
结合第二方面的第一种可能的实现方式，在第二方面的第二种可能的实现 方式中， 所述视频信息处理装置，还用于在以所述第二接口形式将所述压缩码 流传输给所述解码器之后，接收所述解码器以所述第二接口形式传输的第一通 知消息，将用于传输所述第一通知消息的接口形式从所述第二接口形式切换为 所述第一接口形式，并以所述第一接口形式将所述第一通知消息传输给所述播 放器； 其中， 所述第一通知消息用于指示解码完毕。
结合第二方面的第一种可能的实现方式或第二方面的第二种可能的实现 方式， 在第二方面的第三种可能的实现方式中， 所述视频信息处理装置， 还用 于在将所述解码器解码出的视频帧传输给所述后处理单元之前，接收所述播放 器传输的内存描述信息， 并将所述内存描述信息传输给所述后处理单元； 频帧存储到所述内存描述信息指示的内存中，所述经过后处理的视频帧由所述 播放器从所述内存中读取。
结合第二方面的第三种可能的实现方式，在第二方面的第四种可能的实现 方式中， 所述视频信息处理装置，还用于在将所述视频帧和所述内存描述信息 传输给所述后处理单元之后，接收所述后处理单元传以第三接口形式传输的第 二通知消息，将用于传输所述第二通知消息的接口形式从所述第三接口形式切 换为所述第一接口形式，并以所述第一接口形式将所述第二通知消息传输给所 述播放器； 其中， 所述第三接口形式是所述后处理单元所支持的接口形式， 所 述第二通知消息用于指示后处理完毕。
结合第二方面的第一种可能的实现方式或第二方面的第二种可能的实现 方式或第二方面的第三种可能的实现方式或第二方面的第四种可能的实现方 式，在第二方面的第五种可能的实现方式中， 所述第一接口形式为标准解码器 接口形式， 所述第二接口形式为私有解码器接口形式。
本发明实施例提供的视频信息处理方法及设备，视频信息处理装置接收播 放器传输的压缩码流， 将其传输给解码器， 以供解码器进行解码获得视频帧， 再将解码器解码出的视频帧传输给后处理单元进行后处理，由后处理单元向播 放器提供经过后处理的视频帧。通过分析可知， 本发明实施例通过视频后处理 装置改变解码出的视频帧的走向，使得解码出的视频帧被送到解码器之后的后 处理单元， 可由解码器之后的后处理单元对解码出的视频帧进行后处理，相当 于将解码器和后处理单元集成在一起，使得后处理对播放器透明， 这样就不需 要对播放器和解码器进行修改，也不会影响媒体处理系统中的其他组件，在不 大量修改媒体处理系统的前提下实现了对视频帧的后处理，降低了视频后处理 的实现成本、 时间等代价。 附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施 例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地， 下面描 述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出 创造性劳动性的前提下， 还可以根据这些附图获得其他的附图。
图 1为现有技术中一种媒体处理系统的结构示意图；
图 2为本发明实施例提供的一种媒体处理系统的结构示意图；
图 3为本发明实施例提供的一种视频解码设备的结构示意图；
图 4a为本发明实施例提供的一种视频信息处理方法的流程图；
图 4b为本发明实施例提供的另一种视频信息处理方法的流程图；
图 5为本发明实施例提供的又一种视频信息处理方法的流程图；
图 6为本发明实施例提供的基于 OpenMax IL接口形式的视频解码设备与 播放器的信息交互示意图；
图 7为本发明实施例提供的另一种视频解码设备的结构示意图。 具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚， 下面将结合本发明 实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然， 所描述的实施例是本发明一部分实施例， 而不是全部的实施例。基于本发明中 的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其 他实施例， 都属于本发明保护的范围。
针对本申请解决的问题， 本发明实施例提供了一种新的媒体处理系统， 该 媒体处理系统的结构如图 2所示， 主要包括： 播放器 21、 媒体源处理单元 22、 视频解码设备 23和显示单元 24。其中，视频解码设备 23主要集成有解码器和后 处理单元， 一方面完成对压缩码流的解码， 另一方面完成解码之后的视频后处 在一可选实施方式中， 如图 3所示， 视频解码设备 23的实现结构包括： 视 频信息处理装置 231、 解码器 232和后处理单元 233。 其中， 解码器 232主要实现 对压缩码流的解码， 后处理单元 233主要实现解码后的视频后处理功能， 而视 频信息处理装置 231主要用于克服现有技术因实现视频后处理功能所存在的各 种问题。 其中， 播放器 21、 媒体源处理单元 22、 视频信息处理装置 231、 解码 器 232、 后处理单元 233和显示单元 24之间连接关系如图 3所示。
基于上述媒体处理系统， 本发明以下实施例提供一种视频信息处理方法， 如图 4a所示， 该视频信息处理方法包括：
301、 视频信息处理装置接收播放器传输的压缩码流。
302、 视频信息处理装置将压缩码流传输给解码器。
303、 解码器对压缩码流进行解码得到视频帧并将视频帧提供给视频信息 处理装置。
304、 视频信息处理装置将解码器解码出的视频帧传输给后处理单元。
305、 后处理单元对视频帧进行后处理并向播放器提供经过后处理的视频 帧， 该经过后处理的视频帧经过播放器被传输至显示单元以做显示。
在本实施例中，视频信息处理装置位于播放器和解码器之间， 主要负责播 放器和解码器之间的信息传输， 具体的，视频信息处理装置将来自播放器的压 缩码流提供给解码器； 解码器对视频信息处理装置提供的压缩码流进行解码， 并将解码器解码出的视频帧提供给视频信息处理装置；视频信息处理装置再将 解码器解码出的视频帧传输给后处理单元；后处理单元对视频帧进行后处理后 提供给播放器。 在现有技术中， 视频帧从解码器输出后直接被送往播放器， 而 本实施例通过视频信息处理装置将视频帧发送到解码器之后的后处理单元，实 现对视频帧的后处理， 之后再由后处理单元向播放器提供经过后处理的视频 帧， 相当于将解码器和后处理单元集成在一起， 使得后处理对播放器透明， 这 样就不需要对播放器和解码器进行修改，也不会影响媒体处理系统中的其他组 件，在不大量修改媒体处理系统的前提下实现了对视频帧的后处理， 降低了视 频后处理的实现成本、 时间等代价。
考虑到播放器和解码器可以支持相同的接口形式，也可以支持不同的接口 形式， 本发明以下实施例提供另一种视频信息处理方法， 如图 4b所示， 该方法 包括：
401、 视频信息处理装置接收播放器以第一接口形式传输的压缩码流； 其 中第一接口形式是播放器所支持的接口形式。
402、 视频信息处理装置将用于传输压缩码流的接口形式从第一接口形式 切换为第二接口形式，并以第二接口形式将上述压缩码流传输给解码器，其中， 第二接口形式是解码器所支持的接口形式。
403、 解码器对视频信息处理装置以第二接口形式传输的压缩码流进行解 码， 获得视频帧并将视频帧提供给视频信息处理装置。 404、 视频信息处理装置将解码器解码出的视频帧传输给后处理单元。
405、 后处理单元对该视频帧进行后处理并向播放器提供经过后处理的视 频帧， 该经过后处理的视频帧经过播放器被传输至显示单元以做显示。
在本实施例中，播放器传输的压缩码流是以播放器所支持的接口形式传输 的（即以第一接口形式传输该压缩码流）， 且该压缩码流并不像现有技术那样 直接传输给解码器， 而是传输给视频信息处理装置。视频信息处理装置接收到 播放器以该播放器所支持的接口形式传输的压缩码流之后，对传输该压缩码流 的接口形式进行切换， 切换到解码器所支持的接口形式， 即第二接口形式。 然 后，视频信息处理装置以第二接口形式将该压缩码流传输给解码器。由此可见， 在本实施例中，通过在播放器和解码器之间增加视频信息处理装置， 由视频信 息处理装置对播放器和解码器之间传输压缩码流釆用的接口形式进行切换，使 得播放器和解码器可以各自釆用自己所支持的接口形式，不需要因所支持的接 口形式不同而对播放器和解码器进行修改。
通常，播放器所支持的接口形式是标准解码器接口形式， 而解码器所支持 的接口形式一般是私有解码器接口形式。而视频信息处理装置在播放器和解码 器之间进行接口格式的切换，相当于对外提供了统一的标准解码器接口， 这就 使得播放器和解码器均不需要为实现后处理而做改动。在此说明， 进行接口格 式的切换属于现有技术，视频信息处理装置可以根据播放器和解码器所支持的 接口形式参照现有技术中相应的切换方式实现接口格式的切换。
解码器接收视频信息处理装置以第二接口形式传输的压缩码流，对接收到 的压缩码流进行解码处理， 获得视频帧， 并将解码出的视频帧传输给视频信息 处理装置， 再由视频信息处理装置将视频帧传输给后处理单元。后处理单元接 收到视频信息处理装置传输的视频帧后，对视频帧进行后处理， 并向播放器提 供经过后处理的视频帧， 实现对视频帧的后处理。
在此说明，在本发明实施例中，在解码后对视频帧所做的处理叫做后处理。 后处理单元对视频帧的后处理操作包括但不限于以下操作中的至少一个：去块 效应、 去振铃效应、 颜色增强、 对比度增强、 清晰度增强和去隔行处理。
由上述可知，本发明实施例实际上是通过在播放器和解码器之间增加视频 信息处理装置，一方面对播放器和解码器之间用于传输压缩码流的接口形式进 行转换，对外提供标准解码器接口， 另一方面通过改变解码器解码出的视频帧 的走向，使得视频帧被送往解码器之后的后处理单元实现后处理， 并将经过后 处理的视频帧提供给播放器，这相当于将视频后处理功能和解码器集成在一起 实现， 使得视频后处理对播放器透明， 这就无需对播放器和解码器进行修改， 也就解决了要求媒体处理系统所作的修改必须开源的问题，同时降低了实现视 频后处理的成本、 时间等代价。
图 5为本发明实施例提供的又一种视频信息处理方法的流程图。 如图 5所 示， 该视频信息处理方法包括：
501、 视频信息处理装置接收播放器以第一接口形式传输的压缩码流； 其 中第一接口形式是播放器所支持的接口形式。
502、 视频信息处理装置将用于传输压缩码流的接口形式从第一接口形式 切换为第二接口形式，并以第二接口形式将上述压缩码流传输给解码器；其中， 第二接口形式是解码器所支持的接口形式。
503、 解码器接收视频信息处理装置以第二接口形式传输的压缩码流并进 行解码得到视频帧， 并将视频帧提供给视频信息处理装置。
504、视频信息处理装置接收解码器以第二接口形式传输的第一通知消息， 将用于传输第一通信消息的接口形式从第二接口形式切换为第一接口形式，并 以第一接口形式将第一通知消息传输给播放器； 其中， 第一通知消息用于指示 解码完毕。
505、 视频信息处理装置将解码器解码出的视频帧传输给后处理单元。 506、 后处理单元对该视频帧进行后处理并向播放器提供经过后处理的视 频帧， 该经过后处理的视频帧经过播放器被传输至显示单元以做显示。
在此说明， 步骤 501、 502、 503、 505和 506的描述可参见步骤 401-405的描 述， 在此不再赘述。 且步骤 504和步骤 505的先后顺序可以不做限于图 5所示。
在本实施例中，视频信息处理装置以第二接口形式将压缩码流传输给解码 器之后， 解码器会对接收到的压缩码流进行解码处理， 当解码处理结束之后， 解码器会通过视频信息处理装置向播放器通告解码完毕的消息。具体的，解码 器以解码器所支持的第二接口形式向视频信息处理装置传输第一通知消息，由 视频信息处理装置对用于传输第一通知消息的接口形式进行切换，切换为播放 器所支持的第一接口形式。 然后，视频信息处理装置以播放器所支持的第一接 口形式将第一通知消息发送给播放器，这样播放器可以基于该第一通知消息获 知解码器对当前压缩码流解码完毕。可选的，如果播放器还有后续压缩码流需 要进行解码，则可以在接收到第一通知消息后继续通过视频信息处理装置向解 码器提供后续的压缩码流。在此说明， 这里的第一通知消息实际上就是一个通 知消息，为了便于与后续其它通知消息相区分，故在通知消息之前冠以 "第一"， 这里的 "第一" 既没有先后顺序的限定， 也没有个数的限定。
基于图 4a、 图 4b或图 5所示方法实施例， 在一可选实施方式中， 上述视频 信息处理装置将解码器解码出的视频帧传输给后处理单元， 包括：
视频信息处理装置接收解码器输出的视频帧，并接收播放器传输的内存描 述信息； 将该视频帧和内存描述信息传输给后处理单元。
相应的，后处理单元对视频帧进行后处理并向播放器提供经过后处理的视 频帧， 包括：
后处理单元对该视频帧进行后处理并将经过后处理的视频帧存储到该内 存描述信息指示的内存中， 该经过后处理的视频帧由播放器从该内存中读取。
可选的，视频信息处理装置在将内存描述信息传输给后处理单元之前，还 会对传输内存描述信息的接口形式进行切换，将由播放器所支持的接口形式切 换为后处理单元所支持的接口形式，然后再以切换后的接口形式将内存描述信 息传输给后处理单元。
在该实施方式中，播放器除了向解码器提供压缩码流之外，还会向后处理 单元提供用于指示存储经过后处理视频帧的内存描述信息。 同理， 该播放器也 不直接与后处理单元进行通信， 而是通过视频信息处理装置。视频信息处理装 置接收播放器提供的内存描述信息， 并将该内存描述信息提供给后处理单元， 后处理单元根据该内存描述信息确定用于存储经过后处理的视频帧的内存空 间。后处理单元接收视频信息处理装置传输的视频帧和内存描述信息， 一方面 对视频帧进行后处理，另一方面根据内存描述信息确定用于存储经过后处理的 视频帧的内存， 进而将经过后处理的视频帧存储到所确定的内存中， 这样播放 器就可以从该内存描述信息所指示的内存中去读取经过后处理的视频帧并进 行播放。
视频信息处理装置向后处理单元提供解码器解码出的视频帧的过程，与向 后处理单元提供内存描述信息的过程可以在同一过程中 ,也可以是在不同的过 程中。进一步，如果视频信息处理装置向后处理单元提供解码器解码出的视频 帧的过程， 与向后处理单元提供内存描述信息的过程是在不同过程中， 则这两 个过程的先后顺序也不做限定。
基于上述可选实施方式， 进一步可选的，视频信息处理装置将视频帧和内 存描述信息传输给后处理单元之后，还可以接收后处理单元以第三接口形式传 输的第二通知消息，然后将用于传输第二通知消息的接口形式从第三接口形式 切换为第一接口形式，并以播放器所支持的第一接口形式将第二通知消息传输 给播放器， 其中， 第二通知消息用于指示后处理完毕。
在该实施方式中，视频信息处理装置将视频帧和内存描述信息传输给后处 理单元之后，后处理单元会对接收到的视频帧进行后处理，当后处理结束之后， 后处理单元会通过视频信息处理装置向播放器通告后处理完毕的消息。 具体 的，后处理单元以后处理单元所支持的第三接口格式向视频信息处理装置传输 第二通知消息，由视频信息处理装置对用于传输第二通知消息的接口形式进行 切换， 切换为播放器所支持的第一接口形式。 然后， 视频信息处理装置以播放 器所支持的第一接口形式将第二通知消息发送给播放器 ,使播放器基于该第二 通知消息获知后处理单元完成对当前视频帧的后处理。可选的，播放器可以在 接收到第二通告消息之后，去内存描述信息所指示的内存中读取经过后处理的 视频帧。 在此说明， 这里的第二通知消息实际上就是一个通知消息， 为了便于 与第一通知消息相区分， 故在通知消息之前冠以 "第二" ， 这里的 "第二" 既 没有先后顺序的限定， 也没有个数的限定。
在本发明实施例中，对播放器所支持的接口形式、解码器所支持的接口形 式以及后处理单元所支持的接口形式均不做限定。通常，播放器所支持的接口 形式是标准解码器接口形式，而解码器所支持的接口形式是私有解码器接口形 式。 一般， 播放器所支持的接口形式与解码器所支持的接口形式不相同。 但本 发明技术方案同样适用于播放器和解码器所支持的接口形式相同的应用场景。
其中， 本发明实施例中接口的一种实现方式可以是开放多媒体加速层
( Open Media Acceleration , 简称为 OpenMax ) 。 OpenMax是科纳斯组织 ( Khronos Group )制定的应用程序接口 ( Application Programming Interface, 简称为 API ) , 基于 OpenMax接口的播放器和解码器可以快速对接。 OpenMax 接口已经成为业界标准， 大量媒体处理系统都支持以 OpenMax接口访问解码 器。 OpenMax定义了三层 API接口， 分别为应用水平 (Application Level , 简称 为 AL)接口、 集成水平 （Integration Level , 简称为 IL)接口和发展水平 (Development Level, 简称为 DL)接口， 业界最常用的是 IL接口。 以下实施例将 以播放器和解码器均支持 OpenMax IL接口形式为例， 详细说明本发明技术方 案。 在此说明， 在该实施方式中不涉及接口形式切换的问题。
以 OpenMax IL接口形式为例， 本发明实施例中的视频解码设备与播放器 的信息交互可归纳为四类， 如图 6中的① -④：
①： 表示播放器向视频解码设备发送压缩码流， 由播放器主动调用视频解 码设备提供的 OMX— EmptyThisBufferO接口实现；
②： 表示视频解码设备报告码流解码完毕， 由视频解码设备调用播放器提 供的 EmpbyBufferDone()接口实现；
③：表示播放器向视频解码设备提供用于存放解码出的视频帧的内存描述 信息， 由播放器主动调用视频解码设备提供的 OMX— FillThisBuffer()接口实现；
④： 表示视频解码设备报告视频帧后处理完毕，通知播放器可以使用经过 后处理的视频帧， 由视频解码设备调用播放器提供的 FillBufferDoneO接口实 现。
本实施例把视频后处理和视频解码器封装在一起形成视频解码设备，对外 提供 OpenMax IL接口， 完全保持 OpenMax IL解码器的行为模式。 该视频解码 设备的实现结构如图 3所示。该视频解码设备对视频信息进行处理的过程如下： 播放器准备好压缩码流， 调用播放器所提供的 OMX— EmptyThisBuffer()把 压缩码流传送到视频信息处理装置。 视频信息处理装置调用解码器提供的 OMX— EmptyThisBuffer()将压缩码流传送给解码器；
另外， 播放器通过调用 OMX— FillThisBuffer(), 将空闲的用于存放经过后 处理的视频帧的内存描述信息传送给视频信息处理装置，视频信息处理装置记 录播放器每一次通过 OMX— FillThisBuffer()传送的内存描述信息；
解码器对接收到的压缩码流进行解码，解码完毕之后通知视频信息处理装 置，视频信息处理装置通过调用播放器提供的 EmptyBufferDone()通知播放器解 码完毕；
解码器解码出视频帧之后输出给视频信息处理装置，视频信息处理装置从 所记录的内存描述信息中获取对应的一个内存描述信息，然后通过后处理单元 的接口把解码器解码出的视频帧和所获取的内存描述信息传送给后处理单元， 以启动后处理单元。
后处理单元对视频帧进行后处理，并将经过后处理的视频帧存储到内存描 述信息所支持的内存中，之后向视频信息处理装置通告后处理完毕，视频信息 处理装置通过播放器提供的 FillBufferDone()接口通知播放器后处理完毕， 以供 播放器读取经过后处理的视频帧并进行后续处理，所述后续处理一般是指音视 频同步和显示。
由上述可见， 本发明实施例提供的视频信息处理方法，视频信息处理装置 通过调改变解码器解码出的视频帧的走向，将其发送给解码器之后的后处理单 元， 由解码器之后的后处理单元对解码出的视频帧进行后处理， 实现了对视频 帧的后处理过程，再将经过后处理的视频帧提供给播放器，使得该视频后处理 对播放器透明，因此可以在不大量修改媒体处理系统的前提下实现了对视频帧 的后处理， 降低了视频后处理的实现成本、 时间等代价。
通常， 解码器的接口形式是特定供应商自行决定的， 形式各异。 一种常见 的解码器接口形式是： DecodeFrame (解码码流， 解码状态）。 应用程序 （比如 某个特定的播放程序） 不停地调用 DecodeFrameO函数， 每次消耗的码流数量 以及是否有帧输出， 均在 "解码状态" 中予以上报。 应用程序通过这种方式不 断地送入码流， 取走解码帧， 实现视频解码的功能。
假定解码器釆用上述接口形式， 而播放器釆用 OpenMax IL接口形式， 则 视频信息处理装置需要在这种私有的接口形式和 OpenMax IL接口形式之间进 行接口格式的切换， 视频信息处理装置对视频信息进行处理的过程可描述如 下：
1.播放器调用 OMX— EmptyThisBufferO向视频信息处理装置送入压缩码 流， 并通过 OMX— FillThisBufferO向视频信息处理装置提供存放解码帧的内存 描述信息； 其中， OMX— EmptyThisBufferO和 OMX— FillThisBufferO等相当于播 放器所支持的第一接口格式；
2.视频信息处理装置将用于传输压缩码流和内存描述信息的接口形式切 换 为 DecodeFrameO , 通 过 调 用 DecodeFmme() 解 码 由 上 述 OMX— EmptyThisBufferO送入的压缩码流； 其中， DecodeFrameO相当于解码器 所支持的第二接口形式；
3、 DecodeFrameO函数返回后， 视频信息处理装置根据返回结果执行如下 操作： 如果 DecodeFrameO返回的 "解码状态" 报告送入的压缩码流已经解码 完毕， 向播放器返回 OMX— EmptyThisBufferDone()事件， 通知播放器这部分压 缩码流已经处理完毕； 如果 DecodeFrameO返回的 "解码状态" 报告有解码出 的视频帧可以输出，则通过后处理单元的接口把解码器解码出的视频帧和所获 取的内存描述信息传送给后处理单元， 以启动后处理单元， 当后处理单元处理 完毕后， 向播放器发出 OMX— FillThisBufferDoneO事件， 通知播放器解码有帧 输出；
循环执行上述步骤 1-3直至压缩码流解码完毕。
图 7为本发明实施例提供的另一种视频解码设备的结构示意图。 如图 7所 示， 该视频解码设备包括： 视频信息处理装置 71、 解码器 74和后处理单元 75。
视频信息处理装置 71 , 用于接收播放器传输的压缩码流，将压缩码流传输 给解码器 74 ,从解码器 74接收解码器 74解码出的视频帧， 并将解码器 74解码出 的视频帧传输给后处理单元 75。
解码器 74, 用于对视频信息处理装置 71传输的压缩码流进行解码， 获得视 频帧， 并将视频帧提供给视频信息处理装置 71。
后处理单元 75 ,用于对视频信息处理装置 71传输的视频帧进行后处理并向 播放器提供经过后处理的视频帧，该经过后处理的视频帧经过播放器被传输至 显示单元以做显示。
在一可选实施方式中，视频信息处理装置 71具体用于接收播放器以第一接 口形式传输的压缩码流， 其中第一接口形式是播放器所支持的接口形式。
进一步，视频信息处理装置 71在接收播放器以第一接口形式传输的压缩码 流后，还用于将用于传输压缩码流的接口形式从第一接口形式切换为第二接口 形式。 其中， 第二接口形式是解码器 74所支持的接口形式。 则视频信息处理装 置 71具体用于以第二接口形式将压缩码流传输给解码器 74。
在一可选实施方式中，视频信息处理装置 71 ,还用于在以第二接口形式将 压缩码流传输给解码器之后， 接收解码器以第二接口形式传输的第一通知消 息， 将用于传输第一通知消息的接口形式从第二接口形式切换为第一接口形 式， 并以第一接口形式将第一通知消息传输给播放器； 其中， 第一通知消息用 于指示解码完毕。
在一可选实施方式中，视频信息处理装置 71 ,还用于在将解码器 74解码出 的视频帧传输给后处理单元 75之前，接收播放器传输的内存描述信息， 并将内 存描述信息传输给后处理单元 75。 存储到内存描述信息指示的内存中，该经过后处理的视频帧由播放器从内存描 述信息指示的内存中读取。
在一可选实施方式中，视频信息处理装置 71 ,还用于在将视频帧和内存描 述信息传输给后处理单元 75之后，接收后处理单元 75以第三接口形式传输的第 二通知消息，将用于传输第二通知消息的接口形式从第三接口形式切换为第一 接口形式， 并以第一接口形式将第二通知消息传输给播放器。 第三接口形式是 后处理单元所支持的接口形式。 第二通知消息用于指示后处理完毕。
在一可选实施方式中，播放器釆用的第一接口形式可以是标准解码器接口 形式， 例如可以为 OpenMax IL接口形式， 但不限于此。 解码器釆用的第二接 口形式一般为私有解码器接口形式。
本实施例提供的视频解码设备可用于执行前述方法实施例的流程，其及其 内部部件的工作原理不再赘述， 详见方法实施例的描述。
视频信息处理装置 71、解码器 74和后处理单元 75可以通过逻辑集成电路实 现。 具体地， 视频信息处理装置 71、 解码器 74和后处理单元 75的全部功能可以 完全通过硬件来实现，即完全通过逻辑集成电路所执行的算法来实现。可选地， 视频信息处理装置 71、解码器 74和后处理单元 75的全部功能也可通过软件和硬 件结合的方式实现，即所述逻辑集成电路可以在驱动软件的驱动下执行运算来 完成所述功能。
本实施例提供的视频解码设备，一方面在播放器和解码器之间进行接口形 式的切换，对外提供统一的接口形式， 另一方面通过改变解码器解码出的视频 帧的走向，使得视频帧被送往解码器之后的后处理单元实现后处理， 并将经过 后处理的视频帧提供给播放器， 这相当于将解码器和后处理单元集成在一起， 使得后处理对播放器透明， 不需要对播放器和解码器进行修改，也不会影响媒 体处理系统中的其他组件 ,在不修改媒体处理系统的前提下实现了对视频帧的 后处理， 降低了视频后处理的实现成本、 时间等代价。
本领域普通技术人员可以理解：实现上述各方法实施例的全部或部分步骤 可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取 存储介质中。 该程序在执行时， 执行包括上述各方法实施例的步骤； 而前述的 存储介质包括： ROM, RAM,磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是： 以上各实施例仅用以说明本发明的技术方案， 而非对其 限制； 尽管参照前述各实施例对本发明进行了详细的说明， 本领域的普通技术 人员应当理解： 其依然可以对前述各实施例所记载的技术方案进行修改， 或者 对其中部分或者全部技术特征进行等同替换； 而这些修改或者替换， 并不使相 应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims

权 利 要 求
1、 一种视频信息处理方法， 其特征在于， 包括：
视频信息处理装置接收播放器传输的压缩码流；
所述视频信息处理装置将所述压缩码流传输给解码器；
所述解码器对所述压缩码流进行解码得到视频帧并将所述视频帧提供给 所述视频信息处理装置；
所述视频信息处理装置将所述解码器解码出的所述视频帧传输给后处理 单元； 理的视频帧，所述经过后处理的视频帧经过所述播放器被传输至显示单元以做 显示。
2、 根据权利要求 1所述的方法， 其特征在于， 所述视频信息处理装置接收 播放器传输的压缩码流， 包括：
所述视频信息处理装置接收所述播放器以第一接口形式传输的所述压缩 码流， 所述第一接口形式是所述播放器所支持的接口形式；
所述视频信息处理装置将所述压缩码流传输给解码器， 包括：
所述视频信息处理装置将用于传输所述压缩码流的接口形式从所述第一 接口形式切换为第二接口形式，并以所述第二接口形式将所述压缩码流传输给 所述解码器， 所述第二接口形式是所述解码器所支持的接口形式。
3、 根据权利要求 2所述的方法， 其特征在于， 所述视频信息处理装置以第 二接口形式将所述压缩码流传输给所述解码器之后， 还包括：
所述视频信息处理装置接收所述解码器以所述第二接口形式传输的第一 通知消息；
所述视频信息处理装置将用于传输所述第一通知消息的接口形式从所述 第二接口形式切换为所述第一接口形式，并以所述第一接口形式将所述第一通 知消息传输给所述播放器； 其中， 所述第一通知消息用于指示解码完毕。
4、 根据权利要求 2或 3所述的方法， 其特征在于， 所述视频信息处理装置 将所述解码器解码出的所述视频帧传输给后处理单元包括：
所述视频信息处理装置接收所述解码器输出的所述视频帧，并接收所述播 放器传输的内存描述信息； 所述视频信息处理装置将所述视频帧和所述内存描述信息传输给所述后 处理单元； 理的视频帧包括：
所述后处理单元对所述视频帧进行后处理并将经过后处理的视频帧存储 到所述内存描述信息指示的内存中，所述经过后处理的视频帧由所述播放器从 所述内存中读取。
5、 根据权利要求 4所述的方法， 其特征在于， 所述视频信息处理装置将所 述视频帧和所述内存描述信息传输给所述后处理单元之后， 还包括：
所述视频信息处理装置接收所述后处理单元传以第三接口形式传输的第 二通知消息， 所述第三接口形式是所述后处理单元所支持的接口形式；
所述视频信息处理装置将用于传输所述第二通知消息的接口形式从所述 第三接口形式切换为所述第一接口形式，并以所述第一接口形式将所述第二通 知消息传输给所述播放器； 其中， 所述第二通知消息用于指示后处理完毕。
6、 根据权利要求 2-5任一项所述的方法， 其特征在于， 所述第一接口形式 为标准解码器接口形式， 所述第二接口形式为私有解码器接口形式。
7、 一种视频解码设备， 其特征在于， 包括： 视频信息处理装置、 解码器 和后处理单元；
所述视频信息处理装置， 用于接收播放器传输的压缩码流，将所述压缩码 流传输给所述解码器，从所述解码器接收所述解码器解码出的视频帧， 并将所 述视频帧传输给所述后处理单元；
所述解码器， 用于对所述压缩码流进行解码， 获得所述视频帧， 并将所述 视频帧提供给所述视频信息处理装置；
所述后处理单元，用于对所述视频信息处理装置传输的所述视频帧进行后 处理并向所述播放器提供经过后处理的视频帧，所述经过后处理的视频帧经过 所述播放器被传输至显示单元以做显示。
8、 根据权利要求 7所述的设备， 其特征在于， 所述视频信息处理装置具体 用于接收所述播放器以第一接口形式传输的所述压缩码流，所述第一接口形式 是所述播放器所支持的接口形式；
所述视频信息处理装置，还用于将用于传输所述压缩码流的接口形式从所 述第一接口形式切换为第二接口形式，所述第二接口形式是所述解码器所支持 的接口形式；
所述视频信息处理装置具体用于以所述第二接口形式将所述压缩码流传 输给所述解码器。
9、 根据权利要求 8所述的设备， 其特征在于，
所述视频信息处理装置 ,还用于在以所述第二接口形式将所述压缩码流传 输给所述解码器之后，接收所述解码器以所述第二接口形式传输的第一通知消 息，将用于传输所述第一通知消息的接口形式从所述第二接口形式切换为所述 第一接口形式， 并以所述第一接口形式将所述第一通知消息传输给所述播放 器； 其中， 所述第一通知消息用于指示解码完毕。
10、 根据权利要求 8或 9所述的设备， 其特征在于，
所述视频信息处理装置，还用于在将所述解码器解码出的视频帧传输给所 述后处理单元之前，接收所述播放器传输的内存描述信息， 并将所述内存描述 信息传输给所述后处理单元； 频帧存储到所述内存描述信息指示的内存中，所述经过后处理的视频帧由所述 播放器从所述内存中读取。
11、 根据权利要求 10所述的设备， 其特征在于，
所述视频信息处理装置，还用于在将所述视频帧和所述内存描述信息传输 给所述后处理单元之后，接收所述后处理单元传以第三接口形式传输的第二通 知消息，将用于传输所述第二通知消息的接口形式从所述第三接口形式切换为 所述第一接口形式，并以所述第一接口形式将所述第二通知消息传输给所述播 放器； 其中， 所述第三接口形式是所述后处理单元所支持的接口形式， 所述第 二通知消息用于指示后处理完毕。
12、 根据权利要求 8-11任一项所述的设备， 其特征在于， 所述第一接口形 式为标准解码器接口形式， 所述第二接口形式为私有解码器接口形式。
PCT/CN2014/076218 2013-11-22 2014-04-25 视频信息处理方法及设备 WO2015074380A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14811750.0A EP2890132A4 (en) 2013-11-22 2014-04-25 METHOD AND DEVICE FOR PROCESSING VIDEO INFORMATION
US14/586,302 US20150147052A1 (en) 2013-11-22 2014-12-30 Video Information Processing Method and Device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310601757.1A CN103686195B (zh) 2013-11-22 2013-11-22 视频信息处理方法及设备
CN201310601757.1 2013-11-22

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/586,302 Continuation US20150147052A1 (en) 2013-11-22 2014-12-30 Video Information Processing Method and Device

Publications (1)

Publication Number Publication Date
WO2015074380A1 true WO2015074380A1 (zh) 2015-05-28

Family

ID=50322278

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/076218 WO2015074380A1 (zh) 2013-11-22 2014-04-25 视频信息处理方法及设备

Country Status (4)

Country Link
US (1) US20150147052A1 (zh)
EP (1) EP2890132A4 (zh)
CN (1) CN103686195B (zh)
WO (1) WO2015074380A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103686195B (zh) * 2013-11-22 2017-04-05 华为技术有限公司 视频信息处理方法及设备
CN104023266A (zh) * 2014-05-27 2014-09-03 烽火通信科技股份有限公司 一种android系统的通信编解码组件的使用方法
US10943123B2 (en) 2017-01-09 2021-03-09 Mutualink, Inc. Display-based video analytics
DE112018002117T5 (de) * 2017-04-21 2020-01-02 Zenimax Media Inc. Systeme und verfahren für verzögerte post-prozesse in der videocodierung
CN110620954B (zh) * 2018-06-20 2021-11-26 阿里巴巴（中国）有限公司 用于硬解的视频处理方法、装置和存储介质
CN113727183B (zh) * 2021-08-30 2023-09-15 北京百度网讯科技有限公司 直播推流方法、装置、设备、存储介质及计算机程序产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101389020A (zh) * 2008-05-06 2009-03-18 李丹 一种扩展流媒体播放设备解码能力的方法
CN102006501A (zh) * 2010-11-11 2011-04-06 中国联合网络通信集团有限公司 流媒体播放控制方法、装置和流媒体播放器
CN103260017A (zh) * 2013-05-30 2013-08-21 华为技术有限公司 视频处理方法、视频处理装置及视频处理系统
CN103686195A (zh) * 2013-11-22 2014-03-26 华为技术有限公司 视频信息处理方法及设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8095680B2 (en) * 2007-12-20 2012-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Real-time network transport protocol interface method and apparatus
US9426439B2 (en) * 2013-03-12 2016-08-23 Intel Corporation Exposing media processing features

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101389020A (zh) * 2008-05-06 2009-03-18 李丹 一种扩展流媒体播放设备解码能力的方法
CN102006501A (zh) * 2010-11-11 2011-04-06 中国联合网络通信集团有限公司 流媒体播放控制方法、装置和流媒体播放器
CN103260017A (zh) * 2013-05-30 2013-08-21 华为技术有限公司 视频处理方法、视频处理装置及视频处理系统
CN103686195A (zh) * 2013-11-22 2014-03-26 华为技术有限公司 视频信息处理方法及设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2890132A4 *

Also Published As

Publication number Publication date
CN103686195A (zh) 2014-03-26
CN103686195B (zh) 2017-04-05
EP2890132A1 (en) 2015-07-01
EP2890132A4 (en) 2015-09-30
US20150147052A1 (en) 2015-05-28

Similar Documents

Publication Publication Date Title
WO2015074380A1 (zh) 视频信息处理方法及设备
TWI342162B (en) Video processing method and computer-readable storage medium therefor
JP6172610B2 (ja) テレビ会議用システム
JP2016173830A (ja) メディア出力の選択的ミラーリング
CN103118299B (zh) Iptv视频通话控制方法及机顶盒
RU2610451C2 (ru) Способ, устройство и система записи видеоконференции
CN102510541A (zh) 多屏互动的音视频内容切换方法及媒体播放器
WO2012174924A1 (zh) 多媒体会议中多画面的子画面的视频源的选择方法及装置
CN106034261B (zh) 一种视联网业务处理方法和装置
CN102883131A (zh) 基于远程呈现系统的信令交互方法及装置
JP2018521550A (ja) ビデオを再生するための方法、クライアント及びコンピュータ記憶媒体
JPWO2014054325A1 (ja) 符号化制御装置および符号化制御方法
JP5428734B2 (ja) ネットワーク機器、情報処理装置、ストリーム切替方法、情報処理方法、プログラムおよびコンテンツ配信システム
CN103685314A (zh) 实现流媒体播放单播和多播无缝切换的方法
CN103957445A (zh) 一种基于应用虚拟化技术的视频重定向系统及方法
CN102520897B (zh) 一种移动终端及其提高屏幕界面绘制速度的方法
KR20130030219A (ko) 비디오 서버 및 비디오 서버의 제어 방법
CN102572547B (zh) 快速接入组播组的同步方法、同步装置和终端
JP5624582B2 (ja) マルチフォーマット映像再生装置とその制御方法
CN110266911B (zh) 一种可实现视频矩阵同步切换的解码方法、设备及可读存储介质
CN110248047B (zh) 一种视频矩阵的同步切换方法及系统
WO2020063087A1 (zh) 一种显示方法和装置
US9912910B2 (en) Media content updating method, apparatus, and system
US20160117796A1 (en) Content Adaptive Decoder Quality Management
CN110266910B (zh) 一种可实现视频矩阵同步切换的编码方法、设备及可读存储介质

Legal Events

Date Code Title Description
REEP Request for entry into the european phase

Ref document number: 2014811750

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014811750

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE