WO2013149522A1 - 帧场信息的编码方法及解码方法、编码器和解码器 - Google Patents
帧场信息的编码方法及解码方法、编码器和解码器 Download PDFInfo
- Publication number
- WO2013149522A1 WO2013149522A1 PCT/CN2013/071826 CN2013071826W WO2013149522A1 WO 2013149522 A1 WO2013149522 A1 WO 2013149522A1 CN 2013071826 W CN2013071826 W CN 2013071826W WO 2013149522 A1 WO2013149522 A1 WO 2013149522A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- field
- image
- information
- frame
- code stream
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/112—Selection of coding mode or of prediction mode according to a given display mode, e.g. for interlaced or progressive display mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
Definitions
- the present invention relates to video compression coding technology, and in particular, to a method and a decoding method for frame field information, an encoder, a decoder, an electronic product, a codec device and a video playback device. Background technique
- NTSC National Television System Committee
- PAL Phase Alternation Line
- the field rate of a television system can be approximated as 50 fields/second. Therefore, it is necessary to "split" the digitized old movie frames and adjust the field rate to suit different broadcast television systems.
- the image frames scanned by the old film are usually directly split into the top field and the bottom field, and the time interval between the adjacent two fields is set to 1/50 second.
- 3:2 field-field conversion techniques are commonly used to convert two movie image frames into 5 fields, thereby enabling digitization of 24 frames per second.
- the film film scan frame sequence is converted to a field sequence of 60 fields/second suitable for playback by the NTSC system. Although some of the fields are played repeatedly, the human eye is not easily noticeable due to the short play time between adjacent fields. 3:2 pull-down is shown in Figure 1.
- the H.264/AVC standard uses the following field information encoding method:
- Frame-based method directly encodes the frame image sequence after film scanning, and adds Supplemental Enhancement Information (SEI) information to each access unit (AU) to indicate field play. the way.
- SEI Supplemental Enhancement Information
- AU access unit
- pic_struct in the SEI information to identify the playback mode of the decoded frame, including: Top-Bottom, Top-Bottom, and Bottom-Top, the top-bottom-top (Repeated), the top field, and the bottom field (Bottom-Top-Bottom (Repeated))
- SEI Supplemental Enhancement Information
- Field-based method Convert the frame image sequence into a field image sequence used by a 50Hz or 60Hz system, directly using the H.264/AVC field mode for encoding ("48Hz (referred to as "split" after the actual field) ⁇ Sample frequency)
- Field code --> 50Hz refers to the actual playback frequency or the target playback frame rate of the code stream
- Field play target image playback mode of the stream
- the repeated field image produced using 3:2 Pull-Down is also encoded.
- the top field and bottom field flags in the field mode are used in the code stream to identify the frame field information of each image.
- the HEVC encoder encodes the input image in a uniform frame mode, ie the frame field information flag is no longer used in the slice layer.
- the flag field_indication_presence_flag is used to encode the Field Indication SEI Message.
- each image needs to encode the field information of the image by using the field identifier SEI information; when the value of the flag is equal to 0, the image may or may not use the field SEI.
- the information encodes the field information of the image.
- Frame-based method The HEVC frame-based method only supports the "24Hz frame coding -> 50Hz field play" application.
- the encoder identifies the time domain play sequence of each field after the current frame is divided into the top field and the bottom field by encoding the top_field_first_flag flag in the SEI information.
- Field-based method Convert the frame image sequence into a field image sequence used by a 50Hz or 60Hz system, and directly encode the image using HEVC.
- the repeated field image generated using 3:2 Pull-Down is also encoded.
- the encoder encodes SEI information for each AU to identify the field information of the image contained in the current AU, and uses the duplicate flag (duplicate_flag) to identify whether the current field image is a repeated image (mainly used for 3:2 Pull). -Down ).
- both field-based methods in H.264/AVC and HEVC require the encoding of repeated fields. Increased coding bit overhead.
- the HEVC CD method does not support the Frame Mode 3:2 Pull-Down application. Even in the "24Hz frame editing -> 50Hz field playback" application, the encoder needs to force the source parameter (sequence_type_flag, prograssive_source_flag) to be set to (0,0), even if the source characteristics are different. (such as progressive scan frame (0,1)). This can create obstacles to applications that require the use of source parameters.
- the frame mode of H.264/AVC requires the encoded pic_struct to be included in the pic-timing (payload-type) SEI information.
- pic_struct In order to use pic_ struct, further coding of the timing information is required, which increases the coding overhead.
- the field identification SEI information in the HEVC CD can identify the field information of the source sequence, the flag does not distinguish between the frame and the field, and the functions of each flag overlap (such as bottom_field_flag and Top — field — first — flag ).
- the encoder is required to ensure that there is no contradiction between different types of flag bits during the encoding of the SEI information for each AU, which increases the number of judgment operations and the number of consistency check operations of the codec. For example, if the current AU contains a top field image, the SEI information needs to set the value of bottom_field_flag to 0, and the value of top_field_first_flag is set to 1. Although ambiguity can be avoided, in this common application scenario, the same information is repeatedly encoded, wasting coded bits.
- Embodiments of the present invention provide a method and a decoding method for encoding field field information, an encoder, a decoder, an electronic product, a codec device, and a video playing device, to solve the existing encoding of a repeated field, and increase coding bit overhead.
- An embodiment of the present invention provides a method for encoding frame field information, where the method includes:
- the encoder receives the video image to be encoded and the auxiliary information
- the encoder encodes the video image, encodes the field identification information used by the video image according to the code stream organization method of the field identification information, and outputs the code stream including the field identification information.
- the encoder encodes the video image into a repeat play mode using the field identification information for the video image that needs to be played repeatedly.
- the video image to be encoded includes a frame image and a field image; and/or, the field mark
- the information is contained in a Supplemental Enhancement Information (SEI) unit or in a Video Usability Information (VUI) unit, or as a new unit of information.
- SEI Supplemental Enhancement Information
- VUI Video Usability Information
- the auxiliary information includes ordering information of the video image, frame image and field image attribute information of the video image, top field or bottom field attribute information of the field image, and the top field or bottom field Repeat one or more of the field identifiers.
- the auxiliary information further includes playing information of the video image; and the playing information includes one or more of a playing mode, a playing sequence, and a playing field rate of the video image.
- the field identification information includes: a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating the repeated field information, a field indicating a playback mode of the frame image, and indicating that the frame image is split.
- the repeated field information includes a default set repeating field play position; or, The field of the top field or bottom field attribute of the field image, the identification field of the repeated field, the field indicating the repeated field information, the field indicating the position of the repeated field playing, the field indicating the playing mode of the frame image, the splitting of the frame image into the top field, and The field of the play order after the bottom field, the field indicating whether the top or bottom field of the frame image split will be played repeatedly, the field of each play sequence, whether the top field or the bottom field of the frame image is split will be The field that is played repeatedly and the field in which the top or bottom field of the frame image is split will be played repeatedly.
- the encoder encodes the field identification information used by the video image according to the code stream organization method of the field identification information and the auxiliary information, and outputs the code stream including the field identification information, including: The encoder sets a value of each field in the field identification information according to the auxiliary information;
- the encoder uses the field identification information to encode it into a repeat play mode, including: for a field image that needs to be repeatedly played, the encoder will use the field identification information
- the value of the repeated field identification field in the setting is set to a first predetermined value, and the value of the field representing the repeated field information is set to a second predetermined value; or, for a field image that needs to be repeatedly played, the encoder will The value of the repeated field identification field in the field identification information is set to the first predetermined value, the value of the field indicating the repeated field information is set to the second predetermined value, and the field indicating the repeated field playing position is set to Set value.
- the first predetermined value is "0", and the second predetermined value is " ⁇ .
- the embodiment of the present invention further provides a method for decoding frame field information, the method comprising: the decoder parsing the read code stream including the field identification information according to a code stream organization method of the field identification information; The device sends the parsing result to the controller, so that the controller controls the playing of the video image according to the parsing result.
- the video image comprises a frame image and a field image; and/or the field identification information is included in a supplemental enhancement information (SEI) unit or a video availability information (VUI) unit, or in a new information In the unit.
- SEI supplemental enhancement information
- VUI video availability information
- the field identification information includes: a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating the repeated field information, a field indicating a playback mode of the frame image, and indicating that the frame image is split.
- the repeated field information includes a default set repeating field play position; or, The field of the top field or bottom field attribute of the field image, the identification field of the repeated field, the field indicating the repeated field information, the field indicating the position of the repeated field playing, the field indicating the playing mode of the frame image, the splitting of the frame image into the top field, and The field of the play order after the bottom field, the field indicating whether the top or bottom field of the frame image split will be played repeatedly, the field of each play sequence, whether the top field or the bottom field of the frame image is split will be The field that is played repeatedly and the field in which the top or bottom field of the frame image is split will be played repeatedly.
- the decoder parses the read code stream including the field identification information according to the code stream organization method of the field identification information, and the method includes: the decoder parses the code stream according to the code stream organization method of the field identification information. The value of each field in the field identification information.
- the decoder sends a parsing result to the controller, so that the controller controls the playing of the video image according to the parsing result
- the method includes: the decoder corresponding to each field in the parsed field identifier information
- the value of the control parameter is sent to the controller, so that the controller determines the image play sequence and the repeat play mode indicated by the control parameter according to the value of the control parameter, and controls according to the image play sequence and the repeat play mode. Play video images.
- An embodiment of the present invention further provides an encoder, where the encoder includes:
- a receiving module configured to: receive a video image to be encoded and auxiliary information
- An encoding module configured to: encode the video image, according to a code stream of the field identification information
- the organization method and the auxiliary information encode the field identification information used by the video image and output a code stream including the field identification information, wherein the field identification information is used for the video image that needs to be repeatedly played It is encoded as a repeat play mode.
- the video image to be encoded includes a frame image and a field image; and/or the field identification information is included in a supplemental enhancement information (SEI) unit or a video usability information (VUI) unit, or as a New information unit.
- SEI supplemental enhancement information
- VUI video usability information
- the auxiliary information includes ordering information of the video image, frame image and field image attribute information of the video image, top field or bottom field attribute information of the field image, and the top field or bottom field Repeat one or more of the field identifiers.
- the auxiliary information further includes playing information of the video image; and the playing information includes one or more of a playing mode, a playing sequence, and a playing field rate of the video image.
- the field identification information includes: a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating the repeated field information, a field indicating a playback mode of the frame image, and indicating that the frame image is split.
- the repeated field information includes a default set repeating field play position; or, The field of the top field or bottom field attribute of the field image, the identification field of the repeated field, the field indicating the repeated field information, the field indicating the position of the repeated field playing, the field indicating the playing mode of the frame image, the splitting of the frame image into the top field, and The field of the play order after the bottom field, the field indicating whether the top or bottom field of the frame image split will be played repeatedly, the field of each play sequence, whether the top field or the bottom field of the frame image is split will be The field that is played repeatedly and the field in which the top or bottom field of the frame image is split will be played repeatedly.
- the coding module is configured to: set a value of each field in the field identification information according to the auxiliary information; where, for a field image that needs to be repeatedly played, repeat fields in the field identification information Setting a value of the identification field to a first predetermined value, setting a value of the field indicating the repeated field information to a second predetermined value; or, the encoder setting a value of the repeated field identification field in the field identification information For the first predetermined value, the value of the field representing the repeated field information is set to the second predetermined value, and the field indicating the repeated field play position is set to the set value.
- the first predetermined value is “0"
- the second predetermined value is “ ⁇ .
- the embodiment of the invention further provides a decoder, the decoder comprising:
- the parsing module is configured to: parse the read code stream containing the field identification information according to the code stream organization method of the field identification information; and send, by the sending module, the parsing result to the controller, so that the controller is configured according to the The parsing result controls the playback of the video image.
- the video image comprises a frame image and a field image; and/or the field identification information is included in a supplemental enhancement information (SEI) unit or a video availability information (VUI) unit, or in a new information In the unit.
- SEI supplemental enhancement information
- VUI video availability information
- the field identification information includes: a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating the repeated field information, a field indicating a playback mode of the frame image, and indicating that the frame image is split.
- the repeated field information includes a default set repeating field play position; or, The field of the top field or bottom field attribute of the field image, the identification field of the repeated field, the field indicating the repeated field information, the field indicating the position of the repeated field playing, the field indicating the playing mode of the frame image, the splitting of the frame image into the top field, and The field of the play order after the bottom field, the field indicating whether the top or bottom field of the frame image split will be played repeatedly, the field of each play sequence, whether the top field or the bottom field of the frame image is split will be The field that is played repeatedly and the field in which the top or bottom field of the frame image is split will be played repeatedly.
- the parsing module is configured to parse a value of each field in the field identification information according to a code stream organization method of the field identification information.
- the sending module is configured to: send, to the controller, a value of a control parameter corresponding to each field parsed by the parsing module.
- An embodiment of the present invention provides an electronic product including the above decoder, the electronic product further including a controller, where the controller is configured to: receive an analysis result sent by the decoder, and control a video image according to the analysis result. Play.
- the controller is configured to: receive a value of a control parameter sent by the decoder, determine an image playing sequence and a repeat play mode indicated by the control parameter according to a value of the control parameter, and according to the The image playback order and the repeat play mode control the playback of the video image.
- the embodiment of the invention further provides a codec device, comprising the above encoder and the above decoder.
- the embodiment of the invention further provides a video playing device, including the above electronic product and the above-mentioned editing Code.
- An embodiment of the present invention further provides a method for identifying frame field information in a code stream, the method comprising: dividing identification information related to different frame field playing applications into different types of information by using indication information that identifies the entire coding sequence feature. And wherein the entire coding sequence is characterized by an image type in the sequence, the image type includes a field image and a frame image; and the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- the set of information identifies information needed for a conversion operation of a decoded image of a code stream having the entire encoded sequence feature.
- the converting operation converts the decoded image into an image for playback.
- the information group identifies information that is available for the conversion operation to directly use the decoded frame image as the output image after the conversion operation; or, the information group identifies that the conversion operation is completed directly Decoding the decoded field image as information of the output image after the converting operation; or, the information group identifies that the frame image that can be decoded by the conversion operation is split into two field images, and the two are a field image as information of an output image after the converting operation; or, the information group identifies that the frame image that can be decoded by the conversion operation is split into three field images, and the three field images are used as Information of the output image after the conversion operation.
- the information group identifies information that is available for the conversion operation to merge the two field images into one frame image and uses the frame image as the output image after the conversion operation.
- the information group identifies location information of the field image used by the conversion operation in accordance with a field image playback order relative to the currently processed image.
- the information group identifies information that is available for the conversion operation to complete the operation of the field image in the field image playback order when inserted into the specified position.
- the set of information is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit, or in a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the identification of the entire coding sequence feature and/or the source acquisition method is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit in which the information group is located, or in a new information element in.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the source acquiring method comprises: a progressive scanning method and/or an interlaced scanning method.
- the type of information of one type selected and only selected is included in the encoded sequence code stream.
- the embodiment of the present invention further provides a code stream that carries frame field information, including: in the code stream, the indication information that identifies the entire code sequence feature is used to divide the identification information related to different frame field play applications into different types of information groups.
- the entire coding sequence is characterized by an image type in the sequence, and the image type includes a field image and a frame image; and the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- said set of information includes information usable for a conversion operation of a decoded image of a code stream having said entire encoded sequence feature.
- the converting operation converts the decoded image into an image for playback.
- the information group includes information required for the conversion operation to directly complete the decoded frame image as an output image after the conversion operation; or, the information group includes the conversion operation Completing the information required to directly use the decoded field image as the output image after the conversion operation; or, the information group includes a frame image that can be decoded by the conversion operation to split the decoded frame image into two field images, and Using the two field images as information required for the output image after the conversion operation; or, the information group includes a frame image that can be decoded by the conversion operation to split the decoded frame image into three field images, and These three field images serve as information required for the output image after the conversion operation.
- the information set includes information necessary for the conversion operation to complete combining the two field images into one frame image and using the frame image as the output image after the conversion operation.
- the information group includes position information of the field image used by the conversion operation in accordance with the field image playing order with respect to the currently processed image.
- the information set contains information that is available for the conversion operation to complete the operation of the field image in the field image playback order when inserted into the designated position.
- the information set is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit, or in a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the Supplemental Enhancement Information (SEI) unit, or the Video Availability Information (VUI) unit, or a new information element including the information set further includes an identifier of the entire coding sequence feature and/or the source acquisition method. information.
- the source acquiring method comprises: a progressive scanning method and/or an interlaced scanning method.
- a progressive scanning method and/or an interlaced scanning method.
- only one of the selected types of information groups is included in a coded sequence code stream.
- An embodiment of the present invention further provides a method for using a code field carrying a code stream, the method comprising: obtaining, from a parameter set of the code stream, indication information that identifies a feature of the entire coding sequence; and obtaining a different identifier according to the indication information.
- the frame field plays an information group applying the relevant identification information; according to the information group, obtaining a conversion operation method and image playback control information for converting the decoded image into an image for playing, and performing a corresponding conversion operation; wherein, the whole
- the coding sequence feature is an image type in the sequence, and the image type includes a field image and a frame image; the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- the decoded frame image is directly used as the playback image according to the conversion operation method and the image playback control information; or, according to the conversion operation method and the image playback control information, the decoded field image is directly used as the playback image; or Decomposing the decoded frame image into two field images according to the conversion operation method and the image playback control information, and using the two field images as images sequentially played; or, according to the conversion operation method and image
- the control information is played, the decoded frame image is split into three field images, and the three field images are taken as images that are sequentially played.
- the two field images are combined into one frame image, and this frame image is used as a playback image.
- position information of the field image according to the field image playing order relative to the current processed image is obtained; according to the position information, two field images are obtained, and two fields are obtained.
- the images are combined into one frame image and this frame image is used as a playback image.
- the field image is inserted into the designated position in the field image playback order, and the field image is played as the insertion position.
- Image the field image is inserted into the designated position in the field image playback order, and the field image is played as the insertion position.
- the information of the information group is obtained in a Supplemental Enhancement Information (SEI) unit, or a Video Usability Information (VUI) unit, or a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Usability Information
- An embodiment of the present invention further provides an apparatus for using a code stream carrying a frame field information
- the apparatus includes: a first processing unit, configured to: obtain, from a parameter set of the code stream, indication information that identifies a feature of the entire coding sequence;
- the second processing unit is configured to: obtain, according to the indication information, a group of information that identifies the identifier information of the different frame playing application;
- the third processing unit is configured to: convert, according to the information group, the decoded image to be used for playing The image conversion operation method and the image playback control information, and perform a corresponding conversion operation; wherein, the entire coding sequence feature is an image type in the sequence, the image type includes a field image and a frame image; and the indication information is located in the parameter concentrated.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- the third processing unit is configured to: directly use the decoded frame image as a playback image according to the conversion operation method and the image playback control information; or, according to the conversion operation method and the image playback control information, directly Decoding the field image as a playback image; or, according to the conversion operation method and the image playback control information, splitting the decoded frame image into two field images, and using the two field images as images sequentially played; or And decoding the decoded frame image into three field images according to the conversion operation method and the image playback control information, and using the three field images as images sequentially played.
- the third processing unit is configured to: combine the two field images into one frame image according to the conversion operation method and the image playback control information, and use the frame image as a playback image.
- the third processing unit is configured to: obtain, according to the conversion operation method and the image playing control information, location information of the field image according to a field image playing order relative to the current processed image; according to the location information, obtain Two field images, which combine two field images into one frame image and use this frame image as a playback image.
- the third processing unit is configured to: insert the field image into the designated position according to the field image playing order according to the conversion operation method and the image playing control information, and use the field image as the insertion position Play the image.
- the second processing unit is configured to: obtain information of the information group in a supplemental enhancement information (SEI) unit, or a video availability information (VUI) unit, or a spear-new information unit.
- SEI Supplemental Enhancement Information
- VUI video availability information
- An embodiment of the present invention further provides an apparatus, including an electronic product, wherein the electronic product uses a method for identifying frame field information in the code stream.
- Another embodiment of the present invention provides an apparatus, including an electronic product, the electronic product generating the code stream.
- An embodiment of the present invention further provides an apparatus, including an electronic product, wherein the electronic product uses the above method for using a frame field message, a packet, and a code stream.
- Another embodiment of the present invention provides an apparatus, including an electronic product, wherein the electronic product uses the above device.
- Figure 1 is a schematic diagram of a 3:2 Pull-Down
- FIG. 2 is a flowchart of a process for analyzing a field identifier SEI information by a decoder according to an embodiment of the present invention
- FIG. 3 is a flowchart of a process of using a terminal controller for identifying SEI information according to an embodiment of the present invention
- FIG. 5 is a 50 Hz field mode playing device for supporting encoding and decoding methods of "24 Hz frame encoding --> 50 Hz field playing" using one field identification SEI information according to an embodiment of the present invention.
- 6 is an application example of a coding and decoding method for supporting "24 Hz frame coding --> 60 Hz field play" in a 60 Hz field mode playing device by using one field identification SEI information in the embodiment of the present invention
- FIG. 7 is an application example of an encoding and decoding method for supporting a "48 Hz field code -> 50 Hz field play" in a 50 Hz field mode playing device using an identification SEI information in an embodiment of the present invention
- FIG. 8 is an application example of a coding and decoding method for supporting a "60 Hz field coding->60 Hz field play" in a 60 Hz field mode playing device using an identification SEI information in an embodiment of the present invention
- 9 is an application example of a coding and decoding method for supporting "48 Hz field coding--> 60 Hz field play" in a 60 Hz field mode playing device by using one field identification SEI information according to an embodiment of the present invention
- 10 is an application example of a coding and decoding method for supporting "24 Hz frame coding -> 50 Hz field play" in a 25 Hz frame mode playing device by using one field identification SEI information according to an embodiment of the present invention
- 11 is an application example of a coding and decoding method for supporting a "24 Hz frame coding -> 60 Hz field play" in a 25 Hz frame mode playing device using an identification SEI information in an embodiment of the present invention
- FIG. 13 is an application example of a coding and decoding method for supporting a "60 Hz field coding->60 Hz field play" in a 25 Hz frame mode playing device using an identification SEI information in an embodiment of the present invention
- FIG. 15 is a flowchart of a process for analyzing a field identifier SEI information by a decoder according to Embodiment 2 of the present invention
- FIG. 16 is a flowchart of a process of using a terminal controller for identifying SEI information according to an embodiment of the present invention
- FIG. FIG. 18 is a flowchart of processing an encoder that encodes SEI information in two fields
- FIG. 18 is a device for encoding and decoding a "24 Hz frame encoding--> 50 Hz field playback" in a 50 Hz field mode using the two-field identification SEI information of the embodiment of the present invention.
- FIG. 19 is a diagram showing an application example of encoding and decoding methods of "24Hz frame coding --> 60Hz field play" on a 60 Hz field mode playing device using the two-field identification SEI information of the embodiment of the present invention
- 20 is an application example of a coding and decoding method for supporting "48 Hz field coding --> 50 Hz field play" in a 50 Hz field mode playing device by using the two-field identification SEI information of the embodiment of the present invention
- 21 is an application example of a coding and decoding method for supporting a 60 Hz field mode playing device using the two-field identification SEI information of the embodiment of the present invention to support "60 Hz field coding -> 60 Hz field play";
- 22 is an application example of a coding and decoding method for supporting a "48 Hz field code -> 60 Hz field play" in a 60 Hz field mode playing device using the second field identification SEI information of the embodiment of the present invention
- FIG. 23 is a diagram showing an application example of encoding and decoding methods for "24 Hz frame coding --> 50 Hz field play" in a 25 Hz frame mode playing device using the two-field identification SEI information of the embodiment of the present invention
- FIG. 24 is a diagram showing an application example of encoding and decoding a "24 Hz frame coding--> 60 Hz field play" in a 25 Hz frame mode playback device using the two-field identification SEI information of the embodiment of the present invention
- 25 is an application example of a coding and decoding method for supporting "48 Hz field coding--> 50 Hz field play" in a 25 Hz frame mode playing device by using the two-field identification SEI information of the embodiment of the present invention
- 26 is an application example of an encoding and decoding method for supporting a "60 Hz field coding->60 Hz field play" in a 25 Hz frame mode playing device using the two-field identification SEI information of the embodiment of the present invention
- FIG. 27 is a diagram showing an application example of encoding and decoding methods for "48 Hz field coding -> 60 Hz field play" in a 25 Hz frame mode playback device using the two-field identification SEI information of the embodiment of the present invention.
- Preferred embodiment of the invention
- the encoder implementation method in the following embodiments is only one of the possible implementation methods of the encoder in this embodiment, and any encoder capable of generating a code stream that meets the requirements of the decoder stream resolution process of the embodiment is It belongs to the protection category of the encoder of this embodiment.
- An embodiment of the present invention provides a method for encoding frame field information, which is described from the perspective of an encoder, and the method includes:
- Step 11 The encoder receives the video image to be encoded and the auxiliary information.
- the video image to be encoded may include a frame image and a field image; the auxiliary information may include ranking information of the video image, frame image and field image attribute information of the video image, and top of the field image. One or more of the field or bottom field attribute information and the repeated field identifier of the top field or the bottom field; and may further include playing information of the video image; the playing information includes a playing manner of the video image, One or several of the playback order and the playback field rate.
- Step 12 The encoder encodes the video image, encodes the field identification information used by the video image according to the code stream organization method of the field identification information, and outputs the code including the field identification information. a stream, wherein, for the video image that needs to be played repeatedly, the encoder encodes the video image into a repeat play mode using the field identification information.
- the field identification information includes: a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating the repeated field information, a field indicating a frame image playing manner, and a table. a field in which the frame image is split into a play field of each field after the top field and the bottom field, and a field indicating that the top field or the bottom field of the frame image split is to be repeatedly played, and the repeated field information includes a repeated field set by default.
- a playback position or a field indicating a top field or a bottom field attribute of the field image, an identification field of the repeated field, a field indicating repeated field information, a field indicating a repeating field playback position, a field indicating a frame image playing mode, and a frame image
- the field in which the field or bottom field will be played repeatedly and the field in which the top or bottom field from which the frame image is split will be played repeatedly.
- the encoder sets a value of each field in the field identification information according to the auxiliary information; for a field image that needs to be repeatedly played, the encoder uses a repeated field identification field in the field identification information. Setting a value to a first predetermined value, setting a value of the field representing the repeated field information to a second predetermined value; or, the encoder setting a value of the repeated field identification field in the field identification information to the The first predetermined value sets the value of the field indicating the repeated field information to the second predetermined value, and sets a field indicating the repeated field play position to the set value.
- the embodiment of the present invention further provides a method for decoding frame field information, which is described from the perspective of a decoder, and the method includes:
- Step 21 The decoder parses the read code stream containing the field identification information according to a code stream organization method of the field identification information.
- the step may include: the decoder parsing values of the fields in the field identification information according to a code stream organization method of the field identification information.
- Step 22 The decoder will send an analysis result to the controller, so that the controller controls the playing of the video image according to the parsing result.
- the step may include: the decoder sending, to the controller, the value of the control parameter corresponding to each field in the parsed field identification information, so that the controller determines, according to the value of the control parameter, the control parameter
- the image playback sequence and the repeat play mode, and the playback of the video image are controlled in accordance with the image playback order and the repeat play mode.
- an embodiment of the present invention further provides an encoder.
- a decoder wherein: the encoder comprises: a receiving module, configured to receive a video image to be encoded and auxiliary information;
- An encoding module configured to encode the video image, encode a field identification information used by the video image according to a code stream organization method of the field identification information, and output the code including the field identification information a stream, wherein, for the video image that needs to be played repeatedly, the field identification information is used to encode it into a repeat play mode.
- the above decoder includes:
- a parsing module configured to parse the read code stream containing the field identification information according to a code stream organization method of the field identification information
- a sending module configured to send a parsing result to the controller, so that the controller controls playing of the video image according to the parsing result.
- the field identification information is included in a Supplemental Enhancement Information (SEI) unit or a Video Usability Information (VUI) unit, or may exist as a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Usability Information
- the field identification information is included in the SEI unit (i.e., the field identification SEI information) as an example.
- the frame field information encoding and decoding method and apparatus can support multiple field play modes, including: "24Hz frame coding--> 50Hz field play”, “24Hz frame coding--> 60Hz field play”, “ 48Hz field coding --> 50Hz field play”, “60Hz field coding --> 60Hz field play” and "48Hz field code -> 60Hz field play”.
- the meaning of the tagging method used here is as follows:
- the previous frequency value refers to the actual sample rate of the original source of the input encoder or the source of the frame/field converted source (ie, the number of images per second). This value can be different from the encoding frame rate/field rate set when the encoder is operating. For example, for "48Hz field code -> 50Hz field play", the coded field rate can be 50Hz instead of the field rate of 48Hz after conversion.
- the latter frequency value refers to the terminal playback device using the target image playback mode supporting the code stream.
- the target playback frame rate of the stream is the number of images played by the device per second when playing. This value may be different from the actual sample rate of the original source or the frame/field converted source, or may be different from the encoding frame rate/field rate set by the encoder.
- Fre coding or “field coding” refers to whether the image contained in the AU is a frame or a field.
- “Frame Play” or “Field Play” refers to whether the image played by the terminal playback device supporting the target image playback mode of the stream is a frame or a field.
- the VUI code stream organization method used in this embodiment is the same as the HEVC CD method.
- the field identification SEI information code stream organization method used in this embodiment is as shown in Table 1:
- sequence-type-flag sequence-type-flag
- progressive-source-flag are exactly the same as the HEVC CD method.
- the bottom_field_flag is used to identify the top/bottom field properties of the field contained in the current AU.
- the bottom_field_flag is equal to 1, it means that the field image contained in the current AU is the bottom field; otherwise, when the bottom_field_flag is equal to 0, it means that the field image contained in the current AU is the top field.
- duplicate-flag When duplicate-flag is equal to 1, it means that the field contained in the current AU is the weight of the previous play field. On the other hand, when duplicate-flag is equal to 0, it means that the field contained in the current AU is not the repeated field of the previous play field.
- the field is the same.
- Field— output—flag is used to identify the playback mode of the frame contained in the current AU.
- field_output_flag is equal to 1, it means that the frame contained in the current AU will be split into the top field and the bottom field (using the method given in the HEVC CD) for playback; otherwise, when field_output_flag is equal to 0, Indicates that the frames contained in the current AU will be played back in progressive mode.
- Top_field—first—flag is used to identify the playback order of the frames included in the current AU split into the top field and the bottom field.
- field_output_flag is equal to 1
- top_field_output_flag is equal to 1 to play the top field first, then play the bottom field
- top_field_first_flag 0 means to play the bottom field first, then play the top field .
- field_output_flag is equal to 0
- top_field_first_flag has no practical meaning and its value is set to 0.
- the frame-used-for-pull-down-flag is used to identify that the top or bottom field of the frame split contained in the current AU will be played repeatedly.
- field_output_flag is equal to 1
- top_field_output_flag is equal to 1
- frame_used_for_pull-down_flag is equal to 1
- the field uses the "top field - bottom field - repeat top field” play order; top - field_output_flag is equal to 0 and frame_used_for_pull-down_flag is equal to 1, the frame split included in the current AU
- the top field and the bottom field use the "bottom field - top field - repeat bottom field” play order; when frame_used_for-pull-down_flag is equal to 0, the frame contained in the current AU is split.
- the top and bottom fields that are separated are not played repeatedly.
- field_output_flag is equal to 0, frame-used-for-pull-do wn-flag has no practical meaning and its value is set to zero.
- FIG. 2 a flowchart of processing a field identifier SEI information by a decoder according to an embodiment of the present invention, where the terminal uses a field mode for image playback, and an image playback frame rate and a target stream of a code stream The playback rate is the same.
- the process includes:
- Step 201 The receiving end reads the SEI information code stream; the decoder reads the first bit, and parses the value of the sequence_type_flag by using the decoding method of u(l);
- Step 202 The decoder reads the second bit, and parses the value of the progressive_source_flag by using a method corresponding to u(l);
- Step 204 the decoder reads the third bit, and uses the method corresponding to u(l) to parse the value of the bottom_field_flag;
- Step 205 The decoder reads the fourth bit, and parses the value of the duplicate_flag by using a method corresponding to u(l);
- Step 207 the decoder reads the fifth bit, and uses the method corresponding to u(l) to parse the value of the field_used_for_pull_down_flag; and step 214;
- Step 208 the decoder skips the fifth bit, and sets the value of field_used_for_pull_down_flag to 0; step 214;
- Step 209 the decoder reads the third bit, and uses the method corresponding to u(l) to parse the value of the field_ourput_flag;
- Step 211 The decoder reads the fourth bit, and parses the value of the top_field_first_flag by using a method corresponding to u(l);
- Step 212 the decoder reads the fifth bit, and uses the method corresponding to u(l) to parse the value of frame_used_for_pull_down_flag; and step 214;
- Step 213 the decoder skips the fourth bit and the fifth bit; set the value of top_field_first_flag and frame_used_for_pull_down_flag to 0; step 214; Step 214: The decoder skips the sixth, seventh, and eighth three reserved bits; the field identifier SEI information code stream parsing process ends.
- the method includes:
- Step 301 The decoder parses the field identifier SEI information code stream, and transmits the value of the control bit to the playback control unit or the terminal controller of the terminal.
- Step 302 The decoder sends the decoded recovery image to the controller.
- Step 304 The controller sets a top field/bottom field attribute of the currently played image according to the value of the bottom_field_flag;
- Step 307 The controller saves the current field into the play buffer, and sets its attribute to: play the image after the next image is played, and the top field/bottom field attribute of the image does not change; step 315 is performed; step 308, control Put the current field into the play buffer, and add its properties: Immediately play, remove from the buffer after playback; Go to step 315;
- Step 310 The controller sets the play mode: the image is played by using the interlaced field mode; step 311, the controller divides the current frame into two images of the top field and the bottom field;
- the controller splits the current frame into two images, the top field and the bottom field, using the existing methods given in the HEVC CD.
- Step 312 the controller is based on top_field_first_flag and Frame— used— for_pull—down—The value of the flag, controls the order in which the top and bottom fields are placed in the play buffer, and sets the attribute value. Go to step 315.
- the controller controls the top field and the bottom field in the play buffer according to the field playing sequence represented by the combination of the top_field_first_flag and the frame_used_for_pull_down_flag given in the embodiment. Place the order, and set the property values.
- the field playing sequence is as shown in Table 2 below:
- Step 313 the controller sets the play mode: the image is played in the frame mode of the progressive scan; in step 314, the controller puts the current frame into the play buffer, and increases the setting of its attributes: play immediately, play the buffer from the buffer Removed; perform step 315;
- Step 315 The playing unit of the terminal plays according to the attributes of each image in the playing image buffer.
- the process includes:
- Step 401 The encoder reads the current coded image and its auxiliary information.
- the above-mentioned current coded image may be a frame image sequence obtained by progressively scanning the original film, and may be a field image sequence obtained by splitting the frame image by using an interlaced scanning method or a method given in HEVC CD.
- the auxiliary information includes: sorting information of an input image, a frame image of the image, and a field image attribute; If it is a field image, further identify its top field/bottom field attributes and identify whether it is the previous (in play order) repeat field of a field.
- the auxiliary information further includes: playing information of the image.
- This type of information gives the image playback mode (frame mode or field mode), the order in which the images are played (including whether to repeat a field to support the 3:2 Pull-Down function).
- the auxiliary information may be provided to the encoder by a video collection device or a video conversion device.
- Step 402 The encoder sets a value of a sequence_type_flag and a progressive_source_flag according to the source parameter, and writes the code stream to the code stream by using an encoding method corresponding to u(l);
- Sequence—type—flag and progressive—source—flag The method for identifying the source parameters is the same as for the HEVC CD.
- Step 404 The encoder determines a top field/bottom field attribute of the current image according to the auxiliary information, sets a value of the bottom_field_flag, and writes the code stream by using an encoding method corresponding to u(l);
- Step 405 The encoder determines the value of duplicate_flag according to the auxiliary information, and writes the code to the code stream by using an encoding method corresponding to u(l);
- Step 407 The encoder determines the value of the field-used-for-pull-down_flag according to the auxiliary information, and writes the value to the code stream by using the encoding method corresponding to u(l); and executing step 415;
- Step 408 the encoder sets the value of the field_used_for_pull_down_flag to 0, and writes the code stream to the code stream by using the encoding method corresponding to u(l);
- Step 409 The encoder determines, according to the auxiliary information, a play mode of the current frame, sets a value of the field_output_flag, and writes the code stream by using an encoding method corresponding to u(1).
- Step 411 The encoder determines, according to the auxiliary information, a play order in which the current frame is divided into two fields, sets a value of the top_field_first_flag, and writes the code stream by using an encoding method corresponding to u(l); 412.
- the encoder determines, according to the auxiliary information, whether the field to be played first needs to be played repeatedly, sets the value of the frame_for_pull_down_flag, and writes the code to the code stream by using an encoding method corresponding to u(l); ;
- Step 413 The encoder sets the value of the top_field_first_flag to 0, and writes the code stream to the code stream by using an encoding method corresponding to u(l);
- Step 414 the encoder will frame_for_pull_down_flag has a value of 0, and uses u(l) corresponding encoding method to write it into the code stream; step 415;
- Step 415 The encoder continuously writes three 0-value bits in the code stream; the field identifier SEI information encoding process ends.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the first embodiment can support the "24 Hz frame coding -> 50 Hz field play" to play in the 50 Hz field mode.
- the auxiliary information is the same as the auxiliary information in step 401;
- the auxiliary information is specifically: the AU includes a frame image, and each frame is split into a top field and a bottom field before being played, first playing the top field, then playing the bottom field, and playing the field rate. 50Hz.
- Step 502 The encoder according to this embodiment is used to set values of each flag bit in the field identifier SEI information according to the video auxiliary information, and encode the video.
- Step 503 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end controls the playing process of decoding and restoring video by using the controller in this embodiment.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the first embodiment can support the "24 Hz frame coding--> 60 Hz field play" in the 60 Hz field mode. Play the app on your device.
- the application example is shown in FIG. 6.
- the process includes: Step 601: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and provide the necessary auxiliary information for the encoder.
- the auxiliary information is the same as the auxiliary information in step 401.
- the auxiliary information is specifically: the AU includes a frame image, and each frame is split into a top field and a bottom field before being played, and the play rate is achieved by using a 3:2 Pull-Down method. 60Hz requirement.
- the playback order of the original frame every two frames are a group, and the previous playback frame is split into 3 fields by using the 3:2 Pull-Down method, and the latter playback frame is split into the top field and the bottom field, and according to the top
- the field-bottom field has a top field and a bottom field" is played in an alternating sequence, and the playback frame rate is 60 Hz.
- Step 602 The encoder according to this embodiment is used to set values of each flag bit in the field identifier SEI information according to the video auxiliary information, and encode the video.
- Step 603 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end controls the playing process of decoding and restoring video by using the controller in this embodiment.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the first embodiment can support the "48 Hz field coding--> 50 Hz field play" in the 50 Hz field mode. Play the app on your device.
- the application example is shown in FIG. 7.
- the process includes: Step 701: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and provide the necessary auxiliary information for the encoder.
- the auxiliary information is the same as the auxiliary information in step 401.
- the video source collection device can generate a field sequence as shown in FIG. 7 directly during interlaced film image processing.
- the video conversion device may split the frame image obtained by the progressive scan film image output by the video collection device into a top field and a bottom field, and further convert into a top field, a bottom field, and a top field.
- a bottom field ... "Alternate sequence of field images.
- the auxiliary information is specifically: the AU includes a field image, and the sequence The first image in the column is the top field, and the playing field rate is 50 Hz.
- Step 702 The encoder according to the embodiment is used to set values of each flag bit in the field identifier SEI information according to the video auxiliary information, and encode the video.
- Step 703 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end controls the playing process of decoding and restoring video by using the controller in this embodiment.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the first embodiment can support the "60 Hz field coding--> 60 Hz field play" in the 60 Hz field mode.
- the application on the playback device is as shown in FIG. 8.
- the process includes: Step 801: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and is an encoder. Provide necessary auxiliary information;
- the auxiliary information is the same as the auxiliary information in step 401.
- the video source collecting device can directly generate a field sequence as shown in FIG. 8 during interlaced film image processing, and mark the repeated image.
- the video conversion device may convert the 24 Hz frame image sequence obtained by the progressive scan film image output by the video capture device into "top field one" using the 3:2 Pull-Down method shown in FIG.
- the bottom field is a top field and a bottom field... "Alternate field image sequences, and the repeated field images are marked.
- the auxiliary information is specifically: the AU includes a field image, and the first image of the sequence is a top field, and the marked repeated image has a playing field rate of 60 Hz.
- Step 802 using the encoder in this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- Step 803 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end controls the playing process of decoding and restoring video by using the controller in this embodiment.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the first embodiment can support the "48 Hz field coding--> 60 Hz field play" in the 60 Hz field mode. Play the app on your device.
- the application example is shown in Figure 9.
- the process includes: Step 901: Generate a field image sequence of step 801 by using the method in step 801, remove the duplicate image from the generated image sequence, and identify a field that needs to be repeatedly played;
- the auxiliary information is specifically: the AU includes a field image, the top field/bottom field attribute of each field image in the sequence, and the marked field image to be repeatedly played, the playing field rate is 60Hz.
- Step 902 The encoder according to this embodiment is used to set values of each flag bit in the field identifier SEI information according to the video auxiliary information, and encode the video.
- Step 903 The decoder at the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end uses the controller in this embodiment to control the playback process of decoding and restoring the video.
- the above are all application examples of the terminal playing device supporting the target image playing mode and the target playing frame rate of the code stream.
- the terminal playing device is The decoded field image or frame image may be simply and flexibly post-processed with the value of one or some of the syntax elements in the received SEI information unit to match the playback mode and the playback frame rate of the playback device. Match.
- Specific application examples are as follows.
- the player used by the playback device includes a decoder.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "24 Hz" of the application example shown in FIG. Frame Coding --> 50Hz Field Play" Stream.
- the application example is shown in Figure 10. The process includes:
- Step 1001 is exactly the same as step 501.
- Step 1002 is exactly the same as step 502.
- Step 1003 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment. The player judges the value of sequence_type_flag. When the value of the syntax unit is equal to 1, the decoded image is directly played at a frame rate of 25 Hz.
- the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "24 Hz frame encoding --> 60 Hz field playing" code stream of the application example shown in FIG. 6.
- the application example is shown in Figure 11, the process includes:
- Step 1101 is exactly the same as step 601.
- Step 1102 is exactly the same as step 602.
- Step 1103 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment. The player judges the value of sequence_type_flag. When the value of the syntax unit is equal to 1, the decoded image is directly played at a frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "48 Hz" of the application example shown in FIG. Field Code --> 50Hz Field Play" Stream.
- the application example is shown in Figure 12, and the process includes:
- Step 1201 is exactly the same as step 701.
- Step 1202 is exactly the same as step 702.
- Step 1203 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment.
- the player determines the value of the sequence_type_flag.
- the value of the syntax unit is equal to 0
- the field image of the decoded POC value is even and the subsequent decoded field image of the playback sequence is corresponding to the SEI information of the two images.
- the value of bottom_field_flag is combined into a frame image.
- the player uses the field image with the bottom_field_flag value equal to 0 as the top field, and the bottom_field_flag field image with the value equal to 1 as the bottom field.
- the player will play back the frame image obtained at the frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "60 Hz" of the application example shown in FIG. Field Code --> 60Hz Field Play" Stream.
- Figure 13 An application example is shown in Figure 13, which includes:
- Step 1301 is exactly the same as step 801.
- Step 1302 is identical to step 802.
- Step 1303 the player of the 25 Hz frame mode playing device uses the SEI information described in this embodiment.
- the parsing method parses the value of each flag bit.
- the player determines the value of the sequence_type_flag.
- the player searches for a field image corresponding to the duplicate-flag syntax unit in the corresponding SEI information, and the image will not be played.
- the decoder combines the first two fields of the field image of the duplicate-flag syntax unit with a value of 1 into a frame image, and the last two images of the field image of the duplicate-flag syntax unit equal to one in the playback order.
- the field images are combined into one frame image.
- the player uses a field image with a bottom_field_flag equal to 0 as the top field, and a bottom_field_flag value of the field image equal to 1 as the bottom field.
- the player plays the combined frame image at a frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "48 Hz" of the application example shown in FIG. Field Code --> 60Hz Field Play" Stream.
- Figure 14 An example of the application is shown in Figure 14, which includes:
- Step 1401 is exactly the same as step 901.
- Step 1402 is exactly the same as step 902.
- Step 1403 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment.
- the player determines the value of the sequence_type_flag.
- the player searches for a field image corresponding to the field_used_for_pull_down_flag syntax unit corresponding to the SEI information.
- the field image is combined with its next field image in play order into a frame image.
- the player combines the second field image and the third field image after the field image with the value of the field_used_for_pull_down_flag syntax unit corresponding to 1 in the corresponding SEI information into a frame image.
- the player takes the field image with the bottom_field_flag equal to 0 as the top field, and the bottom_field_flag takes the value equal to
- the field image of 1 is used as the bottom field.
- the player will combine the frame images obtained at a frame rate of 25 Hz.
- the VUI code stream organization method used in this embodiment is the same as the HEVC CD method.
- the field identification SEI information code stream organization method used in this embodiment is shown in Table 3:
- sequence-type-flag sequence-type-flag
- progressive-source-flag are exactly the same as the HEVC CD method.
- Bottom— field—flag is used to identify the top/bottom field properties of the field contained in the current AU.
- the bottom_field_flag is equal to 1, it indicates that the field image contained in the current AU is the bottom field; otherwise, when the bottom_field_flag is equal to 0, it indicates that the field image contained in the current AU is the top field.
- duplicate-flag When duplicate-flag is equal to 1, it indicates that the field contained in the current AU is the repeated field of the previous play field; conversely, when duplicate-flag is equal to 0, it indicates that the field contained in the current AU is not the repeated field of the previous play field.
- Order—to — place — duplicate is used to identify the location of the field image contained in the current AU for repeated playback.
- the indicated image is repeatedly played after the order-to-place-duplicate image is played, and the top/bottom field attributes of the repeated image are the same as the indicated image.
- sequence_type_flag is equal to 1
- the indicated image is the field image contained in the current AU
- sequence_type_flag is equal to 0
- the top field in the field image duplicate—top—flag is equal to 1) or the bottom field (when duplicate—top—flag is equal to 0).
- Field— output—flag is used to identify the playback mode of the frame contained in the current AU.
- field_output_flag is equal to 1, it means that the frame contained in the current AU will be split into the top field and the bottom field (using the method given in HEVC CD); otherwise, when field_output_flag is equal to 0, it means the current AU.
- the included frames will be played back in a progressive scan.
- Top_field—first—flag is used to identify the playback order of the frames included in the current AU split into the top field and the bottom field.
- field_output_flag is equal to 1
- top_field_output_flag is equal to 1 to play the top field first, then play the bottom field
- top_field_first_flag 0 means to play the bottom field first, then play the top field .
- field_output_flag is equal to 0
- top_field_first_flag has no practical meaning and its value is set to 0.
- the frame-used-for-pull-down-flag is used to identify that the top or bottom field of the frame split contained in the current AU will be played repeatedly.
- Frame— used— for_pull—down—flag equal to 1 indicates that the top or bottom field of the frame split by the current AU will be played repeatedly;
- frame—used_for_pull—down—flag equal to 0 indicates the frame contained in the current AU The split top and bottom fields will not be played repeatedly.
- top—flag 1 indicates that the top field split from the frame contained in the current AU will be played repeatedly; duplicate—top—flag equal to 0 indicates that the bottom field of the frame split contained in the current AU will be repeated. Play.
- FIG. 15 is a flowchart of processing a field identifier SEI information of a decoder according to Embodiment 2 of the present invention, where the process includes:
- Step 1501 The receiving end reads the SEI information code stream of the admission identifier; the decoder reads the first bit, and parses the value of the sequence_type_flag by using the decoding method of u(l); Step 1502, the decoder reads the second bit, and uses the method corresponding to u(l) to parse the value of the progressive_source_flag;
- Step 1504 the decoder reads the third bit, and uses the method corresponding to u(l) to parse the value of the bottom_field_flag;
- Step 1505 the decoder reads the fourth bit, and uses the method corresponding to u(l) to parse the value of the duplicate_flag;
- Step 1507 the decoder reads the fourth bit, and uses the method corresponding to u(l) to parse the value of the field_used_for_pull_down_flag;
- Step 1509 the decoder uses the method corresponding to u(3) to parse the value of order_to_place_duplicate. Perform step 1517;
- Step 1510 the decoder reads the third bit, and uses the method corresponding to u(l) to parse the value of the field_output_flag;
- Step 1512 the decoder reads the fourth bit, and parses the value of the top_field_first_flag by using a method corresponding to u(l);
- Step 1513 the decoder reads the fifth bit, and uses the method corresponding to u(l) to parse the value of the frame_used_for_pull_down_flag;
- Step 1515 the decoder reads the sixth bit and parses using the method corresponding to u(l).
- Step 1516 the decoder uses the method corresponding to u(3) to parse the value of order_to_place_duplicate; and step 1517;
- step 1517 the decoder skips the byte-alignment( ) bit; the field identification SEI information stream resolution process ends.
- the terminal uses the field mode to perform image playback, and the image playback frame rate is the same as the target playback frame rate of the code stream.
- the process includes:
- Step 1601 the decoder parses the field identifier SEI information code stream, and passes the value of the control bit to the playback control unit or the terminal controller of the terminal;
- Step 1602 the decoder sends the decoded restored image to the controller.
- Step 1604 the controller sets a top field/bottom field attribute of the currently played image according to the value of the bottom_field_flag;
- Step 1607 the controller saves the current field into the play buffer, and sets its attribute to: the first image played by the current access unit, the order-to_place_ duplicate image is played after playing the image, the top of the image
- the field/bottom field property is unchanged; performing step 1615;
- Step 1608 the controller puts the current field into the play buffer, and increases the setting of its attributes: Immediately play, remove from the buffer after playing; Perform step 1615;
- Step 1610 The controller sets a play mode: the image is played in an interlaced field mode;
- Step 1611 The controller divides the current frame into two images of a top field and a bottom field.
- Step 1612 The controller controls the placement order of the top field and the bottom field in the play buffer according to the values of the top_field_first_flag and the frame_used_for_pull_down_flag, and sets the attribute value; 1615;
- top_field_first_flag When top_field_first_flag is equal to 1, the top field image is played first and then the bottom field image is played; when top_field_first_flag is equal to 0, the bottom field image is played first and then the top field image is played.
- Step 1613 the controller sets the play mode: the image is played in the frame mode of the progressive scan; in step 1614, the controller puts the current frame into the play buffer, and increases the setting of its attributes: play immediately, play the buffer from the buffer Removed; perform step 1615;
- Step 1615 The playing unit of the terminal plays according to the attributes of each image in the playing image buffer.
- a process flow diagram of an encoder that uses the second field identification SEI information in the embodiment of the present invention includes:
- Step 1701 the encoder reads in the current encoded image and its auxiliary information
- the encoded image may be a sequence of frame images obtained by progressively scanning the original film, and may be a sequence of field images obtained by splitting from the frame image using an interlaced scanning method or a method given in the HEVC CD.
- the auxiliary information includes: sorting information of the input image, frame image of the image and field image attributes; if it is a field image, further identifying its top field/bottom field attribute, and identifying whether the field of the field is repeated (in order of play) .
- the auxiliary information further includes: playing information of the image. This type of information gives the way the image is played (frame mode or field mode), the order in which the images are played (including whether to repeat a certain field to support
- the auxiliary information may be provided to the encoder by a video collection device or a video conversion device.
- Step 1702 the encoder sets the values of the sequence_type_flag and the progressive_source_flag according to the source parameter, and writes the code stream by using the encoding method corresponding to u(l); sequence_type_flag and progressive-source — flag
- the method for identifying the source parameters is the same as for the HEVC CD.
- Step 1704 the encoder determines the top field/bottom field attribute of the current image according to the auxiliary information, sets the value of the bottom_field_flag, and writes the code stream by using the encoding method corresponding to u(l);
- Step 1705 The encoder determines the value of the duplicate_flag according to the auxiliary information, and writes the code to the code stream by using an encoding method corresponding to u(l);
- Step 1707 The encoder determines the value of the field_used_for_pull_down_flag according to the auxiliary information, and writes the value to the code stream by using an encoding method corresponding to u(l);
- Step 1708 the encoder determines the value of order_to_place_duplicate according to the auxiliary information, and writes the code stream by using the encoding method corresponding to u(3); and executing step 1716;
- Step 1709 the encoder determines, according to the auxiliary information, a play mode of the current frame, sets a value of the field_output_flag, and writes the code stream by using an encoding method corresponding to u(l);
- Step 1711 The encoder determines, according to the auxiliary information, a play order in which the current frame is divided into two fields, sets a value of the top_field_first_flag, and writes the code stream by using an encoding method corresponding to u(l); 1712. The encoder determines, according to the auxiliary information, whether it is necessary to repeatedly play the first played field. Set the value of frame_for_pull_down_flag, and write it to the code stream using the encoding method corresponding to u(l);
- Step 1714 The encoder determines, according to the auxiliary information, whether the field to be repeated is a top field or a bottom field, sets a value of duplicate_top_flag, and writes the code stream by using an encoding method corresponding to u(l);
- Step 1715 the encoder determines the location of the location to be repeated according to the auxiliary information, sets the value of order_to_place_duplicate, and writes the code stream by using the encoding method corresponding to u(3); Step 1716;
- Step ⁇ 1 6 the encoder writes a byte_alignment( ) bit in the code stream; the field identification SEI information encoding process ends.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the second embodiment can support the "24 Hz frame coding--> 50 Hz field play" in the 50 Hz field mode.
- the application on the playback device is as shown in FIG. 18.
- the process includes: Step 1801: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and is an encoder. Provide necessary auxiliary information;
- the auxiliary information is the same as the auxiliary information described in step 1701.
- the auxiliary information is specifically: the AU includes a frame image, and each frame is split into a top field and a bottom field before being played, first playing the top field, then playing the bottom field, and playing the field rate. 50Hz.
- Step 1802 using the encoder according to this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- Step 1803 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end uses the controller of the embodiment to control the playback process of decoding and recovering the video.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method and the coding method given in the second embodiment can support the "24 Hz frame coding--> 60 Hz field play" in the 60 Hz field mode. Play the app on your device.
- the application example is shown in Figure 19.
- the process includes: Step 1901: The video source collecting device and the converting device convert the original video into a video that needs to be sent to the encoder for encoding, and provide the necessary auxiliary information for the encoder.
- the auxiliary information is the same as the auxiliary information described in step 1701.
- the auxiliary information is specifically: the AU includes a frame image, and each frame is split into a top field and a bottom field before being played, and the play rate is achieved by using a 3:2 Pull-Down method. 60Hz requirement.
- the playback order of the original frame every two frames are a group, and the previous playback frame is split into 3 fields by using the 3:2 Pull-Down method, and the latter playback frame is split into the top field and the bottom field, and according to the top
- the field-bottom field has a top field and a bottom field" is played in an alternating sequence, and the playback frame rate is 60 Hz.
- Step 1902 using the encoder according to this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- Step 1903 The decoder at the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end uses the controller in this embodiment to control the playback process of decoding and restoring the video.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the second embodiment can support the "48 Hz field coding -> 50 Hz field play" to play in the 50 Hz field mode.
- the application example is shown in FIG. 20, the process includes: Step 2001: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and provide necessary auxiliary information for the encoder;
- the auxiliary information is the same as the auxiliary information described in step 1701.
- the video source collection device can generate a field sequence as shown in FIG. 20 directly during interlaced film image processing.
- the video conversion device may split the frame image obtained by the progressive scan film image output by the video collection device into a top field and a bottom field, and further convert into a top field, a bottom field, and a top field.
- a bottom field ... "Alternate sequence of field images.
- the auxiliary information is specifically: the AU includes a field image, and the first image of the sequence is a top field, and the playing field rate is 50 Hz.
- Step 2002 Using the encoder according to this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- the receiving end controls the playback process of decoding and restoring video by using the controller in this embodiment.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the second embodiment can support the "60Hz field coding->60Hz field play" to play in the 60 Hz field mode.
- the application on the device. The application example is shown in FIG. 21.
- the process includes: Step 2101: The video source collection device and the conversion device convert the original video into a video that needs to be sent to the encoder for encoding, and provide necessary auxiliary information for the encoder;
- the auxiliary information is the same as the auxiliary information described in step 1701.
- the video source collection device can generate a field sequence as shown in FIG. 21 directly during interlaced film image processing, and mark the repeated image.
- the video conversion device may convert the 24 Hz frame image sequence obtained by the progressive scan film image output by the video capture device into "top field one" using the 3:2 Pull-Down method shown in FIG.
- the bottom field is a top field and a bottom field... "Alternate field image sequences, and the repeated field images are marked.
- the auxiliary information is specifically: the AU includes a field image, and the first image of the sequence is a top field, and the marked repeated image has a playing field rate of 60 Hz.
- Step 2102 using the encoder according to this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- Step 2103 The decoder of the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end uses the controller in this embodiment to control the playback process of decoding and recovering the video.
- the field identification SEI information code stream organization method, the code stream analysis method, the terminal control method, and the coding method provided in the second embodiment can support the "48 Hz field coding--> 60 Hz field play" in the 60 Hz field mode. Play the app on your device.
- the application example is shown in FIG. 22.
- the process includes: Step 2201: Generate a sequence of the field image of step 2201 by using the method in step 2101; remove the duplicate image from the generated image sequence, and identify the field that needs to be played repeatedly;
- the auxiliary information is specifically: the AU includes a field image, and the sequence The top/bottom field attribute of each field image in the column, the field image to be played repeatedly, and the playing field rate
- Step 2202 using the encoder according to this embodiment, setting the value of each flag bit in the field identifier SEI information according to the video auxiliary information, and encoding the video;
- Step 2203 The decoder at the receiving end parses the value of each flag bit by using the field identifier SEI information parsing method in this embodiment.
- the receiving end uses the controller of the embodiment to control the playback process of decoding and recovering the video.
- the terminal playing device supporting the target image playing mode and the target playing frame rate of the code stream.
- the terminal playing device is The decoded field image or frame image may be simply and flexibly post-processed with the value of one or some of the syntax elements in the received SEI information unit to match the playback mode and the playback frame rate of the playback device. Match. Specific application examples are as follows.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "24 Hz" of the application example shown in FIG. Frame Coding --> 50Hz Field Play" Stream.
- the application example is shown in Figure 23, and the process includes:
- Step 2301 is exactly the same as step 1801.
- Step 2302 is exactly the same as step 1802.
- Step 2303 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment. The player judges the value of sequence_type_flag. When the value of the syntax unit is equal to 1, the decoded image is directly played at a frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "24 Hz" application example shown in FIG. Frame Coding --> 60Hz Field Play" Stream.
- the application example is shown in Figure 24, and the process includes:
- Step 2401 is exactly the same as step 1901.
- Step 2402 is exactly the same as step 1902.
- Step 2403 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment. The player judges the value of sequence_type_flag. When the value of the syntax unit is equal to 1, the decoded image is directly played at a frame rate of 25 Hz.
- the 25 Hz frame mode playing device can also decode and play the "48 Hz" of the application example shown in FIG. Field Code --> 50Hz Field Play" Stream.
- the application example is shown in Figure 25.
- the process includes:
- Step 2501 is exactly the same as step 2001.
- Step 2502 is exactly the same as step 2002.
- Step 2503 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment.
- the player determines the value of the sequence_type_flag.
- the value of the syntax unit is equal to 0
- the field image of the decoded POC value is even and the subsequent decoded field image of the playback sequence is corresponding to the SEI information of the two images.
- the value of bottom_field_flag is combined into a frame image.
- the player uses the field image with the bottom_field_flag value equal to 0 as the top field, and the bottom_field_flag field image with the value equal to 1 as the bottom field.
- the player will play back the frame image obtained at the frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "60 Hz" of the application example shown in FIG. Field Code --> 60Hz Field Play" Stream.
- the application example is shown in Figure 26, and the process includes:
- Step 2601 is exactly the same as step 2101.
- Step 2602 is exactly the same as step 2102.
- Step 2603 the player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment.
- the player determines the value of the sequence_type_flag.
- the player searches for a field image corresponding to the duplicate-flag syntax unit in the corresponding SEI information, and the image will not be played.
- the decoder combines the first two field images of the field image with the duplicate-flag syntax unit value equal to 1 into a frame image in the play order,
- the duplicate-flag syntax unit takes a field image equal to 1 and combines the last two field images in the playback order into one frame image.
- the player uses a field image with a bottom_field_flag equal to 0 as the top field, and a bottom_field_flag value of the field image equal to 1 as the bottom field.
- the player plays the combined frame image at a frame rate of 25 Hz.
- the code stream parsing method, the terminal control method and the encoding method, the 25 Hz frame mode playing device can also decode and play the "48 Hz" of the application example shown in FIG. Field Code --> 60Hz Field Play" Stream.
- Figure 27 An example of the application is shown in Figure 27, which includes:
- Step 2701 is exactly the same as step 2201.
- Step 2702 is exactly the same as step 2202.
- Step 2703 The player of the 25 Hz frame mode playing device parses the value of each flag bit by using the SEI information parsing method described in this embodiment.
- the player determines the value of the sequence_type_flag.
- the player searches for a field image corresponding to the field_used_for_pull_down_flag syntax unit corresponding to the SEI information.
- the field image is combined with its next field image in play order into a frame image.
- the player combines the second field image and the third field image after the field image with the value of the field_used_for_pull_down_flag syntax unit corresponding to 1 in the corresponding SEI information into a frame image.
- the player takes the field image with the bottom_field_flag equal to 0 as the top field, and the bottom_field_flag takes the value equal to
- the field image of 1 is used as the bottom field.
- the player will combine the frame images obtained at a frame rate of 25 Hz.
- the above-mentioned encoding method of the field information, the encoder, the electronic product, the codec device and the video playing device encode the image that needs to be repeatedly played back into the repeat playing mode using the field identification information, thereby avoiding encoding the repeated field, thereby saving The coding bit overhead; accordingly, the above decoding method and decoder can save decoding time in the process of parsing the code stream.
- the field identification information code stream organization method used in the embodiment of the present invention sets different flag bits for the frame image and the field image. Moreover, different processing flows are set, the unnecessary operation in the encoding process is avoided, and the coding bit overhead is saved. Moreover, the encoding timing information is not needed in the encoding process, which saves coding overhead.
- the embodiment of the present invention supports the frame image and The operation of the field image, therefore, does not present an obstacle to the application of the source parameters.
- an embodiment of the present invention further provides an electronic product including the above decoder, where the electronic product further includes a controller, and the controller is configured to receive an analysis result sent by the decoder, and control according to the analysis result. Play video images.
- the controller is specifically configured to receive a value of a control parameter sent by the decoder, determine an image playing sequence and a repeat play mode indicated by the control parameter according to the value of the control parameter, and follow the image.
- the playback order and repeat play mode control the playback of video images.
- An embodiment of the present invention further provides a video playback device including the foregoing electronic product and the above encoder, wherein the encoder can encode a video signal and output an encoded code stream including field identification SEI information; the decoder and The controller can decode the code stream containing the field identification SEI information, set the playback control parameters, and play.
- the video playback device may be a related stream generating device and a receiving playback device in a video communication application, such as a mobile phone, a computer, a server, a set top box, a portable mobile terminal, a digital video camera, a television broadcast system device, or the like.
- a video communication application such as a mobile phone, a computer, a server, a set top box, a portable mobile terminal, a digital video camera, a television broadcast system device, or the like.
- the embodiment of the present invention further provides a coding and decoding apparatus, where the apparatus includes the above-mentioned encoder and the above-mentioned decoder, and the functions are the same, and details are not described herein again.
- the embodiment of the present invention further provides a method for identifying frame field information in a code stream, the method comprising: dividing identification information related to different frame field playing applications into different types of information by using indication information that identifies the entire coding sequence feature. Group;
- the entire coding sequence is characterized by an image type in the sequence, the image type including a field image and a frame image;
- the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- said set of information identifies a code stream usable for having said entire code sequence feature The information needed to decode the image's conversion operation.
- the converting operation converts the decoded image into an image for playback.
- the information group identifies information that is available for the conversion operation to directly complete the decoded frame image as an output image after the conversion operation;
- the information group identifies information that is available for the conversion operation to directly complete the decoded field image as an output image after the conversion operation;
- the information group identifies information that is available for the conversion operation to split the decoded frame image into two field images and uses the two field images as the output image after the conversion operation; or the information group Information indicating that the decoded frame image is split into three field images and the three field images are used as the output image after the conversion operation is identified.
- the information group identifies information that is available for the conversion operation to merge the two field images into one frame image and uses the frame image as the output image after the conversion operation.
- the information group identifies location information of the field image used by the conversion operation in accordance with a field image playback order relative to the currently processed image.
- the information group identifies information that is available for the conversion operation to complete the operation of the field image in the field image playback order when inserted into the specified position.
- the set of information is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit, or in a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the identification of the entire coding sequence feature and/or the source acquisition method is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit in which the information group is located, or in a new information element in.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the source acquiring method comprises: a progressive scanning method and/or an interlaced scanning method.
- said one type of information selected for use and selected only is included in the encoded sequence code stream.
- the embodiment of the invention further provides a code stream carrying frame field information, including:
- the indication information that identifies the entire coding sequence feature is used to divide the identification information related to the different field play application into different types of information groups;
- the entire coding sequence is characterized by an image type in the sequence, the image type including a field image and a frame image;
- the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- said set of information includes information usable for a conversion operation of a decoded image of a code stream having said entire encoded sequence feature.
- the converting operation converts the decoded image into an image for playback.
- the information group includes information required for the conversion operation to complete the decoded frame image directly as an output image after the conversion operation; or
- the set of information includes information necessary for the conversion operation to complete the decoded field image directly as an output image after the conversion operation; or
- the information set includes information required for the conversion operation to complete splitting the decoded frame image into two field images and using the two field images as output images after the conversion operation; or
- the information set contains information necessary for the conversion operation to complete splitting the decoded frame image into three field images and using the three field images as the output image after the conversion operation.
- the information set includes information necessary for the conversion operation to complete combining the two field images into one frame image and using the frame image as the output image after the conversion operation.
- the information group includes position information of the field image used by the conversion operation in accordance with the field image playing order with respect to the currently processed image.
- the information set contains information that is available for the conversion operation to complete the operation of the field image in the field image playback order when inserted into the designated position.
- the information set is included in a Supplemental Enhancement Information (SEI) unit or a Video Availability Information (VUI) unit, or in a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Availability Information
- the Supplemental Enhancement Information (SEI) unit, or the Video Availability Information (VUI) unit, or a new information element including the information set further includes an identifier of the entire coding sequence feature and/or the source acquisition method.
- the source acquiring method comprises: a progressive scanning method and/or an interlaced scanning method.
- only one of the selected types of information sets is included in a coded sequence code stream.
- the present invention also provides a method for using a frame field information code stream, the method comprising: obtaining indication information identifying a feature of the entire coding sequence from a parameter set of the code stream; and obtaining a different frame field according to the indication information Playing the information group of the application-related identification information; obtaining, according to the information group, a conversion operation method and image playback control information for converting the decoded image into an image for playing, and performing a corresponding conversion operation;
- the entire coding sequence is characterized by an image type in the sequence, the image type including a field image and a frame image;
- the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- the decoded frame image is directly used as a playback image according to the conversion operation method and the image playback control information; or
- the decoded frame image is split into three field images, and the three field images are used as images to be sequentially played.
- the two field images are combined into one frame image, and this frame image is used as a playback image.
- obtaining the position information of the field image according to the field image playing order relative to the currently processed image obtaining the position information of the field image according to the field image playing order relative to the currently processed image
- the two field images are obtained, the two field images are combined into one frame image, and this frame image is used as a playback image.
- the field image is inserted into the designated position in the field image playback order, and the field image is used as the playback image of the insertion position.
- the information of the information group is obtained in a Supplemental Enhancement Information (SEI) unit, or a Video Usability Information (VUI) unit, or a new information unit.
- SEI Supplemental Enhancement Information
- VUI Video Usability Information
- the embodiment of the present invention further provides an apparatus for using a code stream carrying a frame field information, the apparatus comprising: a first processing unit, configured to: obtain, from the parameter set of the code stream, indication information that identifies a feature of the entire coding sequence;
- the second processing unit is configured to: obtain, according to the indication information, an information group that identifies the identification information of the different field play application;
- a third processing unit configured to: obtain, according to the information group, a conversion operation method and image playback control information for converting the decoded image into an image for playing, and perform a corresponding conversion operation;
- the entire coding sequence is characterized by an image type in the sequence, the image type including a field image and a frame image;
- the indication information is located in a parameter set.
- the field image is an image obtained by interlaced scanning
- the frame image is an image obtained by progressive scanning.
- the third processing unit is configured to:
- the decoded frame image is split into three field images, and the three field images are used as images to be sequentially played.
- the third processing unit is configured to: combine the two field images into one frame image according to the conversion operation method and the image playback control information, and use the frame image as a playback image.
- the third processing unit is configured to:
- two field images are obtained, the two field images are combined into one frame image, and this frame image is used as a playback image.
- the third processing unit is configured to: insert the field image into the designated position according to the field image playing order according to the conversion operation method and the image playing control information, and use the field image as the insertion position Play the image.
- the second processing unit is configured to: obtain information of the information group in a supplemental enhancement information (SEI) unit, or a video availability information (VUI) unit, or a new information unit.
- SEI Supplemental Enhancement Information
- VUI video availability information
- An embodiment of the present invention further provides an apparatus, including an electronic product, wherein the electronic product uses a method for identifying frame field information in the code stream.
- Embodiments of the present invention also provide an apparatus, including an electronic product, the electronic product generating the code stream.
- the embodiment of the present invention further provides an apparatus, including an electronic product, wherein the electronic product uses the above method for using a frame field information code stream.
- Embodiments of the present invention also provide an apparatus, including an electronic product, the electronic product using the above device.
- the encoder can use the field identification information to encode it into the repeat playing mode, thereby avoiding Encoding the repeated field saves coding bit overhead; accordingly, the above decoding method and decoder can save decoding time in the process of parsing the code stream.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
一种帧场信息的编码方法,该方法包括:编码器接收待编码的视频图像和辅助信息;所述编码器对所述视频图像进行编码,根据场标识信息的码流组织方法和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输出包含所述场标识信息的码流,其中,对于需要重复播放的所述视频图像,所述编码器使用所述场标识信息将其编码为重复播放模式。
Description
帧场信息的编码方法及解码方法、 编码器和解码器
技术领域
本发明涉及视频压缩编码技术, 尤其涉及一种帧场信息的编码方法及解 码方法、 编码器、 解码器、 电子产品、 编解码装置和视频播放设备。 背景技术
为在数字广播系统中广播老式胶片电影, 通常首先对原始胶片电影的图 像帧进行扫描和数字化处理, 然后进行编码和传输。 老式胶片电影的帧率是 24帧 /秒,国家电视制式委员会( National Television System Committee, NTSC ) 制式电视系统的场频为近似认为 60场 /秒,逐行倒相( Phase Alternation Line , PAL )制式电视系统的场频可近似认为 50场 /秒。 因此, 需要对数字化的老 式电影帧 "拆成" 场, 并调整场率以适合不同的广播电视系统。
对于 PAL制式的广播电视系统,通常直接将老式胶片扫描得到的图像帧 直接拆分成顶场和底场, 并设定相邻两场之间的时间间隔为 1/50秒。 这样, 如果某电影原播放时长为 90分钟, 则在 PAL制电视系统中的播放时长为: 90 分钟 X (24帧 /秒 X 2场 /帧 X 60秒 /分钟) I (50场 /秒 x 60秒 /分钟) = 86.4 分钟。 尽管播放时长缩短, 但人眼几乎感觉不到。
对于 NTSC制式的广播电视系统, 通常使用 3:2帧场转换技术(通常称 为 "3:2 pull-down" )将两个电影图像帧转换为 5场, 从而实现将 24帧 /秒的 数字化电影胶片扫描帧序列转换为 60场 /秒的适合 NTSC制式广播电视系统 播放的场序列。 尽管其中某些场重复播放, 但由于相邻场之间的播放时间间 隔很短, 人眼也不易察觉。 3:2 pull-down如图 1所示。
对于上述广播应用, H.264/AVC标准釆用如下帧场信息编码方法:
1. 基于帧的方法: 直接对胶片扫描后的帧图像序列进行编码, 为每个接 入单元 ( Access Unit, AU )添力口补充增强信息 ( Supplemental Enhancement Information, SEI )信息用以指示场播放方式。 使用 SEI信息中的 pic— struct 标识解码帧的播放方式, 包括: 先顶场后底场 (Top-Bottom ) 、 先底场后顶
场( Bottom-Top )、先顶场后底场再重复播放顶场( Top-Bottom-Top (Repeated) )、 先底场后顶场再重复播放底场 ( Bottom-Top-Bottom (Repeated) ) , 从而同时 支持 "24 Hz 帧编码 -- > 50 Hz 场播放" 和对解码后的帧图像进行 3:2 Pull-Down ( "24Hz帧编码 --> 60Hz场播放" )应用。
2. 基于场的方法: 将帧图像序列转换为 50Hz或 60Hz系统所使用的场 图像序列, 直接使用 H.264/AVC 的场模式进行编码( "48Hz (指 "拆分" 成场后的实际釆样频率)场编码 -- > 50Hz (指实际播放频率或码流的目标播 放帧率) 场播放(码流的目标图像播放模式) " , "60Hz场编码 —> 60Hz 场播放" )。 对使用 3:2 Pull-Down产生的重复场图像也进行编码。 码流中直 接使用场模式下的顶场、 底场标志位标识各图像的帧场信息。
对于上述广播应用, 目前已基本成形的下一代视频编码标准——高性能 视频编码标准 ( High-Efficiency Video Coding , HEVC ) 的委员会草案 ( Committee Draft, CD ) 中釆用如下帧场信息编码方法:
1. HEVC编码器对输入图像统一釆用帧模式进行编码, 即在分片层不再 使用帧场信息标志位。在视频可用性信息( Video Usability Information, VUI ) 中编码需要使用场标识 SEI信息 (Field Indication SEI Message ) 的标志位 field— indication_presence— flag。 当该标志位的取值等于 1时,每个图像均需要 使用场标识 SEI信息编码该图像的帧场信息; 当该标志位的取值等于 0时, 图像可使用、 也可以不使用场 SEI信息编码该图像的帧场信息。
2.基于帧的方法: HEVC基于帧的方法仅支持 "24Hz帧编码 ->50Hz场 播放"应用。 编码器通过编码 SEI信息中的 top— field— first— flag标志位标识将 当前帧分成顶场和底场后, 各场的时域播放顺序。
3.基于场的方法: 将帧图像序列转换为 50Hz或 60Hz系统所使用的场图 像序列, 直接使用 HEVC对图像进行编码。 对使用 3:2 Pull-Down产生的重 复场图像也进行编码。 编码器为每个 AU编码 SEI信息, 用以标识当前 AU 中包含图像的帧场信息, 并使用其中的重复标识 ( duplicate— flag )标识当前 场图像是否是重复图像(主要用于 3 :2 Pull-Down ) 。
上述方法的主要局限性有如下几点:
第一, H.264/AVC与 HEVC中基于场的方法均需要对重复场进行编码,
增加了编码比特开销。 第二, HEVC CD方法不支持帧模式 3:2 Pull-Down应用。 即使在 "24Hz 帧编- > 50Hz场播放"应用, 编码器需要强制将信源参数 (sequence— type— flag, prograssive— source— flag)设置为(0,0), 即使信源特性与此不同 (如逐行扫描帧 (0,1) ) 。 这样会对需要使用信源参数的应用带来障碍。
第三, H.264/AVC 的帧模式需要编码的 pic— struct 包含在 pic— timing(payload— type) SEI信息中。 为使用 pic— struct, 需要进一步编码定 时信息, 增加了编码开销。
第四, 尽管 HEVC CD中的场标识 SEI信息可以标识信源序列的帧场信 息, 但标志位未对帧、 场进行区分, 各标志位的功能存在一定的重叠 (如 bottom— field— flag和 top— field— first— flag )。 这样一来, 需要编码器为每个 AU 编码 SEI信息过程中保证不同类型标志位之间没有矛盾取值, 增加了编解码 器无谓的判断操作数量和一致性校验操作数量。 例如, 若当前 AU中包含顶 场图像, SEI信息中需将 bottom— field— flag的取值设置为 0、 top— field— first— flag 的取值设置为 1。 尽管可以避免歧义, 但在这种常用应用场景下, 同样的信 息被重复编码, 浪费编码比特。
发明内容
本发明实施例提供了一种帧场信息的编码方法及解码方法、 编码器、 解 码器、 电子产品、 编解码装置和视频播放设备, 以解决现有对重复场进行编 码, 增加了编码比特开销的问题。 本发明实施例提供了一种帧场信息的编码方法, 该方法包括:
编码器接收待编码的视频图像和辅助信息;
所述编码器对所述视频图像进行编码, 根据场标识信息的码流组织方法 和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输出包含所 述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 所述编码 器使用所述场标识信息将其编码为重复播放模式。
优选地, 所述待编码的视频图像包括帧图像和场图像; 和 /或, 所述场标
识信息包含在补充增强信息( SEI )单元中或视频可用性信息( VUI )单元中, 或者作为一种新的信息单元。
优选地, 所述辅助信息包括所述视频图像的排序信息、 所述视频图像的 帧图像和场图像属性信息、 所述场图像的顶场或底场属性信息以及所述顶场 或底场的重复场标识中的一种或几种。
优选地, 所述辅助信息还包括所述视频图像的播放信息; 所述播放信息 包括所述视频图像的播放方式、 播放顺序和播放场率中的一种或几种。
优选地, 所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出 的顶场或底场将被重复播放的字段, 所述重复场信息包括默认设定的重复场 播放位置;或者,表示场图像的顶场或底场属性的字段、重复场的标识字段、 表示重复场信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式 的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像 拆分出的顶场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧 图像拆分出的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的 顶场或底场将被重复播放的字段。
优选地, 所述编码器根据场标识信息的码流组织方法和所述辅助信息对 所述视频图像所使用的场标识信息进行编码并输出包含所述场标识信息的码 流, 包括: 所述编码器根据所述辅助信息对所述场标识信息中各字段的值进 行设置;
所述对于需要重复播放的所述视频图像, 所述编码器使用所述场标识信 息将其编码为重复播放模式, 包括: 对于需要重复播放的场图像, 所述编码 器将所述场标识信息中的重复场标识字段的值设置为第一预定值, 将所述表 示重复场信息的字段的值设置为第二预定值; 或者, 对于需要重复播放的场 图像, 所述编码器将所述场标识信息中的重复场标识字段的值设置为所述第 一预定值, 将所述表示重复场信息的字段的值设置为所述第二预定值, 将表 示重复场播放位置的字段设置为设定值。
优选地, 所述第一预定值为 "0" , 所述第二预定值为 "Γ 。
本发明实施例还提供了一种帧场信息的解码方法, 该方法包括: 解码器根据场标识信息的码流组织方法对读入的包含所述场标识信息的 码流进行解析; 所述解码器向控制器发送解析结果, 以便所述控制器根据所 述解析结果控制视频图像的播放。
优选地, 所述视频图像包括帧图像和场图像; 和 /或, 所述场标识信息包 含在补充增强信息(SEI )单元中或视频可用性信息(VUI )单元中, 或者在 一种新的信息单元中。
优选地, 所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出 的顶场或底场将被重复播放的字段, 所述重复场信息包括默认设定的重复场 播放位置;或者,表示场图像的顶场或底场属性的字段、重复场的标识字段、 表示重复场信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式 的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像 拆分出的顶场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧 图像拆分出的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的 顶场或底场将被重复播放的字段。
优选地, 所述解码器根据场标识信息的码流组织方法对读入的包含所述 场标识信息的码流进行解析, 包括: 所述解码器根据场标识信息的码流组织 方法解析出所述场标识信息中各字段的值。
优选地, 所述解码器将向控制器发送解析结果, 以便所述控制器根据所 述解析结果控制视频图像的播放, 包括: 所述解码器将解析出的所述场标识 信息中各字段对应的控制参数的值发送给控制器 , 以便所述控制器根据所述 控制参数的值确定所述控制参数所指示的图像播放顺序和重复播放模式 , 以 及按照所述图像播放顺序和重复播放模式控制视频图像的播放。
本发明实施例还提供了一种编码器, 该编码器包括:
接收模块, 设置为: 接收待编码的视频图像和辅助信息;
编码模块, 设置为: 对所述视频图像进行编码, 根据场标识信息的码流
组织方法和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输 出包含所述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 使用所述场标识信息将其编码为重复播放模式。
优选地, 所述待编码的视频图像包括帧图像和场图像; 和 /或, 所述场标 识信息包含在补充增强信息( SEI )单元中或视频可用性信息( VUI )单元中, 或者作为一种新的信息单元。
优选地, 所述辅助信息包括所述视频图像的排序信息、 所述视频图像的 帧图像和场图像属性信息、 所述场图像的顶场或底场属性信息以及所述顶场 或底场的重复场标识中的一种或几种。
优选地, 所述辅助信息还包括所述视频图像的播放信息; 所述播放信息 包括所述视频图像的播放方式、 播放顺序和播放场率中的一种或几种。
优选地, 所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出 的顶场或底场将被重复播放的字段, 所述重复场信息包括默认设定的重复场 播放位置;或者,表示场图像的顶场或底场属性的字段、重复场的标识字段、 表示重复场信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式 的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像 拆分出的顶场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧 图像拆分出的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的 顶场或底场将被重复播放的字段。
优选地, 所述编码模块, 设置为: 根据所述辅助信息对所述场标识信息 中各字段的值进行设置; 其中, 对于需要重复播放的场图像, 将所述场标识 信息中的重复场标识字段的值设置为第一预定值, 将所述表示重复场信息的 字段的值设置为第二预定值; 或者, 所述编码器将所述场标识信息中的重复 场标识字段的值设置为所述第一预定值, 将所述表示重复场信息的字段的值 设置为所述第二预定值, 将表示重复场播放位置的字段设置为设定值。
优选地, 所述第一预定值为 "0" , 所述第二预定值为 "Γ 。
本发明实施例又提供了一种解码器, 该解码器包括:
解析模块, 设置为: 根据场标识信息的码流组织方法对读入的包含所述 场标识信息的码流进行解析; 发送模块, 设置为: 向控制器发送解析结果, 以便所述控制器根据所述解析结果控制视频图像的播放。
优选地, 所述视频图像包括帧图像和场图像; 和 /或, 所述场标识信息包 含在补充增强信息(SEI )单元中或视频可用性信息(VUI )单元中, 或者在 一种新的信息单元中。
优选地, 所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出 的顶场或底场将被重复播放的字段, 所述重复场信息包括默认设定的重复场 播放位置;或者,表示场图像的顶场或底场属性的字段、重复场的标识字段、 表示重复场信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式 的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像 拆分出的顶场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧 图像拆分出的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的 顶场或底场将被重复播放的字段。
优选地, 所述解析模块, 设置为: 根据场标识信息的码流组织方法解析 出所述场标识信息中各字段的值。
优选地, 所述发送模块, 设置为: 将所述解析模块解析出的所述各字段 对应的控制参数的值发送给控制器。
本发明实施例提供了一种包括上述解码器的电子产品, 该电子产品还包 括控制器, 所述控制器, 设置为: 接收所述解码器发送的解析结果, 根据所 述解析结果控制视频图像的播放。
优选地, 所述控制器, 设置为: 接收所述解码器发送的控制参数的值, 根据所述控制参数的值确定所述控制参数所指示的图像播放顺序和重复播放 模式, 以及按照所述图像播放顺序和重复播放模式控制视频图像的播放。
本发明实施例另提供了一种编解码装置,包括上述编码器和上述解码器。 本发明实施例又提供了一种视频播放设备, 包括上述电子产品和上述编
码器。
本发明实施例另提供了一种码流中帧场信息的标识方法, 该方法包括: 使用标识整个编码序列特征的指示信息将用于不同帧场播放应用相关的 标识信息划分成不同类型的信息组; 其中, 所述整个编码序列特征为序列中 图像类型,所述图像类型包括场图像和帧图像;所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述信息组标识了可用于对具有所述整个编码序列特征的码流 的解码图像的转换操作所需的信息。
优选地, 所述转换操作将解码图像转换为用于播放的图像。
优选地, 所述信息组标识了可供所述转换操作完成直接将解码的帧图像 作为所述转换操作后的输出图像的信息; 或者, 所述信息组标识了可供所述 转换操作完成直接将解码的场图像作为所述转换操作后的输出图像的信息; 或者, 所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成两个 场图像、 并将这两个场图像作为所述转换操作后的输出图像的信息; 或者, 所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成三个场图像、 并将这三个场图像作为所述转换操作后的输出图像的信息。
优选地, 所述信息组标识了可供所述转换操作完成将两个场图像合并成 一个帧图像、 并将这个帧图像作为所述转换操作后的输出图像的信息。
优选地, 所述信息组标识了所述转换操作使用的场图像按照场图像播放 顺序相对于当前处理图像的位置信息。
优选地, 所述信息组标识了可供所述转换操作完成将场图像按照场图像 播放顺序在插入到指定位置操作的信息。
优选地, 将所述信息组包含在补充增强信息( SEI )单元中或视频可用性 信息 (VUI )单元中, 或者在一种新的信息单元中。
优选地,将标识整个编码序列特征和 /或信源获取方法包含在所述信息组 所在的补充增强信息(SEI )单元中或视频可用性信息(VUI )单元中, 或者 在一种新的信息单元中。
优选地, 所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。 优选地, 将选择使用的一种且仅此选定的一种类型的所述信息组包含在 编码序列码流中。
本发明实施例另提供了一种携带帧场信息的码流, 包括: 码流中, 标识 整个编码序列特征的指示信息用于将不同帧场播放应用相关的标识信息划分 成不同类型的信息组; 其中, 所述整个编码序列特征为序列中图像类型, 所 述图像类型包括场图像和帧图像; 所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述信息组包含了可用于对具有所述整个编码序列特征的码流 的解码图像的转换操作所使用的信息。
优选地, 所述转换操作将解码图像转换为用于播放的图像。
优选地, 所述信息组包含了可供所述转换操作完成直接将解码的帧图像 作为所述转换操作后的输出图像所需的信息; 或者, 所述信息组包含了可供 所述转换操作完成直接将解码的场图像作为所述转换操作后的输出图像所需 的信息; 或者, 所述信息组包含了可供所述转换操作完成将解码的帧图像拆 分成两个场图像、 并将这两个场图像作为所述转换操作后的输出图像所需的 信息; 或者, 所述信息组包含了可供所述转换操作完成将解码的帧图像拆分 成三个场图像、 并将这三个场图像作为所述转换操作后的输出图像所需的信 息。
优选地, 所述信息组包含了可供所述转换操作完成将两个场图像合并成 一个帧图像、 并将这个帧图像作为所述转换操作后的输出图像所需的信息。
优选地, 所述信息组包含了所述转换操作使用的场图像按照场图像播放 顺序相对于当前处理图像的位置信息。
优选地, 所述信息组包含了可供所述转换操作完成将场图像按照场图像 播放顺序在插入到指定位置操作的信息。
优选地, 所述信息组包含在补充增强信息 ( SEI )单元中或视频可用性信 息 (VUI )单元中, 或者在一种新的信息单元中。
优选地, 包含所述信息组的补充增强信息(SEI )单元、 或视频可用性信 息 ( VUI )单元, 或一种新的信息单元中还包含有整个编码序列特征和 /或信 源获取方法的标识信息。
优选地, 所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。 优选地, 一个编码序列码流中仅包含一种且仅此一种选定类型的所述信 息组。
本发明实施例另提供了一种携带帧场信息码流的使用方法,该方法包括: 从所述码流的参数集中获得标识整个编码序列特征的指示信息; 根据所述指 示信息, 获得标识不同帧场播放应用相关标识信息的信息组; 根据所述信息 组, 获得将解码图像转换为用于播放的图像的转换操作方法和图像播放控制 信息, 并进行相应的转换操作; 其中, 所述整个编码序列特征为序列中图像 类型, 所述图像类型包括场图像和帧图像; 所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 直接将解码的帧 图像作为播放图像; 或者, 根据所述转换操作方法和图像播放控制信息, 直 接将解码的场图像作为播放图像; 或者, 根据所述转换操作方法和图像播放 控制信息, 将解码的帧图像拆分成两个场图像、 并将这两个场图像作为依次 进行播放的图像; 或者, 根据所述转换操作方法和图像播放控制信息, 将解 码的帧图像拆分成三个场图像、并将这三个场图像作为依次进行播放的图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 将两个场图像合 并成一个帧图像、 并将这个帧图像作为播放图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 获得所述场图像 按照场图像播放顺序相对于当前处理图像的位置信息; 根据所述位置信息, 获得两个场图像, 将两个场图像合并成一个帧图像、 并将这个帧图像作为播 放图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 将场图像按照场 图像播放顺序在插入到指定位置, 并将所述场图像作为所述插入位置的播放
图像。
优选地, 解析在补充增强信息 (SEI )单元、 或视频可用性信息 (VUI ) 单元、 或者一种新的信息单元获得所述信息组的信息。
本发明实施例另提供了一种使用携带帧场信息码流的装置,该装置包括: 第一处理单元, 设置为: 从所述码流的参数集中获得标识整个编码序列特征 的指示信息; 第二处理单元, 设置为: 根据所述指示信息, 获得标识不同帧 场播放应用相关标识信息的信息组; 第三处理单元, 设置为: 根据所述信息 组, 获得将解码图像转换为用于播放的图像的转换操作方法和图像播放控制 信息, 并进行相应的转换操作; 其中, 所述整个编码序列特征为序列中图像 类型, 所述图像类型包括场图像和帧图像; 所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息, 直接将解码的帧图像作为播放图像; 或者, 根据所述转换操作方 法和图像播放控制信息, 直接将解码的场图像作为播放图像; 或者, 根据所 述转换操作方法和图像播放控制信息, 将解码的帧图像拆分成两个场图像、 并将这两个场图像作为依次进行播放的图像; 或者, 根据所述转换操作方法 和图像播放控制信息, 将解码的帧图像拆分成三个场图像、 并将这三个场图 像作为依次进行播放的图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息,将两个场图像合并成一个帧图像、并将这个帧图像作为播放图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息, 获得所述场图像按照场图像播放顺序相对于当前处理图像的位置 信息; 根据所述位置信息, 获得两个场图像, 将两个场图像合并成一个帧图 像、 并将这个帧图像作为播放图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息, 将场图像按照场图像播放顺序在插入到指定位置, 并将所述场图 像作为所述插入位置的播放图像。
优选地, 所述第二处理单元设置 : 在补充增强信息(SEI )单元、 或视 频可用性信息 (VUI )单元、 或者一矛新的信息单元中获得所述信息组的信 息。
本发明实施例另提供了一种装置 , 包括电子产品, 所述电子产品釆用上 述码流中帧场信息的标识方法。
本发明实施例另提供了一种装置 , 包括电子产品, 所述电子产品产生上 述码流。
本发明实施例另提供了一种装置 , 包括电子产品, 所述电子产品釆用上 述携带帧场信 ,包、码流的使用方法。
本发明实施例另提供了一种设备 , 包括电子产品, 所述电子产品釆用上 述装置。 附图概述
图 1为 3:2 Pull-Down示意图;
图 2为本发明实施例一解码器解析场标识 SEI信息的处理流程图; 图 3为使用本发明实施例一场标识 SEI信息的终端控制器的处理流程图; 图 4为使用本发明实施例一场标识 SEI信息的编码器的处理流程图; 图 5为使用本发明实施例一场标识 SEI信息支持" 24Hz帧编码 -- > 50Hz 场播放" 的编码、 解码方法在 50 Hz场模式播放设备上的应用实例;
图 6为使用本发明实施例一场标识 SEI信息支持" 24Hz帧编码 -- > 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 7为使用本发明实施例一场标识 SEI信息支持" 48Hz场编码 -- > 50Hz 场播放" 的编码、 解码方法在 50 Hz场模式播放设备上的应用实例;
图 8为使用本发明实施例一场标识 SEI信息支持" 60Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 9为使用本发明实施例一场标识 SEI信息支持" 48Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 10为使用本发明实施例一场标识 SEI信息支持" 24Hz帧编码 -> 50Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 11为使用本发明实施例一场标识 SEI信息支持" 24Hz帧编码 -> 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 12为使用本发明实施例一场标识 SEI信息支持" 48Hz场编码 -- > 50Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 13为使用本发明实施例一场标识 SEI信息支持" 60Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 14为使用本发明实施例一场标识 SEI信息支持" 48Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 15为本发明实施例二解码器解析场标识 SEI信息的处理流程图; 图 16为使用本发明实施例二场标识 SEI信息的终端控制器的处理流程图; 图 17为使用本发明实施例二场标识 SEI信息的编码器的处理流程图; 图 18为使用本发明实施例二场标识 SEI信息支持" 24Hz帧编码 --> 50Hz 场播放" 的编码、 解码方法在 50 Hz场模式播放设备上的应用实例;
图 19为使用本发明实施例二场标识 SEI信息支持" 24Hz帧编码 --> 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 20为使用本发明实施例二场标识 SEI信息支持" 48Hz场编码 -- > 50Hz 场播放" 的编码、 解码方法在 50 Hz场模式播放设备上的应用实例;
图 21为使用本发明实施例二场标识 SEI信息支持" 60Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 22为使用本发明实施例二场标识 SEI信息支持" 48Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 60 Hz场模式播放设备上的应用实例;
图 23为使用本发明实施例二场标识 SEI信息支持" 24Hz帧编码 -- > 50Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 24为使用本发明实施例二场标识 SEI信息支持" 24Hz帧编码 -- > 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 25为使用本发明实施例二场标识 SEI信息支持" 48Hz场编码 -- > 50Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 26为使用本发明实施例二场标识 SEI信息支持" 60Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例;
图 27为使用本发明实施例二场标识 SEI信息支持" 48Hz场编码 -- > 60Hz 场播放" 的编码、 解码方法在 25 Hz帧模式播放设备上的应用实例。 本发明的较佳实施方式
下文中将结合附图对本发明的实施例进行详细说明。 需要说明的是, 在 不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互任意组合。
另外, 下述各实施例所述编码器实现方法仅为该实施例下编码器可能的 实现方法之一, 任何能够生成符合该实施例解码器码流解析过程要求的码流 的编码器, 均属于该实施例的编码器的保护范畴。
本发明实施例提供了一种帧场信息的编码方法, 该方法从编码器角度进 行描述, 该方法包括:
步骤 11、 编码器接收待编码的视频图像和辅助信息;
其中, 所述待编码的视频图像可以包括帧图像和场图像; 所述辅助信息 可以包括所述视频图像的排序信息、 所述视频图像的帧图像和场图像属性信 息、 所述场图像的顶场或底场属性信息以及所述顶场或底场的重复场标识中 的一种或几种; 还可以包括所述视频图像的播放信息; 所述播放信息包括所 述视频图像的播放方式、 播放顺序和播放场率中的一种或几种。
步骤 12、 编码器对所述视频图像进行编码, 根据场标识信息的码流组织 方法和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输出包 含所述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 所述 编码器使用所述场标识信息将其编码为重复播放模式。
其中, 所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重 复场的标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表
示帧图像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出的 顶场或底场将被重复播放的字段, 所述重复场信息包括默认设定的重复场播 放位置; 或者, 表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式 的字段、 表示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像 拆分出的顶场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧 图像拆分出的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的 顶场或底场将被重复播放的字段。
另外, 所述编码器根据所述辅助信息对所述场标识信息中各字段的值进 行设置; 对于需要重复播放的场图像, 所述编码器将所述场标识信息中的重 复场标识字段的值设置为第一预定值, 将所述表示重复场信息的字段的值设 置为第二预定值; 或者, 所述编码器将所述场标识信息中的重复场标识字段 的值设置为所述第一预定值, 将所述表示重复场信息的字段的值设置为所述 第二预定值, 将表示重复场播放位置的字段设置为设定值。
相应地, 本发明实施例还提供了一种帧场信息的解码方法, 该方法从解 码器的角度进行描述, 该方法包括:
步骤 21、解码器根据场标识信息的码流组织方法对读入的包含所述场标 识信息的码流进行解析;
该步骤可以包括: 所述解码器根据场标识信息的码流组织方法解析出所 述场标识信息中各字段的值。
步骤 22、 所述解码器将向控制器发送解析结果, 以便所述控制器根据所 述解析结果控制视频图像的播放。
该步骤可以包括: 解码器将解析出的所述场标识信息中各字段对应的控 制参数的值发送给控制器 , 以便所述控制器根据所述控制参数的值确定所述 控制参数所指示的图像播放顺序和重复播放模式, 以及按照所述图像播放顺 序和重复播放模式控制视频图像的播放。
与上述编码方法和解码方法相对应, 本发明实施例还提供了一种编码器
和一种解码器, 其中, 编码器包括: 接收模块, 用于接收待编码的视频图像和辅助信息;
编码模块, 用于对所述视频图像进行编码, 根据场标识信息的码流组织 方法和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输出包 含所述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 使用 所述场标识信息将其编码为重复播放模式。
上述解码器包括:
解析模块, 用于根据场标识信息的码流组织方法对读入的包含所述场标 识信息的码流进行解析;
发送模块, 用于向控制器发送解析结果, 以便所述控制器根据所述解析 结果控制视频图像的播放。
上述编码器和上述解码器完成的功能分别与上述编码方法和上述解码方 法相对应, 此处不再赘述。
本发明中, 所述场标识信息包含在补充增强信息(SEI )单元中或视频可 用性信息 ( VUI )单元中, 也可以作为一种新的信息单元存在。 在后续的具 体实施例中, 以场标识信息包含在 SEI单元中 (即场标识 SEI信息) 为例进 行说明。
本发明实施例提供的帧场信息编解码方法和装置, 可以支持多种场播放 模式, 包括: "24Hz帧编码 --> 50Hz场播放" , " 24Hz帧编码 --> 60Hz 场播放" , "48Hz场编码 -- > 50Hz场播放" , "60Hz场编码 -- > 60Hz场 播放" 和 "48Hz场编码 -> 60Hz场播放" 。 这里使用的标记方法的含义如 下:
前一个频率值指输入编码器的原始片源或经过帧 /场转换后的片源的实 际釆样率 (即每秒钟釆样图像的个数) 。 该值与编码器工作时设置的编码帧 率 /场率可以是不同的。 例如, 对于 "48Hz场编码 -> 50Hz场播放" , 其编 码场率可以是 50Hz而非转换后得到的场率 48Hz。
后一个频率值指使用支持码流的目标图像播放模式的终端播放设备按照
码流的目标播放帧率进行播放时该设备每秒钟播放的图像数量。 该值可以与 原始片源或经过帧 /场转换后的片源的实际釆样率不同,也可以与编码器所设 置的编码帧率 /场率不同。
"帧编码" 或 "场编码" 指的是 AU中所包含的图像是帧还是场。 "帧 播放" 或 "场播放" 指的是支持码流的目标图像播放模式的终端播放设备所 播放的图像是帧还是场。
实施例一
本实施例所使用的 VUI码流组织方法与 HEVC CD方法相同。
本实施例所使用的场标识 SEI信息码流组织方法如表 1所示:
表 1 场标识 SEI信息码流组织方法一
sequence— type— flag、 progressive— source— flag的语义和对应的操作与 HEVC CD方法完全相同。
bottom— field— flag用于标识当前 AU中所包含的场的顶场 /底场属性。 bottom— field— flag等于 1 时, 表示当前 AU中所包含的场图像为底场; 反之, bottom— field— flag等于 0时, 表示当前 AU中所包含的场图像为 顶场。
duplicate— flag等于 1时,表示当前 AU中所包含的场是先前播放场的重
复场; 反之, duplicate— flag等于 0时, 表示当前 AU中所包含的场不是先前 播放场的重复场。
field— used— for— pull— down— flag等于 1时,表示当前 AU中所包含的场将 在下一个场播放后重复播放一次, 且重复播放场的顶场 /底场属性与当前 AU 中所包含场相同。 field— used— for_pull— down— flag等于 0时, 表示当前 AU中 所包含的场不再重复播放。
field— output— flag 用于标识当前 AU 中所包含的帧的播放方式。 field— output— flag等于 1 时, 表示当前 AU中所包含的帧将拆分成顶场 和底场 (使用 HEVC CD 中给出 的方法 ) 进行播放; 反之, field— output— flag等于 0时, 表示当前 AU中所包含的帧将以逐行扫描 的方式进行播放。
top— field— first— flag用于标识当前 AU中所包含的帧拆分成顶场和底场后 各场的播放顺序。 当 field— output— flag等于 1时, top— field— output— flag等于 1 表示先播放顶场,后播放底场; top— field— first— flag等于 0时表示先播放底场, 后播放顶场。 当 field— output— flag等于 0时, top— field— first— flag无实际意义且 其值置为 0。
frame— used— for— pull— down— flag用于标识当前 AU中所包含的帧拆分 出的顶场或底场将重复播放。 当 field— output— flag 等于 1 时, top— field— output— flag等于 1并且 frame— used— for— pull— down— flag等于 1 时,当前 AU中所包含的帧拆分出的顶场和底场釆用 "顶场——底场—— 重复顶 场 " 的播放顺序 ; top— field_output_flag 等于 0 并且 frame— used— for— pull— down— flag等于 1 时, 当前 AU中所包含的帧拆分 出的顶场和底场釆用 "底场——顶场——重复底场" 的播放顺序; 当 frame— used— for— pull— down— flag等于 0时, 当前 AU中所包含的帧拆分 出的顶场和底场均不重复播放。 当 field— output— flag 等于 0 时, frame— used— for— pull— do wn— flag无实际意义且其值置为 0。
如图 2所示, 为本发明实施例一解码器解析场标识 SEI信息的处理流程 图, 所述终端使用场模式进行图像播放, 并且图像播放帧率与码流的目标播
放帧率相同。 该过程包括:
步骤 201 , 接收端读入场标识 SEI信息码流; 解码器读入第一个比特, 使用 u(l)的译码方法解析 sequence— type— flag的取值;
步骤 202 , 解码器读入第二个比特, 使用 u(l)对应的方法解析 progressive— source— flag的取值;
步骤 203 ,解码器判断: sequence— type— flag == 1 ? 若是,执行步骤 204; 否则, 执行步骤 209;
步骤 204 , 解码器读入第三个比特, 使用 u(l)对应的方法解析 bottom— field— flag的取值;
步骤 205 , 解码器读入第四个比特, 使用 u(l)对应的方法解析 duplicate— flag的取值;
步骤 206,解码器判断: duplicate— falg == 0? 若是,执行步骤 207;否则, 执行步骤 208;
步骤 207 , 解码器读入第五个比特, 使用 u(l)对应的方法解析 field— used— for_pull— down— flag的取值; 执行步骤 214;
步骤 208, 解码器跳过第五个比特, 并将 field— used— for_pull— down— flag 的取值置为 0; 执行步骤 214;
步骤 209 , 解码器读入第三个比特, 使用 u(l)对应的方法解析 field— ourput— flag的取值;
步骤 210, 解码器判断: field— output— flag == 1 ? 若是, 执行步骤 211 ; 否则, 执行步骤 213 ;
步骤 211 , 解码器读入第四个比特, 使用 u(l)对应的方法解析 top— field— first— flag的取值;
步骤 212 , 解码器读入第五个比特, 使用 u(l)对应的方法解析 frame— used— for_pull— down— flag的取值; 执行步骤 214;
步骤 213 , 解码器跳过第四个比特和第五个比特; 将 top— field— first— flag 和 frame— used— for_pull— down— flag的取值置均置为 0; 执行步骤 214;
步骤 214, 解码器跳过第六、 第七和第八三个预留比特; 场标识 SEI信 息码流解析过程结束。
如图 3所示, 为使用本发明实施例一场标识 SEI信息的终端控制器的处 理流程图, 该方法包括:
步骤 301 , 解码器解析场标识 SEI信息码流, 并将控制位的值传递给终 端的播放控制单元或终端控制器;
步骤 302, 解码器将解码恢复图像送交给控制器;
步骤 303 ,控制器判断: sequence— type— flag == 1 ? 若是,执行步骤 304; 否则, 执行步骤 309;
步骤 304 ,控制器根据 bottom— field— flag的取值,设置当前播放图像的顶 场 /底场属性;
步骤 305 ,控制器判断: duplicate— flag == 0? 若是,执行步骤 306;否则, 执行步骤 308;
步骤 306, 控制器判断: field— used— for_pull— down— flag == 1 ? 若是, 执 行步骤 307; 否则, 执行步骤 308;
步骤 307 , 控制器将当前场存入播放緩冲区, 并设置其属性为: 在下一 个图像播放后播放该图像, 该图像的顶场 /底场属性不变; 执行步骤 315; 步骤 308 , 控制器将当前场放入播放緩冲区, 并增加设置其属性: 立即 播放, 播放后从緩冲区中移除; 执行步骤 315;
步骤 309, 控制器判断: field— output— flag == 1 ? 若是, 执行步骤 310; 否则, 执行步骤 313 ;
步骤 310,控制器设置播放模式:图像使用隔行扫描的场模式进行播放; 步骤 311 , 控制器将当前帧分成顶场和底场两幅图像;
所述控制器使用 HEVC CD中给出的已有方法将当前帧拆分成顶场和底 场两幅图像。
步 骤 312 , 控 制 器 根 据 top— field— first— flag 和
frame— used— for_pull— down— flag的取值,控制顶场和底场在播放緩冲区中的放 置顺序, 并设置属性值; 执行步骤 315。
所述控制 器根据本实施例 中 给出 的 top— field— first— flag 和 frame— used— for_pull— down— flag的组合所表示的场播放顺序,控制顶场和底场 在播放緩冲区中的放置顺序, 并设置属性值。 场播放顺序如下表 2所示:
场播放顺序
步骤 313 ,控制器设置播放模式:图像使用逐行扫描的帧模式进行播放; 步骤 314 , 控制器将当前帧放入播放緩冲区, 并增加设置其属性: 立即 播放, 播放后从緩冲区中移除; 执行步骤 315;
步骤 315 , 终端的播放单元根据播放图像緩冲区中各图像的属性进行播 放。
如图 4所示, 为使用本发明实施例一场标识 SEI信息的编码器的处理流 程图, 该过程包括:
步骤 401 , 编码器读入当前编码图像及其辅助信息;
上述当前编码图像可以是逐行扫描原始胶片得到的帧图像序列, 可以是 釆用隔行扫描方式或使用 HEVC CD中给出的方法从帧图像拆分得到的场图 像序列。
所述辅助信息包括:输入图像的排序信息,图像的帧图像和场图像属性;
若为场图像, 进一步标识其顶场 /底场属性, 并标识是否是之前(按照播放顺 序) 某场的重复场。
所述辅助信息还包括: 图像的播放信息。 该类信息给出了图像的播放方 式(帧模式还是场模式) , 图像的播放顺序 (包括是否重复播放某个场以支 持 3:2 Pull-Down功能) 。
所述辅助信息可由视频釆集设备、 视频转换设备提供给编码器。
步骤 402 , 编码器根据信源参数设置 sequence— type— flag 和 progressive— source— flag的值, 并使用 u(l)对应的编码方法将其写入码流;
sequence— type— flag 与 progressive— source— flag 标识信源参数的方法与 HEVC CD中的方法相同。
步骤 403 , 编码器判断: sequence— type— flag == 1 ? 若是,执行步骤 404; 否则, 执行步骤 409;
步骤 404, 编码器根据辅助信息, 确定当前图像的顶场 /底场属性, 设置 bottom— field— flag的取值, 并使用 u(l)对应的编码方法将其写入码 流;
步骤 405 ,编码器根据辅助信息,确定 duplicate— flag的取值,并使用 u(l) 对应的编码方法将其写入码流;
步骤 406,编码器判断: duplicate— flag == 0? 若是,执行步骤 407;否则, 执行步骤 408;
步 骤 407 , 编 码 器 根 据 辅 助 信 息 , 确 定 field— used— for— pull— down— flag的取值, 并使用 u(l)对应的编码方法将 其写入码流; 执行步骤 415 ;
步骤 408, 编码器将 field— used— for_pull— down— flag的值置为 0 , 并使用 u(l)对应的编码方法将其写入码流; 执行步骤 415;
步骤 409, 编码器根据辅助信息, 确定当前帧的播放方式, 设置 field— output— flag的取值,并使用 u( 1 )对应的编码方法将其写入码流; 步骤 410, 编码器判断: field— output— flag == 1 ? 若是, 执行步骤 411 ; 否则, 执行步骤 413 ;
步骤 411 , 编码器根据辅助信息, 确定当前帧分成两场后的播放 顺序, 设置 top— field— first— flag 的取值, 并使用 u(l )对应的编码方 法将其写入码流; 步骤 412,编码器根据辅助信息,确定是否需要重复播放首先播放的场, 设置 frame— for_pull— down— flag的取值,并使用 u(l)对应的编码方法将其写入 码流; 执行步骤 415;
步骤 413 , 编码器将 top— field— first— flag的值置为 0, 并使用 u(l)对应的 编码方法将其写入码流;
步骤 414, 编码器将 frame— for_pull— down— flag的值为 0 , 并使用 u(l)对 应的编码方法将其写入码流; 执行步骤 415;
步骤 415 , 编码器连续在码流中写入 3个 0值比特; 场标识 SEI信息编 码过程结束。
使用本实施例一所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "24Hz帧编码 -> 50Hz场播放" 在 50 Hz场模式播放设备上的应用, 该应用实例如图 5所示, 该过程包括: 步骤 501 , 视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 401中所述辅助信息相同;
在图 5所示应用实例中, 所述辅助信息具体为: AU中包含帧图像, 每 帧在播放前拆分成顶场和底场, 首先播放顶场, 然后播放底场, 播放场率为 50Hz。
步骤 502 , 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 503 , 接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制解码恢复视频的 播放过程。
使用本实施例一所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "24Hz帧编码 -- > 60Hz场播放" 在 60 Hz场模式播放设备上的应用。 该应用实例如图 6所示, 该过程包括: 步骤 601 , 视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 401中所述辅助信息相同。
在图 6所示应用实例中, 所述辅助信息具体为: AU中包含帧图像, 每 帧在播放前拆分成顶场和底场, 并使用 3:2 Pull-Down的方法达到播放场率 60Hz要求。 按照原始帧的播放顺序, 每两帧为一组, 前一个播放帧使用 3:2 Pull-Down的方法拆分成 3场,后一个播放帧拆分成顶场和底场, 并按照 "顶 场一底场一顶场一底场 ... ... " 的交替顺序进行播放, 播放帧率为 60Hz。
步骤 602, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 603 , 接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制解码恢复视频的 播放过程。
使用本实施例一所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "48Hz场编码 -- > 50Hz场播放" 在 50 Hz场模式播放设备上的应用。 该应用实例如图 7所示, 该过程包括: 步骤 701 , 视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 401中所述辅助信息相同。
所述视频信源釆集设备可直接在隔行扫描胶片图像过程中, 生成如图 7 所示的场序列。
可替换地, 所述视频转换设备可将所述视频釆集设备输出的逐行扫描胶 片图像得到的帧图像拆分成顶场和底场, 并进一步转换为 "顶场一底场一顶 场一底场 ... ... " 交替的场图像序列。
在图 7所示应用实例中, 所述辅助信息具体为: AU中包含场图像, 序
列第一个图像为顶场, 播放场率为 50Hz。
步骤 702, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 703 , 接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制解码恢复视频的 播放过程。
使用本实施例一所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "60Hz场编码 -- > 60Hz场播放" 在 60 Hz场模式播放设备上的应用, 该应用实例如图 8所示, 该过程包括: 步骤 801 , 视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 401中所述辅助信息相同。
所述视频信源釆集设备可直接在隔行扫描胶片图像过程中, 生成如图 8 所示的场序列, 并对重复图像进行标记。
可替换地, 所述视频转换设备可使用图 1所示的 3:2 Pull-Down方法,将 所述视频釆集设备输出的逐行扫描胶片图像得到的 24Hz帧图像序列转换为 "顶场一底场一顶场一底场 ... ... " 交替的场图像序列, 并对重复场图像进行 标记。
在图 8所示应用实例中, 所述辅助信息具体为: AU中包含场图像, 序 列第一个图像为顶场, 标记出的重复图像, 播放场率为 60Hz。
步骤 802, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 803 , 接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制解码恢复视频的 播放过程。
使用本实施例一所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "48Hz场编码 -- > 60Hz场播放" 在 60 Hz场模式播放设备上的应用。 该应用实例如图 9所示, 该过程包括:
步骤 901 , 使用步骤 801中的方法生成步骤 801的场图像序列, 从所生 成的图像序列中去掉重复图像, 并标识需要重复播放的场;
在图 9所示的应用实例中, 所述辅助信息具体为: AU中包含场图像, 序列中各场图像的顶场 /底场属性, 标记出的需重复播放的场图像, 播放场率 为 60Hz。
步骤 902, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 903 , 接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
以上均为支持码流的目标图像播放模式和目标播放帧率的终端播放设备 的应用实例。 对于与码流的目标图像播放模式和目标播放帧率不相同的终端 播放设备, 由于并不强制要求终端播放设备按照 SEI信息单元中各语法单元 的语义进行完全一致的操作, 因此, 终端播放设备可以以所接收到的 SEI信 息单元中某一个或某些语法单元的取值为依据, 对解码的场图像或帧图像进 行简单而灵活的后处理, 以与播放设备的播放模式和播放帧率相匹配。 具体 的应用实例如下所述。 其中, 所述播放设备使用的播放器中包含解码器。
根据本实施例一所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 5所 示应用实例的 "24Hz帧编码 -- > 50Hz场播放"码流。 该应用实例如图 10所 示, 该过程包括:
步骤 1001 , 与步骤 501完全相同。
步骤 1002, 与步骤 502完全相同。
步骤 1003 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 1时, 直接将解码图像按照 25 Hz的帧率进行播放。
根据本实施例一所给出的场标识信息 SEI码流组织方法、码流解析方法、
终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 6所 示应用实例的 "24Hz帧编码 -- > 60Hz场播放"码流。 该应用实例如图 11所 示, 该过程包括:
步骤 1101 , 与步骤 601完全相同。
步骤 1102, 与步骤 602完全相同。
步骤 1103 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 1时, 直接将解码图像按照 25 Hz的帧率进行播放。
根据本实施例一所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 7所 示应用实例的 "48Hz场编码 -- > 50Hz场播放"码流。 该应用实例如图 12所 示, 该过程包括:
步骤 1201 , 与步骤 701完全相同。
步骤 1202, 与步骤 702完全相同。
步骤 1203 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0时,解码 POC取值为偶数的场图像及其播放顺序的后续 一幅解码场图像按两幅图像对应 SEI信息中 bottom— field— flag的取值组合成 一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图像 作为顶场, bottom— field— flag取值等于 1的场图像作为底场。播放器将组合后 得到的帧图像按照 25 Hz的帧率进行播放。
根据本实施例一所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 8所 示应用实例的 "60Hz场编码 -- > 60Hz场播放"码流。 该应用实例如图 13所 示, 该过程包括:
步骤 1301 , 与步骤 801完全相同。
步骤 1302, 与步骤 802完全相同。
步骤 1303 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息
解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0时,播放器搜索得到对应 SEI信息中 duplicate— flag语法 单元取值等于 1的场图像, 该图像将不被播放。 解码器将 duplicate— flag语法 单元取值等于 1的场图像按播放顺序的前两幅场图像组合成一幅帧图像, 将 duplicate— flag语法单元取值等于 1的场图像按播放顺序的后两幅场图像组合 成一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图 像作为顶场, bottom— field— flag取值等于 1的场图像作为底场。播放器将组合 后得到的帧图像按照 25 Hz的帧率进行播放。
根据本实施例一所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 9所 示应用实例的 "48Hz场编码 -- > 60Hz场播放"码流。 该应用实例如图 14所 示, 该过程包括:
步骤 1401 , 与步骤 901完全相同。
步骤 1402 , 与步骤 902完全相同。
步骤 1403 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0 时, 播放器搜索得到对应 SEI 信息中 field— used— for_pull— down— flag语法单元取值等于 1的场图像, 将该场图像与 其按播放顺序的下一幅场图像组合成一幅帧图像。 播放器将按播放顺序在对 应 SEI信息中 field— used— for_pull— down— flag语法单元取值等于 1的场图像后 的第二幅场图像和第三幅场图像组合成一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图像作为顶场, bottom— field— flag取值等于
1的场图像作为底场。 播放器将组合后得到的帧图像按照 25 Hz的帧率进行 播放。
实施例二
本实施例所使用 VUI码流组织方法与 HEVC CD方法相同。
本实施例所使用的场标识 SEI信息码流组织方法如表 3所示:
表 3 场标识 SEI信息码流组织方法二
field_indication( payloadSize ) { Descriptor sequence_type_flag u(l)
progressive—source—flag u(l)
if (sequence type flag) {
bottom—field—flag u(l) duplicate—flag u(l) if(! duplicate—flag) {
field_used_for_pull_do n_flag u(l) if (field_used_for_pull_down_flag)
order_to_place_duplicate u(3)
}
} else {
field—output—flag u(l) if(field_output_flag) {
top_field_first_flag u(l) frame_used_for_pull_do n_flag u(l) if (frame_used_for_pull_down_flag) {
duplicate—top—flag u(l)
order_to_place_duplicate u(3)
}
}
}
rbsp_trailing_bits ( )
}
上述表 3中:
sequence— type— flag、 progressive— source— flag的语义和对应的操作与 HEVC CD方法完全相同。
bottom— field— flag 用于标识当前 AU 中所包含的场的顶场 /底场属性。 bottom— field— flag等于 1时, 表示当前 AU中所包含的场图像为底场; 反之, bottom— field— flag等于 0时, 表示当前 AU中所包含的场图像为顶场。
duplicate— flag等于 1时,表示当前 AU中所包含的场是先前播放场的重 复场; 反之, duplicate— flag等于 0时, 表示当前 AU中所包含的场不是先前 播放场的重复场。
field— used— for— pull— down— flag等于 1时,表示当前 AU中所包含的场将 重复播放一次, 且重复播放场的顶场 /底场属性与当前 AU中所包含场相同。 field— used— for_pull— down— flag等于 0时, 表示当前 AU中所包含的场不再重
复播放。
order— to— place— duplicate用于标识当前 AU所包含的场图像进行重复播 放的位置。 按照场图像播放顺序, 所指示的图像在 order— to_place— duplicate 个图像播放后进行重复播放,且重复图像的顶场 /底场属性与所指示的图像相 同。 当 sequence— type— flag等于 1时, 所指示的图像为当前 AU中包含的场图 像; 当 sequence— type— flag等于 0时, 所指示的图像为当前 AU中包含的帧图 像拆分出的两场图像中的顶场 ( duplicate— top— flag 等于 1 时) 或底场 ( duplicate— top— flag等于 0时) 。
field— output— flag 用于标识当前 AU 中所包含的帧的播放方式。 field— output— flag等于 1时, 表示当前 AU中所包含的帧将拆分成顶场和底场 (使用 HEVC CD中给出的方法)进行播放; 反之, field_output_flag等于 0 时, 表示当前 AU中所包含的帧将以逐行扫描的方式进行播放。
top— field— first— flag用于标识当前 AU中所包含的帧拆分成顶场和底场后 各场的播放顺序。 当 field— output— flag等于 1时, top— field— output— flag等于 1 表示先播放顶场,后播放底场; top— field— first— flag等于 0时表示先播放底场, 后播放顶场。 当 field— output— flag等于 0时, top— field— first— flag无实际意义且 其值置为 0。
frame— used— for— pull— down— flag用于标识当前 AU中所包含的帧拆分出 的顶场或底场将重复播放。 frame— used— for_pull— down— flag等于 1 表示当前 AU 所 包含 的 帧 拆 分 出 的 顶 场 或 底 场 将被重 复播放 ; frame— used— for_pull— down— flag等于 0表示当前 AU所包含的帧拆分出的顶场 和底场都不会重复播放。
duplicate— top— flag等于 1表示当前 AU中所包含的帧拆分出的顶场将被 重复播放; duplicate— top— flag等于 0表示当前 AU中所包含的帧拆分出的底 场将被重复播放。
如图 15所示,为本发明实施例二解码器解析场标识 SEI信息的处理流程 图, 该过程包括:
步骤 1501 , 接收端读入场标识 SEI信息码流; 解码器读入第一个比特, 使用 u(l)的译码方法解析 sequence— type— flag的取值;
步骤 1502, 解码器读入第二个比特, 使用 u(l)对应的方法解析 progressive— source— flag的取值;
步骤 1503,解码器判断: sequence— type— flag == 1? 若是,执行步骤 1504; 否则, 执行步骤 1510;
步骤 1504, 解码器读入第三个比特, 使用 u(l)对应的方法解析 bottom— field— flag的取值;
步骤 1505, 解码器读入第四个比特, 使用 u(l)对应的方法解析 duplicate— flag的取值;
步骤 1506, 解码器判断: duplicate— falg==0? 若是, 执行步骤 1507; 否 则, 执行步骤 1517;
步骤 1507, 解码器读入第四个比特, 使用 u(l)对应的方法解析 field— used— for_pull— down— flag的取值;
步骤 1508, 解码器判断: field— used— for_pull— down— flag ==1? 若是, 执 行步骤 1509; 否则, 执行步骤 1517;
步骤 1509, 解码器使用 u(3)对应的方法解析 order— to_place— duplicate的 取值。 执行步骤 1517;
步骤 1510, 解码器读入第三个比特, 使用 u(l)对应的方法解析 field— output— flag的取值;
步骤 1511, 解码器判断: field— output— flag ==1? 若是,执行步骤 1512; 否则, 执行步骤 1517;
步骤 1512, 解码器读入第四个比特, 使用 u(l)对应的方法解析 top— field— first— flag的取值;
步骤 1513, 解码器读入第五个比特, 使用 u(l)对应的方法解析 frame— used— for_pull— down— flag的取值;
步骤 1514, 解码器判断: frame— used— for_pull— down— flag == 1? 若是, 执行步骤 1515; 否则, 执行步骤 1517;
步骤 1515, 解码器读入第六个比特, 使用 u(l)对应的方法解析
duplicate— top— flag的取值;
步骤 1516 , 解码器使用 u(3)对应的方法解析 order— to_place— duplicate的 取值; 执行步骤 1517;
步骤 1517 , 解码器跳过 byte— alignment( )比特; 场标识 SEI信息码流解 析过程结束。
如图 16所示,为使用本发明实施例二场标识 SEI信息的终端控制器处理 流程图, 所述终端使用场模式进行图像播放, 并且图像播放帧率与码流的目 标播放帧率相同。 该过程包括:
步骤 1601 , 解码器解析场标识 SEI信息码流, 并将控制位的值传递给终 端的播放控制单元或终端控制器;
步骤 1602, 解码器将解码恢复图像送交给控制器;
步骤 1603 ,控制器判断: sequence— type— flag == 1 ? 若是,执行步骤 1604; 否则, 执行步骤 1609;
步骤 1604, 控制器根据 bottom— field— flag的取值, 设置当前播放图像的 顶场 /底场属性;
步骤 1605 , 控制器判断: duplicate— flag == 0? 若是, 执行步骤 1606; 否 则, 执行步骤 1608;
步骤 1606 , 控制器判断: field— used— for_pull— down— flag == 1 ? 若是, 执 行步骤 1607; 否则, 执行步骤 1608;
步骤 1607 , 控制器将当前场存入播放緩冲区, 并设置其属性为: 当前接 入单元播放的第一个图像起, order— to_place— duplicate个图像播放后播放该图 像, 该图像的顶场 /底场属性不变; 执行步骤 1615;
步骤 1608, 控制器将当前场放入播放緩冲区, 并增加设置其属性: 立即 播放, 播放后从緩冲区中移除; 执行步骤 1615;
步骤 1609,控制器判断: field— output— flag == 1 ? 若是,执行步骤 1610; 否则, 执行步骤 1613 ;
步骤 1610 ,控制器设置播放模式:图像使用隔行扫描的场模式进行播放;
步骤 1611 , 控制器将当前帧分成顶场和底场两幅图像;
步 骤 1612 , 控 制 器 根 据 top— field— first— flag 和 frame— used— for_pull— down— flag的取值,控制顶场和底场在播放緩冲区中的放 置顺序, 并设置属性值; 执行步骤 1615;
当 top— field— first— flag等于 1 时, 先播放顶场图像再播放底场图像; 当 top— field— first— flag等于 0时, 先播放底场图像再播放顶场图像。
当 frame— used— for_pull— down— flag等于 1时, 当前帧拆分出的顶场和底 场中的一场将会被重复播放, 其顶场 /底场特性不变。 当 duplicate— top— flag等 于 1 时, 顶场在播放了 order— to_place— duplicate 个图像后重复播放; duplicate— top— flag等于 0时,底场在播放了 order— to_place— duplicate个图像后 重复播放。 控制器将顶场和底场图像按照播放顺序要求放入播放緩冲区, 并 设置顶场 /底场、 是否重复播放、 重复播放位置等播放属性。
当 frame— used— for_pull— down— flag等于 0时, 当前帧拆分出的顶场和底 场均不会被重复播放。顶场和底场按照 top— field— first— flag标识的播放顺序放 入播放图像緩冲区中, 并设置顶场 /底场的播放属性。
步骤 1613 ,控制器设置播放模式:图像使用逐行扫描的帧模式进行播放; 步骤 1614, 控制器将当前帧放入播放緩冲区, 并增加设置其属性: 立即 播放, 播放后从緩冲区中移除; 执行步骤 1615;
步骤 1615 ,终端的播放单元根据播放图像緩冲区中各图像的属性进行播 放。
如图 17所示,为使用本发明实施例二场标识 SEI信息的编码器的处理流 程图, 该过程包括:
步骤 1701 , 编码器读入当前编码图像及其辅助信息;
所述编码图像可以是逐行扫描原始胶片得到的帧图像序列, 可以是釆用 隔行扫描方式或使用 HEVC CD中给出方法从帧图像拆分得到的场图像序列。
所述辅助信息包括:输入图像的排序信息,图像的帧图像和场图像属性; 若为场图像,进一步标识其顶场 /底场属性,并标识是否之前(按照播放顺序 ) 某场的重复场。
所述辅助信息还包括: 图像的播放信息。 该类信息给出了图像的播放方 式(帧模式还是场模式) , 图像的播放顺序 (包括是否重复播放某个场以支
# 3:2 Pull-Down ) 。
所述辅助信息可由视频釆集设备、 视频转换设备提供给编码器。
步骤 1702 , 编码器根据信源参数设置 sequence— type— flag 和 progressive— source— flag的值, 并使用 u(l)对应的编码方法将其写入码流; sequence— type— flag 与 progressive— source— flag 标识信源参数的方法与 HEVC CD中的方法相同。
步骤 1703 ,编码器判断: sequence— type— flag == 1 ? 若是,执行步骤 1704; 否则, 执行步骤 1709;
步骤 1704 , 编码器根据辅助信息, 确定当前图像的顶场 /底场属性, 设 置 bottom— field— flag的取值, 并使用 u(l)对应的编码方法将其写入码流; 步骤 1705 , 编码器根据辅助信息, 确定 duplicate— flag的取值, 并使用 u(l)对应的编码方法将其写入码流;
步骤 1706, 编码器判断: duplicate— flag == 0? 若是, 执行步骤 1707; 否 则, 执行步骤 1716;
步骤 1707 , 编码器根据辅助信息, 确定 field— used— for_pull— down— flag 的取值, 并使用 u(l)对应的编码方法将其写入码流;
步骤 1708,编码器根据辅助信息,确定 order— to_place— duplicate的取值, 并使用 u(3)对应的编码方法将其写入码流; 执行步骤 1716;
步骤 1709 , 编码器根据辅助信息, 确定当前帧的播放方式, 设置 field— output— flag的取值, 并使用 u(l)对应的编码方法将其写入码流;
步骤 1710, 编码器判断: field— output— flag == 1 ? 若是,执行步骤 1711 ; 否则, 执行步骤 1716;
步骤 1711 , 编码器根据辅助信息, 确定当前帧分成两场后的播放顺序, 设置 top— field— first— flag的取值, 并使用 u(l)对应的编码方法将其写入码流; 步骤 1712 ,编码器根据辅助信息,确定是否需要重复播放首先播放的场,
设置 frame— for_pull— down— flag的取值,并使用 u(l)对应的编码方法将其写入 码流;
步骤 1713 , 编码器判断: frame— for_pull— down— flag == 1 ? 若是, 执行步 骤 1714; 否则, 执行步骤 1716;
步骤 1714, 编码器根据辅助信息确定需要重复的场是顶场还是底场, 设 置 duplicate— top— flag的值, 并使用 u(l)对应的编码方法将其写入码流;
步骤 1715 , 编码器根据辅助信息确定需要重复的场所插入的位置, 设置 order— to_place— duplicate的取值, 并使用 u(3)对应的编码方法将其写入码流; 执行步骤 1716;
步骤 Π16, 编码器在码流中写入 byte_alignment( )比特; 场标识 SEI信 息编码过程结束。
使用本实施例二所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "24Hz帧编码 -- > 50Hz场播放" 在 50 Hz场模式播放设备上的应用, 该应用实例如图 18所示, 该过程包括: 步骤 1801 ,视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 1701中所述辅助信息相同。
在图 18所示应用实例中, 所述辅助信息具体为: AU中包含帧图像, 每 帧在播放前拆分成顶场和底场, 首先播放顶场, 然后播放底场, 播放场率为 50Hz。
步骤 1802, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 1803 ,接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值。 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
使用本实施例二所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "24Hz帧编码 -- > 60Hz场播放" 在 60 Hz场模式播放设备上的应用。 该应用实例如图 19所示, 该过程包括:
步骤 1901 ,视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 1701中所述辅助信息相同。
在图 19所示应用实例中, 所述辅助信息具体为: AU中包含帧图像, 每 帧在播放前拆分成顶场和底场, 并使用 3:2 Pull-Down的方法达到播放场率 60Hz要求。 按照原始帧的播放顺序, 每两帧为一组, 前一个播放帧使用 3:2 Pull-Down的方法拆分成 3场,后一个播放帧拆分成顶场和底场, 并按照 "顶 场一底场一顶场一底场 ... ... " 的交替顺序进行播放, 播放帧率为 60Hz。
步骤 1902, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 1903 ,接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
使用本实施例二所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "48Hz场编码 -> 50Hz场播放" 在 50 Hz场模式播放设备上的应用。 该应用实例如图 20所示, 该过程包括: 步骤 2001 ,视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 1701中所述辅助信息相同。
所述视频信源釆集设备可直接在隔行扫描胶片图像过程中,生成如图 20 所示的场序列。
可替换地, 所述视频转换设备可将所述视频釆集设备输出的逐行扫描胶 片图像得到的帧图像拆分成顶场和底场, 并进一步转换为 "顶场一底场一顶 场一底场 ... ... " 交替的场图像序列。
在图 20所示应用实例中, 所述辅助信息具体为: AU中包含场图像, 序 列第一个图像为顶场, 播放场率为 50Hz。
步骤 2002, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 2003 ,接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值。 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
使用本实施例二所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "60Hz场编码 -> 60Hz场播放" 在 60 Hz场模式播放设备上的应用。 该应用实例如图 21所示, 该过程包括: 步骤 2101 ,视频信源釆集设备和转换设备将原始视频转换为需要送交编 码器进行编码的视频, 并为编码器提供必要辅助信息;
所述辅助信息与步骤 1701中所述辅助信息相同。
所述视频信源釆集设备可直接在隔行扫描胶片图像过程中,生成如图 21 所示的场序列, 并对重复图像进行标记。
可替换地, 所述视频转换设备可使用图 1所示的 3:2 Pull-Down方法,将 所述视频釆集设备输出的逐行扫描胶片图像得到的 24Hz帧图像序列转换为 "顶场一底场一顶场一底场 ... ... " 交替的场图像序列, 并对重复场图像进行 标记。
在图 21所示应用实例中, 所述辅助信息具体为: AU中包含场图像, 序 列第一个图像为顶场, 标记出的重复图像, 播放场率为 60Hz。
步骤 2102, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 2103 ,接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值; 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
使用本实施例二所给出的场标识 SEI信息码流组织方法、码流解析方法、 终端控制方法和编码方法,可以支持所述 "48Hz场编码 -- > 60Hz场播放" 在 60 Hz场模式播放设备上的应用。 该应用实例如图 22所示, 该过程包括: 步骤 2201 , 使用步骤 2101中的方法生成步骤 2201的场图像序列; 从所 生成的图像序列中去掉重复图像, 并标识需要重复播放的场;
在图 22所示应用实例中, 所述辅助信息具体为: AU中包含场图像, 序
列中各场图像的顶场 /底场属性, 标记出的需重复播放的场图像, 播放场率为
60Hz。
步骤 2202, 使用本实施例所述编码器, 根据视频辅助信息, 设置场标识 SEI信息中各标志位的取值, 并对视频进行编码;
步骤 2203 ,接收端的解码器使用本实施例所述场标识 SEI信息解析方法 解析各标志位的取值。 接收端使用本实施例所述控制器控制控制解码恢复视 频的播放过程。
以上均为支持码流的目标图像播放模式和目标播放帧率的终端播放设备 的应用实例。 对于与码流的目标图像播放模式和目标播放帧率不相同的终端 播放设备, 由于并不强制要求终端播放设备按照 SEI信息单元中各语法单元 的语义进行完全一致的操作, 因此, 终端播放设备可以以所接收到的 SEI信 息单元中某一个或某些语法单元的取值为依据, 对解码的场图像或帧图像进 行简单而灵活的后处理, 以与播放设备的播放模式和播放帧率相匹配。 具体 的应用实例如下所述。
根据本实施例二所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 18所 示应用实例的 "24Hz帧编码 -- > 50Hz场播放"码流。 该应用实例如图 23所 示, 该过程包括:
步骤 2301 , 与步骤 1801完全相同。
步骤 2302, 与步骤 1802完全相同。
步骤 2303 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 1时, 直接将解码图像按照 25 Hz的帧率进行播放。
根据本实施例二所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 19所 示应用实例的 "24Hz帧编码 -- > 60Hz场播放"码流。 该应用实例如图 24所 示, 该过程包括:
步骤 2401 , 与步骤 1901完全相同。
步骤 2402 , 与步骤 1902完全相同。
步骤 2403 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 1时, 直接将解码图像按照 25 Hz的帧率进行播放。
根据本实施例二所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 20所 示应用实例的 "48Hz场编码 -- > 50Hz场播放"码流。 该应用实例如图 25所 示, 该过程包括:
步骤 2501 , 与步骤 2001完全相同。
步骤 2502, 与步骤 2002完全相同。
步骤 2503 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0时,解码 POC取值为偶数的场图像及其播放顺序的后续 一幅解码场图像按两幅图像对应 SEI信息中 bottom— field— flag的取值组合成 一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图像 作为顶场, bottom— field— flag取值等于 1的场图像作为底场。播放器将组合后 得到的帧图像按照 25 Hz的帧率进行播放。
根据本实施例二所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 21所 示应用实例的 "60Hz场编码 -- > 60Hz场播放"码流。 该应用实例如图 26所 示, 该过程包括:
步骤 2601 , 与步骤 2101完全相同。
步骤 2602, 与步骤 2102完全相同。
步骤 2603 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0时,播放器搜索得到对应 SEI信息中 duplicate— flag语法 单元取值等于 1的场图像, 该图像将不被播放。 解码器将 duplicate— flag语法 单元取值等于 1的场图像按播放顺序的前两幅场图像组合成一幅帧图像, 将
duplicate— flag语法单元取值等于 1的场图像按播放顺序的后两幅场图像组合 成一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图 像作为顶场, bottom— field— flag取值等于 1的场图像作为底场。播放器将组合 后得到的帧图像按照 25 Hz的帧率进行播放。
根据本实施例二所给出的场标识信息 SEI码流组织方法、码流解析方法、 终端控制方法和编码方法, 25 Hz帧模式播放设备也可以解码和播放图 22所 示应用实例的 "48Hz场编码 -- > 60Hz场播放"码流。 该应用实例如图 27所 示, 该过程包括:
步骤 2701 , 与步骤 2201完全相同。
步骤 2702, 与步骤 2202完全相同。
步骤 2703 , 25 Hz帧模式播放设备的播放器使用本实施例所述 SEI信息 解析方法解析各标志位的取值。播放器判断 sequence— type— flag的取值,在该 语法单元取值等于 0 时, 播放器搜索得到对应 SEI 信息中 field— used— for_pull— down— flag语法单元取值等于 1的场图像, 将该场图像与 其按播放顺序的下一幅场图像组合成一幅帧图像。 播放器将按播放顺序在对 应 SEI信息中 field— used— for_pull— down— flag语法单元取值等于 1的场图像后 的第二幅场图像和第三幅场图像组合成一幅帧图像。 组合过程中, 播放器将 bottom— field— flag取值等于 0的场图像作为顶场, bottom— field— flag取值等于
1的场图像作为底场。 播放器将组合后得到的帧图像按照 25 Hz的帧率进行 播放。
需要说明的是, 图 1、 图 5至图 14、 图 18至图 27中帧图像、 场图像中 的黑白条仅用于标识顶场图像和底场图像从帧图像中所选取的像素行的位置、 并区分来自不同帧图像的场图像, 不代表任何实际应用中帧图像、 场图像的 内容。
上述帧场信息的编码方法、 编码器、 电子产品、 编解码装置和视频播放 设备, 将需要重复播放的图像使用场标识信息编码成重复播放模式, 从而避 免了对重复场进行编码, 因而节省了编码比特开销; 相应地, 上述解码方法 及解码器在对码流进行解析过程中可以节省解码时间。 另外, 本发明实施例 中釆用的场标识信息码流组织方法对帧图像和场图像设置了不同的标志位,
并且设置了不同的处理流程, 避免了编码过程中无谓的操作, 节省了编码比 特开销; 并且,在编码过程中不需要编码定时信息,节省了编码开销; 此外, 本发明实施例支持帧图像和场图像的操作, 因而, 对于信源参数的应用不会 带来障碍。
另外, 本发明实施例还提供了一种包括上述解码器的电子产品, 该电子 产品还包括控制器, 所述控制器, 用于接收所述解码器发送的解析结果, 根 据所述解析结果控制视频图像的播放。
其中, 所述控制器, 具体用于接收所述解码器发送的控制参数的值, 根 据所述控制参数的值确定所述控制参数所指示的图像播放顺序和重复播放模 式, 以及按照所述图像播放顺序和重复播放模式控制视频图像的播放。
本发明实施例还提供了一种包括上述电子产品和上述编码器的视频播放 设备, 其中, 该编码器可以对视频信号进行编码, 并输出包含场标识 SEI信 息的编码码流; 该解码器和控制器可以对包含场标识 SEI信息的码流进行解 码, 设置播放控制参数, 并进行播放。
该视频播放设备可以是视频通信应用中相关码流生成设备和接收播放设 备, 例如, 手机、 计算机、服务器、机顶盒、便携式移动终端、数字摄像机, 电视广播系统设备等。
进一步地, 本发明实施例还提供了一种编码解码装置, 该装置包括上述 编码器和上述解码器, 且功能对应相同, 此处不再赘述。
本发明实施例还提供了一种码流中帧场信息的标识方法, 该方法包括: 使用标识整个编码序列特征的指示信息将用于不同帧场播放应用相关的 标识信息划分成不同类型的信息组; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述信息组标识了可用于对具有所述整个编码序列特征的码流
的解码图像的转换操作所需的信息。
优选地, 所述转换操作将解码图像转换为用于播放的图像。
优选地, 所述信息组标识了可供所述转换操作完成直接将解码的帧图像 作为所述转换操作后的输出图像的信息; 或者
所述信息组标识了可供所述转换操作完成直接将解码的场图像作为所述 转换操作后的输出图像的信息; 或者
所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成两个场 图像、 并将这两个场图像作为所述转换操作后的输出图像的信息; 或者 所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成三个场 图像、 并将这三个场图像作为所述转换操作后的输出图像的信息。
优选地, 所述信息组标识了可供所述转换操作完成将两个场图像合并成 一个帧图像、 并将这个帧图像作为所述转换操作后的输出图像的信息。
优选地, 所述信息组标识了所述转换操作使用的场图像按照场图像播放 顺序相对于当前处理图像的位置信息。
优选地, 所述信息组标识了可供所述转换操作完成将场图像按照场图像 播放顺序在插入到指定位置操作的信息。
优选地, 将所述信息组包含在补充增强信息( SEI )单元中或视频可用性 信息 (VUI )单元中, 或者在一种新的信息单元中。
优选地,将标识整个编码序列特征和 /或信源获取方法包含在所述信息组 所在的补充增强信息(SEI )单元中或视频可用性信息(VUI )单元中, 或者 在一种新的信息单元中。
优选地, 所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。 优选地, 将选择使用的一种且仅此选定的一种类型的所述信息组包含在 编码序列码流中。
本发明实施例还提供了一种携带帧场信息的码流, 包括:
码流中, 标识整个编码序列特征的指示信息用于将不同帧场播放应用相 关的标识信息划分成不同类型的信息组; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述信息组包含了可用于对具有所述整个编码序列特征的码流 的解码图像的转换操作所使用的信息。
优选地, 所述转换操作将解码图像转换为用于播放的图像。
优选地, 所述信息组包含了可供所述转换操作完成直接将解码的帧图像 作为所述转换操作后的输出图像所需的信息; 或者
所述信息组包含了可供所述转换操作完成直接将解码的场图像作为所述 转换操作后的输出图像所需的信息; 或者
所述信息组包含了可供所述转换操作完成将解码的帧图像拆分成两个场 图像、 并将这两个场图像作为所述转换操作后的输出图像所需的信息; 或者 所述信息组包含了可供所述转换操作完成将解码的帧图像拆分成三个场 图像、 并将这三个场图像作为所述转换操作后的输出图像所需的信息。
优选地, 所述信息组包含了可供所述转换操作完成将两个场图像合并成 一个帧图像、 并将这个帧图像作为所述转换操作后的输出图像所需的信息。
优选地, 所述信息组包含了所述转换操作使用的场图像按照场图像播放 顺序相对于当前处理图像的位置信息。
优选地, 所述信息组包含了可供所述转换操作完成将场图像按照场图像 播放顺序在插入到指定位置操作的信息。
优选地, 所述信息组包含在补充增强信息 ( SEI )单元中或视频可用性信 息 (VUI )单元中, 或者在一种新的信息单元中。
优选地, 包含所述信息组的补充增强信息(SEI )单元、 或视频可用性信 息 ( VUI )单元, 或一种新的信息单元中还包含有整个编码序列特征和 /或信 源获取方法的标识信息。
优选地, 所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。 优选地, 一个编码序列码流中仅包含一种且仅此一种选定类型的所述信 息组。
本发明还提供了一种携带帧场信息码流的使用方法, 该方法包括: 从所述码流的参数集中获得标识整个编码序列特征的指示信息; 根据所述指示信息,获得标识不同帧场播放应用相关标识信息的信息组; 根据所述信息组, 获得将解码图像转换为用于播放的图像的转换操作方法 和图像播放控制信息, 并进行相应的转换操作; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 直接将解码的帧 图像作为播放图像; 或者
根据所述转换操作方法和图像播放控制信息, 直接将解码的场图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成两 个场图像、 并将这两个场图像作为依次进行播放的图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成三 个场图像、 并将这三个场图像作为依次进行播放的图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 将两个场图像合 并成一个帧图像、 并将这个帧图像作为播放图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 获得所述场图像 按照场图像播放顺序相对于当前处理图像的位置信息;
根据所述位置信息,获得两个场图像,将两个场图像合并成一个帧图像、 并将这个帧图像作为播放图像。
优选地, 根据所述转换操作方法和图像播放控制信息, 将场图像按照场 图像播放顺序在插入到指定位置, 并将所述场图像作为所述插入位置的播放 图像。
优选地, 解析在补充增强信息 (SEI )单元、 或视频可用性信息 (VUI ) 单元、 或者一种新的信息单元获得所述信息组的信息。
本发明实施例还提供了一种使用携带帧场信息码流的装置,该装置包括: 第一处理单元, 设置为: 从所述码流的参数集中获得标识整个编码序列 特征的指示信息;
第二处理单元, 设置为: 根据所述指示信息, 获得标识不同帧场播放应 用相关标识信息的信息组;
第三处理单元, 设置为: 根据所述信息组, 获得将解码图像转换为用于 播放的图像的转换操作方法和图像播放控制信息 , 并进行相应的转换操作; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
优选地, 所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
优选地, 所述第三处理单元设置为:
根据所述转换操作方法和图像播放控制信息, 直接将解码的帧图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息, 直接将解码的场图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成两 个场图像、 并将这两个场图像作为依次进行播放的图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成三 个场图像、 并将这三个场图像作为依次进行播放的图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息,将两个场图像合并成一个帧图像、并将这个帧图像作为播放图像。
优选地, 所述第三处理单元设置为:
根据所述转换操作方法和图像播放控制信息, 获得所述场图像按照场图 像播放顺序相对于当前处理图像的位置信息;
根据所述位置信息,获得两个场图像,将两个场图像合并成一个帧图像、 并将这个帧图像作为播放图像。
优选地, 所述第三处理单元设置为: 根据所述转换操作方法和图像播放 控制信息, 将场图像按照场图像播放顺序在插入到指定位置, 并将所述场图 像作为所述插入位置的播放图像。
优选地, 所述第二处理单元设置为: 在补充增强信息(SEI )单元、 或视 频可用性信息 (VUI )单元、 或者一种新的信息单元中获得所述信息组的信 息。
本发明实施例还提供了一种装置 , 包括电子产品, 所述电子产品釆用上 述码流中帧场信息的标识方法。
本发明实施例还提供了一种装置 , 包括电子产品, 所述电子产品产生上 述码流。
本发明实施例还提供了一种装置 , 包括电子产品, 所述电子产品釆用的 上述携带帧场信息码流的使用方法。
本发明实施例还提供了一种设备 , 包括电子产品, 所述电子产品釆用上 述装置。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成, 所述程序可以存储于计算机可读存储介质中, 如只读 存储器、 磁盘或光盘等。 可选地, 上述实施例的全部或部分步骤也可以使用 一个或多个集成电路来实现。 相应地, 上述实施例中的各模块 /单元可以釆用 硬件的形式实现, 也可以釆用软件功能模块的形式实现。 本发明不限制于任 何特定形式的硬件和软件的结合。
本发明还可有其他多种实施例,在不背离本发明精神及其实质的情况下, 相应的改变和变形都属于本发明所附的权利要求的保护范围。
工业实用性
上述帧场信息的编码方法、 编码器、 电子产品、 编解码装置和视频播放 设备, 对于需要重复播放的视频图像, 编码器可使用所述场标识信息将其编 码成重复播放模式, 从而避免了对重复场进行编码, 节省了编码比特开销; 相应地,上述解码方法及解码器在对码流进行解析过程中可以节省解码时间。
Claims
1、 一种帧场信息的编码方法, 该方法包括:
编码器接收待编码的视频图像和辅助信息;
所述编码器对所述视频图像进行编码, 根据场标识信息的码流组织方法 和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输出包含所 述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 所述编码 器使用所述场标识信息将其编码为重复播放模式。
2、 根据权利要求 1所述的方法, 其中,
所述待编码的视频图像包括帧图像和场图像; 和 /或
所述场标识信息包含在补充增强信息 (SEI )单元中或视频可用性信息
( VUI )单元中, 或者作为一种新的信息单元。
3、 根据权利要求 1所述的方法, 其中,
所述辅助信息包括所述视频图像的排序信息、 所述视频图像的帧图像和 场图像属性信息、 所述场图像的顶场或底场属性信息以及所述顶场或底场的 重复场标识中的一种或几种。
4、 根据权利要求 3所述的方法, 其中,
所述辅助信息还包括所述视频图像的播放信息; 所述播放信息包括所述 视频图像的播放方式、 播放顺序和播放场率中的一种或几种。
5、 根据权利要求 2或 3或 4所述的方法, 其中,
所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的 标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图 像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出的顶场或 底场将被重复播放的字段,所述重复场信息包括默认设定的重复场播放位置; 或者
表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场 信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式的字段、 表
示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像拆分出的顶 场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧图像拆分出 的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的顶场或底场 将被重复播放的字段。
6、 根据权利要求 5所述的方法, 其中,
所述编码器根据场标识信息的码流组织方法和所述辅助信息对所述视频 图像所使用的场标识信息进行编码并输出包含所述场标识信息的码流,包括: 所述编码器根据所述辅助信息对所述场标识信息中各字段的值进行设置; 所述对于需要重复播放的所述视频图像, 所述编码器使用所述场标识信 息将其编码为重复播放模式, 包括:
对于需要重复播放的场图像, 所述编码器将所述场标识信息中的重复场 标识字段的值设置为第一预定值, 将所述表示重复场信息的字段的值设置为 第二预定值; 或者
对于需要重复播放的场图像, 所述编码器将所述场标识信息中的重复场 标识字段的值设置为所述第一预定值, 将所述表示重复场信息的字段的值设 置为所述第二预定值, 将表示重复场播放位置的字段设置为设定值。
7、 根据权利要求 6所述的方法, 其中,
所述第一预定值为 "0" , 所述第二预定值为 "1" 。
8、 一种帧场信息的解码方法, 该方法包括:
解码器根据场标识信息的码流组织方法对读入的包含所述场标识信息的 码流进行解析;
所述解码器向控制器发送解析结果 , 以便所述控制器根据所述解析结果 控制视频图像的播放。
9、 根据权利要求 8所述的方法, 其中,
所述视频图像包括帧图像和场图像; 和 /或
所述场标识信息包含在补充增强信息 (SEI )单元中或视频可用性信息 ( VUI )单元中, 或者在一种新的信息单元中。
10、 根据权利要求 8或 9所述的方法, 其中,
所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的 标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图 像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出的顶场或 底场将被重复播放的字段,所述重复场信息包括默认设定的重复场播放位置; 或者
表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场 信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式的字段、 表 示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像拆分出的顶 场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧图像拆分出 的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的顶场或底场 将被重复播放的字段。
11、 根据权利要求 10所述的方法, 其中,
所述解码器根据场标识信息的码流组织方法对读入的包含所述场标识信 息的码流进行解析, 包括:
所述解码器根据场标识信息的码流组织方法解析出所述场标识信息中各 字段的值。
12、 根据权利要求 11所述的方法, 其中,
所述解码器将向控制器发送解析结果, 以便所述控制器根据所述解析结 果控制视频图像的播放, 包括:
所述解码器将解析出的所述场标识信息中各字段对应的控制参数的值发 送给控制器 , 以便所述控制器根据所述控制参数的值确定所述控制参数所指 示的图像播放顺序和重复播放模式, 以及按照所述图像播放顺序和重复播放 模式控制视频图像的播放。
13、 一种编码器, 该编码器包括:
接收模块, 设置为: 接收待编码的视频图像和辅助信息;
编码模块, 设置为: 对所述视频图像进行编码, 根据场标识信息的码流
组织方法和所述辅助信息对所述视频图像所使用的场标识信息进行编码并输 出包含所述场标识信息的码流, 其中, 对于需要重复播放的所述视频图像, 使用所述场标识信息将其编码为重复播放模式。
14、 根据权利要求 13所述的编码器, 其中,
所述待编码的视频图像包括帧图像和场图像; 和 /或
所述场标识信息包含在补充增强信息 (SEI )单元中或视频可用性信息 ( VUI )单元中, 或者作为一种新的信息单元。
15、 根据权利要求 13所述的编码器, 其中,
所述辅助信息包括所述视频图像的排序信息、 所述视频图像的帧图像和 场图像属性信息、 所述场图像的顶场或底场属性信息以及所述顶场或底场的 重复场标识中的一种或几种。
16、 根据权利要求 15所述的编码器, 其中,
所述辅助信息还包括所述视频图像的播放信息; 所述播放信息包括所述 视频图像的播放方式、 播放顺序和播放场率中的一种或几种。
17、 根据权利要求 13-16任一权利要求所述的编码器, 其中,
所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的 标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图 像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出的顶场或 底场将被重复播放的字段,所述重复场信息包括默认设定的重复场播放位置; 或者
表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场 信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式的字段、 表 示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像拆分出的顶 场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧图像拆分出 的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的顶场或底场 将被重复播放的字段。
18、 根据权利要求 17所述的编码器, 其中,
所述编码模块, 设置为: 根据所述辅助信息对所述场标识信息中各字段 的值进行设置; 其中, 对于需要重复播放的场图像, 将所述场标识信息中的 重复场标识字段的值设置为第一预定值, 将所述表示重复场信息的字段的值 设置为第二预定值; 或者, 所述编码器将所述场标识信息中的重复场标识字 段的值设置为所述第一预定值, 将所述表示重复场信息的字段的值设置为所 述第二预定值, 将表示重复场播放位置的字段设置为设定值。
19、 根据权利要求 18所述的编码器, 其中,
所述第一预定值为 "0" , 所述第二预定值为 "1" 。
20、 一种解码器, 该解码器包括: 解析模块, 设置为: 根据场标识信息的码流组织方法对读入的包含所述 场标识信息的码流进行解析;
发送模块, 设置为: 向控制器发送解析结果, 以便所述控制器根据所述 解析结果控制视频图像的播放。
21、 根据权利要求 20所述的解码器, 其中,
所述视频图像包括帧图像和场图像; 和 /或
所述场标识信息包含在补充增强信息 (SEI )单元中或视频可用性信息 ( VUI )单元中, 或者在一种新的信息单元中。
22、 根据权利要求 20或 21所述的解码器, 其中,
所述场标识信息包括: 表示场图像的顶场或底场属性的字段、 重复场的 标识字段、 表示重复场信息的字段、 表示帧图像播放方式的字段、 表示帧图 像拆分成顶场和底场后各场播放顺序的字段以及表示帧图像拆分出的顶场或 底场将被重复播放的字段,所述重复场信息包括默认设定的重复场播放位置; 或者
表示场图像的顶场或底场属性的字段、 重复场的标识字段、 表示重复场 信息的字段、 表示重复场播放位置的字段、 表示帧图像播放方式的字段、 表 示帧图像拆分成顶场和底场后各场播放顺序的字段、 表示帧图像拆分出的顶 场或底场是否将重复播放的字段、 各场播放顺序的字段、 表示帧图像拆分出
的顶场或底场是否将被重复播放的字段以及确定帧图像拆分出的顶场或底场 将被重复播放的字段。
23、 根据权利要求 22所述的解码器, 其中,
所述解析模块, 设置为: 根据场标识信息的码流组织方法解析出所述场 标识信息中各字段的值。
24、 根据权利要求 23所述的解码器, 其中,
所述发送模块, 设置为: 将所述解析模块解析出的所述各字段对应的控 制参数的值发送给控制器。
25、 一种包括权利要求 20-24任一权利要求所述的解码器的电子产品, 该电子产品还包括控制器, 所述控制器, 设置为: 接收所述解码器发送的解 析结果, 根据所述解析结果控制视频图像的播放。
26、 根据权利要求 25所述的电子产品, 其中,
所述控制器, 设置为: 接收所述解码器发送的控制参数的值, 根据所述 控制参数的值确定所述控制参数所指示的图像播放顺序和重复播放模式 , 以 及按照所述图像播放顺序和重复播放模式控制视频图像的播放。
27、 一种编解码装置, 包括编码器和解码器, 其中,
所述编码器釆用的是如权利要求 13-19任一权利要求所述的编码器, 所 述解码器釆用的是如权利要求 20-24任一权利要求所述的解码器。
28、 一种视频播放设备, 包括电子产品和编码器, 其中,
所述编码器釆用的是如权利要求 13-19任一权利要求所述的编码器, 所 述电子产品釆用的是如权利要求 25所述的电子产品。
29、 一种码流中帧场信息的标识方法, 该方法包括:
使用标识整个编码序列特征的指示信息将用于不同帧场播放应用相关的 标识信息划分成不同类型的信息组; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
30、 根据权利要求 29所述的方法, 其中, 包括:
所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
31、 根据权利要求 29所述的方法, 其中, 包括:
所述信息组标识了可用于对具有所述整个编码序列特征的码流的解码图 像的转换操作所需的信息。
32、 根据权利要求 31所述的方法, 其中, 包括:
所述转换操作将解码图像转换为用于播放的图像。
33、 根据权利要求 31或权利要求 32所述的方法, 其中, 包括: 所述信息组标识了可供所述转换操作完成直接将解码的帧图像作为所述 转换操作后的输出图像的信息; 或者
所述信息组标识了可供所述转换操作完成直接将解码的场图像作为所述 转换操作后的输出图像的信息; 或者
所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成两个场 图像、 并将这两个场图像作为所述转换操作后的输出图像的信息; 或者
所述信息组标识了可供所述转换操作完成将解码的帧图像拆分成三个场 图像、 并将这三个场图像作为所述转换操作后的输出图像的信息。
34、 根据权利要求 31或 32所述的方法, 其中, 包括:
所述信息组标识了可供所述转换操作完成将两个场图像合并成一个帧图 像、 并将这个帧图像作为所述转换操作后的输出图像的信息。
35、 根据权利要求 34所述的方法, 其中, 包括:
所述信息组标识了所述转换操作使用的场图像按照场图像播放顺序相对 于当前处理图像的位置信息。
36、 根据权利要求 31或 32所述的方法, 其中, 包括:
所述信息组标识了可供所述转换操作完成将场图像按照场图像播放顺序
在插入到指定位置操作的信息。
37、 根据权利要求 29所述的方法, 其中, 包括:
将所述信息组包含在补充增强信息( SEI )单元中或视频可用性信息( VUI ) 单元中, 或者在一种新的信息单元中。
38、 根据权利要求 37所述的方法, 其中, 包括:
将标识整个编码序列特征和 /或信源获取方法包含在所述信息组所在的 补充增强信息(SEI )单元中或视频可用性信息(VUI )单元中, 或者在一种 新的信息单元中。
39、 根据权利要求 38所述的方法, 其中, 包括:
所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。
40、 根据权利要求 38所述的方法, 其中, 包括:
将选择使用的一种且仅此选定的一种类型的所述信息组包含在编码序列 码流中。
41、 一种携带帧场信息的码流, 包括:
码流中, 标识整个编码序列特征的指示信息用于将不同帧场播放应用相 关的标识信息划分成不同类型的信息组; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
42、 根据权利要求 41所述的码流, 其中, 包括:
所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
43、 根据权利要求 41所述的码流, 其中, 包括:
所述信息组包含了可用于对具有所述整个编码序列特征的码流的解码图 像的转换操作所使用的信息。
44、 根据权利要求 43所述的码流, 其中, 包括:
所述转换操作将解码图像转换为用于播放的图像。
45、 根据权利要求 43或 44所述的码流, 其中, 包括:
所述信息组包含了可供所述转换操作完成直接将解码的帧图像作为所述 转换操作后的输出图像所需的信息; 或者
所述信息组包含了可供所述转换操作完成直接将解码的场图像作为所述 转换操作后的输出图像所需的信息; 或者
所述信息组包含了可供所述转换操作完成将解码的帧图像拆分成两个场 图像、 并将这两个场图像作为所述转换操作后的输出图像所需的信息; 或者 所述信息组包含了可供所述转换操作完成将解码的帧图像拆分成三个场 图像、 并将这三个场图像作为所述转换操作后的输出图像所需的信息。
46、 根据权利要求 43或 44所述的码流, 其中, 包括:
所述信息组包含了可供所述转换操作完成将两个场图像合并成一个帧图 像、 并将这个帧图像作为所述转换操作后的输出图像所需的信息。
47、 根据权利要求 46所述的码流, 其中, 包括:
所述信息组包含了所述转换操作使用的场图像按照场图像播放顺序相对 于当前处理图像的位置信息。
48、 根据权利要求 43或 44所述的码流, 其中, 包括:
所述信息组包含了可供所述转换操作完成将场图像按照场图像播放顺序 在插入到指定位置操作的信息。
49、 根据权利要求 41所述的码流, 其中, 包括:
所述信息组包含在补充增强信息( SEI )单元中或视频可用性信息( VUI ) 单元中, 或者在一种新的信息单元中。
50、 根据权利要求 49所述的码流, 其中, 包括:
包含所述信息组的补充增强信息( SEI )单元、或视频可用性信息( VUI ) 单元,或一种新的信息单元中还包含有整个编码序列特征和 /或信源获取方法 的标识信息。
51、 根据权利要求 50所述的码流, 其中, 包括:
所述信源获取方法包括: 逐行扫描方法和 /或隔行扫描方法。
52、 根据权利要求 50所述的码流, 其中, 包括:
一个编码序列码流中仅包含一种且仅此一种选定类型的所述信息组。
53、 一种携带帧场信息码流的使用方法, 该方法包括:
从所述码流的参数集中获得标识整个编码序列特征的指示信息; 根据所述指示信息,获得标识不同帧场播放应用相关标识信息的信息组; 根据所述信息组, 获得将解码图像转换为用于播放的图像的转换操作方法 和图像播放控制信息, 并进行相应的转换操作; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
54、 根据权利要求 53所述的方法, 其中, 包括:
所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
55、 根据权利要求 53所述的方法, 其中, 包括: 根据所述转换操作方法和图像播放控制信息, 直接将解码的帧图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息, 直接将解码的场图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成两 个场图像、 并将这两个场图像作为依次进行播放的图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成三 个场图像、 并将这三个场图像作为依次进行播放的图像。
56、 根据权利要求 53所述的方法, 其中, 包括:
根据所述转换操作方法和图像播放控制信息, 将两个场图像合并成一个 帧图像、 并将这个帧图像作为播放图像。
57、 根据权利要求 53所述的方法, 其中, 包括:
根据所述转换操作方法和图像播放控制信息, 获得所述场图像按照场图 像播放顺序相对于当前处理图像的位置信息; 根据所述位置信息,获得两个场图像,将两个场图像合并成一个帧图像、 并将这个帧图像作为播放图像。
58、 根据权利要求 53所述的方法, 其中, 包括:
根据所述转换操作方法和图像播放控制信息, 将场图像按照场图像播放 顺序在插入到指定位置, 并将所述场图像作为所述插入位置的播放图像。
59、 根据权利要求 53所述的方法, 其中, 包括:
解析在补充增强信息(SEI )单元、 或视频可用性信息(VUI )单元、 或 者一种新的信息单元获得所述信息组的信息。
60、 一种使用携带帧场信息码流的装置, 该装置包括:
第一处理单元, 设置为: 从所述码流的参数集中获得标识整个编码序列 特征的指示信息;
第二处理单元, 设置为: 根据所述指示信息, 获得标识不同帧场播放应 用相关标识信息的信息组;
第三处理单元, 设置为: 根据所述信息组, 获得将解码图像转换为用于 播放的图像的转换操作方法和图像播放控制信息, 并进行相应的转换操作; 其中,
所述整个编码序列特征为序列中图像类型, 所述图像类型包括场图像和 帧图像;
所述指示信息位于参数集中。
61、 根据权利要求 60所述的装置, 其中, 包括:
所述场图像是一种通过隔行扫描得到的图像;
所述帧图像是一种通过逐行扫描得到的图像。
62、 根据权利要求 60所述的装置, 其中, 包括: 所述第三处理单元设置 为:
根据所述转换操作方法和图像播放控制信息, 直接将解码的帧图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息, 直接将解码的场图像作为 播放图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成两 个场图像、 并将这两个场图像作为依次进行播放的图像; 或者
根据所述转换操作方法和图像播放控制信息 , 将解码的帧图像拆分成三 个场图像、 并将这三个场图像作为依次进行播放的图像。
63、 根据权利要求 60所述的装置, 其中, 包括:
所述第三处理单元设置为:根据所述转换操作方法和图像播放控制信息, 将两个场图像合并成一个帧图像、 并将这个帧图像作为播放图像。
64、 根据权利要求 60所述的装置, 其中, 包括: 所述第三处理单元设置 为:
根据所述转换操作方法和图像播放控制信息, 获得所述场图像按照场图 像播放顺序相对于当前处理图像的位置信息;
根据所述位置信息,获得两个场图像,将两个场图像合并成一个帧图像、 并将这个帧图像作为播放图像。
65、 根据权利要求 60所述的装置, 其中, 包括:
所述第三处理单元设置为:根据所述转换操作方法和图像播放控制信息, 将场图像按照场图像播放顺序在插入到指定位置, 并将所述场图像作为所述 插入位置的播放图像。
66、 根据权利要求 60所述的方法, 其中, 包括:
所述第二处理单元设置为: 在补充增强信息(SEI )单元、 或视频可用性 信息 (VUI )单元、 或者一种新的信息单元中获得所述信息组的信息。
67、 一种装置, 包括电子产品, 包括:
所述电子产品釆用的是如权利要求 29-40任一权利要求所述码流中帧场 信息的标识方法。
68、 一种装置, 包括电子产品, 包括:
所述电子产品产生如权利要求 41-52任一权利要求所述的码流。
69、 一种装置, 包括电子产品, 包括:
所述电子产品釆用的是如权利要求 53-59任一权利要求所述的携带帧场 信息码流的使用方法。
70、 一种设备, 包括电子产品, 包括:
所述电子产品釆用的是如权利要求 60-66任一权利要求所述的装置。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210094406.1A CN103369314B (zh) | 2012-04-01 | 2012-04-01 | 帧场信息的编码方法及解码方法、编码器和解码器 |
CN201210094406.1 | 2012-04-01 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013149522A1 true WO2013149522A1 (zh) | 2013-10-10 |
Family
ID=49299970
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2013/071826 WO2013149522A1 (zh) | 2012-04-01 | 2013-02-25 | 帧场信息的编码方法及解码方法、编码器和解码器 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN103369314B (zh) |
WO (1) | WO2013149522A1 (zh) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107810631A (zh) * | 2015-06-16 | 2018-03-16 | Lg电子株式会社 | 广播信号发送装置、广播信号接收装置、广播信号发送方法和广播信号接收方法 |
CN108307237A (zh) * | 2018-01-19 | 2018-07-20 | 西安万像电子科技有限公司 | 显示数据的传输方法、装置和系统 |
WO2023184206A1 (en) * | 2022-03-30 | 2023-10-05 | Intel Corporation | Enhanced presentation of tiles of residual sub-layers in low complexity enhancement video coding encoded bitstream |
CN118474455A (zh) * | 2024-07-11 | 2024-08-09 | 深圳市江元科技(集团)有限公司 | 一种自动生成视频并循环播放演示的方法、系统及介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6118491A (en) * | 1997-02-20 | 2000-09-12 | Lsi Logic Corporation | System and method for enforcing interlaced field synchronization in the presence of broken alternation in an MPEG video datastream |
CN1950907A (zh) * | 2004-04-28 | 2007-04-18 | 松下电器产业株式会社 | 运动画面流产生装置,运动画面编码装置,运动画面多路复用装置和运动画面解码装置 |
US7420616B2 (en) * | 2004-12-07 | 2008-09-02 | Lsi Corporation | Video encoder with repeat field to repeat frame conversion |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7106380B2 (en) * | 2001-03-12 | 2006-09-12 | Thomson Licensing | Frame rate multiplier for liquid crystal display |
KR101273479B1 (ko) * | 2005-07-06 | 2013-06-14 | 톰슨 라이센싱 | 화상 시퀀스 및 로고를 포함하는 비디오 콘텐츠를 코딩하는 방법 및 디바이스 |
CN101009840A (zh) * | 2006-01-24 | 2007-08-01 | 扬智科技股份有限公司 | 对一视讯码流译码及显示的方法 |
CN1925616B (zh) * | 2006-09-14 | 2010-05-12 | 清华大学 | 一种宏块对级帧场自适应编解码方法 |
CN101291434A (zh) * | 2007-04-17 | 2008-10-22 | 华为技术有限公司 | 多视编解码方法及装置 |
CN101094408A (zh) * | 2007-07-20 | 2007-12-26 | 中兴通讯股份有限公司 | 一种通过分片场编码实现编码的方法 |
CN101635856B (zh) * | 2009-08-24 | 2012-01-11 | 杭州华三通信技术有限公司 | 场编码方法及装置 |
CN101783958B (zh) * | 2010-02-10 | 2011-10-05 | 中国科学院计算技术研究所 | Avs视频标准中时域直接模式运动矢量的计算方法和装置 |
-
2012
- 2012-04-01 CN CN201210094406.1A patent/CN103369314B/zh active Active
-
2013
- 2013-02-25 WO PCT/CN2013/071826 patent/WO2013149522A1/zh active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6118491A (en) * | 1997-02-20 | 2000-09-12 | Lsi Logic Corporation | System and method for enforcing interlaced field synchronization in the presence of broken alternation in an MPEG video datastream |
CN1950907A (zh) * | 2004-04-28 | 2007-04-18 | 松下电器产业株式会社 | 运动画面流产生装置,运动画面编码装置,运动画面多路复用装置和运动画面解码装置 |
US7420616B2 (en) * | 2004-12-07 | 2008-09-02 | Lsi Corporation | Video encoder with repeat field to repeat frame conversion |
Also Published As
Publication number | Publication date |
---|---|
CN103369314A (zh) | 2013-10-23 |
CN103369314B (zh) | 2018-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101442278B1 (ko) | 정보 처리 장치 및 방법 | |
KR101426097B1 (ko) | 정보 처리 장치 및 방법과, 프로그램 | |
JP3228874B2 (ja) | 圧縮ディジタルビデオビットストリーム分割方法及び装置、並びにその復号方法及び装置 | |
US8810628B2 (en) | Image processing apparatus and image processing method | |
JP2014523207A (ja) | ワイヤレス3dストリーミングサーバ | |
US8953511B2 (en) | Fast channel switching in TV broadcast systems | |
US20170127076A1 (en) | Method for signaling a gradual temporal layer access picture | |
US10283167B2 (en) | Image decoding device, image decoding method, image encoding device, and image encoding method | |
US8675140B2 (en) | Playback apparatus for playing back hierarchically-encoded video image data, method for controlling the playback apparatus, and storage medium | |
CN107251551B (zh) | 图像处理设备、图像捕获装置、图像处理方法和存储介质 | |
CN109640162B (zh) | 码流转换方法及系统 | |
JP2013527676A (ja) | 三次元映像データを符号化する方法及びその装置、並びに復号化方法及びその装置 | |
WO2013149522A1 (zh) | 帧场信息的编码方法及解码方法、编码器和解码器 | |
JP2017121010A (ja) | 送信装置、送信方法、受信装置および受信方法 | |
JP4408801B2 (ja) | 画像データのコーデック変換装置及びその方法 | |
KR101584111B1 (ko) | 클라우드 컴퓨팅을 이용한 멀티미디어 서비스 품질 향상 방법 및 이를 위한 기기 | |
KR100368301B1 (ko) | 동영상 메일 시스템 및 방법 | |
CN115988171B (zh) | 一种视频会议系统及其沉浸式布局方法和装置 | |
US8184660B2 (en) | Transparent methods for altering the video decoder frame-rate in a fixed-frame-rate audio-video multiplex structure | |
JP2008060767A (ja) | 映像処理方法、映像処理プログラムおよび映像処理装置、ならびに、再生方法、再生プログラムおよび再生装置 | |
CN114501070A (zh) | 视频会议同步额外信息的编解码方法、处理方法和系统 | |
JP5048944B2 (ja) | 動画像処理装置 | |
JP4289055B2 (ja) | トランスコーダおよびこれを用いた記録再生装置 | |
JPWO2004034616A1 (ja) | 放送データ送受信システム及び放送データ送受信方法 | |
JP4320509B2 (ja) | 映像再符号化装置および方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13773057 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13773057 Country of ref document: EP Kind code of ref document: A1 |