WO2004110072A1 - Dispositif et procede pour conversion de format et melange de signal video - Google Patents

Dispositif et procede pour conversion de format et melange de signal video Download PDF

Info

Publication number
WO2004110072A1
WO2004110072A1 PCT/CN2003/000446 CN0300446W WO2004110072A1 WO 2004110072 A1 WO2004110072 A1 WO 2004110072A1 CN 0300446 W CN0300446 W CN 0300446W WO 2004110072 A1 WO2004110072 A1 WO 2004110072A1
Authority
WO
WIPO (PCT)
Prior art keywords
format
image data
sampling
chroma
main
Prior art date
Application number
PCT/CN2003/000446
Other languages
English (en)
Chinese (zh)
Inventor
Tzuping Lin
Original Assignee
Mediatek Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mediatek Inc. filed Critical Mediatek Inc.
Priority to AU2003246127A priority Critical patent/AU2003246127A1/en
Priority to PCT/CN2003/000446 priority patent/WO2004110072A1/fr
Priority to CN03826420.XA priority patent/CN1778118A/zh
Priority to DE10394246T priority patent/DE10394246T5/de
Publication of WO2004110072A1 publication Critical patent/WO2004110072A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N11/00—Colour television systems
    • H04N11/06—Transmission systems characterised by the manner in which the individual colour picture signal components are combined
    • H04N11/20—Conversion of the manner in which the individual colour picture signal components are combined, e.g. conversion of colour television standards
    • H04N11/22—Conversion of the manner in which the individual colour picture signal components are combined, e.g. conversion of colour television standards in which simultaneous signals are converted into sequential signals or vice versa

Definitions

  • the invention provides a device and method for format conversion and mixing of image data, in particular, a method for converting image data having a low sampling frequency chroma format into image data having a high sampling frequency chroma format, and then Another device and method for mixing image data with high sampling frequency and chroma format to avoid data loss.
  • Background technique
  • Motion picture compression standard MPEG-1 and the new motion picture compression standard MPEG-2 are mainly used to play video signal data stored in digital storage media such as CD-ROM or DVD-ROM, such as movies and animations, or applications In high-definition digital televisions, its main function is image-based image compression technology.
  • the MPEG-1 standard is the first standard developed by the MPEG organization. The main goal is to compress a resolution of 320 X 240 and about 20 frames per second to 1.2 Mbps, and to compress stereo music at about 250 kbps. Combined together into a movie of about 1.5Mbps, stored it in a CD-ROM, and played it at 2x CD-Player.
  • the MPEG-2 standard is greatly improved.
  • MPEG-1 not only have significant improvements in picture and sound quality, but also multi-language, multi-language subtitles, multi-angle viewing, movie rating, and so on.
  • MPEG-2 is partially compatible with MPEG-1's sound compression method, and has added AAC (Advanced Audio Coding sound compression technology) with high compression ratio.
  • AAC Advanced Audio Coding sound compression technology
  • picture quality MPEG-2's picture resolution is improved To 720 X 480, and add some new compression methods and video signal sampling formats, in order to improve the picture clarity and provide a more effective compression rate.
  • “Compression” basically refers to the process of reducing the information capacity occupied by the content of an image or group of images by eliminating the redundant components present in the video signal data, and one of the characteristics of the video signal data is the spatially redundant component high.
  • the compression which is the process of so-called spatial redundancy removal, it is necessary to identify the important elements in the video signal data and remove the duplicate and less influential elements.
  • the human eye is more sensitive to changes in brightness and relatively less detectable to changes in chrominance. Therefore, MPEG-2 uses the color representation format of Luminance and Chrominance, Y Indicates the luminance value, C indicates the chrominance value (C includes CB and CR, which represent the first and second chrominance values, respectively).
  • the three primary color component signals 1, G, and B are converted into luminance.
  • MPEG-2 uses reducing chroma sampling to reduce the amount of signal.
  • 4: 2: 0 means that four luminances Y take one chroma CR—one chroma CB.
  • FIG. 1 is a schematic diagram of the distribution of luminance Y and chrominance C in an image plane 10 in a 4: 2 : 0 sampling format.
  • the image plane 10 includes a plurality of image elements 11 (or sampling points).
  • Each picture element 11 may include only luminance Y, chrominance CB, CR, or both luminance Y and chrominance CB, CR after sampling.
  • ⁇ represents the sampling point of luminance Y
  • X represents the sampling points of chrominance CB, CR
  • the entire image plane 10 can be visually composed of multiple lines (Line) 18 (to obtain a clear picture, the brightness Y sampling point ⁇ and chromaticity The sampling points X of CB and CR are shown separately in each picture element 11).
  • the # frequency of chroma C is only half of the luminance Y
  • the sampling frequency of chrominance C can be regarded as a quarter of the luminance Y.
  • FIG. 1 it can be more obvious in a block space 16 containing four luminance Y
  • the significance of the 4: 2: 0 sampling format is that four luminances Y correspond to one chromaticity C (one chromaticity CR—one chromaticity CB).
  • FIG. 2 is a schematic diagram of the distribution of luminance Y and chrominance C in another image plane 20 under a 4: 2: 2 sampling format.
  • the image plane 20 also includes a plurality of image elements 21 , and each image element 2 may include only luminance y, chroma CB, CR, or both luminance Y and chroma CB, CR after sampling, and the entire image plane 20
  • the view is composed of multiple lines (Eine) 28.
  • 0 represents a sampling point of luminance Y
  • X represents a sampling point of chroma CB, CR.
  • the brightness in the 4: 2: 2 sampling format The sampling frequency of Y is 13.5MHz, and the sampling frequencies of both chroma CR and CB are 6.75MHz.
  • FIG. 3 is a schematic diagram of the distribution of luminance Y and chrominance C in another image plane 30 in a 4: 4: 4 sampling format.
  • the image plane 30 ' is composed of multiple lines (Iine) 38 , and includes a plurality of image elements 31, each of which includes both luminance Y (sampling point 0) and chrominance CB, CR (sampling point X). Therefore, each image block space 36 includes four luminances Y, four chroma CRs, and four chroma CBs, that is, no chroma sampling reduction is performed.
  • the main-picture image data in a digital storage medium such as a CD-ROM or DVD-ROM adopts a 2: 0 sampling format
  • the sub-picture (SP-SP) in a DVD-ROM ) Image data and On-Screen Display (OSD) data are in 4: 4: 4 sampling format.
  • the MPEG-2 decoder pecodeir previously applied to DVD players uses an external video signal encoder (TV Encoder), and its interface must conform to the CCIR (now changed to the International Telecommunication Union (ITU) standard) specifications and be able to transmit 4: 2: 2 sampling format MPEG-2 image data, but the aforementioned sub-picture image data and screen image setting data with 4: 4: 4 sampling format cannot be transmitted, so the main picture must be transmitted to the video signal encoder before Interpolate into 4: 2: 2 format first. Therefore, when mixing the MPEG2 main screen image data in the 4: 2: 2 sampling format with the sub-picture image data in the 4: 4: 4 sampling format (Mix), the sub-picture having the 4: 4: 4 sampling format must first be mixed.
  • TV Encoder TV Encoder
  • the image data is first converted into the sub-picture image data in the 4: 2: 2 sampling format, and then mixed with the MPEG2 main picture image data in the 4: 2: 2 sampling format, and then the mixed image data can be transmitted from this interface channel.
  • image data processing methods and related structures to complete image data format conversion and mixing known technologies have appeared in some related literatures and patents.
  • US Patent No. 5,489,947 "On screen display arrangement for a digital video signal processing system", Cooper et al.
  • FIG. 4 is a functional block diagram of a known image data processing device 40.
  • the image data processing device 40 includes a main picture data receiving end 42, a pair of picture data receiving ends 44, a 4: 4: 4 to 4: 2: 2 format converter 46, a data mixing device 48, and an external video
  • the signal encoding module 50 (TV Encoding Module), the interface channel CI between the data mixing device 48 and the video signal encoding module 50 must comply with the CCIR (or ITU) specifications.
  • the main screen data receiving end 42 is used to receive a main screen image data with a 4: 2 : 2 sampling format, and as shown in FIG. 4, the main screen image data received with a 4: 2: 2 sampling format includes a main brightness Ym and a main chromaticity Cm.
  • FIG. 5 is a schematic diagram of the brightness and chromaticity of multiple image data in the transmitted data string in FIG. 4.
  • FIG. 5 shows the main brightness Ym and the main chroma Cm of the main screen image data with the 4: 2: 2 sampling format in FIG. 4 respectively.
  • the data strings are transmitted in time sequence in two different data channels.
  • the data string of Ym contains multiple main luminances YmO, Yml, Ym 2 obtained from different sampling points.
  • the data string of main chromaticity Cm contains multiple main luminances obtained from different sampling points.
  • Chroma CBmO, CRmO, CBm2, CRm2, ⁇ Since the basic concept of the 4: 2: 2 sampling format is that the sampling frequency of chroma C (CR, CB) is one-half of the luminance Y, it can be seen that the main The chrominances CBm0 and CRmO can be from the same sampling point, and correspond to the sampling points of the main luminance YmO, or the average of the main chroma of the surrounding sampling points.
  • the main chroma CBm2, CRm2, and main brightness Ym2 can be the average of the main chroma and main brightness from the same sampling point or the surrounding sampling points.
  • the sub-picture data receiving end 44 in FIG. 4 may be used to receive a sub-picture image data having a 4: 4: 4 sampling format, where the sub-picture image data having a 4: 4: 4 sampling format includes a pair of brightness Ys, a
  • the first sub-chroma CBs and a second sub-chroma CRs can be reconfirmed from FIG. 5 at the same time.
  • Each sampling point includes a sub-chroma Ys, a first sub-chroma CBs, and a second sub-chroma CRs.
  • a sub-chroma Ys a sub-chroma Ys
  • a first sub-chroma CBs a first sub-chroma CBs
  • a second sub-chroma CRs a second sub-chroma CRs.
  • the 4: 4: 4 to 4: 2: 2 format converter 46 is electrically connected to the sub-picture data receiving end 44, and the sub-picture image data with the 4: 4: 4 sampling format is deleted ( After down-sampling), it is converted into sub-picture image data in 4: 2: 2 sampling format.
  • This subtraction process is aimed at reducing the chroma sampling to achieve the effect of data reduction. Therefore, the sub-brightness Ys of the sub-picture image data that originally had the 4: 4: 4 sampling format is not affected at all, 4: 4: 4 to 4:
  • the 2: 2 format converter 46 mainly processes the first sub-chroma CBs and the second sub-chroma CRs.
  • the subtraction A method discards the first sub-chroma CBs or the second sub-chroma CRs sequentially at each sampling point.
  • the chroma CRsO, CBsl, CRs 2 , etc. are discarded to reduce Half the amount of data on chroma.
  • the rule of subtraction B is to completely discard the first sub-chroma CBs and second sub-chroma CRs of the sampling point every other sampling point, and then move the second sub-chroma CRs of the previous sampling point to the discarded sampling point. After consolidating into a complete continuous data string.
  • the sub-picture image data in the 4: 2: 2 sampling format generated after the reduction processing of the 4: 4: 4 to 4: 2: 2 format converter 46 can be regarded as including a (original) sub-luminance Ys, and A pair of chroma Cs, and the secondary chroma Cs can be regarded as a result obtained after the first sub-chroma CBs and the second sub-chroma CRs are processed by the foregoing subtraction A method or subtraction: B method.
  • a data mixing device 48 electrically connected to the 4: 4: 4 to 4: 2: 2 format converter 46 and the main screen data receiving end 42 can be used to combine the main screen image data with a 4: 2: 2 sampling format and have a 4: 2: 2 sampling format.
  • the mixed image data with a 4: 2: 2 sampling format includes a mixed luminance Yg and a mixed chrominance C g .
  • FIG. 5 also shows that the mixed luminance Yg and the mixed chrominance Cg are transmitted in time sequence in two different data channels, respectively. Situation.
  • the main screen data receiving end 42 of FIG. 4 may further include a 4: 2: 0 to 4: 2: 2 format converter 47, which is electrically connected to the main screen data receiving end 4 2 and may store one in a sampling format (in a Digital video discs, such as VCD or DVD, etc., convert the main screen digital image data into the aforementioned main screen image data with a 4: 2: 2 sampling format.
  • the connected video signal encoding module 50 includes a 4: 2: 2 to 4: 4: 4 format converter 49 and a video signal encoder 51CTV Encoder).
  • the video signal encoder 51 The image data must conform to the 4: 4: 4 sampling format, and the 4: 2: 2 to 4: 4: 4 format converter 49 can interpolate the transmitted mixed image data with the 4: 2: 2 sampling format ( After Up-sampling processing, mixed image data (including a mixed luminance Yg, a first mixed chrominance CBg, and a second mixed chrominance CR) having a 4: 4: 4 sampling format is generated, and finally encoded by a video signal the device 51 has a 4: 4: 4 sampling format mixing video data is converted into a television video signal Ts (TV video signal) 0
  • the format converter 49 performs interpolation processing, that is, in the process of reconstructing the first chroma CB and the second chroma CR of each sampling point, the chroma CRsO, CBsl, CRs2, etc. that were originally rounded will be The duplicated chroma CRsl, CBs2, CRs3,... etc. replace the backfill.
  • the main object of the present invention is to provide a device and method that can convert and mix multiple image data with different sampling formats (Sampling Foirmat :), so as to solve the problem.
  • an image data of a main screen with a 4: 2: 2 sampling format is interpolated.
  • Up-sampling becomes the main screen image data with 4: 4: 4 sampling format after processing, and then processes the main screen image data with 4: 4: 4 sampling format and a 4: 4: 4 sampling format.
  • the secondary screen image data is mixed to avoid the loss of some chromaticity information during the conversion of the 4: 4: 4 sampling format to the 4: 2: 2 sampling format by known technologies, resulting in color distortion, and thus can fully Taking advantage of a video signal encoder built into a DVD (or VCD) player chip system, it has a significant effect on improving the picture quality.
  • An object of the present invention is to provide a device for converting and mixing a plurality of video data, each of which has a plurality of sampling formats (Sampling Format :). Sampling frequency chrominance format and a low sampling frequency chrominance format.
  • the device includes a first data receiving end for receiving a first image data having the low sampling frequency chrominance format.
  • a second data receiving Terminal for receiving a second image data having the high sampling frequency chroma format; a format conversion module electrically connected to the first data receiving terminal for receiving the first image having the low sampling frequency chroma format After the data is processed by up-sampling, it becomes the first image data having the high sampling frequency chrominance format; and a data mixing device electrically connected to the format conversion module and the second data receiving end, for After mixing (Mix) the first image data having the high sampling frequency chroma format and the second image data having the high sampling frequency chroma format, a Mixing the high sampling frequency chrominance format video data.
  • Another object of the present invention is to provide an image data processing device, which includes a main frame data receiving end for receiving a main frame image data having a 4: 2 : 2 sampling format, wherein the main frame image data has a 4: 2: 2
  • the main screen image data in the sampling format includes a main luminance value (Luminance) and a main chrominance value (Chrominance);
  • a pair of screen data receiving ends is used to receive a sub screen image data with a 4: 4: 4 sampling format
  • the sub-picture image data with a 4: 4: 4 sampling format includes a pair of luminance values, a first pair of chrominance values, and a second pair of chrominance values;
  • a format conversion module electrically connected to the main screen data
  • the receiving end is used to process the main screen image data with a 4: 2: 2 sampling format into an main screen image data with a 4: 4: 4 sampling format after an Up-sampling process, where the The main screen image data in the 4: 4:
  • a data mixing device is electrically connected to the format conversion module and the auxiliary unit.
  • Another object of the present invention is to provide a method for converting and mixing a plurality of video data (Video Signal) to prevent data leakage.
  • the plurality of video data has multiple sampling formats, respectively. Format contains at least a high sampling frequency
  • the method includes receiving a first image data having the low sampling frequency chroma format and a second image data having the high sampling frequency chroma format;
  • the first image data having the low sampling frequency chroma format converts the first image data having the high sampling frequency chroma format; and the first image data having the high sampling frequency chroma format and the high sampling frequency color
  • a mixed image data having the high sampling frequency chrominance format is output.
  • the image data processing device includes a signal receiving module, a format conversion module, and a data mixing device.
  • the method includes using The signal receiving module receives a main screen image data with a 4: 2: 2 sampling format and a sub screen image data with a 4: 4: 4 sampling format; using the format conversion module to sample the data with 4: 2: 2 Format the main screen image data with the 4: 4: 4 sampling format; and use the data mixing device to convert the main screen image data with the 4: 4: 4 sampling format and the 4: 4 : 4 sub-picture image data After the mixing operation, a mixed image data with a 4: 4: 4 sampling format is output.
  • FIG. 1 is a schematic diagram showing the distribution of luminance and chrominance in an image plane under a 4: 2: 0 sampling format.
  • FIG. 2 is a schematic diagram showing the distribution of luminance and chrominance in an image plane in a 4: 2: 2 sampling format.
  • FIG. 3 is a schematic diagram showing the distribution of brightness and chrominance in an image plane in a 4 : 4: 4 sampling format.
  • FIG. 4 is a functional block diagram of a known image data processing.
  • FIG. 5 is a schematic diagram of brightness and chrominance of a plurality of image data in the transmitted data string in FIG. 4.
  • FIG. 6 is a functional block diagram of an embodiment of a device for converting and mixing multiple image data according to the present invention.
  • FIG. 7 is a functional block diagram of another embodiment of an apparatus for converting and mixing multiple image data according to the present invention.
  • FIG. 8 is a flowchart of a method embodiment of the present invention.
  • FIG. 9 is a flowchart of another method embodiment of the present invention.
  • FIG. 10 is a functional block diagram of an image data processing device according to an embodiment of the present invention during actual implementation.
  • FIG. 11 is a schematic diagram of brightness and chrominance of a plurality of image data in the transmission data string in FIG. 10.
  • FIG. 12 is a schematic diagram of an embodiment of the data mixing device in FIG. 10.
  • FIG. 13 is a functional block diagram of another embodiment of the image data processing apparatus in FIG. 10 when it is actually implemented.
  • FIG. 14 is a flowchart of another method embodiment of the present invention. DESCRIPTION OF SYMBOLS
  • FIG. 6 is a functional block diagram of an embodiment of a device 60 for converting and mixing a plurality of video data according to the present invention.
  • this embodiment includes two image data; a first image data IS1 and a second image data IS2, and the two image data may each have two sampling formats, including a high sampling frequency color. Chrominance format and a low sampling frequency chroma format.
  • the name of the two sampling formats shows that the sampling frequency of chroma for high sampling frequency chroma format is higher than that of low sampling frequency chroma format. For example, if Referring to the description of the basic concepts of chrominance sampling under the new motion image compression standards (MPEG-1, MPEG-2) in FIGS.
  • the device 60 includes a first data receiving end 62, a second data receiving end 64, a format conversion module 65, and a data mixing device 68.
  • the first data receiving end 62 is configured to receive a first image data IS1 having a low sampling frequency chroma format
  • the second data receiving end 64 is configured to receive a second image data IS2 having a high sampling frequency chroma format.
  • the format conversion module 65 is electrically connected to the first data receiving end 62, and is used to process the first image data IS1 with a low sampling frequency chroma format into an chroma format with a high sampling frequency after an up-sampling process.
  • the interpolation process of the first image data IS1 ′ is described in detail in the following description and embodiments.
  • the data mixing device 68 is electrically connected to the format After the conversion module 65 and the second data receiving end 64 are used to mix (Mk) the first image data ISr having a high sampling frequency chroma format and the second image data IS2 having a high sampling frequency chroma format, and output A mixed image data ISg with a high sampling frequency chroma format completes the conversion and mixing of image data with two different sampling frequency chroma formats.
  • Jason It is recommended to change IS1 in the high-sampling-frequency chroma format of Figure 6 to ISr to facilitate identification
  • the device 60 of the embodiment of FIG. 6 discloses one of the important technical features of the present invention, which is to convert an image data (first image data IS1) with a low sampling frequency chroma format into a high sampling frequency chroma Format image data (first image data isr), and then mix it with another image data (second image data IS2) with high sampling frequency chrominance format.
  • first image data IS1 first image data IS1
  • second image data IS2 second image data
  • the conversion process from "high sampling frequency chroma format to low sampling frequency chroma format" occurs, that is, there is no need to discard any chroma-related data, so there will be no loss of chroma data.
  • the number of image data does not need to be limited to two as in this embodiment.
  • FIG. 7 is a functional block diagram of another embodiment of a device 70 for converting and mixing multiple image data according to the present invention.
  • the device 70 of the embodiment of FIG. 7 is substantially similar to the device 60 of the embodiment of FIG.
  • the device 70 in FIG. 7 also includes a first data receiving end 72 , a first data receiving end 74 , a format conversion module 75, and a data mixing device "78.
  • the receiving end 72 receives a first image data IS1 having a low sampling frequency chroma format, and uses the first data receiving end 74 to receive a second image data IS2 having a high sampling frequency chroma format, and uses the format conversion module 75 to have a low
  • the first image data IS1 of the sampling frequency chroma format is converted into the first image data IS1 'of the high sampling frequency chroma format.
  • the data mixing device 78 is used to convert the first image number isr
  • the second image data IS2 having a high sampling frequency chroma format mixes and outputs a mixed image data ISgo having a high sampling frequency chroma format
  • the format conversion module 75 shown in FIG. 7 is constituted by a first intermediate format converter 73 and a second intermediate format converter 76, and this two image data (first image data and second IS1 Two image data IS2) not only have two sampling formats (high sampling frequency chroma format and low sampling Frequency chroma format), and also includes a sampling frequency chroma format, where the sampling frequency chroma format sampling frequency is between the high sampling frequency chroma format and the low sampling frequency chroma format
  • the high sampling frequency chroma format can correspond to 4: 4: 4
  • the sampling format, the medium sampling frequency chroma format may correspond to the 4: 2 : 2 sampling format, and the low sampling frequency chroma format may correspond to the 4: 2: 0 sampling format.
  • the setting of the first and second intermediate format converters "76" represents that the format conversion process of the first image data IS1 is a two-stage process. After a first post-interpolation process, to become the first video data IS1 "chroma format having the sampling frequency, and the second intermediate format converter 76 is electrically connected to the first intermediate format converter 73, is used to having the The first image data isi "of the sampling frequency chrominance format is processed by a second interpolation to become the first image data isr having a high sampling frequency chrominance format.
  • the principles of the first and second interpolation processing are the same as the aforementioned interpolation. The same processing is performed in the same way, which will be described in detail later. Please note that, as described in the embodiment of FIG.
  • the number of image data processed by the present invention is not limited, and the number of types of sampling formats is not limited. Before mixing multiple image data with different sampling frequency chrominance formats, all of them are converted to one of the highest sampling frequency chrominance formats to avoid conversion in high sampling frequency chrominance formats. The loss of chroma data during the low-sampling frequency chroma format is consistent with the technical features of the present invention.
  • the device 70 of this embodiment further includes a video signal encoder 71 (TV Encoder), which is electrically connected to the data mixing device 78 After that, it can be used to convert the mixed image data ISg with a high chroma sampling format into a TV Video Signal Ts.
  • TV Encoder TV Encoder
  • FIG. 8 is a method of the present invention.
  • Step 100 Receive a first image data IS1 having a low sampling frequency chroma format and a second image data IS2 having a high sampling frequency chroma format, respectively.
  • Step 101 Convert the first image data IS1 having a low sampling frequency chroma format into the first image data isr having a high sampling frequency chroma format.
  • Step 102 After mixing the first image data IS with a high sampling frequency chroma format and the second image data IS2 with a high sampling frequency chroma format, output a chroma grid with high sampling frequency Mixed image data ISg;
  • FIG. 9 is a flowchart of another method embodiment of the present invention.
  • Step 200 Receive a first image data IS1 having a low sampling frequency chroma format and a second image data IS2 having a high sampling frequency chroma format, respectively.
  • Step 201 Convert the first image data IS1 having a low sampling frequency chroma format into the first image data IS1 having a high sampling frequency chroma format.
  • Step 202 Convert the first image data IS1 having a low sampling frequency chroma format into the first image data isr having a high sampling frequency chroma format.
  • Step 203 After mixing the first image data ISr with a high sampling frequency chroma format and the second image data IS2 with a high sampling frequency chroma format, output a mixed image data ISg with a high sampling frequency chroma format;
  • the mixed image data ISg having a high chroma sampling format is converted into a television video signal signal.
  • the devices 60 and 70 shown in FIG. 6 and FIG. 7 are applied to a new type of moving image compression standard (MPEG-1, MPEG-2) and JPEG decoder (Decoder), so
  • the aforementioned first image data IS1, second image data IS2, mixed image data ISg, high sampling frequency chroma format, medium sampling frequency chroma format, and low sampling frequency chroma sampling all conform to MPEG-1 and MPEG-2 Specifications (of which three (low, medium, high) sampling frequency chroma formats can correspond to the 4: 2 : 0 sampling format, 4: 2 : 2 sampling format, and 4: 4 shown in Figures 1 to 3, respectively.
  • the first image data IS1 may correspond to a main-picture image data of a digital video disc (VCD and DVD) format
  • the second image data IS2 may correspond to a sub-image of a digital video disc format.
  • SP Picture-Picture
  • FIG. 10 is a functional block diagram of an embodiment of an image data processing device 80 in actual implementation of the present invention, and can be regarded as a detailed embodiment of the embodiment of FIG. 6.
  • the image data processing device 80 includes a main picture data receiving end 82, a pair of picture data receiving ends 84, a format conversion module 85, a data mixing device 88, and a video signal encoder 81.
  • the main picture data receiving end 82 may receive a main picture image data having a 4: 2: 2 sampling format, the same as
  • the sub-picture data receiving end 84 receives a sub-picture image data having a 4: 4: 4 sampling format.
  • the format conversion module 85 is electrically connected to the main screen data receiving end 82, and is used for converting the main screen image data having a 4: 2: 2 sampling format into the main screen image data having a 4: 4: 4 sampling format after interpolation processing. Therefore, the format conversion module 85 can be regarded as a 4: 2 : 2 to 4: 4: 4 format converter.
  • the main screen image data with a 4: 4: 4 sampling format will be transmitted to the data mixing device 88, and after a mixing operation (Mixing Opemtion) with the sub screen image data with a 4: 4: 4 sampling format, a 4: 4: 4 Mixed image data in sampling format.
  • the video signal encoder 81 electrically connected to the data mixing device 88 can convert the mixed image data with a 4: 4: 4 sampling format into a TV Video Signal.
  • the main screen image data with 4: 2: 2 sampling format includes a main brightness
  • the sub-picture image data having a 4: 4: 4 sampling format includes a pair of luminance Ys, a first pair of chroma Ysb, and a second pair of chroma Ysr
  • the main screen image data having a 4: 4: 4 sampling format includes a main luminance Ym, a first main chroma CBm, and a second main chroma CRm.
  • the first main chroma CBm and the second main chroma CRm are generated by the format conversion module 85 after the main chroma Cm is interpolated. Please refer to FIG. 11.
  • FIG. 11 FIG.
  • FIG. 11 is a schematic diagram of brightness and chrominance of a plurality of image data in the transmitted data string in FIG. 10.
  • the main luminance Ym data string contains multiple main luminances YmO, Yml, Ym2, ... obtained from different sampling points, and because the basic concept of the 4: 2: 2 sampling format is chrominance C (CR, CB)
  • the sampling frequency is one-half of the luminance Y. Therefore, it can be seen that among the plurality of main chromaticities CBmO, CRmO, CBm2, CRm2, ...
  • the main chromaticities CBm0, CRmO come from the same sampling point, And corresponding to the sampling point of the main luminance YmO, the main chroma CBm2, CRm2 and the main luminance Ym2 are from the same sampling point.
  • the aforementioned interpolation process is to use a mathematical combination to double the sampling frequency of the main chromaticity Cm. Please refer to FIG. 11.
  • the above numerical combination can be completed by a linear combination. Taking the newly added first main chromaticity CBma as an example, it can use the remaining first main chromaticities CBmO, CBm2, CBm4, ⁇ ⁇ ⁇ The components of.
  • CBma A-2 (nl) X CBm-2 (n- l) + '"+ A-2 X CBm- 2 + A0 X CBmO + A2 X CBm2 + ⁇ ' ⁇ + A2n X CBm2n, where A-2 (n-1), ⁇ A-2, AO, A2, ⁇
  • the A2n are all constants, which respectively represent their corresponding main colors
  • the proportion of the newly added first main chroma CBma is usually closer to the proportion of the newly added first main chroma CBma. For example, as shown in FIG.
  • other first primary chromaticities and second primary chromaticities (such as CRma, CBmb, Crmb, etc. shown in FIG. 11) that need to be added can be generated by a method similar to or the same as the above.
  • the mixed image data having a 4: 4: 4 sampling format generated by the data mixing device 88 has a mixed luminance Yg, a first mixed chrominance CBg, and a second mixed chrominance CRg.
  • the mixing operation performed by the data mixing device 88 is to combine the main luminance Ym, the first main chroma CBm, and the second main chroma CRm with the sub luminance Ys, the first sub chroma CBs, and the second sub chroma CRs respectively.
  • the mixed brightness Yg, the first mixed chromaticity CBg, and the second mixed chromaticity CRg are generated. Please refer to FIG. 12, FIG. 12, FIG.
  • FIG. 12 is a schematic diagram of an embodiment of the data mixing device 88 of FIG.
  • the main technical feature of the data mixing device 88 is that the sub-picture image data and the main-picture image data are mixed to become complete image data.
  • FIG. 13 is a functional block diagram of another embodiment of the image data processing apparatus 80 of FIG. 10 in actual implementation.
  • the 13 includes a 4: 2 ⁇ 0 to 4: 2: 2 format converter 87 and a 4: 2: 2 to 4: 4: 4 format converter 89, 4: 2:
  • the 0 to 4: 2: 2 format converter 87 can convert a main screen digital image data stored in a 4: 2: 0 sampling format (in a digital movie, such as a VCD or DVD, etc.) into the aforementioned 4: 2:
  • the main screen image data in the 2 sampling format is then interpolated by the 4: 2: 2 to 4: 4: 4 format converter 89 to the main screen image data in the 4: 4: 4 sampling format.
  • Step 300 Receive a main screen image data with a 4: 2: 2 sampling format and a
  • Step 301 Convert the main screen image data with a 4: 2: 2 sampling format into the main screen image data with a 4: 4: 4 sampling format;
  • Step 302 After mixing the main screen image data with a 4: 4: 4 sampling format and the sub screen image data with a 4: 4: 4 sampling format, output a mixed image data with a 4: 4: 4 sampling format;
  • Step 303 Convert the mixed image data having a 4: 4: 4 sampling format into a television video signal signal.
  • the image data entering this known video signal encoder must be It conforms to the 4: 2: 2 sampling format.
  • the image data processing device 80 in FIG. 10 and FIG. 13 can set a 4: 4: 4 to 4: 2: 2 format converter after the data mixing device 88, so that the user can switch between them. . It can be known from the above-mentioned embodiments that based on today's new dynamic image compression standards
  • the main technical feature of the present invention is the sub-picture image data Before mixing with the main screen image data, both of the two image data are guaranteed to have a 4: 4: 4 sampling format (the highest sampling frequency chroma format), instead of the two as shown in the known technology of the embodiment of FIG. 4
  • the image data is mixed in the 2: 2 sampling format to avoid the loss of some chrominance information during the conversion of the sub-picture image data from the 4: 4: 4 sampling format to the 4: 2 : 2 sampling format, resulting in Distortion of colors.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne un procédé de conversion et de mélange de données vidéo multiples dans dispositif de traitement de données vidéo. Les données ont respectivement plusieurs formats d'échantillonnage, à savoir un format de chrominance de fréquence d'échantillonnage élevée et basse, au moins. Le procédé comprend les étapes suivantes : réception de premières données vidéo à format de chrominance de fréquence d'échantillonnage basse et de secondes données vidéo à format de chrominance de fréquence d'échantillonnage élevée, respectivement, échantillonnage montant sur les premières données pour passer en format de chrominance de fréquence d'échantillonnage élevée, et mélange avec les secondes données, puis sortie de données mélangées en format de chrominance de fréquence d'échantillonnage élevée.
PCT/CN2003/000446 2003-06-06 2003-06-06 Dispositif et procede pour conversion de format et melange de signal video WO2004110072A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AU2003246127A AU2003246127A1 (en) 2003-06-06 2003-06-06 Apparatus and method for format converting and mixing video signal
PCT/CN2003/000446 WO2004110072A1 (fr) 2003-06-06 2003-06-06 Dispositif et procede pour conversion de format et melange de signal video
CN03826420.XA CN1778118A (zh) 2003-06-06 2003-06-06 用于影像信号的格式转换及混合的装置与方法
DE10394246T DE10394246T5 (de) 2003-06-06 2003-06-06 Vorrichtung und Verfahren zur Signalverarbeitung einer Formatumwandlung und Kombination von Videosignalen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2003/000446 WO2004110072A1 (fr) 2003-06-06 2003-06-06 Dispositif et procede pour conversion de format et melange de signal video

Publications (1)

Publication Number Publication Date
WO2004110072A1 true WO2004110072A1 (fr) 2004-12-16

Family

ID=33494596

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2003/000446 WO2004110072A1 (fr) 2003-06-06 2003-06-06 Dispositif et procede pour conversion de format et melange de signal video

Country Status (4)

Country Link
CN (1) CN1778118A (fr)
AU (1) AU2003246127A1 (fr)
DE (1) DE10394246T5 (fr)
WO (1) WO2004110072A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2501535A (en) * 2012-04-26 2013-10-30 Sony Corp Chrominance Processing in High Efficiency Video Codecs

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1070739A (ja) * 1996-05-29 1998-03-10 Sgs Thomson Microelectron Sa 双方向メニューの挿入を伴うデジタルテレビジョン信号の変換用システム
WO2000002384A2 (fr) * 1998-07-06 2000-01-13 Koninklijke Philips Electronics N.V. Compression de donnees d'image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1070739A (ja) * 1996-05-29 1998-03-10 Sgs Thomson Microelectron Sa 双方向メニューの挿入を伴うデジタルテレビジョン信号の変換用システム
WO2000002384A2 (fr) * 1998-07-06 2000-01-13 Koninklijke Philips Electronics N.V. Compression de donnees d'image

Also Published As

Publication number Publication date
DE10394246T5 (de) 2006-05-04
AU2003246127A1 (en) 2005-01-04
CN1778118A (zh) 2006-05-24

Similar Documents

Publication Publication Date Title
JP4375837B2 (ja) デジタルオーディオ／ビデオシステム及びその方法
EP0662770B1 (fr) Appareil et procede de codage/decodage de donnees de sous-titres
US7880808B2 (en) Video signal processing apparatus to generate both progressive and interlace video signals
TWI324485B (en) Video processing and optical recording
JP4996725B2 (ja) 映像処理装置
TWI229562B (en) Apparatus and method for signal processing of format conversion and combination of video signals
JPH10313445A (ja) 画像信号変換装置およびそれを使用したテレビ受信機、並びにそれに使用される係数データの生成装置および生成方法
RU2507584C2 (ru) Устройство обработки изображения, способ обработки изображения и система передачи данных
CN107396002B (zh) 一种视频图像的处理方法及移动终端
JPH0759058A (ja) ディジタル画像信号伝送装置
JP4543926B2 (ja) 情報処理装置および方法
US8005338B2 (en) Recording and reproducing device
US20040136697A1 (en) Apparatus and method for recording multimedia data with high efficiency
WO2004110072A1 (fr) Dispositif et procede pour conversion de format et melange de signal video
JP3703088B2 (ja) 拡張画像符号化装置及び拡張画像復号化装置
JPH07135635A (ja) 映像信号処理装置
JP2011055485A (ja) 映像処理装置
JP2009038682A (ja) 画像処理装置及び画像処理方法
US7450831B2 (en) Method for DVD-subpicture compositing in 420 chroma format
JP4960463B2 (ja) 映像信号処理装置及び映像信号処理方法
JP4063158B2 (ja) 画像合成装置及び方法、並びに画像再生装置
JP2001223989A (ja) 画像再生装置
JP2000324488A (ja) 静止画伝送方法及び再生方法
JP2000181418A (ja) 画像処理装置及び方法、並びに提供媒体
JPH11317941A (ja) 画像処理装置及び方法、並びに提供媒体

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2003826420X

Country of ref document: CN

RET De translation (de og part 6b)

Ref document number: 10394246

Country of ref document: DE

Date of ref document: 20060504

Kind code of ref document: P

WWE Wipo information: entry into national phase

Ref document number: 10394246

Country of ref document: DE

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8607