Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
  • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
  • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
  • H04N7/012—Conversion between an interlaced and a progressive signal
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
  • H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/12—Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal

Definitions

• the present invention generally relates to low bit rate transmissions and, more particularly, to a method and apparatus for providing format conversion of video to enable low bit rate compression of non-progressive video.
• Video fields are sometimes interlaced to enable serial video bit streams to be sent over networks. Interlacing includes sending alternating fields of video successively over a link. Video streams may be identified as progressive or non- progressive. Progressive video includes pairs of successive fields where there is no
• Non-progressive video can include fields where there is object motion between successive pairs of fields.
• Progressive frames can easily be format converted; however, format converting non-progressive video does not enjoy the same capability. Instead, non-progressive video is much more difficult to format convert without significant loss in vertical resolution.
• One approach to this downconverting is to use intra-field interpolation to convert 240-line incoming fields to 120-line fields.
• the resulting 240 interlaced (240i) video is compressed, transmitted, and decompressed.
• the 240i video is then intra- field converted by vertical interpolation to 240-line fields of a 480i signal and displayed.
• the vertical resolution suffers, especially in comparison to 240
• Diagonal edges of moving objects are jagged, as well.
• a method for format conversion includes providing a first interlaced video signal including non-progressive video of a first resolution, downconverting fields of the first resolution to fields of a second resolution, and combining and interlacing the fields at a third resolution.
• the video signal is transmitted at the third resolution.
• the video signal of the third resolution is deinterlaced to form a progressive format video.
• the progressive format video is converted to the first non-progressive resolution by alternately adjusting position of the progressive format of the third resolution up and down to make upper and lower fields, respectively, of the first resolution for display.
• the step of deinterlacing the non-progressive video signal to a progressive format having the first resolution may be included.
• a jagged diagonal reduction method may be employed to perform deinterlacing.
• a system for format conversion includes a conversion device, which deinterlaces a non-progressive interlaced video signal having a first resolution to a progressive format having the same resolution.
• the conversion device downconverts the progressive format to a second resolution and combines and interlaces fields of the second resolution to provide frames at a third resolution.
• a transmission link is coupled to the conversion device for transmitting the video signal at the third resolution.
• a reconversion device is coupled to the output of the transmission link. The reconversion device deinterlaces the video stream of the third resolution as a progressive format video and converts the progressive format video to alternating upper field lines and lower field lines for display at the first resolution.
• FIG. 1 is block diagram showing an illustrative preprocessing sequence for format conversion in accordance with the present invention
• FIG. 2 is a block diagram showing block 12 in greater detail in accordance with 0 one embodiment of the present invention.
• FIG. 3 is a block diagram showing blocks 16 and 18 in greater detail in accordance with one embodiment of the present invention.
• FIG. 4 is a block diagram showing an illustrative postprocessing sequence for format conversion in accordance with the present invention
• FIG. 5 is a diagram illustratively showing adjustment of line positions in step 34 in accordance with the present invention
• FIG. 6 is a diagram illustratively showing a jagged diagonal reduction method/algorithm employed in accordance with the present invention.
• FIG. 7 is a diagram of an illustrative format conversion system in accordance with the present invention.
• the present invention provides a method and system for format converting a video to permit compression for a low bit rate stream.
• the present invention permits incoming non-progressive video to be deinterlaced and downconverted to fields to provide interlaced video with VT. resolution, for example, the vertical resolution.
• the 1 resolution interlaced video is compressed, transmitted, and decompressed.
• the 1 resolution interlaced video is then deinterlaced to a progressive format, and the progressive format video is converted to alternating upper fields and lower fields for display on conventional TV set or display monitor.
• the present invention is described in terms of a 2:1 resolution reduction, the vertical resolution reduction may be reduced by other ratios, for example, a 4:1 reduction.
• the present invention is described in terms of a conventional 480-line interlaced (480i) video system; however, the present invention is much broader and may include any video formats or sizes, which are capable of delivery over a wired or wireless network.
• 480i 480-line interlaced
• incoming non-progressive 480i video is deinterlaced and downconverted to 120-line fields to make 240i video.
• the 240i video is compressed, transmitted, and decompressed.
• the 240i video is then deinterlaced to 240p.
• the 240p is converted to alternating 240-line upper field and 240-line lower field to make 480i for display on, for example, a conventional TV set.
• the present invention is applicable to any system including video delivery systems over the telephone, set top boxes, computer, satellite links, Internet, etc.
• the present invention is particularly useful in video on-demand applications, which may be implemented on a digital subscriber line (DSL) network or other systems with medium bit rate channels.
• DSL digital subscriber line
• FIGS may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces.
• an incoming signal may be horizontally cropped to reduce processing.
• a 720 pixel (horizontal) by 480 interlaced (480i) pixel signal may be cropped to 704x480i, if needed.
• a horizontal downsampling is performed to form 352x480i.
• a 2 to 1 downsampling is carried out. Other ratios are also contemplated.
• the downsampling may be performed using conventional interpolation filtering methods.
• a low pass anti-alias filter 13 filters the video data followed by a subsampling step in block 15.
• the output of block 15 is a 1 / horizontally downsampled field.
• the signal is deinterlaced to 352x480p to preferably 60Hz in block 14.
• Deinterlacing may be performed by conventional deinterlacing methods.
• the signal is vertically lowpass filtered as shown in FIG. 3, with a , 2, % filter 21 , and subsequently is subsampled 4 to 1 with a first phasing to make an upper 120-line field, shown as lines numbered i1 , i3, etc.
• Other filters may be employed for filter 21. Also shown in FIG.
• a subsequent deinterlaced 480p frame which is processed through the same filter as frame i, but is 4 to 1 subsampled with a different phase than the first phase to make a subsequent lower 120-line field, is shown as lines numbered i2, i4, etc.
• the 240i sequence of 60 Hz fields is formed. Pairs of successive 240i fields are then formed into 30 Hz frames in block 18.
• Each frame is formed in block 18 shown in FIG. 1.
• 704x480i frames have been downconverted to 352x240i frames suitable for a reduced bit rate compression.
• the video stream is compressed and transferred over a network or transmission link (wired or wireless) to a receiver such as a television or display device.
• the present invention improves the displayed vertical resolution for non-moving images. Non-moving images experience a vertical resolution improvement of 2:1 or greater over conventional systems.
• by employing the method of the present invention including for example, jagged diagonal reduction, as will be described below, improved downconverting of non-progressive video streams is provided.
• Postprocessing includes upconverting each frame in the horizontal direction. This is illustratively shown in block 30 where an interpolation method, such as a bicubical interpolation method, is employed to upconvert 352 samples per line to 704 samples per line.
• the upconverted 240i signal is deinterlaced in block 32.
• One of a plurality of different deinterlacing algorithms may be employed. In one embodiment, a jagged diagonal reduction algorithm is employed for the moving portions of the picture. This will be described later with reference to FIG. 5.
• the deinterlaced 240p/60Hz signal is then converted into 240-line fields by alternating upward shift to make an upper 240-line field from a240p frame and a downward shift to make a lower 240-line field from a succeeding 240p line frame. These shifts are performed in block 34 to adjust position up or down to reconstruct 480i fields.
• FIG. 5 is an illustrative diagram showing the conversion of 240p to 480i. The number associated with each line, e.g., A and %, is a weight. A first picture i is shifted up by a quarter line, and a second picture i+1 is shifted down by a quarter line. These two shifted pictures are interlaced to form a 480 line interlaced picture. Following the adjusting of position, the signal can be outputted as a 60Hz field sequence, which is restored to the 704x480i format.
• an illustrative technique for deinterlacing is shown.
• a jagged diagonal reduction portion of the deinterlacing is performed.
• Other deinterlacing techniques may be employed and are contemplated by the present inventors.
• the previous field lines may be inserted between the present field lines to accomplish deinterlacing. This maintains the full level of vertical detail.
• the previous or following field cannot be used to make an in-between line of pixels. So these pixels must be formed from the lines immediately above and below the pixels to be formed.
• a jagged diagonal reduction method preferably employed with the present invention, the diagonal pixel pairs L1 through L5 are tested to see which has the lowest difference, for example, in intensity.
• the pair with the lowest difference is averaged and used as pixel I. The exception to this occurs if this average is not the median of the average, the above pixel and the below pixel. If not, then the above pixel or the below pixel with the value nearest to this average is used instead.
• jagged edges are reduced significantly, rendering a better image on moving objects when the video is displayed.
• FIG. 7 a system 130 for format conversion is schematically shown in accordance with the present invention.
• System 130 provides a conversion device 132, which deinterlaces a non-progressive interlaced video stream having a first resolution (e.g., 480i) to a progressive format (e.g., 480p) having the same resolution.
• the conversion device 132 downconverts the progressive format to a second resolution (e.g., 120) and combines fields of the second resolution to provide frames at a third resolution (240i).
• the conversion device 132 preferably includes a %, Vz, V ⁇ filter 134 which downconverts the progressive format (480p) of the first resolution.
• the filter 134 samples a first image i with a first phase and samples a second image i+1 using the same , Vz, filter 134 with a second phase.
• the fields are output from the %, Vz, filter with the first phase and the second phase and a combining device combines the fields with the first phase with the fields of the second phase to achieve the third resolution.
• a jagged diagonal reduction algorithm 142 may be employed to provide deinterlacing of video signals.
• Conversion device 132 also preferably compresses the video data prior to transmission. Conversion device 132 is described with reference to blocks 10-18 in FIG. 1.
• a transmission link 136 is coupled to the conversion device for transmitting the compressed video stream at the third resolution (e.g., 240).
• a reconversion device 138 is coupled to the transmission link 136 and receives the transmitted video stream.
• the reconversion device 138 decompresses the video data when received.
• Reconversion device 138 deinterlaces the decompressed video stream of the third resolution to a progressive format video and converts the progressive format video to alternating upper field lines and lower field lines to make successive fields for display.
• Reconversion device 138 is described with reference to blocks 30-34 of FIG. 4.
• System 130 may include a cropping module/device 140 for cropping out a portion of the non-progressive interlaced video stream to reduce an amount of pixels being processed.
• Reconversion device 138 may include a jagged diagonal reduction algorithm or other program/device 142 for deinterlacing the video stream. The video is then able to be displayed on, for example, a display or TV set 144. Compression and decompression may be performed in accordance with known methods.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Graphics (AREA)
• Television Systems (AREA)

Applications Claiming Priority (5)

Publications (2)

Family

ID=26825931

Family Applications (1)

Country Status (6)

Families Citing this family (2)

Citations (2)

Family Cites Families (5)

• 2002
  • 2002-11-19 WO PCT/US2002/037186 patent/WO2003045056A1/en active Application Filing
  • 2002-11-19 KR KR1020047007043A patent/KR100958708B1/ko not_active IP Right Cessation
  • 2002-11-19 JP JP2003546568A patent/JP2005510905A/ja active Pending
  • 2002-11-19 CN CNB028230868A patent/CN100336393C/zh not_active Expired - Fee Related
  • 2002-11-19 EP EP02803681A patent/EP1466476A4/en not_active Withdrawn
  • 2002-11-19 AU AU2002366172A patent/AU2002366172A1/en not_active Abandoned

Patent Citations (2)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events