WO2007138320A1 - Displaying resized video - Google Patents

Displaying resized video Download PDF

Info

Publication number
WO2007138320A1
WO2007138320A1 PCT/GB2007/002005 GB2007002005W WO2007138320A1 WO 2007138320 A1 WO2007138320 A1 WO 2007138320A1 GB 2007002005 W GB2007002005 W GB 2007002005W WO 2007138320 A1 WO2007138320 A1 WO 2007138320A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
resolution
resized
window
overlay plane
Prior art date
Application number
PCT/GB2007/002005
Other languages
French (fr)
Inventor
Duncan Rohan White
Nicolas Beaunoir
Franck Bellanger
Laurent Proust
Hervé CHAU
Original Assignee
Nds Technologies France
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nds Technologies France filed Critical Nds Technologies France
Publication of WO2007138320A1 publication Critical patent/WO2007138320A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0125—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards being a high definition standard
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/015—High-definition television systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/44504—Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits

Definitions

  • the present invention relates to a method of operating a video system to display a resized video and also to a video system operable to display a resized video.
  • a number of interactive applications for digital television allow for the display of a resized video in a window (or viewport) of the interactive application.
  • This resized video window is displayed by making a "hole" in an overlay plane (containing the interactive application information, graphics, functions etc.) thus revealing the resized video.
  • the Cartesian coordinates of the resized video window in the overlay plane and the size of the resized video window in the overlay plane were always specified in a frame of reference corresponding to a standard definition (SD) video display format of 4/3 or 16/9, corresponding to a screen resolution of 720x576 pixels (i.e. 720 pixels per column and 576 pixels per line displayed on the screen). Therefore, in standard definition (SD) format, the Cartesian coordinates in the overlay plane of the resized video window as well as the size of the resized video window in the overlay plane required no geometric transformation. In high definition (HD) formatted video, the video image signal could have any one of a plurality of video resolutions when received for display.
  • SD standard definition
  • HD high definition
  • the coordinates and size of a resized video window for the overlay plane of a received video signal must be adjusted to a desired output resolution in order to obtain an output video size that is consistent with the resized video window and is in the correct position on the screen.
  • the HDTV label of the European Information, Communications and Consumer Technology Industry Associations (EICTA) which signifies that a device can receive and process HD television signals, requires support of an automatic mode that preserves the resolution of the received video signal for the output video signal since the resolution of the received video signal is not known in advance (see www.eicta.org, 'EICTA "HDTV” Minimum Requirements for HD Television Receivers ', paragraph 3.2, point 11).
  • DVB video encoded according to the MPEG standard this is a consequence of the video resolution not being signaled in the DVB Service Information (SI) or Programme Specific Information (PSI) or in any MPEG signaling packets. Rather, the MPEG video must be decoded in order to discover the video resolution. It is therefore necessary to modify the video according to the resolution of the received video signal on the one hand and according to the desired output resolution on the other hand.
  • This video image modification requires the translation of the resized video window coordinates and a homothetic conversion of size of the resized video window in order to modify it for display in the desired output resolution.
  • One solution to this problem consists of recalculating the coordinates and dimensions of the resized video window each time a new video signal resolution is received.
  • the resolution information for the received video signal passes from the base layer of the decoder, which receives and decodes the video signal and hence discovers the resolution of the received video signal, to the application layer through various drivers/controllers and interfaces.
  • the resolution of the received video signal is received by the application layer and the dimensioning and positioning calculations have been carried out, these calculations pass from the application layer back to the base layer, which resizes and repositions the received video image in order to display it correctly inside the resized video window.
  • the received video signal is typically displayed immediately after it has been decoded by the base layer and therefore the received video is displayed much more quickly than the time it takes for the position and size information to be processed.
  • the resolution of the received video signal changes (perhaps suddenly), this results in the incorrect display of the received video inside the resized video window and a visible refraining of the video displayed inside the resized video window once the position and size information have been calculated and received.
  • United States patent application of Miura describes synthesizing on screen display (OSD) data to be superposed on a picture of each resolution by using common OSD data.
  • a video resolution converter converts an HD (High Definition) video signal into an SD (Standard Definition) video signal such as an NTSC or PAL video signal.
  • a memory controller receives a sync signal identical to an SD picture obtained by frequency-dividing an HD video signal, and a sync signal based on an SD video signal, and reads out OSD data (4 bits per pixel) from the memory on the basis of these sync signals.
  • the OSD data read out on the basis of the SD video signal is synthesized with the SD video signal by an SD_OSD_MTX unit, and then output.
  • the OSD data read out on the basis of the SD sync signal synchronized with the HD is multiplied by an integer by an OSD resolution converter, synthesized with an HD video signal by an HD_OSD_MIX unit, and then output.
  • a method of operating a video system to display a resized video in a resized video window including a base layer and an application layer, the method including in the application layer: constructing an overlay plane in a reference resolution, the overlay plane including: one or more layers of graphics; and a window; calculating a size and position for the window in the overlay plane; and transferring the overlay plane and the size and position of the window to the base layer; the method further including in the base layer: receiving an input video; resizing the overlay plane using the overlay plane in the reference resolution to form a resized overlay plane in an output resolution, the resized overlay plane including: one or more layers of graphics; and a resized video window; calculating a new size and new position for the resized video window using the size and position of the window; resizing the input video using the new size of the resized video window to form the resized video; and displaying the resized video in the resized video
  • the input video has an input video resolution, and the input video resolution is the same as the output resolution.
  • the input video has an input video resolution, and the input video resolution is different to the output resolution.
  • the input video resolution is a standard definition video resolution.
  • the input video resolution is a high definition video resolution and the output resolution is a standard definition video resolution.
  • the input video resolution is a standard definition video resolution and the output resolution is a high definition video resolution.
  • the input video resolution is a high definition video resolution.
  • the reference resolution is smaller than the output resolution.
  • the reference resolution is the same as the output resolution.
  • a video system operable to display a resized video in a resized video window
  • the video system including: a base layer; and an application layer, where the application layer is operable to: construct an overlay plane in a reference resolution, the overlay plane including: one or more layers of graphics; and a window; calculate a size and position for the window in the overlay plane; and transfer the overlay plane and the size and position of the window to the base layer;
  • the base layer is operable to: receive an input video; resize the overlay plane using the overlay plane in the reference resolution to form a resized overlay plane in an output resolution, the resized overlay plane including: one or more layers of graphics; and a resized video window; calculate a new size and new position for the resized video window using the size and position of the window; resize the input video using the new size of the resized video window to form the resized video; and display the resized video in the resized video window using the new position
  • the input video has an input video resolution, and the input video resolution is different to the output resolution.
  • the input video resolution is a standard definition video resolution.
  • the input video resolution is a high definition video resolution and the output resolution is a standard definition video resolution.
  • the input video resolution is a standard definition video resolution and the output resolution is a high definition video resolution.
  • the input resolution is a high definition video resolution.
  • the reference video resolution is smaller than the output video resolution.
  • the reference video resolution is the same as the output resolution.
  • the method uses a reference resolution, which is independent of both the input video resolution and the output video resolution, for the various processes and calculations carried out in the application layer, as well as for data exchanges that occur between the application layer and the base layer.
  • the overlay plane which includes one or more graphics layers and a window, as well as the size and position of the window, are calculated for the reference resolution in the application layer.
  • the overlay plane as well as the size and position of the window are passed to the base layer in the reference resolution, and the base layer: resizes the overlay plane in accordance with a desired output resolution; calculates a size and position for the resized video window; and resizes the input video signal in accordance with the desired output resolution and then displays it in the resized video window.
  • the reference resolution used by is 960x576 pixels in order to match the legacy SD application video resolution and in order to reduce the amount of graphics calculations that consume lots of RAM and processing (CPU) power.
  • a quality video signal can be provided whilst still maintaining an acceptable level processing power for the various calculations.
  • various decoder input and output signal resolutions can be handled.
  • Figure 1 shows a television broadcasting system according to embodiments of the present invention
  • Figure 2 shows the position of a resized video window relative to an overlay plane, according to embodiments of the present invention
  • Figure 3 shows a digital decoder architecture according to embodiments of the present invention.
  • Figure 4 shows a procedure for managing the display of a resized video image in a resized video window according to embodiments of the present invention.
  • Figure 1 shows a television broadcasting system, and in particular one for HD television.
  • the system comprises, for example, an antenna 1 that broadcasts SD and HD video signals 2.
  • the video signals 2 are received by a decoder 4.
  • These video signals can be in one a plurality of formats: if the video signal is an SD video signal, it can have either a 4/3 or 16/9 format, whereas if the video signal is an HD signal, it has a 16/9 format.
  • An SD video signal has, for example, a resolution of (720x576), which corresponds to a display consisting of 576 rows and 720 columns of pixels.
  • an HD video signal can have one of two resolutions: (1280x720) and (1920x1080).
  • the decoder 4 for the video signal 2 is operable to process at least video signals having a 4/3 format and 16/9 format, as well as video signals having a (720x576) resolution, a (1280x720) resolution and a (1920x1080) resolution.
  • decoder 4 is operable to output two output video signals 3, 5 whatever the format and resolution of the received video signal.
  • Decoder 4 is operable to transmit output video signal 5, whose resolution is (720x576), to an SD display 7, and operable to transmit video signal output 3, whose resolution is (720x576), (1280x720) or (1920x1080), to an HD display 6, whatever the format and resolution of video signal 2.
  • the resolution of the output video signal 3 is the same as the resolution of the received video signal 2. That is to say, when the resolution of the received video signal changes, for example, from (720x576) to (1280x720), the resolution of the output video signal also changes from (720x576) to (1280x720). This is true for both video displayed in full screen and equally true for video displayed in a resized video window.
  • various sub- combinations of the system of figure 1 are possible, including (but not limited to) decoder 4 without the other elements.
  • Figure 2 shows an example of the display of a resized video in a resized video window 23 in an overlay plane 24.
  • the entirety of the original received video 21 is selected and is then resized to the scale of the resized video window that is defined, for example, by width 1 and height h of the resized video window.
  • the resized video window is displayed in a specific position 25, defined according to coordinates (x,y). This position 25 corresponds, for example, to one of the corners of the resized video window 23.
  • a transformation 22 that is proportional to the ratio of the resolution of the output video signal to the resolution of the received video signal is calculated and applied to the received video signal.
  • the transformation is recalculated by the decoder in order to correctly display the video in resized video window 23.
  • a "hole” is realised in the overlay plane 24, the dimensions of the hole being (l,h) and the position of the hole in the overlay plane being (x,y).
  • the overlay plane 24 is then superimposed on the resized video in order to inlay the resized video window in the overlay plane.
  • FIG. 3 shows a high level architecture for digital decoder 4.
  • Decoder 4 processes a received video signal 32, which can contain video data, as well as other digital data such as information relating to the programs being broadcast. A user is also able to access certain interactive applications using decoder 4.
  • Decoder 4 comprises a base layer 34 and an application layer 36.
  • Base layer 34 includes tuner 33, which receives and decodes video signal 32; mixer 38, which composes the output video signal 30 (which may contain only video data but could also contain graphics from interactive applications together with video); drivers/controllers 35; and interface 37, which provides an interface between base layer 34 and application layer 36 of decoder 4. Interface 37 allows information to pass back and forth between base layer 34 and application layer 36.
  • Application layer 36 is loaded with various pieces of software, and in particular, with any interactive applications available to the user.
  • Video signal 32 received by decoder 4 is decoded by tuner 33, which then transmits a video element 39 to mixer 38 for quasi-instantaneous output and display.
  • Tuner 33 also transmits video and other information (e.g. interactive application data) to application layer 36 via interface 37 and a driver/controller associated with tuner 33.
  • application layer 36 supplies mixer 38 (via interface 37 and a driver/controller associated with mixer 38) with an overlay plane in the form of various superimposed planes containing the information to display as part of an interactive application.
  • Mixer 38 then composes a video signal 30 that contains, for example, video in the form of a resized video window inlayed in the graphics of an interactive application.
  • FIG. 4 shows an example of the processing carried out in order to display a resized video window as an inlay in an interactive application overlay plane according to embodiments of the present invention.
  • Video signal 48 which comprises, for example, an HD video signal having a resolution of (1280x720), is received by tuner 52.
  • the video signal 48 is then scaled so as to allow for display with an SD resolution of (720x576), thus providing an SD video signal 47.
  • video signal 48 is also scaled so as to allow for display with a different HD resolution to the HD resolution of video signal 48 (e.g.(1920xl080)), thus providing an HD video signal 53. If no scaling is necessary, video signal 48 is provided as HD signal 53.
  • application layer 36 composes an overlay plane using a reference resolution (e.g. (960x576)).
  • the (960x576) reference resolution is equivalent to a (720x576) resolution that is extended for a 16/9 display by adding 120 columns of pixels onto each side of the overlay plane.
  • the various graphic layers for interactive applications are defined in application layer 36 according to this reference resolution whatever the desired output video resolution.
  • the various computations carried out in application layer 36 are also simplified.
  • the fonts used in the graphics layers of the interactive applications can be defined carefully so as to ensure their accurate reproduction during any future resizing processes. However, after any resizing process, the fonts can sometimes appear pixilated and therefore a smoothing algorithm for the various fonts is preferably applied to any text that appears in the various graphics layers.
  • the smoothing algorithm such as one based in the Freetype 2 font engine of "The Freetype Project" (www.freetype.org), aims to delete the supplementary pixels that can appear after any resizing operation and which pixilate the fonts.
  • a base graphics layer 41 is copied into a buffer memory 44.
  • the buffer memory 44 allows a "hole” 45 to be created in the base graphics layer into which a video window can be inlayed.
  • various graphics layers 42 comprising the interactive application graphics are copied into buffer memory 44.
  • buffer memory 44 comprises the base graphics layer and various other graphics layers, which comprise a "hole” 45 allowing for the display of the video window.
  • the size and position of the video window are calculated in accordance with the reference resolution (e.g. (960x576)).
  • Buffer memory 44 passes the overlay plane to base layer 34 of decoder 31.
  • base layer 34 uses the overlay plane in the reference resolution to resize the overlay plane in accordance with the desired HD output resolution to form resized overlay plane 43 having a resolution of either (1920x1080) or (1280x720). This includes calculating the size and position of a resized video window in the resized overlay plane.
  • Mixer 38 uses the size and position of the resized video window to resize HD video signal 53 to form a resized video and to position the resized video in the resized video window of resized overlay plane 43.
  • the resulting video image 49 contains the received video, which has been resized, embedded in the resized video window of the resized overlay plane.
  • Video image 49 is then passed to the HD output of decoder 4 so as to provide a video signal 50 having an HD resolution.
  • the overlay plane computed by application layer 36 in the reference resolution and held in buffer memory 44 is resized by removing the lateral bands.
  • the size and position of a resized video window in the resized overlay plane are the same as the size and position of the video window as calculated in the reference resolution by application layer 36.
  • Mixer 38 uses the size and position of the resized video window to resize SD video signal 47 to form a resized video and to position the resized video in the resized video window of resized overlay plane 46.
  • the resulting video image 46 contains the received video, which has been resized, embedded in the resized video window of the resized overlay plane.
  • Video image 46 is then passed to the SD output of decoder 4 so as to provide a video signal 51 having an SD resolution. It will be apparent to the person skilled in the art that the example described above in relation to figure 4 applies analogously to the reception of a video signal having an SD resolution.
  • the resizing of the video signals using different resolutions is therefore limited because the resizing is carried out in base layer 34. This allows for the simplification of the processes carried out in application layer 36 and for the optimisation of the performance of these processes.
  • the reference resolution used in the above described embodiments of the present invention is preferably chosen to achieve a satisfactory compromise between good video signal quality and low processing power cost for the various calculations.
  • base layer 34 uses enlargement functions only, since the virtual reference resolution is smaller than or equal to the output resolution. This is advantageous because enlargement of graphic information usually provides better image quality results than reduction, depending on the capabilities of the chipset used in decoder 4.
  • the prior smoothing of the fonts by application layer 36 allows for better text reproduction when the image is enlarged. Hence the resultant video signal is of a good quality.
  • the definition of a reference resolution allows the system to dispense with the various conversions that would otherwise be necessary between the various layers of decoder 4, and which result in signal quality loss and increased computation time.
  • the choice of a smaller reference resolution also reduces computation time for the various signal processing operations.
  • a reference resolution that is larger than any desired output resolution could be used.
  • Another advantage of the procedure described above according to embodiments of the present invention is that it enables application layer 36 to carry out its various operations without regard for the various video resolutions employed elsewhere. This is turn allows for the reuse of the various interactive applications when the resolutions of the input video signal and output video signal are different to those mentioned in the example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

A method of operating a video system to display a resized video in a resized video window is disclosed. The video system comprises a base layer and an application layer, the method comprises in said application layer: constructing an overlay plane in a reference resolution, the overlay plane including: one or more layers of graphics; and a window; calculating a size and position for the window in the overlay plane; and transferring the overlay plane and the size and position of the window to the base layer; the method further including in the base layer: receiving an input video; resizing the overlay plane using the overlay plane in the reference resolution to form a resized overlay plane in an output resolution, the resized overlay plane including: one or more layers of graphics; and a resized video window; calculating a new size and new position for the resized video window using the size and position of the window; resizing the input video using the new size of the resized video window to form the resized video; and displaying the resized video in the resized video window using the new position of the resized video window.

Description

DISPLAYING RESIZED VIDEO
FIELD OF THE INVENTION
The present invention relates to a method of operating a video system to display a resized video and also to a video system operable to display a resized video.
BACKGROUND OF THE INVENTION
A number of interactive applications for digital television allow for the display of a resized video in a window (or viewport) of the interactive application. This resized video window is displayed by making a "hole" in an overlay plane (containing the interactive application information, graphics, functions etc.) thus revealing the resized video.
Prior to the advent of high definition TV, the Cartesian coordinates of the resized video window in the overlay plane and the size of the resized video window in the overlay plane were always specified in a frame of reference corresponding to a standard definition (SD) video display format of 4/3 or 16/9, corresponding to a screen resolution of 720x576 pixels (i.e. 720 pixels per column and 576 pixels per line displayed on the screen). Therefore, in standard definition (SD) format, the Cartesian coordinates in the overlay plane of the resized video window as well as the size of the resized video window in the overlay plane required no geometric transformation. In high definition (HD) formatted video, the video image signal could have any one of a plurality of video resolutions when received for display. The coordinates and size of a resized video window for the overlay plane of a received video signal must be adjusted to a desired output resolution in order to obtain an output video size that is consistent with the resized video window and is in the correct position on the screen. In addition, the HDTV label of the European Information, Communications and Consumer Technology Industry Associations (EICTA), which signifies that a device can receive and process HD television signals, requires support of an automatic mode that preserves the resolution of the received video signal for the output video signal since the resolution of the received video signal is not known in advance (see www.eicta.org, 'EICTA "HDTV" Minimum Requirements for HD Television Receivers ', paragraph 3.2, point 11). For DVB video encoded according to the MPEG standard, this is a consequence of the video resolution not being signaled in the DVB Service Information (SI) or Programme Specific Information (PSI) or in any MPEG signaling packets. Rather, the MPEG video must be decoded in order to discover the video resolution. It is therefore necessary to modify the video according to the resolution of the received video signal on the one hand and according to the desired output resolution on the other hand. This video image modification requires the translation of the resized video window coordinates and a homothetic conversion of size of the resized video window in order to modify it for display in the desired output resolution. One solution to this problem consists of recalculating the coordinates and dimensions of the resized video window each time a new video signal resolution is received. These calculations are typically carried out in the application layer of the decoder. Hence the resolution information for the received video signal passes from the base layer of the decoder, which receives and decodes the video signal and hence discovers the resolution of the received video signal, to the application layer through various drivers/controllers and interfaces. Once the resolution of the received video signal is received by the application layer and the dimensioning and positioning calculations have been carried out, these calculations pass from the application layer back to the base layer, which resizes and repositions the received video image in order to display it correctly inside the resized video window. However, the received video signal is typically displayed immediately after it has been decoded by the base layer and therefore the received video is displayed much more quickly than the time it takes for the position and size information to be processed. When the resolution of the received video signal changes (perhaps suddenly), this results in the incorrect display of the received video inside the resized video window and a visible refraining of the video displayed inside the resized video window once the position and size information have been calculated and received.
United States patent application of Miura (USSN 11/116,221, published as US 2005/0253950) describes synthesizing on screen display (OSD) data to be superposed on a picture of each resolution by using common OSD data. A video resolution converter converts an HD (High Definition) video signal into an SD (Standard Definition) video signal such as an NTSC or PAL video signal. A memory controller receives a sync signal identical to an SD picture obtained by frequency-dividing an HD video signal, and a sync signal based on an SD video signal, and reads out OSD data (4 bits per pixel) from the memory on the basis of these sync signals. The OSD data read out on the basis of the SD video signal is synthesized with the SD video signal by an SD_OSD_MTX unit, and then output. The OSD data read out on the basis of the SD sync signal synchronized with the HD is multiplied by an integer by an OSD resolution converter, synthesized with an HD video signal by an HD_OSD_MIX unit, and then output.
The disclosures of all references mentioned above and throughout the present specification, as well as the disclosures of all references mentioned in those references, are hereby incorporated herein by reference.
SUMMARY OF THE INVENTION
There is provided in accordance with an embodiment of the present invention, a method of operating a video system to display a resized video in a resized video window, the video system including a base layer and an application layer, the method including in the application layer: constructing an overlay plane in a reference resolution, the overlay plane including: one or more layers of graphics; and a window; calculating a size and position for the window in the overlay plane; and transferring the overlay plane and the size and position of the window to the base layer; the method further including in the base layer: receiving an input video; resizing the overlay plane using the overlay plane in the reference resolution to form a resized overlay plane in an output resolution, the resized overlay plane including: one or more layers of graphics; and a resized video window; calculating a new size and new position for the resized video window using the size and position of the window; resizing the input video using the new size of the resized video window to form the resized video; and displaying the resized video in the resized video window using the new position of the resized video window.
Preferably, the input video has an input video resolution, and the input video resolution is the same as the output resolution.
Alternatively, the input video has an input video resolution, and the input video resolution is different to the output resolution. Preferably the input video resolution is a standard definition video resolution.
Alternatively, the input video resolution is a high definition video resolution and the output resolution is a standard definition video resolution.
Alternatively, the input video resolution is a standard definition video resolution and the output resolution is a high definition video resolution.
Alternatively, the input video resolution is a high definition video resolution.
Preferably, the reference resolution is smaller than the output resolution. Alternatively, the reference resolution is the same as the output resolution.
There is provided in accordance with a further embodiment of the present invention, a video system operable to display a resized video in a resized video window, the video system including: a base layer; and an application layer, where the application layer is operable to: construct an overlay plane in a reference resolution, the overlay plane including: one or more layers of graphics; and a window; calculate a size and position for the window in the overlay plane; and transfer the overlay plane and the size and position of the window to the base layer; where the base layer is operable to: receive an input video; resize the overlay plane using the overlay plane in the reference resolution to form a resized overlay plane in an output resolution, the resized overlay plane including: one or more layers of graphics; and a resized video window; calculate a new size and new position for the resized video window using the size and position of the window; resize the input video using the new size of the resized video window to form the resized video; and display the resized video in the resized video window using the new position of the resized video window. Preferably, the input video has an input video resolution, and the input video resolution is the same as the output resolution.
Alternatively, the input video has an input video resolution, and the input video resolution is different to the output resolution.
Preferably, the input video resolution is a standard definition video resolution.
Alternatively, the input video resolution is a high definition video resolution and the output resolution is a standard definition video resolution.
Alternatively, the input video resolution is a standard definition video resolution and the output resolution is a high definition video resolution. Alternatively, the input resolution is a high definition video resolution.
Preferably, the reference video resolution is smaller than the output video resolution.
Alternatively, the reference video resolution is the same as the output resolution.
In order to display a resized video in a resized video window of an interactive application, the method according to embodiments of the present invention uses a reference resolution, which is independent of both the input video resolution and the output video resolution, for the various processes and calculations carried out in the application layer, as well as for data exchanges that occur between the application layer and the base layer. The overlay plane, which includes one or more graphics layers and a window, as well as the size and position of the window, are calculated for the reference resolution in the application layer. Following this, the overlay plane as well as the size and position of the window are passed to the base layer in the reference resolution, and the base layer: resizes the overlay plane in accordance with a desired output resolution; calculates a size and position for the resized video window; and resizes the input video signal in accordance with the desired output resolution and then displays it in the resized video window. Preferably, the reference resolution used by is 960x576 pixels in order to match the legacy SD application video resolution and in order to reduce the amount of graphics calculations that consume lots of RAM and processing (CPU) power. Advantageously, a quality video signal can be provided whilst still maintaining an acceptable level processing power for the various calculations. In addition, various decoder input and output signal resolutions can be handled.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which: Figure 1 shows a television broadcasting system according to embodiments of the present invention;
Figure 2 shows the position of a resized video window relative to an overlay plane, according to embodiments of the present invention;
Figure 3 shows a digital decoder architecture according to embodiments of the present invention; and
Figure 4 shows a procedure for managing the display of a resized video image in a resized video window according to embodiments of the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS
Figure 1 shows a television broadcasting system, and in particular one for HD television. The system comprises, for example, an antenna 1 that broadcasts SD and HD video signals 2. The video signals 2 are received by a decoder 4. These video signals can be in one a plurality of formats: if the video signal is an SD video signal, it can have either a 4/3 or 16/9 format, whereas if the video signal is an HD signal, it has a 16/9 format. An SD video signal has, for example, a resolution of (720x576), which corresponds to a display consisting of 576 rows and 720 columns of pixels. On the other hand, an HD video signal can have one of two resolutions: (1280x720) and (1920x1080). Therefore, the decoder 4 for the video signal 2 is operable to process at least video signals having a 4/3 format and 16/9 format, as well as video signals having a (720x576) resolution, a (1280x720) resolution and a (1920x1080) resolution. In addition, decoder 4 is operable to output two output video signals 3, 5 whatever the format and resolution of the received video signal. Decoder 4 is operable to transmit output video signal 5, whose resolution is (720x576), to an SD display 7, and operable to transmit video signal output 3, whose resolution is (720x576), (1280x720) or (1920x1080), to an HD display 6, whatever the format and resolution of video signal 2. In addition, in the case of a decoder with an HDTV label, the resolution of the output video signal 3 is the same as the resolution of the received video signal 2. That is to say, when the resolution of the received video signal changes, for example, from (720x576) to (1280x720), the resolution of the output video signal also changes from (720x576) to (1280x720). This is true for both video displayed in full screen and equally true for video displayed in a resized video window. In alternative embodiments of the present invention, various sub- combinations of the system of figure 1 are possible, including (but not limited to) decoder 4 without the other elements.
Figure 2 shows an example of the display of a resized video in a resized video window 23 in an overlay plane 24. The entirety of the original received video 21 is selected and is then resized to the scale of the resized video window that is defined, for example, by width 1 and height h of the resized video window. The resized video window is displayed in a specific position 25, defined according to coordinates (x,y). This position 25 corresponds, for example, to one of the corners of the resized video window 23. A transformation 22 that is proportional to the ratio of the resolution of the output video signal to the resolution of the received video signal is calculated and applied to the received video signal. If the resolution of the received video signal changes, the transformation is recalculated by the decoder in order to correctly display the video in resized video window 23. A "hole" is realised in the overlay plane 24, the dimensions of the hole being (l,h) and the position of the hole in the overlay plane being (x,y). The overlay plane 24 is then superimposed on the resized video in order to inlay the resized video window in the overlay plane.
Figure 3 shows a high level architecture for digital decoder 4. Decoder 4 processes a received video signal 32, which can contain video data, as well as other digital data such as information relating to the programs being broadcast. A user is also able to access certain interactive applications using decoder 4. Decoder 4 comprises a base layer 34 and an application layer 36. Base layer 34 includes tuner 33, which receives and decodes video signal 32; mixer 38, which composes the output video signal 30 (which may contain only video data but could also contain graphics from interactive applications together with video); drivers/controllers 35; and interface 37, which provides an interface between base layer 34 and application layer 36 of decoder 4. Interface 37 allows information to pass back and forth between base layer 34 and application layer 36. Application layer 36 is loaded with various pieces of software, and in particular, with any interactive applications available to the user.
Video signal 32 received by decoder 4 is decoded by tuner 33, which then transmits a video element 39 to mixer 38 for quasi-instantaneous output and display. Tuner 33 also transmits video and other information (e.g. interactive application data) to application layer 36 via interface 37 and a driver/controller associated with tuner 33. In the present embodiment, application layer 36 supplies mixer 38 (via interface 37 and a driver/controller associated with mixer 38) with an overlay plane in the form of various superimposed planes containing the information to display as part of an interactive application. Mixer 38 then composes a video signal 30 that contains, for example, video in the form of a resized video window inlayed in the graphics of an interactive application.
Figure 4 shows an example of the processing carried out in order to display a resized video window as an inlay in an interactive application overlay plane according to embodiments of the present invention. Video signal 48, which comprises, for example, an HD video signal having a resolution of (1280x720), is received by tuner 52. The video signal 48 is then scaled so as to allow for display with an SD resolution of (720x576), thus providing an SD video signal 47. If necessary, video signal 48 is also scaled so as to allow for display with a different HD resolution to the HD resolution of video signal 48 (e.g.(1920xl080)), thus providing an HD video signal 53. If no scaling is necessary, video signal 48 is provided as HD signal 53. In parallel, application layer 36 composes an overlay plane using a reference resolution (e.g. (960x576)). The (960x576) reference resolution is equivalent to a (720x576) resolution that is extended for a 16/9 display by adding 120 columns of pixels onto each side of the overlay plane. The various graphic layers for interactive applications are defined in application layer 36 according to this reference resolution whatever the desired output video resolution.
This frees application layer 36 from the constraints associated with having to work with the input video signal resolution (which may not be known until after decoding of the input video signal has commenced) and the output video signal resolution. The various computations carried out in application layer 36 are also simplified. In addition, the fonts used in the graphics layers of the interactive applications can be defined carefully so as to ensure their accurate reproduction during any future resizing processes. However, after any resizing process, the fonts can sometimes appear pixilated and therefore a smoothing algorithm for the various fonts is preferably applied to any text that appears in the various graphics layers. The smoothing algorithm, such as one based in the Freetype 2 font engine of "The Freetype Project" (www.freetype.org), aims to delete the supplementary pixels that can appear after any resizing operation and which pixilate the fonts.
The formation of the overlay plane will now be described in more detail. First a base graphics layer 41 is copied into a buffer memory 44. The buffer memory 44 allows a "hole" 45 to be created in the base graphics layer into which a video window can be inlayed. Following this, various graphics layers 42 comprising the interactive application graphics are copied into buffer memory 44. Hence buffer memory 44 comprises the base graphics layer and various other graphics layers, which comprise a "hole" 45 allowing for the display of the video window. The size and position of the video window are calculated in accordance with the reference resolution (e.g. (960x576)). Buffer memory 44 passes the overlay plane to base layer 34 of decoder 31. For HD display, base layer 34 then uses the overlay plane in the reference resolution to resize the overlay plane in accordance with the desired HD output resolution to form resized overlay plane 43 having a resolution of either (1920x1080) or (1280x720). This includes calculating the size and position of a resized video window in the resized overlay plane. Mixer 38 then uses the size and position of the resized video window to resize HD video signal 53 to form a resized video and to position the resized video in the resized video window of resized overlay plane 43. The resulting video image 49 contains the received video, which has been resized, embedded in the resized video window of the resized overlay plane. Video image 49 is then passed to the HD output of decoder 4 so as to provide a video signal 50 having an HD resolution.
For SD display, since the reference resolution, in this embodiment, is the same resolution as that used for an SD output video signal, the overlay plane computed by application layer 36 in the reference resolution and held in buffer memory 44 is resized by removing the lateral bands. The size and position of a resized video window in the resized overlay plane are the same as the size and position of the video window as calculated in the reference resolution by application layer 36. Mixer 38 then uses the size and position of the resized video window to resize SD video signal 47 to form a resized video and to position the resized video in the resized video window of resized overlay plane 46. The resulting video image 46 contains the received video, which has been resized, embedded in the resized video window of the resized overlay plane. Video image 46 is then passed to the SD output of decoder 4 so as to provide a video signal 51 having an SD resolution. It will be apparent to the person skilled in the art that the example described above in relation to figure 4 applies analogously to the reception of a video signal having an SD resolution.
In view of the large number of video resolutions that various video systems process, the definition of a reference resolution, which is used as a working or interchange resolution, limits the number of data exchanges that take place between application layer 36 and base layer 34 of decoder 4. In fact, in order for base layer 34 to compute the various video signals that are outputted by decoder 4, it is sufficient for application layer 36 to pass to base layer 34:
+ the size and position of the video window, which have been calculated in accordance with the reference resolution; and + the overlay plane in the reference resolution.
The resizing of the video signals using different resolutions is therefore limited because the resizing is carried out in base layer 34. This allows for the simplification of the processes carried out in application layer 36 and for the optimisation of the performance of these processes. The reference resolution used in the above described embodiments of the present invention is preferably chosen to achieve a satisfactory compromise between good video signal quality and low processing power cost for the various calculations.
In the above described embodiments, base layer 34 uses enlargement functions only, since the virtual reference resolution is smaller than or equal to the output resolution. This is advantageous because enlargement of graphic information usually provides better image quality results than reduction, depending on the capabilities of the chipset used in decoder 4. In addition, the prior smoothing of the fonts by application layer 36 allows for better text reproduction when the image is enlarged. Hence the resultant video signal is of a good quality. Moreover, the definition of a reference resolution allows the system to dispense with the various conversions that would otherwise be necessary between the various layers of decoder 4, and which result in signal quality loss and increased computation time. In addition, the choice of a smaller reference resolution also reduces computation time for the various signal processing operations.
In alternative embodiments, a reference resolution that is larger than any desired output resolution could be used.
Another advantage of the procedure described above according to embodiments of the present invention is that it enables application layer 36 to carry out its various operations without regard for the various video resolutions employed elsewhere. This is turn allows for the reuse of the various interactive applications when the resolutions of the input video signal and output video signal are different to those mentioned in the example.
It is appreciated that various features of the invention which are, for clarity, described in the contexts of separate embodiments may also be provided in combination in a single embodiment. Conversely, various features of the invention which are, for brevity, described in the context of a single embodiment may also be provided separately or in any suitable subcombination.
It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the invention is defined only by the claims which follow:

Claims

1. A method of operating a video system to display a resized video in a resized video window, said video system comprising a base layer and an application layer, said method comprising in said application layer: constructing an overlay plane in a reference resolution, said overlay plane comprising: one or more layers of graphics; and a window; calculating a size and position for said window in said overlay plane; and transferring said overlay plane and said size and position of said window to said base layer; said method further comprising in said base layer: receiving an input video; resizing said overlay plane using said overlay plane in said reference resolution to form a resized overlay plane in an output resolution, said resized overlay plane comprising: one or more layers of graphics; and a resized video window; calculating a new size and new position for said resized video window using said size and position of said window; resizing said input video using said new size of said resized video window to form said resized video; and displaying said resized video in said resized video window using said new position of said resized video window.
2. A method according to claim I5 wherein said input video has an input video resolution, and wherein said input video resolution is the same as said output resolution.
3. A method according to claim I5 wherein said input video has an input video resolution, and wherein said input video resolution is different to said output resolution.
4. ' A method according to claim 2, wherein said input video resolution comprises a standard definition video resolution.
5. A method according to claim 3, wherein said input video resolution comprises a high definition video resolution and said output resolution comprises a standard definition video resolution.
6. A method according to claim 3, wherein said input video resolution comprises a standard definition video resolution and said output resolution comprises a high definition video resolution.
7. A method according to claim 2, wherein said input video resolution comprises a high definition video resolution.
8. A method according to any of the preceding claims, wherein said reference resolution is smaller than said output resolution.
9. A method according to any of claims 1 to 7, wherein said reference resolution is the same as said output resolution.
10. A video system operable to display a resized video in a resized video window, said video system comprising: a base layer; and an application layer, wherein said application layer is operable to: construct an overlay plane in a reference resolution, said overlay plane comprising: one or more layers of graphics; and a window; calculate a size and position for said window in said overlay plane; and transfer said overlay plane and said size and position of said window to said base layer; wherein said base layer is operable to: receive an input video; resize said overlay plane using said overlay plane in said reference resolution to form a resized overlay plane in an output resolution, said resized overlay plane comprising: one or more layers of graphics; and a resized video window; calculate a new size and new position for said resized video window using said size and position of said window; resize said input video using said new size of said resized video window to form said resized video; and display said resized video in said resized video window using said new position of said resized video window.
11. A video system according to claim 10, wherein said input video has an input video resolution, and wherein said input video resolution is the same as said output resolution.
12. A video system according to claim 10, wherein said input video has an input video resolution, and wherein said input video resolution is different to said output resolution.
13. A video system according to claim 11, wherein said input video resolution comprises a standard definition video resolution.
14. A video system according to claim 12, wherein said input video resolution comprises a high definition video resolution and said output resolution comprises a standard definition video resolution.
15. A video system according to claim 12, wherein said input video resolution comprises a standard definition video resolution and said output resolution comprises a high definition video resolution.
16. A video system according to claim 11, wherein said input resolution comprises a high definition video resolution.
17. A video system according to any of claims 10 to 16, wherein said reference video resolution is smaller than said output video resolution.
18. A video system according to any of claims 10 to 16, wherein said reference video resolution is the same as said output resolution.
PCT/GB2007/002005 2006-05-30 2007-05-29 Displaying resized video WO2007138320A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0604810A FR2901947A1 (en) 2006-05-30 2006-05-30 METHOD FOR MANAGING THE DISPLAY OF A RESTRICTED VIDEO, IN PARTICULAR FOR HIGH DEFINITION TELEVISION
FR06/04810 2006-05-30

Publications (1)

Publication Number Publication Date
WO2007138320A1 true WO2007138320A1 (en) 2007-12-06

Family

ID=37836788

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2007/002005 WO2007138320A1 (en) 2006-05-30 2007-05-29 Displaying resized video

Country Status (2)

Country Link
FR (1) FR2901947A1 (en)
WO (1) WO2007138320A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1991019378A1 (en) * 1990-06-01 1991-12-12 Thomson Consumer Electronics, Inc. Vertical zoom and panning for television
US20030107676A1 (en) * 2001-12-06 2003-06-12 Lg Electronics Inc. Image display apparatus and operating method thereof
EP1328114A1 (en) * 2002-01-10 2003-07-16 Canal+ Technologies Société Anonyme Image resolution management in a receiver/decoder
EP1499124A2 (en) * 2003-07-18 2005-01-19 Matsushita Electric Industrial Co., Ltd. Display processing method and display processing apparatus
US20050253950A1 (en) * 2004-05-14 2005-11-17 Canon Kabushiki Kaisha Video apparatus and image sensing apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1991019378A1 (en) * 1990-06-01 1991-12-12 Thomson Consumer Electronics, Inc. Vertical zoom and panning for television
US20030107676A1 (en) * 2001-12-06 2003-06-12 Lg Electronics Inc. Image display apparatus and operating method thereof
EP1328114A1 (en) * 2002-01-10 2003-07-16 Canal+ Technologies Société Anonyme Image resolution management in a receiver/decoder
EP1499124A2 (en) * 2003-07-18 2005-01-19 Matsushita Electric Industrial Co., Ltd. Display processing method and display processing apparatus
US20050253950A1 (en) * 2004-05-14 2005-11-17 Canon Kabushiki Kaisha Video apparatus and image sensing apparatus

Also Published As

Publication number Publication date
FR2901947A1 (en) 2007-12-07

Similar Documents

Publication Publication Date Title
US6275267B1 (en) Television receiver for receiving a plurality of formats of video signals having different resolutions
KR100412763B1 (en) Image processing apparatus
US7030932B2 (en) Apparatus and method for converting multi-source input images
US6493036B1 (en) System and method for scaling real time video
JP4541476B2 (en) Multi-image display system and multi-image display method
US7145947B2 (en) Video data processing apparatus and method, data distributing apparatus and method, data receiving apparatus and method, storage medium, and computer program
US8279938B2 (en) Encoding device and method, decoding device and method, program, recording medium, and data structure
US8111932B2 (en) Digital image decoder with integrated concurrent image prescaler
EP1154642B1 (en) A method for using a single osd pixmap across mulitple video raster sizes by chaining osd headers
US20100134684A1 (en) Image Processing Apparatus, Receiver, and Display Device
JP2003338991A (en) Image display device and its method
EP1154643B1 (en) A method and system for using a single osd pixmap across multiple video raster sizes by using multiple headers
JP2001175239A (en) Device, system and method for displaying multiimages and recording medium
CN101448108A (en) Image processing apparatus and related method
US6707853B1 (en) Interface for performing motion compensation
CN100525418C (en) Video processing and output device with the multiple display function
WO2007138320A1 (en) Displaying resized video
JP3872295B2 (en) Data display method, recording medium, and processor-based system
JP2001083951A (en) Method for forming and processing image, osd forming method, image forming system and osd memory
KR20020086878A (en) Method and device for video scene composition including graphic elements
HRP20000484A2 (en) Processing of graphical digital picture data in a decoder
JPH11355683A (en) Video display device
JP4960433B2 (en) Image processing apparatus, receiving apparatus, and display apparatus
Brosz et al. A single-chip HDTV video decoder design
JP2003110956A (en) Digital television receiver, printer, and digital television receiver with image print output function

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07733021

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07733021

Country of ref document: EP

Kind code of ref document: A1