WO2009125342A1

WO2009125342A1 - Electronic device and method of enhancing the picture quality of composite video data having at least one window

Info

Publication number: WO2009125342A1
Application number: PCT/IB2009/051458
Authority: WO
Inventors: Petrus Maria De Greef; Matheus Johannus Gerardus Lammers
Original assignee: Nxp B.V.
Priority date: 2008-04-07
Filing date: 2009-04-07
Publication date: 2009-10-15

Abstract

An electronic device is provided which comprises a picture quality enhancement unit (PQE) for receiving composite video data having at least one window and information with respect to the position and properties of the at least one window from a host unit (HU) and for enhancing the composite video data. The enhancement of the video data is performed by processing each of the at least one windows in the composite video data individually based on the information with respect to the position and properties of the at least one window. An enhanced composite video data having the at least one window is outputted.

Description

Electronic device and method of enhancing the picture quality of composite video data having at least one window

FIELD OF THE INVENTION

The present invention relates to an electronic device and a method of enhancing the picture quality of composite video data having at least one window.

BACKGROUND OF THE INVENTION

Modern multi-media applications are typically based on a combination of graphics, photos and video clips, wherein each of these is displayed in a different window on a display of a personal computer, a mobile phone or a portable media player. These windows will be generated by a host system which will output a single video stream to the display unit. As the quality of the displays of mobile phones or portable media players improves constantly, it is also desirable that the picture quality or the video quality of the multi-media content which is displayed on these display units is also improved. Video-based picture quality enhancements are used for windows with natural content. However, as the host system will only output a single video stream, windows cannot be considered any more as separate entities but the plurality of windows must be considered as a multi-media image. A further improvement of enhancement scheme is sharpening which is typically executed on natural content like photos and videos to improve the legibility and quality of the perceived image, specifically when these images are scaled to a larger resolution. However, if sharpening is also applied to graphics like text, the image can be corrupted. A natural motion processing constitutes a method for motion compensated frame-rate up-conversion of a video signal. Such a processing need not be applied to still images. As the content of input-video- window is typically highly compressed, an up-scaling is typically required to enlarge to image to e.g. full-screen resolution.

US 6,870,538 B2 discloses a video system with a parallel processing of graphic windows with multiple graphics layers.

However, it is desirable to enhance the quality of multimedia images which contain several windows. SUMMARY OF THE INVENTION

It is an object of the invention to provide an electronic device which enables to improve the picture quality of a video signal with at least one window. This object is solved by a video processor according to claim 1 and by a method of enhancing the picture quality of composite video data having at least one window according to claim 9.

Therefore, an electronic device is provided which comprises a picture quality enhancement unit for receiving composite video data having at least one window and information with respect to the position and properties of the at least one window from a host unit and for enhancing the composite video data. The enhancement of the output of the host unit is performed by processing each of the at least one windows in the composite video data individually based on the information with respect to the position and properties of the at least one window. An enhanced composite video data having the at least one window is outputted.

The video data may comprise a background window, a photo window, an overlay window and/or a life window.

According to an aspect of the invention, the picture quality enhancement unit comprises a video managing unit for managing the processing of the at least one window comprised in the composite video data from the host unit. The management is based on the information with respect to the position and the property of the window. The picture quality enhancement unit furthermore comprises a sharpening unit for sharpening content of the at least one window, a natural motion unit for performing a natural motion processing on the at least one window, a scaling unit for scaling content of the at least one window and/or a border unit for performing a border processing of the at least one window. The picture quality enhancement unit furthermore comprises a mixing unit for mixing the outputs of the video managing unit, the sharpening unit, the natural motion unit, the scaling unit and/or the border unit to provide enhanced video data.

According to a further aspect of the invention, the mixing unit is adapted for blending the enhanced video data into one of the windows, for example the background window.

According to a further aspect of the invention, the mixing unit is adapted for blending the enhanced video data into the background window, wherein the size, position and orientation of an overlay window can be freely selected. This can for example be achieved as the natural motion unit can comprise a frame memory enabling a translation and rotation of the enhanced video data.

According to a further aspect of the invention, the mixing unit is adapted for blending enhanced video data into a background window in dependence on the enhanced video data, a live video window and/or a programmable color key. Accordingly, the enhanced video data can be represented on the display at all locations overlapping the live video data. The overlay video data can be equal to the color key data and the overlay video data can be represented at the display at all locations where the overlay video data is not equal to the color key data. According to a further aspect of the invention, the picture quality enhancement unit is also adapted for display enhancement processing.

The invention also relates to a method for enhancing the quality of composite video data having at least one window. Composite video data having at least one window and information with respect to a position and properties of the at least one window is received. The composite video data is enhanced by processing each of the at least one window individually based on the information with respect to the position and properties of the at least one window. Enhanced video data having the at least one window are outputted.

The invention relates to the idea to provide a video processor arranged at an interface between a host system providing already composed video signals and a display driver of a display. The host system may output a composite video signal which includes at least a window which may be a background window, a picture window, a life window or an overlay window. The host system forwards the position and property of each window to the video processor which can perform the required video processing on each window individually based on the property of the respective window. Typically, the content of a video source will be multi-media data with at least one window which may include graphics, photo and/or video content. Each window may comprise a different multi-media content such that each window needs to be processed independently. E. g. natural Motion processing to up- convert the image-rate of the life video window requires at least 2 frame memories, such that the enhanced video can be blend to any location of the background window, including rotation of this window. As the upscaled video-data is covering a portion of the composed window, the overlay window, the image content of this window can be blended with the enhanced video data controlled by a programmable color-key.

The principles of the invention can be applied in a system with a host unit providing the video signal, a picture enhancement and a display module. The host unit can provide the video signal and the position and property of each window in the video signal. The picture quality enhancement unit can apply a picture quality enhancement processing on the respective windows in the video signal individually based on the information provided by the host unit. The picture quality enhancement unit can be provided as a separate or stand- alone unit which can receive the video signal from the host unit and which can output a video signal to the display driver of the display module.

Further aspects of the invention are described in the dependent claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The advantages and embodiments of the present application will now be described in more detail with reference to the Figures.

Fig. 1 shows a block diagram of an electronic device according to a first embodiment, Fig. 2 shows a block diagram of an electronic device according to a second embodiment,

Fig. 3 shows a basic representation of the main components of an electronic device according to a third embodiment,

Fig. 4 shows a basic representation of an image composition of a video signal according to the invention,

Fig. 5 shows a basic representation of several windows on a display module of an electronic device,

Fig. 6 shows a basic representation of a life frame according to the invention, and Fig. 7 shows a block diagram of a video processor according to a fourth embodiment.

DETAILED DESCRIPTION OF EMBODIMENTS

Fig. 1 shows a block diagram of an electronic device according to a first embodiment. The electronic device according to a first embodiment can for example be a mobile device like a mobile phone or a mobile media player. The electronic device comprises (optionally) a host unit HU, a picture quality enhancement unit PQE and a display module DM. The host unit HU can be an internal or external host unit HU and can comprise a video source VS which provides a video composite signal. The host unit HU will also provide information with respect to the coordinates or positions of the windows and the properties of the window to the picture quality enhancement unit PQE.

The picture quality enhancement unit PQE comprises a window managing unit WMU, a sharpening unit SU, a natural motion unit NMU, a scaling unit SCU, a border unit BU, a mixing unit MU, optionally a color gamut unit CGU and optionally a contrast booster unit CBU. Based on the information from the host unit HU with respect to the coordinates and properties of the windows (e.g. background window, photo window, overlay window and/or life window) in the window signal, several branches of the main video stream will be processed individually and can be mixed in the mixer unit MU.

The host unit HU may receive the video data from a storage device via an interface or it can be received via an antenna. Typically, the video data is heavily compressed in order to save transmission bandwidth as well as storage space. The host unit HU is adapted to decode the video data from the video source VS. The host unit HU may be able to provide a RGB video stream or another equivalent video stream.

The picture quality enhancement unit PQE can be implemented on the same chip as the host unit HU. However, alternatively, the picture quality enhancement unit PQE can also be implemented on a separate chip or as a separate device.

By means of the mixing unit, the video data as enhanced by the sharpening unit SU, the natural motion unit NMU, the scaling unit SCU and the border unit BU can be blended into a background window comprised in the composite video data. Furthermore, during the blending of the enhanced video data into a background window, the size, position and orientation of the overlay window can be freely selected. This can for example be performed if the natural motion unit NMU comprises a frame memory enabling a translation and rotation of the enhanced video data.

Fig. 2 shows a block diagram of an electronic device according to a second embodiment. The electronic device according to the second embodiment comprises a host unit HU, a picture quality enhancement unit PQE, a first display driver Dl, a first display panel MDP, a LED booster unit LBl, a LED backlight unit BUl, a second display driver DD2, a second display unit SDP, a second LED booster unit LB2 and a second LED backlight BU2. Here, the electronic device comprises a main display panel MDP and a supplementary display panel SDP each with a backlighting unit BUl, BU2. The picture quality enhancement unit may provide processed video data to the first display driver DDl as well as to the LED booster units LBl which are controlling the backlighting units. The picture quality enhancement unit PQE may be adapted to control the backlighting units BUl, BU2 to enhance the quality of the separate windows individually.

Fig. 3 shows a schematic representation of an electronic device according to a third embodiment. The electronic device according to the third embodiment comprises a baseband application engine BBAE, a picture quality enhancement unit PQE and a display module DM. The baseband application engine BBAE provides a composite image or composite video data. The picture quality enhancement unit PQE receives composite image and video data which may comprise several windows and performs the respective picture quality enhancement processing on each window individually. The picture quality enhancement unit PQE receives a composite image or video, i.e. it will not receive the individual streams for video, graphics and overlay data. The composite video data may include a background window with graphics, a graphics window, a photo window with a natural image, a life video window and/or an overlay window with on-screen display information. Accordingly, although the baseband application engine BBAE provides a composed image or composite image, the picture quality enhancement unit PQE is able to perform a picture quality enhancement processing on each of the windows individually. This can be achieved if the baseband application engine forwards side channel information to the picture quality enhancement unit. The side band information may comprise information to define various windows like graphics windows, photo windows, overlay windows and life windows. Accordingly, each window can be processed according to its requirements.

Afterwards, the different windows can be mixed together into a single composite but enhance image or video. The picture quality enhancement unit PQE is able to process four layers or windows, each relating to a specific window, namely a back window which can be unprocessed, a photo window which can be sharpened, an overlay window and a life window with an enhanced motion processing.

In the following, the window managing processing will be described in more detail.

Fig. 4 shows a basic representation of an image composition with several windows. The image composition may comprise a back window BW, a photo window PW, an overlay window OW and a life window LW. On the right hand side of Fig. 4, the depth relationship of the different windows is depicted. At the bottom of the windows, the back window BW is arranged. On top of the back window BW, the photo window PW is arranged. In turn, on top of the photo window PW, an overlay window OW is arranged. The life window LW will be arranged on top of each of the other windows. Fig. 5 shows a basic representation of an illustration of the window coordinates. The backsize BS may correspond to the size of the display. Furthermore, the window coordinates of the photo window PW, the overlay window OW and the life window LW is depicted. Fig. 6 shows a representation of the backframe BF, the photo frame PF, the overly frame OF and the life frame LF. For example, the image of the photo frame PF can be sharpened while the images of the life frame LF can be motion enhanced, sharpened and scaled. In other words, each window is processed individually according to their coordinates and properties. Fig. 7 shows a block diagram of a window composer according to an embodiment of the invention. Here, a picture quality enhancement unit PQE is provided which comprises a sharpening unit SU, a natural motion unit NMU, a sealer S, a mixer Unit MU and a display processor DP. A content handling unit CH is coupled to the picture quality enhancement unit. The content handler CH will receive an image descriptor ID, an image frame IF and a command to configure the function by the host unit. The content handler CH will output a state to the host unit. The content handler CH can split the image frame into 3 parts and output natural content NC, overlay information O and graphic information G. The picture quality enhancement unit PQE will output enhanced brightness information towards the display backlight and enhanced video information towards the display driver. The principles of the invention can also be applied in a car entertainment system.

According to the invention, the picture quality enhancement unit will receive input images which are already composed by the host unit, i.e. it may comprise graphics, photo and video data. This data can be separated, processed separately and recombined into a new composition. The principles of the invention can be implemented for streaming video processing. The above described host unit or host processor serves as input source for the picture quality enhancement unit.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps other than those listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. In the device claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Furthermore, any reference signs in the claims shall not be constrained as limiting the scope of the claims.

Claims

Electronic device and method of enhancing the picture quality of composite video data having at least one window CLAIMS:

1. Electronic device, comprising a picture quality enhancement unit (PQE) for receiving composite video data having at least one window and information with respect to a position and properties of the at least one window from a host unit (HU) and for enhancing the composite video data by processing each of the at least one windows in the composite video data individually based on the information with respect to the position and properties of the at least one window and for outputting an enhanced composite video data signal having the at least one window.

2. Electronic device according to claim 1, wherein the picture quality enhancement unit (PQE) comprises: a window managing unit (WMU) for managing the processing of the at least one window comprised in the composite video data based on the information with respect to the position and the properties of the window as received by the host unit (HU), a sharpening unit (SU) for sharpening content of the at least one window, - a natural motion unit (NMU) for performing a national motion processing on the at least one window, a scaling unit (SCU) for scaling content of the at least one window, and/or a border unit (BU) for performing a border processing of the at least one window, wherein the picture quality enhancement unit (PQE) comprises a mixing unit

(MU) for mixing the outputs of the video managing unit (VMU), the sharpening unit (SU), the natural motion unit (NMU), the scaling unit (SCU) and/or the border unit (BU) to provide enhanced video data.

3. Electronic device according to claim 2, wherein: the composite video data may comprise at least one of a background window (BW), a photo window (PW), an overlay window and a life window, and wherein the mixing unit (MU) is adapted for blending the enhanced video data into the background window comprised in the video data.

4. Electronic device according to claim 2 or 3, wherein a size, position and orientation of an overlay window in the composite video signal can be freely selected.

5. Electronic device according to claim 2, 3 or 4, wherein the mixing unit (MU) is adapted for blending enhanced video data into a background window in dependence on the enhanced video data, a life video window, and/or a programmable color-key.

6. Electronic device according to any one of the claims 1 to 5, wherein the picture quality enhancement unit (PQE) is adapted for display enhancement processing after the enhanced video data has been mixed by the mixing unit (MU) with the background window.

7. Electronic device according to claim 1 to 6, further comprising at least one display module (MDP), a backlighting unit (BUl) for backlighting the display module (MDP, SDP), wherein the picture quality enhancement unit (PQE) is adapted to control the operation of the backlighting unit (BUl, BU2) such that the operation of the backlighting unit (BUl, BU2) serves to enhance the quality of the display.

8. Video processor, comprising a picture quality enhancement unit (PQE) for receiving composite video data having at least one window and information with respect to a position and properties of the at least one window from a host unit (HU) and for enhancing the composite video data, by processing each of the at least one windows in the composite video data individually based on the information with respect to the position and properties of the at least one window and for outputting an enhanced composite video data signal having the at least one window.

9. Method for enhancing a picture quality of composite video data having at least one window, comprising the steps of: receiving composite video data having at least one window and information with respect to the position and properties of at least one window, enhancing the composite video data by processing the at least one window in the composite video data individually based on the information with respect to the position and properties of the at least one window, and outputting enhanced video data having the at least one window.

10. Display apparatus, comprising at least one electronic device according to one of the claims 1 to 7, and a display for displaying the output video data of the picture quality enhancement unit (PQE).