GB2527738A - Method and apparatus for controlling a display - Google Patents

Method and apparatus for controlling a display Download PDF

Info

Publication number
GB2527738A
GB2527738A GB1408358.8A GB201408358A GB2527738A GB 2527738 A GB2527738 A GB 2527738A GB 201408358 A GB201408358 A GB 201408358A GB 2527738 A GB2527738 A GB 2527738A
Authority
GB
United Kingdom
Prior art keywords
image
transform process
display
characteristic
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1408358.8A
Other versions
GB201408358D0 (en
GB2527738B (en
Inventor
Michael Tusch
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apical Ltd
Original Assignee
Apical Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apical Ltd filed Critical Apical Ltd
Priority to GB1408358.8A priority Critical patent/GB2527738B/en
Publication of GB201408358D0 publication Critical patent/GB201408358D0/en
Priority to US14/709,698 priority patent/US9947297B2/en
Publication of GB2527738A publication Critical patent/GB2527738A/en
Application granted granted Critical
Publication of GB2527738B publication Critical patent/GB2527738B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/363—Graphics controllers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57—Control of contrast or brightness
    • H04N5/58—Control of contrast or brightness in dependence upon ambient light
    • G06T5/92—
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G09G3/3413—Details of control of colour illumination sources
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0613—The adjustment depending on the type of the information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0613—The adjustment depending on the type of the information to be displayed
    • G09G2320/062—Adjustment of illumination source parameters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/066—Adjustment of display parameters for control of contrast
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0693—Calibration of display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data

Abstract

In a method of enhancing the appearance of a digital image on an electronic display, an image transform process 16 is controlled according to at least one display condition, such as sensed ambient light or screen brightness, as well as at least one characteristic of an image to be displayed, this being determinable without analysis for the image data. Ambient Light Sensor (ALS) and Screen Brightness (SB) inputs may be combined with a calibration input 12 to generate a first strength parameter 22, including a component dependent only upon the properties of the display. A further, content-based input 24 is also combined to generate a second strength parameter 26, including a component dependent only upon a content type (e.g. game image, digital photograph, moving picture frame, graphical user interface (GUI), etc), and/or quality (e.g. bit-rate, quantization parameter, etc). The extent of display condition-based control may be determined prior to determining the extent of image-based control. The image transform process may be calibrated to display properties, and may be a fixed or image-adaptive transform, e.g. adaptive different to different image regions. A gain applied to dark image regions may be specified.

Description

Method and Apparatus for Controlling a Display The present invention relates to a method and art apparatus for controlling a disp].ay, and is concerned particularly with a method and an apparatus for enhancing the appearance of a digital image displayed on an electronic display in the presence of ambient light.
Because of the limited brightness of the screen and the reflection of ambient light from the surface(s) of the display, the appearance of a digital image may differ from its ideal appearance in the absence of ambient light. In particular, parts of the image that are relatively dark may become hidden by screen reflections. The degree to which an image with bright and dark parts becomes distorted by ambient light will depend cn the brightness of the display and on the amount of ambient light. One previousl.y considered method for reducing the distortion of image appearance caused by ambient light is to increase the brightness of the display in dependence on the ambient light. Additionally, the digital values of the image itself may be adjusLed, in order La increase the actual brightness of part, or all, of the image.
It is known for the screen brightness (SB) to be adjusted automatically based on ambient light as measured by an ambient light sensor (ALS) . Also, methods of improving the visibility of digital images on displays are known, whereby an image processing algorithm is controlled by the ALS. An example is described in WO 2006/072866.
In practice, the ALS values are filtered in time to avoid fast fluctuations in SB and image appearance, as described for example in WO 2014/041193. In such a system, the device incorporates an algorithm that converts the measured ALS value into one or more parameters that a.ftect the strength of digital image processing. This may be via a mathematical formula or a look-up-table (LUT) that provides a value of such a "strength" parameter for a series of input values of ALS and interpolation between them.
A simple relationship is as follows: Strength F(AT.S) min(strengthmax,ajpha*ALS) (1) where alpha is a tuning parameter and strengt}irnax is the maximum possible strength of the transform. Other relaLionships F between strength and ALS can be considered which may involve morc than a singl.e parameter and may be non-linear, in order to improve the overall appearance of the displayed image.
The strength parameter may be related to the gain applied to each pixel in the image, gain being defined such thai: a pixel value after image transformation equals the input pixel value multiplied by the gain value. In the simplest case, the gain can be a constant value, and output values that exceed the maximum digital value of the image (for example, R=255,G=255,B=255 in a standard 8-bit image) are clamped at their maximum values.
In the above example, gain is set equal to strength. The larger the value of alpha, the greater the gain that will be applied to the image as a function of ALS and therefore the brighter the image will appear as ambient light increases. Alpha is chosen in dependence on the display itself. The more reflective the display, the greater the S value of alpha needed to preserve the visibility of dark pixels in the presence of screen reflections. An optimal value of alpha may be determined in order to minimize the perceived distortion of the image caused by the presence of ambient light.
Such a simple method typically gives poor image quality.
Much better results are obtained by an adaptive space-variant algorithm such as is described in "ORMIT" US 7,302,110. This gives better results because the gain in bright areas, which are most resilient to the effects of changes in ALS and SB, can be made near to unity, while the gain in dark areas1 which are most affected by changes in ALS and SB, can be made much larger.
For an adaptive transform such as ORMIT, a corresponding value of strength can be defined, and related to the gain applied to pixels in the dark part of an image, as described in WO 2006/072356.
The value of screen brightness can also be used as an additional means of controlling strength, such that strength increases further if the screen brightness becomes reduced from its maximum value. In this case, the formula (1) is modified to include a term that depends on SB.
A limitation of the abcve method is that the value of strength for the ideal visual, experience may differ from one type of content to another. For example, in the case of movie content compressed with low quality, it may be desirable to select a low strength value to avoid revealing compression artefacts, while in the case of a movie compressed with high quality it may be desirable to select a higher strength to reveal detail otherwise lost in shadow areas. In addition, it may be desirable to set another strength value for a graphical game, in order to reveal yet further shadow detail. As a result, an average value of strength must be chosen which is not optimal for any specific content type. It is therefore desirable to have a method which retains the ability to deliver a good visual experience when the type of contenL is unknown but which can deliver an optimal visual experience when the type of content is known.
The present invention is defined in the attached independent claims, to which reference should now be made.
Further, preferred features may be found in the sub-claims appended thereto.
According to one aspect of the present invention, there is provided a method of enhancing the appearance of a digital image on an electronic display, the method comprising controlling an image transform process according to at least one condition of the display, and controlling the image transform process according to at least one characteristic of the image to be displayed.
Preferably the characteristic is determinable without analysis of the image data.
The method may comprise controlling the image transform process according to a condition of the display which condition comprises a sensed ambient light. Alternatively or in addition the method may comprise controlling the image transform process according to a screen brightness of the display.
The method preferably comprises controlling the image transform process in accordance with a characteristic of the image to he displayed, which characteristic comprises the image content type. The image content type may be any of the following, but not limited to: a game image, a digital photograph and a frame of a moving picture.
Alternatively or in addition the method may comprise controlling the image transform process in accordance with a characteristic of the image to be displayed, which characteristic comprises a quality-related parameter, such as but not limited to bit-rate or quantization parameter of the image to be displayed.
In a preferred arrangement the extent to which control must be performed according to a condition of the display is determined prior to determining the extent to which control must be performed according to a characteristic of the image to be displayed.
In a preferred arrangement, the method comprises calibrating the image transform process according to one or more properties of the disp]ay.
The method may comprise a method of enhancing an image comprising a still image. Alternatively or in addition, the method may comprise a method of enhancing an image comprising a moving image.
S
The method may comprise using an image transform process to adjust image data values from their original data values.
The image transform process may be fixed for all ±mages.
Alternatively the image transform process may be adaptive to the image. The image transform process may be adaptive differently to different regions of the image on the screen.
The method may include Lhe step of specifying the amount of gain to be applied to the image data. Preferably the method comprises specifying a gain value to be applied to portions of an image corresponding to dark regions.
The invention also includes apparatus for enhancing the appearance of a digital image on ar electronic display, the apparatus comprising an image transform process controlled according to at least one condition of the display, arid according to at least one characteristic of the image to he displayed.
Preferably the characteristic is determinable without analysis of the image data.
The image transform process may be controlled according to a condition of the display which condition comprises a sensed ambient light. Alternatively or in addition thc image transform process may be controlled according to a screen brightness of the display.
The image transform process may be controlled in accordance with a characteristic of the image to be displayed, which characteristic comprises the image content type. The image content type may be any of the following, but not limited to: a game image, a digital photograph, a frame of a moving picture, and a graphical user interface.
Alternatively or in addition the image transform process may be controlled in accordance with a characteristic of the image to be displayed, which characteristic comprises a quality-related parameter, such as but not limited to bit-rate or quantization parameter of the image to be displayed.
In a preferred ari.angement the exten to which control must be performed according to a condition of the display is determined prior to determining the extent to which control must be performed according to a characteristic of the image to be displayed.
In a preferred arrangement, the image transform process may be arranged to be calibrated according to one or more properties of the display.
The image transform process may be arranged in use to adjast image data values from their original data values.
The image transform process may be arranged to adjust image data in a manner that is fixed for all images.
Alternatively the image transform process may be adaptive to the image. The image transform process may be adaptive differently to different regions of the image on the careen.
The invention also comprises a program for causing a device to perform a method of enhancing the appearance of a digital image on an electronic display, the method comprising controlling an image transform process according to at least one condition of the display, and controlling the image transform process according to at least one characteristic of the image to be displayed.
The invention also comprises a computer program product, storing, carrying or transmitting thereon or therothi-ough a program for causing a device to perform a method of enhancing the appearance of a digital image on an electronic display, the method comprising controlling an image transform process according to at least one condition of the display, and controlling the image transform process according to at least one characteristic of the image Lo be displayed.
The invention may include any combination of the features or limitations referred to herein, except such a combination of features as are mutually exclusive, or mutually inconsistent.
A preferred embodiment of the present invention will now be described. By way of example only, with reference to the accompanying diagrammatic drawings, in which: Figure 1 shows schematically a previously considered method for controlling an image transform engine; Figure 2 shows schematically a method of controlling an image transform engine according to an embodiment of the present invention; Figure 3 shows schematically an implementation of the method depicted in Figure 2; and Figure 4 is a graph showing strength of image transform as a function of ALS for different values of a parameter beta.
The key part of the invention relates to the modification of the strength parameter of Equation 1 in dependence on a characteristic of the image being displayed.
it is usually found that the most optimal value of strength at given ALS and SB values depends on the type of image being displayed. For example, the most desirable value of strength may be greatest for a graphical image, such as a frame of an iinnersive game, may be lesser for a digital.
phoLograph, and may be lesser still for the frame of a movie. And for a movie, the optimal. value of strength may depend on the compression quality of the movie, because increasing strength increases the visibility of compression artefacts, which is undesirable. Therefore a movie encoded with high quality may be optimally displayed using a strength parameter greater than that of the same movie encoded with low quality.
Therefore it is desirable to have a method whereby the value of strength obtained automatically by Equation (1) or a generalization thereof, which does not depend on the type or quality of the image content itself, can be further modified based on the properties of the specific type of image content being displayed at a particular time. Note that by "type of content" it is not implied that the parameter should be varied based on the specific image, but rather the type of image (movie frame, game, photograph, user interface for example) -To achieve this, the following scheme is provided; * The device is calibrated at time of production with an alpha parameter setting based on an average over all kinds of content which will be displayed on Lhe device * A software application may offset this value based on the type or quality of content being displayed.
In other words, we replace Equation (1) by: strength = min(strengthmax, beta* alpha * P15) (2) where alpha is dependent only on the display properties and beta is dependent only Lho type or quality of content.
It is important to note that the parameter alpha is tuned to compensate for variations in the display properties, primarily its reflectivity. This reduces variation in distortion of the displayed image between different kinds of displays. Therefore the beta parameter can be tuned purely based on Lho type of content, and independent of L:he display itself. This is practically very important since it would not be practical for a software application, which must run on many different types of devices, to have to select a tuning parameter that depends on each individual device type.
Thus the alpha parameter is tuned one time as a one-off factory calibration, whereas the beta parameter is tuned at the time the specific content is displayed.
Different values of beta may be chosen for different types of content. For example, a graphical game may select a value of beta2, meaning that shadow detail is twice as bright as it would be for standard content, at each given ThIS value.
For movies, beta may be chosen in dependence of the quality of the content since, as mentioned above, the primary factor affecting the quality of the enhanced image is the amount of compression artefacts that are present.
For example, beta movie=G(biLrate) or, better: beta movje=G (1 /QP) where OP is the wall-known quantization parameter that affects the amount of spatial detail which is preserved by the compression algorithm. In a simple example, G=garnraa* (i.e. multiply by a further tun-ing parameter gamma) Typically, the alpha parameter will be set by the device OS via the dispiLay driver, while the beta parameter will be set by the application which delivers the particular image content.
Turning to Figure 1, this shows schematically, generally at 10 a previously considered method of controlling an image transform engine in which ambient light sensor (ALS) and screen brightness (SB) inputs are combined with a screen calibration parameter 12 to determine a strength parameter 14 for controlling the image transform 16. The image transform converts inpi.it image data 13 to output image data accordingly.
Figure 2 illustrates schematically a method according to an embodiment of the present invention. ALS and SB inputs are combined with a calibration input 12 as before to generate a first strength parameter 22, including an alpha component that is dependent only upon the properties of the display.
Thon a further, content-based input 24 is also combined to generate a second strength parameter 26, including a beta component that is dependent only upon a content type, or a content quality, or both.
The image Lransform 16 again converts the inpuL image data 18 to output image data 20, but now the output image data 20 is optimised for the ambient light, the screen brightness, the characteristics of the particular display and the content of the image.
Figure 3 illustrates schematically an implementation of the scheme of Figure 2, in this case on a smartphone 28. The ambient light sensor inputs to the operating system 30 which controls a display driver. One or more calibration parameters 12 are also input to the operating system offline. An application 32 delivers image content and also provides one or more content-relevant parameters 34 for further control of the image data transform process. The operating system, via the display driver, then provides a combined image processing parameter 34 to a video processing engine 36.
Turning to Figure 4, this illustrates graphically a strength parameter strength max (y-axis) as a function of ambient light sensed (ALS) (x-axis) . The broken line represents a content-based adjustment parameter beta, where beLa 1, corresponding to an unknown imagery. The solid line represents a beta value of 2, corresponding to a high-qualiLy movie or game imagery.
In accordance with embodiments of the invention, an image transform.i.s used to process an imago or video to be displayed. The transform is controlled in accordance with a parameter or set of parameters dependent on the properties of the display and also in accordance with another parameter or parameters dependent on the prcperties or characteristics of the type of imagc or video to be displayed.
The characteristic of the image is not readily determined by analysis of the pixels, but is something that is delivered additionally to the image data. An example would be that the image data is labelled as a photograph.
Therefore the image transform is adapted to the image in two separate ways; the overall strength of the transform, which controls the maximum gain that can be applied to the darkest parts of any image, is determined according to the image type, while the actual gain applied to an individual pixel of a specific image may be determined adaptively based on a statistical analysis of the image histogram for
S example.
An image transform engine is used to adjust image data values from their original values. The transform engine is controlled based on the ambient light or the screen brightness or both. The control method is calibrated based on the properties or characteristics of the display and is further modified based on the properties of the image being displayed The image transform may be a fixed transform for all images or may be adaptive to the original image. In particular, the image transform may be adaptive differently to different regions of an image. When the image transform engine is adaptive to the image, the control method may consist of specifying the amount of gain to be applied to portions of an image which correspond to relatively dark regions as displayed.
The type of content can be determined, for example, from the file typo (e.g. JPEG) or via an application running on the device which has a priori knowledge about the type of content which is being rendered locally on the device or which is been downloaded or streamed from a remote server.
hilst endeavouring in the foregoing specification to draw attention to those features of the invenLion believed to he of particular importance, it should be understood that the applicant claims protection in respect of any patentable feature or combination of features referred to herein and/or shown in the drawings, whether or not particular emphasis has been placed thereon.

Claims (25)

  1. CLAIMS1. A method of enhancing the appearance of a digital image on an electronic display, the method comprising controlling an image transform process according to at least one condition of the display, and controlling the image transform process according to at least one characteristic of the image to be displayed, which characteristic is determinable without analysis of the image data.
  2. 2. A method according to Claim 1, comprising controlling the image transform process according to a condition of the display which condition comprises a sensed ambient light.
  3. 3. A method according to claim 1 or 2, comprising controlling the image transform process according to a condition of the display which condition comprises a screen brightness of the display.
  4. 4. A rnebhod according to any of the preceding claims, wherein the method comprises controlling the image transform process in accordance with a characteristic of the image to be displayed, which characteristic comprises the image content type.
  5. 5. A method according to Claim 4, wherein the image content type comprises any of the following: a game image, a digital photograph, a frame of a moving picture and a graphical user interface.
  6. 6. A method according to any of the preceding claims comprising controlling the image transform process in accordance with a characteristic of the image to be displayed, which characteristic comprises a quality-related parameterf such as bit-rate or quantizalion parameter of the image to be displayed.
  7. 7. A method according to any of Claims 1-6, wherein the extent to which control must be performed according to a condition of the display is determined prior to determining the extent to which control must be performed according to a characteristic of the image to be displayed.
  8. 8. A method according to any of the preceding claims, comprising calibrating the image transform process according to one or more properties of the display.
  9. 9. A method according to any of the preceding claims, wherein the image transform process ie fixed for all images.
  10. 10. A method according to any of Claims 1-8, wherein the image transform process is adaptive to the image.
  11. 11. A method according to Claim 10, wherein the image transform process is adaptive differently Lo different regions of the image on the screen.
  12. 12. A method according to any of the preceding claims, comprising specifying a gain value to be applied to portions of an image corresponding to dark regions.
  13. 13. Apparatus for enhancing the appearance of a digital image on an electronic display, the apparatus comprising an image transform process controlled 3 according to at least one condition of the display, and according to at least one characteristic of the image to be displayed, which characteristic is determinable without analysis of the image data.
  14. 14. Apparatus according to Claim 13, wherein the image transform process is controlled according to a condition of the display which condition comprises a sensed ambient light.
  15. 15. Apparatus according to Claim 13 or 14, wherein the image transform process is controllcd according to a screen brightness of the display!
  16. 16. Apparatus according to any of Claims 13-15, wherein the image transform process is controlled in accordance with a characteristic of the image to be displayed, which characteristic comprisos the image content type.
  17. 17. Apparatus according to Claim 16, wherein the image content type may be any of the following: a game image, a digital photograph, a frame of a moving picture and a graphical user interface.
  18. 18. Apparatus according to any of Claims 13-17, wherein the Image transform process is controlled in accordance with a characteristic of the image to be displayed, which characteristic comprises a quality-related parameter, such as bit-rate or quantization parameter of the image to be displayed.
  19. 19. Apparatus according to any of Claims 13-18, wherein the extent to which control must be performed according to a condition of the display is determined prior to determining the extent to which control must be performed according to a characteristic of the image to be displayed.
  20. 20. Apparatus according to any of Claims 13-19, wherein the image transform process is arranged to be calibrated according to one or more properties of the display.
  21. 21. Apparatus according to any of Claims 13-20, wherein the image transform process is arranged in use to adjust image data values from their original data values.
  22. 22. Apparatus according to any of Claims 13-21, wherein the image transform process is arranged to adjust image data in a manner that is fixed for all images.
  23. 23. Apparatus according to any of Claims 13-21, wheroin the image transform process is adaptive differently to different regions of the image on the careen.
  24. 24. A program for causing a device to perform a method of enhancing the appearance of a digital image on an electronic display, the meLhod comprising controlling an image transform process according to at least one condition of the display, and controlling the image transform process according to at least one characteristic of the image to be displayed, which characteristic is determinable without analysis of the image data.
  25. 25. A computer program product, storing, carrying or transmitting thereon or therethrough a program for causing a device to perform a method of enhancing the appearance of a digital image on an electronic display, the method comprising controlling an image transform process according Lo at least one condition of the display, and controlling the image transform process according to at least one characteristi.c of the image to be displayed, which characteristic is determinable without analysis of the image data.
GB1408358.8A 2014-05-12 2014-05-12 Method and apparatus for controlling a display Active GB2527738B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB1408358.8A GB2527738B (en) 2014-05-12 2014-05-12 Method and apparatus for controlling a display
US14/709,698 US9947297B2 (en) 2014-05-12 2015-05-12 Method and apparatus for controlling a display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1408358.8A GB2527738B (en) 2014-05-12 2014-05-12 Method and apparatus for controlling a display

Publications (3)

Publication Number Publication Date
GB201408358D0 GB201408358D0 (en) 2014-06-25
GB2527738A true GB2527738A (en) 2016-01-06
GB2527738B GB2527738B (en) 2020-08-12

Family

ID=51032603

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1408358.8A Active GB2527738B (en) 2014-05-12 2014-05-12 Method and apparatus for controlling a display

Country Status (2)

Country Link
US (1) US9947297B2 (en)
GB (1) GB2527738B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10388247B2 (en) * 2016-03-29 2019-08-20 Bby Solutions, Inc. Dynamic display device adjustment for streamed video
CN106060615B (en) * 2016-05-23 2020-05-22 Tcl海外电子（惠州）有限公司 Judgment method and device for realizing screen parameter automatic matching by using optical sensor
KR102554379B1 (en) * 2016-10-31 2023-07-11 엘지디스플레이 주식회사 Image processing method and module for high dynamic range (hdr) and display device using the same
CN107854840B (en) * 2017-12-06 2020-09-29 北京像素软件科技股份有限公司 Eye simulation method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998048571A1 (en) * 1997-04-23 1998-10-29 Thomson Consumer Electronics, Inc. Control of video level by region and content of information displayed
US20020109789A1 (en) * 1998-09-28 2002-08-15 Mitsubishi Denki Kabushiki Kaisha Image display device with controlled image quality
US7302110B2 (en) * 2001-05-02 2007-11-27 Apical Ltd Image enhancement methods and apparatus therefor
US20100118198A1 (en) * 2007-03-23 2010-05-13 Pioneer Corporation Video quality adjustment support unit, video signal processing unit, and video quality adjustment support method
WO2011004804A1 (en) * 2009-07-06 2011-01-13 シャープ株式会社 Video display device and video display method
WO2011013669A1 (en) * 2009-07-27 2011-02-03 シャープ株式会社 Display device, program, and computer-readable storage medium having program recorded therein

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0500149D0 (en) 2005-01-05 2005-02-16 Koninkl Philips Electronics Nv Emissive display device
EP1720149A3 (en) * 2005-05-02 2007-06-27 Semiconductor Energy Laboratory Co., Ltd. Display device
US7679602B2 (en) * 2006-09-22 2010-03-16 Aptina Imaging Corporation Graphical user interface based control of imaging parameters including scene illumination parameters
KR100836433B1 (en) * 2007-02-05 2008-06-09 삼성에스디아이 주식회사 Organic light emitting display device and driving method thereof
KR100836438B1 (en) * 2007-02-05 2008-06-09 삼성에스디아이 주식회사 Organic light emitting display device and driving method thereof
KR100836432B1 (en) * 2007-02-05 2008-06-09 삼성에스디아이 주식회사 Organic light emitting display device and driving method thereof
US20140049527A1 (en) * 2012-08-15 2014-02-20 Dell Products L.P. Dynamic backlight control with color temperature compensation
WO2014041193A2 (en) 2012-09-17 2014-03-20 Apical Ltd Method and device for ambient light estimation

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998048571A1 (en) * 1997-04-23 1998-10-29 Thomson Consumer Electronics, Inc. Control of video level by region and content of information displayed
US20020109789A1 (en) * 1998-09-28 2002-08-15 Mitsubishi Denki Kabushiki Kaisha Image display device with controlled image quality
US7302110B2 (en) * 2001-05-02 2007-11-27 Apical Ltd Image enhancement methods and apparatus therefor
US20100118198A1 (en) * 2007-03-23 2010-05-13 Pioneer Corporation Video quality adjustment support unit, video signal processing unit, and video quality adjustment support method
WO2011004804A1 (en) * 2009-07-06 2011-01-13 シャープ株式会社 Video display device and video display method
WO2011013669A1 (en) * 2009-07-27 2011-02-03 シャープ株式会社 Display device, program, and computer-readable storage medium having program recorded therein

Also Published As

Publication number Publication date
US20150325208A1 (en) 2015-11-12
GB201408358D0 (en) 2014-06-25
US9947297B2 (en) 2018-04-17
GB2527738B (en) 2020-08-12

Similar Documents

Publication Publication Date Title
EP1242975B1 (en) Digital imaging
US10134359B2 (en) Device or method for displaying image
JP6362793B2 (en) Display management for high dynamic range video
JP6367839B2 (en) Display management for high dynamic range video
KR101625362B1 (en) Method for converting input image data into output image data, image conversion unit for converting input image data into output image data, image processing apparatus, display device
JP5259785B2 (en) Visual processing device, visual processing method, television, portable information terminal, camera and processor
EP1292118A2 (en) Tone scale adjustment of digital images
US9947297B2 (en) Method and apparatus for controlling a display
KR101629825B1 (en) Display apparatus and method using high dynamic range for vehicle
JP2007310887A (en) Automatic mapping method of image data, and image processing device
CN108012050B (en) Image brightness adjusting method, system and computer readable storage medium
US8781248B2 (en) Image details preservation and enhancement
US11361410B2 (en) Image denoising in SDR to HDR image conversion
JP2006114005A (en) Gradation conversion apparatus, program, electronic camera, and method therefor
JP4758999B2 (en) Image processing program, image processing method, and image processing apparatus
JP2008072450A (en) Image processor and image processing method
Reflectance–Illuminance Retinex image processing: improving the visual realism of color images
Jung et al. Naturalness-preserved tone mapping in images based on perceptual quantization
JP2011120299A (en) Gradation conversion apparatus, program, electronic camera, and method therefor
JP2009508173A (en) Video-level dynamic soft clipping
US20200053333A1 (en) Circuit for controlling image capturing device and associated control method
JP3596410B2 (en) Image signal processing apparatus and processing method thereof
KR20160025876A (en) Method and apparatus for intensificating contrast in image
KR102477391B1 (en) Method for image processing, image signal processor and termainal device
Guarnieri et al. Nonlinear mapping for dynamic range compression in digital images

Legal Events

Date Code Title Description
732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20220929 AND 20221005