EP3338273A1 - Electronic display with environmental adaptation of display characteristics based on location - Google Patents

Electronic display with environmental adaptation of display characteristics based on location

Info

Publication number
EP3338273A1
EP3338273A1 EP16837775.2A EP16837775A EP3338273A1 EP 3338273 A1 EP3338273 A1 EP 3338273A1 EP 16837775 A EP16837775 A EP 16837775A EP 3338273 A1 EP3338273 A1 EP 3338273A1
Authority
EP
European Patent Office
Prior art keywords
sunrise
sunset
display
gamma
electronic display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP16837775.2A
Other languages
German (de)
French (fr)
Other versions
EP3338273A4 (en
Inventor
John Schuch
William Dunn
Rick De Laet
Dan Safstrom
Harry Presley
Jerry Wasinger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MRI Inc
Manufacturing Resources International Inc
Original Assignee
MRI Inc
Manufacturing Resources International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/043,100 external-priority patent/US9924583B2/en
Application filed by MRI Inc, Manufacturing Resources International Inc filed Critical MRI Inc
Publication of EP3338273A1 publication Critical patent/EP3338273A1/en
Publication of EP3338273A4 publication Critical patent/EP3338273A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10Intensity circuits
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05BELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10Controlling the light source
    • H05B47/16Controlling the light source by timing means
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0673Adjustment of display parameters for control of gamma adjustment, e.g. selecting another gamma curve
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/14Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/16Calculation or use of calculated indices related to luminance levels in display data
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02BCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
    • Y02B20/40Control techniques providing energy savings, e.g. smart controller or presence detection

Definitions

  • the exemplary embodiments herein pertain to a display and a method that utilizes measured or calculated properties of the viewing environment in order to automatically vary the visual characteristics of a display according to a set of predefined rules. Some embodiments provide an autonomous display that exhibits optimal visual perception for image reproduction at all environmental viewing conditions.
  • Displays are used in a very wide range of applications, including entertainment (e.g., television, e-books), advertisement (e.g., shopping malls, airports, billboards), information (e.g., automotive, avionics, system monitoring, security), and cross-applications (e.g., computers, smart phones).
  • entertainment e.g., television, e-books
  • advertisement e.g., shopping malls, airports, billboards
  • information e.g., automotive, avionics, system monitoring, security
  • cross-applications e.g., computers, smart phones.
  • the exemplary embodiments herein utilize location-based and/or time-based determinations of ambient conditions in conjunction with stored characteristic display data to dynamically (in real-time) process and alter an image and/or video signal so that key display performance parameters such as brightness, black level, gamma, saturation, hue, and sharpness would be perceived as optimal, meaning they are tuned to their best intended rendering for the given viewing conditions.
  • Other embodiments also provide the method by which a display is calibrated to perform as described as well as the method for performing the dynamic performance process.
  • FIGURE 1 is a graphical representation of a typical image reproduction process.
  • FIGURE 2 is a block diagram for a signal encoding and decoding process.
  • FIGURE 3 is a graphical representation of image signal transformations per ITU-R BT.709/1886.
  • FIGURE 4 is a graphical representation of end-to-end power vs. ambient illumination.
  • FIGURE 5 is a graphical representation of end-to-end power vs. ambient illumination in a discrete implementation.
  • FIGURE 6 is a block diagram for the basic elements in an embodiment of the invention.
  • FIGURE 7 is an illustration of reflected ambient light and its relationship with displayed light.
  • FIGURE 8 is a logical flow chart for performing an exemplary embodiment of location-based determinations of ambient conditions.
  • FIGURE 9 is block diagram for an embodiment using post-decoding adjustment of black level and/or linearity.
  • FIGURE 10 is a graphical representation of example signal transforms of Figure 8 using Equation (2).
  • FIGURE 11 is a block diagram of an alternate embodiment for post-decoding adjustment.
  • FIGURE 12 is a block diagram of an embodiment for pre-decoding adjustment of black level and/or linearity.
  • FIGURE 13 is a graphical representation of example signal transforms of Figure 11 using Equation (4).
  • FIGURE 14 is graphical representation of example signal transforms of Figure 11 using Equation (5).
  • FIGURE 15 is graphical representation of example signal transforms of Figure 11 using Equation (6).
  • FIGURE 16 is graphical representation of example signal transforms of Figure 11 using Equation (7).
  • FIGURE 17 is a detailed view of the lower left hand corner of Figure 15.
  • FIGURE 18 provides a logical flowchart for performing an embodiment that uses the AAS technique during sunset/sunrise transition times while using a nighttime/daytime level for the remaining times.
  • FIGURE 19 provides a logical flowchart for performing an embodiment that uses the AAS technique with only a single transition period while using nighttime/daytime instructions for the remaining times.
  • FIGURE 20 provides a logical flowchart for performing the advanced embodiment that uses the AAS technique during sunset/sunrise transition times as well as the daytime while factoring in the local weather information.
  • Embodiments of the invention are described herein with reference to illustrations that are schematic illustrations of idealized embodiments (and intermediate structures) of the invention. As such, variations from the shapes of the illustrations as a result, for example, of manufacturing techniques and/or tolerances, are to be expected. Thus, embodiments of the invention should not be construed as limited to the particular shapes of regions illustrated herein but are to include deviations in shapes that result, for example, from manufacturing.
  • FIG. 1 A very high-level diagram of an exemplary image capture and reproduction process is shown in Figure 1.
  • Images typically originate from either real-world scenes captured by video/still cameras or from computer-generated scenery.
  • the lofty goal of most reproduction systems is to display the most life-like image that is possible to the final human observer. There are many impediments to doing this perfectly; in fact, some "enhancements" are often purposely added to the displayed image to improve the viewing experience.
  • One of the major impediments to high-fidelity reproduction is that the local viewing environment of the final observer cannot be definitively predicted, yet the viewing environment can have a profound impact on the visual quality of the reproduction. Also, the viewing environment can change almost continuously except in a few special cases such as the tightly controlled environment of a theater.
  • a subtle but very germane aspect of Figure 1 is that the total light that is reflected from a physical object is essentially the linear summation of the reflected light from all light sources that impinge upon the object.
  • an object may also emit its own light, and this light is also linearly added to the reflected contributions from the object in order to arrive at the total observed light.
  • the absolute brightness or luminance of any point in a scene is proportional to all constituent components of light that are traceable to that point. This is the reality that is presented to the human observer of a real scene, and is also the manner in which computer-generated scenery is typically created.
  • a display device should also adhere to the principle of luminance linearity for the purest form of reproduction. Or more generally, the entire end-to-end chain of processes, from the light that enters a camera to the light that exits the display, should adhere to the principle of luminance linearity. This principle will be relevant to various aspects of the subject invention.
  • the goal of a display should be to reproduce a life-like replica of the original scene.
  • One such limitation is the difficulty for a display to match the dynamic range of luminance that exists in the real world, especially at the upper end of the scale (e.g., the sun and reflections thereof).
  • Another limitation is that a display is a predominately "flat” version of the original scene; hence true three-dimensional (3D) depth reproduction is not possible, although various "3D” technologies exist to produce the illusion of depth, at least from one or more specific perspectives.
  • common displays cannot begin to simulate the nearly hemispherical field- of-view of the human eye, although special venues such as IMAX ® theaters attempt to overcome this.
  • the display itself is a physical object that exists in some environment, and the environment itself can have a very significant impact on the visual quality of the reproduction.
  • each pixel is typically comprised of 3 sub-pixels, one for each of the primary colors - typically red, green, and blue. While there are displays that may use 4 or more sub-pixels, the embodiments herein do not depend on the precise number of sub-pixels or colors that they represent.
  • the information content of a displayed image is the result of uniquely commanding, or driving, each sub-pixel, with the specifics of the driving process being technology-dependent (e.g., CRT, plasma, LCD, OLED, etc.). It should be noted, that the exemplary embodiments herein can be utilized on any type of electronic display, and is not specific to one display type.
  • the drive level of each sub-pixel can range from full off to full on - this is the fundamental process by which images are formed by a display.
  • the total range of displayable colors i.e., the color gamut
  • Non-primary colors are produced when the human eye integrates the 3 sub-pixels to produce an effective blended color via the controlled mixing of the primary colors.
  • a gray level is a special case where all sub-pixels are being driven at the same level (as defined by VESA FPDM 2.0).
  • Gamma (symbolized by ⁇ ) refers to the mathematic exponent in a power function S Y that transforms the scaling of gray levels (on a sub-pixel basis) in an image.
  • FIG. 1 The conceptually simplest image reproduction stream is illustrated in Figure 2.
  • a detector commonly a solid-state pixilated detector using CCD or CMOS technology
  • O/E optical-to- electrical
  • This image signal is typically a voltage signal that is approximately proportional to the amount of light falling on each pixilated detector element, but S s may be immediately converted into a digital signal.
  • the source image signal S s may originate from computer-generated graphics that are typically developed in the linear domain in much the same way as light behaves in the real world.
  • the a exponent is referred to as a gamma-correction exponent, but for the purposes of this discussion it will be referred to more generally as a signal encoding exponent.
  • the decoded image signal Sd is then used to drive the components in the display that convert the electrical image data into light that is emitted by the display (L 0 ) via an electrical-to-optical (E/O) conversion process.
  • E/O electrical-to-optical
  • the details of the E/O process are unique to the display technology; e.g., LCD, plasma, OLED, etc.
  • the decoding function d was an integral part of the E/O conversion process.
  • the signals 'S' represent normalized values typically ranging from 0 to 1.
  • VMAX For the case of voltage signals, the actual signals would be normalized by VMAX such that
  • DMAX For the case of digital signals, the signals would be normalized by DMAX such that 256).
  • the signal normalization process generally requires processing steps that are not explicitly shown in Figure 2, but are implied herein. As long as normalized signals are consistently used it does not matter whether the signals represent voltage levels or bit levels, and both would be covered by the exemplary embodiments herein.
  • Eq(l) can be implemented in a discrete fashion, as illustrated in Figure 5.
  • the number of discretized levels illustrated in Figure 5 is representative; various embodiments of the invention may implement an arbitrary number of discrete levels, depending on the processing abilities and application.
  • FIG. 6 provides a schematic view of the basic components of an exemplary embodiment.
  • an environment processor 200 may obtain video data from a video source 150.
  • the display controller 110 may contain several components, including but not limited to a microprocessor and electronic storage (which can store the calibration data 120).
  • the environmental processor 200 is preferably then in electrical communication with the display 300. In some embodiments, it would be the display controller 110 that is in electrical communication with the video source 150 and the display 300.
  • One or more microprocessors found on the display controller 110 can perform any of the functionality described herein.
  • the video source 150 can be any number of devices which generate and/or transmit video data, including but not limited to television/cable/satellite transmitters, DVD/Blue Ray players, computers, video recorders, or video gaming systems.
  • the display controller 110 may be any combination of hardware and software that utilizes the location-based ambient environment data and modifies the video signal based on the calibration data.
  • the calibration data 120 is preferably a nonvolatile data storage which is accessible to the display controller that contains calibration data for the location-based ambient environment data and optionally including reflectance information for the display assembly.
  • the display 300 can be any electronic device which presents an image to the viewer.
  • the desired brightness (i.e., maximum luminance) of a display may change, but perhaps the most obvious case is when displays are used outdoors.
  • the ambient light illumination that surrounds the display may vary anywhere from the dark of night to the full sun of midday - roughly a factor of ten million, or 7 orders of magnitude.
  • the operation of the human visual system (comprising the eye, optic nerve, and brain) is a very complex subject; indeed, there is not full consensus on its parametric performance by most of the leading experts in the field. The issue is exacerbated by the highly adaptive and non-linear nature of the human visual system. Hence, there is no utility in attempting to define specific visual capabilities in this disclosure. However, there are a few generalities on which everyone would agree. For one, the human visual system can adapt over a very wide range of light levels given some time to adapt, by perhaps as much as 12 orders of magnitude. However, there is a limit to the instantaneous dynamic range of human vision at any particular level of adaptation, perhaps 2-3 orders of magnitude (this varies with the absolute level of adaptation).
  • a specific adaptation level depends on the integrated field-of-view of the eye (nearly hemispherical) taking into account all viewable objects and sources of light in this range. Since a display will only occupy some fraction of the total field-of-view then the maximum brightness of the display should be varied to accommodate the overall adaptation of human vision to various light levels, which of course would include the light from the display itself.
  • a display that produces 500 candela per square meter (nits) might be painfully bright when viewing at nighttime or other dark environments (unless one walked up close enough to the display so that it mostly fills their field-of-view and then allows some time for proper adaptation to occur), but the same display would appear somewhat dim and unimpressive on a bright sunlit day, and in fact may have lower gray levels that are indiscernible.
  • any display will reflect ambient environmental light to a certain degree.
  • the reflected light level may be high enough to substantially dominate the darker regions of the displayed image or video content (hereafter simply 'image').
  • the visual details in the darker regions of the image are essentially "washed out”.
  • the display cannot produce visually discernable brightness levels in an image that fall below the equivalent brightness level of the reflected ambient light.
  • Figure 7 where RAL is the effective brightness of the reflected ambient light and DBL is the displayed brightness level of any portion of an image. Wherever DBL ⁇ RAL in the image then there will be a discernable loss in image content in those regions.
  • An analogy is not being able to hear quieter passages within music while listening in an environment that has excessive background noise. For this very reason most radio broadcasts transmit signals that have a compressed dynamic range for improved "perceptual" listening in the noisy environment of a car.
  • an exemplary embodiment of the invention provides a means of automatically adjusting the black level and/or the gamma of a display according to pre-defined rules, such as but not limited to those previously discussed.
  • FIG. 8 The conceptually and functionally easiest location to perform autonomous black level and linearity adjustments are after the normal image signal decoding process, as generally illustrated in Figure 8.
  • the signal flow is similar to that described previously in Figure 2, except that now a new signal processing block labeled f v has been inserted into the signal flow for the purposes of providing automatic, real-time image signal adjustment in response to varying environmental conditions (i.e., an environmentally-reactive adjustment).
  • the processing block represented by f v can be viewed as a post-decoding processor since it operates after the normal signal decoding processor that is represented by fd.
  • the ambient environmental conditions can be determined based on the geographical location of the display and based on the calendar date, the approximate times of sunrise and sunset can be calculated and compared to the current time in order to determine what the ambient environmental conditions currently are.
  • Figure 8 provides a logical flow chart for performing a first embodiment of the method which is controlled only based on the display location data.
  • the system preferably determines the geographical location data for the display. This can be performed in a number of ways.
  • the physical address of the display may be used to determine the city/state in which the display is located.
  • the physical address of the display can be exchanged for the latitude and longitude coordinates. This technique can be performed by accessing a number of online tools, including but not limited to www.latlong.net.
  • the location of the display can be determined by reading coordinates from a GPS capable device 400 within the electronic display, and may form part of the display controller 110 or could be a separate device in electrical connection with the display controller 110.
  • the sunset and sunrise times for this location are preferably determined.
  • the timing for performing this step can vary. In some embodiments, this step could be performed only once, with 365 days of data being used for the display throughout the remainder of the display's lifetime. Alternatively, this step could be performed annually, monthly, weekly, or even daily. This step can also be performed in a number of ways. First, when given a physical address, the system can determine the sunrise/sunset times based on this address and store them within the electronic storage on the display controller 110.
  • the system can determine the sunrise/sunset times based on these coordinates and store them within the electronic storage on the display controller 110.
  • the location data can be converted to sunrise/sunset times by accessing any number of online databases, including but not limited to: www.sunrisesunset.com, www.suncalc.net, and various NOAA online tools. Additionally the latitude and longitude data can be used to calculate sunrise/sunset times based on the sunrise equation:
  • &> is the hour angle at either sunrise (when negative value is taken)
  • is the latitude of the observer on the Earth.
  • d is the sun declination.
  • the steps of determining geographical location data for the display and determining approximate sunrise/sunset times based on the geographical location data may be performed either electronically or manually and may also be performed before the display is shipped to its actual location. In other embodiments, the display may be installed within its actual location prior to performing these two steps.
  • the system would then check to see what the current time is and determine whether it is currently night or day. While the figure reads the logic as “does the current time fall after sunset and before sunrise,” it seems clear that this could also be performed by determining "does the current time fall after sunrise and before sunset” and it makes no difference in any of the subject embodiments.
  • the system determines that it is currently nighttime, the system provides nighttime instructions to the display controller 110.
  • the system determines that it is daytime, the system provides nighttime instructions to the display controller 110.
  • the nighttime/daytime instructions may simply be an indication sent to the display controller 110 (possibly from another component within the display controller 110) that simply indicates that it's currently daytime/nighttime.
  • the relative daytime and nighttime settings and variables for the display can be selected for this embodiment through a simple binary operation where a first set of settings and variables for the display is desired during nighttime and a second set of settings and variables for the display is desired during daytime.
  • an appropriate gamma or black level may be selected for the "nighttime instructions" with another for the "daytime instructions" and this could be selected from a look-up table based on a desired relationship between ambient light and gamma (similar to what is shown in Figure 4 or 5) or any other desired relationship between ambient light and gamma or black level (or other display settings).
  • the dashed lines on the figure indicate the option of the system returning to determine the approximate sunrise/sunset times, if practicing an embodiment where this data is updated annually, monthly, weekly, or daily.
  • the daytime/nighttime indications are preferably sent to an environmental processing unit labeled 'Proc' that contains at minimum a lookup table and/or computational algorithms that determine the desired display black level (and other settings discussed below) relative to the daytime/nighttime indications.
  • This environmental processing unit can be a part of the display controller 110 and may use the microprocessor on the display controller 110 or a separate processor. Additionally the environmental processor may communicate with electronic storage having a lookup table and/or computational algorithms for image signal linearity modification (e.g., a power function) relative to the daytime/nighttime instructions. Also, a provision to add real-time programmable instructions to the environmental processor is shown.
  • the environmental processor output signal S a contains the instantaneous value of the desired display black level Sb and optionally a signal linearity modification value that, for the case of a simple power function, takes the form of an exponent herein called ⁇ .
  • the decoded image signal Sd and environmentally-reactive control signal S a are fed into the image signal processing block labeled f v which, in an exemplary embodiment, produces a final display driving signal S p according to Eq(2) below.
  • This equation assumes that the all three image signal transformations (encoding, decoding, and post-decoding) are performed with power law functions. Signal encoding and decoding with power law functions, are typical in the industry, although this is not a necessity for the invention as other functions may be used with various embodiments herein.
  • the right-hand side of Eq(2) represents the processing functionality of block f ? , accepting the input signals S a and Sd and outputting the signal S p .
  • s p s b +Q-s b y s E « ⁇ 3 ⁇ 4
  • linearity modifier power exponent (assuming power law modification)
  • the encoding exponent a and the decoding exponent ⁇ are known quantities, as assumed in Eq(2), then the final end-to-end signal linearity is determined solely by the value of the linearity modifier exponent ⁇ ; i.e., ⁇ is equivalent to the previously defined end-to-end linearity power exponent ⁇ .
  • the encoding exponent a is typically known based on the source of the image data, and the decoding exponent ⁇ is either given by the manufacturer of the display and/or can be determined by testing.
  • Eq(2) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
  • Eq(2) The functionality of Eq(2) is illustrated in Figure 10.
  • the requested black level has been set at 0.1 and the linearity modifier exponent ⁇ has been set to 1.20, but generally these values will be (preferably automatically) chosen by the system based on the daytime/nighttime indications.
  • the functionality of the image signal decoding block f& could be absorbed into the environmental processor block f ? as a new processing block labeled dp, as shown in Figure 11.
  • the encoded image signal S e and environmentally-reactive control signal S a are fed into the image signal processing block labeled f ? which, in an exemplary embodiment, produces a final display driving signal S p according to Eq(4) below.
  • This equation assumes that the all three image signal transformations (encoding, pre-decoder processing, and decoding) are performed with power law functions. Signal encoding and decoding with power law functions, are typical in the industry, although this is not a necessity for any of the embodiments herein.
  • the right-hand side of Eq(4) represents the processing functionality of block f p , accepting the input signals S a and S e and outputting the signal S p . ⁇ -
  • Sb desired black level offset as a fraction of the full-scale signal
  • linearity modifier power exponent (assuming power law modification)
  • the encoding exponent a and the decoding exponent ⁇ are known quantities, as assumed in Eq(4), then the final signal linearity is determined solely by the value of the linearity modifier exponent ⁇ ; i.e., ⁇ is equivalent to the previously defined end-to-end linearity power exponent ⁇ .
  • the encoding exponent a is typically known based on the source of the image data, and the decoding exponent ⁇ is either given by the manufacturer of the display and/or can be determined by testing.
  • Eq(4) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
  • FIG. 13 An example of the functionality of Eq(4) is illustrated in Figure 13.
  • the requested black level has been set at 0.1 and the linearity modifier exponent ⁇ has been set to 1.20.
  • Figure 13 appears identical to Figure 10 because the same black level (Sb) and linearity modifier ( ⁇ ) have been requested in both cases.
  • the encoded image signal S e and environmentally-reactive control signal S a are fed into the image signal processing block labeled f ? which, in an exemplary embodiment, produces a pre-decoding image signal S p according to Eq(5) below.
  • Eq(5) represents the processing functionality of block f p , accepting the input signals S a and S e and outputting the signal S P .
  • a new feature of this embodiment is the introduction of a gray level threshold labeled St, leading to the two conditional cases expressed in Eq(5).
  • the 1 st condition is applicable when encoded signal levels fall below a level that is derived from St, in which case those signal levels will be set to 0 (i.e., full black). Otherwise, the 2 nd condition in Eq(5) is applicable for encoded signal levels that fall above the level derived from St.
  • St desired gray level threshold as a fraction of the full-scale input signal
  • the gray level threshold (St) may be: 1) an environmentally-reactive variable determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc' , or 3) be a fixed value pre-programmed within 'Proc' , or 4) any combination of the above.
  • St may be a fixed value within the f ? processing block.
  • the encoding exponent a and the decoding exponent ⁇ are known quantities, as assumed in Eq(5), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent ⁇ ; i.e., ⁇ is equivalent to the previously defined end-to-end linearity power exponent ⁇ .
  • the encoding exponent a is typically known based on the source of the image data, and the decoding exponent ⁇ is either given by the manufacturer of the display and/or can be determined by testing.
  • Eq(5) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
  • Eq(5) An example of the functionality of Eq(5) is illustrated in Figure 14.
  • the requested black level has been set at 0.1
  • the requested black level threshold has been set to 0.05
  • the linearity modifier exponent ⁇ has been set to 1.20.
  • the "cliff type of threshold cutoff produced by Eq(5) and illustrated in Figure 13 may produce objectionable visual artifacts in the image, especially for higher levels of thresholds and/or black level offsets. This would manifest as darker regions in an image that suddenly and unnaturally become black - this a phenomena that is sometimes referred to as banding. This effect can be reduced by softening the edge of the threshold.
  • Eq(6) represents the processing functionality of block f v , accepting the input signals S a and S e and outputting the signal S p .
  • a new feature of this embodiment is the introduction of a gray level turn-off point labeled So, leading to the three conditional cases expressed in Eq(6).
  • the 1 st condition is applicable when the encoded signal levels fall below a level that is derived from So, in which case those signal levels are set to 0 (i.e., full black).
  • the 2 nd condition in Eq(6) is applicable for encoded signal levels that fall above the level derived from So but below the threshold level derived from St.
  • the 3 rd condition in Eq(6) is applicable for encoded signal levels that fall above the level derived from St.
  • St desired gray level threshold as a fraction of the full-scale input signal
  • Sb desired black level offset as a fraction of the full-scale output signal
  • linearity modifier power exponent (assuming power law modification)
  • the gray level turn-off point (So) and gray level threshold (St) may be: 1) environmentally-reactive variables determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc', or 3) be fixed values pre-programmed within 'Proc', or 4) any combination of the above.
  • So and St may be fixed values within the f v processing block.
  • the encoding exponent a and the decoding exponent ⁇ are known quantities, as assumed in Eq(6), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent ⁇ ; i.e., ⁇ is equivalent to the previously defined end-to-end linearity power exponent ⁇ .
  • the encoding exponent a is typically known based on the source of the image data, and the decoding exponent ⁇ is either given by the manufacturer of the display and/or can be determined by testing.
  • Eq(6) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
  • Eq(6) An example of the functionality of Eq(6) is illustrated in Figure 15.
  • the requested black level offset has been set at 0.1
  • the requested gray level turn-off has been set to 0.02
  • the gray level threshold has been set to 0.05
  • the linearity modifier exponent ⁇ has been set to 1.20.
  • the linear ramp between (So, 0) and (St, St.) serve to reduce the aforementioned banding effect.
  • the encoded image signal S e and environmentally- reactive control signal S a are preferably fed into the image signal processing block labeled f v which, in an exemplary embodiment, produces a pre-decoding image signal S p according to Eq( 7 ) below.
  • Eq( 7 ) represents the processing functionality of block f p , accepting the input signals S a and S e and outputting the signal S p .
  • a new feature of this embodiment is the introduction of a gray level turn-off point labeled So, leading to the three conditional cases expressed in Eq( 7 ).
  • the 1 st condition is applicable when the encoded signal levels fall below a level that is derived from So, in which case those signal levels are set to 0 (i.e., full black).
  • the 2 nd condition in Eq( 7 ) is applicable for encoded signal levels that fall above the level derived from St.
  • St desired gray level threshold as a fraction of the full-scale input signal
  • Sb desired black level offset as a fraction of the full-scale output signal
  • linearity modifier power exponent (assuming power law modification)
  • the gray level turn-off point (So) and gray level threshold (St) may be: 1) environmentally-reactive variables determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc', or 3) be fixed values pre-programmed within 'Proc', or 4) any combination of the above.
  • So and St may be fixed values within the f ? processing block.
  • the encoding exponent a and the decoding exponent ⁇ are known quantities, as assumed in Eq( 7 ), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent ⁇ ; i.e., ⁇ is equivalent to the previously defined end-to-end linearity power exponent ⁇ .
  • the encoding exponent a is typically known based on the source of the image data, and the decoding exponent ⁇ is either given by the manufacturer of the display and/or can be determined by testing.
  • Eq( 7 ) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
  • Eq( 7 ) An example of the functionality of Eq( 7 ) is illustrated in Figure 16.
  • the requested black level offset has been set at 0.1
  • the requested gray level turn-off has been set to 0.02
  • the gray level threshold has been set to 0.05
  • the linearity modifier exponent ⁇ has been set to 1.20.
  • Eq(8) The BT.709 encoding process is described by Eq(8).
  • the 1 st condition in Eq(8) is intended to prevent a nearly infinite slope in the transform function for small signals (i.e., darkest gray levels), as would be the case for a purely power-law function, that would be problematic for noise at such low levels.
  • the BT.1886 decoding process is simply a power-law transformation as described by Eq(9).
  • the encoded image signal S e and environmentally- reactive control signal S a are fed into the image signal processing block labeled f v which, in an exemplary embodiment, produces a pre-decoding image signal S P according to Eq(10) below which represents the processing functionality of block f ? , accepting the input signals S a and S e and outputting the signal S p .
  • the break point at S s 0.018 in the encoding process described by Eq(8) leads to the two sets of conditional cases as expressed in Eq(10).
  • the 2 nd set of conditions in Eq(10) is applicable when the encoded signal level S e is greater than 0.081, leading to three more sub- conditions 2a-2c that are dependent on the encoded signal level S e relative to the black level transition parameters So and St.
  • Eq(10) a sine function has been implemented for the black level transition for conditions lb and 2b, although there many functions that could be used for this purpose.
  • Gamma symbolized by ⁇ generally refers to the mathematic exponent in a power function S Y that transforms the scaling of gray levels (on a sub-pixel basis) in an image.
  • the exemplary embodiments of the system can select a desired yfor the display, depending on the data from an ambient light sensor or, as shown in Figure 8, data related to the sunset and sunrise times for the location of the display, without requiring the use of actual data from an ambient light sensor. Taking this concept even further, the embodiment below allows various display settings, specifically gamma ( ⁇ ) or the black level to be selected based on artificial ambient light sensor data (AAS data), without requiring the use of actual data from an ambient light sensor.
  • AAS data artificial ambient light sensor data
  • anomalies in the display environment can sometimes create variations in the ambient light sensor data that can cause the display to change brightness levels drastically, even though the surrounding environment has not changed quite as drastically.
  • the ambient light sensor may be positioned within a shadow while the rest of the display is not. This select- shadowing can be caused by a number of obstructions, including but not limited to light posts, trees, passing vehicles, and/or construction equipment.
  • Other anomalies can create variability in the ambient light sensor data, including variations in: the response of each different sensor, the response of the sensor over temperature changes, variations in the positioning of the light sensor in each display, and variations in the typical ambient environment of the display over time.
  • the system can function without the use of data from the ambient light sensor. This however does typically limit some of the functionality of the system and its benefits, specifically power saving benefits, and can sometimes produce drastic changes in the display luminance.
  • the following embodiments provide a system and method for controlling the luminance of an electronic display by producing artificial ambient light sensor data (AAS).
  • AAS artificial ambient light sensor data
  • generating artificial ambient sensor data involves defining the following parameters:
  • the artificial ambient sensor (AAS) data can be calculated in the following manner, where t 1 provides the time in transition (i.e. t 1 varies between zero and t sr ).
  • AAS for sunrise (t 1 * HA)/t sr .
  • the AAS for sunset can be calculated in the following manner, where t 1 provides the time in transition (i.e. t 1 varies between zero and t ss ).
  • AAS for sunset HA - (t 1 * HA)/t ss .
  • the desired backlight level can be determined from any of the ambient light vs. display settings described above.
  • FIGURE 18 provides a logical flowchart for performing an embodiment that uses the AAS technique during sunset/sunrise transition times while using a nighttime/daytime level for the remaining times.
  • the sunset transition period and the sunrise transition period may be similar or substantially the same. In this case, it may not be necessary to have two transition periods. Instead, one transition period may be used.
  • FIGURE 19 provides a logical flowchart for performing an embodiment that uses the AAS technique with only a single transition period while using nighttime/daytime instructions for the remaining times.
  • the system and method can also utilize local weather information to further tailor the display settings, without requiring actual data from the ambient light sensor.
  • the local weather information can be obtained from available web APIs or other online weather information which may be accessed at a predetermined time interval (ex. every 15 minutes).
  • a weather factor WF is used where:
  • C 1 Clearness percentage with a higher percentage representing a clear sky and a lower percentage representing a large amount of cloud cover.
  • the inversion could be used, where a higher percentage represents more cloud cover and a lower percentage represents less cloud cover. Either technique can be used by a person of ordinary skill in the art.
  • the artificial ambient sensor (AAS) data can be calculated in the following manner.
  • AAS for sunrise (t 1 * (HA*WF))/t sr .
  • AAS for sunset (HA*WF) - (t 1 * (HA*WF))/t ss .
  • AAS HA*WF.
  • the desired display settings can be determined from any of the ambient light levels vs. display settings described above.
  • FIGURE 20 provides a logical flowchart for performing the advanced embodiment that uses the AAS technique during sunset/sunrise transition times as well as the daytime while factoring in the local weather information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The exemplary embodiments herein provide an electronic display with a display controller in electrical connection with the electronic display and adapted to direct the electronic display to operate per nighttime instructions if the present time is between sunrise and sunset, without accepting any input from an ambient light sensor, and direct the electronic display to operate per daytime instructions if the present time is between sunset and sunrise, without accepting any input from an ambient light sensor. The nighttime instructions may include a first setting for gamma while the daytime instructions may include a second setting for gamma. Sunrise and sunset transition periods can be calculated using Artificial Ambient Sensor Data (AAS), with further settings for gamma chosen based on the AAS data.

Description

ELECTRONIC DISPLAY WITH ENVIRONMENTAL ADAPTATION OF DISPLAY CHARACTERISTICS BASED ON LOCATION
Cross-Reference to Related Applications
[0001] This application claims priority to US Provisional Application No. 62/206,050 filed on August 17, 2015 and US Provisional Application No. 62/314,073 filed on March 28, 2016, both of which are herein incorporated by reference in their entirety. This application is also a continuation-in-part of US Application No. 15/043,100 filed on February 12, 2016 and US Application No. 15/043,135 filed on February 12, 2016, both of which claim priority to US Provisional Application No. 62/161,673 filed on May 14, 2015, all of which are herein incorporated by reference in their entirety.
Technical Field
[0002] The exemplary embodiments herein pertain to a display and a method that utilizes measured or calculated properties of the viewing environment in order to automatically vary the visual characteristics of a display according to a set of predefined rules. Some embodiments provide an autonomous display that exhibits optimal visual perception for image reproduction at all environmental viewing conditions.
Background of the Art
[0003] Displays are used in a very wide range of applications, including entertainment (e.g., television, e-books), advertisement (e.g., shopping malls, airports, billboards), information (e.g., automotive, avionics, system monitoring, security), and cross-applications (e.g., computers, smart phones). As such, displays are generally subject to a wide range of viewing environments, and in many applications the viewing environment of the display is not a constant.
Summary of the Exemplary Embodiments
[0004] The exemplary embodiments herein utilize location-based and/or time-based determinations of ambient conditions in conjunction with stored characteristic display data to dynamically (in real-time) process and alter an image and/or video signal so that key display performance parameters such as brightness, black level, gamma, saturation, hue, and sharpness would be perceived as optimal, meaning they are tuned to their best intended rendering for the given viewing conditions. Other embodiments also provide the method by which a display is calibrated to perform as described as well as the method for performing the dynamic performance process.
[0005] The foregoing and other features and advantages of the present invention will be apparent from the following more detailed description of the particular embodiments, as illustrated in the accompanying drawings.
Brief Description of the Drawings
[0006] A better understanding of an exemplary embodiment will be obtained from a reading of the following detailed description and the accompanying drawings wherein identical reference characters refer to identical parts and in which:
[0007] FIGURE 1 is a graphical representation of a typical image reproduction process.
[0008] FIGURE 2 is a block diagram for a signal encoding and decoding process.
[0009] FIGURE 3 is a graphical representation of image signal transformations per ITU-R BT.709/1886.
[0010] FIGURE 4 is a graphical representation of end-to-end power vs. ambient illumination.
[0011] FIGURE 5 is a graphical representation of end-to-end power vs. ambient illumination in a discrete implementation.
[0012] FIGURE 6 is a block diagram for the basic elements in an embodiment of the invention.
[0013] FIGURE 7 is an illustration of reflected ambient light and its relationship with displayed light.
[0014] FIGURE 8 is a logical flow chart for performing an exemplary embodiment of location-based determinations of ambient conditions.
[0015] FIGURE 9 is block diagram for an embodiment using post-decoding adjustment of black level and/or linearity.
[0016] FIGURE 10 is a graphical representation of example signal transforms of Figure 8 using Equation (2).
[0017] FIGURE 11 is a block diagram of an alternate embodiment for post-decoding adjustment. [0018] FIGURE 12 is a block diagram of an embodiment for pre-decoding adjustment of black level and/or linearity.
[0019] FIGURE 13 is a graphical representation of example signal transforms of Figure 11 using Equation (4).
[0020] FIGURE 14 is graphical representation of example signal transforms of Figure 11 using Equation (5).
[0021] FIGURE 15 is graphical representation of example signal transforms of Figure 11 using Equation (6).
[0022] FIGURE 16 is graphical representation of example signal transforms of Figure 11 using Equation (7).
[0023] FIGURE 17 is a detailed view of the lower left hand corner of Figure 15.
[0024] FIGURE 18 provides a logical flowchart for performing an embodiment that uses the AAS technique during sunset/sunrise transition times while using a nighttime/daytime level for the remaining times.
[0025] FIGURE 19 provides a logical flowchart for performing an embodiment that uses the AAS technique with only a single transition period while using nighttime/daytime instructions for the remaining times.
[0026] FIGURE 20 provides a logical flowchart for performing the advanced embodiment that uses the AAS technique during sunset/sunrise transition times as well as the daytime while factoring in the local weather information.
Detailed Description
[0027] The exemplary embodiments of the invention are described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity.
[0028] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/ or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
[0029] Embodiments of the invention are described herein with reference to illustrations that are schematic illustrations of idealized embodiments (and intermediate structures) of the invention. As such, variations from the shapes of the illustrations as a result, for example, of manufacturing techniques and/or tolerances, are to be expected. Thus, embodiments of the invention should not be construed as limited to the particular shapes of regions illustrated herein but are to include deviations in shapes that result, for example, from manufacturing.
[0030] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
[0031] A very high-level diagram of an exemplary image capture and reproduction process is shown in Figure 1. Images typically originate from either real-world scenes captured by video/still cameras or from computer-generated scenery. The lofty goal of most reproduction systems is to display the most life-like image that is possible to the final human observer. There are many impediments to doing this perfectly; in fact, some "enhancements" are often purposely added to the displayed image to improve the viewing experience. One of the major impediments to high-fidelity reproduction is that the local viewing environment of the final observer cannot be definitively predicted, yet the viewing environment can have a profound impact on the visual quality of the reproduction. Also, the viewing environment can change almost continuously except in a few special cases such as the tightly controlled environment of a theater.
[0032] A subtle but very germane aspect of Figure 1 is that the total light that is reflected from a physical object is essentially the linear summation of the reflected light from all light sources that impinge upon the object. In addition, an object may also emit its own light, and this light is also linearly added to the reflected contributions from the object in order to arrive at the total observed light. This is basically a statement that incoherent light behaves linearly in this regard (e.g., 1 + 1 = 2). As a result, the absolute brightness or luminance of any point in a scene is proportional to all constituent components of light that are traceable to that point. This is the reality that is presented to the human observer of a real scene, and is also the manner in which computer-generated scenery is typically created. Therefore, in theory a display device should also adhere to the principle of luminance linearity for the purest form of reproduction. Or more generally, the entire end-to-end chain of processes, from the light that enters a camera to the light that exits the display, should adhere to the principle of luminance linearity. This principle will be relevant to various aspects of the subject invention.
[0033] As mentioned above, the goal of a display should be to reproduce a life-like replica of the original scene. But there are several inherent and unavoidable limitations. One such limitation is the difficulty for a display to match the dynamic range of luminance that exists in the real world, especially at the upper end of the scale (e.g., the sun and reflections thereof). Another limitation is that a display is a predominately "flat" version of the original scene; hence true three-dimensional (3D) depth reproduction is not possible, although various "3D" technologies exist to produce the illusion of depth, at least from one or more specific perspectives. Also, common displays cannot begin to simulate the nearly hemispherical field- of-view of the human eye, although special venues such as IMAX® theaters attempt to overcome this. Finally, the display itself is a physical object that exists in some environment, and the environment itself can have a very significant impact on the visual quality of the reproduction.
[0034] In a traditional color display each pixel is typically comprised of 3 sub-pixels, one for each of the primary colors - typically red, green, and blue. While there are displays that may use 4 or more sub-pixels, the embodiments herein do not depend on the precise number of sub-pixels or colors that they represent. The information content of a displayed image is the result of uniquely commanding, or driving, each sub-pixel, with the specifics of the driving process being technology-dependent (e.g., CRT, plasma, LCD, OLED, etc.). It should be noted, that the exemplary embodiments herein can be utilized on any type of electronic display, and is not specific to one display type. The drive level of each sub-pixel can range from full off to full on - this is the fundamental process by which images are formed by a display. The total range of displayable colors (i.e., the color gamut) is obtained by varying the relative drive levels of the sub-pixels through their entire range of combinations. Non-primary colors are produced when the human eye integrates the 3 sub-pixels to produce an effective blended color via the controlled mixing of the primary colors. In the digital domain if the sub-pixel drive levels are defined with 8 digital bits then there can be a total of 28 = 256 distinct drive levels per sub-pixel. A gray level is a special case where all sub-pixels are being driven at the same level (as defined by VESA FPDM 2.0). This will generally produce a 'gray-like' color ranging from full off (lowest brightness, appearing predominately black) to full on (highest brightness, appearing predominately white). Continuing with 8 bits per sub-pixel (often called 24-bit color: 3 sub-pixels x 8 bits = 24) there are 224 = 16,777,216 possible colors, but only 256 unique gray levels by the strict definition that gray levels are produced when all sub-pixels are identically driven. For simplicity we shall speak of gray levels on a sub-pixel basis (i.e., 256 gray levels for 8 bits of control) with the implicit understanding that neighboring sub-pixels are not necessarily driven to the same level as required for the generation of color images. This is because the invention stands independent of color reproduction, but is completely compatible with color reproduction.
[0035] Gamma (symbolized by γ) refers to the mathematic exponent in a power function SY that transforms the scaling of gray levels (on a sub-pixel basis) in an image. Although the roots of gamma processing trace back to the earliest days of vacuum-tube cameras and CRT displays, it is still a very relevant process in modern displays for improving the perceived resolution in the darker regions of an image where human vision is more sensitive to absolute changes in brightness.
[0036] The conceptually simplest image reproduction stream is illustrated in Figure 2. Light from a real-world scene (Li) is captured by the camera and falls onto a detector (commonly a solid-state pixilated detector using CCD or CMOS technology) that performs an optical-to- electrical (O/E) conversion to generate the initial source image signal Ss. This image signal is typically a voltage signal that is approximately proportional to the amount of light falling on each pixilated detector element, but Ss may be immediately converted into a digital signal. Alternatively, the source image signal Ss may originate from computer-generated graphics that are typically developed in the linear domain in much the same way as light behaves in the real world. In either case, signal encoding occurs in the function block labeled fe, which typically (though not necessarily) takes the form of a power function: fe = (S)a. Historically the a exponent is referred to as a gamma-correction exponent, but for the purposes of this discussion it will be referred to more generally as a signal encoding exponent. The resulting encoded signal Se (= (Ss)a) then enters the display and is decoded by the function block labeled f&, which typically (though not necessarily) takes the form of another power function: f& =(S)Y. By substitution the resulting decoded signal Sd (= (Se)7) that drives the display is related to the initial source image signal Ss via Sd = (Ss)"7. It is noted that in practice there are variants to the relatively simple transformations described above, but the general process of encoding and decoding image signals is the same.
[0037] Referring still to Figure 2, the decoded image signal Sd is then used to drive the components in the display that convert the electrical image data into light that is emitted by the display (L0) via an electrical-to-optical (E/O) conversion process. The details of the E/O process are unique to the display technology; e.g., LCD, plasma, OLED, etc. In fact, for the virtually obsolete CRT technology the decoding function d was an integral part of the E/O conversion process.
[0038] It is noted in the above discussions that the signals 'S' represent normalized values typically ranging from 0 to 1. For the case of voltage signals, the actual signals would be normalized by VMAX such that For the case of digital signals, the signals would be normalized by DMAX such that 256). The signal normalization process generally requires processing steps that are not explicitly shown in Figure 2, but are implied herein. As long as normalized signals are consistently used it does not matter whether the signals represent voltage levels or bit levels, and both would be covered by the exemplary embodiments herein.
[0039] As a specific example of an end-to-end image processing stream, ITU-R BT.709- 5(2002) recommends encoding a television signal with an a value of =0.5 (Note: this is a slight simplification of BT.709), while ITU-R BT.1886(2011) recommends decoding a television signal with a γ value of 2.4, leading to an end-to-end power (ε ) of 1.2: Sd = Se 24 = (Ss a5)2'4 = §s (o.5 x 1.2) _ §si.2 signai transformations that occur in the above ITU-defined processes are illustrated in Figure 3, where the parameters for the horizontal 'input' axis and vertical Output' axis depend on the relevant processing step. For example, during the signal encoding operation the horizontal axis would represent Ss (as the input signal) while the vertical axis would represent Se (as the output signal). The implied normalization of signals is evident in Figure 3 since all signal levels reside between the values of 0 and 1.
[0040] It is noted in Figure 3 that the ITU-R BT.709/1886 signal transformation processes do not strictly adhere to the aforementioned principle of end-to-end luminance linearity since the reproduction system has an end-to-end power law exponent of ε = 1.2, rather than ε = 1.0 as would be the case for pure linearity. This produces the slight curve of the black line in Figure 3. The primary reason for deviating from pure linearity is that a camera/display cannot practically reproduce the full dynamic range of light that exists in the real world. As a result, the end-to-end exponent (or power) of ε = 1.2 is generally considered to produce a better perceptual experience for in-home television viewing with an average background illumination of =200 lux. This is based on reproducing a more life-like image contrast when the human eye is adapted to the typical in-home environment. [0041] However, it is common for movie producers to deviate from ITU-R BT.709 encoding in order to target much darker viewing environments such as theaters with a background illumination of =1-10 lux and/or to create artistically-flavored video content. A typical encoding exponent for this application is approximately oc=0.60. If this signal is subsequently decoded with a power exponent γ=2.4 then the end-to-end linearity power is ε =1.45.
[0042] Another popular image encoding scheme is the sRGB standard that is intended for image rendering in moderately bright environments such as work offices with a background illumination of =350 lux. sRGB calls for a signal encoding exponent approximating oc=0.45. If such an sRGB-encoded signal is subsequently decoded with a power exponent γ=2.4 then the end-to-end linearity power is ε =1.1.
[0043] The three different viewing environments discussed above and their suggested end- to-end linearity power exponents can be curve-fitted and used to extrapolate to higher levels of ambient illumination. The trend is given by Eq(l), which is plotted in figure 4. Hence, once the ambient illumination level (Ia) has been measured then the desired end-to-end linearity power exponent (ε) can be determined from Eq(l). This relationship between Ia and ε will be germane to certain aspects of the invention as described in following sections. The relationship given by Eq(l) is merely representative, and the invention is not dependent on the exact form of Eq(l). In general, the invention may implement any arbitrary relationship between Ia and ε.
ε≡ 1 + 0.48 · ^-(°·0045*/Ω) Eqd)
[0044] It is noted in Figure 4 that as the ambient illumination increases that the desired end- to-end power asymptotically approaches purely linear; i.e., ε— > 1. Above 1000 lux the power ε is essentially equal to 1. This is basically a statement that as the eye becomes adapted to full daylight conditions that the display should start to adhere to the principle of pure end-to-end luminance linearity as was previously discussed. However, few if any displays actually implement a power of ε = 1.
[0045] Alternatively, the function described by Eq(l) can be implemented in a discrete fashion, as illustrated in Figure 5. The number of discretized levels illustrated in Figure 5 is representative; various embodiments of the invention may implement an arbitrary number of discrete levels, depending on the processing abilities and application.
[0046] Figure 6 provides a schematic view of the basic components of an exemplary embodiment. Here, an environment processor 200 may obtain video data from a video source 150. The display controller 110 may contain several components, including but not limited to a microprocessor and electronic storage (which can store the calibration data 120). The environmental processor 200 is preferably then in electrical communication with the display 300. In some embodiments, it would be the display controller 110 that is in electrical communication with the video source 150 and the display 300. One or more microprocessors found on the display controller 110 can perform any of the functionality described herein.
[0047] The video source 150 can be any number of devices which generate and/or transmit video data, including but not limited to television/cable/satellite transmitters, DVD/Blue Ray players, computers, video recorders, or video gaming systems. The display controller 110 may be any combination of hardware and software that utilizes the location-based ambient environment data and modifies the video signal based on the calibration data. The calibration data 120 is preferably a nonvolatile data storage which is accessible to the display controller that contains calibration data for the location-based ambient environment data and optionally including reflectance information for the display assembly. The display 300 can be any electronic device which presents an image to the viewer.
[0048] Brightness Adjustment
[0049] There are many applications where the desired brightness (i.e., maximum luminance) of a display may change, but perhaps the most obvious case is when displays are used outdoors. In this case the ambient light illumination that surrounds the display may vary anywhere from the dark of night to the full sun of midday - roughly a factor of ten million, or 7 orders of magnitude.
[0050] The operation of the human visual system (comprising the eye, optic nerve, and brain) is a very complex subject; indeed, there is not full consensus on its parametric performance by most of the leading experts in the field. The issue is exacerbated by the highly adaptive and non-linear nature of the human visual system. Hence, there is no utility in attempting to define specific visual capabilities in this disclosure. However, there are a few generalities on which everyone would agree. For one, the human visual system can adapt over a very wide range of light levels given some time to adapt, by perhaps as much as 12 orders of magnitude. However, there is a limit to the instantaneous dynamic range of human vision at any particular level of adaptation, perhaps 2-3 orders of magnitude (this varies with the absolute level of adaptation).
[0051] A specific adaptation level depends on the integrated field-of-view of the eye (nearly hemispherical) taking into account all viewable objects and sources of light in this range. Since a display will only occupy some fraction of the total field-of-view then the maximum brightness of the display should be varied to accommodate the overall adaptation of human vision to various light levels, which of course would include the light from the display itself. For example, a display that produces 500 candela per square meter (nits) might be painfully bright when viewing at nighttime or other dark environments (unless one walked up close enough to the display so that it mostly fills their field-of-view and then allows some time for proper adaptation to occur), but the same display would appear somewhat dim and unimpressive on a bright sunlit day, and in fact may have lower gray levels that are indiscernible.
[0052] Black Level and Linearity Adjustment
[0053] Any display will reflect ambient environmental light to a certain degree. In some instances the reflected light level may be high enough to substantially dominate the darker regions of the displayed image or video content (hereafter simply 'image'). When this occurs the visual details in the darker regions of the image are essentially "washed out". Said another way, the display cannot produce visually discernable brightness levels in an image that fall below the equivalent brightness level of the reflected ambient light. The general situation is illustrated in Figure 7, where RAL is the effective brightness of the reflected ambient light and DBL is the displayed brightness level of any portion of an image. Wherever DBL < RAL in the image then there will be a discernable loss in image content in those regions. An analogy is not being able to hear quieter passages within music while listening in an environment that has excessive background noise. For this very reason most radio broadcasts transmit signals that have a compressed dynamic range for improved "perceptual" listening in the noisy environment of a car.
[0054] To recover the visual discernment of darker regions within the image one may artificially raise the black level of the image signal so that the displayed brightness of the black level is more or less equal to the effective brightness of the reflected ambient light. This is equivalent to creating a signal-to-noise ratio >1 for all displayed light levels vs. the reflected ambient light. As a result a pure black region in the original image would become a specific level of dark gray depending on the ambient light level; i.e., the dynamic range of the image is compressed.
[0055] In addition to raising the black level, one may also alter the end-to-end linearity (or gamma) of the display system in order to enhance the contrast of select regions of the gray scale (also known as tone scale) depending on the specific application and rendering intent. This could be based on the previous Eq(l), as illustrated in Figure 4 and Figure 5, or any other defined relationship.
[0056] For outdoor applications and certain indoor applications the amount of ambient light that is reflected from a display will vary almost continuously depending on the time of day and other operating conditions (e.g., weather, shadowing effects, mood lighting, etc.). Therefore, an exemplary embodiment of the invention provides a means of automatically adjusting the black level and/or the gamma of a display according to pre-defined rules, such as but not limited to those previously discussed.
[0057] It is noted that in darkened theater or similar environments there is little or no reflected ambient light from the display, in which case there is no specific need to raise the black level of the image, although it may still be desired to alter the end-to-end linearity (gamma) of images in certain applications; for example, artistic liberty in digital signage.
[0058] The conceptually and functionally easiest location to perform autonomous black level and linearity adjustments are after the normal image signal decoding process, as generally illustrated in Figure 8. In this figure the signal flow is similar to that described previously in Figure 2, except that now a new signal processing block labeled fv has been inserted into the signal flow for the purposes of providing automatic, real-time image signal adjustment in response to varying environmental conditions (i.e., an environmentally-reactive adjustment). The processing block represented by fv can be viewed as a post-decoding processor since it operates after the normal signal decoding processor that is represented by fd.
[0059] Determining Ambient Environmental Conditions
[0060] In an exemplary embodiment, the ambient environmental conditions can be determined based on the geographical location of the display and based on the calendar date, the approximate times of sunrise and sunset can be calculated and compared to the current time in order to determine what the ambient environmental conditions currently are.
[0061] Figure 8 provides a logical flow chart for performing a first embodiment of the method which is controlled only based on the display location data. As an initial step in this embodiment, the system preferably determines the geographical location data for the display. This can be performed in a number of ways. First, the physical address of the display may be used to determine the city/state in which the display is located. Second, the physical address of the display can be exchanged for the latitude and longitude coordinates. This technique can be performed by accessing a number of online tools, including but not limited to www.latlong.net. Third, the location of the display can be determined by reading coordinates from a GPS capable device 400 within the electronic display, and may form part of the display controller 110 or could be a separate device in electrical connection with the display controller 110. If the coordinates result in a physical address then this can be converted to the latitude and longitude coordinates, or vice versa by the techniques noted above. [0062] Once the location of the display is determined, the sunset and sunrise times for this location are preferably determined. The timing for performing this step can vary. In some embodiments, this step could be performed only once, with 365 days of data being used for the display throughout the remainder of the display's lifetime. Alternatively, this step could be performed annually, monthly, weekly, or even daily. This step can also be performed in a number of ways. First, when given a physical address, the system can determine the sunrise/sunset times based on this address and store them within the electronic storage on the display controller 110. Second, when given latitude/longitude coordinates, the system can determine the sunrise/sunset times based on these coordinates and store them within the electronic storage on the display controller 110. The location data can be converted to sunrise/sunset times by accessing any number of online databases, including but not limited to: www.sunrisesunset.com, www.suncalc.net, and various NOAA online tools. Additionally the latitude and longitude data can be used to calculate sunrise/sunset times based on the sunrise equation:
[0063] €OS ¾;j™— X % ΐ δ where:
[0064] &> is the hour angle at either sunrise (when negative value is taken)
or sunset (when positive value is taken);
[0065] ^ is the latitude of the observer on the Earth; and
[0066] d is the sun declination.
[0067] It should be noted that the steps of determining geographical location data for the display and determining approximate sunrise/sunset times based on the geographical location data, may be performed either electronically or manually and may also be performed before the display is shipped to its actual location. In other embodiments, the display may be installed within its actual location prior to performing these two steps.
[0068] Once the approximate sunrise/sunset times are determined (and preferably stored at the display), the system would then check to see what the current time is and determine whether it is currently night or day. While the figure reads the logic as "does the current time fall after sunset and before sunrise," it seems clear that this could also be performed by determining "does the current time fall after sunrise and before sunset" and it makes no difference in any of the subject embodiments. In this first embodiment, if the system determines that it is currently nighttime, the system provides nighttime instructions to the display controller 110. Alternatively, if the system determines that it is daytime, the system provides nighttime instructions to the display controller 110. Generally speaking, the nighttime/daytime instructions may simply be an indication sent to the display controller 110 (possibly from another component within the display controller 110) that simply indicates that it's currently daytime/nighttime.
[0069] The relative daytime and nighttime settings and variables for the display can be selected for this embodiment through a simple binary operation where a first set of settings and variables for the display is desired during nighttime and a second set of settings and variables for the display is desired during daytime. Thus, an appropriate gamma or black level may be selected for the "nighttime instructions" with another for the "daytime instructions" and this could be selected from a look-up table based on a desired relationship between ambient light and gamma (similar to what is shown in Figure 4 or 5) or any other desired relationship between ambient light and gamma or black level (or other display settings).
[0070] The dashed lines on the figure indicate the option of the system returning to determine the approximate sunrise/sunset times, if practicing an embodiment where this data is updated annually, monthly, weekly, or daily.
[0071] In Figure 9, the daytime/nighttime indications (location-based determinations of ambient conditions) are preferably sent to an environmental processing unit labeled 'Proc' that contains at minimum a lookup table and/or computational algorithms that determine the desired display black level (and other settings discussed below) relative to the daytime/nighttime indications. This environmental processing unit can be a part of the display controller 110 and may use the microprocessor on the display controller 110 or a separate processor. Additionally the environmental processor may communicate with electronic storage having a lookup table and/or computational algorithms for image signal linearity modification (e.g., a power function) relative to the daytime/nighttime instructions. Also, a provision to add real-time programmable instructions to the environmental processor is shown. The programmable instructions can be used in a wide variety of ways, including but not limited to altering or overriding the environmental-based processing depending on time-of-day, display content, etc. In summary, the environmental processor output signal Sa contains the instantaneous value of the desired display black level Sb and optionally a signal linearity modification value that, for the case of a simple power function, takes the form of an exponent herein called β.
[0072] Still referring to Figure 9, the decoded image signal Sd and environmentally-reactive control signal Sa are fed into the image signal processing block labeled fv which, in an exemplary embodiment, produces a final display driving signal Sp according to Eq(2) below. This equation assumes that the all three image signal transformations (encoding, decoding, and post-decoding) are performed with power law functions. Signal encoding and decoding with power law functions, are typical in the industry, although this is not a necessity for the invention as other functions may be used with various embodiments herein. The right-hand side of Eq(2) represents the processing functionality of block f?, accepting the input signals Sa and Sd and outputting the signal Sp. sp = sb +Q-sby s E«<¾
[0073] a = signal encoding power exponent (assuming power law encoding)
[0074] γ = signal decoding power exponent (assuming power law decoding)
Sb and β are contained in the environmentally-reactive control signal Sa:
[0075] Sb = desired black level offset as a fraction of the full-scale signal
[0076] β = linearity modifier power exponent (assuming power law modification)
[0077] If the encoding exponent a and the decoding exponent γ are known quantities, as assumed in Eq(2), then the final end-to-end signal linearity is determined solely by the value of the linearity modifier exponent β; i.e., β is equivalent to the previously defined end-to-end linearity power exponent ε. The encoding exponent a is typically known based on the source of the image data, and the decoding exponent γ is either given by the manufacturer of the display and/or can be determined by testing. Eq(2) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
[0078] The functionality of Eq(2) is illustrated in Figure 10. Here, the encoding process is a single power law transformation with an exponent a = 0.50 (as approximated by ITU-R BT.709-5), and the decoding process is a single power law transformation with an exponent γ = 2.40 (per ITU-R BT.1886). For this example the requested black level has been set at 0.1 and the linearity modifier exponent β has been set to 1.20, but generally these values will be (preferably automatically) chosen by the system based on the daytime/nighttime indications. The effective decoding transformation is given by the lower curve, and the end-to-end signal transformation is given by the middle curve which exhibits the desired black level offset of 0.1 and a slightly drooped linearity that is consistent with an end-to-end signal transform power of ε = 1.20. [0079] Alternatively, the functionality of the image signal decoding block f& could be absorbed into the environmental processor block f? as a new processing block labeled dp, as shown in Figure 11.
[0080] In Figure 11 the display driving signal SP is formed b Eq( 3 )
[0081] Where β*= β/γ, and all other parameters are defined as before. Eq( 3 ) possesses the same functionality as Eq(2) and hence produces the same results as shown in Figure 10.
[0082] In certain instances it is more convenient, or even necessary, to perform black level and/or linearity adjustments prior to the normal signal decoding transformation. The general process is illustrated in Figure 12. In this figure it is seen that the environmentally-reactive image signal processing function, represented by f?, has been moved ahead of the normal image signal decoder function represented by f&. In this manner fv can be viewed as a pre-decoding function.
[0083] Referring to Figure 12, the encoded image signal Se and environmentally-reactive control signal Sa are fed into the image signal processing block labeled f? which, in an exemplary embodiment, produces a final display driving signal Sp according to Eq(4) below. This equation assumes that the all three image signal transformations (encoding, pre-decoder processing, and decoding) are performed with power law functions. Signal encoding and decoding with power law functions, are typical in the industry, although this is not a necessity for any of the embodiments herein. The right-hand side of Eq(4) represents the processing functionality of block fp, accepting the input signals Sa and Se and outputting the signal Sp. β -
Sp = [Sb + (\ - Sb) - S -«>Y E"<4)
[0084] a = signal encoding power exponent (assuming power law encoding)
[0085] γ = signal decoding power exponent (assuming power law decoding)
Sb and β are contained in the environmentally-reactive control signal Sa:
[0086] Sb = desired black level offset as a fraction of the full-scale signal
[0087] β = linearity modifier power exponent (assuming power law modification)
[0088] If the encoding exponent a and the decoding exponent γ are known quantities, as assumed in Eq(4), then the final signal linearity is determined solely by the value of the linearity modifier exponent β; i.e., β is equivalent to the previously defined end-to-end linearity power exponent ε. The encoding exponent a is typically known based on the source of the image data, and the decoding exponent γ is either given by the manufacturer of the display and/or can be determined by testing. Eq(4) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
[0089] An example of the functionality of Eq(4) is illustrated in Figure 13. Here, the encoding process is a single power law transformation with an exponent a = 0.50 (as approximated by ITU-R BT.709-5), and the decoding process is a single power law transformation with an exponent γ = 2.40 (per ITU-R BT.1886). For this example the requested black level has been set at 0.1 and the linearity modifier exponent β has been set to 1.20. The effective decoding transformation is given by the lower curve, and the end-to-end signal transformation is given by the middle curve which exhibits the desired black level offset of 0.1 and a slightly drooped linearity that is consistent with an end-to-end signal transform power of ε = 1.20. As expected, Figure 13 appears identical to Figure 10 because the same black level (Sb) and linearity modifier (β) have been requested in both cases.
[0090] One may modify the scenarios described in the previous sections in order to maintain and/or reduce gray levels below a certain threshold. A primary reason for doing this is to retain the attractive power-saving attributes of backlight dynamic dimming in liquid crystal displays (LCD). Dynamic dimming has been addressed by co-pending application 12/793,474 filed on June 3, 2010 and is fully incorporated herein by reference in its entirety.
[0091] For the purposes of illustration, the embodiment described in this section will assume a pre-decoder processor as shown previously in Figure 12.
[0092] Exemplary Embodiment 1
[0093] Referring to Figure 12 the encoded image signal Se and environmentally-reactive control signal Sa are fed into the image signal processing block labeled f? which, in an exemplary embodiment, produces a pre-decoding image signal Sp according to Eq(5) below. This equation assumes that the all three image signal transformations (encoding, pre-decoder processing, and decoding) are performed with power law functions, although this is not a necessity for the invention. Eq(5) represents the processing functionality of block fp, accepting the input signals Sa and Se and outputting the signal SP. A new feature of this embodiment is the introduction of a gray level threshold labeled St, leading to the two conditional cases expressed in Eq(5). The 1st condition is applicable when encoded signal levels fall below a level that is derived from St, in which case those signal levels will be set to 0 (i.e., full black). Otherwise, the 2nd condition in Eq(5) is applicable for encoded signal levels that fall above the level derived from St.
< (St )e : S = 0
[0094] a = signal encoding power exponent (assuming power law encoding)
[0095] γ = signal decoding power exponent (assuming power law decoding)
St, Sb and β are contained in the environmentally-reactive control signal Sa:
[0096] St = desired gray level threshold as a fraction of the full-scale input signal
[0097] Sb = desired black level offset as a fraction of the full-scale output signal
[0098] β = linearity modifier power exponent (assuming power law modification)
[0099] The gray level threshold (St) may be: 1) an environmentally-reactive variable determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc' , or 3) be a fixed value pre-programmed within 'Proc' , or 4) any combination of the above. Alternatively, St may be a fixed value within the f? processing block.
[00100] If the encoding exponent a and the decoding exponent γ are known quantities, as assumed in Eq(5), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent β; i.e., β is equivalent to the previously defined end-to-end linearity power exponent ε. The encoding exponent a is typically known based on the source of the image data, and the decoding exponent γ is either given by the manufacturer of the display and/or can be determined by testing. Eq(5) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
[00101] An example of the functionality of Eq(5) is illustrated in Figure 14. Here, the encoding process is a single power law transformation with an exponent a = 0.50 (as approximated by ITU-R BT.709-5), and the decoding process is a single power law transformation with an exponent γ = 2.40 (per ITU-R BT.1886). For this example the requested black level has been set at 0.1, the requested black level threshold has been set to 0.05, and the linearity modifier exponent β has been set to 1.20. The effective decoding transformation is given by the lower curve, and the end-to-end signal transformation is given by the middle curve which exhibits the desired black level offset of 0.1 at a threshold of 0.05, and a slightly drooped linearity that is consistent with an end-to-end signal transform power of ε = 1.20.
[00102] Exemplary Embodiment 2
[00103] The "cliff type of threshold cutoff produced by Eq(5) and illustrated in Figure 13 may produce objectionable visual artifacts in the image, especially for higher levels of thresholds and/or black level offsets. This would manifest as darker regions in an image that suddenly and unnaturally become black - this a phenomena that is sometimes referred to as banding. This effect can be reduced by softening the edge of the threshold.
[00104] Referring back to Figure 12 the encoded image signal Se and environmentally- reactive control signal Sa are fed into the image signal processing block labeled fv which, in an exemplary embodiment, produces a pre-decoding image signal Sp according to Eq(6) below. This equation assumes that the all three image signal transformations (encoding, pre-decoder processing, and decoding) are performed with power law functions, although this is not a necessity for the invention. Eq(6) represents the processing functionality of block fv, accepting the input signals Sa and Se and outputting the signal Sp. A new feature of this embodiment is the introduction of a gray level turn-off point labeled So, leading to the three conditional cases expressed in Eq(6). The 1st condition is applicable when the encoded signal levels fall below a level that is derived from So, in which case those signal levels are set to 0 (i.e., full black). Next, for encoded signal levels that fall above the level derived from So but below the threshold level derived from St then the 2nd condition in Eq(6) is applicable. Otherwise, the 3rd condition in Eq(6) is applicable for encoded signal levels that fall above the level derived from St. The 2nd condition is used to soften the transition between the raised black level and the full off level by creating a linear ramp in the display drive signal (Sd) between So (drive level = 0) to St (drive level = Sb).
l) for Se≤(S0)4 0
[00105] a = signal encoding power exponent (assuming power law encoding)
[00106] γ = signal decoding power exponent (assuming power law decoding)
So, St, Sb and β are contained in the environmentally-reactive control signal Sa:
[00107] So = desired gray level turn-off point as a fraction of the full-scale input signal
[00108] St = desired gray level threshold as a fraction of the full-scale input signal
[00109] Sb = desired black level offset as a fraction of the full-scale output signal
[00110] β = linearity modifier power exponent (assuming power law modification)
[00111] The gray level turn-off point (So) and gray level threshold (St) may be: 1) environmentally-reactive variables determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc', or 3) be fixed values pre-programmed within 'Proc', or 4) any combination of the above. Alternatively, So and St may be fixed values within the fv processing block.
[00112] If the encoding exponent a and the decoding exponent γ are known quantities, as assumed in Eq(6), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent β; i.e., β is equivalent to the previously defined end-to-end linearity power exponent ε. The encoding exponent a is typically known based on the source of the image data, and the decoding exponent γ is either given by the manufacturer of the display and/or can be determined by testing. Eq(6) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
[00113] An example of the functionality of Eq(6) is illustrated in Figure 15. Here, the encoding process is a single power law transformation with an exponent a = 0.50 (as approximated by ITU-R BT.709-5), and the decoding process is a single power law transformation with an exponent γ = 2.40 (per ITU-R BT.1886). For this example the requested black level offset has been set at 0.1, the requested gray level turn-off has been set to 0.02, the gray level threshold has been set to 0.05, and the linearity modifier exponent β has been set to 1.20. The effective decoding transformation is given by the lower curve, and the end-to-end signal transformation is given by the middle curve which exhibits the desired black level offset of 0.1, a gray level turn-off of 0.02, and gray level threshold of 0.05, and a slightly drooped linearity that is consistent with an end-to-end signal transform power of ε = 1.20. The linear ramp between (So, 0) and (St, St.) serve to reduce the aforementioned banding effect.
[00114] Exemplary Embodiment 3
[00115] The linear ramp provided as a transition between full off and threshold in the previous embodiment affords a significant reduction in visual artifacts, or banding, but there is still a sharp point in the end-to-end transform curve shown in Figure 15 that has the potential to produce visual artifacts. To further improve the transition, a specific example using a sine curve will be described below, although other functions could be used.
[00116] Referring back to Figure 12 the encoded image signal Se and environmentally- reactive control signal Sa are preferably fed into the image signal processing block labeled fv which, in an exemplary embodiment, produces a pre-decoding image signal Sp according to Eq( 7 ) below. This equation assumes that the all three image signal transformations (encoding, pre-decoder processing, and decoding) are performed with power law functions, although this is not a necessity for the invention. Eq( 7 ) represents the processing functionality of block fp, accepting the input signals Sa and Se and outputting the signal Sp. A new feature of this embodiment is the introduction of a gray level turn-off point labeled So, leading to the three conditional cases expressed in Eq( 7 ). The 1st condition is applicable when the encoded signal levels fall below a level that is derived from So, in which case those signal levels are set to 0 (i.e., full black). Next, for encoded signal levels that fall above the level derived from So but below the threshold level derived from St then the 2nd condition in Eq( 7 ) is applicable. Otherwise, the 3rd condition in Eq( 7 ) is applicable for encoded signal levels that fall above the level derived from St. The 2nd condition is used to soften the transition between the raised black level and the full off level by creating a sine-curve ramp in the display drive signal (Sd) between So (drive level = 0) to St (drive level = St.).
[00117] a = signal encoding power exponent (assuming power law encoding)
[00118] γ = signal decoding power exponent (assuming power law decoding)
So, St, Sb and β are contained in the environmentally-reactive control signal Sa:
[00119] So = desired gray level turn-off point as a fraction of the full-scale input signal
[00120] St = desired gray level threshold as a fraction of the full-scale input signal
[00121] Sb = desired black level offset as a fraction of the full-scale output signal
[00122] β = linearity modifier power exponent (assuming power law modification)
[00123] The gray level turn-off point (So) and gray level threshold (St) may be: 1) environmentally-reactive variables determined via a lookup table or computational algorithms within the processing block labeled 'Proc' , or 2) provided by the 'programmable instructions' port on 'Proc', or 3) be fixed values pre-programmed within 'Proc', or 4) any combination of the above. Alternatively, So and St may be fixed values within the f? processing block.
[00124] If the encoding exponent a and the decoding exponent γ are known quantities, as assumed in Eq( 7 ), then the final signal linearity beyond the gray level threshold St is determined solely by the value of the linearity modifier exponent β; i.e., β is equivalent to the previously defined end-to-end linearity power exponent ε. The encoding exponent a is typically known based on the source of the image data, and the decoding exponent γ is either given by the manufacturer of the display and/or can be determined by testing. Eq( 7 ) offers a specific example of the processes described in this section based on a specific method of signal encoding/decoding, but the general process is the same for any other method of encoding/decoding.
[00125] An example of the functionality of Eq( 7 ) is illustrated in Figure 16. Here, the encoding process is a single power law transformation with an exponent a = 0.50 (as approximated by ITU-R BT.709-5), and the decoding process is a single power law transformation with an exponent γ = 2.40 (per ITU-R BT.1886). For this example the requested black level offset has been set at 0.1, the requested gray level turn-off has been set to 0.02, the gray level threshold has been set to 0.05, and the linearity modifier exponent β has been set to 1.20. The effective decoding transformation is given by the lower curve, and the end-to-end signal transformation is given by the middle curve which exhibits the desired black level offset of 0.1, a gray level turn-off of 0.02, and gray level threshold of 0.05, and a slightly drooped linearity that is consistent with an end-to-end signal transform power of ε = 1.20.
[00126] A close-up of the lower left-hand corner of Figure 16 is shown below in Figure 17. This shows a smoother transition of the end-to-end signal transform at the gray level threshold,
[00127] It bears repeating that all examples provided in this section are provided solely for the clarification of the general principles of the invention, and do not limit the scope of the invention. In particular, functions other than the sine function may be used in Eq( 7 ) to provide "tangential-matching" of the slopes of the curves at the threshold point for further improvement of gray level processing in this region.
[00128] Exemplary Embodiment 4
[00129] The embodiment described in this section illustrates the implementation of autonomous black level and linearity adjustment using a very common industry-standard method of image encoding: ITU-R BT.709-5(2002), and image decoding: ITU-R BT.1886(2011). This embodiment also serves to generally illustrate how this invention may be adapted to any encoded/decoded signal transformation formats.
[00130] The BT.709 encoding process is described by Eq(8). The 1st condition in Eq(8) is intended to prevent a nearly infinite slope in the transform function for small signals (i.e., darkest gray levels), as would be the case for a purely power-law function, that would be problematic for noise at such low levels.
[00131] The BT.1886 decoding process is simply a power-law transformation as described by Eq(9).
Sd = Sp 7 (where γ = 2Λ0) Eq(9)
[00132] Referring back to Figure 12, the encoded image signal Se and environmentally- reactive control signal Sa are fed into the image signal processing block labeled fv which, in an exemplary embodiment, produces a pre-decoding image signal SP according to Eq(10) below which represents the processing functionality of block f?, accepting the input signals Sa and Se and outputting the signal Sp. The break point at Ss = 0.018 in the encoding process described by Eq(8) leads to the two sets of conditional cases as expressed in Eq(10). The 1st set of conditions is applicable when the encoded signal level Se falls below the value of 0.081 (= 4.5 x 0.018), leading to three sub-conditions la-lc that are dependent on the encoded signal level Se relative to the black level transition parameters So and St. The 2nd set of conditions in Eq(10) is applicable when the encoded signal level Se is greater than 0.081, leading to three more sub- conditions 2a-2c that are dependent on the encoded signal level Se relative to the black level transition parameters So and St. In Eq(10) a sine function has been implemented for the black level transition for conditions lb and 2b, although there many functions that could be used for this purpose.
1) for 5 < 0.081 : a) if -^ < 5„ 0
e
2) for Se≥ 0.081 : a) if 5* < 5,
S„ + 0.099 Eq(10)
where : S
1.099 )
[00133] In addition, depending on the spectral distribution of the ambient light it may be desirable to automatically alter the white balance of the display.
[00134] As noted above, Gamma (symbolized by γ) generally refers to the mathematic exponent in a power function SYthat transforms the scaling of gray levels (on a sub-pixel basis) in an image. As taught above, the exemplary embodiments of the system can select a desired yfor the display, depending on the data from an ambient light sensor or, as shown in Figure 8, data related to the sunset and sunrise times for the location of the display, without requiring the use of actual data from an ambient light sensor. Taking this concept even further, the embodiment below allows various display settings, specifically gamma (γ) or the black level to be selected based on artificial ambient light sensor data (AAS data), without requiring the use of actual data from an ambient light sensor.
[00135] It has been discovered, that anomalies in the display environment can sometimes create variations in the ambient light sensor data that can cause the display to change brightness levels drastically, even though the surrounding environment has not changed quite as drastically. For example, the ambient light sensor may be positioned within a shadow while the rest of the display is not. This select- shadowing can be caused by a number of obstructions, including but not limited to light posts, trees, passing vehicles, and/or construction equipment. Other anomalies can create variability in the ambient light sensor data, including variations in: the response of each different sensor, the response of the sensor over temperature changes, variations in the positioning of the light sensor in each display, and variations in the typical ambient environment of the display over time.
[00136] In some embodiments, as mentioned above, the system can function without the use of data from the ambient light sensor. This however does typically limit some of the functionality of the system and its benefits, specifically power saving benefits, and can sometimes produce drastic changes in the display luminance. However, the following embodiments provide a system and method for controlling the luminance of an electronic display by producing artificial ambient light sensor data (AAS).
[00137] In one embodiment, generating artificial ambient sensor data involves defining the following parameters:
[00138] (1) Nighttime Instructions - the desired Gamma at nighttime.
[00139] (2) Daytime Instructions - the desired Gamma during the daytime.
[00140] (3) High Ambient Reading (HA) - the approximate raw data received by the ambient light sensor when experiencing the highest ambient light levels for the display environment.
[00141] (4) GPS coordinates for the display location or the address/City/State.
[00142] (5) Sunrise transition period (tsr) - the amount of time (usually measured in seconds) to transition from a nighttime ambient light sensor reading to a daytime ambient light sensor reading. [00143] (6) Sunset transition period (tss) - the amount of time (usually measured in seconds) to transition from a daytime ambient light sensor reading to a nighttime ambient light sensor reading.
[00144] For this embodiment, during the sunrise transition period, the artificial ambient sensor (AAS) data can be calculated in the following manner, where t1 provides the time in transition (i.e. t1 varies between zero and tsr).
[00145] AAS for sunrise = (t1 * HA)/tsr.
[00146] Similarly, the AAS for sunset can be calculated in the following manner, where t1 provides the time in transition (i.e. t1 varies between zero and tss).
[00147] AAS for sunset = HA - (t1 * HA)/tss.
[00148] Once AAS for either transition period has been calculated, the desired backlight level can be determined from any of the ambient light vs. display settings described above.
[00149] FIGURE 18 provides a logical flowchart for performing an embodiment that uses the AAS technique during sunset/sunrise transition times while using a nighttime/daytime level for the remaining times.
[00150] In some embodiments, the sunset transition period and the sunrise transition period may be similar or substantially the same. In this case, it may not be necessary to have two transition periods. Instead, one transition period may be used. FIGURE 19 provides a logical flowchart for performing an embodiment that uses the AAS technique with only a single transition period while using nighttime/daytime instructions for the remaining times.
[00151] In an advanced embodiment, the system and method can also utilize local weather information to further tailor the display settings, without requiring actual data from the ambient light sensor. The local weather information can be obtained from available web APIs or other online weather information which may be accessed at a predetermined time interval (ex. every 15 minutes). Here, a weather factor (WF) is used where:
[00152] If it is daytime or any transition period: WF = 4 * C1, where C1 = Clearness percentage with a higher percentage representing a clear sky and a lower percentage representing a large amount of cloud cover. Of course the inversion could be used, where a higher percentage represents more cloud cover and a lower percentage represents less cloud cover. Either technique can be used by a person of ordinary skill in the art.
[00153] For this embodiment, during the sunrise transition period, the artificial ambient sensor (AAS) data can be calculated in the following manner.
[00154] AAS for sunrise = (t1 * (HA*WF))/tsr.
[00155] Similarly, the AAS for sunset can be calculated in the following manner. [00156] AAS for sunset = (HA*WF) - (t1 * (HA*WF))/tss.
[00157] If it is daytime, AAS = HA*WF.
[00158] If it is nighttime, AAS = 0.
[00159] Once AAS for either transition period or the daytime has been calculated, the desired display settings can be determined from any of the ambient light levels vs. display settings described above.
[00160] FIGURE 20 provides a logical flowchart for performing the advanced embodiment that uses the AAS technique during sunset/sunrise transition times as well as the daytime while factoring in the local weather information.
[00161] For example, when during the daytime (i.e. not within either transition period or nighttime) and where it is overcast and raining, the relevant calculations would be:
[00162] Ci = 10% clearness percentage
[00163] HA = 500
[00164] Weather factor = 4 * 0.10 = 0.40
[00165] AAS = 500 * 0.40 = 300
[00166] Note that without correction for local weather conditions, the daytime value would likely be 500, which would mean a different display setting (here Gamma) would be required. From here we see significant power savings due to the overcast skies.
[00167] For the same example, if the display is halfway through a sunrise or sunset transition, the calculated light sensor value and corresponding desired brightness would be:
[00168] tsr = 1800 seconds
[00169] t1 = 900 seconds
[00170] HA = 500
[00171] Weather factor = 4 * 0.10 = 0.40
[00172] AAS = (900 * 500 * 0.40)/1800 = 100
[00173] Without correction for local conditions, the AAS value would be 250.
[00174] Having shown and described a preferred embodiment of the invention, those skilled in the art will realize that many variations and modifications may be made to affect the described invention and still be within the scope of the claimed invention. Additionally, many of the elements indicated above may be altered or replaced by different elements which will provide the same result and fall within the spirit of the claimed invention. It is the intention, therefore, to limit the invention only as indicated by the scope of the claims.

Claims

CLAIMS We claim:
1. An electronic display assembly comprising:
an electronic display; and
a display controller in electrical connection with the electronic display and adapted to: direct the electronic display to operate per nighttime instructions if the present time is between sunrise and sunset, without accepting any input from an ambient light sensor, and
direct the electronic display to operate per daytime instructions if the present time is between sunset and sunrise, without accepting any input from an ambient light sensor.
2. The electronic display assembly of claim 1 wherein:
the nighttime instructions include a desired black level for the display during low ambient light conditions and
the daytime instructions include a desired black level for the display during high ambient light conditions.
3. The electronic display assembly of claim 1 wherein:
the nighttime instructions include a desired gamma setting for the display during low ambient light conditions and
the daytime instructions include a desired gamma setting for the display during high ambient light conditions.
4. The electronic display assembly of claim 1 wherein:
the display controller determines the sunrise and sunset times for each day.
5. The electronic display assembly of claim 4 wherein:
the display controller determines the sunrise and sunset times for each day by calculating the sunrise equation.
6. The electronic display assembly of claim 1 wherein:
the display controller is further adapted to determine whether the present time is during a sunset or sunrise transition period and
calculate artificial ambient sensor data (AAS) for sunset, if during a sunset transition period,
calculate artificial ambient sensor data (AAS) for sunrise, if during a sunrise transition period, and
direct the display to operate based on the AAS data.
7. The electronic display assembly of claim 1 wherein:
the display controller is further adapted to calculate artificial ambient sensor data (AAS);
determine a desired gamma based on the AAS data; and
drive the electronic display using the desired gamma.
8. The electronic display assembly of claim 1 wherein:
the display controller is further adapted to determine local weather information;
calculate artificial ambient sensor data (AAS) based on the local weather information; determine a desired gamma based on the AAS data; and
drive the electronic display using the desired gamma.
9. An electronic display assembly comprising:
an electronic display; and
a display controller in electrical connection with the electronic display and adapted to: determine the sunset and sunrise times for each day, including the sunset transition period and the sunrise transition period, determine if the present time is during a sunrise transition, daytime, a sunset transition, or nighttime,
calculate artificial ambient sensor data (AAS) for sunrise and determine a desired gamma based on the AAS data if the present time is during a sunrise transition period,
determine a desired daytime gamma if the present time is daytime, calculate artificial ambient sensor data (AAS) for sunset and determine a desired gamma based on the AAS data if the present time is during a sunset transition period,
determine a desired nighttime gamma if the present time is if the present time is nighttime, and
drive the electronic display at the desired gamma level.
10. The electronic display assembly of claim 9 wherein:
the AAS data approximates the amount of ambient light that is present in the environment.
11. The electronic display assembly of claim 9 wherein:
the desired gamma level is determined by approximating the amount of ambient light present in the environment.
12. The electronic display assembly of claim 10 wherein: the desired gamma is determined by comparing the AAS data to a predetermined relationship between ambient light in the environment and a corresponding value for gamma.
13. The electronic display assembly of claim 9 wherein:
the display controller is further adapted to determine a black level offset for the desired gamma.
14. The electronic display assembly of claim 9 wherein:
the display controller is further adapted to determine a black level offset based on the AAS data.
15. The electronic display assembly of claim 9 wherein:
the display controller is further adapted to determine a percentage of cloud cover.
16. An electronic display assembly comprising:
an electronic display;
a GPS device; and
a display controller in electrical connection with the electronic display and the GPS device and adapted to:
determine the location data for the electronic display through the GPS device, determine the sunrise and sunset times for a given day,
direct the electronic display to utilize a first gamma setting if the present time is between sunrise and sunset, and
direct the electronic display to utilize a second gamma setting if the present time is between sunset and sunrise.
17. The electronic display assembly of claim 16 wherein:
the display controller does not use data from an ambient light sensor to operate the electronic display.
18. The electronic display assembly of claim 16 wherein:
the display controller determines the sunrise and sunset times based on the longitude and latitude coordinates of the electronic display.
19. The electronic display assembly of claim 18 wherein:
the display controller determines the sunrise and sunset times by calculating the
sunrise equation.
20. The electronic display assembly of claim 16 wherein:
the display controller is further adapted to determine whether the present time is during a sunset or sunrise transition period and calculate artificial ambient sensor data (AAS) for sunset, if during a sunset transition period,
calculate artificial ambient sensor data (AAS) for sunrise, if during a sunrise transition period, and
determine a gamma setting for the electronic display based on the AAS data.
21. A method for environmental adaptation of electronic display characteristics, comprising the steps of:
determining the sunset and sunrise times for the day;
determining whether the present time is between sunrise and sunset or between sunset and sunrise;
selecting a gamma for the display based on whether the present time is between sunrise and sunset or between sunset and sunrise; and
driving the display at the selected gamma.
22. The method of claim 21 further comprising the steps of:
gradually changing the gamma for the display when transitioning from nighttime to sunrise; and
gradually changing the gamma for the display when transitioning from daytime to sunset.
23. The method of claim 21 wherein:
the step of selecting a gamma is performed without any actual input from an ambient light sensor.
24. The method of claim 21 wherein:
the step of determining the sunset and sunrise times for the day is performed by calculating the sunrise equation.
25. The method of claim 21 further comprising the step of:
selecting a black level offset for the display based on whether the present time is between sunrise and sunset or between sunset and sunrise; and driving the display at the selected black level offset.
26. The method of claim 21 further comprising the steps of:
determining whether the present time is during a sunset or sunrise transition period, calculate artificial ambient sensor data (AAS) for sunset, if during a sunset transition period,
calculate artificial ambient sensor data (AAS) for sunrise, if during a sunrise transition period, select a gamma for the display based on the AAS data if the present time is during a sunset or sunrise transition period, and
driving the display at the selected gamma if the present time is during a sunset or sunrise transition period.
27. The method of claim 21 further comprising the steps of:
determining whether the present time is during a sunset or sunrise transition period; and calculating artificial ambient sensor data (AAS) if during a sunset or sunrise transition period, and
selecting a gamma for the display based on the AAS data if during a sunset or sunrise transition period.
28. The method of claim 21 further comprising the steps of:
determining local weather information,
calculating artificial ambient sensor data (AAS) based on the local weather information, select a gamma for the display based on the AAS data and whether the present time is between sunrise and sunset or between sunset and sunrise, and driving the display at the selected gamma.
29. A method for environmental adaptation of electronic display characteristics, comprising the steps of:
determining the sunset and sunrise times for the day, including the sunset transition period and the sunrise transition period,
determining if the present time is during a sunrise transition, daytime, a sunset transition, or nighttime,
calculating artificial ambient sensor data (AAS) for sunrise and selecting a gamma for the display based on the AAS data if the present time is during a sunrise transition period,
selecting a gamma for the display for daytime if the present time is daytime, calculating AAS data for sunset and selecting a gamma for the display based on the
AAS data if the present time is during a sunset transition period, selecting a gamma for the display for nighttime if the present time is nighttime, and driving the display with the selected gamma.
30. The method of claim 29 wherein:
the AAS data approximates the amount of ambient light that is present in the environment.
31. The method of claim 29 wherein the desired gamma level is determined by approximating the amount of ambient light present in the environment.
32. The method of claim 29 wherein the step of selecting a gamma for the display based on A AS data is performed by:
comparing the AAS data to a predetermined relationship between ambient light in the environment and a corresponding value for gamma.
33. The method of claim 29 further comprising the steps of:
selecting a black level offset for the display based on whether the present time is between sunrise and sunset or between sunset and sunrise; and driving the display at the selected black level offset.
34. The method of claim 29 further comprising the step of:
determining a black level offset for the display based on the AAS data.
35. The method of claim 29 further comprising the step of:
calculating a percentage of cloud cover; and
further selecting a gamma for the display based on the percentage of cloud cover.
36. A method for environmental adaptation of electronic display characteristics, comprising the steps of:
determine the location data for the electronic display through a GPS device; and determining the sunrise and sunset times for a given day,
directing the electronic display to utilize a first gamma setting if the present time is between sunrise and sunset, and
directing the electronic display to utilize a second gamma setting if the present time is between sunset and sunrise.
37. The method of claim 36 wherein:
the steps of directing the electronic display to utilize a first gamma setting or a second gamma setting is performed without accepting any input from an ambient light sensor.
38. The method of claim 36 wherein:
the step of calculating the sunrise and sunset times is performed based on
the longitude and latitude coordinates of the electronic display.
39. The method of claim 38 further comprising the steps of:
selecting a black level offset for the display based on whether the present time is between sunrise and sunset or between sunset and sunrise; and driving the display at the selected black level offset.
40. The method of claim 38 further comprising the steps of:
calculating a percentage of cloud cover; and
further selecting a gamma for the display based on the percentage of cloud cover.
EP16837775.2A 2015-08-17 2016-08-17 Electronic display with environmental adaptation of display characteristics based on location Withdrawn EP3338273A4 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201562206050P 2015-08-17 2015-08-17
US15/043,100 US9924583B2 (en) 2015-05-14 2016-02-12 Display brightness control based on location data
US15/043,135 US10321549B2 (en) 2015-05-14 2016-02-12 Display brightness control based on location data
US201662314073P 2016-03-28 2016-03-28
PCT/US2016/047412 WO2017031237A1 (en) 2015-08-17 2016-08-17 Electronic display with environmental adaptation of display characteristics based on location

Publications (2)

Publication Number Publication Date
EP3338273A1 true EP3338273A1 (en) 2018-06-27
EP3338273A4 EP3338273A4 (en) 2019-09-18

Family

ID=58051720

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16837775.2A Withdrawn EP3338273A4 (en) 2015-08-17 2016-08-17 Electronic display with environmental adaptation of display characteristics based on location

Country Status (6)

Country Link
EP (1) EP3338273A4 (en)
JP (1) JP2018525650A (en)
KR (1) KR102130667B1 (en)
AU (1) AU2016308187B2 (en)
CA (1) CA2985673C (en)
WO (1) WO2017031237A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10255884B2 (en) 2011-09-23 2019-04-09 Manufacturing Resources International, Inc. System and method for environmental adaptation of display characteristics
US10321549B2 (en) 2015-05-14 2019-06-11 Manufacturing Resources International, Inc. Display brightness control based on location data
US10593255B2 (en) 2015-05-14 2020-03-17 Manufacturing Resources International, Inc. Electronic display with environmental adaptation of display characteristics based on location
US10607520B2 (en) 2015-05-14 2020-03-31 Manufacturing Resources International, Inc. Method for environmental adaptation of display characteristics based on location
US10782276B2 (en) 2018-06-14 2020-09-22 Manufacturing Resources International, Inc. System and method for detecting gas recirculation or airway occlusion
US11022635B2 (en) 2018-05-07 2021-06-01 Manufacturing Resources International, Inc. Measuring power consumption of an electronic display assembly
US11526044B2 (en) 2020-03-27 2022-12-13 Manufacturing Resources International, Inc. Display unit with orientation based operation

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8125163B2 (en) 2008-05-21 2012-02-28 Manufacturing Resources International, Inc. Backlight adjustment system
US10586508B2 (en) 2016-07-08 2020-03-10 Manufacturing Resources International, Inc. Controlling display brightness based on image capture device data
CN113870810A (en) * 2021-11-08 2021-12-31 合肥杰发科技有限公司 Color adjusting method and device and display equipment

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2801798B2 (en) * 1991-07-10 1998-09-21 パイオニア株式会社 Navigation system
US7795574B2 (en) * 2004-02-23 2010-09-14 Xenonics, Inc. Low-light viewing device for displaying image based on visible and near infrared light
JP4475008B2 (en) * 2004-05-25 2010-06-09 株式会社デンソー Brightness adjustment device, display device, and program
JP2006106345A (en) * 2004-10-05 2006-04-20 Seiko Epson Corp Video display device
TWI326443B (en) * 2004-10-27 2010-06-21 Chunghwa Picture Tubes Ltd Dynamic gamma correction circuit, method thereof and plane display device
KR100679689B1 (en) * 2005-01-26 2007-02-06 주식회사 에스티월 System for lighting using GPS reciever
EP2048862A3 (en) * 2005-01-31 2009-04-22 Research In Motion Limited Method for and mobile device having a geographical position and ambient dependent backlight of a display
EP1720149A3 (en) * 2005-05-02 2007-06-27 Semiconductor Energy Laboratory Co., Ltd. Display device
JP5119636B2 (en) * 2006-09-27 2013-01-16 ソニー株式会社 Display device and display method
KR101330353B1 (en) * 2008-08-08 2013-11-20 엘지디스플레이 주식회사 Liquid Crystal Display and Driving Method thereof
JP2010181487A (en) * 2009-02-03 2010-08-19 Sanyo Electric Co Ltd Display device
JP4585601B1 (en) * 2009-09-14 2010-11-24 株式会社東芝 Video display device and video display method
US20110102630A1 (en) * 2009-10-30 2011-05-05 Jason Rukes Image capturing devices using device location information to adjust image data during image signal processing
US9286020B2 (en) * 2011-02-03 2016-03-15 Manufacturing Resources International, Inc. System and method for dynamic load sharing between electronic displays
US8885443B2 (en) * 2011-09-20 2014-11-11 Rashed Farhan Sultan Marzouq Apparatus for making astronomical calculations
US9210759B2 (en) * 2012-11-19 2015-12-08 Express Imaging Systems, Llc Luminaire with ambient sensing and autonomous control capabilities
US9536325B2 (en) * 2013-06-09 2017-01-03 Apple Inc. Night mode
US9530342B2 (en) * 2013-09-10 2016-12-27 Microsoft Technology Licensing, Llc Ambient light context-aware display

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10255884B2 (en) 2011-09-23 2019-04-09 Manufacturing Resources International, Inc. System and method for environmental adaptation of display characteristics
US10321549B2 (en) 2015-05-14 2019-06-11 Manufacturing Resources International, Inc. Display brightness control based on location data
US10412816B2 (en) 2015-05-14 2019-09-10 Manufacturing Resources International, Inc. Display brightness control based on location data
US10593255B2 (en) 2015-05-14 2020-03-17 Manufacturing Resources International, Inc. Electronic display with environmental adaptation of display characteristics based on location
US10607520B2 (en) 2015-05-14 2020-03-31 Manufacturing Resources International, Inc. Method for environmental adaptation of display characteristics based on location
US11022635B2 (en) 2018-05-07 2021-06-01 Manufacturing Resources International, Inc. Measuring power consumption of an electronic display assembly
US11656255B2 (en) 2018-05-07 2023-05-23 Manufacturing Resources International, Inc. Measuring power consumption of a display assembly
US10782276B2 (en) 2018-06-14 2020-09-22 Manufacturing Resources International, Inc. System and method for detecting gas recirculation or airway occlusion
US11293908B2 (en) 2018-06-14 2022-04-05 Manufacturing Resources International, Inc. System and method for detecting gas recirculation or airway occlusion
US11774428B2 (en) 2018-06-14 2023-10-03 Manufacturing Resources International, Inc. System and method for detecting gas recirculation or airway occlusion
US11526044B2 (en) 2020-03-27 2022-12-13 Manufacturing Resources International, Inc. Display unit with orientation based operation
US11815755B2 (en) 2020-03-27 2023-11-14 Manufacturing Resources International, Inc. Display unit with orientation based operation

Also Published As

Publication number Publication date
KR102130667B1 (en) 2020-07-06
KR20180008757A (en) 2018-01-24
EP3338273A4 (en) 2019-09-18
AU2016308187B2 (en) 2019-10-31
CA2985673C (en) 2021-03-23
JP2018525650A (en) 2018-09-06
WO2017031237A1 (en) 2017-02-23
CA2985673A1 (en) 2017-02-23
AU2016308187A1 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
US10593255B2 (en) Electronic display with environmental adaptation of display characteristics based on location
US10607520B2 (en) Method for environmental adaptation of display characteristics based on location
US10255884B2 (en) System and method for environmental adaptation of display characteristics
AU2016308187B2 (en) Electronic display with environmental adaptation of display characteristics based on location
JP6700322B2 (en) Improved HDR image encoding and decoding method and apparatus
ES2808177T3 (en) High dynamic range image optimization for particular displays
JP6495552B2 (en) Dynamic range coding for images and video
KR102337438B1 (en) Encoding and decoding of HDR video
CN109219961B (en) Method and apparatus for encoding and decoding HDR video
ES2825699T3 (en) High dynamic range imaging and optimization for home screens
US10217198B2 (en) Simple but versatile dynamic range coding
CN117321626A (en) Content optimized ambient light HDR video adaptation
CN117321625A (en) Display optimized HDR video contrast adaptation
CN117296076A (en) Display optimized HDR video contrast adaptation
CN117280381A (en) Display optimized ambient light HDR video adaptation

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20171108

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: H05B 37/00 20060101ALI20190520BHEP

Ipc: H05B 37/02 20060101ALI20190520BHEP

Ipc: G09G 5/10 20060101ALI20190520BHEP

Ipc: G09G 5/00 20060101AFI20190520BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20190821

RIC1 Information provided on ipc code assigned before grant

Ipc: G09G 5/00 20060101AFI20190814BHEP

Ipc: H05B 37/00 20060101ALI20190814BHEP

Ipc: G09G 5/10 20060101ALI20190814BHEP

Ipc: H05B 37/02 20060101ALI20190814BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20200206