EP1818901B1 - System and method for adjusting a backlight level for a display on an electronic device - Google Patents
System and method for adjusting a backlight level for a display on an electronic device Download PDFInfo
- Publication number
- EP1818901B1 EP1818901B1 EP06101680A EP06101680A EP1818901B1 EP 1818901 B1 EP1818901 B1 EP 1818901B1 EP 06101680 A EP06101680 A EP 06101680A EP 06101680 A EP06101680 A EP 06101680A EP 1818901 B1 EP1818901 B1 EP 1818901B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- backlight
- display
- average
- another
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000004364 calculation method Methods 0.000 claims abstract description 31
- 238000004590 computer program Methods 0.000 claims 2
- 238000004891 communication Methods 0.000 description 42
- 239000003086 colorant Substances 0.000 description 10
- 230000004913 activation Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000010295 mobile communication Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 208000015976 Corneal dystrophy-perceptive deafness syndrome Diseases 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000003760 hair shine Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003442 weekly effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/066—Adjustment of display parameters for control of contrast
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
- G09G3/3611—Control of matrices with row and column drivers
Definitions
- a system for an electronic device comprising: a display for displaying an image to be backlit; a backlight adjustment module to calculate an average intensity of said image on a running average basis from a greyscale value associated with said image corrected according to a gamma curve and to determine an backlight level for said image using said average intensity; and a backlight system to provide a backlight for said display, said backlight system responsive to control signals generated by said backlight adjustment module, whereby the darker the image the greater is the backlight intensity.
- the average intensity may be calculated from a greyscale value associated with the image and the greyscale value may have been corrected according to a gamma curve.
- Communication functions including data and voice communications, are performed through the communication subsystem 34 and the short-range communication subsystem 36. Collectively, subsystem 34 and subsystem 36 provide the signal-level interface for all communication technologies processed by device 10. Various other applications 48 provide the operational controls to further process and log the communications.
- Communication subsystem 34 includes receiver 50, transmitter 52 and one or more antennas, illustrated as receive antenna 54 and transmit antenna 56. In addition, communication subsystem 34 also includes processing module, such as digital signal processor (DSP) 58 and local oscillators (LOs) 60. The specific design and implementation of communication subsystem 34 is dependent upon the communication network in which device 10 is intended to operate.
- DSP digital signal processor
- LOs local oscillators
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Liquid Crystal Display Device Control (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Liquid Crystal (AREA)
Abstract
Description
- The invention described herein relates to a system and method for controlling and adjusting a backlight level for a display on an electronic device. In particular, the invention described herein relates to controlling the backlight level by determining a current intensity of an image being shown on the display.
- Current wireless handheld mobile communication devices perform a variety of functions to enable mobile users to stay current with information and communications, such as e-mail, corporate data and organizer information while they are away from their desks. A wireless connection to a server allows a mobile communication device to receive updates to previously received information and communications. The handheld devices optimally are lightweight, compact and have long battery life.
- Current devices are used in all types of ambient environments. In different environments, e.g. lightly or dimly lit environments, different amounts of backlighting may be needed. This may also be valid for the type of image, colourwise, that is being displayed. Present systems do not adjust the backlight level to adjust for the brightness of the currently displayed image.
- There is a need for a system and method which addresses deficiencies in the prior art.
-
US-A-2001/033260 discloses a display device for displaying video data. In one specific embodiment backlighting of the image is discussed. It is suggested to increase the backlighting when the average luminance of the image is high and to reduce the backlighting when the average luminance is low. - In a first aspect, there is provided a system for an electronic device, comprising: a display for displaying an image to be backlit; a backlight adjustment module to calculate an average intensity of said image on a running average basis from a greyscale value associated with said image corrected according to a gamma curve and to determine an backlight level for said image using said average intensity; and a backlight system to provide a backlight for said display, said backlight system responsive to control signals generated by said backlight adjustment module, whereby the darker the image the greater is the backlight intensity.
- In the system, the greyscale value may provide a weight to favour green colours in the image.
- In the system, another calculation may be made for another intensity value for another image when the image is replaced on the display.
- In the system, another calculation may be made for another intensity value for another image when the image is replaced by another image and if another image has changes over the image over more than a small portion of the display.
- In a second aspect, a method of adjusting a backlight for a display for an electronic device comprises calculating an average intensity of said image on a running average basis from a greyscale value associated with said image corrected according to a gamma curve; determining a backlight level for said image based on said intensity level; and providing said backlight level to a backlight system for a display when said image is generated on said display whereby the darker the image the greater is the backlight intensity.
- In the method, the average intensity may be calculated from a greyscale value associated with the image and the greyscale value may have been corrected according to a gamma curve.
- In the method, the greyscale value may provide a weight to favour green colours in the image.
- In the method, another calculation may be made for another intensity value for another image when the image is replaced by the another image on the display. In the method, another calculation may be made for another intensity value for another image when the image is replaced by the another image and if the another image has changes over the image over more than a small portion.
- In the method, the display may be displaying a video image comprising the image and another image; and another calculation may made for another intensity value for another image shown on said display after the image.
- In other aspects, various sets and subsets of the above noted aspects are provided.
- The invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
-
Fig. 1 is a schematic representation of an electronic device having a display and a background light adjustment system for the display in accordance with an embodiment; -
Fig. 2 is a block diagram of internal components of the device ofFig. 1 including the display and the background light adjustment system; -
Fig. 3 is a flow chart of an algorithm executed by the backlight adjustment system ofFig. 1 ; -
Fig. 4 is an extract of exemplary pseudocode to implement the algorithm ofFig. 3 ; and -
Fig. 5 is a graph illustrating a backlight intensity level for various ambient lighting conditions used by an embodiment ofFig. 1 . - The description which follows and the embodiments described therein are provided by way of illustration of an example or examples of particular embodiments of the principles of the present invention. These examples are provided for the purposes of explanation and not limitation of those principles and of the invention. In the description which follows, like parts are marked throughout the specification and the drawings with the same respective reference numerals.
- Referring to
Fig. 1 , an electronic device for receiving electronic communications in accordance with an embodiment of the invention is indicated generally at 10. In the present embodiment,electronic device 10 is based on a computing platform having functionality of an enhanced personal digital assistant with cellphone and e-mail features. It is, however, to be understood thatelectronic device 10 can be based on construction design and functionality of other electronic devices, such as smart telephones, desktop computers pagers or laptops having telephony equipment. In a present embodiment,electronic device 10 includes ahousing 12, anLCD 14,speaker 16, anLED indicator 19, atrackwheel 20, an ESC ("escape")key 22,keypad 24, a telephone headset comprised of anear bud 28 and amicrophone 30.Trackwheel 20 andESC key 22 can be inwardly depressed along the path of arrow "A" as a means to provide additional input todevice 10. - It will be understood that
housing 12 can be made from any suitable material as will occur to those of skill in the art and may be suitably formed to house and hold all components ofdevice 10. -
Device 10 is operable to conduct wireless telephone calls, using any known wireless phone system such as a Global System for Mobile Communications ("GSM") system, Code Division Multiple Access ("CDMA") system, Cellular Digital Packet Data ("CDPD") system and Time Division Multiple Access ("TDMA") system. Other wireless phone systems can include Bluetooth and the many forms of 802.11 wireless broadband, like 802.11a, 802.11b, 802.11g, etc. that support voice. Other embodiments include Voice over IP (VoIP) type streaming data communications that can simulate circuit switched phone calls.Ear bud 28 can be used to listen to phone calls and other sound messages andmicrophone 30 can be used to speak into and input sound messages todevice 10. - Various applications are provided on
device 10, including email, telephone, calendar and address book applications. A GUI to activate these applications is provided ondisplay 14 through a series oficons 26. Shown arecalendar icon 26,telephone icon 26,email icon 26 and addressbook icon 26. Such applications can be selected and activated using thekeypad 24 and / or thetrackwheel 20. Further detail on selected applications is provided below. - Referring to
Fig. 2 , functional elements ofdevice 10 are provided. The functional elements are generally electronic or electro-mechanical devices. In particular,microprocessor 18 is provided to control and receive almost all data, transmissions, inputs and outputs related todevice 10.Microprocessor 18 is shown schematically as coupled tokeypad 24, display 14 and other internal devices.Microprocessor 18 controls the operation of thedisplay 14, as well as the overall operation of thedevice 10, in response to actuation of keys on thekeypad 24 by a user. Exemplary microprocessors formicroprocessor 18 include Data 950 (trade-mark) series microprocessors and the 6200 series microprocessors, all available from Intel Corporation. - In addition to the
microprocessor 18, other internal devices of thedevice 10 include: acommunication subsystem 34; a short-range communication subsystem 36;keypad 24; anddisplay 14; with other input/output devices including a set of auxiliary I/O devices throughport 38, aserial port 40, aspeaker 16 and amicrophone port 32 formicrophone 30; as well as memory devices including a flash memory 42 (which provides persistent storage of data) and random access memory (RAM) 44;clock 46 and other device subsystems (not shown). Thedevice 10 is preferably a two-way radio frequency (RF) communication device having voice and data communication capabilities. In addition,device 10 preferably has the capability to communicate with other computer systems via the Internet. - Operating system software executed by
microprocessor 18 is preferably stored in a computer readable medium, such asflash memory 42, but may be stored in other types of memory devices, such as read only memory (ROM) or similar storage element. In addition, system software, specific device applications, or parts thereof, may be temporarily loaded into a volatile storage medium, such as RAM 44. Communication signals received by the mobile device may also be stored to RAM 44. -
Microprocessor 18, in addition to its operating system functions, enables execution of software applications ondevice 10. A set ofsoftware applications 48 that control basic device operations, such as avoice communication module 48A and adata communication module 48B, may be installed on thedevice 10 during manufacture or downloaded thereafter. - Communication functions, including data and voice communications, are performed through the
communication subsystem 34 and the short-range communication subsystem 36. Collectively,subsystem 34 andsubsystem 36 provide the signal-level interface for all communication technologies processed bydevice 10. Variousother applications 48 provide the operational controls to further process and log the communications.Communication subsystem 34 includesreceiver 50,transmitter 52 and one or more antennas, illustrated as receive antenna 54 and transmitantenna 56. In addition,communication subsystem 34 also includes processing module, such as digital signal processor (DSP) 58 and local oscillators (LOs) 60. The specific design and implementation ofcommunication subsystem 34 is dependent upon the communication network in whichdevice 10 is intended to operate. For example,communication subsystem 34 of thedevice 10 may be designed to operate with the Mobitex (trade-mark), DataTAC (trade-mark) or General Packet Radio Service (GPRS) mobile data communication networks and also designed to operate with any of a variety of voice communication networks, such as Advanced Mobile Phone Service (AMPS), Time Division Multiple Access (TDMA), Code Division Multiple Access CDMA, Personal Communication Service (PCS), Global System for Mobile Communication (GSM), etc.Communication subsystem 34 providesdevice 10 with the capability of communicating with other devices using various communication technologies, including instant messaging (IM) systems, text messaging (TM) systems and short message service (SMS) systems. - In addition to processing communication signals,
DSP 58 provides control ofreceiver 50 andtransmitter 52. For example, gains applied to communication signals inreceiver 50 andtransmitter 52 may be adaptively controlled through automatic gain control algorithms implemented inDSP 58. - In a data communication mode a received signal, such as a text message or web page download, is processed by the
communication subsystem 34 and is provided as an input tomicroprocessor 18. The received signal is then further processed bymicroprocessor 18 which can then generate an output to thedisplay 14 or to an auxiliary I/O port 38. A user may also compose data items, such as e-mail messages, usingkeypad 24, a thumbwheel associated withkeypad 24, and/or some other auxiliary I/O device connected toport 38, such as a touchpad, a rocker key, a separate thumbwheel or some other input device. The composed data items may then be transmitted overcommunication network 68 viacommunication subsystem 34. - In a voice communication mode, overall operation of
device 10 is substantially similar to the data communication mode, except that received signals are output tospeaker 16, and signals for transmission are generated bymicrophone 30. Alternative voice or audio I/O subsystems, such as a voice message recording subsystem, may also be implemented ondevice 10. - Short-
range communication subsystem 36 enables communication betweendevice 10 and other proximate systems or devices, which need not necessarily be similar devices. For example, the short-range communication subsystem may include an infrared device and associated circuits and components, or a Bluetooth (trade-mark) communication module to provide for communication with similarly-enabled systems and devices. - Powering the entire electronics of the mobile handheld communication device is
power source 62. Preferably, thepower source 62 includes one or more batteries. More preferably, thepower source 62 is a single battery pack, especially a rechargeable battery pack. A power switch (not shown) provides an "on/off" switch fordevice 10. Upon activation of the power switch anapplication 48 is initiated to turn ondevice 10. Upon deactivation of the power switch, anapplication 48 is initiated to turn offdevice 10. Power todevice 10 may also be controlled by other devices and by internal software applications. -
Display 14 hasbacklight system 64 to assist in theviewing display 14, especially under low-light conditions. A backlight system is almost invariably present in a LCD. A typical backlight system comprises a lighting source, such as a series of LEDs or a lamp located behind the LCD panel of the display, and a controller to control activation of the lighting source. The lamp may be fluorescent, incandescent, electroluminescent or any other suitable light source. As the lighting sources are illuminated, their light shines through the LCD panel providing backlight to the display. The intensity of the backlight level may be controlled by the controller by selectively activating a selected number of lighting sources (e.g. one, several or all LEDs) or by selectively controlling the activation duty cycle of the activated lighting sources (e.g. a duty cycle anywhere between 0% to 100% may be used). - To assist with one method of adjusting the backlight level,
light sensor 66 is provided ondevice 10.Sensor 66 is a light sensitive device which converts detected light levels into an electrical signal, such as a voltage. It may be located anywhere ondevice 10, having considerations for aesthetics and operation characteristics ofsensor 66. In one embodiment, an opening for light to be received bysensor 66 is located on the front cover of the housing ofdevice 10 to reduce the possibility of blockage of the opening. In other embodiments,multiple sensors 66 may be provided and the software may provide different emphasis on signals provided fromdifferent sensors 66. The signal(s) provided by sensor(s) 66 can be used by a circuit indevice 10 to determine whendevice 10 is in a well-lit, dimly lit or moderately-lit environment. This information can then be used to control backlight levels fordisplay 14. - Brief descriptions are provided on the
applications 48 stored and executed indevice 10. Additional applications includecalendar 48C which tracks appointments and other status matters relating to the user anddevice 10.Calendar 48C is activated by activation ofcalendar icon 26 ondisplay 14. It provides a daily/weekly/month electronic schedule of appointments, meetings and events entered by the user.Calendar 48C tracks time and day data fordevice 10 usingprocessor 18 andinternal clock 46. The schedule contains data relating to the current accessibility of the user. For example it can indicate when the user is busy, not busy, available or not available. In use,calendar 48C generates input screens ondevice 10 prompting the user to input scheduled events throughkeypad 24. Alternatively, notification for scheduled events could be received via an encoded signal in a received communication, such as an e-mail, SMS message or voicemail message. Once the data relating to the event is entered,calendar 48C stores processes information relating to the event; generates data relating to the event; and stores the data in memory indevice 10. -
Address book 48D enablesdevice 10 to store contact information for persons and organizations.Address book 48D is activated by activation ofaddress book icon 26 ondisplay 14. In particular, name, address, telephone numbers, e-mail addresses, cellphone numbers and other contact information is stored. The data can be entered throughkeypad 24 and is stored in an accessible a database in non-volatile memory, such aspersistent storage 70, which is associated withmicroprocessor 18, or any other electronic storage provided indevice 10. -
Email application 48E provides modules to allow user ofdevice 10 to generate email messages ondevice 10 and send them to their addressees.Application 48E also provides a GUI which provides a historical list of emails received, drafted, saved and sent. Text for emails can be entered throughkeypad 24.Email application 48E is activated by activation ofemail icon 26 ondisplay 14. -
Calculator application 48F provides modules to allow user ofdevice 10 to create and process arithmetic calculations and display the results through a GUI. -
Backlight adjustment application 48G is an image processing module and instructions to an image that is about to be displayed ondisplay 14 to be analyzed for its intensity. Based on the intensity (or luminosity), a backlight level can be calculated and set for the image. As such, when the image is actually displayed ondisplay 14, the backlight level can be appropriately set for the image. Backlight adjustment application can generate an appropriate signal, such as a pulse width modulation (PWM) signal or values for a PWM signal, that can be used to drive a backlight inbacklight system 64 to an appropriate level. Ifbacklight system 64 utilizes a duty cycle signal to determine a backlight level,application 48G can be modified to provide a value for such a signal, based on inputs received. Further detail on calculations conducted byapplication 48G are provided below. - Further detail is now provided on notable aspects of an embodiment. An embodiment provides a system and method for dynamically adjusting the lighting intensity of the backlight on
display 14. As a backlight system for a display tends to consume a large percentage of power required by ahandheld device 10, using the backlight more efficiently can increase battery life fordevice 10.Backlight system 64 provides the lighting means to vary the intensity of the backlight provided to display 14.Backlight adjustment application 48G provides the software that controls the intensity of the backlight using various inputs and signals available to display 14 relating to an image that is currently generated ondisplay 14. A basic algorithm provided by the embodiment is to first make a determination of an intensity of an image currently being displayed, then make any adjustment to the intensity to account for intensity characteristics of colours generated in the image and finally, adjusting a backlight level for the image being generated on the display based on the adjusted intensity. The intensity may be based on any type of intensity reading determined for the image. For example, an average intensity reading can be determined. Various types of averages can be used. Details of each are described in turn. - One feature of an embodiment is that the intensity of a backlight is dynamically calculated and adjusted as different images are displayed on
display 14. This can have the effect of providing an efficient backlight value for each image, thereby reducing power consumption forbacklight system 64 by adjusting its output to meet the current characteristics of the current image. - The embodiment utilizes difference in perceived brightness level in a displayed image versus the actual brightness level of the image. For example, an image having many dark pixels may appear to be less bright than an image having many lighter pixels. This apparent brightness level difference occurs because the liquid crystal in an LCD generally allows more light to pass through lighter pixels and less light passes through darker pixels. In an idealized image, all light would pass through a completely white image and no light would pass through a completely black image.
- Referring to
Fig. 3 , further detail is provided on a calculation conducted bymodule 48G. Thereinalgorithm 300 comprises the above noted three main calculations: calculate an average greyscale value for an image insection 302; adjust a greyscale value insection 304; convert the adjusted greyscale value to a backlight percentage value insection 306; adjust the backlight values between minimum and maximum brightness values insection 308 and set the calculated backlight value and display the image insection 310. Each section is described in turn. - For
section 302, an embodiment provides an algorithm implemented in software that executes ondevice 10 that calculates an average of greyscale values for an image being generated ondisplay 14. The greyscale values are calculated as the image is read from memory or as the image is being written to thedisplay 14. A greyscale value is derived from a photopic curve based calculation which combines three colour pixels (i.e. red, green and blue) into a single value. The average may be calculated on a running average basis, in order to minimize the processing of large numbers. As an image is being read from memory or as it is being written to the display the value of each pixel is computed into the running average. A conventional method of calculating an average is to first sum intensity values of all the pixels in an image and then divide by the total number of pixels. This computational method introduces large numbers in the calculation method. As an alternative, an embodiment preferably sequentially adds a pixel value to a running average total. After every pixel value has been added to the total, the average value can be calculated by dividing by the total number of pixels. - For example, for a colour image having dimensions of 260x240 pixels, there are 62400 pixels. If each pixel is provided with a 5 bit greyscale pixel, then after converting the greyscale into a decimal number, the pixel greyscale value is between 0 and 31. For an example where an image in which every pixel is fully on, the greyscale of each pixel would be set at 31. During a conventional calculation of an average greyscale the running total of greyscale values would be 1934400 for an image the size of 260x240 pixels (i.e., image size x greyscale value of each pixel = 260 x 240 x 31). This running total value would cause an overflow of a regular 16-bit unsigned integer, which typically has a maximum value of 65535.
- As such, to avoid such an overflow condition, the embodiment uses an average calculation that calculates a running average per equation 1:
Therein, AN is the new average, A N-1 is the previous average, X is the new value added to the average, and N is the number of values included in the average so far. Exemplary pseudocode forEquation 1 is provided inFig. 4 . - As the
display 14 generates images in colour, in order to provide an intensity value for the image that can be compared against other intensity values for other images, it is preferable to convert the net colour value for the image into a greyscale value. It is preferable to convert each RGB pixel value into a greyscale value in order to provide a common value to base a calculation on every pixel. For example, in a given image, a pixel that is green at a given intensity is more luminous that a pixel that is red at the same intensity. By converting all colour values for all pixels to a greyscale, such differences are smoothed out, since during the conversion process, the luminosity of different colours is preferably taken into consideration. - Further detail on a greyscale conversion is provided. In an
exemplary display 14 indevice 10, a colour format used is RGB 565, meaning that there are 32 levels of resolution for red in five bits, 64 levels for green in six bits and 32 levels for blue in five bits. For the greyscale conversion, a first step is to drop the least significant bit (LSB) of the green pixel, in order to normalize all bit values for the red, green, and blue colours. As such, each of the three colours is represented by a number between 0-31. Next, the values for the three colours are converted into a single greyscale value by a weighted calculation. The weighting of each pixel colour is based on the photopic curve. The human eye does not perceive all wavelengths of light equally: generally green wavelengths are perceived to be more intense than red and blue wavelengths. Therefore when converting a red-green-blue image to a greyscale image, the green value in the image is preferably most heavily weighted. A commonly used (NTSC Standard) weighting is provided in Equation 2:
It can be seen that the green value is most heavily weighted with a scaling factor of 0.59, the red value is next most heavily weighted with a scaling factor of 0.3 and the blue value is least heavily weighted with a scaling factor of 0.11. In other embodiments, other scaling factors may be used. - Next, for
section 304 the value of the intensity is adjusted using a gamma curve correction factor. A gamma curve can be used to correct the brightness of all pixel colours lying between white and black. The gamma curve is provided in Equation 3:
where y is the gamma-corrected pixel value, x is the original pixel value, MAX is the maximum pixel value and γ is the gamma correction value. For the instance of a pixel having 5-bit colour resolution, MAX is 31. The gamma value of a typical LCD is about 2.2. In order to simplify mathematical calculations, a gamma value of may be used 2: calculating a non-integral power (e.g. x 2.2) requires more calculations and longer time than calculating an integral power (i.e. x 2). However, if an embodiment has sufficient processing power, other values may also be used. - Next, for
section 306, the average greyscale value is converted into a percentage based on a minimum brightness level (the level that would be set for a completely white image) and a maximum brightness level (the level that would be set for a completely black image). Between the minimum and maximum levels, a parabolic curve is used to determine a brightness of all images between white and black. The curve may be based on the gamma curve, as known in the art. - Next, for
section 308, a range of minimum and maximum brightness levels forbacklight system 64 is provided in order to provide practical operational boundaries for the brightness level signals provided bybacklight system 64. The boundaries may vary on the characteristics of eachdevice 10 and each type ofdisplay 14 provided therein. - Finally for
section 310, once all backlight parameters are set, all control signals for thebacklight system 64 are provided byapplication 48G to backlight system (e.g. as a PWM signal or a duty cycle signal), andbacklight system 64 provides a backlight intensity corresponding to the signal provided. At the same time, the image is written itself to display 14. -
Fig. 4 provides a pseudo-code listing which may be used as a basis to implementflow chart 300 in software. - The following Table A provides an exemplary set of results of processing various images by an embodiment. Therein, six images are shown of varying colour intensities. The PWM signals shown in the right column represent the duty cycle calculated for a
display 14 to provide sufficient and consistent backlighting among the six images when displayed ondevice 10. - As long as an image remains generated on
display 14, the backlight level preferably remains the same. The embodiment describes providing backlight calculations for images that are static ondisplay 14. For video images, an embodiment can utilize the same techniques described herein on a frame-by-frame basis. Alternatively, for video applications, the backlight calculations may be done on an interval basis, for example, once every 2, 3, 5, 10, 15, 20, 30 ... frames. This interval may be based on the video CODEC used. Many CODECs only contain complete frame data only for one frame in an interval. Subsequent frames in the interval are composites of these full-data frames. - It will further be appreciated that for an electronic device, several static images may be displayed on
device 10, even though minimal activity is apparent ondevice 10. For example, for a device that has a moveable displayed cursor, each instance of a movement of the cursor would cause a new image to be generated ondisplay 14. As such, a new calculation may be done for each updated image. Also, a display ondevice 14 having a clock signal would be updated each time a digit changed on the clock signal. For such instances, if the change in the image affects only a relatively small portion of the entire screen, the system may selectively not conduct a recalculation of the intensity of the image. - The embodiment described herein provides an intensity calculation based on the entire display section of
display 14. In other embodiments, different sections ofdisplay 14 may be used to calculate an average. For example, an average may be calculated based on alternating rows indisplay 14 or on a specific section of display 14 (e.g. its central area). Other averages may use only one or two of the colours (e.g. green and red, as they are the two most dominant colours). In other embodiments a combination of any of these alternative calculations may be used. - It will be appreciated that the embodiment can be used on monochrome displays. Therein, a greyscale value is already provided for the image being displayed on
display 14. - In other embodiments, the intensity calculation provided above can be used with ambient lighting condition information provided by
sensor 66 to make further adjustments to the intensity level. - Referring to
Fig. 5 ,graph 500 shows a backlight level fordisplay 14 on the y-axis compared against a level of ambientlight surrounding device 14 on the x-axis. As is shown,graph 500 has in a low backlight level whendisplay 14 is in a very dark environment. As the amount of ambient light increases, the backlight level increases as well.Graph 500 provides a linear increase in backlight level intensity to as the amount of ambient light increases. At a certain point, the ambient light conditions are very bright and as such, the backlight may not be very effective in those conditions. As shown ingraph 500, at that point, backlighting may be turned off. It will be appreciated that in other embodiments for other LCDs, other graphs of backlight level progressions may be used, including step-wise progressions and non-linear progressions. A backlight level progression may be expressed as a formula, which may be used by software to determine an appropriate control signal for the controller of the backlight system for a given level of ambient light. In other embodiments, a backlight level progression may be stored as a table providing a set of backlight levels for a corresponding set of ambient light levels. In other embodiments, a series of different adjustment algorithms may be used. - The present invention is defined by the claims appended hereto, with the foregoing description being merely illustrative of a preferred embodiment of the invention. Those of ordinary skill may envisage certain modifications to the foregoing embodiments which, although not explicitly discussed herein, do not depart from the scope of the invention, as defined by the appended claims.
Claims (19)
- A system for an electronic device (10), comprising:a display (14) for displaying an image to be backlit;a backlight adjustment module (48G) to calculate an average intensity of said image on a running average basis from a greyscale value associated with said image corrected according to a gamma curve and to determine a backlight level for said image using said average intensity; anda backlight system (64) to provide a backlight for said display (14), said backlight system responsive to control signals generated by said backlight adjustment module, whereby the darker the image the greater is the backlight intensity.
- The system as claimed in claim 1, wherein said greyscale value is obtained from a weighted calculation in which green values are weighted most heavily.
- The system as claimed in claim 1 or 2, wherein said backlight level is adjusted between minimum and maximum backlight levels for said display (14) set for a completely white and a completely black image, respectively.
- The system as claimed in any one of claims 1 to 3, wherein said system is arranged to make another calculation for another intensity value for another image when said image is replaced by said another image on said display (14).
- The system as claimed in claim 4, wherein said image and said another image relate to a video signal.
- The system as in any of the previous claims, wherein the running average is computed by sequentially adding a greyscale pixel value to a running total.
- The system as in any of the previous claims, wherein said backlight level is further responsive to a signal representing an amount of ambient light detected around the device whereby as the amount of ambient light increases, the backlight level increases.
- A method of adjusting a backlight for an image generated on a display (14) of an electronic device, comprising:calculating an average intensity of said image on a running average basis from a greyscale value associated with said image corrected according to a gamma curve; determining a backlight level for said image based on said intensity level; andproviding said backlight level to a backlight system (64) for a display when said image is generated on said display (14) whereby the darker the image the greater is the backlight intensity.
- The method as claimed in claim 9, wherein said greyscale value is obtained from a weighted calculation in which green values are weighted most heavily.
- The method as claimed in claim 9 or 10, wherein said backlight level is adjusted between minimum and maximum backlight levels said display set for a completely white and a completely black image, respectively.
- The method as claimed in any one of claims 9 to 11, wherein another calculation is made for another intensity value for another image when said image is replaced by said another image on said display.
- The method as claimed in claim 12, wherein said another calculation is made for another intensity value for another image when said image is replaced by said another image on said display and said another intensity value is calculated on a predefined section of said another image.
- The method as claimed in claim 13, wherein said display is displaying a video image comprising said image and another image; and another calculation is made for another intensity value for another image shown on said display (14) after said image.
- The method as in any one of claims 9 to 14, wherein the running average is computed by sequentially adding a pixel value to a running total.
- The method as in as in any of claims 9 to 15, wherein said level of backlight is further adjusted using ambient lighting condition information such that as the amount of ambient light increases, the backlight level increases.
- An electronic device having the system as claimed in any one of claims 1 to 8.
- A computer program product for adjusting a backlight for a display for an electronic device, said computer program product comprising a computer readable medium embodying program code means for implementing in an electronic device the method of any one of claims 9 to 17.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10152602.8A EP2184732B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
DE602006012439T DE602006012439D1 (en) | 2006-02-14 | 2006-02-14 | System and method for setting a backlight level for a display of an electronic device |
AT06101680T ATE459072T1 (en) | 2006-02-14 | 2006-02-14 | SYSTEM AND METHOD FOR ADJUSTING A LEVEL OF BACKLIGHTING FOR A DISPLAY OF AN ELECTRONIC DEVICE |
EP06101680A EP1818901B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
CA2574807A CA2574807C (en) | 2006-02-14 | 2007-01-22 | System and method for adjusting a backlight level for a display on an electronic device |
HK08101716.3A HK1108964A1 (en) | 2006-02-14 | 2008-02-15 | System and method for adjusting a backlight level for a display on an electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP06101680A EP1818901B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10152602.8A Division EP2184732B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1818901A1 EP1818901A1 (en) | 2007-08-15 |
EP1818901B1 true EP1818901B1 (en) | 2010-02-24 |
Family
ID=36177811
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10152602.8A Active EP2184732B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
EP06101680A Active EP1818901B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10152602.8A Active EP2184732B1 (en) | 2006-02-14 | 2006-02-14 | System and method for adjusting a backlight level for a display on an electronic device |
Country Status (5)
Country | Link |
---|---|
EP (2) | EP2184732B1 (en) |
AT (1) | ATE459072T1 (en) |
CA (1) | CA2574807C (en) |
DE (1) | DE602006012439D1 (en) |
HK (1) | HK1108964A1 (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2099019A1 (en) | 2008-02-29 | 2009-09-09 | Research In Motion Limited | System and method for adjusting an intensity value and a backlight level for a display of an electronic device |
US8194028B2 (en) | 2008-02-29 | 2012-06-05 | Research In Motion Limited | System and method for adjusting an intensity value and a backlight level for a display of an electronic device |
WO2010092179A1 (en) * | 2009-02-16 | 2010-08-19 | Arcelik Anonim Sirketi | A display device and the control method thereof |
CN110288952B (en) * | 2019-06-24 | 2021-07-16 | 湖北亿咖通科技有限公司 | Method and device for setting backlight brightness of vehicle-mounted system during startup |
CN113192464B (en) * | 2020-01-14 | 2023-01-13 | 华为技术有限公司 | Backlight adjusting method and electronic equipment |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03179886A (en) * | 1989-12-07 | 1991-08-05 | Toshiba Corp | Projection type liquid crystal display device |
TW518882B (en) | 2000-03-27 | 2003-01-21 | Hitachi Ltd | Liquid crystal display device for displaying video data |
US6762741B2 (en) * | 2000-12-22 | 2004-07-13 | Visteon Global Technologies, Inc. | Automatic brightness control system and method for a display device using a logarithmic sensor |
US7093941B2 (en) * | 2001-04-25 | 2006-08-22 | Matsushita Electric Industrial Co., Ltd. | Video display apparatus and video display method |
-
2006
- 2006-02-14 DE DE602006012439T patent/DE602006012439D1/en active Active
- 2006-02-14 EP EP10152602.8A patent/EP2184732B1/en active Active
- 2006-02-14 AT AT06101680T patent/ATE459072T1/en not_active IP Right Cessation
- 2006-02-14 EP EP06101680A patent/EP1818901B1/en active Active
-
2007
- 2007-01-22 CA CA2574807A patent/CA2574807C/en active Active
-
2008
- 2008-02-15 HK HK08101716.3A patent/HK1108964A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
EP2184732B1 (en) | 2014-12-17 |
CA2574807C (en) | 2012-04-03 |
DE602006012439D1 (en) | 2010-04-08 |
CA2574807A1 (en) | 2007-08-14 |
EP2184732A1 (en) | 2010-05-12 |
HK1108964A1 (en) | 2008-05-23 |
EP1818901A1 (en) | 2007-08-15 |
ATE459072T1 (en) | 2010-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7821490B2 (en) | System and method for adjusting a backlight level for a display on an electronic device | |
US8451213B2 (en) | System and method for adjusting a backlight level for a display on an electronic device | |
US8194028B2 (en) | System and method for adjusting an intensity value and a backlight level for a display of an electronic device | |
CA2661689C (en) | Methods and apparatus for automatic brightness adjustment on a display of a mobile electronic device | |
US8471500B2 (en) | Electronic device and method of illumination | |
US8817002B2 (en) | Data display adapted for bright ambient light | |
US8730271B2 (en) | Method and device for controlling power of active matrix organic light-emitting diode | |
US20080278099A1 (en) | Controlling electroluminescent panels in response to cumulative utilization | |
KR100455991B1 (en) | Apparatus for controlling lcd backlight in mobile station | |
EP1818901B1 (en) | System and method for adjusting a backlight level for a display on an electronic device | |
JP2015018285A (en) | Portable telephone terminal, image display control method, and image display control program | |
JP2010517099A (en) | System and method for reducing power consumption in devices by content adaptive display | |
WO2006111797A1 (en) | Device and method for controlling a backlit display | |
WO2003081567A1 (en) | Display device, mobile terminal, and luminance control method in mobile terminal | |
JP2007148064A (en) | Portable electronic apparatus and control method thereof | |
CA2655089C (en) | System and method for adjusting an intensity value and a backlight level for a display of an electronic device | |
EP1654721B1 (en) | Monochromatic field sequential liquid crystal display | |
CA2654847C (en) | System and method for adjusting a backlight level for a display on an electronic device | |
EP2403223A1 (en) | Adaptation of display illumination depending on ambient light | |
US8502473B2 (en) | System and method for illuminating a component of an electronic device | |
EP2224696B1 (en) | Automatic keypad backlight adjustment on a mobile handheld electronic device | |
US20080042966A1 (en) | Monochromatic field sequential liquid crystal display | |
CA2769377C (en) | Method and system to quickly fade the luminance of an oled display | |
KR20070012144A (en) | Apparatus and method for controlling a backlight of portable terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20060214 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
17Q | First examination report despatched |
Effective date: 20070814 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AXX | Extension fees paid |
Extension state: MK Payment date: 20060214 Extension state: AL Payment date: 20060214 Extension state: HR Payment date: 20060214 Extension state: YU Payment date: 20060214 Extension state: BA Payment date: 20060214 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1108964 Country of ref document: HK |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602006012439 Country of ref document: DE Date of ref document: 20100408 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1108964 Country of ref document: HK |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20100224 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20100224 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100625 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100624 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100604 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100525 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100524 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
26N | No opposition filed |
Effective date: 20101125 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110228 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110228 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100224 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602006012439 Country of ref document: DE Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN, DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602006012439 Country of ref document: DE Owner name: BLACKBERRY LIMITED, WATERLOO, CA Free format text: FORMER OWNER: RESEARCH IN MOTION LTD., WATERLOO, ONTARIO, CA Effective date: 20140925 Ref country code: DE Ref legal event code: R082 Ref document number: 602006012439 Country of ref document: DE Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN, DE Effective date: 20140925 Ref country code: DE Ref legal event code: R082 Ref document number: 602006012439 Country of ref document: DE Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN PATENTANWA, DE Effective date: 20140925 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240228 Year of fee payment: 19 Ref country code: GB Payment date: 20240220 Year of fee payment: 19 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602006012439 Country of ref document: DE Ref country code: DE Ref legal event code: R081 Ref document number: 602006012439 Country of ref document: DE Owner name: MALIKIE INNOVATIONS LTD., IE Free format text: FORMER OWNER: BLACKBERRY LIMITED, WATERLOO, ONTARIO, CA |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20240226 Year of fee payment: 19 Ref country code: FR Payment date: 20240226 Year of fee payment: 19 |