EP2184732B1 - Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique - Google Patents

Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique Download PDF

Info

Publication number
EP2184732B1
EP2184732B1 EP10152602.8A EP10152602A EP2184732B1 EP 2184732 B1 EP2184732 B1 EP 2184732B1 EP 10152602 A EP10152602 A EP 10152602A EP 2184732 B1 EP2184732 B1 EP 2184732B1
Authority
EP
European Patent Office
Prior art keywords
image
backlight
display
average
level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10152602.8A
Other languages
German (de)
English (en)
Other versions
EP2184732A1 (fr
Inventor
Bergen Fletcher
Robert Lowles
James Robinson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BlackBerry Ltd
Original Assignee
BlackBerry Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BlackBerry Ltd filed Critical BlackBerry Ltd
Priority to EP10152602.8A priority Critical patent/EP2184732B1/fr
Publication of EP2184732A1 publication Critical patent/EP2184732A1/fr
Application granted granted Critical
Publication of EP2184732B1 publication Critical patent/EP2184732B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/066—Adjustment of display parameters for control of contrast
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/021—Power management, e.g. power saving
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • G09G3/3611—Control of matrices with row and column drivers

Definitions

  • the invention described herein relates to a system and method for controlling and adjusting a backlight level for a display on an electronic device.
  • the invention described herein relates to controlling the backlight level by determining a current intensity of an image being shown on the display.
  • Japanese Patent Publiction no. 03 179886 A discloses a projection type liquid crystal display device that has a purpose of displaying a picture of white characters with brightness by controlling the lamp luminous quantity in response to an average video level to increase the brightness of a white level peak without reducing the utilizing efficiency of a light in a liquid crystal light bulb.
  • 2001/0033260 discloses a system and method for adjusting the backlighting for a video feed and is directed towards backlight control for moving images, identifying several colour grades for video images, including the use of greyscales and weighing different colours in the greyscale with different values. It describes ⁇ -correction, as well as an average intensity reading for an image and feeding this back to determine a luminance value.
  • the present teaching provides a backlight adjustment module as detailed in claim 1. Additionally, an electronic device as detailed in claim 6 is provided. The teaching also relates to a method as detailed in claim 7. Advantageous embodiments are provided in the dependent claims.
  • a backlight adjustment module controls a backlight system that provides backlight for a display in an electronic device.
  • the backlight adjustment module provides: calculations of an average intensity for an image being displayed on the display on a running average basis from a greyscale value associated with the image corrected according to a gamma curve and to determine a backlight level for the image using the average intensity, where the darker the image the greater is the backlight level; and controls signals to the backlight system based on the calculations to generate a backlight for the image generated on the display.
  • the greyscale value may be obtained from a weighted calculation in which green values are weighted most heavily.
  • the backlight level is adjusted between minimum and maximum backlight levels for the display set for a completely white and a completely black image, respectively.
  • the backlight adjustment module may provide another calculation for another intensity value for another image when the image is replaced by the another image on the display.
  • the backlight adjustment module may provide a greater backlight level to the darker image between the image and another image.
  • the image and another image may relate to a video signal.
  • the running average may be computed by sequentially adding a greyscale pixel value to a running total.
  • control signals may be provided to the backlight system when the image is provided to the display for generation on the display.
  • the backlight level may be further responsive to a signal representing an amount of ambient light detected around the device whereby as the amount of ambient light increases, the backlight level increases.
  • an electronic device having the backlight adjustment module as provided above.
  • a method of adjusting a backlight for images generated on a display of an electronic device comprises: calculating an average intensity of a first image on a running average basis from a greyscale value associated with the image corrected according to a gamma curve; determining a first backlight level for the image based on the intensity level; providing the first backlight level to a backlight system for a display when the first image is generated on the display; calculating an average intensity of a second image on a running average basis from a greyscale value associated with the image corrected according to a gamma curve; determining a backlight level for the second image based on the intensity level; and providing the backlight level to the backlight system for the display when the second image is generated on the display, the darker of the first and the second image is provided with a greater backlight intensity.
  • the greyscale values may be obtained from a weighted calculation in which green values are weighted most heavily.
  • the backlight levels may be adjusted between minimum and maximum backlight levels the display set for a completely white and a completely black image, respectively.
  • a backlight system for an electronic device preferably comprises: a backlight adjustment module to calculate an intensity value of an image; a display for displaying the image; and a backlight system to provide a backlight for the display.
  • the backlight system is preferably responsive to control signals generated by the backlight adjustment module.
  • the intensity value represents an average intensity of the image.
  • the average intensity may be calculated from a greyscale value associated with the image and the greyscale value may have been corrected according to a gamma curve.
  • the average intensity may be calculated on a running average basis of pixels in the image.
  • the greyscale value may provide a weight to favour green colours in the image.
  • another calculation may be made for another intensity value for another image when the image is replaced on the display.
  • another calculation may be made for another intensity value for another image when the image is replaced by another image and if another image has changes over the image over more than a small portion of the display.
  • a method of adjusting a backlight for a display for an electronic device preferably comprises: calculating an intensity value of an image; determining a backlight level for the image based on the intensity level; and providing the backlight level to a backlight system for a display when the image is generated on the display.
  • the intensity value preferably represents an average intensity of the image.
  • the average intensity may be calculated from a greyscale value associated with the image and the greyscale value may have been corrected according to a gamma curve.
  • the average intensity may be calculated on a running average basis of pixels in the image.
  • the greyscale value may provide a weight to favour green colours in the image.
  • another calculation may be made for another intensity value for another image when the image is replaced by the another image on the display.
  • another calculation may be made for another intensity value for another image when the image is replaced by the another image and if the another image has changes over the image over more than a small portion.
  • the display may be displaying a video image comprising the image and another image; and another calculation may made for another intensity value for another image shown on said display after the image.
  • Fig. 1 is a schematic representation of an electronic device having a display and a background light adjustment system for the display in accordance with an embodiment
  • Fig. 2 is a block diagram of internal components of the device of Fig. 1 including the display and the background light adjustment system;
  • Fig. 3 is a flow chart of an algorithm executed by the backlight adjustment system of Fig. 1 ;
  • Fig. 4 is an extract of exemplary pseudocode to implement the algorithm of Fig. 3 ;
  • Fig. 5 is a graph illustrating a backlight intensity level for various ambient lighting conditions used by an embodiment of Fig. 1 .
  • an electronic device for receiving electronic communications in accordance with an embodiment of the invention is indicated generally at 10.
  • electronic device 10 is based on a computing platform having functionality of an enhanced personal digital assistant with cellphone and e-mail features. It is, however, to be understood that electronic device 10 can be based on construction design and functionality of other electronic devices, such as smart telephones, desktop computers pagers or laptops having telephony equipment.
  • electronic device 10 includes a housing 12, an LCD 14, speaker 16, an LED indicator 19, a trackwheel 20, an ESC ("escape") key 22, keypad 24, a telephone headset comprised of an ear bud 28 and a microphone 30.
  • Trackwheel 20 and ESC key 22 can be inwardly depressed along the path of arrow "A" as a means to provide additional input to device 10.
  • housing 12 can be made from any suitable material as will occur to those of skill in the art and may be suitably formed to house and hold all components of device 10.
  • Device 10 is operable to conduct wireless telephone calls, using any known wireless phone system such as a Global System for Mobile Communications (“GSM”) system, Code Division Multiple Access (“CDMA”) system, Cellular Digital Packet Data (“CDPD”) system and Time Division Multiple Access (“TDMA”) system.
  • GSM Global System for Mobile Communications
  • CDMA Code Division Multiple Access
  • CDPD Cellular Digital Packet Data
  • TDMA Time Division Multiple Access
  • Other wireless phone systems can include Bluetooth and the many forms of 802.11 wireless broadband, like 802.11a, 802.11b, 802.11g, etc. that support voice.
  • Other embodiments include Voice over IP (VoIP) type streaming data communications that can simulate circuit switched phone calls.
  • Ear bud 28 can be used to listen to phone calls and other sound messages and microphone 30 can be used to speak into and input sound messages to device 10.
  • VoIP Voice over IP
  • Various applications are provided on device 10, including email, telephone, calendar and address book applications.
  • a GUI to activate these applications is provided on display 14 through a series of icons 26. Shown are calendar icon 26, telephone icon 26, email icon 26 and address book icon 26.
  • Such applications can be selected and activated using the keypad 24 and / or the trackwheel 20. Further detail on selected applications is provided below.
  • microprocessor 18 is provided to control and receive almost all data, transmissions, inputs and outputs related to device 10.
  • Microprocessor 18 is shown schematically as coupled to keypad 24, display 14 and other internal devices.
  • Microprocessor 18 controls the operation of the display 14, as well as the overall operation of the device 10, in response to actuation of keys on the keypad 24 by a user.
  • Exemplary microprocessors for microprocessor 18 include Data 950 (trade-mark) series microprocessors and the 6200 series microprocessors, all available from Intel Corporation.
  • other internal devices of the device 10 include: a communication subsystem 34; a short-range communication subsystem 36; keypad 24; and display 14; with other input/output devices including a set of auxiliary I/O devices through port 38, a serial port 40, a speaker 16 and a microphone port 32 for microphone 30; as well as memory devices including a flash memory 42 (which provides persistent storage of data) and random access memory (RAM) 44; clock 46 and other device subsystems (not shown).
  • the device 10 is preferably a two-way radio frequency (RF) communication device having voice and data communication capabilities.
  • device 10 preferably has the capability to communicate with other computer systems via the Internet.
  • Operating system software executed by microprocessor 18 is preferably stored in a computer readable medium, such as flash memory 42, but may be stored in other types of memory devices, such as read only memory (ROM) or similar storage element.
  • system software, specific device applications, or parts thereof may be temporarily loaded into a volatile storage medium, such as RAM 44. Communication signals received by the mobile device may also be stored to RAM 44.
  • Microprocessor 18 in addition to its operating system functions, enables execution of software applications on device 10.
  • Communication functions including data and voice communications, are performed through the communication subsystem 34 and the short-range communication subsystem 36. Collectively, subsystem 34 and subsystem 36 provide the signal-level interface for all communication technologies processed by device 10. Various other applications 48 provide the operational controls to further process and log the communications.
  • Communication subsystem 34 includes receiver 50, transmitter 52 and one or more antennas, illustrated as receive antenna 54 and transmit antenna 56. In addition, communication subsystem 34 also includes processing module, such as digital signal processor (DSP) 58 and local oscillators (LOs) 60. The specific design and implementation of communication subsystem 34 is dependent upon the communication network in which device 10 is intended to operate.
  • DSP digital signal processor
  • LOs local oscillators
  • communication subsystem 34 of the device 10 may be designed to operate with the Mobitex (trade-mark), DataTAC (trade-mark) or General Packet Radio Service (GPRS) mobile data communication networks and also designed to operate with any of a variety of voice communication networks, such as Advanced Mobile Phone Service (AMPS), Time Division Multiple Access (TDMA), Code Division Multiple Access CDMA, Personal Communication Service (PCS), Global System for Mobile Communication (GSM), etc.
  • AMPS Advanced Mobile Phone Service
  • TDMA Time Division Multiple Access
  • CDMA Code Division Multiple Access CDMA
  • PCS Personal Communication Service
  • GSM Global System for Mobile Communication
  • Communication subsystem 34 provides device 10 with the capability of communicating with other devices using various communication technologies, including instant messaging (IM) systems, text messaging (TM) systems and short message service (SMS) systems.
  • IM instant messaging
  • TM text messaging
  • SMS short message service
  • DSP 58 provides control of receiver 50 and transmitter 52.
  • gains applied to communication signals in receiver 50 and transmitter 52 may be adaptively controlled through automatic gain control algorithms implemented in DSP 58.
  • a received signal such as a text message or web page download
  • the received signal is then further processed by microprocessor 18 which can then generate an output to the display 14 or to an auxiliary I/O port 38.
  • a user may also compose data items, such as e-mail messages, using keypad 24, a thumbwheel associated with keypad 24, and/or some other auxiliary I/O device connected to port 38, such as a touchpad, a rocker key, a separate thumbwheel or some other input device.
  • the composed data items may then be transmitted over communication network 68 via communication subsystem 34.
  • a voice communication mode In a voice communication mode, overall operation of device 10 is substantially similar to the data communication mode, except that received signals are output to speaker 16, and signals for transmission are generated by microphone 30.
  • Alternative voice or audio I/O subsystems such as a voice message recording subsystem, may also be implemented on device 10.
  • Short-range communication subsystem 36 enables communication between device 10 and other proximate systems or devices, which need not necessarily be similar devices.
  • the short-range communication subsystem may include an infrared device and associated circuits and components, or a Bluetooth (trade-mark) communication module to provide for communication with similarly-enabled systems and devices.
  • Powering the entire electronics of the mobile handheld communication device is power source 62.
  • the power source 62 includes one or more batteries. More preferably, the power source 62 is a single battery pack, especially a rechargeable battery pack.
  • a power switch (not shown) provides an "on/off" switch for device 10. Upon activation of the power switch an application 48 is initiated to turn on device 10. Upon deactivation of the power switch, an application 48 is initiated to turn off device 10. Power to device 10 may also be controlled by other devices and by internal software applications.
  • Display 14 has backlight system 64 to assist in the viewing display 14, especially under low-light conditions.
  • a backlight system is almost invariably present in a LCD.
  • a typical backlight system comprises a lighting source, such as a series of LEDs or a lamp located behind the LCD panel of the display, and a controller to control activation of the lighting source.
  • the lamp may be fluorescent, incandescent, electroluminescent or any other suitable light source. As the lighting sources are illuminated, their light shines through the LCD panel providing backlight to the display.
  • the intensity of the backlight level may be controlled by the controller by selectively activating a selected number of lighting sources (e.g. one, several or all LEDs) or by selectively controlling the activation duty cycle of the activated lighting sources (e.g. a duty cycle anywhere between 0% to 100% may be used).
  • light sensor 66 is provided on device 10.
  • Sensor 66 is a light sensitive device which converts detected light levels into an electrical signal, such as a voltage. It may be located anywhere on device 10, having considerations for aesthetics and operation characteristics of sensor 66.
  • an opening for light to be received by sensor 66 is located on the front cover of the housing of device 10 to reduce the possibility of blockage of the opening.
  • multiple sensors 66 may be provided and the software may provide different emphasis on signals provided from different sensors 66.
  • the signal(s) provided by sensor(s) 66 can be used by a circuit in device 10 to determine when device 10 is in a well-lit, dimly lit or moderately-lit environment. This information can then be used to control backlight levels for display 14.
  • Calendar 48C which tracks appointments and other status matters relating to the user and device 10.
  • Calendar 48C is activated by activation of calendar icon 26 on display 14. It provides a daily/weekly/month electronic schedule of appointments, meetings and events entered by the user.
  • Calendar 48C tracks time and day data for device 10 using processor 18 and internal clock 46.
  • the schedule contains data relating to the current accessibility of the user. For example it can indicate when the user is busy, not busy, available or not available.
  • calendar 48C generates input screens on device 10 prompting the user to input scheduled events through keypad 24. Alternatively, notification for scheduled events could be received via an encoded signal in a received communication, such as an e-mail, SMS message or voicemail message.
  • calendar 48C stores processes information relating to the event; generates data relating to the event; and stores the data in memory in device 10.
  • Address book 48D enables device 10 to store contact information for persons and organizations. Address book 48D is activated by activation of address book icon 26 on display 14. In particular, name, address, telephone numbers, e-mail addresses, cellphone numbers and other contact information is stored. The data can be entered through keypad 24 and is stored in an accessible a database in non-volatile memory, such as persistent storage 70, which is associated with microprocessor 18, or any other electronic storage provided in device 10.
  • non-volatile memory such as persistent storage 70, which is associated with microprocessor 18, or any other electronic storage provided in device 10.
  • Email application 48E provides modules to allow user of device 10 to generate email messages on device 10 and send them to their addressees.
  • Application 48E also provides a GUI which provides a historical list of emails received, drafted, saved and sent. Text for emails can be entered through keypad 24.
  • Email application 48E is activated by activation of email icon 26 on display 14.
  • Calculator application 48F provides modules to allow user of device 10 to create and process arithmetic calculations and display the results through a GUI.
  • Backlight adjustment application 48G is an image processing module and instructions to an image that is about to be displayed on display 14 to be analyzed for its intensity. Based on the intensity (or luminosity), a backlight level can be calculated and set for the image. As such, when the image is actually displayed on display 14, the backlight level can be appropriately set for the image.
  • Backlight adjustment application can generate an appropriate signal, such as a pulse width modulation (PWM) signal or values for a PWM signal, that can be used to drive a backlight in backlight system 64 to an appropriate level. If backlight system 64 utilizes a duty cycle signal to determine a backlight level, application 48G can be modified to provide a value for such a signal, based on inputs received. Further detail on calculations conducted by application 48G are provided below.
  • PWM pulse width modulation
  • An embodiment provides a system and method for dynamically adjusting the lighting intensity of the backlight on display 14. As a backlight system for a display tends to consume a large percentage of power required by a handheld device 10, using the backlight more efficiently can increase battery life for device 10.
  • Backlight system 64 provides the lighting means to vary the intensity of the backlight provided to display 14.
  • Backlight adjustment application 48G provides the software that controls the intensity of the backlight using various inputs and signals available to display 14 relating to an image that is currently generated on display 14.
  • a basic algorithm provided by the embodiment is to first make a determination of an intensity of an image currently being displayed, then make any adjustment to the intensity to account for intensity characteristics of colours generated in the image and finally, adjusting a backlight level for the image being generated on the display based on the adjusted intensity.
  • the intensity may be based on any type of intensity reading determined for the image. For example, an average intensity reading can be determined. Various types of averages can be used. Details of each are described in turn.
  • One feature of an embodiment is that the intensity of a backlight is dynamically calculated and adjusted as different images are displayed on display 14. This can have the effect of providing an efficient backlight value for each image, thereby reducing power consumption for backlight system 64 by adjusting its output to meet the current characteristics of the current image.
  • the embodiment utilizes difference in perceived brightness level in a displayed image versus the actual brightness level of the image. For example, an image having many dark pixels may appear to be less bright than an image having many lighter pixels. This apparent brightness level difference occurs because the liquid crystal in an LCD generally allows more light to pass through lighter pixels and less light passes through darker pixels. In an idealized image, all light would pass through a completely white image and no light would pass through a completely black image.
  • algorithm 300 comprises the above noted three main calculations: calculate an average greyscale value for an image in section 302; adjust a greyscale value in section 304; convert the adjusted greyscale value to a backlight percentage value in section 306; adjust the backlight values between minimum and maximum brightness values in section 308 and set the calculated backlight value and display the image in section 310. Each section is described in turn.
  • an embodiment provides an algorithm implemented in software that executes on device 10 that calculates an average of greyscale values for an image being generated on display 14.
  • the greyscale values are calculated as the image is read from memory or as the image is being written to the display 14.
  • a greyscale value is derived from a photopic curve based calculation which combines three colour pixels (i.e. red, green and blue) into a single value.
  • the average may be calculated on a running average basis, in order to minimize the processing of large numbers.
  • a conventional method of calculating an average is to first sum intensity values of all the pixels in an image and then divide by the total number of pixels.
  • an embodiment preferably sequentially adds a pixel value to a running average total. After every pixel value has been added to the total, the average value can be calculated by dividing by the total number of pixels.
  • each pixel is provided with a 5 bit greyscale pixel, then after converting the greyscale into a decimal number, the pixel greyscale value is between 0 and 31.
  • the greyscale of each pixel would be set at 31.
  • Exemplary pseudocode for Equation 1 is provided in Fig. 4 .
  • the display 14 in order to provide an intensity value for the image that can be compared against other intensity values for other images, it is preferable to convert the net colour value for the image into a greyscale value. It is preferable to convert each RGB pixel value into a greyscale value in order to provide a common value to base a calculation on every pixel. For example, in a given image, a pixel that is green at a given intensity is more luminous that a pixel that is red at the same intensity. By converting all colour values for all pixels to a greyscale, such differences are smoothed out, since during the conversion process, the luminosity of different colours is preferably taken into consideration.
  • a colour format used is RGB 565, meaning that there are 32 levels of resolution for red in five bits, 64 levels for green in six bits and 32 levels for blue in five bits.
  • a first step is to drop the least significant bit (LSB) of the green pixel, in order to normalize all bit values for the red, green, and blue colours.
  • LSB least significant bit
  • each of the three colours is represented by a number between 0-31.
  • the values for the three colours are converted into a single greyscale value by a weighted calculation. The weighting of each pixel colour is based on the photopic curve.
  • the human eye does not perceive all wavelengths of light equally: generally green wavelengths are perceived to be more intense than red and blue wavelengths. Therefore when converting a red-green-blue image to a greyscale image, the green value in the image is preferably most heavily weighted.
  • a gamma curve can be used to correct the brightness of all pixel colours lying between white and black.
  • the gamma value of a typical LCD is about 2.2.
  • a gamma value of may be used 2: calculating a non-integral power (e.g. x 2.2 ) requires more calculations and longer time than calculating an integral power (i.e. x 2 ). However, if an embodiment has sufficient processing power, other values may also be used.
  • the average greyscale value is converted into a percentage based on a minimum brightness level (the level that would be set for a completely white image) and a maximum brightness level (the level that would be set for a completely black image). Between the minimum and maximum levels, a parabolic curve is used to determine a brightness of all images between white and black. The curve may be based on the gamma curve, as known in the art.
  • a range of minimum and maximum brightness levels for backlight system 64 is provided in order to provide practical operational boundaries for the brightness level signals provided by backlight system 64.
  • the boundaries may vary on the characteristics of each device 10 and each type of display 14 provided therein.
  • backlight system 64 provides a backlight intensity corresponding to the signal provided.
  • backlight system e.g. as a PWM signal or a duty cycle signal
  • backlight system 64 provides a backlight intensity corresponding to the signal provided.
  • the image is written itself to display 14.
  • Fig. 4 provides a pseudo-code listing which may be used as a basis to implement flow chart 300 in software.
  • Table A provides an exemplary set of results of processing various images by an embodiment. Therein, six images are shown of varying colour intensities.
  • the PWM signals shown in the right column represent the duty cycle calculated for a display 14 to provide sufficient and consistent backlighting among the six images when displayed on device 10.
  • Table A Image Number Backlight intensity (where 0% is off, and 100% is full power)
  • Image 1 Third darkest image (fourth brightest image) 74%
  • Image 2 Fifth darkest image (second brightest image) 61%
  • Image 3 Fourth darkest image (third brightest image) 68%
  • Image 4 Least dark image (Brightest image) From BlackBerry Subject: Top 10 Typing Tips 54% You can find more typing tips in the on handheld help. In the menu of any program, click Help.
  • the backlight level preferably remains the same.
  • the embodiment describes providing backlight calculations for images that are static on display 14.
  • an embodiment can utilize the same techniques described herein on a frame-by-frame basis.
  • the backlight calculations may be done on an interval basis, for example, once every 2, 3, 5, 10, 15, 20, 30 ... frames. This interval may be based on the video CODEC used. Many CODECs only contain complete frame data only for one frame in an interval. Subsequent frames in the interval are composites of these full-data frames.
  • the embodiment described herein provides an intensity calculation based on the entire display section of display 14.
  • different sections of display 14 may be used to calculate an average.
  • an average may be calculated based on alternating rows in display 14 or on a specific section of display 14 (e.g. its central area).
  • Other averages may use only one or two of the colours (e.g. green and red, as they are the two most dominant colours).
  • a combination of any of these alternative calculations may be used.
  • the intensity calculation provided above can be used with ambient lighting condition information provided by sensor 66 to make further adjustments to the intensity level.
  • graph 500 shows a backlight level for display 14 on the y-axis compared against a level of ambient light surrounding device 14 on the x-axis.
  • graph 500 has in a low backlight level when display 14 is in a very dark environment.
  • the backlight level increases as well.
  • Graph 500 provides a linear increase in backlight level intensity to as the amount of ambient light increases. At a certain point, the ambient light conditions are very bright and as such, the backlight may not be very effective in those conditions. As shown in graph 500, at that point, backlighting may be turned off.
  • a backlight level progression may be expressed as a formula, which may be used by software to determine an appropriate control signal for the controller of the backlight system for a given level of ambient light.
  • a backlight level progression may be stored as a table providing a set of backlight levels for a corresponding set of ambient light levels.
  • a series of different adjustment algorithms may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Liquid Crystal (AREA)

Claims (8)

  1. Module de réglage de rétroéclairage (48G) pour contrôler un système de rétroéclairage (64) qui fournit un rétroéclairage à un écran (14) dans un dispositif électronique (10), ledit module de réglage de rétroéclairage (48G) étant conçu :
    pour fournir des calculs d'une intensité moyenne pour l'image d'une vidéo qui est affichée sur ledit écran sur une base moyenne mobile à partir de valeurs d'échelle de gris associées à des pixels de ladite image ayant des valeurs de pixel rouge, vert et bleu (RGB) et ladite moyenne est corrigée conformément à une courbe gamma, les valeurs de pixel de l'échelle de gris obtenues à partir d'un calcul pondéré dans lequel des valeurs de pixel vert de ladite image sont pondérées plus fortement que des valeurs de pixel bleu et de pixel rouge et la moyenne mobile est calculée en ajoutant, successivement, une valeur de pixel d'échelle de gris à une moyenne mobile pour ladite image, où la moyenne mobile est calculée conformément à l'équation suivante : A N = A N - 1 - A N - 1 - X N ,
    Figure imgb0015
    où, AN est la nouvelle moyenne, AN-1 est la moyenne précédente, X est a nouvelle valeur de pixel d'échelle de gris ajoutée à la moyenne, et N est le nombre de valeurs comprises jusque-là dans la moyenne ;
    pour déterminer un niveau de rétroéclairage pour ladite image au moyen de ladite intensité moyenne, où plus l'image est sombre, plus le niveau de rétroéclairage est élevé ; et
    pour fournir des signaux de contrôle audit système de rétroéclairage sur la base desdits calculs pour générer un rétroéclairage pour ladite image générée sur ledit écran (14) et où ledit niveau de rétroéclairage est en outre réceptif à un signal représentant une quantité de lumière ambiante détectée autour du dispositif moyennant quoi, à mesure que la quantité de lumière ambiante augmente, le niveau de rétroéclairage augmente jusqu'à ce qu'une quantité prédéterminée de ladite lumière ambiante soit détectée et moment auquel ledit rétroéclairage est éteint.
  2. Module selon la revendication 1, dans lequel ledit niveau de rétroéclairage est réglé entre des niveaux de rétroéclairage minimum et maximum pour ledit écran (14), définis, respectivement, pour une image complètement blanche et une image complètement noire.
  3. Module selon la revendication 1 ou la revendication 2, dans lequel ledit module de réglage de rétroéclairage fournit un autre calcul pour une autre valeur d'intensité pour une autre image lorsque ladite image est remplacée par ladite autre image sur ledit écran (14).
  4. Module selon la revendication 3, dans lequel ladite image et ladite autre image concernent un signal vidéo.
  5. Module selon l'une quelconque des revendications précédentes, dans lequel lesdits signaux de contrôle sont fournis audit système de rétroéclairage lorsque ladite image est fournie audit écran pour une génération sur ledit écran.
  6. Dispositif électronique comprenant le module (48G) selon l'une quelconque des revendications 1 à 5.
  7. Procédé pour régler un rétroéclairage pour des images générées sur un écran (14) d'un dispositif électronique, comprenant les étapes suivantes :
    calculer une intensité moyenne d'une première image d'une vidéo sur la base d'une moyenne mobile à partir de valeurs d'échelle de gris associées à des pixels desdites premières images où ladite moyenne est corrigée conformément à une courbe gamma ;
    déterminer un premier niveau de rétroéclairage pour ladite première image sur la base dudit niveau d'intensité moyenne ;
    fournir ledit premier niveau de rétroéclairage à un système de rétroéclairage (64) pour un écran lorsque ladite première image est générée sur ledit écran (14) ;
    calculer une intensité moyenne d'une seconde image de ladite vidéo sur la base d'une moyenne mobile à partir des valeurs d'échelle de gris associées à des pixels de ladite seconde image où ladite moyenne est corrigée conformément à une courbe gamma, les valeurs de pixel de l'échelle de gris sont obtenues à partir d'un calcul pondéré dans lequel des valeurs de pixel vert parmi des valeurs de pixel rouge, vert et bleu (RGB), des valeurs de pixel de ladite seconde image sont pondérées plus fortement que les valeurs de pixel rouge et de pixel bleu et la moyenne mobile est calculée en ajoutant, successivement, une valeur de pixel d'échelle de gris à une moyenne mobile pour ladite image, où chaque moyenne mobile est calculée conformément à l'équation suivante : A N = A N - 1 - A N - 1 - X N ,
    Figure imgb0016
    où, AN est la nouvelle moyenne, AN-1 est la moyenne précédente, X est a nouvelle valeur de pixel d'échelle de gris ajoutée à la moyenne, et N est le nombre de valeurs comprises jusque-là dans la moyenne ;
    déterminer un niveau de rétroéclairage pour ladite seconde image sur la base dudit niveau d'intensité ; et
    fournir ledit niveau de rétroéclairage audit système de rétroéclairage (64) pour ledit écran lorsque ladite seconde image est générée sur ledit écran (14), la plus sombre entre ladite première et ladite seconde image est pourvue d'une intensité de rétroéclairage plus grande et où ledit niveau de rétroéclairage est en outre réceptif à un signal représentant une quantité de lumière ambiante détectée autour du dispositif moyennant quoi, à mesure que la quantité de lumière ambiante augmente, le niveau de rétroéclairage augmente jusqu'à ce qu'une quantité prédéterminée de ladite lumière ambiante soit détectée et moment auquel ledit rétroéclairage s'éteint.
  8. Procédé selon la revendication 7, dans lequel lesdits niveaux de rétroéclairage sont réglés entre des niveaux de rétroéclairage minimum et maximum dudit écran définis, respectivement, pour une image complètement blanche ou une image complètement noire.
EP10152602.8A 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique Active EP2184732B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP10152602.8A EP2184732B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP10152602.8A EP2184732B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique
EP06101680A EP1818901B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP06101680.4 Division 2006-02-14
EP06101680A Division EP1818901B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique

Publications (2)

Publication Number Publication Date
EP2184732A1 EP2184732A1 (fr) 2010-05-12
EP2184732B1 true EP2184732B1 (fr) 2014-12-17

Family

ID=36177811

Family Applications (2)

Application Number Title Priority Date Filing Date
EP10152602.8A Active EP2184732B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique
EP06101680A Active EP1818901B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP06101680A Active EP1818901B1 (fr) 2006-02-14 2006-02-14 Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique

Country Status (5)

Country Link
EP (2) EP2184732B1 (fr)
AT (1) ATE459072T1 (fr)
CA (1) CA2574807C (fr)
DE (1) DE602006012439D1 (fr)
HK (1) HK1108964A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2099019A1 (fr) 2008-02-29 2009-09-09 Research In Motion Limited Système et procédé pour régler une valeur d'intensité et un niveau de rétroéclairage de l'affichage dans un dispositif électronique
US8194028B2 (en) 2008-02-29 2012-06-05 Research In Motion Limited System and method for adjusting an intensity value and a backlight level for a display of an electronic device
WO2010092179A1 (fr) * 2009-02-16 2010-08-19 Arcelik Anonim Sirketi Dispositif d'affichage et son procédé de commande
CN110288952B (zh) * 2019-06-24 2021-07-16 湖北亿咖通科技有限公司 一种车载系统开机时背光亮度的设置方法和装置
CN113192464B (zh) * 2020-01-14 2023-01-13 华为技术有限公司 一种背光调节方法及电子设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03179886A (ja) 1989-12-07 1991-08-05 Toshiba Corp 投写形液晶表示装置
TW518882B (en) 2000-03-27 2003-01-21 Hitachi Ltd Liquid crystal display device for displaying video data
US6762741B2 (en) * 2000-12-22 2004-07-13 Visteon Global Technologies, Inc. Automatic brightness control system and method for a display device using a logarithmic sensor
CN1307608C (zh) * 2001-04-25 2007-03-28 松下电器产业株式会社 图象显示装置及图象显示方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SHAYLE R SEARLE: "The Recurrence Formulae for Means and Variances", TEACHING STATISTICS, vol. 5, no. 1, 1 January 1983 (1983-01-01), pages 7 - 10, XP055122512, ISSN: 0141-982X *

Also Published As

Publication number Publication date
EP1818901B1 (fr) 2010-02-24
EP1818901A1 (fr) 2007-08-15
HK1108964A1 (en) 2008-05-23
ATE459072T1 (de) 2010-03-15
EP2184732A1 (fr) 2010-05-12
DE602006012439D1 (de) 2010-04-08
CA2574807A1 (fr) 2007-08-14
CA2574807C (fr) 2012-04-03

Similar Documents

Publication Publication Date Title
US8878767B2 (en) System and method for adjusting a backlight level by calculating a running average of pixel intensity for a display on an electronic device
US8194028B2 (en) System and method for adjusting an intensity value and a backlight level for a display of an electronic device
US8063873B2 (en) System and method for adjusting a backlight level for a display on an electronic device
US8817002B2 (en) Data display adapted for bright ambient light
US8902132B2 (en) Self light emission display device, power consumption detecting device, and program
US7932879B2 (en) Controlling electroluminescent panels in response to cumulative utilization
US8471500B2 (en) Electronic device and method of illumination
JP5415571B2 (ja) コンテンツ適応ディスプレイによってデバイスにおける電力消費を低減する方法、装置、システム、およびコンピュータ読取可能媒体
EP2204792A1 (fr) Procédé et dispositif pour contrôler l'alimentation d'une diode électroluminescente organique à matrice active
JP2015018285A (ja) 携帯電話端末、画像表示制御方法、及び画像表示制御プログラム
EP2184732B1 (fr) Système et procédé pour régler le niveau de rétroéclairage de l'affichage dans un dispositif électronique
EP1494202A1 (fr) Afficheur, terminal mobile et procede de commande de la luminance dans un terminal mobile
CA2655089C (fr) Systeme et methode permettant de regler l'intensite et le niveau de contre-jour du panneau d'affichage d'un dispositif electronique
EP2403223B1 (fr) Adaptation d'éclairage d'un ecran en fonction de la lumière ambiante
CA2654847C (fr) Systeme et methode permettant de regler le niveau de contre-jour du panneau d'affichage d'un dispositif electronique
KR20120079398A (ko) 휴대용 단말기에서 전력 소모 방지 방법 및 장치
EP2224696B1 (fr) Ajustement automatique de rétroéclairage de clavier sur un dispositif électronique mobile portable
JP2010139678A (ja) 表示駆動装置
CA2769377C (fr) Procede et systeme pour reduire rapidement la luminance d'un dispositif d'affichage a diodes electroluminescentes organiques
KR20070012144A (ko) 휴대용 단말기의 백라이트 제어 장치 및 방법

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100204

AC Divisional application: reference to earlier application

Ref document number: 1818901

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17Q First examination report despatched

Effective date: 20111026

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140708

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AC Divisional application: reference to earlier application

Ref document number: 1818901

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 702385

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602006044058

Country of ref document: DE

Effective date: 20150129

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150318

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 702385

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150417

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006044058

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150214

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150228

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

26N No opposition filed

Effective date: 20150918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150214

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20060214

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141217

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230223

Year of fee payment: 18

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20240226

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240228

Year of fee payment: 19

Ref country code: GB

Payment date: 20240220

Year of fee payment: 19

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602006044058

Country of ref document: DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602006044058

Country of ref document: DE

Owner name: MALIKIE INNOVATIONS LTD., IE

Free format text: FORMER OWNER: BLACKBERRY LTD., WATERLOO, ONTARIO, CA