DE102011002867A1 - Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal - Google Patents

Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal Download PDF

Info

Publication number
DE102011002867A1
DE102011002867A1 DE201110002867 DE102011002867A DE102011002867A1 DE 102011002867 A1 DE102011002867 A1 DE 102011002867A1 DE 201110002867 DE201110002867 DE 201110002867 DE 102011002867 A DE102011002867 A DE 102011002867A DE 102011002867 A1 DE102011002867 A1 DE 102011002867A1
Authority
DE
Germany
Prior art keywords
mobile terminal
user
terminal
backlight
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
DE201110002867
Other languages
German (de)
Inventor
Stephan Storck
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Priority to DE201110002867 priority Critical patent/DE102011002867A1/en
Publication of DE102011002867A1 publication Critical patent/DE102011002867A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/021—Power management, e.g. power saving
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/027—Arrangements or methods related to powering off a display

Abstract

The method involves using a built-in camera (K) for detecting the viewing directions (R,R1,R2) of the user. The backlight (L) of the mobile terminal (E) is turned-off for a particular period of time, when the viewing direction of the user is not directed to the mobile terminal. The backlight of the mobile terminal is turned-on for a particular period of time, when the viewing direction of the user is directed to the mobile terminal. An independent claim is included for computer program product for controlling backlight of mobile terminal.

Description

Die Erfindung betrifft ein Verfahren zur Steuerung der Beleuchtung der Anzeige eines mobilen Endgerätes.The invention relates to a method for controlling the illumination of the display of a mobile terminal.

Anwendungen auf mobilen Geräten finden immer mehr Einzug in das tägliche Leben. Eine der Beschränkungen dieser mobilen Geräte ist die Akkulaufzeit, die unter anderem entscheidend durch die Hintergrundbeleuchtung der Anzeigeeinheit beziehungsweise des Displays mitbestimmt wird. Des Weiteren werden mobile Applikationen, wie z. B. Navigation oder Digital Graffiti, immer mehr über längere Zeit aktiv betrieben. Häufig verbleibt hierbei das Gerät mit eingeschalteter Displaybeleuchtung, damit der Anwender zu jeder Zeit die entsprechenden Information ablesen kann. Dies reduziert die Akkulaufzeit erheblich.Applications on mobile devices are finding their way into daily life more and more. One of the limitations of these mobile devices is the battery life, which is crucially influenced, among other things, by the backlight of the display unit or the display. Furthermore, mobile applications, such. As navigation or digital graffiti, more and more actively operated for a long time. Frequently, the device remains with the display illumination switched on, so that the user can read the corresponding information at any time. This significantly reduces the battery life.

Die meisten der heutigen Geräte verfügen deshalb über eine automatische Displayabschaltung, die nach einer definierten Zeit die Hintergrundbeleuchtung abschaltet. Diese Abschaltung muss jedoch durch eine bewusste Aktion des Anwenders, z. B. durch drücken einer Taste oder berühren des Displays, wieder aufgehoben werden, bevor die Informationen der Applikation wieder sichtbar sind.Most of today's devices therefore have an automatic display shutdown, which switches off the backlight after a defined time. This shutdown must, however, by a deliberate action of the user, for. B. by pressing a button or touching the display, be canceled again before the information of the application are visible again.

Die der Erfindung zu Grunde liegende Aufgabe besteht nun darin, ein Verfahren zur Steuerung der Beleuchtung der Anzeige eines mobilen Endgerätes derart anzugeben, dass die oben genannten Nachteile möglichst vermieden werden.The object underlying the invention is now to specify a method for controlling the illumination of the display of a mobile terminal such that the abovementioned disadvantages are avoided as far as possible.

Diese Aufgabe wird durch die Merkmale des Patentanspruchs 1 erfindungsgemäß gelöst. Die weiteren Ansprüche betreffen bevorzugte Ausgestaltungen der Erfindung und ein entsprechendes Computerprogrammprodukt.This object is achieved by the features of claim 1 according to the invention. The other claims relate to preferred embodiments of the invention and a corresponding computer program product.

Die Erfindung betrifft im Wesentlichen ein Verfahren zur Steuerung der Anzeigenbeleuchtung eines mobilen Endgeräts, bei dem die Augenpartie des Anwenders mit Hilfe einer im Endgerät eingebauten Kamera erfasst wird und bei dem durch ein im Endgerät ausführbares Programm die Blickrichtung des Anwenders ermittelt und eine Abschaltung der Anzeigenbeleuchtung des Endgeräts bewirkt wird, sobald die Blickrichtung des Anwenders für eine gewisse Zeitdauer nicht auf das Endgerät gerichtet ist und/oder entsprechend ein Einschalten der Anzeigenbeleuchtung des Endgeräts bewirkt wird, sobald die Gesamtblickrichtung des Anwenders für eine bestimmte Zeitdauer auf das Endgerät gerichtet ist.The invention relates essentially to a method for controlling the display illumination of a mobile terminal, in which the eye area of the user is detected by means of a built-in terminal in the terminal and in which by a program executable in the terminal determines the viewing direction of the user and a shutdown of the display illumination of the Terminal is effected as soon as the line of sight of the user for a certain period of time is not directed to the terminal and / or a corresponding switching on the display illumination of the terminal is effected as soon as the overall viewing direction of the user is directed to the terminal for a certain period of time.

Hierdurch wird der Energieverbrauch des mobilen Endgerätes erheblich reduziert beziehungsweise die Akkulaufzeit entsprechend verlängert und eine manuelle Aktivierung der Anzeigenbeleuchtung ist nicht erforderlich.As a result, the power consumption of the mobile terminal is significantly reduced or extended the battery life accordingly and manual activation of the display lighting is not required.

Nachfolgend wird die Erfindung anhand von in der Zeichnung dargestellten Ausführungsbeispielen näher erläutert.The invention will be explained in more detail with reference to embodiments shown in the drawing.

Dabei zeigtIt shows

1 eine Übersichtsdarstellung zur Erläuterung des erfindungsgemäßen Verfahrens und 1 an overview of the explanation of the method according to the invention and

2 eine Darstellung zur Erläuterung eines speziellen Ausführungsbeispiels der Erfindung. 2 a representation for explaining a specific embodiment of the invention.

In 1 ist die Augenpartie AP mit den Augen A1 und A2 eines Anwenders angedeutet die sich in einem Abstand d von dessen Endgerät E befindet und von einer im Endgerät E eingebauten Kamera K erfasst wird, wobei die Blickrichtungen R1 und R2 beziehungsweise die Gesamtblickrichtung R der beiden Augen A1 und A2 auf das Endgerät E gerichtet sind.In 1 the eye area AP is indicated with the eyes A1 and A2 of a user who is at a distance d from his terminal E and is detected by a camera K installed in the terminal E, the viewing directions R1 and R2 or the overall viewing direction R of the two eyes A1 and A2 are directed to the terminal E.

Eine im Endgerät befindliche Verarbeitungseinheit VE verarbeitet, beispielsweise durch Ausführung eines entsprechenden Computerprogramms, ein von der Kamera K erfasstes Bild der Augenpartie AP des Anwenders derart, dass eine Gesamtblickrichtung des Anwenders ermittelt und eine Abschaltung der Anzeigenbeleuchtung L des Endgeräts bewirkt wird, sobald die Gesamtblickrichtung des Anwenders für eine bestimmte Zeitdauer, typischerweise einige Sekunden, nicht auf das Endgerät gerichtet ist und/oder entsprechend ein Einschalten der Anzeigenbeleuchtung L des Endgeräts bewirkt wird, sobald die Gesamtblickrichtung des Anwenders für eine bestimmte Zeitdauer, typischerweise einige Sekunden, auf das Endgerät gerichtet ist.A processing unit VE located in the terminal processes, for example by executing a corresponding computer program, an image of the eye area AP of the user captured by the camera K in such a way that an overall viewing direction of the user is determined and a shutdown of the display illumination L of the terminal is effected as soon as the overall viewing direction of the user User is for a certain period of time, typically a few seconds, is not directed to the terminal and / or a corresponding turn on the display illumination L of the terminal is effected as soon as the overall direction of the user for a certain period of time, typically a few seconds, is directed to the terminal.

Hierbei wird die Lage eines oder beider Augen durch übliche Mustererkennungsverfahren erkannt und auf Basis entweder einer oder beider Pupillenpositionen relativ zum Augenzentrum zusammen mit üblichen Werten für die Augengeometrie sowie des üblichen Leseabstandes d und im Wesentlichen mit Hilfe des Strahlensatzes aus der Mathematik die Gesamtblickrichtung R ermittelt.Here, the position of one or both eyes is detected by conventional pattern recognition method and based on either one or both pupil positions relative to the eye center together with the usual values for the eye geometry and the usual reading distance d and essentially with the help of the jet set from mathematics, the overall direction R determined.

Eine besonders einfache Ausführungsform der Erfindung ist in 2 angedeutet. Hierbei wird aus dem Kamerabild der Augenpartie AP die Lage eines Augenzentrums Z ermittelt und ein für das Betrachten eines bestimmten Endgerätes typischer Pupillenbereich B relativ zur Lage des Zentrums Z festgelegt. Befindet sich nun die Pupille P beziehungsweise deren Mittelpunkt innerhalb des Pupillenbereichs kann davon ausgegangen werden, dass der Anwender des Endgerätes gerade das Endgerät betrachtet. Entsprechend kann zur Erhöhung der Genauigkeit des Verfahrens auch die Lage beider Augenzentren in entsprechender Weise ermittelt und ausgewertet werden.A particularly simple embodiment of the invention is in 2 indicated. In this case, the position of an eye center Z is determined from the camera image of the eye area AP, and a pupil area B typical for the viewing of a specific terminal is determined relative to the position of the center Z. If the pupil P or its center is now located within the pupil area, it can be assumed that the user of the terminal is currently looking at the terminal. Accordingly, the position of both eye centers can be determined and evaluated in a corresponding manner to increase the accuracy of the method.

Claims (3)

Verfahren zur Steuerung der Anzeigenbeleuchtung (L) eines mobilen Endgeräts (E), bei dem die Augenpartie (AP) eines Anwenders des Endgeräts mit Hilfe einer im Endgerät eingebauten Kamera (K) erfasst wird und bei dem die Blickrichtung (R, R1, R2) des Anwenders ermittelt und eine Abschaltung der Anzeigenbeleuchtung des Endgeräts bewirkt wird, sobald die Blickrichtung des Anwenders für eine bestimmte Zeitdauer nicht auf das Endgerät gerichtet ist und/oder ein Einschalten der Anzeigenbeleuchtung des Endgeräts bewirkt wird, sobald die Gesamtblickrichtung des Anwenders für eine bestimmte Zeitdauer einige Sekunden, auf das Endgerät gerichtet ist.Method for controlling the display illumination (L) of a mobile terminal (E), in which the eye area (AP) of a user of the terminal is detected by means of a built-in terminal (K) and in which the viewing direction (R, R1, R2) determined by the user and a shutdown of the display lighting of the terminal is effected when the user's gaze direction for a certain period of time is not directed to the terminal and / or switching on the display illumination of the terminal is effected as soon as the overall viewing direction of the user for a certain period of time Seconds, is directed to the terminal. Verfahren nach Anspruch 1, bei dem dadurch festgestellt wird, ob die Blickrichtung des Anwenders für eine bestimmte Zeitdauer nicht auf das Endgerät gerichtet ist, dass innerhalb des von der Kamera erfassten Bildes der Augenpartie bei mindestens einem abgebildeten Auge (A1, A2) ein jeweiliger Bereich (B) um das Zentrum des jeweiligen Auges festgelegt wird und überprüft wird, ob sich die Pupille (P) innerhalb dieses jeweiligen Bereiches befindet oder nicht.The method of claim 1, wherein it is determined by whether the user's line of sight is not aimed at the terminal for a certain period of time, that within the image of the eye area detected by the camera at least one imaged eye (A1, A2) a respective area (B) is determined around the center of the respective eye and it is checked whether the pupil (P) is within this respective area or not. Computerprogrammprodukt zur Ausführung in einer Verarbeitungseinheit (VE) eines mobilen Endgeräts (E) mit eingebauter Kamera (K) zur Durchführung eines Verfahrens nach Anspruch 1 oder 2.Computer program product for execution in a processing unit (VE) of a mobile terminal (E) with built-in camera (K) for performing a method according to claim 1 or 2.
DE201110002867 2011-01-19 2011-01-19 Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal Ceased DE102011002867A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE201110002867 DE102011002867A1 (en) 2011-01-19 2011-01-19 Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE201110002867 DE102011002867A1 (en) 2011-01-19 2011-01-19 Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal

Publications (1)

Publication Number Publication Date
DE102011002867A1 true DE102011002867A1 (en) 2012-07-19

Family

ID=46510187

Family Applications (1)

Application Number Title Priority Date Filing Date
DE201110002867 Ceased DE102011002867A1 (en) 2011-01-19 2011-01-19 Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal

Country Status (1)

Country Link
DE (1) DE102011002867A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030038754A1 (en) * 2001-08-22 2003-02-27 Mikael Goldstein Method and apparatus for gaze responsive text presentation in RSVP display
US20060192775A1 (en) * 2005-02-25 2006-08-31 Microsoft Corporation Using detected visual cues to change computer system operating states
US20080118152A1 (en) * 2006-11-20 2008-05-22 Sony Ericsson Mobile Communications Ab Using image recognition for controlling display lighting
WO2009095843A1 (en) * 2008-01-28 2009-08-06 Nxp B.V. Method and apparatus for controlling the brightness of a display unit
US20090268944A1 (en) * 2008-04-28 2009-10-29 Omron Corporation Line of sight detecting device and method
EP2149856A2 (en) * 2008-07-29 2010-02-03 Hitachi CO., LTD. Image information processing method and apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030038754A1 (en) * 2001-08-22 2003-02-27 Mikael Goldstein Method and apparatus for gaze responsive text presentation in RSVP display
US20060192775A1 (en) * 2005-02-25 2006-08-31 Microsoft Corporation Using detected visual cues to change computer system operating states
US20080118152A1 (en) * 2006-11-20 2008-05-22 Sony Ericsson Mobile Communications Ab Using image recognition for controlling display lighting
WO2009095843A1 (en) * 2008-01-28 2009-08-06 Nxp B.V. Method and apparatus for controlling the brightness of a display unit
US20090268944A1 (en) * 2008-04-28 2009-10-29 Omron Corporation Line of sight detecting device and method
EP2149856A2 (en) * 2008-07-29 2010-02-03 Hitachi CO., LTD. Image information processing method and apparatus

Similar Documents

Publication Publication Date Title
DE102014009303B4 (en) Method for operating a virtual reality glasses and system with a virtual reality glasses
EP2467822B1 (en) Continuous determination of a perspective
DE102016210288A1 (en) Eyetracker unit operating device and method for calibrating an eyetracker unit of an operating device
WO2013152930A1 (en) Method, device, and computer program product for controlling at least one function of at least one display device for a vehicle interior
DE102015115526A1 (en) Method for target detection of target objects, in particular for the target detection of operating elements in a vehicle
DE102014112837A1 (en) Electronic device and information processing method
EP2987057A1 (en) Method for selecting an information source from a plurality of information sources for display on a display of data spectacles
EP3096969A1 (en) User interface and method for controlling a volume by means of a touch-sensitive display unit
EP3123278B1 (en) Method and system for operating a display device
DE102017117393A1 (en) A vehicle display device and method for controlling the vehicle display device
EP3418861A1 (en) Method for operating a display device, and a motor vehicle
DE102014213285A1 (en) Head-direction-dependent display of content on data glasses
DE102010012239A1 (en) Operating and indicator device of motor car, has combination instrument containing virtual operating unit which is displayed during approximation of thumb with respect to actual operating unit
WO2014111241A1 (en) Method and system for controlling at least one functional unit, and motor vehicle and mobile terminal device having such a system
DE102011002867A1 (en) Method for controlling backlight of mobile terminal e.g. navigation device, involves operating backlight of mobile terminal for particular period of time, when viewing direction of user is directed to mobile terminal
WO2014067774A1 (en) Method and device for operating an input device
EP3908475B1 (en) Operating device for operating at least one appliance, and method for operating such an operating device
DE102017211508A1 (en) Operating unit for vehicle fund
EP3005566A1 (en) Switch-actuating apparatus, mobile device, and method for actuating a switch by means of the presence of a heat-emitting part
DE102013021814A1 (en) Control device with eyetracker
DE102014009301A1 (en) Method for operating a virtual reality glasses and system with a virtual reality glasses
DE102016225262A1 (en) Method and device for operating a display system with data glasses
WO2019037906A1 (en) Method for operating an assist system for a vehicle, and assist system
DE102018222788B3 (en) Contact lens assembly with augmented reality capability for a vehicle driver and method for operating such a contact lens assembly
DE112018007216B4 (en) Input control device, display input device and input control method

Legal Events

Date Code Title Description
R002 Refusal decision in examination/registration proceedings
R003 Refusal decision now final

Effective date: 20121114