EP3298762A1 - Dispositif de terminal d'utilisateur et son procédé de réglage de luminance - Google Patents
Dispositif de terminal d'utilisateur et son procédé de réglage de luminanceInfo
- Publication number
- EP3298762A1 EP3298762A1 EP16811884.2A EP16811884A EP3298762A1 EP 3298762 A1 EP3298762 A1 EP 3298762A1 EP 16811884 A EP16811884 A EP 16811884A EP 3298762 A1 EP3298762 A1 EP 3298762A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- illumination
- sensor
- luminance
- user terminal
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 41
- 238000005286 illumination Methods 0.000 claims abstract description 422
- 230000001965 increasing effect Effects 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000003247 decreasing effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 27
- 238000003860 storage Methods 0.000 description 15
- 238000012937 correction Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000005259 measurement Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 239000004973 liquid crystal related substance Substances 0.000 description 4
- 230000002708 enhancing effect Effects 0.000 description 3
- 239000010410 layer Substances 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000007794 irritation Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 239000002096 quantum dot Substances 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 230000016776 visual perception Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000011229 interlayer Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- WFKWXMTUELFFGS-UHFFFAOYSA-N tungsten Chemical compound [W] WFKWXMTUELFFGS-UHFFFAOYSA-N 0.000 description 1
- 229910052721 tungsten Inorganic materials 0.000 description 1
- 239000010937 tungsten Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/342—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
- G09G2320/0653—Controlling or limiting the speed of brightness adjustment of the illumination source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0686—Adjustment of display parameters with two or more screen areas displaying information with different brightness or colours
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
- G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
Definitions
- Apparatuses and methods consistent with the exemplary embodiments relate to a user terminal device and a method for adjusting luminance thereof, and more particularly, to a user terminal device for supporting a function of detecting surrounding illumination and a method for adjusting luminance thereof.
- Exemplary embodiments overcome the above disadvantages and other disadvantages not described above. Also, the exemplary embodiments are not required to overcome the disadvantages described above, and an exemplary embodiment may not overcome any of the problems described above.
- the exemplary embodiments provide a user terminal device and a method for adjusting luminance thereof, for enhancing visibility of a displayed image by adjusting an output luminance value of a display in consideration of rear illumination as well as front illumination.
- a user terminal device includes a display, a first sensor provided on a front surface of the user terminal device and configured to detect emitted light, a second sensor provided on a rear surface of the user terminal device and configured to detect emitted light, and a controller configured to adjust luminance of the display based on front illumination detected through the first sensor and rear illumination detected through the second sensor.
- the controller may determine whether an illumination space is changed based on instantaneous variation of the front illumination and instantaneous variation of the rear illumination, and upon determining that the illumination space is changed, the controller may adjust the luminance of the display so as to correspond to the changed illumination space.
- the controller may determine that the illumination space is changed and adjusts the luminance of the display at a time point when the illumination space is changed when the instantaneous variation of the front illumination and the instantaneous variation of the rear illumination are preset threshold values or more, respectively and variation directions thereof are identical to each other.
- the controller may determine that the illumination space is relatively changed to a light space from a dark space, and when the instantaneous variation of the front illumination and the instantaneous variation of the rear illumination are negative numbers, the controller may determine that the illumination space is relatively changed to a dark space from a light space.
- the controller may determine a backlight situation based on a comparison result of the front illumination and the rear illumination, and when a current situation is a backlight situation, the controller may adjust the luminance of the display so as to correspond to the backlight situation.
- the controller may upward adjust the luminance of the display compared with current luminance.
- the controller may calculate intensity of backlight upon determining that the current situation is the backlight situation and calculates a value obtained by upward adjusting luminance based on the intensity of the backlight.
- the controller may determine intensity of the backlight based on at least one of a ratio of the front illumination and the rear illumination, a difference of the front illumination and the rear illumination, and a preset mathematical calculation combination of the front illumination and the rear illumination.
- the controller may adjust the luminance of the display based on the rear illumination or adjust the luminance of the display to a luminance value calculated by applying a higher weight than the front illumination to the rear illumination.
- the first sensor and the second sensor may each be embodied as at least one of an illumination sensor, an RGB sensor, a white sensor, an IR sensor, an IR+RED sensor, an HRM sensor, and a camera.
- the first sensor may be embodied as an RGB sensor and the second sensor is embodied as an HRM sensor, and the controller may scale a sensing value sensed by the HRM sensor based on characteristic of an illumination of a space in which the user terminal device is positioned and uses a scaled value as the rear illumination.
- a method for adjusting luminance of a user terminal device including a first sensor provided on a front surface of the user terminal device and configured to detect emitted light and a second sensor provided on a rear surface of the user terminal device and configured to detected emitted light includes detecting light emitted through the first sensor and the second sensor, and adjusting luminance of a display provided on the front surface based on front illumination detected through the first sensor and rear illumination detected through the second sensor.
- the adjusting may include determining whether an illumination space is changed based on instantaneous variation of the front illumination and instantaneous variation of the rear illumination, and upon determining that the illumination space is changed, adjusting the luminance of the display so as to correspond to the changed illumination space.
- the adjusting may include determining that the illumination environment is changed and adjusting the luminance of the display at a time point when the illumination environment is changed when the instantaneous variation of the front illumination and the instantaneous variation of the rear illumination are preset threshold values or more, respectively and variation directions thereof are identical to each other.
- the adjusting may include, when the instantaneous variation of the front illumination and the instantaneous variation of the rear illumination are positive numbers, determining that the illumination space is relatively changed to a light space from a dark space, and when the instantaneous variation of the front illumination and the instantaneous variation of the rear illumination are negative numbers, determining that the illumination space is relatively changed to a dark space from a light space.
- the adjusting may include determining a backlight situation based on a comparison result of the front illumination and the rear illumination, and when a current situation is a backlight situation, adjusting the luminance of the display so as to correspond to the backlight situation.
- the adjusting may include, upon determining the current situation is the backlight situation, upward adjusting the luminance of the display compared with current luminance.
- the adjusting may include calculating intensity of backlight upon determining that the current situation is the backlight situation and calculating a value obtained by upward adjusting luminance based on the intensity of the backlight.
- the adjusting may include calculating intensity of the backlight based on at least one of a ratio of the front illumination and the rear illumination, a difference of the front illumination and the rear illumination, and a preset mathematical calculation combination of the front illumination and the rear illumination.
- a computer readable recording medium has recorded thereon a program for executing a method for adjusting luminance of a user terminal device including a first sensor provided on a front surface of the user terminal device and configured to detect emitted light and a second sensor provided on a rear surface of the user terminal device and configured to detected emitted light, the method including detecting light emitted through the first sensor and the second sensor, and adjusting luminance of a display provided on the front surface based on front illumination detected through the first sensor and rear illumination detected through the second sensor.
- output luminance proper to an illumination environment may be adjusted by accurately estimating a changed illumination environment, and visibility of a displayed image may be enhanced.
- a user terminal device includes a display; a first sensor provided on a front surface of the user terminal device and configured to detect a front illumination; a second sensor provided on a rear surface of the user terminal device and configured to detect a rear illumination; and a controller configured to adjust a luminance of the display based on the front illumination detected by the first sensor and the rear illumination detected by the second sensor.
- a method of adjusting luminance of a user terminal device including a first sensor provided on a front surface of the user terminal device and configured to detect a front illumination and a second sensor provided on a rear surface of the user terminal device and configured to detected a rear illumination, includes: detecting the front illumination by the first sensor and the rear illumination by second sensor; and adjusting a luminance of a display provided on the front surface of the user terminal device based on the front illumination detected by the first sensor and the rear illumination detected by the second sensor.
- a computer readable recording medium has recorded thereon a program for executing a method for adjusting luminance of a user terminal device comprising a first sensor provided on a front surface of the user terminal device and configured to detect a front illumination and a second sensor provided on a rear surface of the user terminal device and configured to detected a rear illumination, the method including: detecting the front illumination by the first sensor and the rear illumination by the second sensor; and adjusting a luminance of a display provided on the front surface of the user terminal device based on the front illumination detected by the first sensor and the rear illumination detected by the second sensor.
- a user terminal device having an automatic luminance adjusting function includes a display provided on a first side of the user terminal device; a first sensor provided on the first side of the user terminal device and configured to measure a first received luminance; a second sensor provided on a second side of the user terminal device and configured to measure a second received luminance; and one or more processors configured to calculate a target display luminance based on the first received luminance and the second received luminance; and to automatically adjust a luminance of the display to the target display luminance.
- the one or more processors may be further configured to identify a first illumination space having a first illumination environment and a second illumination space having a second illumination environment based on the first received luminance and the second received luminance.
- the one or more processors may be further configured to identify, based on the first received luminance and the second received luminance, a change from the first illumination environment to the second illumination environment, and to adjust the target display luminance in response to the change.
- the second surface may be opposite to the first surface, and the one or more processors may be further configured to increase the target display luminance in response to an increase in the second received luminance.
- the one or more processors may be further configured such that the target display luminance is calculated based on a difference between the second received luminance and the first received luminance.
- the display may be configured to display an image, and the one or more processors may be further configured to control a luminance of a first region of the image independently from a second region of the image.
- the user terminal may also include a proximity sensor provided on the second side of the user terminal device, and the one or more processors may be further configured to calculate the target display luminance based on a weighted combination of the first received luminance and the second received luminance.
- the one or more processors may be further configured to calculate the target display luminance based only on the first received luminance in response to a motion being detected by the proximity sensor.
- the one or more processors may be further configured to correct a value of the target display luminance based on a value returned from a lookup table.
- the second sensor may be further configured to measure a heart rate of a user.
- FIGS. 1A, 1B, and 1C are diagrams illustrating an example of a user terminal device according to an exemplary embodiment
- FIG. 2 is a diagram illustrating a sensing coverage range when a user terminal device includes a plurality of illumination sensors according to an exemplary embodiment
- FIG. 3A is a block diagram illustrating a configuration of a user terminal device according to an exemplary embodiment
- FIG. 3B is a block diagram illustrating a detailed configuration of the user terminal apparatus illustrated in FIG. 3A;
- FIG. 4 is a diagram illustrating various modules stored in a storage
- FIGS. 5A and 5B are diagrams illustrating a method for determining an illumination space according to an exemplary embodiment
- FIGS. 6 and 7 are diagrams illustrating a method for determining backlight according to an exemplary embodiment
- FIGS. 8A and 8B are diagrams illustrating a method for adjusting luminance according to various exemplary embodiments
- FIGS. 9A and 9B are diagrams illustrating a method for calculating illumination according to an exemplary embodiment
- FIGS. 10A and 10B are diagrams illustrating a method for calculating illumination according to an exemplary embodiment
- FIG. 11 is a diagram illustrating a method for calculating illumination according to an exemplary embodiment
- FIGS. 12A and 12B are diagrams illustrating an illumination sensor according to an exemplary embodiment
- FIG. 13 is a diagram illustrating a method for estimating a type of a light source according to an exemplary embodiment.
- FIG. 14 is a flowchart illustrating a method for adjusting luminance of a user terminal apparatus according to an exemplary embodiment.
- FIGS. 1A to 1C are diagrams illustrating an example of a user terminal device 100 according to an exemplary embodiment.
- the user terminal device 100 may be embodied as, but is not limited to, a cellular phone such as a smart phone, and may be any device that is carriable by a user and has a display function.
- Non-limiting examples may include a tablet personal computer (PC), a smart watch, a portable multimedia player (PMP), a personal digital assistant (PDA), a notebook PC, a television (TV), a head mounted display (HMD), and a near eye display (NED).
- PC personal computer
- PMP portable multimedia player
- PDA personal digital assistant
- TV television
- HMD head mounted display
- NED near eye display
- the user terminal device 100 may be configured to include various types of displays such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), a liquid crystal on silicon (LCoS), digital light processing (DLP), and a quantum dot (QD) display panel.
- LCD liquid crystal display
- OLED organic light-emitting diode
- LCDoS liquid crystal on silicon
- DLP digital light processing
- QD quantum dot
- the user terminal device 100 may provide a luminance automatic adjusting function for sensing surrounding illumination and automatically adjusting luminance of a display based on the sensed surrounding illumination to provide optimum display luminance.
- the user terminal device 100 may include illumination sensors 10 and 20 that are provided on front and rear surfaces, respectively, as illustrated in FIGS. 1A and 1B.
- the illumination sensor 10 provided on the front surface may be provided on an upper bezel region of a screen
- the illumination sensor 20 provided on the rear surface may be provided to the right of a camera.
- this is merely an exemplary embodiment, and thus illumination sensors provided on the front and rear surfaces may be provided at various portions of the front/rear surfaces of the user terminal device 100.
- the illumination sensor 20 may be provided on at least one portion of the upper, lower, right, left, and lateral surfaces of the user terminal device 100, instead of the rear surface.
- the lateral surface may refer to a peripheral surface outside an edge on which a power key and the like illustrated in FIG. 1C are positioned.
- the lateral surface may refer to a surface on which a volume key, a power key, a universal serial bus (USB) interface, an earphone interface, and the like are positioned.
- USB universal serial bus
- the user terminal device 100 may sense illumination in different directions based on the user terminal device 100, as illustrated in FIG. 1C.
- FIG. 2 is a diagram illustrating a sensing coverage range when the user terminal device 100 includes a plurality of illumination sensors according to an exemplary embodiment.
- FIG. 2 illustrates a sensing coverage range when one illumination sensor is provided and a sensing coverage range when two or more illumination sensors are provided in the user terminal device 100 such as a mobile device, in particular, a sensing coverage range when two or more illumination sensors are provided on a front/rear surface and a front/lateral surface.
- a dark area may refer to an area on which sunlight is directly incident and a dashed area may refer to a range sensed by each sensor.
- an overlap region between the dark areas indicating the area on which sunlight is incident and the dashed area indicating the range sensed by each sensor may be a sensing coverage region.
- % number may refer to a sensing coverage rate of each case. That is, when two or more sensors are provided in the user terminal device 100 so as to sense illumination, a sensing coverage range is effective when respective sensors are provided on the front/rear surface or the front/lateral surface.
- the possible arrangements may be limited due to the design of the lateral surface, and thus, hereinafter, a case in which illumination sensors are provided on the front/rear surfaces, respectively, will be described.
- the same algorithm and driving principle according to exemplary embodiments may be applied to the case of the front/lateral surface.
- FIG. 3A is a block diagram illustrating a configuration of the user terminal device 100 according to an exemplary embodiment.
- the user terminal device 100 may include a display 110, a first sensor 120, a second sensor 130, and a controller 140.
- the display 110 may provide various content images that are capable of being provided through the user terminal device 100.
- the content image may include various contents such as an image, a video, a text, an application execution image containing the various contents, a graphic user interface (GUI) image, and the like.
- GUI graphic user interface
- the display 110 may be embodied as various types of displays such as a liquid crystal display, an organic light-emitting diode, liquid crystal on silicon (LCoS), and digital light processing (DLP).
- the display 110 may be formed of a transparent material and embodied as a transparent display for displaying information.
- the display 110 may be embodied in the form of a touchscreen for configuration of an interlayer structure with a touchpad, and in this case, the display 110 may be used as a user interface as well as an output device.
- the first sensor 120 may be provided on a front surface of the user terminal device 100 and may detect emitted light.
- the first sensor 120 may detect at least one of various characteristics such as the illumination, intensity, color, incident direction, incident area, and distribution of light.
- the first sensor 120 may be an illumination sensor, a temperature detection sensor, an optical amount sensing layer, a camera, or the like.
- the first sensor 120 may be embodied as, but is not limited to, an illumination sensor for sensing RGB light, and thus may be any sensor for sensing light, such as a white sensor, an IR sensor, and an IR+RED sensor.
- the illumination sensor may use various photoelectric cells, but may also use a photoelectric tube for measurement of very low illumination.
- a CDS illumination sensor may be included in the user terminal device 100 and may detect illumination in opposite directions.
- the illumination sensor may be installed on at least one preset region of opposite surfaces of the user terminal device 100, but may also be installed in each pixel unit of the opposite surfaces.
- an illumination sensor formed by enlarging a CMOS sensor so as to correspond to a size of the display 110 may be installed so as to measure an illumination state for each region or each pixel.
- the CDS illumination sensor may detect light around the user terminal device 100, and an A/D converter may convert a voltage acquired through the CDS illumination sensor into a digital value and transmit the digital value to a controller 140.
- the second sensor 130 may be installed on a rear surface of the user terminal device 100 and may detect emitted light.
- the second sensor 130 may be provided on at least one of upper, lower, right, and left lateral surfaces instead of the rear surface.
- exemplary embodiments are not limited thereto, and thus the second sensor 130 may be provided at any other position as long as the second sensor 130 is configured to measure illumination in a different direction from the first sensor 120.
- the second sensor 130 may be provided at a position at which illumination at an angle that is 90 degrees or more from the illumination detected by the first sensor 120 is capable of being detected.
- the second sensor 130 may detect at least one of various characteristics such as the illumination, intensity, color, incident direction, incident area, and distribution of light.
- the second sensor 130 may be an illumination sensor, a temperature detection sensor, an optical amount sensing layer, a camera, or the like.
- the second sensor 130 may be embodied as, but is not limited to, an illumination sensor for sensing RGB light, and thus may be any sensor for sensing light, such as a white sensor, an IR sensor, and an IR+RED sensor.
- the controller 140 may control an overall operation of the user terminal device 100.
- the controller 140 may adjust luminance of the display 110 based on front illumination detected through the first sensor 120 and rear illumination detected through the second sensor 130.
- the controller 140 may include a micro control unit, a micom, a processor, a central processing unit (CPU), and the like.
- the controller 140 may be embodied as a System-on-Chip (SoC) including an image processing algorithm stored therein and embodied in the form of a field programmable gate array (FPGA).
- SoC System-on-Chip
- FPGA field programmable gate array
- a method for adjusting luminance may be performed by changing an output luminance value of the display 100. That is, a brightness value of a backlight or OLED installed in the display 110 may be adjusted.
- a method for performing image processing on displayed content to change a pixel luminance value may be used.
- various surrounding environment information items including a surrounding environment other than illumination, for example, a power state of the user terminal device 100, a user state (sleep, reading, etc.), place information, and time information.
- the controller 140 may determine whether an illumination space is changed based on instantaneous variation of front illumination detected through the first sensor 120 and instantaneous variation of rear illumination detected through the second sensor 130.
- the controller 140 may adjust luminance of the display 110 so as to correspond to the changed illumination space upon determining that the illumination space is changed.
- the illumination space may be a physically separated space, for example, an office/lobby, a room/living room, and an indoor/outdoor area.
- a visual system (hereinafter, VS) of a user may allow the user to feel as if illumination is uniform across the illumination space.
- the same display luminance may be maintained in the same space, and when a space is changed, the luminance may be immediately or gradually changed to an optimum luminance proper to the corresponding space.
- the illumination space may refer to a space that provides a specific illumination environment.
- a space that is close to a window and illuminated by a large amount of light and a space that is far from the window and illuminated by a small amount of light may provide much different environments, and thus the spaces may be considered different illumination spaces according to exemplary embodiments.
- the controller 140 may determine that an illumination space is changed and adjust luminance of the display 110 at a time point when the illumination space is changed.
- the controller 140 may determine whether a current situation is a backlight situation based on a comparison result of the front illumination and the rear illumination, and upon determining that the current situation is the backlight situation, the controller 140 may adjust display luminance so as to correspond to the backlight situation.
- 'a' may be acquired from an experimental value or the like or may be simply set to 1.
- the controller 140 may determine an intensity of the backlight based on at least one of a difference between the front illumination and the rear illumination, a ratio of the front illumination and the rear illumination, and a mathematical calculation combination of the front illumination and the rear illumination. For example, the controller 140 may determine the intensity of the backlight based on a value of "front illumination/rear illumination” or based on a value of "front illumination ? rear illumination”.
- the controller 140 may adjust luminance of the display 110 to be higher than current luminance.
- the controller 140 may calculate a value obtained by raising luminance based on intensity of backlight upon determining that the current situation is the backlight situation. For example, the controller 140 may increase the value obtained by raising luminance as intensity of backlight is increased. This is because visibility of a display image is further reduced since the display 110 provided on a front surface of the user terminal device 100 is darker as the intensity of backlight is increased.
- the controller 140 may adjust luminance of the display 110 based on the rear illumination. In detail, upon determining that the current situation is the backlight situation, the controller 140 may calculate the value obtained by raising luminance based on only the rear illumination.
- the controller 140 may adjust the luminance of the display 110 to a luminance value calculated by applying a higher weight than the front illumination to the rear illumination.
- the controller 140 may perform correction (e.g., scaling) on a sensing value.
- the controller 140 may scale a sensing value sensed by the HRM sensor and use the scaled sensing value as rear illumination based on illumination characteristics of a space in which the user terminal device 100 is positioned, which will be described in detail.
- the controller 140 may adjust a luminance value of the display 110 so as to be gradually increased or decreased to a target luminance value from an initial luminance value. For example, this may correspond to a case in which a light surrounding environment of a display is abruptly changed to a specific illumination (e.g., 100 lux) or less, a case in which a dark display screen with a specific illumination or less is converted to a light screen, or a case in which a display screen is converted into an activated state from an inactivated state when surrounding illumination is a specific illumination or less.
- a specific illumination e.g. 100 lux
- the controller 140 may divide an image into at least one region and a remaining region based on an attribute of the content of the display and may separately control luminance values of the respective separated regions.
- the luminance values of the respective regions may include at least one of a maximum brightness value, a maximum color value, and an average brightness value of the displayed content.
- the controller 140 may separately control the luminance of each region such that the luminance of information displayed in at least one region is different from the luminance of information displayed on the remaining region.
- the controller 140 may separately control the luminance of each region such that the luminance of the information displayed in at least one region reaches a target luminance value earlier than the luminance of the information displayed in the remaining region.
- target luminance values of the respective regions may be the same or different.
- the controller 140 may differently apply a shape of a gamma curve applied to at least one region and a shape of a gamma curve applied to the remaining region.
- a gamma curve may refer to a table showing a relationship between a gray scale and display luminance of an image
- the gamma curve may refer to a table showing a relationship between a gray scale and display luminance of an image based on a case in which the user terminal device 100 emits light with a maximum luminance level.
- a gamma curve in a logarithmic form is applied to a region of interest
- a gamma curve in an exponential function form is applied to a region of non-interest
- the user may feel as if the region of interest is first recognized and then the region of non-interest is gradually recognized.
- the controller 140 may provide a user interface (UI) image for adjusting a luminance value of the display 110 according to a preset event on one region of the display 110. Accordingly, in order to change the adjusted luminance value according to an exemplary embodiment, a user may manually adjust the luminance value of the display through the UI image. In this case, the controller 140 may provide a graphic user interface (GUI) indicating an original luminance value of corresponding content on the UI image. Accordingly, the user may appropriately adjust the luminance value of the display through the corresponding GUI.
- GUI graphic user interface
- the controller 140 may calculate the luminance adjusting value based on pre-stored data.
- a luminance adjusting value e.g., a target luminance value or a luminance value to be increased or reduced
- a luminance adjusting value corresponding to a current situation may be selected based on the stored LUT.
- FIG. 3B is a block diagram illustrating a detailed configuration of the user terminal apparatus illustrated in FIG. 3A.
- a user terminal apparatus 100' may include the display 110, the first sensor 120, the second sensor 130, the controller 140, a storage 150, an audio processor 160, and a video processor 170.
- a user terminal apparatus 100' may include the display 110, the first sensor 120, the second sensor 130, the controller 140, a storage 150, an audio processor 160, and a video processor 170.
- the controller 140 may include a random access memory (RAM) 141, a read only memory (ROM) 142, a main central processing unit (CPU) 143, a graphic processor 144, first to nth interfaces 145-1 to 145-n, and a bus 146.
- RAM random access memory
- ROM read only memory
- CPU main central processing unit
- graphic processor first to nth interfaces 145-1 to 145-n
- bus 146 a bus 146.
- the RAM 141, the ROM 142, the main CPU 143, the graphic processor 144, the first to nth interfaces 145-1 to 145-n, and the like may be connected to each other through the bus 146.
- the first to nth interfaces 145-1 to 145-n may be connected to the aforementioned components.
- One of the interfaces may be a network interface that is connected to an external apparatus though a network.
- the main CPU 143 may access the storage 150 and perform a system booting operation using an operating system (O/S) stored in the storage 150.
- the main CPU 143 may perform various operations using various modules, various programs, content, data, and the like which are stored in the storage 150.
- the main CPU 143 may perform an operation according to various exemplary embodiments based on an illumination calculating module 154, the illumination space determining module 155, a backlight determining module 156, and a luminance adjusting module 157 ,which are illustrated in FIG. 4.
- the ROM 142 may store a command set and the like, for the system booting operation.
- the main CPU 143 may copy the O/S stored in the storage 150 and execute the O/S to boot a system according to the command stored in the ROM 142.
- the main CPU 143 may copy various programs stored in the storage 150 to the RAM 141 and execute a program copied to the RAM 141 to perform various operations.
- the graphic processor 144 may generate an image including various objects such as an icon, an image, a text, and the like using a subprocessor (not shown) and a renderer (not shown).
- the subprocessor (not shown) may calculate an attribute value such as a coordinate value, a shape, a size, and color, for displaying each object according to a layout of an image, based on a received control command.
- the renderer (not shown) may generate images of various layouts, including objects, based on the attribute values calculated by the subprocessor (not shown).
- the aforementioned operation of the controller 140 may be executed according to the program stored in the storage 150.
- the storage 150 may store various data items, such as an operating system (O/S) software module and various multimedia contents, for driving a broadcast receiving apparatus 200.
- the storage 150 may store luminance information and the like according to programs, and illumination and content characteristics of an illumination calculating module, an illumination space determining module, a luminance adjusting module, and the like.
- O/S operating system
- the controller 140 may store luminance information and the like according to programs, and illumination and content characteristics of an illumination calculating module, an illumination space determining module, a luminance adjusting module, and the like.
- FIG. 4 is a diagram illustrating various modules stored in a storage 150.
- the storage 150 may store software including a base module 151, a sensing module 152, a communication module 153, the illumination calculating module 154, an illumination space determining module 155, a backlight determining module 156, and the luminance adjusting module 157.
- the base module 151 may refer to a basic module that processes a signal transmitted from each hardware item included in the user terminal apparatus 100' and transmits the signal to a higher layer module.
- the base module 151 may include a storage module 151-1 for managing a database (DB) or a register, a security module 151-2 for supporting certification, request permission, secure storage, and the like for hardware, and a network module 151-3 for supporting network connection.
- DB database
- security module 151-2 for supporting certification, request permission, secure storage, and the like for hardware
- a network module 151-3 for supporting network connection.
- the sensing module 152 may collect information from various sensors and analyze and manage the collected information.
- the sensing module 152 may include an illumination detection module, a touch recognition module, a head direction recognition module, a face recognition module, a voice recognition module, a motion recognition module, and the like.
- the communication module 153 may communicate with an external device.
- the communication module 153 may include a messaging module such as a device module, a messenger program, a short message service (SMS) & multimedia message service (MMS) program, and an e-mail program, which are used in communication with an external device, and a telephone module including a call info aggregator program module, a VoIP module, and the like.
- a messaging module such as a device module, a messenger program, a short message service (SMS) & multimedia message service (MMS) program, and an e-mail program, which are used in communication with an external device
- a telephone module including a call info aggregator program module, a VoIP module, and the like.
- the illumination calculating module 154 may calculate illumination information according to a front illumination signal and a rear illumination signal, which are detected through the first sensor 120 and the second sensor 130. To this end, the illumination calculating module 154 may include a preset algorithm for converting the detected illumination signal into illumination information determinable by the controller 140.
- the illumination space determining module 155 may determine a change in an illumination space in real-time based on surrounding illumination calculated by the illumination calculating module 154, that is, the front illumination and the rear illumination.
- FIGS. 5A and 5B are diagrams illustrating a method for determining an illumination space according to an exemplary embodiment.
- instantaneous variation of illumination measured by the first sensor 120 and instantaneous variation of illumination measured by the second sensor 130 may be compared with each other to determine whether an illumination environment is changed.
- Whether the illumination environment is changed may be determined according to whether instantaneous variation of illumination 511 measured by the first sensor 120 and instantaneous variation of illumination 512 measured by the second sensor 130 satisfy a preset condition (S520).
- the controller 140 may determine whether the instantaneous variation of the illumination 511 measured by the first sensor 120 and the instantaneous variation of the illumination 512 measured by the second sensor 130 are changed to respective specific threshold values or more, whether variation directions thereof are identical to each other, and whether the illumination space is changed based on the determination result.
- the instantaneous variation of the illumination 511 measured by the first sensor 120 and the instantaneous variation of the illumination 512 measured by the second sensor 130 are changed to respective specific threshold values or more, and when variation directions thereof are identical to each other (Y of 530), it may be determined that the illumination space is changed (550). Otherwise (N of 530), it may be determined that the illumination space is not changed (540).
- a table 520 illustrated in FIG. 5B when the instantaneous variation of the first sensor 120 is increased to a specific threshold value or more and the instantaneous variation of the second sensor 130 is increased to a specific threshold value or more (in the case of 'True' in the table 520), it may be determined that the illumination space is changed.
- instantaneous variation of the first sensor 120 is reduced to a specific threshold value or less and the instantaneous variation of the second sensor 130 is reduced to a specific threshold value or more (in the case of 'True' in the table 520)
- it may be determined that the illumination space is changed.
- a time point when instantaneous variation is a positive number or a negative number may be a time point when a space change occurs.
- a time point when an illumination environment is changed may be determined in real-time. That is, it is impossible to accurately determine a time point when the illumination environment is changed using only a single illumination sensor, but according to an exemplary embodiment, sensing accuracy of change in an illumination space may be enhanced and measurement time may be reduced by using an additional sensor.
- the backlight determining module 156 may determine a backlight situation and an intensity of the backlight based on surrounding illumination, that is, front illumination and rear illumination that are calculated by the illumination calculating module 154.
- FIGS. 6 and 7 are diagrams illustrating a method for determining backlight according to an exemplary embodiment.
- luminance of display may be upward adjusted in a backlight situation.
- a backlight situation and backlight intensity may be determined based on sizes of illumination 611 measured by the first sensor 120 and illumination 612 measured by the second sensor 130.
- a backlight situation and backlight intensity may be determined based on at least one of a ratio, a difference value, and a mathematical calculation combination of front/rear illumination of the illumination 611 measured by the first sensor 120 and the illumination 612 measured by the second sensor 130.
- a ratio of the illumination 611 measured by the first sensor 120 to the illumination 612 measured by the second sensor 130 is greater than a preset threshold value (or is equal to or more than a preset threshold value) or a value obtained by subtracting the illumination 611 measured by the first sensor 120 from the illumination 612 measured by the second sensor 130 is greater than a preset threshold value (or is equal to or more than a preset threshold value) (620)
- a current situation is determined as a backlight situation (630).
- an intensity of the backlight may be determined according to a ratio of the illumination 611 measured by the first sensor 120 to the illumination 612 measured by the second sensor 130, a value obtained by subtracting the illumination 611 measured by the first sensor 120 from the illumination 612 measured by the second sensor 130, a mathematical calculation combination of front/rear illumination, or the like (640).
- a value obtained by increasing the luminance or a target luminance value may be calculated and luminance may be increased based on the calculated value, thereby enhancing visibility of display.
- the luminance adjusting module 157 may adjust luminance of the display 110 based on at least one of output values of an illumination calculating module 145, the illumination space determining module 155, and the backlight determining module 156.
- FIGS. 8A and 8B are diagrams illustrating a method for adjusting luminance according to various exemplary embodiments.
- FIG. 8A illustrates the case in which a user moves in an office space.
- a visual system hereinafter, VS
- VS visual system
- FIG. 8A illustrates the case in which a user moves in an office space.
- a visual system hereinafter, VS
- VS visual system
- a part of the illumination space may be under many lamps, and another part of the illumination space may be under only a few lamps, the user may still feel as if the parts are similar illumination spaces. Accordingly, constancy of 'the same display luminance' may be maintained in 'the same space'.
- FIG. 8B illustrates the case in which a user moves in three different spaces.
- the same display luminance may be maintained in the same space, and when a space is changed, the luminance may be immediately or gradually changed to optimum luminance proper to the corresponding space.
- the user terminal apparatus 100' may include a touch sensor, a geomagnetic sensor, a gyro sensor, an acceleration sensor, a proximity sensor, a grip sensor, and the like. Accordingly, the user terminal apparatus 100' may detect various manipulation operations such as touch, rotation, inclination, pressure, proximity, and grip.
- the touch sensor may be embodied as an electrostatic type sensor or a resistive type sensor.
- the electrostatic type sensor may refer to a sensor that calculates a touch coordinate by detecting nano electricity excited in the body of a user when a part of the user's body is touched on a display surface using a dielectric substance coated on the display surface.
- the resistive type sensor may refer to a touch sensor that includes two electrode plates installed in the user terminal device 100 and calculates a touch coordinate by detecting that upper and lower plates of a touched point contact each other such current flows while being touched by a user.
- an infrared ray detection method, a surface ultrasonic conduction method, an integral strain gauge method, a piezo effect method, or the like may be used to detect touch interaction.
- the user terminal apparatus 100' may determine whether a touch object such as a finger or a stylus pen contacts or approaches a target using a magnetic and magnetic field sensor, an optical sensor, a proximity sensor, or the like instead of a touch sensor.
- a touch object such as a finger or a stylus pen contacts or approaches a target using a magnetic and magnetic field sensor, an optical sensor, a proximity sensor, or the like instead of a touch sensor.
- the geomagnetic sensor may be a sensor for detecting a rotation state, a moving direction, and the like of the user terminal apparatus 100'.
- the gyro sensor may be a sensor for detection of a rotational angle of the user terminal apparatus 100'. Both of the geomagnetic sensor and the gyro sensor may be included, but even if one of these is included, a rotation state of the user terminal apparatus 100' may be detected.
- the acceleration sensor may be a sensor for detecting a movement acceleration degree in X and Y axes of the user terminal apparatus 100'.
- the proximity sensor may be a sensor for detection of a motion of an object approaching a display surface without direct contact with the display surface.
- the proximity sensor may be embodied in the form of various types of sensors such as a high frequency oscillating type sensor that forms a high-frequency magnetic field and detects current induced by magnetic field characteristics changed in the case of proximity of an object, a magnetic type sensor using a magnet, and a capacitance type sensor for detecting electrostatic capacitance changed due to proximity of an object.
- the grip sensor may be a sensor that is provided on a rear surface, an edge, and a handle portion irrespective of a touch sensor included in a touch screen of the user terminal apparatus 100' so as to detect user grip.
- the grip sensor may be embodied as a pressure sensor other than a touch sensor.
- the user terminal apparatus 100' may further include the audio processor 160 for processing audio data, the video processor 170 for processing video data, a speaker (not shown) for outputting various notification sounds, voice messages, or the like as well as various audio data items processed by the audio processor 160, and a microphone (not shown) for receiving user voice or other sounds and converting the sounds into audio data.
- the audio processor 160 for processing audio data
- the video processor 170 for processing video data
- a speaker for outputting various notification sounds, voice messages, or the like as well as various audio data items processed by the audio processor 160
- a microphone not shown
- FIGS. 9A and 9B are diagrams illustrating a method for calculating illumination according to an exemplary embodiment.
- the user terminal apparatuses 100 and 100' may use inclination information detected by the gyro sensor, the geomagnetic sensor, the acceleration sensor, and the like.
- the measured illumination may be corrected based on the sensing illumination 911 and the inclination information 912 detected by the gyro sensor, the geomagnetic sensor, the acceleration sensor, and the like.
- the illumination information may be a single illumination measured by the first or second sensor 120 or 130.
- a value obtained by correcting illumination which corresponds to the inclination information 912, may be acquired (920) and the sensing illumination 911 may be corrected based on the acquired value obtained by correcting illumination (930).
- the value obtained by correcting illumination for each inclination may be stored in the form of a lookup table 925 and a illumination value that is actually measured in real time may be corrected based on the corresponding lookup table 925.
- the lookup table 925 may be separately provided for each sensor included in the user terminal apparatuses 100 and 100'.
- a corresponding lookup table may be provided based on sensing characteristics, a position in which a sensor is installed, and the like according to a sensor type.
- a lookup table for correcting illumination measured by the first sensor 120 and a lookup table for correcting illumination measured by the second sensor 130 may be separately provided.
- the lookup table may be stored during manufacture of the user terminal apparatuses 100 and 100' but may be provided by a server (not shown) or updated.
- Corrected illumination may be calculated according to "input illumination*illumination correction value for each inclination” but is not limited thereto, and thus may be calculated in various forms according to a type of an illumination correction value for each inclination. For example, when an illumination correction value for each inclination is stored as an illumination amount to be added or subtracted, the corrected illumination may be calculated in the form of "input illumination ⁇ illumination correction value for inclination”.
- inclination information may be used during measurement of illumination, thereby enhancing accuracy of an illumination measurement value.
- FIGS. 10A and 10B are diagrams illustrating a method for calculating illumination according to an exemplary embodiment.
- illumination may be calculated based on illumination 1011 measured by the first sensor 120, illumination 1012 measured by the second sensor 130, and inclination information 1020.
- a weight corresponding to each sensor corresponding to the inclination information 1020 may be acquired (1030) and illumination may be estimated based on the acquired weight for each sensor (1040).
- a value of illumination of the first sensor 120 and the second sensor 130 is changed according to a device inclination. For example, when a device is directed upward, a value for use of a front illumination sensor may be high, and when the device is directed downward, a value for use of a rear illumination may be high. As such, weights for summing two or more illumination sensors may be differentiated according to an inclination of the device.
- different weights to be applied to respective illuminations measured by the first sensor 120 and the second sensor 130 for each inclination (e.g., an X-axis angle) of the user terminal device 100 may be stored in the form of a lookup table 1035 and an illumination that is actually measured in real time may be corrected based on the corresponding lookup table 930.
- the lookup table 1035 may be embodied in various forms in some embodiments.
- an inclination range for applying the same weight, a weight applied to each inclination range, and the like may be differently set from the illustrated lookup table 1035.
- a specific weight may be switched to "front illumination 100 % / rear illumination 0%" or "front illumination 0% / rear illumination 100%".
- a lookup table may be set in the form of a correction value to be added or subtracted according to an inclination instead of a weight.
- the lookup table may be stored during manufacture of the user terminal apparatuses 100 and 100' but may be provided by a server (not shown) or updated.
- Estimated illumination may be calculated according to "( ⁇ *first sensor illumination) + ( ⁇ *second sensor illumination),”wherein ⁇ and ⁇ are weights, but is not limited thereto.
- corrected illumination may be calculated according to " ⁇ (first sensor illumination- ⁇ )+(second sensor illumination- ⁇ ) ⁇ /k,” wherein ⁇ and ⁇ are correction values.
- FIG. 11 is a diagram illustrating a method for calculating illumination according to an exemplary embodiment.
- illumination may be calculated based on a sensing result of proximity sensors provided on front and rear surfaces on which the first sensor 120 and the second sensor 130 are provided.
- an IR sensor or the like may be used as the proximity sensor provided on the rear surface, but is not limited thereto. This is based on a principle in which sensing data of a corresponding illumination sensor is reliable only when there is no approaching person or object, in that the reliability of sensing data of the illumination sensor is lowered when a person or an object approaches.
- the illumination 1111 sensed by the first sensor 120 may be disregarded (1130), and only when proximity is not detected by the proximity sensor (1120:N), the illumination 1111 sensed by the first sensor 120 may be used (1140).
- the illumination 1112 sensed by the second sensor 130 may be disregarded (1155), and only when proximity is not detected by the proximity sensor (1150:N), illumination sensed by the second sensor 130 may be used (1160).
- illumination may be calculated in consideration of inclination using the illumination 1111 sensed by the first sensor 120 and the illumination 1112 sensed by the second sensor 130 via the various methods described with reference to FIGS. 9A and 9B (1170).
- FIGS. 12A and 12B are diagrams illustrating an illumination sensor according to an exemplary embodiment.
- FIG. 12A is a diagram illustrating a case in which a heart rate monitor (HRM) sensor provided on a rear surface of the user terminal device 100 is used as the second sensor 130 according to an exemplary embodiment.
- HRM heart rate monitor
- the HRM sensor may sense both visible light rays and infrared light rays in order to measure a heart rate of a user. As illustrated in FIG. 12A, the HRM sensor may sense a portion of a visible ray region. Accordingly, the HRM sensor may be used instead of the second sensor 130.
- many indoor spaces include fluorescent lamp and/or light emitting diode (LED) illumination.
- LED light emitting diode
- FIG. 12B since the fluorescent lamp and the LED illumination have insignificant IR components, when light emitted therefrom is sensed by the HRM, only the visible light rays are sensed. That is, under the fluorescent lamp and the LED illumination, the HRM sensor has high reliability as an illumination sensor.
- sunlight and tungsten-based light bulbs include significant IR components, and thus when light is sensed by the HRM sensor, a sensed value is high. In this case, the sensed value may downscaled and used. That is, when the HRM sensor is used as a rear illumination sensor, the characteristics of a light source need to be analyzed in order to estimate illumination. For example, whether an illumination of a space in which an object is currently positioned is a fluorescent lamp or an incandescent lamp may be determined and a scaling factor corresponding thereto may be applied.
- FIG. 13 is a diagram illustrating a method for estimating a type of a light source according to an exemplary embodiment.
- a type of a light source of a space in which a user is positioned may be determined using a sensing value of the RGB sensor.
- an R/G/B ratio of a sensing value 1311 sensed by the RGB sensor may be analyzed (1320) and a weight corresponding to the analyzed ratio, that is, the light source type may be acquired (1330).
- a weight corresponding to the R/G/B ratio may be acquired based on predefined mapping information (e.g., a graph formed by mapping an R/G/B ratio and a weight).
- the acquired weight may be applied to a value 1312 sensed by the second sensor 130, that is, the HRM sensor, to calculate an estimated value of illumination of the second sensor (1340).
- the value 1312 sensed by the HRM sensor may be multiplied by a weight to calculate an estimated value of illumination.
- an incandescent lamp contains more red wavelength ranges than blue wavelength ranges
- high R/B values may be obtained from a value sensed by the first sensor 120, that is, a front RGB sensor.
- a high HRM sensing value may be obtained compared with illumination, and thus the HRM sensing value may be corrected by reducing an applied weight.
- a low R/B value is sensed compared with an incandescent lamp with respect to the LED, and thus illumination may be estimated from the HRM sensing value by increasing the applied weight in this case.
- the aforementioned embodiment is merely an exemplary embodiment, and as necessary, the value 1312 sensed by the HRM sensor may be directly used as an illumination value rather than being corrected or may be simply scaled and used as an illumination value.
- rear illumination rear HRM sensing value* K (fixed simple scaling factor) may be calculated.
- FIG. 14 is a flowchart illustrating a method for adjusting luminance of a user terminal apparatus according to an exemplary embodiment.
- the first sensor and the second sensor may detect emitted light (S1410).
- luminance of a display provided on the front surface may be adjusted based on front illumination detected through the first sensor and rear illumination detected through the second sensor (S1420).
- whether an illumination space is changed may be determined based on instantaneous variation of the front illumination and instantaneous variation of the rear illumination, and when it is determined that the illumination space is changed, luminance of the display may be adjusted so as to correspond to the changed illumination space.
- luminance of a display when the instantaneous variation of the front illumination and instantaneous variation of the rear illumination are equal to or more than a predetermined threshold value and variation directions thereof are identical to each other, luminance of a display may be adjusted at a time point when the illumination space is changed.
- an illumination space when instantaneous variations of the front illumination and rear illumination are positive numbers, an illumination space may be determined to be relatively changed to a light space from a dark space, and, when instantaneous variations of the front illumination and rear illumination are negative numbers, the illumination space may be determined to be relatively changed to a dark space from a light space.
- a backlight situation may be determined based on a comparison result of the front illumination and the rear illumination, and when a current situation is determined to be a backlight situation, luminance of the display may be adjusted to correspond to the backlight situation.
- luminance of the display when a current situation is determined to be a backlight situation, luminance of the display may be increased compared with current luminance.
- an intensity of the backlight may be calculated and a value obtained by increasing luminance may be calculated based on the intensity of backlight.
- the intensity of backlight may be calculated based on at least one of a ratio, a difference value, and a mathematical calculation combination of front illumination and rear illumination.
- luminance of display when a current situation is determined to be a backlight situation, luminance of display may be adjusted based on the rear illumination or a higher weight than the front illumination may be applied to the rear illumination to adjust luminance of the display to the calculated luminance value.
- measurement error when illumination is measured using an optical sensor, measurement error may be minimized and measurement accuracy may be enhanced. That is, it may be possible to sense optimum illumination by combining device inclination information and proximity information of an object using a plurality of illumination data items. Accordingly, it may be possible to sense illumination with high reliability even under various unfavorable conditions such as user movement or inclination and shadow.
- minimum sensing delay time may be drastically reduced in terms of development of an illumination sensor. Accordingly, a high performance and rapid illumination sensing device may be developed.
- sensing values may be accumulated or a sensing value may be determined to be a true value only when variation in the sensing value is maintained for predetermined time or more when the sensing value is varied.
- the "minimum sensing delay time” may refer to delay time required to this objective.
- a diffuser is installed on a single optical sensor.
- two or more sensors may be simultaneously used, and thus there may be many instrumental advantages in terms of a measurement direction and range.
- the device may be frequently present in a backlight situation.
- a user of a mobile device may frequently face a backlight situation at the window in the daytime.
- optimum visibility may be ensured.
- VS visual system
- the method for adjusting luminance of a user terminal device according to the diverse exemplary embodiments may be embodied as a program and provided to a user terminal device.
- a non-transitory computer readable medium may be provided for storing a program for an operation of executing detecting light emitted through a first sensor provided on a first surface of a user terminal device and a second sensor provided on a rear surface of the user terminal device and adjusting luminance of display based on front illumination detected through the first sensor and rear illumination detected through the second sensor.
- the non-transitory computer readable medium is a medium which does not store data temporarily such as a register, cache, or memory but stores data semi-permanently and is readable by other devices. More specifically, the aforementioned applications or programs may be stored in the non-transitory computer readable media such as compact disks (CDs), digital video disks (DVDs), hard disks, Blu-ray disks, universal serial buses (USBs), memory cards, and read-only memory (ROM).
- CDs compact disks
- DVDs digital video disks
- hard disks hard disks
- Blu-ray disks Blu-ray disks
- USBs universal serial buses
- memory cards and read-only memory (ROM).
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Liquid Crystal Display Device Control (AREA)
- Life Sciences & Earth Sciences (AREA)
- Sustainable Development (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Controls And Circuits For Display Device (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562181380P | 2015-06-18 | 2015-06-18 | |
KR1020150142128A KR102100768B1 (ko) | 2015-06-18 | 2015-10-12 | 사용자 단말 장치 및 그 휘도 조정 방법 |
PCT/KR2016/006278 WO2016204471A1 (fr) | 2015-06-18 | 2016-06-14 | Dispositif de terminal d'utilisateur et son procédé de réglage de luminance |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3298762A1 true EP3298762A1 (fr) | 2018-03-28 |
EP3298762A4 EP3298762A4 (fr) | 2018-05-02 |
EP3298762B1 EP3298762B1 (fr) | 2023-04-26 |
Family
ID=57724736
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16811884.2A Active EP3298762B1 (fr) | 2015-06-18 | 2016-06-14 | Dispositif de terminal d'utilisateur et son procédé de réglage de luminance |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP3298762B1 (fr) |
KR (1) | KR102100768B1 (fr) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102419799B1 (ko) * | 2019-09-05 | 2022-07-14 | 주식회사 아이에스피디 | 인공지능 객체 검출을 이용한 스마트폰 전방 조도센서와 후방 카메라센서간 역광 판단과 개선 장치 및 방법 |
KR20220015712A (ko) * | 2020-07-31 | 2022-02-08 | 삼성전자주식회사 | 디스플레이의 휘도를 조절하기 위한 전자 장치 및 그의 동작 방법 |
EP4210306A4 (fr) | 2021-01-14 | 2024-05-01 | Samsung Electronics Co Ltd | Dispositif électronique et procédé de réglage de luminosité |
US11594199B2 (en) | 2021-04-30 | 2023-02-28 | Apple Inc. | Electronic device with multiple ambient light sensors |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007279179A (ja) * | 2006-04-04 | 2007-10-25 | Matsushita Electric Ind Co Ltd | 輝度調整装置 |
US20080078921A1 (en) * | 2006-08-25 | 2008-04-03 | Motorola, Inc. | Multiple light sensors and algorithms for luminance control of mobile display devices |
US7826681B2 (en) * | 2007-02-28 | 2010-11-02 | Sharp Laboratories Of America, Inc. | Methods and systems for surround-specific display modeling |
JP2010091816A (ja) * | 2008-10-08 | 2010-04-22 | Sony Corp | 表示装置 |
US8154532B2 (en) * | 2008-10-15 | 2012-04-10 | Au Optronics Corporation | LCD display with photo sensor touch function |
JP5274287B2 (ja) * | 2009-02-09 | 2013-08-28 | 三菱電機株式会社 | 表示装置および表示システム |
US20110193872A1 (en) * | 2010-02-09 | 2011-08-11 | 3M Innovative Properties Company | Control system for hybrid daylight-coupled backlights for sunlight viewable displays |
JP2014202941A (ja) * | 2013-04-05 | 2014-10-27 | キヤノン株式会社 | 表示装置、表示方法、およびプログラム |
-
2015
- 2015-10-12 KR KR1020150142128A patent/KR102100768B1/ko active IP Right Grant
-
2016
- 2016-06-14 EP EP16811884.2A patent/EP3298762B1/fr active Active
Also Published As
Publication number | Publication date |
---|---|
EP3298762A4 (fr) | 2018-05-02 |
KR20160149968A (ko) | 2016-12-28 |
KR102100768B1 (ko) | 2020-04-14 |
EP3298762B1 (fr) | 2023-04-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2016204471A1 (fr) | Dispositif de terminal d'utilisateur et son procédé de réglage de luminance | |
WO2016171433A1 (fr) | Appareil d'affichage et son procédé de commande | |
WO2019182336A1 (fr) | Dispositif électronique et procédé de commande d'affichage du dispositif électronique | |
WO2018143624A1 (fr) | Procédé de commande d'affichage, support de mémoire et dispositif électronique | |
WO2017116024A1 (fr) | Dispositif électronique ayant un dispositif d'affichage souple, et procédé de fonctionnement du dispositif électronique | |
WO2016195291A1 (fr) | Appareil terminal d'utilisateur et son procédé de commande | |
WO2017090960A1 (fr) | Appareil électronique, capteur de mesure de distance et procédé de commande d'appareil électronique et de capteur de mesure de distance | |
WO2015072669A1 (fr) | Dispositif visiocasque et son procédé de modification de transmittance | |
WO2017043710A1 (fr) | Dispositif intelligent et son procédé de commande | |
WO2017200352A1 (fr) | Procédé de fonctionnement d'un affichage correspondant à la luminance, circuit de commande et dispositif électronique prenant en charge ce dernier | |
WO2018038482A1 (fr) | Dispositif électronique comprenant une pluralité de dispositifs d'affichage tactiles et procédé de changement d'état de celui-ci | |
WO2018182287A1 (fr) | Procédé de commande à faible puissance d'un dispositif d'affichage et dispositif électronique pour la mise en oeuvre de ce procédé | |
WO2016167610A1 (fr) | Terminal portatif pouvant commander la luminosité de ce dernier, et son procédé de commande de luminosité | |
WO2020256463A1 (fr) | Dispositif électronique comprenant un écran secondaire et procédé de fonctionnement associé | |
EP3298762A1 (fr) | Dispositif de terminal d'utilisateur et son procédé de réglage de luminance | |
EP2898400A2 (fr) | Appareil souple et son procédé de commande | |
WO2018044051A1 (fr) | Procédé de pilotage d'affichage comprenant une zone d'affichage incurvée, circuit de commande d'affichage supportant celui-ci, et dispositif électronique comprenant celui-ci | |
WO2021157819A1 (fr) | Procédé de réduction de la détérioration de l'affichage d'un dispositif électronique, et dispositif électronique pliable utilisant le procédé | |
WO2022030996A1 (fr) | Dispositif électronique comprenant un dispositif d'affichage et procédé de fonctionnement associé | |
WO2021091286A1 (fr) | Dispositif électronique comprenant un capteur pour détecter une entrée externe | |
WO2019143167A1 (fr) | Dispositif électronique qui commande le degré auquel un capteur d'empreintes digitales est visuellement reconnu | |
WO2015072714A1 (fr) | Procédé et appareil de fourniture d'informations d'application | |
WO2019035607A1 (fr) | Dispositif électronique et procédé de commande de signaux de détection de toucher, et support d'informations | |
WO2019199086A1 (fr) | Dispositif électronique et procédé de commande pour dispositif électronique | |
WO2020111794A1 (fr) | Dispositif électronique comprenant un panneau d'affichage comprenant des électrodes ayant des formes différentes pour des zones respectives |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20171220 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20180405 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01J 1/42 20060101ALI20180329BHEP Ipc: G09G 3/34 20060101ALI20180329BHEP Ipc: H04M 1/725 20060101AFI20180329BHEP |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210506 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230131 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016079069 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1563677 Country of ref document: AT Kind code of ref document: T Effective date: 20230515 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230620 Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20230426 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1563677 Country of ref document: AT Kind code of ref document: T Effective date: 20230426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230828 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230726 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230620 Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230826 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230727 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016079069 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20230630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230614 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230614 |
|
26N | No opposition filed |
Effective date: 20240129 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230614 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230426 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230626 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230630 |