EP3066640B1 - Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant - Google Patents

Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant Download PDF

Info

Publication number
EP3066640B1
EP3066640B1 EP14860962.1A EP14860962A EP3066640B1 EP 3066640 B1 EP3066640 B1 EP 3066640B1 EP 14860962 A EP14860962 A EP 14860962A EP 3066640 B1 EP3066640 B1 EP 3066640B1
Authority
EP
European Patent Office
Prior art keywords
image
level
imperceivable
user
regions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP14860962.1A
Other languages
German (de)
English (en)
Other versions
EP3066640A1 (fr
EP3066640A4 (fr
Inventor
Hansub Jung
Kyoungmo Kim
Dongwook Kang
Wansang Park
Cheehoon Lee
Seongji Jang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3066640A1 publication Critical patent/EP3066640A1/fr
Publication of EP3066640A4 publication Critical patent/EP3066640A4/fr
Application granted granted Critical
Publication of EP3066640B1 publication Critical patent/EP3066640B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2007—Display of intermediate tones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • G09G3/3208—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
    • G09G3/3225—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/10—Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void
    • G01J1/20—Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void intensity of the measured or reference value being varied to equalise their effects at the detectors, e.g. by varying incidence angle
    • G01J1/28—Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void intensity of the measured or reference value being varied to equalise their effects at the detectors, e.g. by varying incidence angle using variation of intensity or distance of source
    • G01J1/30—Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void intensity of the measured or reference value being varied to equalise their effects at the detectors, e.g. by varying incidence angle using variation of intensity or distance of source using electric radiation detectors
    • G01J1/32—Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void intensity of the measured or reference value being varied to equalise their effects at the detectors, e.g. by varying incidence angle using variation of intensity or distance of source using electric radiation detectors adapted for automatic variation of the measured or reference value
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0238—Improving the black level
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/066—Adjustment of display parameters for control of contrast
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02—Details of power systems and of start or stop of display operation
    • G09G2330/021—Power management, e.g. power saving
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light

Definitions

  • the present invention relates generally to an electronic device having a display function, and more particularly, to an electronic device and operating method therefor in which the display function is performed using image processing information in order to reduce current consumption.
  • a high-end electronic device may support various functions related to calls (voice call and video call), messages (Short Message Service (SMS), Multimedia Message Service (MMS), electronic mail, etc.), navigation, image capture, broadcast reception and display, media playback (video and music), Internet, instant messengers, and Social Networking Services (SNSs).
  • calls voice call and video call
  • messages Short Message Service (SMS), Multimedia Message Service (MMS), electronic mail, etc.
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • SNSs Social Networking Services
  • the contrast ratio generally refers to a ratio of the luminance of the brightest white to that of the darkest black that the electronic device can produce. For example, when an electronic device has a contrast ratio of 1000:1, this indicates that the difference between the brightest screen and the darkest screen that the electronic device can produce may be large.
  • the contrast ratio is more influenced by dark colors than by bright colors. When the contrast ratio is high, colors can be easily and clearly distinguished.
  • the contrast ratio supported by an electronic device may have a strong influence on the overall quality, such as visibility, perceived by a user viewing an image displayed the screen of the electronic device.
  • the contrast ratio perceived by the user may vary in the presence of light from surroundings or ambient illumination, and hence, the visibility of the screen produced by an electronic device may vary. For example, the same screen may appear to be brighter in a darker viewing environment (e.g., at night) and may appear to be darker in a brighter viewing environment (e.g., in daylight).
  • the perceived contrast ratio is decreased due to ambient illumination, the brightness range not perceived by the user (e.g., an imperceivable region) may increase.
  • WO-2013/044245-a1 relates to a system and method for altering the characteristics of a display based on environmental data.
  • the system includes a light sensor, an environmental processing unit which is adapted to receive electrical signals from the light sensor and generate an environmentally-reactive control signal (Sa), an image signal processor which accepts Sa and an encoded image signal (Se) and generates a pre-decoding image signal (Sp), and an image signal decoder which accepts Sp and generates a decoded image signal for the display.
  • the environmentally-reactive control signal (Sa) may contain the instantaneous value of the desired display black level Sb. Alternatively or additionally, the environmentally-reactive control signal (Sa) may contain a signal linearity modification value.
  • US-2013/271514-a1 relates to an LED electronic sign board capable of power-saving per pixel line, comprising: an LED display panel; a panel driver; a switching mode power supply that receives AC power, generates driving power required to operate the LED display panel and the panel driver and supplies power to the LED display panel and the panel driver; a black line extractor that analyses an image signal which will be displayed on the LED display panel and extracts pixel lines which becomes black per LED module; and a main controller that controls the panel driver to display an image on the LED display panel according to the image signal, and that controls a switching signal for the operation of the switching mode power supply to shut off driving power that is supplied to the pixel lines extracted by the black line extractor from the switching mode power supply.
  • US-2010/201709-A1 relates to an image display method and apparatus.
  • the comprehensibility of the foreground image is enhanced by adjusting the brightness of the background image on the basis of the external illumination, of the brightness difference between the background image and the foreground image, or of the image complexity of the background or foreground images.
  • US-2010/103186-A1 relates to Enhanced user interface elements in ambient light.
  • a sensor input can be received from light sensor(s) that detect ambient light proximate an integrated display of a portable device.
  • a determination can be made that the ambient light detracts from the visibility of user interface elements displayed in a user interface on the integrated display, and graphic components of a user interface element can be modified to enhance the visibility of the user interface element for display in the ambient light.
  • An aspect of the present invention is to address at least the above mentioned problems and/or disadvantages and to provide at least the advantages described below.
  • an aspect of the present invention is to provide an electronic device and operating method therefor, which support a display function in an effective manner.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which can divide images into regions perceivable by the user and regions imperceivable by the user, based on image processing information, in order to minimize current consumption in the imperceivable regions.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which perform image transformation to identify imperceivable regions according to at least one of illuminance, screen brightness, and image attributes, and display the imperceivable regions based on the at least one of the illuminance, the screen brightness, and the image attributes.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which transform images to be displayed, based on image processing information , and display the transformed images, so that visibility can be maintained in consideration of user perception in consideration of the image processing information, thereby minimizing current consumption in the imperceivable regions.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which black out imperceivable regions not perceived by the user due to ambient illuminance, thereby reducing current consumption in the imperceivable regions.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which that black out regions not perceived by the user according to a preset screen bright level, thereby reducing current consumption in the imperceivable regions.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which can determine a level of image transformation in consideration of both a detected illuminance level and a preset screen brightness level, and can black out regions not perceived by the user based on the level of image transformation, thereby reducing current consumption in the imperceivable regions.
  • Another aspect of the present invention is to provide an electronic device and operating method therefor, which recognize an optimum environment to support a display function to thereby enhance user convenience and device usability.
  • a method for display operation in an emissive display device whose individual pixels emit light includes obtaining an image to be displayed in response to a user input; determining image processing information of the emissive display device including a level of ambient illuminance and a level of screen brightness of a display unit of the emissive display device; determining a level of image transformation; transforming the image based on the determined level of image transformation; and displaying the transformed image; wherein determining the level of image transformation comprises: dividing dynamically, according to both the level of ambient brightness and the level of screen brightness of the display unit, image brightnesses into a range which is not perceivable to a user and a range which is perceivable to a user; and identifying the pixels in the image to be displayed whose input brightness is comprised in the imperceivable range, said pixels forming one or more imperceivable regions of the image; and wherein transforming the image comprises: blacking out
  • determining the level of image transformation comprises determining a region to be blacked out in the image based on the image processing information.
  • determining the level of image transformation further comprises: expanding the region to be blacked out with an increasing level of illuminance according to the image processing information; reducing the region to be blacked out with a decreasing level of illuminance according to the image processing information; expanding the region to be blacked out with a decreasing level of screen brightness according to the image processing information; and reducing the region to be blacked out with an increasing level of screen brightness according to the image processing information.
  • determining the level of image transformation further comprises: determining the level of image transformation based on first image processing information; and adjusting the determined level of image transformation based on second image processing information.
  • transforming the image further comprises: transforming the region to be blacked out in the image; and shutting off power supplied to pixels of a display unit corresponding to the region to be blacked out.
  • the method further comprises examining image transform settings related to processing the image, after the image is obtained; displaying the obtained image, when the image transform settings indicate a default mode; transforming the image based on the image processing information, when the image transform settings indicate an automatic mode; and determining whether a user adjustment is necessary in a non-automatic mode, when the image transform settings indicate the non-automatic mode.
  • the method further comprises providing an adjustment user interface to permit adjustment of the level of image transformation, when the user adjustment is necessary in the non-automatic mode, wherein transforming the image comprises: receiving a user input through the adjustment user interface; adjusting the level of image transformation according to the user input; transforming the image according to the adjusted level of image transformation; and removing the adjustment user interface when the user input is released from the adjustment user interface.
  • the method further comprising transforming the image according to a level of image transformation set by a user or by a default, when the user adjustment is not necessary in the non-automatic mode.
  • the method further comprising displaying a pre-stored transformed image, when a transformed image corresponding to the obtained image is pre-stored.
  • displaying the transformed image comprises: determining whether transformed images corresponding to the obtained image are pre-stored; determining whether one of the pre-stored transformed images corresponds to the image processing information; and displaying the pre-stored transformed image corresponding to the image processing information.
  • a method for display operation in an electronic device is provided.
  • the method includes initiating an image display mode; obtaining an original image while in the image display mode; identifying a level of illuminance; determining whether to transform the original image based on the identified level of illuminance; and upon determining to transform the original image, determining an imperceivable region in the original image according to the level of illuminance, blacking out the imperceivable region, and outputting a transformed image including the blacked out the imperceivable region of the original image.
  • determining the imperceivable region comprises: determining a level of image transformation to be applied to the original image based on the level of illuminance; identifying a level of screen brightness; adjusting the level of image transformation according to the identified level of screen brightness; and determining the imperceivable region according to the adjusted level of image transformation.
  • a non-transitory computer readable storage medium for storing a program that implements the above-described method on a processor.
  • a non-transitory computer readable storage medium for storing a program, which when executed, controls an electronic device to obtain an image, obtain image processing information to be used for the image, transform the image based on the image processing information, and output the transformed image.
  • an electronic device in accordance with another aspect of the present invention, includes an emissive display unit whose individual pixels emit light configured to display an image; and a control unit configured to obtain image processing information to be used for displaying the image, to transform the image based on the image processing information, and to display the transformed image; wherein the control unit further comprises: an information acquisition module configured to obtain the image processing information including a level of ambient illuminance and a level of screen brightness of the display unit; a transform determination module configured to determine a level of image transformation ; and an image processing module configured to transform the image according to the level of image transformation, wherein determining the level of image transformation comprises dividing dynamically, according to both the level of ambient illuminance and the level of screen brightness of the display unit, input image brightnesses into a range which is not perceivable to a user and a range which is perceivable to a user, and identifying the pixels in the image to be displayed whose input brightness is comprised in the imperceivable range
  • control unit is further configured to expand the region to be blacked out with an increasing level of illuminance according to the image processing information, reduce the region to be blacked out with a decreasing level of illuminance according to the image processing information, expand the region to be blacked out with a decreasing level of screen brightness according to the image processing information, and reduce the region to be blacked out with an increasing level of screen brightness according to the image processing information.
  • control unit is further configured to shut off power supplied to pixels of the display unit corresponding to the region to be blacked out.
  • control unit is further configured to determine a level of image transformation based on first image processing information, and to adjust the determined level of image transformation based on second image processing information.
  • control unit is further configured to display the image in a default mode, transform the image based on the image processing information and display the transformed image in an automatic mode, and transform the image according to a user input and display the transformed image in a non-automatic mode.
  • control unit is further configured to find a pre-stored transformed image that corresponds to the image processing information, when transformed images corresponding to the image are pre-stored, and to display the pre-stored transformed image corresponding to the image processing information.
  • the display unit comprises an emissive display including pixels that emit light individually.
  • an electronic device in accordance with another aspect of the present invention, includes a display unit configured to display an image; an illumination sensor configured to measure a level of illuminance; a communication unit configured to perform communication for the electronic device; a storage unit configured to store one or more programs; and one or more processors to execute the one or more programs.
  • the one or more programs include a program, which when executed, controls the one or more processors to obtain an original image from the storage unit or through the communication unit upon an initiation of an image display mode, identify the level of illuminance using the illumination sensor during the image display mode, determine whether to transform the original image based on the identified level of illuminance, and upon determining to transform the original image, to determine an imperceivable region of the original image according to the level of illuminance, to black out the imperceivable region of the original image, and to display a transformed image including the blacked out imperceivable region of the original image on the display unit.
  • the one or more programs include a program that is configured to control the one or more processors to determine a level of image transformation to be applied to the original image based on the level of illuminance, identify a level of screen brightness, adjust the level of image transformation according to the identified level of screen brightness, and determine the imperceivable region according to the adjusted level of image transformation.
  • the electronic device having a display function and operating method therefor may selectively process or transform images to be displayed on the basis of various obtained information (such as illuminance, screen brightness and image attributes) and display the transformed images, reducing current consumption needed for image display while maintaining visibility.
  • various obtained information such as illuminance, screen brightness and image attributes
  • the electronic device obtains various information regarding images to be displayed for image processing or transformation and divides the images into regions perceivable to the user and regions imperceivable to the user on the basis of the obtained information, wherein, during display of images, the electronic device identifies regions imperceivable to the user according to illuminance and screen brightness.
  • the electronic device applies image transformation to imperceivable regions of the images to be displayed to thereby minimize current consumption in the imperceivable regions.
  • the image transformation consists in blacking out imperceivable regions not perceived by the user owing to illuminance and screen brightness, reducing current consumption in the imperceivable regions.
  • the electronic device it is possible for the electronic device to reduce current consumption while maintaining screen visibility to the user under various environmental conditions.
  • the electronic device may realize an optimum environment to support a display function, so that user convenience can be enhanced and device usability, accessibility and competitiveness can be heightened.
  • the present invention may be implemented using various electronic devices, such as a mobile communication terminal, smartphone, tablet computer, portable game console, Portable Multimedia Player (PMP), Personal Digital Assistant (PDA) and wearable device, and other devices supporting a display function.
  • PMP Portable Multimedia Player
  • PDA Personal Digital Assistant
  • Various embodiments of the present invention relate to an electronic device that provides a display function and an operating method therefor, which apply image transformation to images to be displayed according to image processing information and output the transformed images, thereby reducing current consumed in regions of the images with a brightness level that is not recognizable by the user (i.e., imperceivable regions).
  • the image processing information may include environmental information, image attribute information, user setting information, etc.
  • the environmental information include information regarding illuminance, infrared radiation, and ultraviolet radiation.
  • the image attribute information include information indicating whether the image is a moving image, still image, gaming image, image being scrolled, or the like.
  • the user setting information include information on a level of screen brightness and a level of image transformation, which may be set in advance by the user. In the following description, although illuminance and screen brightness are used as representative examples of image processing information, other information elements may also be used as image processing information.
  • image transformation may be performed by distinguishing regions of images that can be perceived by the user (i.e., perceivable regions) from regions of the images that cannot perceived by the user (i.e., imperceivable regions) according to changes of contrast ratio due to the influence of illuminance and/or screen brightness, and blacking out the imperceivable regions according to the image processing information. For example, after identifying the imperceivable regions, these regions are displayed in black.
  • images are transformed based on image processing information in order to minimize unnecessary current that is consumed by displaying imperceivable regions, while maintaining screen visibility to the user.
  • the electronic device may reduce current consumption during display operations while maintaining screen visibility based on a perceived contrast ratio of images on the screen in the presence of environmental influence, such as ambient illumination.
  • environmental influence such as ambient illumination.
  • the perceived contrast ratio of images on the screen lowers.
  • imperceivable regions of images to be displayed may be blacked out in order to minimize current normally consumed by displaying these imperceivable regions.
  • FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention.
  • the electronic device includes a wireless communication unit 110, a user input unit 120, a touchscreen 130, an audio processing unit 140, a storage unit 150, an interface unit 160, a control unit 170, and a power supply unit 180.
  • the electronic device may include one or more units not illustrated in FIG. 1 , and one or more units illustrated in the electronic device in FIG. 1 may be removed or replaced.
  • a camera module may also be included therein.
  • the broadcast reception module 119 of the wireless communication unit 110 may be omitted therefrom.
  • the wireless communication unit 110 may include one or more modules that support wireless communication between the electronic device and a wireless communication system or between the electronic device and another electronic device.
  • the wireless communication unit 110 includes a mobile communication module 111, a wireless local area network (WLAN) module 113, a short-range communication module 115, a location identification module 117, and a broadcast reception module 119.
  • WLAN wireless local area network
  • the mobile communication module 111 sends and receives radio signals to and from at least one of a base station, an external terminal, and a server (such as an integration server, provider server, content server, Internet server, or cloud server) on a mobile communication network.
  • the radio signals may carry various types of data in relation to voice calls, video calls, and text or multimedia messages.
  • the mobile communication module 111 may receive one or more images, which are a target for image transformation or processing.
  • the mobile communication module 111 may also receive images from another electronic device or a server connected with the electronic device through a network (such as a mobile communication network).
  • the mobile communication module 111 may send and receive data mapped with contrast ratios (e.g., a gamma correction table or profile) corresponding to various image processing information (e.g., environmental information, image attribute information, and user setting information) for use in a display operation of the electronic device to and from an external entity (such as a server or external electronic device).
  • contrast ratios e.g., a gamma correction table or profile
  • image processing information e.g., environmental information, image attribute information, and user setting information
  • the WLAN module 113 may be used to wirelessly access the Internet and to establish a WLAN link to another electronic device.
  • the WLAN module 113 may be a built-in module or a removable module.
  • Wireless Internet access may be achieved through Wi-Fi, Wireless broadband (WiBro), Worldwide Interoperability for Microwave Access (WiMAX), or High Speed Downlink Packet Access (HSDPA).
  • Wi-Fi Wireless broadband
  • WiMAX Worldwide Interoperability for Microwave Access
  • HSDPA High Speed Downlink Packet Access
  • the WLAN module 113 may send user input data to an external device or receive data from an external device through a messenger application.
  • the WLAN module 113 may receive one or more images for image transformation or processing.
  • the WLAN module 113 may receive images from another electronic device or a server connected with the electronic device through a network (such as wireless Internet).
  • the WLAN module 113 may send and receive data for use in a display operation of the electronic device (e.g., a gamma correction table) to and from an external entity (such as a server).
  • a display operation of the electronic device e.g., a gamma correction table
  • an external entity such as a server
  • the WLAN module 113 may send and receive various data (such as an image, a moving image, a music file, and a gamma correction table) to and from the different electronic device according to user selection.
  • the WLAN module 113 may always be on or may be turned on according to user settings or user input.
  • the short-range communication module 115 is used to support short-range communication.
  • Short-range communication may be provided through Bluetooth, Bluetooth low energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, or Near Field Communication (NFC).
  • BLE Bluetooth low energy
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • ZigBee ZigBee
  • NFC Near Field Communication
  • the short-range communication module 115 may receive one or more images for image transformation or processing.
  • the short-range communication module 115 may receive images from another electronic device connected with the electronic device through a network (such as short-range communication).
  • the short-range communication module 115 may send and receive various data (such as an image, a moving image, a music file, and a gamma correction table) to and from the different electronic device according to user selection.
  • the short-range communication module 115 may always be on or may be turned on according to user settings or user input.
  • the location identification module 117 is used to identify the location of the electronic device.
  • the location identification module 117 may be a Global Positioning System (GPS) module.
  • GPS Global Positioning System
  • the location identification module 117 may compute the latitude, longitude and altitude of the current location by applying triangulation to distance and time information received from three or more base stations.
  • the location identification module 117 may also identify the current location by use of signals received in real time from three or more satellites.
  • Location information of the electronic device may be obtained in various ways.
  • the broadcast reception module 119 may receive a broadcast signal (e.g., a TV broadcast signal, radio broadcast signal or data broadcast signal) and associated information (e.g., information regarding broadcast channels, broadcast programs and broadcast service providers) from an external broadcasting server through a broadcast channel (e.g., a satellite channel or a terrestrial channel).
  • a broadcast signal e.g., a TV broadcast signal, radio broadcast signal or data broadcast signal
  • associated information e.g., information regarding broadcast channels, broadcast programs and broadcast service providers
  • the user input unit 120 generates an input signal for controlling the electronic device corresponding to user manipulation.
  • the user input unit 120 may include a keypad, a dome switch, a touchpad (resistive or capacitive), a jog shuttle, and sensors (such as a voice recognition sensor, proximity sensor, illumination sensor, acceleration sensor, gyro sensor, geomagnetic sensor, color sensor, temperature sensor, and motion recognition sensor).
  • the user input unit 120 may include physical buttons formed on the exterior of the electronic device and virtual buttons on a touch panel.
  • the user input unit 120 may receive user input for manipulating the electronic device and generate an input signal corresponding to the user input.
  • the user input unit 120 may receive user input for applying image transformation (e.g., blacking out imperceivable regions) according to image processing information (e.g., illuminance and screen brightness) and generate an input signal corresponding to the user input.
  • image transformation e.g., blacking out imperceivable regions
  • image processing information e.g., illuminance and screen brightness
  • a user manipulates the user input unit 120 to raise a level of image transformation at an outdoor site with a high illuminance; and the user manipulates the user input unit 120 to lower the level of image transformation at an indoor site with a low illuminance.
  • the level of image transformation may indicate, for example, the size of the region of an image to be blacked out in consideration of visibility of the image to the user.
  • the level of image transformation may be set to be low. Being outside on a cloudy afternoon with illuminance of 3000 to 4000 lux, the level of image transformation may be set to be medium. Being outside on a sunny afternoon with illuminance of 40000 lux or more, the level of image transformation may be set to be high.
  • UV ultraviolet
  • the touchscreen 130 supports both an input function and a display function, and includes a display unit 131 and a touch sensor 133.
  • the display unit 131 of the touchscreen 130 is used to display various screens of the electronic device, such as an instant messenger screen, a call handling screen, a gaming screen, a video playback screen, a gallery screen, a webpage screen, a home screen, etc.
  • the touchscreen 130 may send an input signal corresponding to the touch event to the control unit 170, which may then identify the touch event and control an operation according to the touch event. For example, the touchscreen 130 receives a user input or touch event for image transformation while displaying a video playback screen, and displays the video playback screen based on the images that are transformed to an extent indicated by the user input (e.g., imperceivable regions of the images are blacked out) under control of the control unit 170.
  • the control unit 170 may send an input signal corresponding to the touch event to the control unit 170, which may then identify the touch event and control an operation according to the touch event. For example, the touchscreen 130 receives a user input or touch event for image transformation while displaying a video playback screen, and displays the video playback screen based on the images that are transformed to an extent indicated by the user input (e.g., imperceivable regions of the images are blacked out) under control of the control unit 170.
  • the display unit 131 displays or outputs information processed by the electronic device. For example, when the electronic device is in a call handling mode, the display unit 131 may display a user interface (UI) or graphical user interface (GUI) for call handling. When the electronic device is in a video call mode or capture mode, the display unit 131 may output a UI or GUI for displaying received or captured images.
  • the display unit 131 may display the screen in a landscape mode or portrait mode and may switch between landscape mode and portrait mode according to rotation or placement of the electronic device.
  • the display unit 131 may be realized using one or more display techniques based on liquid crystal display (LCD), thin film transistor liquid crystal display (TFT-LCD), light emitting diodes (LED), organic light emitting diodes (OLED), active matrix OLEDs (AMOLED), flexible display, bendable display, and 3D display.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor liquid crystal display
  • LED light emitting diodes
  • OLED organic light emitting diodes
  • AMOLED active matrix OLEDs
  • flexible display bendable display
  • bendable display and 3D display.
  • 3D display 3D display.
  • the display unit 131 may also use a transparent display technology so as to be seen from the outside.
  • the display operation method for the electronic device may be applied to a variety of display types.
  • the display operation method may reduce a high amount current when applied to an emissive display such as an AMOLED display whose individual pixels emit light.
  • the display unit 131 may be realized using an emissive display whose individual pixels emit light.
  • the touch sensor 133 may be placed on the display unit 131 and may sense user input of touching the surface of the touchscreen 130 or hovering thereon.
  • user touch input may correspond to a touch event such as tap, drag, sweep, flick, drag and drop, drawing, single touch, multi touch or handwriting.
  • the touch sensor 133 identifies the coordinates of the touch point and sends the coordinates to the control unit 170. That is, when user input is detected on the surface of the touchscreen 130, the touch sensor 133 generates an input signal corresponding to the user input and sends the input signal to the control unit 170, which may then perform a function according to the area in which the user input is generated.
  • the touch sensor 133 may receive user input for initiating the display function of the present invention and generate an input signal corresponding to the user input.
  • the touch sensor 133 may receive user input for applying image transformation (e.g., blacking out imperceivable regions (imperceivable regions are displayed in black)) according to image processing information (e.g., illuminance and/or screen brightness) and may generate an input signal corresponding to the user input.
  • image transformation e.g., blacking out imperceivable regions (imperceivable regions are displayed in black
  • image processing information e.g., illuminance and/or screen brightness
  • the touch sensor 133 converts a pressure change or capacitance change detected at a site of the display unit 131 into an electrical signal.
  • the touch sensor 133 may sense the position and area of user touch input and may also sense pressure caused by touch input according to a touch technique employed.
  • the touch sensor 133 may send a corresponding electrical signal to a touch controller (not shown).
  • the touch controller may process the received electrical signal and send data corresponding to the processed result to the control unit 170. Accordingly, the control unit 170 may identify a touch point on the touchscreen 130.
  • the audio processing unit 140 may send an audio signal from the control unit 170 to a speaker 141, and may send an audio signal such as a voice signal from a microphone 143 to the control unit 170. Under control of the control unit 170, the audio processing unit 140 may convert voice or audio data into an audio signal and output the audio signal through the speaker 141, and may convert an audio signal such as a voice signal from the microphone 143 into a digital signal and send the digital signal to the control unit 170.
  • the speaker 141 is used to output audio, e.g., audio data received through the wireless communication unit 110 or stored in the storage unit 150, and sound effects related to functions being executed (e.g., instant messaging, image display, image transformation, call handling, image capture, content file playback, etc.).
  • audio e.g., audio data received through the wireless communication unit 110 or stored in the storage unit 150
  • sound effects related to functions being executed e.g., instant messaging, image display, image transformation, call handling, image capture, content file playback, etc.
  • the microphone 143 may be used to receive audio from the outside and convert the audio into electrical audio data. For example, during a call, the processed audio data may be converted into a format transmittable to a base station through the mobile communication module 111. Further, the microphone 143 may implement a variety of noise removal algorithms to remove noise occurring while receiving an audio signal from the outside.
  • the storage unit 150 may store programs executable by the control unit 170, and may store input/output data such as messenger data like conversation data, contact information (fixed or mobile telephone numbers), messages, and media content (audio, video and images).
  • input/output data such as messenger data like conversation data, contact information (fixed or mobile telephone numbers), messages, and media content (audio, video and images).
  • the storage unit 150 may store a display support program used to obtain original images from the storage unit 150 or through the wireless communication unit 110 (e.g., the mobile communication module 111, WLAN module 113, short-range communication module 115, or broadcast reception module 119) according to the initiation of an image display mode, to measure illuminance using an illumination sensor during the image display mode, to determine whether to apply image transformation to the original images based on the measured illuminance, to identify imperceivable regions in the original images, upon determining to apply image transformation, to black out the imperceivable regions of the original images, and to display the images transformed through blacking out on the display unit 131.
  • the wireless communication unit 110 e.g., the mobile communication module 111, WLAN module 113, short-range communication module 115, or broadcast reception module 119
  • the storage unit 150 may also store a program used to determine the level of image transformation based on a measured illuminance, to identify screen brightness, to adjust the level of image transformation according to the screen brightness, and to identify imperceivable regions in the original images in consideration of the adjusted level of image transformation.
  • the storage unit 150 may store one or more images to be transformed or processed.
  • the storage unit 150 may store transformed images, image processing information (e.g., illuminance and/or screen brightness), and levels of image transformation corresponding to the image processing information.
  • image processing information e.g., illuminance and/or screen brightness
  • levels of image transformation corresponding to the image processing information e.g., illuminance and/or screen brightness
  • the storage unit 150 may store information on various contrast ratios perceived by the user according to image processing information, and store a table containing mappings between contrast ratios and levels of image transformation (e.g., a gamma correction table).
  • the storage unit 150 may store information on usage frequencies, importance and priorities of applications and content.
  • the storage unit 150 may store information on various patterns of vibrations and sound effects output in response to touch input on the touchscreen 130.
  • the storage unit 150 may temporarily or semi-permanently store an operating system (OS) of the electronic device, programs supporting input and display operations of the touchscreen 130, programs supporting image transformation based on image processing information and display of transformed images, and data generated during program execution.
  • OS operating system
  • the storage unit 150 may include one or more of various types of storage media, such as flash memory, a hard disk, a multimedia or other memory card (e.g., micro, SD, or XD), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic memory (MRAM), magnetic disk, and optical disc.
  • the storage unit 150 may function in cooperation with a Web storage over the Internet.
  • the interface unit 160 may be used as an interface for connecting an external appliance to the electronic device.
  • the interface unit 160 may be used to receive data or power from an external appliance and to send internal data to the external appliance.
  • the interface unit 160 may include a wired/wireless headset port, a charger port, a wired/wireless data port, a memory card port, a port for a device with an identification module, an audio input/output port, a video input/output port, and an earphone port.
  • the control unit 170 may control the overall operation of the electronic device. For example, the control unit 170 may control operations related to voice communication, data communication, and video communication.
  • the control unit 170 may include a data processing module (not shown) to perform image transformation according to image processing information and display the transformed images.
  • the control unit 170 may include one or more processors that can execute one or more programs stored in the storage unit 150 to control image transformation based on image processing information (e.g., illuminance and/or screen brightness).
  • control unit 170 may obtain images to be displayed on the display unit 131 from an internal component or external entity in response to user input.
  • the control unit 170 may obtain image processing information (e.g., illuminance and/or preset screen brightness) to be used to process or transform the images.
  • image processing information e.g., illuminance and/or preset screen brightness
  • the control unit 170 may determine whether to perform image transformation based on the image processing information, and may determine the level of image transformation to be applied to the images, upon determining to perform image transformation.
  • the control unit 170 may compare the image processing information with preset thresholds (ranges or intervals) for determining whether to apply image transformation (e.g., values corresponding to various levels of illuminance (and/or screen brightness)).
  • the control unit 170 may determine to apply image transformation when the image processing information matches the preset thresholds. For example, when regions not perceived by the user (i.e., imperceivable regions) are present in the images at a given illuminance level, the control unit 170 may determine to apply image transformation and black out the imperceivable regions.
  • the level of image transformation may indicate the amount of transformation to be applied to a given image while maintaining visibility of the image to the user.
  • the control unit 170 may transform the image (e.g., blacking out imperceivable regions of the image) according to the level of image transformation determined based on, for example, the illuminance level.
  • control unit 170 may further consider user setting information. For example, the control unit 170 may adjust the level of image transformation according to preset screen brightness for the display unit 131.
  • the control unit 170 may also determine the level of image transformation in consideration of multiple items of the image processing information. For example, the control unit 170 may determine the level of image transformation according to first image processing information (e.g., illuminance or screen brightness) and may then adjust the level of image transformation according to second image processing information (e.g., screen brightness or illuminance).
  • first image processing information e.g., illuminance or screen brightness
  • second image processing information e.g., screen brightness or illuminance
  • the control unit 170 may also determine the level of image transformation at one time in consideration of first and second image processing information.
  • control unit 170 may control the display unit 131 to display the transformed images. That is, the control unit 170 may control an operation so that imperceivable regions of the images, which are determined based on illuminance, are blacked out. For example, the control unit 170 may shut off power supplied to pixels of the display unit 131 corresponding to the imperceivable regions.
  • control unit 170 may determine whether to apply image transformation based on one or more pieces of information, transform the images according to the determination result, and display the transformed images.
  • control unit 170 may obtain environmental information related to ambient illumination, ultraviolet rays, and infrared rays by use of an illumination sensor, ultraviolet sensor, and infrared sensor.
  • the control unit 170 may obtain image attribute information indicating one of image types including a moving image, a still image, a gaming image, and a screen being scrolled by analyzing attributes of images to be processed.
  • An image may correspond to a webpage that is viewable through a web browser or to a page provided by a native program such as a telephony program or word processing program.
  • An image may also correspond to a full screen displayed on the display unit 131 or to a portion of a full screen.
  • the control unit 170 may obtain information on the screen brightness of the display unit 131 and the level of image transformation preset by the user.
  • the control unit 170 may determine whether a transformed image corresponding to an image to be displayed is stored. When at least one transformed image corresponding to an image to be displayed is present, the control unit 170 may output the pre-stored transformed image without transforming the image to be displayed. When one or more pre-stored transformed images corresponding to the image to be displayed are present, the control unit 170 may determine whether one of the transformed images matches image processing information (e.g., illuminance level). When a pre-stored transformed image matching the image processing information (e.g., illuminance level) is present, the control unit 170 may control the display unit 131 to display the matching pre-stored transformed image. When a pre-stored transformed image matching the image processing information (e.g., illuminance level) is not present, the control unit 170 may transform the image to be displayed according to the image processing information and control the display unit 131 to display the transformed image.
  • image processing information e.g., illuminance level
  • the control unit 170 may store multiple transformed images according to particular conditions (e.g., multiple illuminance levels) and display one of the transformed images in response to a viewing request for the image, avoiding repeated image transformation. That is, when the user repeatedly selects the same image, the control unit 170 may output a corresponding stored transformed image without performing image transformation requiring current consumption. Hence, it is possible to prevent repeated image transformation for the same image, reducing current consumption and load.
  • particular conditions e.g., multiple illuminance levels
  • control unit 170 may control regular operations of the electronic device. For example, when an application is executed, the control unit 170 may control application execution and screen display for the application. The control unit 170 may receive an input signal corresponding to a touch event generated on a touch-based input interface (such as the touchscreen 130) and control function execution according to the input signal. The control unit 170 may also control transmission and reception of various data carried out through wired or wireless communication.
  • the power supply unit 180 may supply power from an external or internal power source to the individual components of the electronic device under control of the control unit 170.
  • the power supply unit 180 may supply or shut off power to individual pixels of the display unit 131 under control of the control unit 170.
  • the electronic device may be any electronic appliance including an Application Processor (AP), a Graphics Processing Unit (GPU), and a Central Processing Unit (CPU), such as an information and communication device, multimedia device or applied device.
  • the electronic device may be a mobile communication terminal based on communication protocols supporting various communication systems, a tablet computer, a smartphone, a wearable device (i.e., a smart device that may be worn or put on by a user, such as a wearable phone, a wearable watch, a wearable computer, a wearable camera, wearable shoes, a wearable pendant, a wearable ring, a wearable bracelet, wearable glasses or goggles), a Portable Multimedia Player (PMP), a media player such as an MP3 player, a portable game console, or a PDA.
  • the function control scheme of the embodiments of the present invention may also be applied to various display devices such as a laptop computer, a Personal Computer (PC), a digital television, Digital Signage (AP), a Personal Computer (PC), a
  • Various embodiments of the present invention can be implemented using hardware, software or a combination thereof.
  • Software implementation can be stored in a storage medium readable by a computer or a similar device.
  • Hardware implementation may be achieved using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, and an electric unit for providing a specific function.
  • ASIC Application Specific Integrated Circuit
  • DSP Digital Signal Processor
  • DSPD Digital Signal Processing Device
  • PLD Programmable Logic Device
  • FPGA Field Programmable Gate Array
  • processor a controller, a microcontroller, a microprocessor, and an electric unit for providing a specific function.
  • the storage medium may be a computer readable storage medium storing a program used to obtain original images, obtain image processing information (e.g., illuminance and screen brightness) for the images, determine whether to apply image transformation to the images on the basis of the image processing information, transform the images according to the image processing information, and output the transformed images.
  • image processing information e.g., illuminance and screen brightness
  • control unit 170 Some embodiments of the present invention may be directly implemented by the control unit 170. Procedures and functions described as embodiments in the present specification may be implemented by software modules. Each software module may perform one or more functions or operations described in the present specification.
  • FIG. 2 illustrates operations performed by an electronic device for image processing and display according to an embodiment of the present invention.
  • control unit 170 of the electronic device obtains an original image 210 from the storage unit 150 or through the wireless communication unit 110 in response to a user input for image display.
  • the control unit 170 may determine whether to apply image transformation to the original image 210 based on one or more pieces of image processing information, such as environmental information (e.g., illuminance), state information (e.g., screen brightness) or image attribute information.
  • image processing information e.g., illuminance
  • state information e.g., screen brightness
  • image attribute information e.g., image attribute information
  • the control unit 170 using an information acquisition module 171, obtains image processing information (e.g., illuminance through an illumination sensor).
  • the control unit 170 Upon determining to transform the original image 210, the control unit 170, using image processing module 175, determines the level of image transformation to be applied to the original image 210 (e.g., the region to be blacked out), based on the image processing information (e.g., illuminance). When the illuminance level is high, the control unit 170, using an image processing module 175, raises the level of image transformation; and when the illuminance level is low, the control unit 170, using the image processing module 175, lowers the level of image transformation.
  • the image processing information e.g., illuminance
  • control unit 170 when the electronic device is located outside with a high illuminance, the control unit 170, using the image processing module 175, raises the level of image transformation; and when the electronic device is indoors with a low illuminance, the control unit 170, using the image processing module 175, lowers the level of image transformation.
  • the control unit 170 may increase the region to be blacked out when illuminance is high, and may decrease the region to be blacked out when illuminance is low. For example, in a poorly lit room with illuminance of 0 to 800 lux, the control unit 170, using the transform determination module 173, determines the level of image transformation to be low and decreases the region to be blacked out in a given image. When outside on a cloudy afternoon with illuminance of 3000 to 4000 lux, the control unit 170, using the transform determination module 173, determines the level of image transformation to be medium and increases the region to be blacked out in a given image.
  • the control unit 170 uses the transform determination module 173, determines the level of image transformation to be at a maximum and maximizes the region to be blacked out in a given image.
  • the region to be displayed in black i.e., the imperceivable region or region to be blacked out
  • the control unit 170 uses the transform determination module 173, identifies a contrast ratio corresponding to the image processing information (e.g., illuminance and screen brightness).
  • the contrast ratio is related to an image displayed on the display unit 131.
  • the control unit 170 uses the transform determination module 173, determines the level of image transformation to be applied to the original image 210, based on the contrast ratio corresponding to the image processing information. For example, the control unit 170, using the transform determination module 173, divides the original image 210 into a perceivable region and an imperceivable region, based on the contrast ratio, and determines the region to be blacked out (i.e., the level of image transformation) in the imperceivable region. For example, the region to be blacked out may be the whole imperceivable region or a portion of the imperceivable region.
  • the control unit 170 Upon determining the level of image transformation to be applied to the original image 210, the control unit 170, using the image processing module 175, transforms the original image 210 accordingly (e.g., blacks out the imperceivable region). Accordingly, the control unit 170, using the image processing module 175, generates a transformed image 250 and outputs the transformed image 250 to the display unit 131. The control unit 170, using the image processing module 175, also stores the transformed image 250 in the storage unit 150.
  • control unit 170 may vary the level of image transformation based on information regarding at least one of illuminance, ultraviolet rays, infrared rays, and location (indoor or outdoor), thereby improving visibility of displayed images to the user.
  • control unit 170 determines whether to apply image transformation to the original image 210 based on user setting information. For example, the control unit 170 may adjust a level of image transformation according to screen brightness of the display unit 131 as preset by the user. That is, the control unit 170 may lower the level of image transformation when the screen brightness is high, and raise the level of image transformation when the screen brightness is low.
  • control unit 170 may vary a level of image transformation according to the screen brightness of the display unit 131, and as such, may lower the level of image transformation when the screen brightness is high because of a user selection or device state, thereby reducing current consumption and improving visibility.
  • FIGs. 3A and 3B illustrate image transformation based on image processing information according to an embodiment of the present invention. Specifically, FIG. 3A illustrates variation of an imperceivable region in an image displayed on the display unit 131 with variation of illuminance, and FIG. 3B illustrates variation of an imperceivable region in an image displayed on the display unit 131 with variation of screen brightness.
  • reference numerals 310, 330, and 350 indicate contrast ratios perceived by a user when the illuminance level is 10 lux, 1500 lux, and 20000 lux, respectively.
  • Reference numerals 315, 335, and 355 indicate regions not perceived by the user (i.e., imperceivable regions) at perceived contrast ratios corresponding to the above illuminance levels (i.e., 10 lux, 1500 lux, and 20000 lux).
  • the imperceivable region to be blacked out may vary according to the level of illuminance. That is, the imperceivable region may expand with the increasing level of illuminance.
  • Reference numerals 320, 340, and 360 represent visibility of the same image to the user at the above illuminance levels 10 lux, 1500 lux, and 20000 lux. Further, reference numerals 345 and 365 indicate regions not perceived by the user (i.e., imperceivable regions) in the image displayed on the display unit 131.
  • the perceived contrast ratio of the image on the display unit 131 decreases with the increasing level of illuminance (i.e., 10 lux, 1500 lux, and 20000 lux). As the perceived contrast ratio decreases with the increasing level of illuminance, the regions not perceived by the user (i.e., imperceivable regions 345 and 365) expand.
  • the imperceivable region 365 in the image 360 at illuminance level 20000 lux is larger than the imperceivable region 345 in the image 340 at illuminance level 1500 lux.
  • the level of illuminance is high (e.g., a bright room or a sunny outdoor site)
  • a large difference may exist between the image on the display unit 131 and the image perceived by the user because high illuminance acts as noise to the displayed image on the display unit 131, thereby lowering visibility of the image.
  • the imperceivable region to be blacked out may vary according to the level of illuminance.
  • the imperceivable region may also vary according to the screen brightness of the display unit 131.
  • reference numerals 370, 380, and 390 indicate contrast ratios perceived by the user when the preset screen brightness is 300 nit, 100 nit, and 20 nit, respectively.
  • Reference numerals 375, 385, and 395 indicate regions not perceived by the user (i.e., imperceivable regions) at perceived contrast ratios corresponding to the above screen brightnesses 300 nit, 100 nit, and 20 nit.
  • the imperceivable region to be blacked out may vary according to the level of screen brightness. That is, the imperceivable region may expand with the decreasing level of screen brightness.
  • the perceived contrast ratio of the image on the display unit 131 decreases with the decreasing level of screen brightness 300 nit, 100 nit, and 20 nit.
  • the region not perceived by the user i.e., an imperceivable region expands.
  • the imperceivable region 395 in the image 390 at a screen brightness of 20 nit is larger than the imperceivable region 375 in the image 370 at a screen brightness of 300 nit.
  • the screen brightness is low, a large difference may exist between the image on the display unit 131 and the image perceived by the user.
  • the imperceivable region may be reduced when the screen brightness is high, and may be expanded when the screen brightness is low. For example, when the level of screen brightness increases, the imperceivable region having been not perceived by the user becomes brighter, and hence, can be perceived by the user.
  • the imperceivable region not perceived by the user may vary according to changes in illuminance and/or screen brightness.
  • the level of image transformation is determined based on preset image processing information (e.g., at least one of illuminance and screen brightness), and the imperceivable region of an image is blacked out according to the determined level of image transformation. Accordingly, it is possible to maintain visibility to the user and reduce current consumed in the imperceivable region under various environmental conditions.
  • FIGs. 4 and 5 illustrate images perceived by a user as results of display operations according to an embodiment of the present invention.
  • part (A) illustrates an original image 210 being displayed as a result image 410 on the display unit 131 without separate image processing, under conditions indicated by image processing information (e.g., at least one of illuminance and screen brightness).
  • Part (B) illustrates an original image 210 being processed into a transformed image 250 and the transformed image 250 being displayed as a result image 430 on the display unit 131, under conditions indicated by image processing information 450 (e.g., at least one of illuminance and screen brightness).
  • part (A) illustrates an original image 210 being viewed by a user at a default contrast ratio 510 of the electronic device under conditions indicated by given image processing information (e.g., illuminance and screen brightness).
  • Reference numeral 530 indicates a graph representing a relationship between input contrast ratio (X-axis) and output contrast ratio (Y-axis) for the original image 210.
  • Reference numeral 410 represents a result image viewed by the user when the original image 210 is displayed on the display unit 131 under conditions indicated by the image processing information.
  • illuminance When illuminance is used as image processing information in part (A), at a site with high illuminance (e.g., a sunny outdoor site), illuminance may act as noise to the image displayed on the display unit 131. Consequently, visibility of the result image 410 on the display unit 131 may be reduced due to a dark region (i.e., an imperceivable region) in the result image 410. As illustrated in part (A), the electronic device consumes current to display an imperceivable region that is not perceived by the user.
  • a site with high illuminance e.g., a sunny outdoor site
  • illuminance may act as noise to the image displayed on the display unit 131. Consequently, visibility of the result image 410 on the display unit 131 may be reduced due to a dark region (i.e., an imperceivable region) in the result image 410.
  • the electronic device consumes current to display an imperceivable region that is not perceived by the user
  • an original image 210 is processed into a transformed image 250, based on a contrast ratio 520 corresponding to specific image processing information (e.g., illuminance and screen brightness) and the transformed image is displayed as a result image 430 on the display unit 131.
  • Reference numeral 540 indicates a graph representing a relationship between input contrast ratio (X-axis) and output contrast ratio (Y-axis) for the original image 210. As indicated by the graph 540, regions 555 of the image corresponding to the imperceivable region 525 indicated by the image processing information (e.g., illuminance and screen brightness) are blacked out, i.e., image transformation is applied.
  • the original image 210 may be transformed into a transformed image 250 by blacking out the regions 555 of the original image 210 (relative to the output contrast ratio) corresponding to the imperceivable region 525 (relative to the input contrast ratio), and the transformed image 250 may be output as the result image 430.
  • Reference numeral 430 indicates a result image viewed by the user under the influence of the image processing information (e.g., illuminance and screen brightness) when the original image 210 is transformed and displayed as a transformed image 250 on the display unit 131.
  • the image processing information e.g., illuminance and screen brightness
  • the electronic device may determine the level of image transformation to be applied to the original image 210 based on the identified level of illuminance (e.g., 20000 lux). For example, the electronic device may identify imperceivable regions 555 of the original image 210, which are not perceived by the user at the given level of illuminance. The electronic device may identify the contrast ratio 520 corresponding to the given level of illuminance and identify the imperceivable regions 555 in the original image 210 according to the contrast ratio 520.
  • the identified level of illuminance e.g. 20000 lux
  • the electronic device may transform the original image 210 into a transformed image 250 by blacking out the imperceivable regions 555 of the original image 210 (e.g., corresponding pixels are turned off). The electronic device may then output the transformed image 250 as a result image 430 on the display unit 131.
  • regions of the original image 210 not perceived by the user i.e., the imperceivable regions 555
  • image processing information e.g., illuminance and screen brightness
  • FIG. 6 illustrates relationships between input image brightness and output image brightness in imperceivable regions according to an embodiment of the present invention.
  • FIG. 6 illustrates a relationship between input image brightness and output image brightness, which may be used to identify an imperceivable region to be blacked out according to the obtained image processing information.
  • illuminance is used as image processing information.
  • part (A) illustrates a relationship graph when the level of illuminance is 10 lux
  • part (B) illustrates a relationship graph when the level of illuminance is 1500 lux
  • part (C) illustrates a relationship graph when the level of illuminance is 20000 lux.
  • the region to be blacked out may vary according to levels of illuminance.
  • the region to be blacked out may be expanded with the increasing level of illuminance as indicated by part (A), part (B) and part (C).
  • the relationship between input image brightness and output image brightness may also vary.
  • the region to be blacked out is determined at illuminance level 10 lux, as indicated by 315.
  • the output brightness may be set to 0 (zero), e.g., by shutting off power supplied to pixels of the display unit 131 corresponding to the blackout region.
  • the output brightness may be produced according to the existing input/output relationship.
  • the region to be blacked out is determined at illuminance level 1500 lux, as indicated by 335.
  • the output brightness may be set to 0 (zero), e.g., by shutting off power supplied to pixels of the display unit 131 corresponding to the blackout region.
  • the input interval W whose output brightness is set to zero, is extended. That is, the region to be blacked out (i.e., the imperceivable region in an image) may expand with the increasing level of illuminance.
  • the output brightness may be produced according to the existing input/output relationship.
  • the region to be blacked out is determined at illuminance level 20000 lux, as indicated by 355.
  • the output brightness may be set to 0 (zero), e.g., by shutting off power supplied to pixels of the display unit 131 corresponding to the blackout region.
  • the input interval W whose output brightness is set to zero, is extended. That is, the region to be blacked out (i.e., the imperceivable region in the image) expands with the increasing level of illuminance.
  • the output brightness may be produced according to the existing input/output relationship.
  • FIG. 7 is a flowchart illustrating a display method for an electronic device according to an embodiment of the present invention.
  • the control unit 170 obtains an image to be displayed on the display unit 131. For example, in response to a user input for selecting an image from an internal component or an external entity, the control unit 170 obtains the image selected by the user.
  • the control unit 170 may obtain an image to be displayed from the storage unit 150 or an external device, such as an external electronic device or server connected with the electronic device through a network (such as the Internet, wireless local area network, or mobile communication network).
  • a network such as the Internet, wireless local area network, or mobile communication network.
  • the control unit 170 collects image processing information (e.g., illuminance and/or screen brightness).
  • image processing information may include various types of information, such as environmental information, image attribute information, and user setting information.
  • the control unit 170 determines to apply image transformation to the image based on the image processing information. For example, the control unit 170 identifies the level of illuminance using an illumination sensor in response to user input for image selection and determines to apply image transformation based on the level of illuminance. The control unit 170 may identify the screen brightness preset by the user in response to user input for image selection and determine whether to apply image transformation based on the screen brightness. The control unit 170 may determine whether to apply image transformation in consideration of both illuminance and screen brightness.
  • the control unit 170 may determine to apply image transformation when the image processing information meets preset conditions. For example, if the level of illuminance matches a preset threshold (range or interval), the control unit 170 may determine to apply image transformation. When an imperceivable region is present under conditions indicated by the image processing information (e.g., illuminance and screen brightness), the control unit 170 may determine to apply image transformation.
  • a preset threshold range or interval
  • the control unit 170 may determine to apply image transformation.
  • an imperceivable region is present under conditions indicated by the image processing information (e.g., illuminance and screen brightness)
  • the control unit 170 may determine to apply image transformation.
  • the control unit 170 determines the level of image transformation.
  • the level of image transformation may vary according to levels of illuminance. For example, the region not perceived by user may expand with the increasing level of illuminance. As such, the control unit 170 may increase the level of image transformation (e.g., expanding the region to be blacked out) when the level of illuminance is high, and decrease the level of image transformation (e.g., reducing the region to be blacked out) when the level of illuminance is low.
  • the control unit 170 may vary the level of image transformation according to levels of screen brightness.
  • the control unit 170 may determine the level of image transformation in consideration of both illuminance and screen brightness. For example, the control unit 170 may vary the level of image transformation according to a measured level of screen brightness (or a measured level of illuminance) within a preset range of illuminance (or a preset range of screen brightness).
  • the region not perceived by the user may vary according to levels of screen brightness. That is, at the same level of illuminance, the region not perceived by the user may expand with the decreasing level of screen brightness.
  • the control unit 170 may increase the level of image transformation (e.g., expanding the region to be blacked out), when the screen brightness is low, and may decrease the level of image transformation (e.g., reducing the region to be blacked out), when the screen brightness is high.
  • control unit 170 performs image transformation according to the level of image transformation. For example, the control unit 170 transforms the image by a large amount when the electronic device is at an outdoor site with high illuminance, and transforms the image by a small amount when the electronic device is at an indoor site with low illuminance.
  • control unit 170 may further consider user setting information. For example, the control unit 170 may adjust the level of image transformation in consideration of screen brightness.
  • the control unit 170 may decrease the level of image transformation when the screen brightness of the display unit 131 is high, and may increase the level of image transformation when the screen brightness is low.
  • control unit 170 outputs the transformed image to the display unit 131.
  • the control unit 170 may output the transformed image at the same level of visibility as that of the original image while minimizing current consumption in the imperceivable region (i.e., the blackout region) of the image not perceived by the user.
  • FIG. 8 illustrates a procedure to determine a level of image transformation according to an embodiment of the present invention.
  • the control unit 170 may transform an image to be displayed on the display unit 131 based on multiple pieces of image processing information, such as first and second image processing information.
  • the first image processing information and the second image processing information may include different pieces of information.
  • illuminance is used as the first image processing information
  • screen brightness is used as the second image processing information.
  • control unit 170 obtains an image to be displayed on the display unit 131 from an internal component or an external entity, in response to user input.
  • control unit 170 obtains multiple pieces of image processing information (e.g., illuminance, screen brightness).
  • image processing information e.g., illuminance, screen brightness
  • control unit 170 determines the level of image transformation to be applied to the image on the basis of the image processing information.
  • the control unit 170 determines to use illuminance as the first image processing information.
  • the control unit 170 determines the level of image transformation according to the first image processing information (i.e., illuminance).
  • the control unit 170 determines to use screen brightness as the second image processing information.
  • the control unit 170 adjusts the level of image transformation according to the second image processing information. That is, the control unit 170 may temporarily determine the level of image transformation according to the first image processing information and may then adjust the level of image transformation according to the second image processing information. That is, the control unit 170 may determine the optimum level of image transformation in consideration of composite image processing information including, for example, illuminance and screen brightness.
  • step 880 the control unit 170 transforms the image according to the determined level of image transformation.
  • FIGs. 9A and 9B are flowcharts illustrating a display method in an electronic device according to an embodiment of the present invention.
  • the control unit 170 enters an image display mode in response to a user input for image output.
  • the user may initiate image output by selecting a still image (e.g., a photograph in a gallery), a moving image, a gaming image, or a webpage using a web browser.
  • the control unit 170 may enter the image display mode to display images in response to user input.
  • image display mode may be associated with application execution and screen display corresponding to user input.
  • the control unit 170 may examine a state of an image information source (e.g., an illumination sensor) to acquire image processing information (e.g., illuminance) and turn on the image information source if necessary.
  • an image information source e.g., an illumination sensor
  • image processing information e.g., illuminance
  • control unit 170 obtains an image corresponding to a user input (i.e., an image to be displayed on the display unit 131).
  • the control unit 170 may obtain an image from an internal component of the electronic device or an external entity according to user input.
  • the control unit 170 examines image transform settings related to processing the image.
  • the electronic device may provide a user interface for configuring display operation (e.g., image transform options).
  • the user interface may include various setting menus to configure whether to apply image transformation (e.g., activation or deactivation), configure whether to initiate automatic mode or non-automatic mode for image transformation, and configure the level of image transformation.
  • the level of image transformation may be set to a default setting value (e.g., average) provided by the electronic device or to a user setting value entered directly by the user.
  • control unit 170 If the image transform settings indicate a default mode in step 705, the control unit 170 outputs the original image in step 707. That is, the control unit 170 may control the display unit 131 to display the original image without image transformation.
  • the control unit 170 determines image processing information (e.g., illuminance and screen brightness) to be used for image transformation in step 709.
  • image processing information may include environmental information, image attribute information, and user setting information.
  • control unit 170 determines whether to apply image transformation to the image based on the image processing information. For example, the control unit 170 may determine if image transformation is to be performed based on the level of illuminance measured by an illumination sensor and/or a preset level of screen brightness of the display unit 131.
  • control unit 170 Upon determining not to apply image transformation in step 711, the control unit 170 outputs the original image in step 707.
  • the control unit 170 determines the level of image transformation to be applied to the image in step 713. For example, the control unit 170 may determine the level of image transformation according to a contrast ratio mapped with the level of illuminance measured by an illumination sensor. The control unit 170 may raise the level of image transformation when the level of illuminance is high, and may lower the level of image transformation when the level of illuminance is low. That is, the control unit 170 may vary the region to be blacked out in the original image according to levels of illuminance.
  • the control unit 170 may expand the imperceivable region (i.e., the region to be blacked out) in the original image when the level of illuminance is high, and may reduce the imperceivable region in the original image when the level of illuminance is low.
  • the control unit 170 transforms the image according to the determine level of image transformation. For example, the control unit 170 may identify a region to be blacked out in the image based on the level of image transformation determined according to image processing information, and black out the identified region of the image. Specifically, the control unit 170 may transform the image by a large amount (i.e., may black out a larger region of the image) when the electronic device is at an outdoor site with high illuminance, and may transform the image by a small amount (i.e., may black out a smaller region of the image) when the electronic device is at an indoor site with low illuminance. The control unit 170 may adaptively adjust the extent of the blackout region (e.g., the size and number of regions to be blacked out) according to image processing information.
  • the control unit 170 may adaptively adjust the extent of the blackout region (e.g., the size and number of regions to be blacked out) according to image processing information.
  • the control unit 170 displays the transformed image obtained by transforming the image on the display unit 131.
  • the control unit 170 may output the transformed image at the same level of visibility as that of the original image while minimizing current consumption in the region of the image not perceived by the user.
  • control unit 170 determines whether a user adjustment is necessary in non-automatic mode in step 719.
  • the control unit 170 outputs the original image in step 721.
  • the control unit 170 may output an adjustment user interface on the image being displayed on the display unit 131 to enable the user to directly adjust the level of image transformation.
  • the adjustment user interface may be provided in an area of the screen (e.g., an upper area, a middle area, a lower area, a right area, or a left area of the screen).
  • the adjustment user interface may be provided as a horizontal adjustment bar (e.g., a progress bar, a scroll bar, or a slide bar), or as a vertical adjustment bar.
  • control unit 170 transforms the image according to user input (e.g., a drag) through the adjustment user interface.
  • the control unit 170 may expand the region to be blacked out in the image when the user has raised the level of image transformation through the adjustment user interface, and may reduce or remove (no image transformation) the region to be blacked out in the image, when the user has lowered the level of image transformation.
  • step 725 the control unit 170 outputs the transformed image in an adaptive manner. While outputting the transformed image, the control unit 170 may sustain display of the adjustment user interface.
  • step 727 the control unit 170 checks whether user input is released during the display of the transformed image. Release of user input may correspond to detachment of an input means (e.g., a finger or an electronic pen) from the adjustment user interface.
  • an input means e.g., a finger or an electronic pen
  • control unit 170 When user input is released, the control unit 170 removes the adjustment user interface from the screen in step 729. For example, when user input is released during display of the transformed image, the control unit 170 may remove the adjustment user interface from the screen while displaying the transformed image.
  • control unit 170 checks whether preset information is present in relation to the level of image transformation in step 731.
  • control unit 170 identifies the level of image transformation preset by the user in step 733. Thereafter, the method returns to step 715 to transform the image according to the level of image transformation preset by the user.
  • control unit 170 identifies the default level of image transformation in step 735. Thereafter, the method returns to step 715 to transform the image according to the default level of image transformation provided by the electronic device.
  • an electronic device to reduce current consumption while displaying images, while maintaining visibility to a user in consideration of user perception according to image transform information (e.g., illuminance and screen brightness).
  • image transform information e.g., illuminance and screen brightness
  • modules may be realized in software, firmware, hardware or a combination thereof. Some or all modules may be combined into one entity without change in functions of the modules.
  • operations may be executed in sequence, by repetition, or in parallel. Some operations may be omitted or new operations may be added.
  • Various embodiments of the present invention may be implemented as computer programs and may be stored in various computer readable storage media.
  • the computer readable storage media may store program instructions, data files, data structures, and combinations thereof.
  • the program instructions may include instructions developed specifically for the embodiments of the present invention and widely known general-purpose instructions.
  • the computer readable storage media may include magnetic media such as a hard disk and floppy disk, optical media such as a Compact Disc Read Only Memory (CD-ROM) and Digital Versatile Disc (DVD), magneto-optical media such as a floptical disk, and memory devices such as a ROM, RAM and flash memory.
  • the program instructions may include machine codes produced by compilers and high-level language codes executable through interpreters. Each hardware device may be replaced with one or more software modules to perform operations according to the present invention, and vice versa.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Spectroscopy & Molecular Physics (AREA)

Claims (12)

  1. Procédé permettant l'affichage d'une image (210) dans un dispositif d'affichage émissif dont les pixels individuels émettent de la lumière, ledit procédé comprenant :
    l'obtention (601) d'une image (210) à afficher en réponse à une entrée d'utilisateur ;
    la détermination (603) des informations de traitement d'image du dispositif d'affichage émissif comprenant un niveau d'éclairement ambiant et un niveau de luminosité d'écran d'une unité d'affichage (131) du dispositif d'affichage émissif ;
    la détermination (607) d'un niveau de transformation d'image ;
    la transformation (609) de l'image sur la base du niveau de transformation d'image déterminé ; et
    l'affichage (611) de l'image transformée (250) ;
    ladite détermination (607) du niveau de transformation d'image comprenant :
    la division de manière dynamique, selon le niveau d'éclairement ambiant et le niveau de luminosité d'écran de l'unité d'affichage, des luminosités d'image en une plage non perceptible par un utilisateur et une plage perceptible par un utilisateur ; et
    l'identification des pixels dans l'image à afficher dont la luminosité d'entrée est comprise dans la plage imperceptible, lesdits pixels formant une ou plusieurs zones imperceptibles de l'image ; et
    ladite transformation (609) de l'image (210) comprenant l'obscurcissement des pixels de l'image à afficher dans ladite ou lesdites zones imperceptibles en définissant la valeur de luminosité desdits pixels dans ladite ou lesdites zones imperceptibles de l'image à la valeur noir.
  2. Procédé selon la revendication 1, ladite transformation de l'image comprenant la coupure de l'alimentation fournie aux pixels de l'unité d'affichage (131) correspondant à la ou les zones imperceptibles (345).
  3. Procédé selon la revendication 1, ladite détermination (607) du niveau de transformation d'image comprenant en outre :
    l'accroissement de la plage imperceptible avec un niveau d'éclairement ambiant croissant, élargissant ainsi le ou les zones
    imperceptibles (345) à obscurcir ;
    la réduction de la plage imperceptible avec un niveau d'éclairement ambiant de décroissant, réduisant ainsi la ou les zones imperceptibles (345) à obscurcir ;
    l'accroissement de la plage imperceptible avec un niveau de luminosité d'écran décroissant, élargissant ainsi la ou les zones imperceptibles (345) à obscurcir ; et
    la réduction de la plage imperceptible avec un niveau de luminosité d'écran croissant, réduisant ainsi la ou les zones imperceptibles (345) à obscurcir.
  4. Procédé selon la revendication 1, comprenant en outre l'examen des paramètres de transformation d'image liés au traitement de l'image, après l'obtention de l'image ;
    l'affichage (707) de l'image obtenue (210), lorsque les paramètres de transformation d'image indiquent un mode par défaut ;
    la transformation (711) de l'image (210) sur la base des informations de traitement d'image, lorsque les paramètres de transformation d'image indiquent un mode automatique ; et
    la détermination (719) pour savoir si un réglage utilisateur est nécessaire dans un mode qui n'est pas automatique, lorsque les paramètres de transformation d'image indiquent le mode qui n'est pas automatique.
  5. Procédé selon la revendication 4, comprenant en outre la fourniture (721) d'une interface utilisateur de réglage pour permettre le réglage du niveau de transformation de l'image, lorsque le réglage utilisateur est nécessaire dans le mode qui n'est pas automatique,
    ladite transformation de l'image comprenant : la réception d'une entrée d'utilisateur par l'intermédiaire de l'interface utilisateur de réglage ; le réglage du niveau de transformation d'image selon l'entrée d'utilisateur ; la transformation (723) de l'image selon le niveau de transformation d'image réglé ; et
    la suppression (729) de l'interface utilisateur de réglage lorsque l'entrée d'utilisateur est libérée de l'interface utilisateur de réglage.
  6. Procédé selon la revendication 4, comprenant en outre la transformation (733, 735) de l'image (210) selon un niveau de transformation d'image défini par un utilisateur ou par défaut, lorsque le réglage utilisateur n'est pas nécessaire dans le mode qui n'est pas automatique.
  7. Procédé selon la revendication 1, comprenant en outre l'affichage d'une image transformée pré-stockée, lorsqu'une image transformée correspondant à l'image obtenue est pré-stockée, ledit affichage de l'image transformée comprenant :
    la détermination pour savoir si les images transformées correspondant à l'image obtenue sont pré-stockées ;
    la détermination pour savoir si l'une des images transformées pré-stockées correspond aux informations de traitement d'image ; et
    l'affichage de l'image transformée pré-stockée correspondant aux informations de traitement d'image.
  8. Dispositif électronique comprenant :
    une unité d'affichage émissive (131) dont les pixels individuels émettent de la lumière, conçue pour afficher une image (210) ; et
    une unité de commande (170) conçue pour obtenir des informations de traitement d'image à utiliser pour l'affichage de l'image (210), pour transformer l'image (210) sur la base des informations de traitement d'image, et pour afficher l'image transformée (250), ladite unité de commande (170) comprenant :
    un module d'acquisition d'informations (171) conçu pour obtenir les informations de traitement d'image comprenant un niveau d'éclairement ambiant et un niveau de luminosité d'écran de l'unité d'affichage (131) ;
    un module de détermination de transformation (173) conçu pour déterminer un niveau de transformation d'image ; et
    un module de traitement d'image (175) conçu pour transformer l'image (210) selon le niveau de transformation d'image,
    ladite détermination (607) du niveau de transformation d'image comprenant :
    la division de manière dynamique, selon le niveau d'éclairement ambiant et du niveau de luminosité d'écran de l'unité d'affichage (131), de la luminosité d'image d'entrée en une plage qui n'est pas perceptible pour un utilisateur
    et une plage qui est perceptible pour un utilisateur, et
    l'identification des pixels dans l'image à afficher dont la luminosité d'entrée est comprise dans la plage imperceptible, lesdits pixels formant une ou plusieurs zones imperceptibles de l'image ; et
    ladite transformation (609) de l'image (210) comprenant l'obscurcissement des pixels de l'image à afficher dans ladite ou lesdites zones imperceptibles en définissant la valeur de luminosité desdits pixels dans ladite ou lesdites zones imperceptibles de l'image à la valeur noir.
  9. Dispositif électronique selon la revendication 8, ledit module de traitement d'image (175) étant en outre conçu pour
    accroître la plage imperceptible avec un niveau d'éclairement ambiant croissant, élargissant ainsi la ou les zones imperceptibles (345) à obscurcir ;
    réduire la plage imperceptible avec un niveau d'éclairement ambiant décroissant, réduisant ainsi la ou les zones imperceptibles (345) à obscurcir ;
    accroître la plage imperceptible avec un niveau de luminosité d'écran décroissant, élargissant ainsi la ou les zones imperceptibles (345) à obscurcir ; et
    réduire la plage imperceptible avec un niveau de luminosité d'écran croissant, réduisant ainsi la ou les zones imperceptibles (345) à obscurcir.
  10. Dispositif électronique selon la revendication 8, ladite unité de commande (170) étant en outre conçue pour afficher
    l'image (210) dans un mode par défaut,
    transformer l'image (210) sur la base des informations de traitement d'image et afficher l'image transformée (250) dans un mode automatique, et
    transformer l'image (210) selon une entrée d'utilisateur et afficher l'image transformée (250) dans un mode qui n'est pas automatique.
  11. Dispositif électronique selon la revendication 8, ladite unité de commande (170) étant en outre conçue pour trouver une image transformée pré-stockée qui correspond aux informations de traitement d'image, lorsque les images transformées correspondant à l'image sont pré-stockées, et afficher l'image transformée pré-stockée correspondant aux informations de traitement d'image.
  12. Support d'enregistrement lisible par ordinateur possédant, stockées sur celui-ci, des instructions exécutables par ordinateur agencées pour mettre en oeuvre le procédé selon l'une quelconque des revendications 1 à 7.
EP14860962.1A 2013-11-05 2014-11-05 Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant Not-in-force EP3066640B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020130133706A KR102187516B1 (ko) 2013-11-05 2013-11-05 표시 기능을 구비한 전자 장치 및 그 운영 방법
PCT/KR2014/010591 WO2015069023A1 (fr) 2013-11-05 2014-11-05 Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant

Publications (3)

Publication Number Publication Date
EP3066640A1 EP3066640A1 (fr) 2016-09-14
EP3066640A4 EP3066640A4 (fr) 2017-05-03
EP3066640B1 true EP3066640B1 (fr) 2019-04-17

Family

ID=53006728

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14860962.1A Not-in-force EP3066640B1 (fr) 2013-11-05 2014-11-05 Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant

Country Status (4)

Country Link
US (1) US10032404B2 (fr)
EP (1) EP3066640B1 (fr)
KR (1) KR102187516B1 (fr)
WO (1) WO2015069023A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10152947B2 (en) * 2016-04-06 2018-12-11 Microsoft Technology Licensing, Llc Display brightness updating
US10826020B2 (en) * 2018-11-16 2020-11-03 Sharp Kabushiki Kaisha Quantum dot LED structure having optically transparent layer on partially transmitting reflector for enhanced emission
JP2021057737A (ja) * 2019-09-30 2021-04-08 セイコーエプソン株式会社 表示システム、表示制御方法、および、プログラム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7379094B2 (en) * 2002-04-18 2008-05-27 Olympus Corporation Electronic still imaging apparatus and method having function for acquiring synthesis image having wide-dynamic range
US7605828B2 (en) 2004-02-18 2009-10-20 Hewlett-Packard Development Company, L.P. Method and system for reducing gray scale discontinuities in contrast enhancing screens affected by ambient light
JP4736487B2 (ja) 2005-03-22 2011-07-27 株式会社日立製作所 映像処理装置
KR100772913B1 (ko) * 2006-01-27 2007-11-05 삼성전자주식회사 영상 디스플레이 장치 및 방법
US7916218B2 (en) 2006-01-27 2011-03-29 Samsung Electronics Co., Ltd. Image display apparatus and method
TWI479891B (zh) * 2007-06-26 2015-04-01 Apple Inc 動態背光調適
US8284218B2 (en) 2008-05-23 2012-10-09 Semiconductor Energy Laboratory Co., Ltd. Display device controlling luminance
US8514242B2 (en) * 2008-10-24 2013-08-20 Microsoft Corporation Enhanced user interface elements in ambient light
KR101547556B1 (ko) * 2009-02-06 2015-08-26 삼성전자주식회사 이미지 표시 방법 및 장치
US20110074803A1 (en) 2009-09-29 2011-03-31 Louis Joseph Kerofsky Methods and Systems for Ambient-Illumination-Selective Display Backlight Modification and Image Enhancement
TW201126505A (en) 2010-01-20 2011-08-01 Prime View Int Co Ltd Display device for converting between bright and dark states and method thereof
KR101752001B1 (ko) * 2010-11-24 2017-06-28 엘지디스플레이 주식회사 휴대용표시장치의 가독성 향상방법
CA2849902C (fr) * 2011-09-23 2019-02-26 Manufacturing Resources International, Inc. Systeme et procede d'adaptation a l'environnement de caracteristiques d'affichage
KR101079289B1 (ko) * 2011-10-04 2011-11-04 (주)동방데이타테크놀러지 픽셀 라인 단위의 절전이 가능한 ｌｅｄ 전광판

Also Published As

Publication number Publication date
KR20150052448A (ko) 2015-05-14
EP3066640A1 (fr) 2016-09-14
US20150124009A1 (en) 2015-05-07
US10032404B2 (en) 2018-07-24
KR102187516B1 (ko) 2020-12-08
EP3066640A4 (fr) 2017-05-03
WO2015069023A1 (fr) 2015-05-14

Similar Documents

Publication Publication Date Title
US10650790B2 (en) System, apparatus, and method for optimizing viewing experience on an intelligent terminal
US10181305B2 (en) Method of controlling display and electronic device for providing the same
KR102353766B1 (ko) 디스플레이를 제어하는 장치 및 방법
US9712779B2 (en) Image display method and apparatus
EP2990937B1 (fr) Dispositif électronique à porter
AU2013318697B2 (en) Method and apparatus for providing multi-window in touch device
US10635373B2 (en) Display apparatus and method of controlling the same
US8775954B2 (en) Mobile terminal to display a plurality of graphic user interfaces
US9502001B2 (en) Display control method and apparatus for power saving
US20150067590A1 (en) Method and apparatus for sharing objects in electronic device
KR20150049045A (ko) 휴대단말에서 화면 밝기를 제어하는 방법 및 장치
US20170309216A1 (en) Device and method for displaying content
CN103714796A (zh) 用于与照度的变化对应地控制屏幕亮度的方法和设备
CN107210024B (zh) 显示装置及其控制方法
KR20160011915A (ko) 화면 제어 방법 및 이를 사용하는 전자 장치
KR102319286B1 (ko) 드래그 앤 드롭 처리 방법 및 장치
KR20180011651A (ko) 노트와 연관된 사용자 인터페이스 제공 방법 및 이를 구현한 전자 장치
KR20150135911A (ko) Ui 효과 디스플레이 방법 및 전자 장치
EP3066640B1 (fr) Dispositif électronique ayant une fonction d'affichage et procédé de fonctionnement correspondant
KR20150054389A (ko) 어플리케이션 정보를 제공하는 방법 및 장치
EP3298762B1 (fr) Dispositif de terminal d'utilisateur et son procédé de réglage de luminance
CN106796489B (zh) 用于处理电子设备中的显示数据的方法和装置
US20180225261A1 (en) Electronic device and operating method thereof
CN107710147B (zh) 能够控制其亮度的便携式终端及其亮度控制方法
KR20180108182A (ko) 어플리케이션의 표시 비율 변경 방법 및 이를 구현한 전자 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160603

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20170404

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/01 20060101ALI20170329BHEP

Ipc: G06T 3/00 20060101AFI20170329BHEP

Ipc: G09G 3/3225 20160101ALI20170329BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20181107

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014045087

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1122385

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190515

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190417

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190817

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190718

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1122385

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190817

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014045087

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

26N No opposition filed

Effective date: 20200120

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602014045087

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191105

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200603

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141105

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211022

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190417

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221105

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221105