WO2017007220A1 - Dispositif électronique et procédé de commande d'affichage dans un dispositif électronique - Google Patents

Dispositif électronique et procédé de commande d'affichage dans un dispositif électronique Download PDF

Info

Publication number
WO2017007220A1
WO2017007220A1 PCT/KR2016/007267 KR2016007267W WO2017007220A1 WO 2017007220 A1 WO2017007220 A1 WO 2017007220A1 KR 2016007267 W KR2016007267 W KR 2016007267W WO 2017007220 A1 WO2017007220 A1 WO 2017007220A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
sensor
display
processor
brightness
Prior art date
Application number
PCT/KR2016/007267
Other languages
English (en)
Korean (ko)
Inventor
박현희
김성오
김재문
이용만
박경민
박기현
박대근
장슬기
전형주
최종범
김광태
김수형
염동현
이기혁
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020160064994A external-priority patent/KR102565847B1/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to US15/741,632 priority Critical patent/US20180218710A1/en
Priority to CN201680040173.3A priority patent/CN107851422A/zh
Publication of WO2017007220A1 publication Critical patent/WO2017007220A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed

Definitions

  • Various embodiments of the present disclosure relate to a method and an apparatus for controlling a property of a display related to display of content in a electronic device or a property of the displayed content.
  • an electronic device including: a display configured to display content in a direction corresponding to a first surface of the electronic device; A sensor for detecting light incident on the second surface of the electronic device; And a processor, wherein the processor is configured to determine brightness information of the periphery of the electronic device based at least on the sensed light, and based at least on the brightness information, at least one attribute of the display or It may be set to adjust at least one property of the content.
  • FIGS. 8A and 8B are perspective views illustrating an electronic device in which sensors are disposed according to various embodiments of the present disclosure.
  • FIG. 11 is a diagram illustrating detailed blocks of an image signal processor according to various embodiments of the present disclosure.
  • FIG. 13 is a block diagram illustrating a configuration of an image processing apparatus according to various embodiments of the present disclosure.
  • 17 is a block diagram illustrating a program module according to various embodiments of the present disclosure.
  • expressions such as “have”, “may have”, “include”, or “may contain” include the presence of a corresponding feature (e.g., numerical, functional, operational, or component such as a component). Does not exclude the presence of additional features.
  • Expressions such as “first,” “second,” “first,” or “second,” used in various embodiments may modify various elements in any order and / or importance, and may modify the elements. It is not limited. The above expressions may be used to distinguish one component from another.
  • the first user device and the second user device may represent different user devices regardless of the order or importance.
  • the first component may be referred to as a second component, and similarly, the second component may be renamed to the first component.
  • the expression “configured to” used in this document is, for example, “suitable for”, “having the capacity to” depending on the situation. It may be used interchangeably with “designed to”, “adapted to”, “made to”, or “capable of”.
  • the term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “device configured to” may mean that the device “can” along with other devices or components.
  • the phrase “processor configured (or set up) to perform A, B, and C” may execute a dedicated processor (eg, an embedded processor) to perform the operation, or one or more software programs stored in a memory device. By doing so, it may mean a general-purpose processor (for example, a CPU or an application processor) capable of performing the corresponding operations.
  • the electronic device may be a smart home appliance.
  • Smart home appliances are, for example, televisions, digital video disk (DVD) players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, home automation Home automation control panel, security control panel, TV box (e.g. Samsung HomeSync TM, Apple TV TM, or Google TV TM), game console (e.g. Xbox TM, PlayStation TM), electronics It may include at least one of a dictionary, an electronic key, a camcorder, or an electronic picture frame.
  • DVD digital video disk
  • an electronic device may be a furniture or part of a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, or radio wave measuring instrument).
  • the electronic device may be one or a combination of the aforementioned various devices.
  • An electronic device according to an embodiment may be a flexible electronic device.
  • the electronic device according to an embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technology development.
  • white balance may mean a distribution of colors, and for example, may mean a numerical representation of a distribution of R, G, or B values. .
  • the white balance may be calculated from an RGB histogram sensed by the image sensor.
  • the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.
  • the bus 110 may include, for example, circuits for connecting the components 110 to 192 to each other and transferring communication (eg, control messages and / or data) between the components. .
  • the processor 120 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).
  • the processor 120 may execute, for example, an operation or data processing related to control and / or communication of at least one other element of the electronic device 101.
  • the input / output interface 150 may serve as, for example, an interface capable of transferring a command or data input from a user or another external device to other component (s) of the electronic device 101.
  • the input / output interface 150 may output a command or data received from other component (s) of the electronic device 101 to a user or another external device.
  • the display 160 is a means for adjusting and displaying an attribute (eg, luminance, saturation, or color) of a screen provided to a user according to various embodiments of the present disclosure.
  • the display 160 may be a liquid crystal display (LCD).
  • LCD liquid crystal display
  • LED Light emitting diode
  • OLED organic light emitting diode
  • MEMS microelectromechanical systems
  • the display 160 may display, for example, various contents (for example, text, an image, a video, an icon, a symbol, etc.) to a user.
  • the display 160 may include a touch screen.
  • the display 160 may receive a touch, gesture, proximity, or hovering input using an electronic pen or a part of a user's body.
  • the communication interface 170 may, for example, communicate between the electronic device 101 and an external device (eg, the first external electronic device 102, the second external electronic device 104, or the server 106). Can be set.
  • the communication interface 170 may be connected to the network 162 through wireless or wired communication to communicate with the external device (eg, the second external electronic device 104 or the server 106).
  • the communication interface 170 may directly communicate with the external device (eg, the first external electronic device 102) through, for example, wireless communication or wired communication.
  • the first external electronic device 102 may be a wearable device.
  • the smartphone and the wearable device may communicate with each other to transmit and receive information related to an electronic map.
  • Wireless communication is, for example, a cellular communication protocol, for example, long-term evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), UMTS (universal).
  • LTE long-term evolution
  • LTE-A LTE Advance
  • CDMA code division multiple access
  • WCDMA wideband CDMA
  • UMTS universal
  • WBro mobile telecommunications system
  • WiBro wireless broadband
  • GSM global system for mobile communications
  • wireless communication may include, for example, near field communication 164.
  • the local area communication 164 may include, for example, at least one of wireless fidelity (WiFi), Bluetooth, near field communication (NFC), global navigation satellite system (GNSS), and the like.
  • WiFi wireless fidelity
  • NFC near field communication
  • GNSS global navigation satellite system
  • Each of the first and second external electronic devices 102 and 104 may be a device of the same or different type as the electronic device 101.
  • the server 106 may include a group of one or more servers.
  • all or part of operations executed in the electronic device 101 may be executed in another or a plurality of electronic devices (for example, the electronic devices 102 and 104 or the server 106).
  • the electronic device 101 when the electronic device 101 needs to perform a function or service automatically or by request, the electronic device 101 instead of executing the function or the service by itself or Additionally, at least some functions associated with the request may be requested to another device (eg, the electronic device 102 or 104 or the server 106).
  • the server 106 drives the electronic device 101 by performing at least one operation (or function) among operations (or functions) implemented in the electronic device 101.
  • the server 106 may include a display control server module (not shown) capable of supporting the display control module 180 implemented in the electronic device 101.
  • the display control server module may include at least one component of the display control module 180 to perform (or at least one of the operations (or functions) the display control module 180 performs. You can also act.
  • the server 106 may be an image editing function providing server capable of providing various image editing related functions to the electronic device 101.
  • the display control module 180 may be obtained from, for example, other components (eg, the processor 120, the memory 130, the input / output interface 150, the communication interface 170, etc.). At least some of the information may be processed and provided to the user in various ways.
  • the illuminance sensor 191 is, for example, a sensor capable of sensing a value related to brightness, and is not limited to a sensor of a specific name, but may be of any type capable of determining a value related to the brightness by sensing.
  • the sensor may also be included in the illuminance sensor according to the embodiment of the present invention.
  • the storage unit 240 may include, for example, color information 241 or brightness information, luminance information 242, chroma information 243, and display adjustment mapping table 244 information for each pixel.
  • Information stored in the storage 240 may be provided from an electronic device (eg, a server or another electronic device) external to the electronic device 200.
  • the storage unit 240 may further store various information related to the control of the display.
  • the adjustment situation determination unit 221 of the control unit 220 may be an attribute (eg, luminance or saturation or color) of the display unit 210 (eg, the display 160), or content displayed through the display unit 210. It is possible to determine whether to adjust the attributes (eg luminance or saturation or color) of the. For example, the adjustment situation determination unit 221 may display an attribute (eg, luminance or saturation or color) of the display 160 or an attribute (eg, luminance or saturation or color) of the content displayed through the display unit 210. It is determined whether a predetermined condition is satisfied in order to adjust the value, and when the condition is satisfied, the luminance determining unit 223 or the color determining unit 224 of the control unit 220 controls the at least one illuminance sensor 261 and 262.
  • the luminance determining unit 223 or the color determining unit 224 of the control unit 220 controls the at least one illuminance sensor 261 and 262.
  • the luminance or saturation or color of the content displayed on the screen or the screen may be periodically adjusted.
  • the second illuminance sensor 262 or the second image sensor 272 disposed on one surface (eg, the rear surface) of the electronic device 200 may be operated at regular time intervals so that one surface (eg, the rear surface) of the electronic device 200 is operated.
  • the brightness information of the can be sensed.
  • the luminance or saturation or color of the content displayed on the screen or the screen may be adjusted.
  • the luminance or saturation or color of the content displayed on the screen or the screen may be adjusted.
  • various motion detection sensors eg, a gyro sensor, an acceleration sensor, etc.
  • the brightness or saturation or color of the content displayed on the screen or the screen may be implemented.
  • a user of the electronic device 200 moves from the inside of the building to the outside or moves from the outside of the building to the inside, a significant change in brightness occurs immediately. It can be implemented to adjust the luminance or saturation or color.
  • a sensor provided on one surface eg, a rear surface
  • the second illuminance sensor 262 or the second image sensor 272 is used to adjust the brightness or saturation or color of the screen or the content displayed on the screen so that the user responds to a sudden change in ambient brightness.
  • the display unit 210 may control an attribute (eg, luminance or saturation or color) displayed on the screen or the content displayed on the screen.
  • the first sensor may be an illuminance sensor
  • the second sensor may be an image sensor
  • the apparatus may further include an image signal processor configured to receive a color value of each pixel sensed by the second sensor to process an image signal, and transmit the image signal processed result to the controller.
  • the image signal processor includes a plurality of functional blocks, and if the controller satisfies a preset condition for determining the brightness of the display, at least one functional block among the plurality of functional blocks. Can be turned off.
  • the image signal processor includes a plurality of functional blocks connected to each other in a pipeline form, and when the controller satisfies a preset condition for determining the brightness of the display, the plurality of functional blocks At least one of the functional blocks may be bypassed.
  • the apparatus may further include an image preprocessing module provided between the second sensor and the image signal processing unit, and if the control unit satisfies a preset condition for determining the brightness of the display, the image preprocessing module At least one functional block of the plurality of functional blocks included in may be turned off.
  • the controller may determine whether the controller satisfies a preset condition for determining the brightness of the display, and when the preset condition is satisfied, the controller determines from the first sensor or the second sensor.
  • the received data can be processed.
  • the movement of the electronic device when the display is in an on state, when the display is switched from an off state to an on state, and when a predetermined period is satisfied, the movement of the electronic device may occur.
  • the degree of movement of the electronic device when it occurs, when the degree of movement of the electronic device is out of a predetermined threshold value, when it is determined that the user of the electronic device moves from the inside of the building to the outside or from the outside of the building to the inside, when a significant change in brightness is expected, when the cover of the electronic device is covered and the first sensor or the second sensor is covered by the cover, and when a predetermined event occurs while the cover is covered It may include any one of.
  • An electronic device may include a display for displaying content in a direction corresponding to a first surface of the electronic device; A sensor for detecting light incident on the second surface of the electronic device; And a processor, wherein the processor is configured to determine brightness information of the periphery of the electronic device based at least on the sensed light, and based at least on the brightness information, at least one attribute of the display or It may be set to adjust at least one property of the content.
  • the apparatus may further include another sensor for detecting light incident on the first surface, and the processor may further include another processor determined based on light detected through the other sensor.
  • the processor may further include another processor determined based on light detected through the other sensor.
  • the apparatus may further include another sensor for detecting light incident on the first surface, and the processor may further include another processor determined based on light detected through the other sensor.
  • the adjusting may be performed based on brightness information.
  • the apparatus may further include an image signal processor including a first functional block and a second functional block to process the light obtained from the sensor, and the processor may further include the first functional block. And selecting a function block related to the brightness information from the second function block, and performing the determining operation using the selected function block.
  • the processor may be configured to select one or more pixels having the lowest number among the plurality of pixels as the designated pixel.
  • the processor may be set to determine the brightness information based on color information corresponding to the light.
  • the processor may be set to determine the brightness information based on the time information of the sensor exposed to the light.
  • the electronic device may further include a housing forming at least a portion of an external surface of the electronic device, and the sensor may constitute at least a portion of the housing. .
  • the senor may be located between the display and the housing.
  • the electronic device may further include an image preprocessing module between the sensor and the processor, and when the preset condition for determining the brightness of the display is satisfied by the processor, the electronic device may be configured to the image preprocessing module. At least one functional block of the plurality of included functional blocks may be turned off.
  • FIG 3 is a flowchart illustrating a procedure of controlling a display (for example, the display 160) in an electronic device (for example, the processor 120 or the display control module 180) according to various embodiments of the present disclosure.
  • the electronic device may display content by, for example, a display (eg, the display 160) provided on the first surface of the electronic device.
  • a display eg, the display 160
  • light incident by the sensor provided on the second surface of the electronic device may be detected.
  • the electronic device may determine ambient brightness information of the electronic device based at least on the detected light.
  • the electronic device may determine at least one property of the display of the electronic device or at least one property (eg, luminance or saturation or color) of the content, based at least on the brightness information.
  • 4A is a flowchart illustrating a procedure of controlling luminance or color of a display (eg, display 160) in an electronic device (eg, the processor 120 or the display control module 180) according to various embodiments of the present disclosure. to be.
  • a display eg, display 160
  • an electronic device eg, the processor 120 or the display control module 180
  • the electronic device may determine, for example, whether a display adjustment situation is performed.
  • the electronic device may determine whether the display unit is turned on, the display unit is turned on, or periodically, whether the display is adjusted.
  • the electronic device is provided in the electronic device when a movement of the electronic device occurs, when a user of the electronic device moves from the inside of the building to the outside or moves from the outside of the building to the inside to cause a momentary change in brightness.
  • a specific event occurs while the at least one sensor is covered by the cover of the electronic device, when the reproduction of the virtual reality content through the electronic device is ended, it may be determined as a display adjustment situation.
  • the electronic device when it corresponds to the display adjustment situation, the electronic device (eg, the processor 120) may perform operation 404, for example.
  • the electronic device may determine the illuminance or the white balance from the value sensed by the first sensor.
  • the electronic device eg. the processor 120 may perform operation 402, for example.
  • the electronic device may check or determine the illuminance or the white balance, for example, from the value sensed by the second sensor.
  • the first sensor and the second sensor may be disposed on the same plane of the electronic device or may be disposed on different planes (eg, front or rear).
  • the first sensor and the second sensor may be the same type of sensor (eg, the first sensor and the second sensor are an illuminance sensor or an image sensor), and different types (eg, the first sensor are the illuminance sensor and the second sensor).
  • the sensor may be an image sensor or a first sensor may be an image sensor and the second sensor may be a sensor of an illuminance sensor.
  • the electronic device may display a property of the display (eg, the display 160) or the content displayed through the display based on the illuminance or the white balance determined by the values sensed by the first sensor and the second sensor. Judgment, determination or adjustment can be made.
  • the attribute may include, for example, luminance or saturation or color of a screen. Detailed embodiments thereof will be described later.
  • FIG. 4B is a flowchart illustrating a procedure of controlling the brightness of a display (eg, the display 160) in an electronic device (eg, the processor 120 or the display control module 180) according to various embodiments of the present disclosure.
  • the electronic device eg, the processor 120
  • the electronic device may determine, for example, whether a display adjustment is performed.
  • the electronic device may determine whether the display unit is turned on, the display unit is turned on, or periodically, in a display adjustment situation.
  • the electronic device is provided in the electronic device when a movement of the electronic device occurs, when a user of the electronic device moves from the inside of the building to the outside or moves from the outside of the building to the inside to cause a momentary change in brightness.
  • a specific event occurs while the at least one sensor is covered by the cover of the electronic device, when the reproduction of the virtual reality content through the electronic device is ended, it may be determined as a display adjustment situation.
  • the electronic device may perform operation 414, for example.
  • the electronic device may determine the brightness of the display from the value sensed by the first sensor. For example, the electronic device may identify or determine the illuminance or the white balance from the value sensed by the first sensor, and determine or determine the luminance to be applied to the content to be displayed through the display or the display from the determined illuminance or the white balance.
  • the electronic device may determine the brightness of the display from the value sensed by the second sensor. For example, the electronic device may check or determine the illuminance or the white balance from the value sensed by the second sensor, and determine or determine the luminance to be applied to the content to be displayed through the display or the display from the determined illuminance or the white balance.
  • the first sensor and the second sensor may be disposed on the same plane of the electronic device or may be disposed on different planes (eg, front or rear). Further, the first sensor and the second sensor may be sensors of the same type or may be sensors of different types (eg, the first sensor is an illuminance sensor and the second sensor is an image sensor).
  • the electronic device eg. the processor 120 may perform operation 412, for example.
  • 5A is a flowchart illustrating a procedure of controlling saturation of a display (eg, display 160) in an electronic device (eg, the processor 120 or the display control module 180) according to various embodiments of the present disclosure.
  • the electronic device eg, the processor 120
  • the electronic device may determine, for example, whether a display adjustment is in progress.
  • the electronic device may determine whether the display is turned on or turned on, or periodically, whether the display is adjusted.
  • the electronic device is provided in the electronic device when a movement of the electronic device occurs, when a user of the electronic device moves from the inside of the building to the outside or moves from the outside of the building to the inside to cause a momentary change in brightness.
  • a specific event occurs while the at least one sensor is covered by the cover of the electronic device, when the reproduction of the virtual reality content through the electronic device is ended, it may be determined as a display adjustment situation.
  • the electronic device when it corresponds to the display adjustment situation, the electronic device (eg, the processor 120) may perform operation 504, for example.
  • the electronic device may check or determine the white balance from the value sensed by the first sensor.
  • the white balance may be checked or determined from the value sensed by the second sensor.
  • the electronic device eg. the processor 120 may perform operation 502, for example.
  • the electronic device displays a display based on the white balance checked or determined from the value sensed by the first sensor and the white balance checked or determined from the value sensed by the second sensor (eg, the display 160).
  • the saturation or color of the content displayed on the display may be determined, determined, or adjusted.
  • the electronic device may determine whether the display unit is turned on, the display unit is turned on, or periodically, whether the display is adjusted.
  • the electronic device is provided in the electronic device when a movement of the electronic device occurs, when a user of the electronic device moves from the inside of the building to the outside or moves from the outside of the building to the inside to cause a momentary change in brightness.
  • a specific event occurs while the at least one sensor is covered by the cover of the electronic device, when the reproduction of the virtual reality content through the electronic device is ended, it may be determined as a display adjustment situation.
  • the electronic device eg, the processor 120 may perform operation 512, for example.
  • the display brightness is adjusted when there is a large difference in brightness between the front and rear surroundings based on the display.
  • a user may use the electronic device in a backlight environment such that a rear surface of the electronic device faces a window corresponding to a light source that is much brighter than the room in a dark room.
  • the illumination sensor provided on the display surface of the electronic device measures the illumination in the direction toward the user, and the brightness of the display adjusted according to the illumination value is in the state where the user's gaze faces the bright window. May not provide enough brightness to use.
  • FIG. 6A illustrates a luminance of a display (eg, the display 160) when the electronic device (eg, the processor 120 or the display control module 180) is in a backlight environment in an automatic brightness operation state according to various embodiments of the present disclosure. It is a flowchart showing the procedure for controlling the.
  • the electronic device may determine whether the display auto brightness is turned on. That is, it is determined whether the automatic brightness function of the electronic device for automatically adjusting the brightness of the display is on. In this case, when the display auto brightness function is not turned on, operation 602 may be performed again.
  • the auto-brightness function is a state in which the brightness of the display is adjusted using an illuminance sensor provided on the front of the electronic device.
  • the electronic device may determine whether the rear camera is turned on in operation 604.
  • the rear camera may be an image sensor disposed on the rear of the electronic device. If the rear camera is turned on, the electronic device may sense a brightness value (BV) in operation 606. For example, the electronic device may obtain an RGB histogram based on the data acquired through the image sensor, and then obtain a brightness value based on the histogram. Subsequently, the electronic device may determine whether the brightness value sensed in operation 608 is equal to or greater than the threshold brightness value.
  • the threshold brightness value may be a predetermined threshold value corresponding to a backlight situation. According to an embodiment of the present disclosure, the backlight situation may be determined based on a brightness value sensed once or a brightness value sensed more than a predetermined number of times.
  • the electronic device When the sensed brightness value is greater than or equal to the threshold brightness value, it may be regarded as a backlight situation. If the sensed brightness value is greater than or equal to the threshold brightness value, the electronic device increases the brightness of the display based on the sensed brightness value in operation 610. Can be. As described above, the electronic device automatically adjusts the brightness of the display using the illumination sensor, that is, the brightness of the display is adjusted according to the sensing value of the illumination sensor while the brightness measurement value using the rear camera is higher than a threshold brightness value corresponding to backlight. In addition, after increasing the brightness of the display, an automatic brightness operation of the display may be performed. According to an embodiment of the present disclosure, an increase in brightness of the display may be determined according to a difference between the sensed brightness value and the threshold brightness value.
  • the case where the camera disposed on the rear side of the electronic device is turned on is described as an example.
  • the automatic brightness operation is performed by additionally using at least one sensor turned on. It may be implemented.
  • the electronic device performs the display brightness using the illuminance sensor and performs the display brightness using the sensing value of the rear camera as an example.
  • the sensing value of the rear camera may also be used, which will be described in detail with reference to FIG. 6B.
  • FIG. 6B illustrates luminance of a display (eg, the display 160) by using an illumination sensor and an image sensor in an electronic device (eg, the processor 120 or the display control module 180) according to various embodiments of the present disclosure.
  • a flow chart showing the procedure for controlling.
  • the electronic device may determine whether the display auto brightness is turned on. In this case, when the display auto brightness function is not turned on, operation 612 may be performed again. If the automatic display brightness is turned on in operation 612, the electronic device may determine whether the rear camera is turned on in operation 614.
  • the rear camera may be an image sensor disposed at the rear of the electronic device.
  • the electronic device may sense a brightness value (BV) using the rear camera in operation 616. Subsequently, in operation 618, the electronic device may convert the brightness value into an illuminance value.
  • BV brightness value
  • the electronic device may determine the display brightness to be adjusted using the sensor value of the illuminance sensor provided on the front of the electronic device and the converted illuminance value. have. That is, the electronic device may calculate how much brightness is adjusted by using the sensor value of the illuminance sensor and the sensor value of the rear camera together. In this case, in order to determine how much the brightness is to be adjusted, a predetermined table value, a predetermined function, etc., which maps an illumination value (eg, the converted illumination value and a sensor value of the illumination sensor) and the brightness adjustment range, may be used. Accordingly, in operation 622, the electronic device may set the display luminance according to the display luminance determined in operation 620.
  • the electronic device may operate in a virtual reality (VR) mode, and in operation 704, VR-related content may be played.
  • VR virtual reality
  • the user may be in a relatively dark state because the user is disconnected from the external environment in the VR mode.
  • the VR mode is terminated, the user's eyes may not be able to adapt as the light is instantly switched to the bright state.
  • the remaining time until the time at which playback of the VR-related content ends or the ratio of remaining time to total time may be determined.
  • the remaining time or the ratio of the remaining time to the total time is less than or equal to a preset threshold Tr, in operation 710, the brightness, saturation, or color of the display may be adjusted.
  • the rear information of the electronic device may be overlaid and displayed on the screen as illustrated in FIG. 18 so as to be adapted to a sudden environmental change.
  • the overlaid backside information may be set to become gradually brighter as the end point of the VR-related content approaches.
  • At least one of the operations illustrated in FIGS. 3 to 7 may be omitted, and at least one other operation may be added between the operations.
  • the operations of FIGS. 3 to 7 may be processed in the order shown, and the execution order of at least one operation may be changed from the execution order of other operations.
  • 3 to 7 may be performed in an electronic device or may be performed in a server.
  • at least one of the operations illustrated in FIGS. 3 to 7 may be performed in the electronic device, and the remaining operations may be implemented in the server.
  • a method of operating an electronic device may include: displaying content by a display provided on a first surface of the electronic device; Sensing light incident by a sensor provided on a second surface of the electronic device; Determining brightness information around the electronic device based on at least the sensed light; And adjusting at least one property of the display or at least one property of the content based at least on the brightness information.
  • the determination may be performed. To perform the operation.
  • the adjusting may be further performed based on another brightness information determined based on light detected by another sensor for detecting light incident on the first surface. Can be done.
  • the preset condition may include display state information of the electronic device, information related to the movement of the electronic device, information about the surrounding environment of the electronic device, and information related to a cover attached to the electronic device. It may be determined based on at least one of.
  • the touch screen 890 may be disposed at the center of the front surface of the electronic device 800.
  • the touch screen 890 may be large so as to occupy most of the front surface of the device 800.
  • 8A illustrates an example in which a main home screen is displayed on the touch screen 890.
  • the main home screen may include the first screen displayed on the touch screen 890 when the device 800 is turned on.
  • the main home screen may be the first home screen of the home pages of the several pages.
  • the home screen may display shortcut icons 871a, 871b, and 871c, a main menu switch key 871d, a time, and a weather 870 for executing frequently used applications.
  • the main menu switch key 871d displays a menu screen on the touch screen 890.
  • a status bar may be formed at the top of the touch screen 890 to display the status of the device 800 such as a battery charging status, a received signal strength, and a current time.
  • a home button 861a, a menu button 861b, and a back button 861c may be formed below the touch screen 890.
  • Menu button 861b provides a connection menu that can be used on touch screen 890.
  • the connection menu may include a widget adding menu, a background screen changing menu, a search menu, an editing menu, an environment setting menu, and the like.
  • the back button 861c may display a screen that was executed immediately before the currently running screen or terminate the most recently used application.
  • the first camera 866 (eg, the first image sensor), the illuminance sensor 864, and / or the proximity sensor may be disposed at the front edge of the electronic device 800.
  • a second camera 852 (eg, a second image sensor), a flash 853, and a speaker 863 may be disposed on the rear surface 800c of the device 800.
  • the electronic device 800 may include a housing that forms at least a portion of an external surface of the electronic device, and includes at least one sensor (eg, a first camera 866). ), A second camera 852, an illumination sensor 864, a proximity sensor, etc. may constitute at least a part of the housing.
  • at least one sensor eg, a first camera 866.
  • a second camera 852, an illumination sensor 864, a proximity sensor, etc. may constitute at least a part of the housing.
  • the senor may be located between the display and the housing.
  • one camera is disposed on the front and the rear of the electronic device 800, and one illuminance sensor is disposed on the front, but according to various embodiments of the present disclosure. Accordingly, the number and / or arrangement position of the image sensor or the illuminance sensor may be variously modified.
  • the electronic device may have a wrap-around form, a full front display form (for example, a front surface configured as a display and no bezel or minimized form), and a transparent device. It may be implemented in various forms, such as, various embodiments of the present invention is not limited to a specific form of the electronic device.
  • an image processing apparatus may include an image sensor module 910, an image preprocessing module 920 (eg, a companion chip), and an application processor (AP) 930. It can be configured to include.
  • the image processing apparatus may be implemented to be directly connected to the application processor 930 from the image sensor module 910 without the image preprocessing module 920.
  • the image preprocessing module 920 may be further configured, for example, to support a specific function of the image sensor.
  • the image preprocessing module 920 may perform preprocessing to improve image quality, a detailed example of which will be described later with reference to FIG. 10.
  • the application processor 930 may include, for example, an image signal processor 931 (ISP; image signal processor) and a main processor (CPU) 932.
  • the image signal processor 931 may include, for example, a Bayer processor 931a and / or a color processor 931b (Luma / Color).
  • the Bayer processor 931a or the color processor 931b may have a plurality of processing blocks in the form of a pipeline for each processing function as shown.
  • FIG. 11 A detailed implementation example of the image signal processor 931 is illustrated in FIG. 11.
  • a processing block related to the data acquisition is performed among a plurality of blocks constituting an internal pipeline of the image signal processor ( on, the remaining unrelated processing blocks can be turned off or bypassed on the pipeline.
  • the block indicated by the solid line of the plurality of blocks constituting the Bayer processor 931a may be operated, and the block indicated by the dotted line may be turned off or bypassed.
  • the block indicated by the solid line among the plurality of blocks constituting the color processor 931b may be operated, and the block indicated by the dotted line may be turned off or bypassed.
  • the value acquired or output by the Bayer processor 931a may include an accumulated pixel value (eg, an RGB pixel accumulation value) or an RGB histogram.
  • the color processor 931b may perform a function of processing brightness or color of the sensed image.
  • only the processing block related to the data acquisition is turned on among the plurality of blocks constituting the internal pipeline of the image preprocessing module 920 in the image preprocessing module 920. And other unrelated processing blocks can be turned off or bypassed on the pipeline. A detailed example thereof will be described later with reference to FIG. 10.
  • the electronic device may transmit high-speed data communication (for example, pixel information) from the image sensor module 910 to the image preprocessing module 920.
  • MIPI can be turned off and only the control signal line (eg, SPI) can be implemented.
  • information obtained from the ISP 931 of the AP 930 may be stored in a memory (eg, the storage 240).
  • the CPU 932 may calculate backside information using the result stored in the memory.
  • the above-described image preprocessing module of FIG. 9 may include a differential pulse code modulation (DPCM) canceling unit 1010, a pixel value adding unit 1020, a cutting unit 1030, a gamma value processing unit 1040, and a binning correction unit. 1050, the DPCM compression unit 1060 may include at least one. As described above, in order to obtain a value related to brightness by information obtained from an image sensor, only at least some blocks of a plurality of blocks of the image preprocessing module may be used.
  • DPCM differential pulse code modulation
  • the DPCM canceling unit 1010 and the pixel value summing unit 1020 are turned on, and the cutting unit 1030, the gamma value processing unit 1040, the binning correction unit 1050, and the DPCM compression unit 1060 are turned off. It can be bypassed.
  • FIG. 11 is a diagram illustrating detailed blocks of an image signal processor 931 according to various embodiments of the present disclosure.
  • an image signal processing unit eg, a Defective Pixel Correction unit (DPC), a Color Filter Array Interpolation unit (CFA), and an STATS unit (image statistics unit) for the YCC
  • DPC Defective Pixel Correction unit
  • CFA Color Filter Array Interpolation unit
  • STATS unit image statistics unit
  • YCC image signal processing unit
  • the CCM unit is a module for correcting a color variation of an image caused by an optical reason, an illumination variable, a color filter characteristic of a sensor, etc.
  • the gamma unit is a module for correcting a gamma value
  • the enhancement unit reduces noise. It is a module to improve edge.
  • the MANR unit is a module for adaptively reducing noise according to the movement
  • the CSC unit is a module for converting the color space
  • the CR unit for converting the YcbCr input to the desired chroma sub-sampling format (sub-sampling) format Module.
  • the configuration of the image signal module unit illustrated in FIG. 11 is an example of an image signal module unit to which an embodiment of the present invention can be applied, and embodiments of the present invention may be applied to variously configured image signal module units.
  • at least one processing block eg, a module or a component
  • the plurality of detailed processing blocks constituting the image signal module unit may be turned off or bypassed.
  • an image processing apparatus includes an image sensor module 1210, an image preprocessing module 1220 (eg, companion chip), and an application processor (AP) 1230. Can be.
  • the image processing apparatus may be implemented to be directly connected to the application processor 1230 from the image sensor module 1210 without the image preprocessing module 1220.
  • the image preprocessing module 1220 may be further configured to support a specific function of the image sensor. For example, the image preprocessing module 1220 may perform preprocessing to improve image quality.
  • the application processor 1230 may include an image signal processor 1231 (ISP) and a main processor (CPU) 1232.
  • the image signal processor 1231 may include a Bayer processor 1231a and a color processor 1231b (Luma / Color).
  • the Bayer processor 1231a or the color processor 1231b may have a plurality of processing blocks in a pipeline form for each processing function as shown.
  • a detailed implementation example of the image signal processor 1231 is illustrated in FIG. 11. Since the basic functions of the above components have been described above with reference to FIG. 9, repeated descriptions thereof will be omitted.
  • the image preprocessing module 1220 may obtain data related to the brightness from the Bayer processor 1231a of the application processor (AP) 1230.
  • the image preprocessing module 1220 may extract a Bayer histogram from the Bayer processor 1231a and directly transfer the Bayer histogram to the main processor (CPU) 1232 of the application processor (AP) 1230.
  • the image preprocessing module 1220 extracts a Bayer histogram from the Bayer processing unit 1231a and calculates data related to brightness or white balance using the extracted Bayer histogram. The result may be transferred to the main processor (CPU) 1232 of the application processor (AP) 1230.
  • At least some of the blocks included in the ISP 1231 of the AP 1230 may be turned off to reduce power consumption. Can be.
  • the electronic device may transmit pixel information from the image sensor module 1210 to the image preprocessing module 1220.
  • High speed data communication eg, MIPI
  • MIPI High speed data communication
  • SPI control signal lines
  • information obtained from the ISP 1231 of the AP 1230 may be stored in the memory (eg, the storage unit 240).
  • the CPU 1232 may calculate backside information using the result stored in the memory.
  • the information obtained from the ISP 1231 of the AP 1230 is stored in a memory, only relevant blocks of pipelines inside the ISP 1231 are operated to reduce power consumption, and the remaining blocks are turned off or bypassed. Can be.
  • the main processor (CPU) 1232 of the application processor (AP) 1230 may calculate or process data related to brightness based on information transmitted from the image preprocessing module 1220.
  • the image sensor module 1310 is a module for sensing an image and may transmit each pixel value sensed through a MIPI line to the image preprocessing module 1320 or the application processor 1330. In addition, the image sensor module 1310 may transmit and receive various control signals through SPI or I2C.
  • the image sensor module 1310 may be implemented to include an image sensor 1311 (eg, a CMOS sensor) and control logic 1312.
  • the image preprocessing module 1320 may be further configured to support a specific function of the image sensor. For example, the image preprocessing module 1320 may perform preprocessing to improve image quality.
  • the application processor 1330 may include an image signal processor 1331 (ISP) and a main processor (CPU) 1332.
  • the image signal processor 1331 may include a Bayer processor 1331a and a color processor 1331b (Luma / Color).
  • the Bayer processor 1331a or the color processor 1331b may have a plurality of processing blocks in the form of a pipeline for each processing function as shown.
  • FIG. 11 Since the basic functions of the above components have been described above with reference to FIGS. 9 and 13, repeated descriptions thereof will be omitted.
  • the image processing apparatus may obtain desired information by operating only at least some functional blocks of the image preprocessing module 1320.
  • the high-speed data communication line eg, MIPI
  • the control line eg, SPI or I2C
  • the DPCM canceling unit 1010 and the pixel value summing unit 1020 are turned on and the cutting unit 1030 is turned on.
  • the gamma value processing unit 1040, the binning correction unit 1050, and the DPCM compression unit 1060 may be turned off or bypassed.
  • an image processing apparatus includes an image sensor module 1410, an image preprocessing module 1420 (eg, a companion chip), and an application processor (AP) 1430. Can be.
  • the image processing apparatus may be implemented to be directly connected to the application processor 1430 from the image sensor module 1410 without the image preprocessing module 1420.
  • the image sensor module 1410 senses an image by the image sensor 1411 and data related to brightness from information sensed by the image sensor 1411 directly by the control logic 1412. Alternatively, information such as white balance may be generated.
  • the application processor (AP) 1430 may include an image signal processor 1431 (ISP) and a main processor (CPU) 1432.
  • the image signal processor 1431 may include a Bayer processor 1431a and a color processor 1431b (Luma / Color). Since the basic functions of the above components have been described above with reference to FIGS. 9 and 13, repeated descriptions thereof will be omitted.
  • At least some functions of the image preprocessing module 1420 and the ISP 1431 may be turned off to reduce power consumption. Also, for example. Functional blocks other than the image sensor, such as actuators, optical image stabilization (OIS), and the like, of the image sensor module 1410 may be turned off or bypassed. In addition, according to various embodiments of the present disclosure, only some scan lines of the image sensor module 1410 may be driven as shown in FIGS. 15A and 15B to reduce power consumption.
  • OIS optical image stabilization
  • the image sensor module 1510 senses an image by the image sensor 1511 and data related to brightness from information sensed by the image sensor 1511 directly by the control logic 1512. Alternatively, information such as white balance may be generated.
  • Data or white balance information related to the brightness generated by the image sensor module 1510 may be transmitted to the application processor (AP) 1530 through the image preprocessing module 1520.
  • AP application processor
  • the application processor (AP) 1530 may include an image signal processor 1531 (ISP) and a main processor (CPU) 1532.
  • the image signal processor 1531 may include a Bayer processor 1531a and a color processor 1531b (Luma / Color). Since the basic functions of the above components have been described above with reference to FIGS. 9 and 13, repeated descriptions thereof will be omitted.
  • the image signal processor 1510 directly generates information related to brightness, and since the information on each pixel is not used, the image sensor 1511. Instead of using the entire area of), only some pixel areas may be used to generate brightness-related information.
  • information related to brightness may be generated only by the values sensed in pixels of odd or even lines by alternating with each horizontal or vertical line.
  • the entire area of the image sensor 1511 is divided into a plurality of areas 1513a and 1513b, and the brightness is sensed with only a value detected for at least one area 1513a of the plurality of areas.
  • Information related to may also be generated.
  • the electronic device may include a plurality of unit pixels (eg, red, green, and / or the like) included in the image sensor module 1510. Alternatively, only some pixels of blue may be used to generate (determine) data or white balance information related to brightness.
  • the electronic device eg, the controller 220
  • the electronic device may include attributes (eg, attributes of the pixels constituting the largest number of unit pixels constituting the image sensor module 1510 (eg, the image sensor 1411). Color information may be used to determine data related to brightness (eg, brightness information) or white balance information.
  • the unit having the green property when the unit pixel having the green property is larger than the pixel having the red or blue property, the unit having the green property
  • Brightness or white balance information may be determined using image information (eg, color information) of the pixel.
  • the electronic device eg, the controller 220
  • the electronic device may use data related to brightness (eg, brightness information) by using one or more pixels having the lowest number among a plurality of pixels.
  • the white balance information may be determined.
  • the electronic device may determine brightness information by using color information of the pixel having the smallest number of pixels constituting the image sensor module 1510 (eg, the image sensor 1411).
  • the selected unit pixel is selected by selecting color information of one of the unit pixels having a red or blue property.
  • the brightness information or the white balance information may be determined using the color information of.
  • the electronic device eg, the controller 220
  • the color used to determine the brightness information or the white balance information based on the priority set in the electronic device can be determined.
  • the electronic device for example, the controller 220
  • Information can be judged.
  • the preset priority may be changed based on the amount of light incident on the image sensor module 1510.
  • the electronic device compares the amount of light incident on the image sensor module 1510 for each unit pixel, and based on the comparison result, the brightness information or the white balance.
  • the priority used to determine the information can be changed. For example, if the amount of light of a red pixel (e.g., a pixel of red property) is greater than the amount of light of a blue pixel (e.g., the light of the red property is more than the light of a blue property), the priority of the red pixel is recalled. It can be set higher than the priority of blue pixels.
  • the illuminance may be determined from the color information by using the illuminance conversion table for the RGB sensor value.
  • the illuminance value corresponding to the color information sensed by the RGB sensor may be determined using a table in which the illuminance value corresponding to the RGB sensor value is set.
  • the illumination may be adaptively determined according to the current lighting environment through information sensed by the at least one sensor.
  • Each of the WiFi module 1623, the Bluetooth module 1625, the GNSS module 1627, or the NFC module 1628 may include, for example, a processor for processing data transmitted and received through a corresponding module.
  • at least some (eg, two or more) of the cellular module 1621, the WiFi module 1623, the Bluetooth module 1625, the GNSS module 1627, or the NFC module 1628 may be one integrated chip. (IC) or in an IC package.
  • the RF module 1629 may transmit / receive, for example, a communication signal (for example, an RF signal).
  • the RF module 1629 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, or the like.
  • PAM power amp module
  • LNA low noise amplifier
  • at least one of the cellular module 1621, the WiFi module 1623, the Bluetooth module 1625, the GNSS module 1627, or the NFC module 1628 may transmit and receive RF signals through a separate RF module. Can be.
  • Subscriber identification module 1624 may include, for example, a card containing a subscriber identification module and / or an embedded SIM, and may include unique identification information (eg, an integrated circuit card identifier (ICCID)) or It may include subscriber information (eg, international mobile subscriber identity (IMSI)).
  • ICCID integrated circuit card identifier
  • IMSI international mobile subscriber identity
  • the sensor module 1640 may measure a physical quantity or detect an operation state of the electronic device 1601, and may convert the measured or detected information into an electrical signal.
  • the sensor module 1640 may include, for example, a gesture sensor 1640A, a gyro sensor 1640B, an air pressure sensor 1640C, a magnetic sensor 1640D, an acceleration sensor 1640E, a grip sensor 1640F, and a proximity sensor ( 1640G), color sensor 1640H (e.g., red (green, blue) sensor), biometric sensor (1640I), temperature / humidity sensor (1640J), light sensor (1640K), or UV (ultra violet) ) May include at least one of the sensors 1640M.
  • a gesture sensor 1640A e.g., a gyro sensor 1640B, an air pressure sensor 1640C, a magnetic sensor 1640D, an acceleration sensor 1640E, a grip sensor 1640F, and a proximity sensor ( 1640G), color sensor 1640H (e.g., red (green,
  • the input device 1650 is, for example, a touch panel 1652, a (digital) pen sensor 1654, a key 1656, or an ultrasonic input device ( 1658).
  • the touch panel 1652 may use at least one of capacitive, resistive, infrared, and ultrasonic methods.
  • the touch panel 1652 may further include a control circuit.
  • the touch panel 1652 may further include a tactile layer to provide a tactile response to the user.
  • the (digital) pen sensor 1654 may be, for example, part of a touch panel or include a separate sheet for recognition.
  • the key 1656 may include, for example, a physical button, an optical key, or a keypad.
  • the ultrasonic input device 1658 may detect ultrasonic waves generated by an input tool through a microphone (for example, the microphone 1688) and check data corresponding to the detected ultrasonic waves.
  • Display 1660 may include panel 1662, hologram device 1664, or projector 1666.
  • the panel 1662 may include a configuration that is the same as or similar to the display 160 of FIG. 1.
  • the panel 1662 may be implemented to be, for example, flexible, transparent, or wearable.
  • the panel 1662 may be configured as a single module together with the touch panel 1652.
  • the hologram device 1664 may show a stereoscopic image in the air by using interference of light.
  • the projector 1666 may display an image by projecting light onto a screen.
  • the screen may be located inside or outside the electronic device 1601.
  • the display 1660 may further include a control circuit for controlling the panel 1662, the hologram device 1664, or the projector 1666.
  • the interface 1670 may be, for example, a high-definition multimedia interface (HDMI) 1672, a universal serial bus (USB) 1674, an optical interface 1676, or a D-subminiature (D-subminiature). ) 1678.
  • the interface 1670 may be included in, for example, the communication interface 170 shown in FIG. 1. Additionally or alternatively, the interface 1670 may be, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an IrDA (infrared). data association) may include a standard interface.
  • MHL mobile high-definition link
  • SD secure digital
  • MMC multi-media card
  • IrDA infrared
  • the audio module 1680 may bidirectionally convert, for example, a sound and an electrical signal. At least some components of the audio module 1680 may be included in, for example, the input / output interface 145 illustrated in FIG. 1.
  • the audio module 1680 may process sound information input or output through, for example, a speaker 1802, a receiver 1684, an earphone 1686, a microphone 1688, or the like.
  • the power management module 1695 may manage power of the electronic device 1601, for example.
  • the power management module 1695 may include a power management integrated circuit (PMIC), a charger integrated circuit (ICC), or a battery or fuel gauge.
  • PMIC power management integrated circuit
  • ICC charger integrated circuit
  • the PMIC may have a wired and / or wireless charging scheme.
  • the wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method, an electromagnetic wave method, or the like, and may further include additional circuits for wireless charging, such as a coil loop, a resonance circuit, a rectifier, and the like. have.
  • the battery gauge may measure, for example, the remaining amount of the battery 1696, the voltage, the current, or the temperature during charging.
  • the battery 1696 may include, for example, a rechargeable battery and / or a solar battery.
  • the indicator 1697 may display a specific state of the electronic device 1601 or a part thereof (for example, the processor 1610), for example, a booting state, a message state, or a charging state.
  • the motor 1698 may convert an electrical signal into mechanical vibrations, and may generate a vibration or haptic effect.
  • the electronic device 1601 may include a processing device (eg, a GPU) for supporting mobile TV.
  • the processing apparatus for supporting mobile TV may process media data according to a standard such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo TM .
  • DMB digital multimedia broadcasting
  • DVD digital video broadcasting
  • mediaFlo TM mediaFlo TM
  • Each of the components described in this document may be composed of one or more components, and the names of the components may vary according to the type of electronic device.
  • the electronic device may be configured to include at least one of the components described in this document, and some components may be omitted or further include additional components.
  • some of the components of the electronic device according to various embodiments of the present disclosure may be combined to form a single entity, and thus may perform the same functions of the corresponding components before being combined.
  • the program module 1710 may include an operating system (OS) for controlling resources related to the electronic device and / or various applications (eg, application programs) running on the operating system.
  • OS operating system
  • applications eg, application programs
  • the operating system can be an example, and Android (Android TM), iOS TM, Windows (Windows TM), Symbian (Symbian TM), Tizen (Tizen TM), or sea (Samsung bada os TM) .
  • the kernel 1720 may include, for example, a system resource manager 1721 or a device driver 1723.
  • the system resource manager 1721 may perform control, allocation, or retrieval of system resources.
  • the system resource manager 1721 may include a process manager, a memory manager, or a file system manager.
  • the device driver 1723 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an inter-process communication (IPC) driver. have.
  • IPC inter-process communication
  • the middleware 1730 may provide, for example, a function commonly required by the application 1770 or the API 1760 to enable the application 1770 to efficiently use limited system resources inside the electronic device. Various functions may be provided to the application 1770 through.
  • the middleware 1730 includes a runtime library 1735, an application manager 1741, a window manager 1742, a multimedia manager 1743, and a resource manager. (resource manager) 1744, power manager 1745, database manager 1746, package manager 1747, connectivity manager 1748, notification manager It may include at least one of a notification manager 1749, a location manager 1750, a graphic manager 1751, and a security manager 1702.
  • the runtime library 1735 may include, for example, a library module used by a compiler to add a new function through a programming language while the application 1770 is running.
  • the runtime library 1735 may perform input / output management, memory management, or a function for an arithmetic function.
  • the application manager 1741 may manage, for example, a life cycle of at least one of the applications 1770.
  • the window manager 1742 may manage GUI resources used on the screen.
  • the multimedia manager 1743 may identify a format required for playing various media files, and may encode or decode the media file by using a codec suitable for the format.
  • the resource manager 1744 may manage resources such as source code, memory, or storage space of at least one of the applications 1770.
  • the power manager 1745 may operate together with, for example, a basic input / output system (BIOS) to manage a battery or power, and provide power information necessary for the operation of the electronic device. .
  • the database manager 1746 may generate, search for, or change a database to be used by at least one of the applications 1770.
  • the package manager 1747 may manage installation or update of an application distributed in the form of a package file.
  • the connection manager 1748 may manage, for example, a wireless connection such as WIFI or Bluetooth.
  • the notification manager 1749 may display or notify an event such as an arrival message, an appointment, a proximity notification, or the like in a manner that does not disturb the user.
  • the location manager 1750 may manage location information of the electronic device.
  • the graphic manager 1751 may manage graphic effects to be provided to the user or a user interface related thereto.
  • the security manager 1702 may provide various security functions required for system security or user authentication. According to an embodiment of the present disclosure, when the electronic device (eg, the electronic device of FIG. 8) includes a telephone function, the middleware 1730 may include a telephone manager for managing a voice or video call function of the electronic device. It may further include.
  • the middleware 1730 may include a middleware module forming a combination of various functions of the above-described components.
  • the middleware 1730 may provide modules specialized according to types of operating systems in order to provide differentiated functions.
  • the middleware 1730 may dynamically delete some of the existing components or add new components.
  • the API 1760 is, for example, a set of API programming functions, and may be provided in a different configuration according to an operating system. For example, in the case of Android or iOS, one API set may be provided for each platform, and in Tizen, two or more API sets may be provided for each platform.
  • the application 1770 may be, for example, a home 1771, a dialer 1772, an SMS / MMS 1773, an instant message 1774, a browser 1775, a camera 1776, and an alarm 1777. ), Contacts (1778), voice dial (1779), email (1780), calendar (1781), media player (1782), album (1783), or watch (1784), health care (e.g., exercise volume Or one or more applications that may provide functions such as measuring blood sugar, or providing environmental information (eg, providing barometric pressure, humidity, or temperature information).
  • the application 1770 may be an application that supports information exchange between the electronic device (for example, the electronic device of FIG. 1 or 2) and an external electronic device (hereinafter, for convenience of description, an “information exchange application”). ").
  • the information exchange application may include, for example, a notification relay application for delivering specific information to the external electronic device, or a device management application for managing the external electronic device. .
  • the notification delivery application may provide a function of delivering notification information generated by another application of the electronic device (eg, an SMS / MMS application, an email application, a health care application, or an environmental information application) to an external electronic device. It may include.
  • the notification transmission application may receive notification information from an external electronic device and provide the notification information to a user.
  • the device management application may, for example, turn-on / turn-off or brightness of a display of at least one function of an external electronic device (eg, the external electronic device itself (or some component)) in communication with the electronic device. (Or, resolution) adjustment), an application running on the external electronic device or a service (eg, a call service or a message service) provided by the external electronic device may be managed (eg, installed, deleted, or updated).
  • the application 1770 may include an application (eg, a health care application) designated according to an attribute of the external electronic device (eg, an attribute of the electronic device, and the type of the electronic device is a mobile medical device). Can be.
  • the application 1770 may include an application received from an external electronic device.
  • the application 1770 may include a preloaded application or a third party application downloadable from a server.
  • the names of the components of the program module 1710 according to the shown embodiment may vary depending on the type of operating system.
  • At least a part of the program module 1710 may be implemented in software, firmware, hardware, or a combination of two or more thereof. At least a part of the program module 1710 may be implemented (for example, executed) by, for example, a processor (for example, the AP 3310). At least a part of the program module 1710 may include, for example, a module, a program, a routine, sets of instructions, or a process for performing one or more functions.
  • module or “functional unit” may refer to a unit including one or a combination of two or more of hardware, software, or firmware.
  • Module or “functional part” is used interchangeably with terms such as, for example, unit, logic, logical block, component, or circuit.
  • Can be The "module” or “functional part” may be a minimum unit or part of an integrally formed part.
  • the module may be a minimum unit or part of performing one or more functions.
  • the “module” or “functional part” can be implemented mechanically or electronically.
  • a “module” or “function unit” may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or programmable logic devices that perform certain operations, known or developed in the future. -logic device).
  • ASIC application-specific integrated circuit
  • FPGAs field-programmable gate arrays
  • programmable logic devices that perform certain operations, known or developed in the future. -logic device).
  • an apparatus eg, modules or functions thereof
  • a method eg, operations
  • computer-readable storage media in the form of a program module. It can be implemented as a command stored in.
  • the command is executed by a processor (eg, the controller 220)
  • the one or more processors may perform a function corresponding to the command.
  • the computer-readable storage medium may be, for example, the storage unit 240.
  • the computer-readable recording medium may include a hard disk, a floppy disk, a magnetic medium (for example, magnetic tape), an optical media (for example, a compact disc read only memory (CD-ROM), a DVD). (digital versatile disc), magneto-optical media (such as floptical disk), hardware devices (such as read only memory, random access memory (RAM), or flash memory Etc.
  • the program instructions may include not only machine code generated by a compiler, but also high-level language code executable by a computer using an interpreter, etc.
  • the above-described hardware device may include It may be configured to operate as one or more software modules to perform the operations of the various embodiments, and vice versa.
  • Modules or program modules according to various embodiments of the present disclosure may include at least one or more of the above components, some of them may be omitted, or may further include additional components. Operations performed by a module, program module, or other component according to various embodiments of the present disclosure may be executed in a sequential, parallel, repetitive, or heuristic manner. In addition, some operations may be executed in a different order, may be omitted, or other operations may be added.
  • the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Selon différents exemples, la présente invention concerne un dispositif électronique comprenant : un dispositif d'affichage pour afficher un contenu dans une direction correspondant à une première surface du dispositif électronique; un capteur pour détecter une lumière incidente sur une seconde surface du dispositif électronique; et un processeur, le processeur déterminant des informations de la luminosité autour du dispositif électronique, au moins sur la base de la lumière détectée, et pouvant être configuré pour régler au moins un attribut du dispositif d'affichage ou au moins un attribut du contenu. En outre, d'autres exemples en plus des différents exemples de la présente invention sont possibles.
PCT/KR2016/007267 2015-07-06 2016-07-05 Dispositif électronique et procédé de commande d'affichage dans un dispositif électronique WO2017007220A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/741,632 US20180218710A1 (en) 2015-07-06 2016-07-05 Electronic device and display control method in electronic device
CN201680040173.3A CN107851422A (zh) 2015-07-06 2016-07-05 电子设备和电子设备中的显示控制方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562188932P 2015-07-06 2015-07-06
US62/188,932 2015-07-06
KR1020160064994A KR102565847B1 (ko) 2015-07-06 2016-05-26 전자 장치 및 전자 장치에서의 디스플레이 제어 방법
KR10-2016-0064994 2016-05-26

Publications (1)

Publication Number Publication Date
WO2017007220A1 true WO2017007220A1 (fr) 2017-01-12

Family

ID=57685864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/007267 WO2017007220A1 (fr) 2015-07-06 2016-07-05 Dispositif électronique et procédé de commande d'affichage dans un dispositif électronique

Country Status (1)

Country Link
WO (1) WO2017007220A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108388334A (zh) * 2017-02-03 2018-08-10 三星电子株式会社 电子设备及防止电子设备消耗电流的方法
CN112071257A (zh) * 2020-07-31 2020-12-11 佛山市青松科技股份有限公司 一种led屏校正方法、装置、存储介质及led屏

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050025579A (ko) * 2002-07-03 2005-03-14 이노베이티브 솔루션즈 앤드 서포트 인코포레이티드 다양하게 조절할 수 있는 백라이트를 가지는 평면 패널디스플레이의 조명 방법 및 장치
US20080078921A1 (en) * 2006-08-25 2008-04-03 Motorola, Inc. Multiple light sensors and algorithms for luminance control of mobile display devices
US20110063341A1 (en) * 2009-09-15 2011-03-17 Wendell Knicely Method and system for correction, measurement and display of images
US20120044372A1 (en) * 2010-08-18 2012-02-23 Apple Inc. Dual image sensor image processing system and method
US20150070337A1 (en) * 2013-09-10 2015-03-12 Cynthia Sue Bell Ambient light context-aware display
KR20150033880A (ko) * 2013-09-25 2015-04-02 삼성전자주식회사 전자장치의 화면 표시장치 및 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050025579A (ko) * 2002-07-03 2005-03-14 이노베이티브 솔루션즈 앤드 서포트 인코포레이티드 다양하게 조절할 수 있는 백라이트를 가지는 평면 패널디스플레이의 조명 방법 및 장치
US20080078921A1 (en) * 2006-08-25 2008-04-03 Motorola, Inc. Multiple light sensors and algorithms for luminance control of mobile display devices
US20110063341A1 (en) * 2009-09-15 2011-03-17 Wendell Knicely Method and system for correction, measurement and display of images
US20120044372A1 (en) * 2010-08-18 2012-02-23 Apple Inc. Dual image sensor image processing system and method
US20150070337A1 (en) * 2013-09-10 2015-03-12 Cynthia Sue Bell Ambient light context-aware display
KR20150033880A (ko) * 2013-09-25 2015-04-02 삼성전자주식회사 전자장치의 화면 표시장치 및 방법

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108388334A (zh) * 2017-02-03 2018-08-10 三星电子株式会社 电子设备及防止电子设备消耗电流的方法
CN108388334B (zh) * 2017-02-03 2023-08-25 三星电子株式会社 电子设备及防止电子设备消耗电流的方法
CN112071257A (zh) * 2020-07-31 2020-12-11 佛山市青松科技股份有限公司 一种led屏校正方法、装置、存储介质及led屏
CN112071257B (zh) * 2020-07-31 2021-12-10 佛山市青松科技股份有限公司 一种led屏校正方法、装置、存储介质及led屏

Similar Documents

Publication Publication Date Title
AU2017254304B2 (en) Display driving integrated circuit and electronic device having the same
WO2018043884A1 (fr) Procédé de commande de caméra et dispositif électronique correspondant
WO2018199542A1 (fr) Dispositif électronique et procédé d'affichage d'image par un dispositif électronique
AU2017240614B2 (en) Electronic device including display
AU2016334911B2 (en) Electronic device and method for generating image data
WO2018070716A1 (fr) Dispositif électronique ayant une pluralité de modes de détection d'empreinte digitale et son procédé de commande
WO2018182197A1 (fr) Dispositif pour fournir des informations relatives à un objet dans une image
WO2018169273A1 (fr) Procédé de fourniture d'un indicateur différent pour une image sur la base d'un mode de prise de vue et dispositif électronique associé
WO2018021739A1 (fr) Procédé de fourniture de contenu vidéo et dispositif électronique le prenant en charge
WO2017131449A1 (fr) Dispositif électronique et procédé pour exécuter une fonction selon la transformation d'un dispositif d'affichage d'un dispositif électronique
WO2017116024A1 (fr) Dispositif électronique ayant un dispositif d'affichage souple, et procédé de fonctionnement du dispositif électronique
WO2017030411A1 (fr) Dispositif électronique et procédé de charge filaire et sans fil dans un dispositif électronique
WO2017074078A1 (fr) Procédé de fonctionnement de dispositif électronique et dispositif électronique pour prendre en charge ce procédé
WO2016035901A1 (fr) Procédé de reconnaissance de l'iris et dispositif électronique associé
WO2018004238A1 (fr) Appareil et procédé de traitement d'image
WO2017175964A1 (fr) Procédé de commande d'antenne et dispositif électronique correspondant
WO2017074010A1 (fr) Dispositif de traitement d'image et son procédé de fonctionnement
WO2016085253A1 (fr) Procédé de configuration d'écran, dispositif électronique, et support d'informations
WO2018143696A1 (fr) Dispositif électronique permettant de capturer une image animée sur la base d'un changement entre une pluralité d'images, et procédé de commande associé
WO2017026709A1 (fr) Procédé et dispositif d'ajustement de la résolution d'un dispositif électronique
WO2015102464A1 (fr) Dispositif électronique et procédé d'affichage d'événement en mode de réalité virtuelle
WO2018143632A1 (fr) Capteur pour capturer une image et son procédé de commande
WO2016137309A1 (fr) Dispositif et procédé de traitement d'image
WO2018012831A1 (fr) Commande de focalisation basée sur un objet ou une zone dans une vidéo
WO2018174581A1 (fr) Procédé et dispositif de commande de la fonction de balance des blancs d'un dispositif électronique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16821626

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15741632

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16821626

Country of ref document: EP

Kind code of ref document: A1