WO2023106614A1 - Method and device for improving accuracy of ambient light measurement in electronic device - Google Patents

Abstract

Embodiments of the present disclosure provide a method and device for improving the accuracy of ambient light measurement in an electronic device. An electronic device according to an embodiment of the present disclosure may comprise: a display module; an ambient light sensor comprising an ambient light sensor set to sense incident light which falls incident from an external light source, and an optical sensor; a memory; and a processor. The processor may operate so as to obtain a sensing value of the incident light by means of the optical sensor. The processor may operate so as to calculate the direction of the light source on the basis of the sensing value. The processor may operate so as to calculate the change in ratio of the area of a photodiode of each channel of the ambient light sensor receiving light from the calculated direction. The processor may operate so as to determine a correction ratio with respect to the direction of the light source of the ambient light sensor, on the basis of the calculated change in the ratio. The processor may operate so as to correct ambient light corresponding to the direction of the light source, on the basis of the determined correction ratio. Various embodiments are possible.

Description

Method and Apparatus for Improving Accuracy of Illuminance Measurement in Electronic Devices

Embodiments of the present disclosure provide a method and apparatus capable of improving the accuracy of illuminance measurement in an electronic device.

With the development of digital technology, mobile communication terminals, PDAs (personal digital assistants), electronic notebooks, smart phones, tablet PCs (personal computers), wearable devices and / or laptops Various types of electronic devices such as personal computers are widely used. In order to support and increase functions of these electronic devices, hardware parts and/or software parts of electronic devices are continuously being developed.

For example, an electronic device includes a display for visual support and can display various contents through the display. Electronic devices provide a function of adjusting brightness, contrast, and/or luminance of a display for user convenience. For example, the electronic device includes a function of detecting ambient light using an ambient light sensor (ALS) and automatically adjusting the brightness of the display in response to the ambient light. The electronic device may be used in an inactive area other than the display area of the display (eg, a bezel arrangement structure) (eg, a black matrix (BM) area or an inactive area) or an active area of the display (eg, an under-panel arrangement structure) ), an illuminance sensor can be placed (or included), and the brightness of the display can be automatically adjusted based on the measured ambient brightness through the illuminance sensor.

Recently, depending on the development of display technology and/or the layout structure of the illuminance sensor (e.g., under-panel layout structure), the ambient brightness sensing may be inaccurate or difficult to accurately sense due to the FOV (field of view) limitation of the illuminance sensor. there is. Accordingly, when the user moves to a dark environment, the display may operate with a brightness that is darker or brighter than the brightness corresponding to the ambient brightness. For example, when an electronic device arranges an illuminance sensor in an inactive area or an active area of a display, accuracy of illuminance (or illuminance value) measured by the illuminance sensor may deteriorate due to a FOV limit.

In various embodiments, illuminance is miscalculated due to a biased direction of a light source (or light) that occurs due to a field of view (FOV) limit according to an arrangement structure of an ambient light sensor (ALS) and/or a display structure. It discloses a method and device that can reduce the

In various embodiments, the direction of an external light source (eg, an IR light source) is calculated (eg, predicted), and the measured illuminance is corrected using a change in value according to the angle and/or direction of the external light source, so as to measure the illuminance. A method and apparatus capable of improving accuracy are disclosed.

In various embodiments, a method and apparatus capable of improving the accuracy of illuminance measurement by calculating a direction of an external light source, calculating a change in ratio according to a FOV limit in the corresponding direction, and compensating for the calculated ratio are disclosed.

In various embodiments, an optical sensor (eg, IR PD) is disposed outside the illuminance sensor, a direction of an external light source is calculated using the optical sensor, and a ratio between the illuminance sensor and IR (eg, ALS) is calculated in the calculated direction. /IR ratio), and if the calculated ratio is distorted beyond a certain level, the ratio is corrected based on the correction ratio corresponding to the direction of the light source to increase the accuracy of the illuminance and reduce the malfunction of the automatic brightness function. A method and apparatus are disclosed.

The technical problem to be achieved in this document is not limited to the technical problem mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

An electronic device according to an embodiment of the present disclosure includes a display, an illuminance sensor including an illuminance sensor configured to sense incident light incident from an external light source, and an optical sensor, a memory, and operation with the display, the illuminance sensor, and the memory. It may include an enemy-connected processor. According to an embodiment, the processor may operate to obtain a sensing value of the incident light through the optical sensor. According to an embodiment, the processor may operate to calculate the direction of the light source based on the sensing value. According to an embodiment, the processor may operate to calculate a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction. According to an embodiment, the processor may operate to determine a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change. According to an embodiment, the processor may operate to correct the illuminance corresponding to the direction of the light source based on the determined correction ratio.

An electronic device according to an embodiment of the present disclosure includes a display, an illuminance sensor, an optical sensor disposed outside the illuminance sensor and set to sense incident light incident from an external light source, a memory, and the display, the illuminance sensor, and the display. an optical sensor, and a processor operatively coupled with the memory. According to an embodiment, the processor may operate to obtain a sensing value of the incident light through the optical sensor. According to an embodiment, the processor may operate to calculate a ratio of an area receiving light from a photodiode of each channel of the illuminance sensor based on the sensing value. According to an embodiment, the processor may operate to determine a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio. According to an embodiment, the processor may operate to correct illuminance based on the determined correction ratio.

An operating method of an electronic device according to an embodiment of the present disclosure may include an operation of obtaining a sensing value of incident light incident from an external light source through an optical sensor disposed to surround an illuminance sensor. The operating method may include calculating a direction of the light source based on the sensing value. The operation method may include an operation of calculating a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction. The operating method may include determining a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change. The operating method may include correcting an illuminance corresponding to a direction of the light source based on the determined correction ratio.

In various embodiments of the present disclosure to solve the above problems, a computer-readable recording medium in which a program for executing the method in a processor may be included.

According to one embodiment, a non-transitory computer readable storage medium (or computer program product) storing one or more programs is described. According to one embodiment, one or more programs, when executed by a processor of an electronic device, obtain a sensing value of incident light incident from an external light source through an optical sensor disposed in a form surrounding an illuminance sensor, the sensing value Calculating the direction of the light source based on the calculated direction, calculating the ratio change of the area receiving light from the photodiode of each channel of the illuminance sensor in the calculated direction, and the illumination sensor based on the calculated ratio change may include instructions for performing an operation of determining a correction ratio for the direction of the light source and an operation of correcting the illuminance corresponding to the direction of the light source based on the determined correction ratio.

Additional scope of applicability of the present disclosure will become apparent from the detailed description that follows. However, since various changes and modifications within the spirit and scope of the present disclosure may be clearly understood by those skilled in the art, it should be understood that the detailed description and specific embodiments such as the preferred embodiments of the present disclosure are given by way of example only.

According to an electronic device, an operating method thereof, and a recording medium according to an embodiment of the present disclosure, the field of view (FOV) limit according to the arrangement structure and / or display structure of an ambient light sensor (ALS) occurs. It is possible to reduce the miscalculation of the illuminance due to the biased direction of the light source (or light) (e.g., photometry). According to an embodiment, the electronic device calculates (eg, predicts) the direction of an external light source and corrects the measured illuminance using a change in value according to the angle and/or direction of the external light source, thereby improving the accuracy of the illuminance measurement. can do. According to an embodiment, the electronic device 101 may calculate a direction of an external light source, calculate a change in a ratio according to a FOV limit in the corresponding direction, determine a situation in which the calculated ratio is distorted beyond a certain level, and compensate for this. there is.

According to an embodiment, the electronic device 101 may dispose an optical sensor (eg, IR PD) outside the illuminance sensor to calculate the direction of the external light source. According to an embodiment, the electronic device 101 detects a light source according to a difference in a ratio (eg, ALS/IR ratio) between photodiode light reception and IR light reception for each channel of an illuminance sensor in a direction of a light source (eg, a light metering direction). It is possible to calculate a correction value that compensates for the photometric direction of . According to an embodiment, the electronic device 101 may apply the calculated correction value to a lux calculation formula to improve the accuracy of illuminance measurement in an external light source (eg, an IR light source).

According to an embodiment of the present disclosure, an optical sensor is disposed outside the illuminance sensor, a direction of an external light source is calculated using the optical sensor, a change in ALS/IR ratio is calculated in the calculated direction, and the calculated ratio is When the ratio is distorted beyond a certain level, a correction ratio corresponding to the direction of the light source is determined in consideration of the ratio change, and the illumination intensity is corrected based on the determined correction ratio to increase the accuracy of the illumination intensity and reduce the malfunction of the automatic brightness function.

In addition to this, various effects identified directly or indirectly through this document may be provided. Effects obtainable in the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below. will be.

In the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

1 is a block diagram of an electronic device in a network environment according to various embodiments.

2 is a diagram illustrating an example of an electronic device according to an embodiment.

3 is a diagram illustrating an example of an electronic device according to an embodiment.

4 is a diagram for explaining a difference in light reception amount according to a direction of a light source in an illuminance sensor.

5 is a view for explaining the direction of the amount of light received according to the direction of the light source and the principle of receiving light in a specific direction.

6 is a diagram illustrating an example of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.

7 is a diagram illustrating an example of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.

8 is a diagram illustrating an example of a graph showing relative sensitivity according to wavelengths of an illuminance sensor.

FIG. 9 is a diagram for explaining an example of an operation of calculating a direction of a light source in the optical sensor arrangement structure of FIG. 6 according to an exemplary embodiment.

10 is a diagram schematically illustrating a configuration of an electronic device according to an exemplary embodiment.

11 is a flowchart illustrating a method of operating an electronic device according to an exemplary embodiment.

1 is a block diagram of an electronic device 101 within a network environment 100 according to various embodiments.

Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to an embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit (CPU) or an application processor (AP)) or a secondary processor (which may be operated independently of or together with the main processor 121). 123) (e.g., graphic processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor hub processor, or communication processor (CP, communication processor)). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 may At least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or At least some of the functions or states related to the communication module 190) may be controlled. According to one embodiment, the auxiliary processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of other functionally related components (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130, and may include, for example, an operating system (OS) 142, middleware 144, or an application 146. there is.

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, a : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunications network such as a LAN or wide area network (WAN)). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (eMBB, mobile broadband), minimization of terminal power and access of multiple terminals (mMTC, massive machine type communications), or high-reliability and low-latency (URLLC, ultra-reliable and low-latency communications) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO, full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 may be used to realize peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC). Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a bottom surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish that component from other corresponding components, and may refer to that component in other respects (eg, importance or order) is not limited. A (eg, first) component is said to be "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the operations performed by a module, program or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order. may be added, omitted, or one or more other actions may be added.

Prior to describing various embodiments of the present disclosure, an electronic device 101 to which embodiments of the present disclosure may be applied will be described.

2 is a diagram illustrating an example of an electronic device according to an embodiment.

3 is a diagram illustrating an example of an electronic device according to an exemplary embodiment.

According to one embodiment, FIGS. 2 and 3 may show various examples of a structure in which a sensor circuit (eg, an illuminance sensor and/or a roughness sensor) according to an embodiment of the present disclosure is disposed in the electronic device 101. .

Referring to FIGS. 2 and 3 , an electronic device 101 according to an embodiment may include housings 200 and 300 including a front side, a back side, and side surfaces surrounding a space between the front and rear sides. . In one embodiment, the housings 200 and 300 may refer to a structure forming some of the front, rear, and side surfaces.

According to one embodiment, the front surface may be formed by a front plate 210, 310 that is at least partially transparent (eg, a glass plate including various coating layers, or a polymer plate). there is. According to one embodiment, the back surface may be formed by a substantially opaque back plate (not shown). For example, the back plate may be coated or tinted glass, ceramic, polymer, metal (eg, aluminum, stainless steel (STS), or magnesium), or at least two of the foregoing. can be formed by combination. According to an embodiment, the side surfaces may be coupled to the front plates 210 and 310 and the rear plates and may be formed by a side bezel structure (or “side member”) including metal and/or polymer. In some embodiments, the back plate and side bezel structure may be integrally formed and include the same material (eg, a metal material such as aluminum).

According to an embodiment, the displays 201 and 301 (eg, the display module 160 of FIG. 1 ) may be exposed, for example, through a significant portion of the front plates 210 and 310 . The displays 201 and 301 may be implemented in various forms including a liquid crystal display (LCD), an organic light emitting diode (OLED), or an active matrix OLED (AMOLED). The displays 201 and 301 may display moving images or still images based on the control of a processor (eg, the processor 120 of FIG. 1 ), and may display various external objects (eg, human hands) on the displays 201 and 301 . , stylus pen) may receive an input. The displays 201 and 301 may include touch sensors to receive inputs from various external objects. According to an embodiment, the display 201 or 301 includes a touch sensing circuit (or touch sensor), a pressure sensor capable of measuring the strength (pressure) of a touch, and/or a digitizer that detects a magnetic stylus pen and They may be combined or placed adjacent to each other.

According to one embodiment, FIG. 2 may show an example in which the sensor module 230 including a proximity sensor, an illuminance sensor, and/or a roughness sensor is disposed on the front plate 210 of the electronic device 101 .

Referring to FIG. 2 , an electronic device 101 according to an exemplary embodiment includes a display 201, a front plate 210, and a housing 200, and the display 201 and sound are mounted on the front plate 210. It may include an output device 220 , a sensor module 230 , a camera module 240 , and/or an indicator 250 . In some embodiments, the electronic device 101 may omit at least one of the components (eg, the indicator 250) or may additionally include other components.

According to an embodiment, in FIG. 3 , a sensor module 330 including a proximity sensor, an illuminance sensor, and/or a roughness sensor is located under the display 301 of the electronic device 101 (eg, under the panel). ).

Referring to FIG. 3 , an electronic device 101 according to an embodiment includes a display 301, a front plate 310, and a housing 300, and a sensor module 330 and a sensor module 330 under the display 301. A camera module 340 may be included. Although not shown in FIG. 3 , the electronic device 101 may additionally include other components (eg, the sound output device 220 and the indicator 250) as described in the description with reference to FIG. 2 . According to an embodiment, in the electronic device 101 according to the embodiment of FIG. 3 , the audio output device 220 may be disposed at the edge of the bezel area. According to an embodiment, the electronic device 101 according to the embodiment of FIG. 3 may include an under panel speaker using the display 301 (eg, OLED) as a diaphragm. For example, an under-panel speaker may be placed under the display 301 and not visible from the outside.

2 and 3 , the sound output device 220 may include a speaker. The speaker may include a receiver for a call. The sensor modules 230 and 330 may generate electrical signals or data values corresponding to an internal operating state of the electronic device 101 or an external environmental state. The sensor modules 230 and 330 may include, for example, a proximity sensor, an illuminance sensor, and/or a roughness sensor. The proximity sensor may detect an external object approaching the electronic device 101 . The proximity sensor may include a light emitter that emits infrared rays and a light receiver that receives infrared rays reflected by an external object. The illuminance sensor may measure illumination around the electronic device 101 (eg, a magnitude (unit: lux) detected by the ambient brightness). The illuminance sensor may measure illuminance by measuring the amount of light through a pre-created hole.

In FIGS. 2 and 3 , the camera modules 240 and 240 (eg, the camera module 180 of FIG. 1 ) may include one or a plurality of lenses, an image sensor, and/or an image signal processor. In some embodiments, two or more lenses (eg, wide-angle and telephoto lenses) and image sensors may be disposed on one side (eg, front and/or rear) of the electronic device 101 . The indicator 250 may provide, for example, state information of the electronic device 101 in the form of light. In one embodiment, the indicator 250 may provide a light source interlocked with the operation of the camera modules 240 and 240 . The indicator 250 includes, for example, a luminous element such as a light emitting diode (LED), an infrared (IR) LED, a laser diode (LD), and/or a xenon lamp. can do.

In FIG. 2 , a sensor module 230 (eg, a proximity sensor, an ambient light sensor) (eg, the sensor module 176 of FIG. 1 ) may be disposed on the front plate 210 of the housing 200 . For example, the electronic device 101 may place an illuminance sensor in an inactive area of the display 201, the illuminance sensor measures illuminance (or ambient light), and based on this, It can be used for adjusting the brightness of the display 201. In FIG. 3 , the sensor module 330 may be disposed below the display 301 between the front surface of the housing 300 and the rear surface facing the front surface. For example, the electronic device 101 may place an illuminance sensor in an active area of the display 301, and the illuminance sensor may adjust the illuminance (or Ambient brightness) can be measured, and based on this, it can be used for adjusting the brightness of the display 301 .

According to an embodiment, the electronic device 101 may correct an illuminance measurement value using color on pixel ratio (COPR) information. For example, the illuminance sensor may measure the illuminance only during the display off time to minimize the influence of the display 201 or 301, and additionally correct the illuminance measurement value based on the color displayed on the display 201 or 301. You may.

According to an embodiment, the display off time of the display 201 or 301 may indicate a time for the illuminance sensor not to be affected by the brightness of the display 201 or 301 when sensing the illuminance. For example, the display off time can be used to control the timing to reduce the impact of the illumination measurement due to the display of the displays 201 and 301 . According to an embodiment, the COPR information may be used to correct an illuminance measurement value based on a color displayed on the displays 201 and 301 . For example, since white is bright and black is dark, correction values may be different according to colors. For example, when there is a large amount of red among the colors displayed on the displays 201 and 301, a high value of the R channel among red, green, and blue (RGB) channels of the illuminance sensor may be output, and the R channel value of the illuminance sensor is corrected. can do.

Recently, the displays 201 and 301 of the electronic device 101 may be implemented with a design with an increased area occupied on the front surface (eg, a bezel-less display), and various parts disposed on the front surface (eg, shown in FIG. 3 ). The sensor module 330 and the camera module 340) may be disposed between the display 301 and the rear surface or may be disposed inside the display 301 . According to an embodiment, the proximity sensor, illuminance sensor, and/or camera module 340 has an under display sensor structure between the display 301 and the rear surface (or the lower part of the display 301 (eg, the under display sensor)). panel)). According to one embodiment, the sensor module 330 (eg, a proximity sensor, an illuminance sensor) and/or the camera module 340 have an in-display sensor structure and are integrated with the display 301 to display ( 301) can be formed in. In the case of an in-display sensor structure, for example, a sensor (eg, a sensor module 330 and/or a camera module 340) on a cell, such as an “on cell touch AMOLED (OCTA)” structure, which is a kind of touch screen panel technology. ))) may be included.

Recently, as the area occupied by the display 301 on the front increases, the size of the area where various components (eg, a proximity sensor, an illuminance sensor, and/or a camera module) are disposed on the front is decreasing. For example, as the area occupied by the display 301 increases, it may be difficult to mount electronic components alongside the display 301 due to a relatively narrow bezel area. Accordingly, display structures in which electronic components are disposed between the display 301 and the back plate or within the display 301 are increasing.

Meanwhile, depending on the arrangement structure of the illuminance sensor in the electronic device 101, sensing of the ambient brightness may be inaccurate or difficult due to the field of view (FOV) limit of the illuminance sensor. For example, when the electronic device 101 arranges an illuminance sensor in an inactive area or an active area of a display, the accuracy of illuminance (or illuminance value) measured by the illuminance sensor may deteriorate. For example, the illuminance sensor may measure the illuminance by receiving an external light source through a pre-created hole in the inactive area or the active area and measuring the amount of light. However, due to limitations of the pre-created hole design, light may be biased and incident to a partial area (eg, a specific photodiode area) rather than the entire area of the illuminance sensor. In this case, the illuminance accuracy according to the change in the ratio between photodiode light reception and IR light reception for each channel of the illuminance sensor (eg, ALS/IR ratio) may be reduced, which is It may lead to malfunction of automatic brightness control.

For example, if the ratio of ALS/IR in the ambient light sensor is different from the specified reference ratio, the ambient light accuracy may be affected. In particular, such an accuracy problem may occur in sunlight, and the non-uniform arrangement of the photodiodes and the transmission performance of the filter of the photodiodes may be affected according to the inclination angle of the electronic device 101 (or the illuminance sensor set). there is. An example thereof will be described with reference to FIGS. 4 and 5 .

4 is a diagram for explaining a difference in light reception amount according to a direction of a light source in an illuminance sensor.

5 is a view for explaining the direction of the amount of light received according to the direction of the light source and the principle of receiving light in a specific direction.

As shown in FIGS. 4 and 5 , a difference may occur in the amount of light received by the photodiode 410 of the illuminance sensor 400 according to the FOV limit according to the direction of the light source 450 . For example, examples <401> and <501> may represent examples in which the light source 450 is positioned in a direction perpendicular to the illuminance sensor 400 . Examples <403> and <503> are cases in which the light source 450 is biased (or tilted) in a first direction (eg, left, right, upper, or lower) that is not perpendicular to the illuminance sensor 400. example can be given. Examples <405> and <505> may represent examples in which the light source 450 is biased in a second direction (eg, left, right, upper, or lower) that is not perpendicular to the illuminance sensor 400. .

In one embodiment, the situation in which the direction of the light source 450 is inclined in a direction other than the vertical direction with respect to the illuminance sensor 400 is, for example, when the illuminance sensor 400 receives light in a diagonal direction. can This may include a situation where the illuminance sensor 400 is not positioned perpendicular to the light source 450 or the illuminance sensor 400 (or the electronic device 101) is tilted in one direction.

Referring to Example <401> and Example <501>, when the light source 450 is positioned in a direction perpendicular to the illuminance sensor 400, through the entire area A of the photodiode 410 of the illuminance sensor 400. Light for the light source 450 may be received.

Referring to Example <403> and Example <503>, when the light source 450 is located in a direction biased toward the first side instead of perpendicular to the illuminance sensor 400, the photodiode of the illuminance sensor 400 according to the FOV limit Light from the light source 450 may be received through a partial area (eg, a specific photodiode area such as area B) instead of the entire area A of 410 .

Referring to Examples <405> and <505>, when the light source 450 is located in a direction biased toward the second side instead of being perpendicular to the illuminance sensor 400, the photodiode of the illuminance sensor 400 according to the FOV limit Light from the light source 450 may be received through a partial area (eg, a specific photodiode area such as area C) instead of the entire area A of 410 .

For example, in the illuminance sensor 400, the larger the area of the photodiode 410 that receives light from the light source 450, the greater the amount of incident light and the higher the analog digital converter (ADC) value. As the area of the photodiode 410 receiving light from 450 decreases, the incident light amount decreases and the ADC value can be sensed as low. For example, in the illuminance sensor 400, the area where the photodiode 410 receives light may vary according to the direction of the light source 450 according to the FOV limit.

As illustrated in FIGS. 4 and 5 , the ratio of ALS/IR used in a calculation method (or calculation formula) designated for calculating illuminance may vary when deflected light reception is performed. For example, according to the area (or area) in which light is received from the photodiode 410 of the illuminance sensor 400, the ALS channels of the photodiode 410 (eg, R (red), G (green), B A ratio between (blue), and/or C (clear) channel) light reception and IR light reception (eg, ALS/IR ratio) may vary.

For example, the principle in which the ALS/IR ratio is shifted is that, as described above, the light source 450 is incident on the entire area of the photodiode 410 according to the incident angle (eg, area A, area B, or area C). may be different, and the ratio of each channel may be different because the ratio of the area receiving light of the photodiode for each channel is different at a specific angle. For example, as shown in the examples of FIGS. 4 and 5 , when light is incident in a diagonal direction (eg, photometry) such as left, right, upper, or lower with respect to the illuminance sensor 400, the Unlike the environment in which light is incident in the vertical direction above the right angle, the ratio of IR and ALS may be distorted. For example, depending on which direction (eg, left, right, top, or bottom) light is emitted from the illuminance sensor 400, a situation may occur in which the photodiode 410 does not receive light evenly, and in this case The ratio characteristics may vary.

In one embodiment, as described above, when the illuminance sensor 400 is tilted or the position with the light source 450 is out of the vertical range and light is incident in an oblique direction (eg, a diagonal direction) as photometry, the light source The number of photodiodes 410 that receive light from 450 may vary, and the ratio may vary accordingly.

In the present disclosure, the ratio between the angle at which light is received from the illuminance sensor 400 and the light source 450 (eg, incident angle) and the data for each channel is checked, and when the ratio change is confirmed, the illumination intensity is corrected according to the ratio difference. can act to do so. Through this, in the present disclosure, malfunctions during automatic brightness control of the display module 160 may be reduced.

According to an embodiment of the present disclosure, a plurality of optical sensors capable of identifying the direction of the light source 450 are disposed outside (or around) the illuminance sensor 400, and the measured values of the optical sensor (eg, IR PD) The direction of the light source 450 may be calculated (eg, predicted) based on the difference between . Examples of this are shown in FIGS. 6 and 7 .

6 and 7 are diagrams illustrating examples of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.

8 is a diagram illustrating an example of a graph showing relative sensitivity according to wavelengths of an illuminance sensor.

6 and 7 may show various configuration examples of the illuminance sensor 600 in the electronic device 101 according to an embodiment of the present disclosure. For example, according to an embodiment of the present disclosure, the electronic device 101 includes an illuminance sensor 600 and a plurality of optical sensors 700 (eg, 710, 720, 730, and 740) outside the illuminance sensor 600. Including, the illuminance sensor module 900 (or illuminance sensor set) may be configured. For example, the illuminance sensor module 900 is arranged to surround the illuminance sensor 600 by using a plurality of optical sensors 700 (eg, 710, 720, 730, 740) outside the illuminance sensor 600. It may include a layout structure that According to an embodiment, the optical sensors 700 (eg, 710, 720, 730, and 740) may be disposed in a form surrounding the illuminance sensor 600 based on a horizontal reference point (or a flat reference point) of the illuminance sensor 600. can

6 and 7, in one embodiment, the illuminance sensor 600 is a sensor that measures (or detects) the intensity of ambient light, for example, detects light and outputs raw data. can do. According to an embodiment, the illuminance sensor 600 may operate in an interrupt mode to synchronize with COPR information of a display (eg, the display module 160 of FIG. 1 ).

The illuminance sensor 600 may have a plurality of channels to detect ambient light. For example, the illuminance sensor 600 generally includes visible light red (R, green), blue (B, blue) of visible light, and all visible light clear (C, clear) in order to receive visible light. ) channels. For example, the illuminance sensor 600 may determine the illuminance value based on the signal intensity according to the amount of light received through the R, G, and B bands of visible light and/or the C band of all visible light.

The illuminance sensor 600 may receive light of a specified band in each channel and detect which color of external light is received. In the illuminance sensor 600, individual channels may receive light in an infrared (IR) band as well as a visible light band. For example, as illustrated in FIG. 8 , the illuminance sensor 600 may include R/G/B channels that receive light of about 450 nm band, about 550 nm band, and about 650 nm band. According to an embodiment, the illuminance sensor 600 may include a channel (eg, C channel) that receives light of an IR band (eg, a band of about 940 nm).

For example, referring to FIG. 8 , the illuminance sensor 600 includes photodiodes 630 for each wavelength according to color (eg, 630-1, 630-2, 630-3, 630-4, 630- The relative sensitivity of 5) may vary. For example, in the illuminance sensor 600, the blue photodiode can show high responsiveness to light of about 450 nm band, the green photodiode to light of about 550 nm band, and the red photodiode to light of about 650 nm band. . For example, in the illuminance sensor 600, the clear photodiode may show high response to light in a band of about 450 nm to about 940 nm. In the present disclosure, examples of each band of the photodiode 630 (eg, 630-1, 630-2, 630-3, 630-4, and 630-5) are not limited to the disclosed examples, and, for example, about It can be designed in various ways, such as being implemented to accept light in a band of 400 nm to about 1000 nm.

According to an embodiment of the present disclosure, the illuminance sensor module 900 arranges a plurality of additional optical sensors 700 (eg, 710, 720, 730, 740) outside the illuminance sensor 600, and the illuminance sensor module ( 900) determine the position of the external light source by determining the light reception ratio of the IR (610) (e.g., 610-1, 610-2, 610-3, 610-4, 610-5, 610-6) according to the tilt angle. It can be calculated (e.g. predicted). According to an embodiment, the light sensor 700 (eg, 710, 720, 730, 740) is a sensor that detects ambient light, and is, for example, an IR photodiode (PD), a spectrometric sensor, RGB sensors, and/or all types of sensors that detect light, such as UV (ultraviolet) sensors.

In one embodiment, FIG. 6 shows four optical sensors 700 (eg, a first optical sensor 710, a second optical sensor 720, and a third optical sensor 730) around the outer periphery of the illuminance sensor 600. and a first symmetrical structure in which the fourth optical sensor 740 is symmetrically disposed. For example, four light sensors 700 may be disposed on top, bottom, left, and right sides of the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 .

In one embodiment, FIG. 7 shows eight optical sensors 700 (eg, a first optical sensor 710, a second optical sensor 720, and a third optical sensor 730) around the outer periphery of the illuminance sensor 600. , second symmetry in which the fourth optical sensor 740, the fifth optical sensor 715, the sixth optical sensor 725, the seventh optical sensor 735, and the eighth optical sensor 745) are symmetrically disposed. An example of a structure can be given. For example, based on the illuminance sensor 600, eight light sensors 700 (e.g., 710 , 720, 730, 740, 715, 725, 735, 745) may be disposed.

In the present disclosure, the arrangement of the optical sensor 700 is not limited to the example of FIG. 6 or 7, and the position of the optical sensor 700 can be designed in various ways considering the mechanical structure, and the direction of the external light source ( Or position) may include various shapes that can be arranged to surround the illuminance sensor 600 in the outer periphery of the illuminance sensor 600 .

According to an embodiment, the electronic device 101 may check whether light is detected through at least one light sensor 700 among the light sensors 700 in the illuminance sensor module 900, and the light sensor detecting the light ( 700), the direction of the external light source may be calculated (eg, predicted. For example, as in the example of FIG. 6 or 7, in the present disclosure, a plurality of light sensors (eg, around the illuminance sensor 600) 700), the angle (eg, the direction of the light source) of the illuminance sensor module 900 (or the illuminance sensor 600 or set) may be determined using the optical sensor 700.

According to an embodiment, referring to FIG. 6 , when light is sensed through the first optical sensor 710 to the fourth optical sensor 740, the external light source is positioned in a direction perpendicular to the illuminance sensor 600. can be judged to be For example, when light is sensed through the first optical sensor 710, it may be determined that an external light source is located in a first diagonal direction (eg, a downward direction) from the illuminance sensor 600. For example, when light is sensed through the second optical sensor 720, it may be determined that an external light source is located in a second diagonal direction (eg, a left direction) from the illuminance sensor 600. For example, when light is sensed through the third optical sensor 730, it may be determined that an external light source is located in a third diagonal direction (eg, an upward direction) from the illuminance sensor 600. For example, when light is sensed through the fourth light sensor 740, it may be determined that the external light source is located in a fourth diagonal direction (eg, right direction) from the illuminance sensor 600.

This is an example for explanation, and the embodiments of the present disclosure are not limited thereto, and a plurality of light sensors 700 (eg, 710, 720, 730, 740), the position of the external light source can be determined in various combinations. For example, the electronic device 101 checks the ratio of data (e.g., amount of light) of the light sensor 700 according to the incident direction of light up, down, left, right as well as top left, bottom left, top right, and bottom right. As such, the direction of the light source may be calculated (eg, predicted) in all directions through a combination of data of the optical sensor 700 .

FIG. 9 is a diagram for explaining an example of an operation of calculating a direction of a light source in the optical sensor arrangement structure of FIG. 6 according to an exemplary embodiment.

Referring to FIG. 9 , for example, when the light source is located in the lower left direction, data of the optical sensors 710 and 720 of the first region 910 in the upper right direction may increase. For example, when the light source is located in the upper left direction, the data of the light sensors 720 and 730 of the second area 920 in the lower right direction may increase. For example, when the light source is located in the upper right direction, data of the optical sensors 730 and 740 of the third area 930 in the lower left direction may increase. For example, when the light source is located in the lower right direction, data of the optical sensors 740 and 710 of the fourth region 940 in the upper left direction may increase. This can be summarized as shown in <Table 1> below.

light source location	First optical sensor 710	Second optical sensor 720	Third optical sensor 730	Fourth optical sensor 740
top left	△	○	○	△
bottom left	○	○	△	△
top right	△	△	○	○
bottom right	○	△	△	○
award	△	△	○	△
under	○	△	△	△
left	△	○	△	△
right	△	△	△	○

In the example of <Table 1>, an area receiving a small amount of light (eg, amount of light) from a light source may be represented by a triangle (Δ), and an area receiving a relatively large amount of light may be represented by a circle (○).

According to the present disclosure, through the arrangement of the optical sensor 700 of the illuminance sensor module 900 as described above, the direction of the external light source may be calculated (eg, predicted). According to the present disclosure, the direction of an external light source is calculated through the optical sensor 700, and the ratio change of each photodiode 630 of the illuminance sensor 600 is inverted in the calculated direction to correct the illuminance according to the direction of the light source. can do. For example, the electronic device 101 may calculate the direction of the light source based on a reference range in which an external light source is located in a direction perpendicular to the illuminance sensor 600 (eg, the front side) and is incident. For example, the electronic device 101 stores an incident reference range (eg, reference ratio) in the memory 130 when an external light source is located in a direction designated with respect to the illuminance sensor 600 (eg, a vertical direction or a front surface). In this case, the illuminance may be corrected by calculating the ratio of each photodiode 630 of the illuminance sensor 600 .

According to the present disclosure, the electronic device 101 calculates the direction of the light source, and in the calculated direction, the ratio between the light reception of the photodiode 630 and the light reception of the IR 610 for each channel of the illuminance sensor according to the FOV limit (eg : ALS/IR ratio) change (e.g., an increase or decrease in angle in the reference range) can be calculated, and a situation in which the calculated ALS/IR ratio is distorted beyond a certain level can be determined. According to the present disclosure, the electronic device 101 determines a correction ratio based on the direction of the light source and the angle of the tilted set for the ALS/IR ratio when the ALS/IR ratio is distorted by a certain amount or more, and based on the determined correction ratio By correcting the illuminance, the accuracy of the illuminance may be increased and malfunction of the automatic brightness function may be reduced. According to an embodiment, when the ALS/IR ratio changes (eg, increases or decreases over a certain angle within a reference range), the ALS/IR ratio may be corrected in the following manner according to the amount of change in the angle.

In one embodiment, <Equation 1> may represent an example of an equation for correcting an ALS/IR ratio through a direction of a light source and an angle of an inclined set (eg, the illuminance sensor module 900). In Equation 1, the reference range represents the ratio of the light sensor 700 when the light sensor 600 is perpendicular to the light source, and the ratio difference is the ratio of the light sensor 700 when the light source is inclined. This changed value (eg the difference between the reference range and the changed range) can be represented. For example, the electronic device 101 may compensate as shown in <Equation 1> in consideration of the ratio of the area illuminated by the optical sensor 700 according to the angle (eg, photometry) that is deflected from the direction of the light source.

As described above, the electronic device 101 according to an embodiment detects light from at least one optical sensor 700 of the illuminance sensor module 900, and data by the optical sensor 700 that detects the light ( Example: The correction ratio can be determined by dividing the reference range (or reference ratio) by the ratio of the amount of light) and multiplying it by the ALS/IR ratio to correct the illuminance. For example, the electronic device 101 may calculate a correction value (e.g., correction ratio) for compensating for the direction of the light source with a difference in ALS/IR ratio, and apply the calculated correction value to an illuminance calculation formula. , it is possible to improve the illuminance accuracy according to the direction of the external light source.

10 is a diagram schematically illustrating a configuration of an electronic device according to an exemplary embodiment.

Referring to FIG. 10 , an electronic device 101 according to an embodiment may include a display module 160, a memory 130, an illuminance sensor module 900, and a processor 120.

According to an embodiment, the display module 160 can visually provide various information to the outside of the electronic device 101 (eg, a user). According to an embodiment, the display module 160 includes a touch sensing circuit (or touch sensor), a pressure sensor capable of measuring the strength of a touch, and/or a touch panel (eg, a digitizer) detecting a magnetic stylus pen. can include According to an embodiment, the display module 160 is a touch sensing circuit, a pressure sensor, and/or a signal for a specific position of the display module 160 based on the touch panel (eg, voltage, light intensity, resistance, electromagnetic signal, and/or Alternatively, a touch input and/or a hovering input (or proximity input) may be sensed by measuring a change in charge amount.

According to an embodiment, the display module 160 is based on luminance corresponding to manual brightness control by a user input or automatic brightness control by an illuminance value measured by the illuminance sensor 600 under the control of the processor 120. Thus, it can operate with the corresponding brightness. According to an embodiment, the display module 160 may include a liquid crystal display (LCD), an organic light emitted diode (OLED), or an active matrix organic light emitted diode (AMOLED). According to some embodiments, the display module 160 may be configured as a flexible display.

According to an embodiment, the illuminance sensor module 900 may include an illuminance sensor 600 and an optical sensor 700 . According to an embodiment, the illuminance sensor module 900 may be disposed in an inactive area of the display module 160 or an active area of the display module 160 . In one embodiment, the illuminance sensor module 900 is directly connected to the processor 120, or an auxiliary processor managing the overall operation of the sensor module (eg, the sensor module 176 of FIG. 1) in the electronic device 101. (e.g. sensor hub or sensor hub processor). When the sculpture sensor module 900 is connected to an auxiliary processor, the operation of the processor 120 may be processed by the auxiliary processor, or the processor 120 and the auxiliary processor may process the operation in parallel.

The illuminance sensor 600 may include a device (or sensor) capable of measuring (or measuring) light (or the amount or amount of light) so that the brightness (or illuminance) of the electronic device 101 can be estimated. can For example, the illuminance sensor 600 includes an element (eg, a cadmium sulfide (Cds) element) having a photoelectric effect in which electrons moving inside are generated when light energy (or light) is received and the conductivity is converted. can do. According to an embodiment, the illuminance sensor 600 may include a roughness sensor combining an illuminance sensor and a proximity sensor into one device (or module). In some embodiments, the illuminance sensor 600 may include various sensors that operate (or sense) based on light, such as a picker sensor, a flicker sensor, a color sensor, and/or a spectrometer. can include In one embodiment, the illuminance sensor 600 is a sensor that measures the intensity of ambient light and may include a photodiode. The illuminance sensor 600 may determine the illuminance value through signal intensity (eg, light intensity) according to the amount of light received through the R, G, and B bands of visible light and/or the entire C band of visible light.

In one embodiment, the optical sensor 700 may be disposed outside the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 . In one embodiment, the light sensor 700 is a sensor that detects ambient light, such as an IR photodiode (PD), a spectrometric sensor, an RGB sensor, and/or an ultraviolet (UV) sensor. Any kind of sensor that detects light can be included.

In one embodiment, the optical sensor 700 may be integrally formed with the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 . For example, the illuminance sensor 600 may include an optical sensor 700 . According to various embodiments, the optical sensor 700 may be formed separately from the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 . For example, the optical sensor 700 may be formed outside the illuminance sensor 600 .

According to an embodiment, the memory 130 may store various data used by the electronic device 101 . The data may include, for example, input data or output data for an application (eg, the program 140 of FIG. 1 ) and a command related thereto. According to one embodiment, the memory 130 may store instructions that, when executed, cause the processor 120 to operate. For example, the application may be stored as software on the memory 130 and may be executable by the processor 120 . According to an embodiment, the applications may be various applications capable of supporting automatic brightness control of the display module 160 based on ambient illumination in the electronic device 101 .

According to an embodiment, the memory 130 obtains a sensing value of incident light through the light sensor 700 according to an embodiment of the present disclosure, calculates a direction of a light source based on the sensing value, and illuminates in the calculated direction. A ratio change of an area receiving light from the photodiode of each channel of the sensor 600 is calculated, a correction ratio for the direction of a light source of the illuminance sensor 600 is determined based on the calculated ratio change, and a correction ratio is determined according to the determined correction ratio. At least one component (or module) related to a function (or operation) of correcting the illuminance corresponding to the direction of the light source may be stored. For example, the memory 130 includes a function of adjusting the brightness of the display module 160 using an illuminance sensor, executable by the processor 120 (eg, an automatic brightness adjustment function) in the form of software (or instruction form). can do.

According to an embodiment, the processor 120 may control a related operation to reduce erroneous calculation of illuminance due to a biased direction of an external light source (or light). According to an embodiment, the processor 120 calculates the direction of the external light source using data detected by the light sensor 700 disposed outside the illuminance sensor 600, and the ALS/IR ratio in the calculated direction. Calculate the change of , and if the calculated ratio is distorted beyond a certain level, correct the illuminance based on the correction ratio corresponding to the direction of the light source, thereby increasing the accuracy of the illuminance and reducing the malfunction of the automatic brightness function. can do.

According to an embodiment, the processor 120 obtains a sensing value of incident light through the optical sensor 700, calculates a direction of the light source based on the sensing value, and calculates a direction of the light source for each channel of the illuminance sensor 600 in the calculated direction. Calculate the ratio change of the area where the photodiode receives light, determine the correction ratio for the direction of the light source of the illuminance sensor 600 based on the calculated ratio change, and respond to the direction of the light source based on the determined correction ratio It is possible to control related operations for correcting the intensity of illumination. According to one embodiment, the operation of the processor 120 is described below.

According to one embodiment, the processor 120 may include at least one component (or module) for an operation according to an embodiment of the present disclosure. For example, the processor 120 includes at least one functional module such as a light source direction estimation module 1010, a ratio change determination module 1020, a correction ratio determination module 1030, and/or a brightness adjustment module 1040. can include According to an embodiment, at least some of the functional modules are included in the processor 120 as hardware modules (eg, circuitry), and/or software including one or more instructions executable by the processor 120. can be implemented as For example, operations performed by the processor 120 may be executed by instructions stored in the memory 130 and causing the processor 120 to operate when executed.

In an embodiment, the light source direction prediction module 1010 may calculate (eg, predict) a location light source direction of an external light source from data obtained through the light sensor 700 of the illuminance sensor module 900 . According to an embodiment, the light source direction prediction module 1010 determines the direction of the light source and the incident angle at which light is incident from the light source based on data (eg, sensing values of incident light) acquired from the plurality of light sensors 700. can do. In an embodiment, the light source direction estimation module 1010 may obtain data (or information) related to an incident angle of light by an external light source using the optical sensor 700 .

According to an embodiment, the light source direction prediction module 1010 determines the amount of light that is projected onto the optical sensor 700 from a plurality of optical sensors 700 disposed to surround the illuminance sensor 600 outside the illuminance sensor 600. Data related to the angle of incidence can be obtained. In one embodiment, the data related to the incident angle of light is information for determining whether or not the light source is photometric for the illuminance sensor 600, for example, whether or not light is detected and/or detected by the plurality of light sensors 700. It may include information related to the amount of light (and/or intensity of light). According to some embodiments, the data related to the angle of incidence of light may include an angle of incidence of light and/or a range of angles of incidence of light.

According to an embodiment, the light source direction prediction module 1010 uses a plurality of optical sensors 700 disposed outside the illuminance sensor 600 to determine the intensity of light projected onto an area corresponding to each optical sensor 700. (e.g. data related to the incident angle of light) can be measured. In an embodiment, the processor 120 may determine the intensity of light projected onto a first area where the first optical sensor 710 is disposed, the intensity of light projected onto a second region where the second optical sensor 720 is disposed, and a third The intensity of light projected onto the third region where the optical sensor 730 is disposed and/or the intensity of light projected onto the fourth region where the fourth optical sensor 740 is disposed may be acquired. In an embodiment, the light source direction estimation module 1010 may obtain the intensity of light projected onto a corresponding region from the plurality of light sensors 700 disposed in an area around the illuminance sensor 600 .

According to an embodiment, the light source direction prediction module 1010 may calculate (eg, predict) the direction of the light source based on data obtained from the light sensor 700 . According to an embodiment, the light source direction prediction module 1010 may include a position of at least one optical sensor 700 transmitting data among a plurality of optical sensors 700 and/or a position transmitted from the at least one optical sensor 700. The direction of the light source may be determined based on the size of data (eg, light intensity).

For example, the light source direction prediction module 1010 determines that the light source moves to the left when the data of the optical sensors 710 and 720 disposed in the first region 910 in the upper right direction among the regions of the optical sensor 700 increases. It can be determined that it is located in the lower direction. For example, the light source direction prediction module 1010 determines that, when the data of the light sensors 720 and 730 disposed in the second area 920 in the lower right direction among the areas of the light sensor 700 increases, the light source It can be determined that it is located in the upper left direction. For example, when the data of the optical sensors 730 and 740 disposed in the third region 930 in the lower left direction among the regions of the optical sensor 700 increases, the light source direction prediction module 1010 determines that the light source direction is It can be determined that it is located in the upper right direction. For example, the light source direction prediction module 1010 determines that, when the data of the optical sensors 740 and 710 disposed in the fourth region 940 in the upper-left direction among the regions of the optical sensor 700 increases, the light source moves to the right. It can be determined that it is located in the lower direction.

According to an embodiment, the light source direction prediction module 1010 may obtain information about an incident angle of light by comparing the intensity of light that is projected onto at least one area where the light sensor 700 is disposed. For example, the light source direction prediction module 1010 may estimate the inclination (or incident angle) of photometric light by comparing the intensity of light illuminated on a certain region. For example, the light source direction prediction module 1010 determines the intensity (eg, first intensity) of light projected onto the first optical sensor 710 in the first area 910 and the second optical sensor 720 in the first area. It may be determined that the greater the difference in intensity (eg, the second intensity) of the irradiated light is, the greater the incident angle of light is, and the smaller the difference between the first and second intensities is, the smaller the incident angle of light is. In an embodiment, the light source direction prediction module 1010 may determine whether the light emitted to the illuminance sensor 600 is metering based on whether the ratio of the incident angle and the reference angle (eg, vertical) exceeds a threshold value. there is.

In an embodiment, the ratio change determination module 1020 may calculate a ratio change of an area receiving light from the photodiode of each channel of the illuminance sensor 600 in the direction of the light source calculated by the light source direction estimation module 1010. there is. According to an embodiment, the ratio change determination module 1020 calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a specified reference ratio, and determines whether the calculated ratio is deviated beyond a certain level. can determine whether

In one embodiment, the correction ratio determining module 1030 determines the correction ratio for the direction of the light source based on the calculated ratio change when it is determined that the ratio calculated by the ratio determination module 1020 is distorted beyond a certain level. can decide According to an embodiment, the correction ratio determination module 1030 may determine the correction ratio based on a calculation formula such as the example of <Equation 1> described above.

In an embodiment, the brightness adjustment module 1040 may correct the illuminance corresponding to the direction of the light source based on the determined correction ratio and adjust the brightness of the display module 160 based on the corrected illuminance. According to an embodiment, the brightness adjustment module 1040 uses a correction value (eg, a correction ratio) corrected in accordance with the direction of the light source to calculate an illuminance (eg, an illuminance calculation formula as shown in Equation 2 below). ), the illuminance according to the direction of the light source may be corrected, and the brightness of the display module 160 may be adjusted to a brightness corresponding to the corrected illuminance.

According to an embodiment, the brightness adjustment module 1040 may correct an illuminance value measured in response to light acquired using the illuminance sensor 600 . In one embodiment, the brightness adjustment module 1040 may vary the degree of correcting the illuminance value according to the correction ratio. In one embodiment, the larger the incident angle, the larger the dark area generated in the illuminance sensor 600 may be, and accordingly, the larger the incident angle, the larger the correction ratio and the larger the degree of correction of the illuminance value. For example, the brightness control module 1040 may correct a first illuminance value acquired through the illuminance sensor 600 to a second illuminance value when the incident angle of light falls within a first range (or first level). According to an exemplary embodiment, the brightness control module 1040 determines the first light obtained through the illuminance sensor 600 when the incident angle of light falls within a second range (or second level) different from the first range (or first level). The illuminance value may be corrected to a third illuminance value different from the second illuminance value.

In an embodiment, the brightness adjustment module 1040 may determine the illuminance value based on an illuminance calculation formula such as <Equation 2>.

In <Equation 2>, R may represent the intensity of light acquired through at least one red photodiode. G may represent the intensity of light acquired through at least one green photodiode. B may represent the intensity of light obtained through at least one blue photodiode. C may represent the intensity of light acquired through at least one clear photodiode. In <Equation 2>, the coefficient may represent, for example, a correction ratio calculated by <Equation 1>. For example, the brightness control module 1040 may apply a coefficient having a first value (eg, a first correction ratio) to <Equation 2> to light having a first incident angle, and may have a second incident angle. A coefficient having a second value for light (eg, a second correction ratio) may be applied to <Equation 2>.

According to an embodiment, the processor 120 may perform an application layer processing function requested by a user of the electronic device 101 . According to an embodiment, the processor 120 may provide functional control and commands for various blocks of the electronic device 101 . According to an embodiment, the processor 120 may perform calculations or data processing related to control and/or communication of each component of the electronic device 101 . For example, the processor 120 may include at least some of the components and/or functions of the processor 120 of FIG. 1 . The processor 120 may be operatively connected to components of the electronic device 101 , for example. The processor 120 may load commands or data received from other components of the electronic device 101 into the memory 130, process the commands or data stored in the memory 130, and store resultant data. there is.

According to one embodiment, the processor 120 may include processing circuitry and/or executable program elements. According to an embodiment, the processor 120 determines the biased light source (or light) generated due to the FOV limit according to the arrangement structure of the illuminance sensor and/or the display structure, based on the processing circuit and/or the executable program element. It is possible to control (or process) operations related to reducing miscalculation of illuminance due to orientation.

According to one embodiment, operations performed by the processor 120 may be implemented as a recording medium (or a computer program product). For example, the recording medium may include a non-transitory computer-readable recording medium in which a program for executing various operations performed by the processor 120 is recorded.

The embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to hardware implementation, the operations described in one embodiment are ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays) ), processors, controllers, micro-controllers, microprocessors, and/or electrical units for performing other functions. .

In one embodiment, the recording medium (or computer program product) includes an operation of obtaining a sensing value of incident light incident from an external light source through an optical sensor disposed in a form surrounding an illuminance sensor, and the light source based on the sensing value An operation of calculating a direction of , an operation of calculating a change in ratio of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction, and an operation of calculating a change in ratio of an area receiving light in the calculated direction, and an operation of calculating the direction of the light source of the illuminance sensor based on the calculated ratio change. It may include a computer-readable recording medium recording a program for executing an operation of determining a correction ratio for , and an operation of correcting an illuminance corresponding to a direction of the light source based on the determined correction ratio.

In various embodiments, the instructions include an operation of obtaining a sensing value of incident light through the optical sensor 700, calculating a direction of a light source based on the sensing value, and calculating a direction of each channel of the illuminance sensor 600 in the calculated direction. An operation of calculating the ratio change of the area receiving light from the photodiode, an operation of determining a correction ratio for the direction of the light source of the illuminance sensor 600 based on the calculated ratio change, and an operation of determining the direction of the light source based on the determined correction ratio It may include instructions for executing an operation of correcting the illuminance corresponding to . According to one embodiment, the above operations performed by the processor 120 may be included in a computer-readable recording medium in which a program is recorded.

The electronic device 101 according to an embodiment of the present disclosure senses incident light incident from a display module (eg, the display module 160 of FIG. 1 , the display 201 or 301 of FIG. 2 or 3 ) and an external light source. An illuminance sensor module (eg, the illuminance sensor 600 of FIGS. 6, 7, or 10) and an optical sensor (eg, the optical sensor 700 of FIGS. 6, 7, or 10) set to 900), a memory (eg, the memory 130 of FIG. 1 or 10), and the display module, the illuminance sensor module, and a processor operatively connected to the memory (eg, the processor 120 of FIG. 1 or 10). )), wherein the processor obtains a sensing value of the incident light through the light sensor, calculates a direction of the light source based on the sensing value, and calculates a direction of each channel of the illuminance sensor in the calculated direction. A photodiode calculates a ratio change of an area receiving light, determines a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change, and determines a direction of the light source based on the determined correction ratio. It can operate to correct the illuminance corresponding to .

According to an embodiment, the optical sensor may be disposed in a form surrounding the illuminance sensor based on a horizontal reference point of the illuminance sensor.

According to an embodiment, a plurality of optical sensors may be formed to surround the illuminance sensor, and the plurality of optical sensors may be disposed in a symmetrical structure.

According to an embodiment, the optical sensor may include four optical sensors disposed above, below, left, and right outside the illuminance sensor.

According to an embodiment, the light sensor may include eight light sensors respectively disposed outside the upper, lower, left, right, upper left, upper right, lower left, and lower right edges of the illuminance sensor.

According to an embodiment, the processor may operate to calculate a direction of the light source based on a criterion in which the light source is incident when the light source is located in a direction perpendicular to the illuminance sensor.

According to an embodiment, the processor may operate to calculate a direction of the light source based on a degree to which incident light of the light source is sensed by the light sensor, using the light sensor disposed outside the illuminance sensor. there is.

According to an embodiment, the processor is configured to obtain data related to an incident angle of light shining onto the optical sensor from an optical sensor disposed outside the illuminance sensor and to surround the illuminance sensor, and Data related to is information for determining whether the light source is photometric for the illuminance sensor, and may include information related to whether or not light is sensed by the light sensor, the amount of detected light, and/or the intensity of light.

According to an embodiment, the processor determines the direction of the light source based on the position of at least one optical sensor transmitting the sensing value among the optical sensors and/or the size of the sensing value transmitted from the at least one optical sensor. can act to determine

According to an embodiment, the processor calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a designated reference ratio, and when the calculated ratio is distorted by more than a certain level, the calculation Based on the ratio change, a correction ratio for the direction of the light source may be determined.

According to an embodiment, the processor may operate to determine a correction ratio based on a ratio of an area illuminated by the light sensor according to the calculated photometric light source direction.

According to an embodiment, the processor may operate to correct the illuminance according to the direction of the light source by applying a correction ratio corrected corresponding to the direction of the light source to an illuminance calculation formula.

According to an embodiment, the processor may operate to adjust the brightness of the display module based on the corrected illuminance.

The electronic device 101 according to an embodiment of the present disclosure includes a display module (eg, the display module 160 of FIG. 1 , the display 201 or 301 of FIG. 2 or 3 ), an illuminance sensor (eg, the display module 160 of FIG. 6 , The illuminance sensor 600 of FIG. 7 or 10), an optical sensor disposed outside the illuminance sensor and configured to sense incident light incident from an external light source (eg, the optical sensor 700 of FIGS. 6, 7, or 10) )), a memory (eg, the memory 130 of FIG. 1 or 10), and a processor operatively connected to the display module, the illuminance sensor, the light sensor, and the memory, the processor comprising: Obtains a sensing value of the incident light through an optical sensor, calculates a ratio of an area receiving light from a photodiode of each channel of the illumination sensor based on the sensing value, and calculates a ratio of the illumination sensor based on the calculated ratio. A correction ratio for the direction of the light source may be determined, and an illumination intensity may be corrected based on the determined correction ratio.

Hereinafter, an operating method of the electronic device 101 according to various embodiments will be described in detail. Operations performed by the electronic device 101 described below are performed by the processor 120 including various processing circuitry and/or executable program elements of the electronic device 101. can be executed According to an embodiment, operations performed by the electronic device 101 may be executed by instructions that are stored in the memory 130 and cause the processor 120 to operate when executed.

11 is a flowchart illustrating a method of operating an electronic device according to an exemplary embodiment.

According to an embodiment, FIG. 11 illustrates direction calculation of a light source based on data measured from a plurality of light sensors 700 disposed outside an illuminance sensor 600 in an electronic device 101 according to an embodiment, and An example of an operation of correcting the illuminance according to FIG.

According to an embodiment, the processor 120 of the electronic device 101 may measure ambient light around the electronic device 101 through the light sensor 600 . According to an embodiment, the processor 120 may obtain data about the intensity of light in bands corresponding to the R, G, B, and C channels.

For example, the processor 120 may obtain data about the intensity of light in a band corresponding to the red filter from at least one photodiode including a red filter (eg, a red photodiode) among the photodiodes. For example, the processor 120 may obtain data about the intensity of light in a band corresponding to the green filter from at least one photodiode including a green filter (eg, a green photodiode) among the photodiodes. For example, the processor 120 may obtain data about the intensity of light in a band corresponding to the blue filter from at least one photodiode including a blue filter (eg, a blue photodiode) among the photodiodes. For example, the processor 120 may obtain data about the intensity of light in a band corresponding to the clear filter from at least one photodiode including a clear filter (eg, a clear photodiode) among the photodiodes. According to an embodiment, the processor 120 may calculate illuminance based on data obtained for each channel.

According to an embodiment, when light is irradiated to the illuminance sensor 600 of the electronic device 101, the illuminance value obtained through the illuminance sensor 600 may differ from the actual illuminance of the front surface of the electronic device 101. there is. According to the present disclosure, the processor 120 may correct the illuminance using data obtained through the light sensor 700 when calculating (or measuring) the illuminance. To this end, when measuring the illuminance, the processor 120 may correct the illuminance based on the incident angle of light projected onto the illuminance sensor 600 through operations 1101 to 1109 .

Referring to FIG. 11 , in operation 1101, the processor 120 of the electronic device 101 may obtain data (or information) related to an incident angle of light from an external light source using the optical sensor 700.

According to an embodiment, the processor 120 determines the incident angle of light emitted to the optical sensor 700 from the plurality of optical sensors 700 arranged to surround the illuminance sensor 600 outside the illuminance sensor 600. data can be obtained. In one embodiment, the data related to the incident angle of light is information for determining whether or not the light source is photometric for the illuminance sensor 600, for example, whether or not light is detected and/or detected by the plurality of light sensors 700. It may include information related to the amount of light (and/or intensity of light). According to some embodiments, the data related to the angle of incidence of light may include an angle of incidence of light and/or a range of angles of incidence of light.

According to an embodiment, the processor 120 uses a plurality of optical sensors 700 disposed outside the illuminance sensor 600 to determine the intensity of light (for example: data related to the incident angle of light) can be measured. In an embodiment, the processor 120 may determine the intensity of light projected onto a first area where the first optical sensor 710 is disposed, the intensity of light projected onto a second region where the second optical sensor 720 is disposed, and a third The intensity of light projected onto the third region where the optical sensor 730 is disposed and/or the intensity of light projected onto the fourth region where the fourth optical sensor 740 is disposed may be acquired.

In an embodiment, the processor 120 may obtain the intensity of light projected onto a corresponding region from the plurality of light sensors 700 disposed in the surrounding region of the illuminance sensor 600 .

In operation 1103, the processor 120 may calculate the direction of the light source based on data obtained from the light sensor 700. According to an embodiment, the processor 120 may include a position of at least one optical sensor 700 transmitting data among a plurality of optical sensors 700 and/or a size of data transmitted from the at least one optical sensor 700. (e.g. light intensity) to determine the direction of the light source. According to an embodiment, the processor 120 determines that, when data of the optical sensors 710 and 720 disposed in the first region 910 in the upper right direction among the regions of the optical sensor 700 increases, the light source moves to the lower left corner. It can be judged by being located in the direction. For example, when the data of the optical sensors 720 and 730 disposed in the second region 920 in the lower right direction among the regions of the optical sensor 700 increases, the processor 120 moves the light source in the upper left direction. location can be judged. According to an embodiment, the processor 120, when the data of the optical sensors 730 and 740 disposed in the third region 930 in the lower left direction among the regions of the optical sensor 700 increases, sets the light source to the upper right corner. It can be judged by being located in the direction. According to an embodiment, the processor 120, when the data of the optical sensors 740 and 710 disposed in the fourth region 940 in the upper left direction among the regions of the optical sensor 700 increases, the light source moves to the lower right corner. It can be judged by being located in the direction.

According to an embodiment, the processor 120 may obtain information about an incident angle of light by comparing an intensity of light that is projected onto at least one area where the light sensor 700 is disposed. For example, the processor 120 may estimate the inclination (or incidence angle) of photometric light by comparing the intensity of light illuminated on a certain area. For example, the processor 120 determines the intensity (eg, first intensity) of light projected onto the first optical sensor 710 in the first region 910 and the intensity of light projected onto the second optical sensor 720 in the first region. It can be determined that the larger the difference in intensity (eg, the second intensity) is, the larger the incident angle of light is, and the smaller the difference between the first and second intensities is, the smaller the incident angle of light is. In an embodiment, the processor 120 may determine whether the light projected onto the illuminance sensor 600 is metering based on whether the ratio of the incident angle and the reference angle (eg, vertical) exceeds a threshold value. For example, the processor 120 may compare the intensity of light projected onto the light sensor 700 to determine whether or not photometric light is projected onto the illuminance sensor 600 .

At operation 1105, the processor 120 may calculate a rate change based on the direction of the light source. According to an embodiment, the processor 120 may calculate a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor 600 in the calculated direction of the light source. According to an embodiment, the processor 120 calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a designated reference ratio, and determines whether the calculated ratio is distorted by a certain amount or more. can do.

At operation 1107, the processor 120 may determine a correction ratio based on the ratio change. According to an embodiment, the processor 120 may determine a correction ratio for the direction of the light source based on a change in the calculated ratio when it is determined that the calculated ratio is distorted beyond a certain level. According to an embodiment, the processor 120 may determine the correction ratio based on a calculation formula such as the example of <Equation 1> described above. According to an embodiment, the processor 120 calculates the ALS/IR ratio based on a formula for compensating the light source direction and the angle of the tilted set (eg, the illuminance sensor module 900) in the calculated light source direction. In consideration of the ratio of the area illuminated by the optical sensor 700 according to the twisted angle (eg, photometry), compensation can be performed as shown in Equation 1. For example, the processor 120 may determine the degree of correction for correcting the illuminance according to a range of incident angles in which the incident angle of light deviates from a specified range by a predetermined amount or more.

In operation 1109, the processor 120 may correct the illuminance based on the correction ratio. According to an embodiment, the processor 120 applies a correction value (eg, a correction ratio) corrected in accordance with the direction of the light source to an illuminance calculation formula (eg, an illuminance calculation formula as shown in Equation 2). Thus, the illuminance according to the direction of the light source can be corrected. For example, the processor 120 may correct an illuminance value measured in response to light acquired using the illuminance sensor 600 . In one embodiment, the processor 120 may vary the degree of correcting the illuminance value according to the correction ratio. In one embodiment, the larger the incident angle, the larger the dark area generated in the illuminance sensor 600 may be, and accordingly, the larger the incident angle, the larger the correction ratio and the larger the degree of correction of the illuminance value. According to an embodiment, the processor 120 may correct the first illuminance value obtained through the illuminance sensor 600 to the second illuminance value when the incident angle of light falls within the first range (or first level).

According to an embodiment, the processor 120 determines the first illuminance value obtained through the illuminance sensor 600 when the incident angle of light falls within a second range (or second level) different from the first range (or first level). may be corrected with a third illuminance value different from the second illuminance value. According to an embodiment, the processor 120 may determine the illuminance value based on an illuminance calculation formula such as the example of Equation 2. For example, the processor 120 may apply a coefficient (eg, a first correction ratio) having a first value to light having a first incident angle to <Equation 2>, and may apply a coefficient having a first value to light having a second incident angle. A coefficient having a second value (eg, a second correction ratio) may be applied to <Equation 2>.

In operation 1111, the processor 120 may adjust the brightness of the display module 160 based on the corrected illuminance. According to an embodiment, the processor 120 may obtain an illuminance value close to the illuminance of the actual electronic device 101 by considering the incident angle of light measured by the optical sensor 700, and thus the surroundings of the actual electronic device 101. The brightness of the display module 1600 may be adjusted to suit the environment.

According to an embodiment, operations 1101 to 1111 may be repeatedly or periodically performed while a function for automatically adjusting the brightness of the display module 160 is being executed. According to an embodiment, the processor 120 may operate to correct the illuminance by performing the operation of FIG. 11 based on whether a change in the illuminance value or a change in the posture of the electronic device 101 is detected. . For example, when a posture change of the electronic device 101 occurs, the incident angle of light projected onto the optical sensor 700 also changes, so the illuminance value may be corrected based on the new incident angle.

An operating method performed by the electronic device 101 according to an embodiment of the present disclosure includes an optical sensor (eg, the illuminance sensor 600 of FIGS. 6, 7, or 10) disposed in a form surrounding an illuminance sensor (eg, the illuminance sensor 600 of FIG. 6, 7, or 10). Obtaining a sensing value of incident light incident from an external light source through the optical sensor 700 of FIG. 6, FIG. 7 or 10), calculating the direction of the light source based on the sensing value, and An operation of calculating a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in a direction, an operation of determining a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change, and An operation of correcting the illuminance corresponding to the direction of the light source based on the determined correction ratio may be included.

According to an embodiment, a plurality of optical sensors may be formed, and the plurality of optical sensors may be disposed in a symmetrical structure.

According to an embodiment, the operation of calculating the direction of the light source may include an operation of calculating the direction of the light source based on a criterion in which the light source is located in a direction perpendicular to the illuminance sensor and is incident.

According to an embodiment, the calculating of the direction of the light source may include obtaining data related to an incident angle of light shining onto the optical sensor from the optical sensor disposed outside the illuminance sensor to surround the illuminance sensor. and determining a direction of the light source based on data related to the incident angle of light, wherein the data related to the incident angle of light is information for determining whether the light source is photometric for the illuminance sensor, It may include information related to whether light is detected by the light sensor, the amount of light detected, and/or the intensity of light.

According to an embodiment, the operation of determining the correction ratio may include an operation of determining the correction ratio based on a ratio of an area illuminated by the light sensor according to the calculated photometry of the direction of the light source.

According to an embodiment, the operation of correcting the illuminance may include an operation of correcting the illuminance according to the direction of the light source by applying a correction ratio corrected corresponding to the direction of the light source to an illuminance calculation formula.

According to one embodiment, the operation of correcting the illuminance may include adjusting the brightness of the display module based on the corrected illuminance.

Various embodiments of the present disclosure disclosed in the present specification and drawings are only presented as specific examples to easily explain the technical content of the present disclosure and help understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modified forms derived based on the technical spirit of the present disclosure in addition to the embodiments disclosed herein.

Claims (15)

1. In electronic devices,

   display;

   an illuminance sensor including an illuminance sensor and an optical sensor configured to sense incident light incident from an external light source;

   Memory; and

   a processor operatively coupled with the display, the ambient light sensor, and the memory, the processor comprising:

   Obtaining a sensing value of the incident light through the optical sensor;

   Calculate the direction of the light source based on the sensing value,

   Calculate a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction;

   Determine a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change, and

   An electronic device configured to correct illuminance corresponding to a direction of the light source based on the determined correction ratio.
2. The method of claim 1, wherein the optical sensor,

   The electronic device characterized in that it is disposed in a form surrounding the illuminance sensor based on the horizontal reference point of the illuminance sensor.
3. The method of claim 1, wherein the optical sensor,

   It is formed in plurality to surround the illuminance sensor,

   The electronic device, characterized in that the plurality of optical sensors are arranged in a symmetrical structure.
4. The method of claim 3, wherein the optical sensor,

   An electronic device configured to include four optical sensors disposed above, below, left, and right outside the illuminance sensor, respectively.
5. The method of claim 3, wherein the optical sensor,

   The electronic device configured to include eight optical sensors respectively disposed outside the upper, lower, left, right, upper left, upper right, lower left, and lower right edges of the illuminance sensor.
6. The method of claim 1, wherein the processor,

   An electronic device configured to calculate a direction of the light source based on a criterion in which the light source is incident in a direction perpendicular to the illuminance sensor.
7. The method of claim 1, wherein the processor,

   The electronic device configured to calculate a direction of the light source based on a degree to which incident light of the light source is sensed by the light sensor by using the light sensor disposed outside the illuminance sensor.
8. The method of claim 7, wherein the processor,

   It is set to acquire data related to an incident angle of light shining on the optical sensor from the optical sensor disposed outside the illuminance sensor to surround the illuminance sensor,

   The data related to the incident angle of the light is information for determining whether the light source is photometric for the illuminance sensor, and includes information related to whether light is detected by the light sensor, the amount of light detected, and / or the intensity of light electronic device.
9. The method of claim 8, wherein the processor,

   An electronic device configured to determine a direction of the light source based on a position of at least one light sensor transmitting the sensed value among the light sensors and/or a magnitude of the sensed value transmitted from the at least one light sensor.
10. The method of claim 1, wherein the processor,

    Calculate the change in ALS / IR ratio in the calculated direction of the light source;

    An electronic device configured to compare the calculated ratio with a specified reference ratio and determine a correction ratio for a direction of the light source based on a change in the calculated ratio when the calculated ratio is distorted by a certain amount or more.
11. The method of claim 10, wherein the processor,

    An electronic device configured to determine a correction ratio based on a ratio of an area illuminated by the light sensor according to the calculated photometric light source direction.
12. The method of claim 1, wherein the processor,

    An electronic device set to adjust the brightness of the display based on the calibrated illuminance.
13. In the method of operating an electronic device,

    obtaining a sensing value of incident light incident from an external light source through an optical sensor disposed to surround the illuminance sensor;

    calculating a direction of the light source based on the sensing value;

    calculating a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction;

    determining a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change; and

    and correcting the illuminance corresponding to the direction of the light source based on the determined correction ratio.
14. The method of claim 13, wherein the operation of calculating the direction of the light source,

    obtaining data related to an incident angle of light projected onto the optical sensor from the optical sensor disposed outside the illuminance sensor to surround the illuminance sensor;

    determining a direction of the light source based on data related to an incident angle of the light;

    The data related to the incident angle of the light is information for determining whether the light source is photometric for the illuminance sensor, and includes information related to whether light is detected by the light sensor, the amount of light detected, and / or the intensity of light method.
15. The method of claim 13, wherein the determining of the correction ratio comprises:

    Determining a correction ratio based on a ratio of an area illuminated by the optical sensor according to the calculated photometry of the direction of the light source;

    The operation of correcting the illuminance,

    Correcting the illuminance according to the direction of the light source by applying the corrected correction ratio corresponding to the direction of the light source to the illuminance calculation formula;

    A method comprising adjusting the brightness of a display based on the calibrated illuminance.

Images