WO2023106614A1 - Procédé et dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique - Google Patents

Procédé et dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique Download PDF

Info

Publication number
WO2023106614A1
WO2023106614A1 PCT/KR2022/015980 KR2022015980W WO2023106614A1 WO 2023106614 A1 WO2023106614 A1 WO 2023106614A1 KR 2022015980 W KR2022015980 W KR 2022015980W WO 2023106614 A1 WO2023106614 A1 WO 2023106614A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
sensor
light source
illuminance
electronic device
Prior art date
Application number
PCT/KR2022/015980
Other languages
English (en)
Korean (ko)
Inventor
최광호
김규성
김종아
윤희웅
이기혁
이동한
조정호
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020220004875A external-priority patent/KR20230085038A/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2023106614A1 publication Critical patent/WO2023106614A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/08—Arrangements of light sources specially adapted for photometry standard sources, also using luminescent or radioactive material
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/44—Electric circuits

Definitions

  • Embodiments of the present disclosure provide a method and apparatus capable of improving the accuracy of illuminance measurement in an electronic device.
  • an electronic device includes a display for visual support and can display various contents through the display.
  • Electronic devices provide a function of adjusting brightness, contrast, and/or luminance of a display for user convenience.
  • the electronic device includes a function of detecting ambient light using an ambient light sensor (ALS) and automatically adjusting the brightness of the display in response to the ambient light.
  • ALS ambient light sensor
  • the electronic device may be used in an inactive area other than the display area of the display (eg, a bezel arrangement structure) (eg, a black matrix (BM) area or an inactive area) or an active area of the display (eg, an under-panel arrangement structure) ), an illuminance sensor can be placed (or included), and the brightness of the display can be automatically adjusted based on the measured ambient brightness through the illuminance sensor.
  • a bezel arrangement structure eg, a black matrix (BM) area or an inactive area
  • BM black matrix
  • active area of the display eg, an under-panel arrangement structure
  • the ambient brightness sensing may be inaccurate or difficult to accurately sense due to the FOV (field of view) limitation of the illuminance sensor.
  • FOV field of view
  • the display may operate with a brightness that is darker or brighter than the brightness corresponding to the ambient brightness.
  • accuracy of illuminance (or illuminance value) measured by the illuminance sensor may deteriorate due to a FOV limit.
  • illuminance is miscalculated due to a biased direction of a light source (or light) that occurs due to a field of view (FOV) limit according to an arrangement structure of an ambient light sensor (ALS) and/or a display structure. It discloses a method and device that can reduce the
  • the direction of an external light source (eg, an IR light source) is calculated (eg, predicted), and the measured illuminance is corrected using a change in value according to the angle and/or direction of the external light source, so as to measure the illuminance.
  • an external light source eg, an IR light source
  • the measured illuminance is corrected using a change in value according to the angle and/or direction of the external light source, so as to measure the illuminance.
  • a method and apparatus capable of improving the accuracy of illuminance measurement by calculating a direction of an external light source, calculating a change in ratio according to a FOV limit in the corresponding direction, and compensating for the calculated ratio are disclosed.
  • an optical sensor eg, IR PD
  • a direction of an external light source is calculated using the optical sensor
  • a ratio between the illuminance sensor and IR is calculated in the calculated direction. /IR ratio)
  • the ratio is corrected based on the correction ratio corresponding to the direction of the light source to increase the accuracy of the illuminance and reduce the malfunction of the automatic brightness function.
  • An electronic device includes a display, an illuminance sensor including an illuminance sensor configured to sense incident light incident from an external light source, and an optical sensor, a memory, and operation with the display, the illuminance sensor, and the memory. It may include an enemy-connected processor.
  • the processor may operate to obtain a sensing value of the incident light through the optical sensor.
  • the processor may operate to calculate the direction of the light source based on the sensing value.
  • the processor may operate to calculate a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction.
  • the processor may operate to determine a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change. According to an embodiment, the processor may operate to correct the illuminance corresponding to the direction of the light source based on the determined correction ratio.
  • An electronic device includes a display, an illuminance sensor, an optical sensor disposed outside the illuminance sensor and set to sense incident light incident from an external light source, a memory, and the display, the illuminance sensor, and the display. an optical sensor, and a processor operatively coupled with the memory.
  • the processor may operate to obtain a sensing value of the incident light through the optical sensor.
  • the processor may operate to calculate a ratio of an area receiving light from a photodiode of each channel of the illuminance sensor based on the sensing value.
  • the processor may operate to determine a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio.
  • the processor may operate to correct illuminance based on the determined correction ratio.
  • An operating method of an electronic device may include an operation of obtaining a sensing value of incident light incident from an external light source through an optical sensor disposed to surround an illuminance sensor.
  • the operating method may include calculating a direction of the light source based on the sensing value.
  • the operation method may include an operation of calculating a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction.
  • the operating method may include determining a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change.
  • the operating method may include correcting an illuminance corresponding to a direction of the light source based on the determined correction ratio.
  • a computer-readable recording medium in which a program for executing the method in a processor may be included.
  • a non-transitory computer readable storage medium (or computer program product) storing one or more programs.
  • one or more programs when executed by a processor of an electronic device, obtain a sensing value of incident light incident from an external light source through an optical sensor disposed in a form surrounding an illuminance sensor, the sensing value Calculating the direction of the light source based on the calculated direction, calculating the ratio change of the area receiving light from the photodiode of each channel of the illuminance sensor in the calculated direction, and the illumination sensor based on the calculated ratio change may include instructions for performing an operation of determining a correction ratio for the direction of the light source and an operation of correcting the illuminance corresponding to the direction of the light source based on the determined correction ratio.
  • the field of view (FOV) limit according to the arrangement structure and / or display structure of an ambient light sensor (ALS) occurs. It is possible to reduce the miscalculation of the illuminance due to the biased direction of the light source (or light) (e.g., photometry).
  • the electronic device calculates (eg, predicts) the direction of an external light source and corrects the measured illuminance using a change in value according to the angle and/or direction of the external light source, thereby improving the accuracy of the illuminance measurement. can do.
  • the electronic device 101 may calculate a direction of an external light source, calculate a change in a ratio according to a FOV limit in the corresponding direction, determine a situation in which the calculated ratio is distorted beyond a certain level, and compensate for this. there is.
  • the electronic device 101 may dispose an optical sensor (eg, IR PD) outside the illuminance sensor to calculate the direction of the external light source.
  • the electronic device 101 detects a light source according to a difference in a ratio (eg, ALS/IR ratio) between photodiode light reception and IR light reception for each channel of an illuminance sensor in a direction of a light source (eg, a light metering direction). It is possible to calculate a correction value that compensates for the photometric direction of .
  • the electronic device 101 may apply the calculated correction value to a lux calculation formula to improve the accuracy of illuminance measurement in an external light source (eg, an IR light source).
  • an optical sensor is disposed outside the illuminance sensor, a direction of an external light source is calculated using the optical sensor, a change in ALS/IR ratio is calculated in the calculated direction, and the calculated ratio is When the ratio is distorted beyond a certain level, a correction ratio corresponding to the direction of the light source is determined in consideration of the ratio change, and the illumination intensity is corrected based on the determined correction ratio to increase the accuracy of the illumination intensity and reduce the malfunction of the automatic brightness function.
  • FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
  • FIG. 2 is a diagram illustrating an example of an electronic device according to an embodiment.
  • FIG. 3 is a diagram illustrating an example of an electronic device according to an embodiment.
  • FIG. 4 is a diagram for explaining a difference in light reception amount according to a direction of a light source in an illuminance sensor.
  • 5 is a view for explaining the direction of the amount of light received according to the direction of the light source and the principle of receiving light in a specific direction.
  • FIG. 6 is a diagram illustrating an example of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.
  • FIG. 7 is a diagram illustrating an example of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.
  • FIG. 8 is a diagram illustrating an example of a graph showing relative sensitivity according to wavelengths of an illuminance sensor.
  • FIG. 9 is a diagram for explaining an example of an operation of calculating a direction of a light source in the optical sensor arrangement structure of FIG. 6 according to an exemplary embodiment.
  • FIG. 10 is a diagram schematically illustrating a configuration of an electronic device according to an exemplary embodiment.
  • FIG. 11 is a flowchart illustrating a method of operating an electronic device according to an exemplary embodiment.
  • FIG. 1 is a block diagram of an electronic device 101 within a network environment 100 according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added.
  • some of these components eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.
  • the processor 120 for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • software eg, the program 140
  • processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
  • the processor 120 may include a main processor 121 (eg, a central processing unit (CPU) or an application processor (AP)) or a secondary processor (which may be operated independently of or together with the main processor 121). 123) (e.g., graphic processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor hub processor, or communication processor (CP, communication processor)).
  • main processor 121 e.g., a central processing unit (CPU) or an application processor (AP)
  • a secondary processor which may be operated independently of or together with the main processor 121). 123) (e.g., graphic processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor hub processor, or communication processor (CP, communication processor)).
  • the main processor 121 e.g., a central processing unit (CPU) or an application processor (AP)
  • secondary processor which may be operated independently of or together with the main processor 121).
  • the main processor 121 e.g., graphic processing unit (GPU), neural
  • the secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 may At least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or At least some of the functions or states related to the communication module 190) may be controlled.
  • the auxiliary processor 123 eg, an image signal processor or a communication processor
  • the auxiliary processor 123 may be implemented as part of other functionally related components (eg, the camera module 180 or the communication module 190). there is.
  • the auxiliary processor 123 eg, a neural network processing device
  • AI models can be created through machine learning.
  • Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited.
  • the artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples.
  • the artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, program 140) and commands related thereto.
  • the memory 130 may include volatile memory 132 or non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130, and may include, for example, an operating system (OS) 142, middleware 144, or an application 146. there is.
  • OS operating system
  • middleware middleware
  • application application
  • the input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user).
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output sound signals to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • a receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
  • the display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device.
  • the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of force generated by the touch.
  • the audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.
  • the interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD secure digital
  • connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 may be a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, a : a local area network (LAN) communication module or a power line communication module).
  • a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module).
  • the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199.
  • IMSI International Mobile Subscriber Identifier
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology).
  • NR access technologies include high-speed transmission of high-capacity data (eMBB, mobile broadband), minimization of terminal power and access of multiple terminals (mMTC, massive machine type communications), or high-reliability and low-latency (URLLC, ultra-reliable and low-latency communications) can be supported.
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO, full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported.
  • the wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199).
  • the wireless communication module 192 may be used to realize peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC).
  • peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC.
  • DL downlink
  • UL uplink each of 0.5 ms or less, or round trip 1 ms or less
  • the antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB).
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC) may be additionally formed as a part of the antenna module 197 in addition to the radiator.
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a bottom surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • signal e.g. commands or data
  • commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself.
  • one or more external electronic devices may be requested to perform the function or at least part of the service.
  • One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 .
  • the electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • Electronic devices may be devices of various types.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a camera
  • a wearable device e.g., a smart bracelet
  • first, second, or first or secondary may simply be used to distinguish that component from other corresponding components, and may refer to that component in other respects (eg, importance or order) is not limited.
  • a (eg, first) component is said to be “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively.”
  • the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits.
  • a module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • a storage medium eg, internal memory 136 or external memory 138
  • a machine eg, electronic device 101
  • a processor eg, the processor 120
  • a device eg, the electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.
  • a signal e.g. electromagnetic wave
  • the method according to various embodiments disclosed in this document may be provided by being included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • a computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • a device-readable storage medium eg compact disc read only memory (CD-ROM)
  • an application store eg Play Store TM
  • It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.
  • each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
  • one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg modules or programs
  • the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. .
  • the operations performed by a module, program or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order. may be added, omitted, or one or more other actions may be added.
  • FIG. 2 is a diagram illustrating an example of an electronic device according to an embodiment.
  • FIG. 3 is a diagram illustrating an example of an electronic device according to an exemplary embodiment.
  • FIGS. 2 and 3 may show various examples of a structure in which a sensor circuit (eg, an illuminance sensor and/or a roughness sensor) according to an embodiment of the present disclosure is disposed in the electronic device 101. .
  • a sensor circuit eg, an illuminance sensor and/or a roughness sensor
  • an electronic device 101 may include housings 200 and 300 including a front side, a back side, and side surfaces surrounding a space between the front and rear sides.
  • the housings 200 and 300 may refer to a structure forming some of the front, rear, and side surfaces.
  • the front surface may be formed by a front plate 210, 310 that is at least partially transparent (eg, a glass plate including various coating layers, or a polymer plate). there is.
  • the back surface may be formed by a substantially opaque back plate (not shown).
  • the back plate may be coated or tinted glass, ceramic, polymer, metal (eg, aluminum, stainless steel (STS), or magnesium), or at least two of the foregoing. can be formed by combination.
  • the side surfaces may be coupled to the front plates 210 and 310 and the rear plates and may be formed by a side bezel structure (or “side member”) including metal and/or polymer.
  • the back plate and side bezel structure may be integrally formed and include the same material (eg, a metal material such as aluminum).
  • the displays 201 and 301 may be exposed, for example, through a significant portion of the front plates 210 and 310 .
  • the displays 201 and 301 may be implemented in various forms including a liquid crystal display (LCD), an organic light emitting diode (OLED), or an active matrix OLED (AMOLED).
  • the displays 201 and 301 may display moving images or still images based on the control of a processor (eg, the processor 120 of FIG. 1 ), and may display various external objects (eg, human hands) on the displays 201 and 301 . , stylus pen) may receive an input.
  • the displays 201 and 301 may include touch sensors to receive inputs from various external objects.
  • the display 201 or 301 includes a touch sensing circuit (or touch sensor), a pressure sensor capable of measuring the strength (pressure) of a touch, and/or a digitizer that detects a magnetic stylus pen and They may be combined or placed adjacent to each other.
  • a touch sensing circuit or touch sensor
  • a pressure sensor capable of measuring the strength (pressure) of a touch
  • a digitizer that detects a magnetic stylus pen and They may be combined or placed adjacent to each other.
  • FIG. 2 may show an example in which the sensor module 230 including a proximity sensor, an illuminance sensor, and/or a roughness sensor is disposed on the front plate 210 of the electronic device 101 .
  • an electronic device 101 includes a display 201, a front plate 210, and a housing 200, and the display 201 and sound are mounted on the front plate 210. It may include an output device 220 , a sensor module 230 , a camera module 240 , and/or an indicator 250 . In some embodiments, the electronic device 101 may omit at least one of the components (eg, the indicator 250) or may additionally include other components.
  • a sensor module 330 including a proximity sensor, an illuminance sensor, and/or a roughness sensor is located under the display 301 of the electronic device 101 (eg, under the panel). ).
  • an electronic device 101 includes a display 301, a front plate 310, and a housing 300, and a sensor module 330 and a sensor module 330 under the display 301.
  • a camera module 340 may be included.
  • the electronic device 101 may additionally include other components (eg, the sound output device 220 and the indicator 250) as described in the description with reference to FIG. 2 .
  • the audio output device 220 may be disposed at the edge of the bezel area.
  • the electronic device 101 according to the embodiment of FIG. 3 may include an under panel speaker using the display 301 (eg, OLED) as a diaphragm.
  • an under-panel speaker may be placed under the display 301 and not visible from the outside.
  • the sound output device 220 may include a speaker.
  • the speaker may include a receiver for a call.
  • the sensor modules 230 and 330 may generate electrical signals or data values corresponding to an internal operating state of the electronic device 101 or an external environmental state.
  • the sensor modules 230 and 330 may include, for example, a proximity sensor, an illuminance sensor, and/or a roughness sensor.
  • the proximity sensor may detect an external object approaching the electronic device 101 .
  • the proximity sensor may include a light emitter that emits infrared rays and a light receiver that receives infrared rays reflected by an external object.
  • the illuminance sensor may measure illumination around the electronic device 101 (eg, a magnitude (unit: lux) detected by the ambient brightness).
  • the illuminance sensor may measure illuminance by measuring the amount of light through a pre-created hole.
  • the camera modules 240 and 240 may include one or a plurality of lenses, an image sensor, and/or an image signal processor. In some embodiments, two or more lenses (eg, wide-angle and telephoto lenses) and image sensors may be disposed on one side (eg, front and/or rear) of the electronic device 101 .
  • the indicator 250 may provide, for example, state information of the electronic device 101 in the form of light. In one embodiment, the indicator 250 may provide a light source interlocked with the operation of the camera modules 240 and 240 .
  • the indicator 250 includes, for example, a luminous element such as a light emitting diode (LED), an infrared (IR) LED, a laser diode (LD), and/or a xenon lamp. can do.
  • a sensor module 230 (eg, a proximity sensor, an ambient light sensor) (eg, the sensor module 176 of FIG. 1 ) may be disposed on the front plate 210 of the housing 200 .
  • the electronic device 101 may place an illuminance sensor in an inactive area of the display 201, the illuminance sensor measures illuminance (or ambient light), and based on this, It can be used for adjusting the brightness of the display 201.
  • the sensor module 330 may be disposed below the display 301 between the front surface of the housing 300 and the rear surface facing the front surface.
  • the electronic device 101 may place an illuminance sensor in an active area of the display 301, and the illuminance sensor may adjust the illuminance (or Ambient brightness) can be measured, and based on this, it can be used for adjusting the brightness of the display 301 .
  • the illuminance sensor may adjust the illuminance (or Ambient brightness) can be measured, and based on this, it can be used for adjusting the brightness of the display 301 .
  • the electronic device 101 may correct an illuminance measurement value using color on pixel ratio (COPR) information.
  • the illuminance sensor may measure the illuminance only during the display off time to minimize the influence of the display 201 or 301, and additionally correct the illuminance measurement value based on the color displayed on the display 201 or 301. You may.
  • the display off time of the display 201 or 301 may indicate a time for the illuminance sensor not to be affected by the brightness of the display 201 or 301 when sensing the illuminance.
  • the display off time can be used to control the timing to reduce the impact of the illumination measurement due to the display of the displays 201 and 301 .
  • the COPR information may be used to correct an illuminance measurement value based on a color displayed on the displays 201 and 301 . For example, since white is bright and black is dark, correction values may be different according to colors.
  • a high value of the R channel among red, green, and blue (RGB) channels of the illuminance sensor may be output, and the R channel value of the illuminance sensor is corrected. can do.
  • the displays 201 and 301 of the electronic device 101 may be implemented with a design with an increased area occupied on the front surface (eg, a bezel-less display), and various parts disposed on the front surface (eg, shown in FIG. 3 ).
  • the sensor module 330 and the camera module 340) may be disposed between the display 301 and the rear surface or may be disposed inside the display 301 .
  • the proximity sensor, illuminance sensor, and/or camera module 340 has an under display sensor structure between the display 301 and the rear surface (or the lower part of the display 301 (eg, the under display sensor)). panel)).
  • the sensor module 330 eg, a proximity sensor, an illuminance sensor
  • the camera module 340 have an in-display sensor structure and are integrated with the display 301 to display ( 301) can be formed in.
  • a sensor eg, a sensor module 330 and/or a camera module 340
  • OCTA on cell touch AMOLED
  • the size of the area where various components eg, a proximity sensor, an illuminance sensor, and/or a camera module
  • various components eg, a proximity sensor, an illuminance sensor, and/or a camera module
  • display structures in which electronic components are disposed between the display 301 and the back plate or within the display 301 are increasing.
  • the illuminance sensor may measure the illuminance by receiving an external light source through a pre-created hole in the inactive area or the active area and measuring the amount of light.
  • the illuminance accuracy according to the change in the ratio between photodiode light reception and IR light reception for each channel of the illuminance sensor (eg, ALS/IR ratio) may be reduced, which is It may lead to malfunction of automatic brightness control.
  • the ambient light accuracy may be affected.
  • such an accuracy problem may occur in sunlight, and the non-uniform arrangement of the photodiodes and the transmission performance of the filter of the photodiodes may be affected according to the inclination angle of the electronic device 101 (or the illuminance sensor set). there is. An example thereof will be described with reference to FIGS. 4 and 5 .
  • FIG. 4 is a diagram for explaining a difference in light reception amount according to a direction of a light source in an illuminance sensor.
  • 5 is a view for explaining the direction of the amount of light received according to the direction of the light source and the principle of receiving light in a specific direction.
  • examples ⁇ 401> and ⁇ 501> may represent examples in which the light source 450 is positioned in a direction perpendicular to the illuminance sensor 400 .
  • examples ⁇ 403> and ⁇ 503> are cases in which the light source 450 is biased (or tilted) in a first direction (eg, left, right, upper, or lower) that is not perpendicular to the illuminance sensor 400. example can be given.
  • Examples ⁇ 405> and ⁇ 505> may represent examples in which the light source 450 is biased in a second direction (eg, left, right, upper, or lower) that is not perpendicular to the illuminance sensor 400. .
  • the situation in which the direction of the light source 450 is inclined in a direction other than the vertical direction with respect to the illuminance sensor 400 is, for example, when the illuminance sensor 400 receives light in a diagonal direction.
  • This may include a situation where the illuminance sensor 400 is not positioned perpendicular to the light source 450 or the illuminance sensor 400 (or the electronic device 101) is tilted in one direction.
  • Example ⁇ 401> and Example ⁇ 501> when the light source 450 is positioned in a direction perpendicular to the illuminance sensor 400, through the entire area A of the photodiode 410 of the illuminance sensor 400. Light for the light source 450 may be received.
  • Example ⁇ 403> and Example ⁇ 503> when the light source 450 is located in a direction biased toward the first side instead of perpendicular to the illuminance sensor 400, the photodiode of the illuminance sensor 400 according to the FOV limit Light from the light source 450 may be received through a partial area (eg, a specific photodiode area such as area B) instead of the entire area A of 410 .
  • a partial area eg, a specific photodiode area such as area B
  • the photodiode of the illuminance sensor 400 when the light source 450 is located in a direction biased toward the second side instead of being perpendicular to the illuminance sensor 400, the photodiode of the illuminance sensor 400 according to the FOV limit Light from the light source 450 may be received through a partial area (eg, a specific photodiode area such as area C) instead of the entire area A of 410 .
  • a partial area eg, a specific photodiode area such as area C
  • ADC analog digital converter
  • the area of the photodiode 410 receiving light from 450 decreases, the incident light amount decreases and the ADC value can be sensed as low.
  • the area where the photodiode 410 receives light may vary according to the direction of the light source 450 according to the FOV limit.
  • the ratio of ALS/IR used in a calculation method (or calculation formula) designated for calculating illuminance may vary when deflected light reception is performed.
  • the ALS channels of the photodiode 410 eg, R (red), G (green), B A ratio between (blue), and/or C (clear) channel
  • light reception and IR light reception eg, ALS/IR ratio
  • the ALS channels of the photodiode 410 eg, R (red), G (green), B A ratio between (blue), and/or C (clear) channel
  • IR light reception eg, ALS/IR ratio
  • the principle in which the ALS/IR ratio is shifted is that, as described above, the light source 450 is incident on the entire area of the photodiode 410 according to the incident angle (eg, area A, area B, or area C). may be different, and the ratio of each channel may be different because the ratio of the area receiving light of the photodiode for each channel is different at a specific angle.
  • the ratio of IR and ALS may be distorted.
  • the ratio characteristics may vary depending on which direction (eg, left, right, top, or bottom) light is emitted from the illuminance sensor 400.
  • the light source 450 when the illuminance sensor 400 is tilted or the position with the light source 450 is out of the vertical range and light is incident in an oblique direction (eg, a diagonal direction) as photometry, the light source
  • the number of photodiodes 410 that receive light from 450 may vary, and the ratio may vary accordingly.
  • the ratio between the angle at which light is received from the illuminance sensor 400 and the light source 450 (eg, incident angle) and the data for each channel is checked, and when the ratio change is confirmed, the illumination intensity is corrected according to the ratio difference. can act to do so. Through this, in the present disclosure, malfunctions during automatic brightness control of the display module 160 may be reduced.
  • a plurality of optical sensors capable of identifying the direction of the light source 450 are disposed outside (or around) the illuminance sensor 400, and the measured values of the optical sensor (eg, IR PD)
  • the direction of the light source 450 may be calculated (eg, predicted) based on the difference between . Examples of this are shown in FIGS. 6 and 7 .
  • 6 and 7 are diagrams illustrating examples of configuring an illuminance sensor in an electronic device according to an exemplary embodiment.
  • FIG. 8 is a diagram illustrating an example of a graph showing relative sensitivity according to wavelengths of an illuminance sensor.
  • the electronic device 101 includes an illuminance sensor 600 and a plurality of optical sensors 700 (eg, 710, 720, 730, and 740) outside the illuminance sensor 600.
  • the illuminance sensor module 900 (or illuminance sensor set) may be configured.
  • the illuminance sensor module 900 is arranged to surround the illuminance sensor 600 by using a plurality of optical sensors 700 (eg, 710, 720, 730, 740) outside the illuminance sensor 600.
  • the optical sensors 700 may be disposed in a form surrounding the illuminance sensor 600 based on a horizontal reference point (or a flat reference point) of the illuminance sensor 600.
  • the illuminance sensor 600 is a sensor that measures (or detects) the intensity of ambient light, for example, detects light and outputs raw data. can do. According to an embodiment, the illuminance sensor 600 may operate in an interrupt mode to synchronize with COPR information of a display (eg, the display module 160 of FIG. 1 ).
  • the illuminance sensor 600 may have a plurality of channels to detect ambient light.
  • the illuminance sensor 600 generally includes visible light red (R, green), blue (B, blue) of visible light, and all visible light clear (C, clear) in order to receive visible light. ) channels.
  • the illuminance sensor 600 may determine the illuminance value based on the signal intensity according to the amount of light received through the R, G, and B bands of visible light and/or the C band of all visible light.
  • the illuminance sensor 600 may receive light of a specified band in each channel and detect which color of external light is received.
  • individual channels may receive light in an infrared (IR) band as well as a visible light band.
  • the illuminance sensor 600 may include R/G/B channels that receive light of about 450 nm band, about 550 nm band, and about 650 nm band.
  • the illuminance sensor 600 may include a channel (eg, C channel) that receives light of an IR band (eg, a band of about 940 nm).
  • the illuminance sensor 600 includes photodiodes 630 for each wavelength according to color (eg, 630-1, 630-2, 630-3, 630-4, 630- The relative sensitivity of 5) may vary.
  • the blue photodiode can show high responsiveness to light of about 450 nm band, the green photodiode to light of about 550 nm band, and the red photodiode to light of about 650 nm band.
  • the clear photodiode may show high response to light in a band of about 450 nm to about 940 nm.
  • examples of each band of the photodiode 630 are not limited to the disclosed examples, and, for example, about It can be designed in various ways, such as being implemented to accept light in a band of 400 nm to about 1000 nm.
  • the illuminance sensor module 900 arranges a plurality of additional optical sensors 700 (eg, 710, 720, 730, 740) outside the illuminance sensor 600, and the illuminance sensor module ( 900) determine the position of the external light source by determining the light reception ratio of the IR (610) (e.g., 610-1, 610-2, 610-3, 610-4, 610-5, 610-6) according to the tilt angle. It can be calculated (e.g. predicted).
  • the IR e.g., 610-1, 610-2, 610-3, 610-4, 610-5, 610-6
  • the light sensor 700 is a sensor that detects ambient light, and is, for example, an IR photodiode (PD), a spectrometric sensor, RGB sensors, and/or all types of sensors that detect light, such as UV (ultraviolet) sensors.
  • PD IR photodiode
  • RGB sensors spectrometric sensors
  • UV sensors ultraviolet (ultraviolet) sensors.
  • FIG. 6 shows four optical sensors 700 (eg, a first optical sensor 710, a second optical sensor 720, and a third optical sensor 730) around the outer periphery of the illuminance sensor 600. and a first symmetrical structure in which the fourth optical sensor 740 is symmetrically disposed.
  • four light sensors 700 may be disposed on top, bottom, left, and right sides of the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 .
  • FIG. 7 shows eight optical sensors 700 (eg, a first optical sensor 710, a second optical sensor 720, and a third optical sensor 730) around the outer periphery of the illuminance sensor 600. , second symmetry in which the fourth optical sensor 740, the fifth optical sensor 715, the sixth optical sensor 725, the seventh optical sensor 735, and the eighth optical sensor 745) are symmetrically disposed.
  • An example of a structure can be given.
  • eight light sensors 700 e.g., 710 , 720, 730, 740, 715, 725, 735, 745) may be disposed.
  • the arrangement of the optical sensor 700 is not limited to the example of FIG. 6 or 7, and the position of the optical sensor 700 can be designed in various ways considering the mechanical structure, and the direction of the external light source ( Or position) may include various shapes that can be arranged to surround the illuminance sensor 600 in the outer periphery of the illuminance sensor 600 .
  • the electronic device 101 may check whether light is detected through at least one light sensor 700 among the light sensors 700 in the illuminance sensor module 900, and the light sensor detecting the light ( 700), the direction of the external light source may be calculated (eg, predicted.
  • a plurality of light sensors (eg, around the illuminance sensor 600) 700), the angle (eg, the direction of the light source) of the illuminance sensor module 900 (or the illuminance sensor 600 or set) may be determined using the optical sensor 700.
  • the external light source when light is sensed through the first optical sensor 710 to the fourth optical sensor 740, the external light source is positioned in a direction perpendicular to the illuminance sensor 600.
  • the first optical sensor 710 it may be determined that an external light source is located in a first diagonal direction (eg, a downward direction) from the illuminance sensor 600.
  • a second diagonal direction eg, a left direction
  • an external light source is located in a third diagonal direction (eg, an upward direction) from the illuminance sensor 600.
  • a fourth diagonal direction eg, right direction
  • the position of the external light source can be determined in various combinations.
  • the electronic device 101 checks the ratio of data (e.g., amount of light) of the light sensor 700 according to the incident direction of light up, down, left, right as well as top left, bottom left, top right, and bottom right.
  • the direction of the light source may be calculated (eg, predicted) in all directions through a combination of data of the optical sensor 700 .
  • FIG. 9 is a diagram for explaining an example of an operation of calculating a direction of a light source in the optical sensor arrangement structure of FIG. 6 according to an exemplary embodiment.
  • data of the optical sensors 710 and 720 of the first region 910 in the upper right direction may increase.
  • the data of the light sensors 720 and 730 of the second area 920 in the lower right direction may increase.
  • data of the optical sensors 730 and 740 of the third area 930 in the lower left direction may increase.
  • data of the optical sensors 740 and 710 of the fourth region 940 in the upper left direction may increase. This can be summarized as shown in ⁇ Table 1> below.
  • First optical sensor 710 Second optical sensor 720
  • Third optical sensor 730 Fourth optical sensor 740 top left ⁇ ⁇ ⁇ ⁇ bottom left ⁇ ⁇ ⁇ ⁇ top right ⁇ ⁇ ⁇ ⁇ bottom right ⁇ ⁇ ⁇ ⁇ award ⁇ ⁇ ⁇ ⁇ under ⁇ ⁇ ⁇ ⁇ left ⁇ ⁇ ⁇ ⁇ right ⁇ ⁇ ⁇ ⁇
  • an area receiving a small amount of light (eg, amount of light) from a light source may be represented by a triangle ( ⁇ ), and an area receiving a relatively large amount of light may be represented by a circle ( ⁇ ).
  • the direction of the external light source may be calculated (eg, predicted).
  • the direction of an external light source is calculated through the optical sensor 700, and the ratio change of each photodiode 630 of the illuminance sensor 600 is inverted in the calculated direction to correct the illuminance according to the direction of the light source.
  • the electronic device 101 may calculate the direction of the light source based on a reference range in which an external light source is located in a direction perpendicular to the illuminance sensor 600 (eg, the front side) and is incident.
  • the electronic device 101 stores an incident reference range (eg, reference ratio) in the memory 130 when an external light source is located in a direction designated with respect to the illuminance sensor 600 (eg, a vertical direction or a front surface).
  • the illuminance may be corrected by calculating the ratio of each photodiode 630 of the illuminance sensor 600 .
  • the electronic device 101 calculates the direction of the light source, and in the calculated direction, the ratio between the light reception of the photodiode 630 and the light reception of the IR 610 for each channel of the illuminance sensor according to the FOV limit (eg : ALS/IR ratio) change (e.g., an increase or decrease in angle in the reference range) can be calculated, and a situation in which the calculated ALS/IR ratio is distorted beyond a certain level can be determined.
  • the FOV limit eg : ALS/IR ratio
  • the electronic device 101 determines a correction ratio based on the direction of the light source and the angle of the tilted set for the ALS/IR ratio when the ALS/IR ratio is distorted by a certain amount or more, and based on the determined correction ratio
  • the accuracy of the illuminance may be increased and malfunction of the automatic brightness function may be reduced.
  • the ALS/IR ratio may be corrected in the following manner according to the amount of change in the angle.
  • ⁇ Equation 1> may represent an example of an equation for correcting an ALS/IR ratio through a direction of a light source and an angle of an inclined set (eg, the illuminance sensor module 900).
  • the reference range represents the ratio of the light sensor 700 when the light sensor 600 is perpendicular to the light source
  • the ratio difference is the ratio of the light sensor 700 when the light source is inclined.
  • This changed value eg the difference between the reference range and the changed range
  • the electronic device 101 may compensate as shown in ⁇ Equation 1> in consideration of the ratio of the area illuminated by the optical sensor 700 according to the angle (eg, photometry) that is deflected from the direction of the light source.
  • the electronic device 101 detects light from at least one optical sensor 700 of the illuminance sensor module 900, and data by the optical sensor 700 that detects the light ( Example:
  • the correction ratio can be determined by dividing the reference range (or reference ratio) by the ratio of the amount of light) and multiplying it by the ALS/IR ratio to correct the illuminance.
  • the electronic device 101 may calculate a correction value (e.g., correction ratio) for compensating for the direction of the light source with a difference in ALS/IR ratio, and apply the calculated correction value to an illuminance calculation formula. , it is possible to improve the illuminance accuracy according to the direction of the external light source.
  • FIG. 10 is a diagram schematically illustrating a configuration of an electronic device according to an exemplary embodiment.
  • an electronic device 101 may include a display module 160, a memory 130, an illuminance sensor module 900, and a processor 120.
  • the display module 160 can visually provide various information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 includes a touch sensing circuit (or touch sensor), a pressure sensor capable of measuring the strength of a touch, and/or a touch panel (eg, a digitizer) detecting a magnetic stylus pen.
  • the display module 160 is a touch sensing circuit, a pressure sensor, and/or a signal for a specific position of the display module 160 based on the touch panel (eg, voltage, light intensity, resistance, electromagnetic signal, and/or Alternatively, a touch input and/or a hovering input (or proximity input) may be sensed by measuring a change in charge amount.
  • the display module 160 is based on luminance corresponding to manual brightness control by a user input or automatic brightness control by an illuminance value measured by the illuminance sensor 600 under the control of the processor 120. Thus, it can operate with the corresponding brightness.
  • the display module 160 may include a liquid crystal display (LCD), an organic light emitted diode (OLED), or an active matrix organic light emitted diode (AMOLED).
  • the display module 160 may be configured as a flexible display.
  • the illuminance sensor module 900 may include an illuminance sensor 600 and an optical sensor 700 . According to an embodiment, the illuminance sensor module 900 may be disposed in an inactive area of the display module 160 or an active area of the display module 160 . In one embodiment, the illuminance sensor module 900 is directly connected to the processor 120, or an auxiliary processor managing the overall operation of the sensor module (eg, the sensor module 176 of FIG. 1) in the electronic device 101. (e.g. sensor hub or sensor hub processor). When the sculpture sensor module 900 is connected to an auxiliary processor, the operation of the processor 120 may be processed by the auxiliary processor, or the processor 120 and the auxiliary processor may process the operation in parallel.
  • an auxiliary processor managing the overall operation of the sensor module (eg, the sensor module 176 of FIG. 1) in the electronic device 101.
  • the sculpture sensor module 900 is connected to an auxiliary processor, the operation of the processor 120 may be processed by the auxiliary processor, or the processor 120 and the auxiliary processor may process the operation in parallel
  • the illuminance sensor 600 may include a device (or sensor) capable of measuring (or measuring) light (or the amount or amount of light) so that the brightness (or illuminance) of the electronic device 101 can be estimated.
  • the illuminance sensor 600 includes an element (eg, a cadmium sulfide (Cds) element) having a photoelectric effect in which electrons moving inside are generated when light energy (or light) is received and the conductivity is converted. can do.
  • the illuminance sensor 600 may include a roughness sensor combining an illuminance sensor and a proximity sensor into one device (or module).
  • the illuminance sensor 600 may include various sensors that operate (or sense) based on light, such as a picker sensor, a flicker sensor, a color sensor, and/or a spectrometer. can include In one embodiment, the illuminance sensor 600 is a sensor that measures the intensity of ambient light and may include a photodiode. The illuminance sensor 600 may determine the illuminance value through signal intensity (eg, light intensity) according to the amount of light received through the R, G, and B bands of visible light and/or the entire C band of visible light.
  • signal intensity eg, light intensity
  • the optical sensor 700 may be disposed outside the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 .
  • the light sensor 700 is a sensor that detects ambient light, such as an IR photodiode (PD), a spectrometric sensor, an RGB sensor, and/or an ultraviolet (UV) sensor. Any kind of sensor that detects light can be included.
  • PD IR photodiode
  • RGB spectrometric
  • UV ultraviolet
  • the optical sensor 700 may be integrally formed with the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 .
  • the illuminance sensor 600 may include an optical sensor 700 .
  • the optical sensor 700 may be formed separately from the illuminance sensor 600 in a shape surrounding the illuminance sensor 600 .
  • the optical sensor 700 may be formed outside the illuminance sensor 600 .
  • the memory 130 may store various data used by the electronic device 101 .
  • the data may include, for example, input data or output data for an application (eg, the program 140 of FIG. 1 ) and a command related thereto.
  • the memory 130 may store instructions that, when executed, cause the processor 120 to operate.
  • the application may be stored as software on the memory 130 and may be executable by the processor 120 .
  • the applications may be various applications capable of supporting automatic brightness control of the display module 160 based on ambient illumination in the electronic device 101 .
  • the memory 130 obtains a sensing value of incident light through the light sensor 700 according to an embodiment of the present disclosure, calculates a direction of a light source based on the sensing value, and illuminates in the calculated direction.
  • a ratio change of an area receiving light from the photodiode of each channel of the sensor 600 is calculated, a correction ratio for the direction of a light source of the illuminance sensor 600 is determined based on the calculated ratio change, and a correction ratio is determined according to the determined correction ratio.
  • At least one component (or module) related to a function (or operation) of correcting the illuminance corresponding to the direction of the light source may be stored.
  • the memory 130 includes a function of adjusting the brightness of the display module 160 using an illuminance sensor, executable by the processor 120 (eg, an automatic brightness adjustment function) in the form of software (or instruction form). can do.
  • the processor 120 may control a related operation to reduce erroneous calculation of illuminance due to a biased direction of an external light source (or light).
  • the processor 120 calculates the direction of the external light source using data detected by the light sensor 700 disposed outside the illuminance sensor 600, and the ALS/IR ratio in the calculated direction. Calculate the change of , and if the calculated ratio is distorted beyond a certain level, correct the illuminance based on the correction ratio corresponding to the direction of the light source, thereby increasing the accuracy of the illuminance and reducing the malfunction of the automatic brightness function. can do.
  • the processor 120 obtains a sensing value of incident light through the optical sensor 700, calculates a direction of the light source based on the sensing value, and calculates a direction of the light source for each channel of the illuminance sensor 600 in the calculated direction. Calculate the ratio change of the area where the photodiode receives light, determine the correction ratio for the direction of the light source of the illuminance sensor 600 based on the calculated ratio change, and respond to the direction of the light source based on the determined correction ratio It is possible to control related operations for correcting the intensity of illumination. According to one embodiment, the operation of the processor 120 is described below.
  • the processor 120 may include at least one component (or module) for an operation according to an embodiment of the present disclosure.
  • the processor 120 includes at least one functional module such as a light source direction estimation module 1010, a ratio change determination module 1020, a correction ratio determination module 1030, and/or a brightness adjustment module 1040.
  • the functional modules are included in the processor 120 as hardware modules (eg, circuitry), and/or software including one or more instructions executable by the processor 120. can be implemented as For example, operations performed by the processor 120 may be executed by instructions stored in the memory 130 and causing the processor 120 to operate when executed.
  • the light source direction prediction module 1010 may calculate (eg, predict) a location light source direction of an external light source from data obtained through the light sensor 700 of the illuminance sensor module 900 . According to an embodiment, the light source direction prediction module 1010 determines the direction of the light source and the incident angle at which light is incident from the light source based on data (eg, sensing values of incident light) acquired from the plurality of light sensors 700. can do. In an embodiment, the light source direction estimation module 1010 may obtain data (or information) related to an incident angle of light by an external light source using the optical sensor 700 .
  • the light source direction prediction module 1010 determines the amount of light that is projected onto the optical sensor 700 from a plurality of optical sensors 700 disposed to surround the illuminance sensor 600 outside the illuminance sensor 600. Data related to the angle of incidence can be obtained.
  • the data related to the incident angle of light is information for determining whether or not the light source is photometric for the illuminance sensor 600, for example, whether or not light is detected and/or detected by the plurality of light sensors 700. It may include information related to the amount of light (and/or intensity of light).
  • the data related to the angle of incidence of light may include an angle of incidence of light and/or a range of angles of incidence of light.
  • the light source direction prediction module 1010 uses a plurality of optical sensors 700 disposed outside the illuminance sensor 600 to determine the intensity of light projected onto an area corresponding to each optical sensor 700. (e.g. data related to the incident angle of light) can be measured.
  • the processor 120 may determine the intensity of light projected onto a first area where the first optical sensor 710 is disposed, the intensity of light projected onto a second region where the second optical sensor 720 is disposed, and a third The intensity of light projected onto the third region where the optical sensor 730 is disposed and/or the intensity of light projected onto the fourth region where the fourth optical sensor 740 is disposed may be acquired.
  • the light source direction estimation module 1010 may obtain the intensity of light projected onto a corresponding region from the plurality of light sensors 700 disposed in an area around the illuminance sensor 600 .
  • the light source direction prediction module 1010 may calculate (eg, predict) the direction of the light source based on data obtained from the light sensor 700 .
  • the light source direction prediction module 1010 may include a position of at least one optical sensor 700 transmitting data among a plurality of optical sensors 700 and/or a position transmitted from the at least one optical sensor 700.
  • the direction of the light source may be determined based on the size of data (eg, light intensity).
  • the light source direction prediction module 1010 determines that the light source moves to the left when the data of the optical sensors 710 and 720 disposed in the first region 910 in the upper right direction among the regions of the optical sensor 700 increases. It can be determined that it is located in the lower direction. For example, the light source direction prediction module 1010 determines that, when the data of the light sensors 720 and 730 disposed in the second area 920 in the lower right direction among the areas of the light sensor 700 increases, the light source It can be determined that it is located in the upper left direction.
  • the light source direction prediction module 1010 determines that the light source direction is It can be determined that it is located in the upper right direction. For example, the light source direction prediction module 1010 determines that, when the data of the optical sensors 740 and 710 disposed in the fourth region 940 in the upper-left direction among the regions of the optical sensor 700 increases, the light source moves to the right. It can be determined that it is located in the lower direction.
  • the light source direction prediction module 1010 may obtain information about an incident angle of light by comparing the intensity of light that is projected onto at least one area where the light sensor 700 is disposed. For example, the light source direction prediction module 1010 may estimate the inclination (or incident angle) of photometric light by comparing the intensity of light illuminated on a certain region. For example, the light source direction prediction module 1010 determines the intensity (eg, first intensity) of light projected onto the first optical sensor 710 in the first area 910 and the second optical sensor 720 in the first area.
  • the intensity eg, first intensity
  • the light source direction prediction module 1010 may determine whether the light emitted to the illuminance sensor 600 is metering based on whether the ratio of the incident angle and the reference angle (eg, vertical) exceeds a threshold value. there is.
  • the ratio change determination module 1020 may calculate a ratio change of an area receiving light from the photodiode of each channel of the illuminance sensor 600 in the direction of the light source calculated by the light source direction estimation module 1010. there is. According to an embodiment, the ratio change determination module 1020 calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a specified reference ratio, and determines whether the calculated ratio is deviated beyond a certain level. can determine whether
  • the correction ratio determining module 1030 determines the correction ratio for the direction of the light source based on the calculated ratio change when it is determined that the ratio calculated by the ratio determination module 1020 is distorted beyond a certain level. can decide According to an embodiment, the correction ratio determination module 1030 may determine the correction ratio based on a calculation formula such as the example of ⁇ Equation 1> described above.
  • the brightness adjustment module 1040 may correct the illuminance corresponding to the direction of the light source based on the determined correction ratio and adjust the brightness of the display module 160 based on the corrected illuminance.
  • the brightness adjustment module 1040 uses a correction value (eg, a correction ratio) corrected in accordance with the direction of the light source to calculate an illuminance (eg, an illuminance calculation formula as shown in Equation 2 below). ), the illuminance according to the direction of the light source may be corrected, and the brightness of the display module 160 may be adjusted to a brightness corresponding to the corrected illuminance.
  • the brightness adjustment module 1040 may correct an illuminance value measured in response to light acquired using the illuminance sensor 600 .
  • the brightness adjustment module 1040 may vary the degree of correcting the illuminance value according to the correction ratio.
  • the larger the incident angle the larger the dark area generated in the illuminance sensor 600 may be, and accordingly, the larger the incident angle, the larger the correction ratio and the larger the degree of correction of the illuminance value.
  • the brightness control module 1040 may correct a first illuminance value acquired through the illuminance sensor 600 to a second illuminance value when the incident angle of light falls within a first range (or first level).
  • the brightness control module 1040 determines the first light obtained through the illuminance sensor 600 when the incident angle of light falls within a second range (or second level) different from the first range (or first level).
  • the illuminance value may be corrected to a third illuminance value different from the second illuminance value.
  • the brightness adjustment module 1040 may determine the illuminance value based on an illuminance calculation formula such as ⁇ Equation 2>.
  • R may represent the intensity of light acquired through at least one red photodiode.
  • G may represent the intensity of light acquired through at least one green photodiode.
  • B may represent the intensity of light obtained through at least one blue photodiode.
  • C may represent the intensity of light acquired through at least one clear photodiode.
  • the coefficient may represent, for example, a correction ratio calculated by ⁇ Equation 1>.
  • the brightness control module 1040 may apply a coefficient having a first value (eg, a first correction ratio) to ⁇ Equation 2> to light having a first incident angle, and may have a second incident angle.
  • a coefficient having a second value for light (eg, a second correction ratio) may be applied to ⁇ Equation 2>.
  • the processor 120 may perform an application layer processing function requested by a user of the electronic device 101 .
  • the processor 120 may provide functional control and commands for various blocks of the electronic device 101 .
  • the processor 120 may perform calculations or data processing related to control and/or communication of each component of the electronic device 101 .
  • the processor 120 may include at least some of the components and/or functions of the processor 120 of FIG. 1 .
  • the processor 120 may be operatively connected to components of the electronic device 101 , for example.
  • the processor 120 may load commands or data received from other components of the electronic device 101 into the memory 130, process the commands or data stored in the memory 130, and store resultant data. there is.
  • the processor 120 may include processing circuitry and/or executable program elements. According to an embodiment, the processor 120 determines the biased light source (or light) generated due to the FOV limit according to the arrangement structure of the illuminance sensor and/or the display structure, based on the processing circuit and/or the executable program element. It is possible to control (or process) operations related to reducing miscalculation of illuminance due to orientation.
  • operations performed by the processor 120 may be implemented as a recording medium (or a computer program product).
  • the recording medium may include a non-transitory computer-readable recording medium in which a program for executing various operations performed by the processor 120 is recorded.
  • the embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.
  • the operations described in one embodiment are ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays) ), processors, controllers, micro-controllers, microprocessors, and/or electrical units for performing other functions. .
  • the recording medium includes an operation of obtaining a sensing value of incident light incident from an external light source through an optical sensor disposed in a form surrounding an illuminance sensor, and the light source based on the sensing value
  • An operation of calculating a direction of an operation of calculating a change in ratio of an area receiving light from a photodiode of each channel of the illuminance sensor in the calculated direction, and an operation of calculating a change in ratio of an area receiving light in the calculated direction, and an operation of calculating the direction of the light source of the illuminance sensor based on the calculated ratio change.
  • It may include a computer-readable recording medium recording a program for executing an operation of determining a correction ratio for , and an operation of correcting an illuminance corresponding to a direction of the light source based on the determined correction ratio.
  • the instructions include an operation of obtaining a sensing value of incident light through the optical sensor 700, calculating a direction of a light source based on the sensing value, and calculating a direction of each channel of the illuminance sensor 600 in the calculated direction.
  • It may include instructions for executing an operation of correcting the illuminance corresponding to .
  • the above operations performed by the processor 120 may be included in a computer-readable recording medium in which a program is recorded.
  • the electronic device 101 senses incident light incident from a display module (eg, the display module 160 of FIG. 1 , the display 201 or 301 of FIG. 2 or 3 ) and an external light source.
  • An illuminance sensor module eg, the illuminance sensor 600 of FIGS. 6, 7, or 10
  • an optical sensor eg, the optical sensor 700 of FIGS. 6, 7, or 10
  • a memory eg, the memory 130 of FIG. 1 or 10
  • a photodiode calculates a ratio change of an area receiving light, determines a correction ratio for the direction of the light source of the illuminance sensor based on the calculated ratio change, and determines a direction of the light source based on the determined correction ratio. It can operate to correct the illuminance corresponding to .
  • the optical sensor may be disposed in a form surrounding the illuminance sensor based on a horizontal reference point of the illuminance sensor.
  • a plurality of optical sensors may be formed to surround the illuminance sensor, and the plurality of optical sensors may be disposed in a symmetrical structure.
  • the optical sensor may include four optical sensors disposed above, below, left, and right outside the illuminance sensor.
  • the light sensor may include eight light sensors respectively disposed outside the upper, lower, left, right, upper left, upper right, lower left, and lower right edges of the illuminance sensor.
  • the processor may operate to calculate a direction of the light source based on a criterion in which the light source is incident when the light source is located in a direction perpendicular to the illuminance sensor.
  • the processor may operate to calculate a direction of the light source based on a degree to which incident light of the light source is sensed by the light sensor, using the light sensor disposed outside the illuminance sensor. there is.
  • the processor is configured to obtain data related to an incident angle of light shining onto the optical sensor from an optical sensor disposed outside the illuminance sensor and to surround the illuminance sensor, and Data related to is information for determining whether the light source is photometric for the illuminance sensor, and may include information related to whether or not light is sensed by the light sensor, the amount of detected light, and/or the intensity of light.
  • the processor determines the direction of the light source based on the position of at least one optical sensor transmitting the sensing value among the optical sensors and/or the size of the sensing value transmitted from the at least one optical sensor. can act to determine
  • the processor calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a designated reference ratio, and when the calculated ratio is distorted by more than a certain level, the calculation Based on the ratio change, a correction ratio for the direction of the light source may be determined.
  • the processor may operate to determine a correction ratio based on a ratio of an area illuminated by the light sensor according to the calculated photometric light source direction.
  • the processor may operate to correct the illuminance according to the direction of the light source by applying a correction ratio corrected corresponding to the direction of the light source to an illuminance calculation formula.
  • the processor may operate to adjust the brightness of the display module based on the corrected illuminance.
  • the electronic device 101 includes a display module (eg, the display module 160 of FIG. 1 , the display 201 or 301 of FIG. 2 or 3 ), an illuminance sensor (eg, the display module 160 of FIG. 6 , The illuminance sensor 600 of FIG. 7 or 10), an optical sensor disposed outside the illuminance sensor and configured to sense incident light incident from an external light source (eg, the optical sensor 700 of FIGS. 6, 7, or 10) )), a memory (eg, the memory 130 of FIG.
  • a display module eg, the display module 160 of FIG. 1 , the display 201 or 301 of FIG. 2 or 3
  • an illuminance sensor eg, the display module 160 of FIG. 6 , The illuminance sensor 600 of FIG. 7 or 10
  • an optical sensor disposed outside the illuminance sensor and configured to sense incident light incident from an external light source (eg, the optical sensor 700 of FIGS. 6, 7, or 10) )
  • a memory eg, the memory 130
  • a processor operatively connected to the display module, the illuminance sensor, the light sensor, and the memory, the processor comprising: Obtains a sensing value of the incident light through an optical sensor, calculates a ratio of an area receiving light from a photodiode of each channel of the illumination sensor based on the sensing value, and calculates a ratio of the illumination sensor based on the calculated ratio.
  • a correction ratio for the direction of the light source may be determined, and an illumination intensity may be corrected based on the determined correction ratio.
  • Operations performed by the electronic device 101 described below are performed by the processor 120 including various processing circuitry and/or executable program elements of the electronic device 101. can be executed According to an embodiment, operations performed by the electronic device 101 may be executed by instructions that are stored in the memory 130 and cause the processor 120 to operate when executed.
  • FIG. 11 is a flowchart illustrating a method of operating an electronic device according to an exemplary embodiment.
  • FIG. 11 illustrates direction calculation of a light source based on data measured from a plurality of light sensors 700 disposed outside an illuminance sensor 600 in an electronic device 101 according to an embodiment, and An example of an operation of correcting the illuminance according to FIG.
  • the processor 120 of the electronic device 101 may measure ambient light around the electronic device 101 through the light sensor 600 . According to an embodiment, the processor 120 may obtain data about the intensity of light in bands corresponding to the R, G, B, and C channels.
  • the processor 120 may obtain data about the intensity of light in a band corresponding to the red filter from at least one photodiode including a red filter (eg, a red photodiode) among the photodiodes.
  • the processor 120 may obtain data about the intensity of light in a band corresponding to the green filter from at least one photodiode including a green filter (eg, a green photodiode) among the photodiodes.
  • the processor 120 may obtain data about the intensity of light in a band corresponding to the blue filter from at least one photodiode including a blue filter (eg, a blue photodiode) among the photodiodes.
  • the processor 120 may obtain data about the intensity of light in a band corresponding to the clear filter from at least one photodiode including a clear filter (eg, a clear photodiode) among the photodiodes.
  • the processor 120 may calculate illuminance based on data obtained for each channel.
  • the processor 120 may correct the illuminance using data obtained through the light sensor 700 when calculating (or measuring) the illuminance. To this end, when measuring the illuminance, the processor 120 may correct the illuminance based on the incident angle of light projected onto the illuminance sensor 600 through operations 1101 to 1109 .
  • the processor 120 of the electronic device 101 may obtain data (or information) related to an incident angle of light from an external light source using the optical sensor 700.
  • the processor 120 determines the incident angle of light emitted to the optical sensor 700 from the plurality of optical sensors 700 arranged to surround the illuminance sensor 600 outside the illuminance sensor 600.
  • data can be obtained.
  • the data related to the incident angle of light is information for determining whether or not the light source is photometric for the illuminance sensor 600, for example, whether or not light is detected and/or detected by the plurality of light sensors 700. It may include information related to the amount of light (and/or intensity of light).
  • the data related to the angle of incidence of light may include an angle of incidence of light and/or a range of angles of incidence of light.
  • the processor 120 uses a plurality of optical sensors 700 disposed outside the illuminance sensor 600 to determine the intensity of light (for example: data related to the incident angle of light) can be measured.
  • the processor 120 may determine the intensity of light projected onto a first area where the first optical sensor 710 is disposed, the intensity of light projected onto a second region where the second optical sensor 720 is disposed, and a third The intensity of light projected onto the third region where the optical sensor 730 is disposed and/or the intensity of light projected onto the fourth region where the fourth optical sensor 740 is disposed may be acquired.
  • the processor 120 may obtain the intensity of light projected onto a corresponding region from the plurality of light sensors 700 disposed in the surrounding region of the illuminance sensor 600 .
  • the processor 120 may calculate the direction of the light source based on data obtained from the light sensor 700.
  • the processor 120 may include a position of at least one optical sensor 700 transmitting data among a plurality of optical sensors 700 and/or a size of data transmitted from the at least one optical sensor 700. (e.g. light intensity) to determine the direction of the light source.
  • the processor 120 determines that, when data of the optical sensors 710 and 720 disposed in the first region 910 in the upper right direction among the regions of the optical sensor 700 increases, the light source moves to the lower left corner. It can be judged by being located in the direction.
  • the processor 120 moves the light source in the upper left direction. location can be judged.
  • the processor 120 when the data of the optical sensors 730 and 740 disposed in the third region 930 in the lower left direction among the regions of the optical sensor 700 increases, sets the light source to the upper right corner. It can be judged by being located in the direction.
  • the processor 120 when the data of the optical sensors 740 and 710 disposed in the fourth region 940 in the upper left direction among the regions of the optical sensor 700 increases, the light source moves to the lower right corner. It can be judged by being located in the direction.
  • the processor 120 may obtain information about an incident angle of light by comparing an intensity of light that is projected onto at least one area where the light sensor 700 is disposed. For example, the processor 120 may estimate the inclination (or incidence angle) of photometric light by comparing the intensity of light illuminated on a certain area. For example, the processor 120 determines the intensity (eg, first intensity) of light projected onto the first optical sensor 710 in the first region 910 and the intensity of light projected onto the second optical sensor 720 in the first region. It can be determined that the larger the difference in intensity (eg, the second intensity) is, the larger the incident angle of light is, and the smaller the difference between the first and second intensities is, the smaller the incident angle of light is.
  • the intensity eg, first intensity
  • the processor 120 may determine whether the light projected onto the illuminance sensor 600 is metering based on whether the ratio of the incident angle and the reference angle (eg, vertical) exceeds a threshold value. For example, the processor 120 may compare the intensity of light projected onto the light sensor 700 to determine whether or not photometric light is projected onto the illuminance sensor 600 .
  • the processor 120 may calculate a rate change based on the direction of the light source. According to an embodiment, the processor 120 may calculate a ratio change of an area receiving light from a photodiode of each channel of the illuminance sensor 600 in the calculated direction of the light source. According to an embodiment, the processor 120 calculates a change in the ALS/IR ratio in the calculated direction of the light source, compares the calculated ratio with a designated reference ratio, and determines whether the calculated ratio is distorted by a certain amount or more. can do.
  • the processor 120 may determine a correction ratio based on the ratio change. According to an embodiment, the processor 120 may determine a correction ratio for the direction of the light source based on a change in the calculated ratio when it is determined that the calculated ratio is distorted beyond a certain level. According to an embodiment, the processor 120 may determine the correction ratio based on a calculation formula such as the example of ⁇ Equation 1> described above. According to an embodiment, the processor 120 calculates the ALS/IR ratio based on a formula for compensating the light source direction and the angle of the tilted set (eg, the illuminance sensor module 900) in the calculated light source direction.
  • the processor 120 may determine the degree of correction for correcting the illuminance according to a range of incident angles in which the incident angle of light deviates from a specified range by a predetermined amount or more.
  • the processor 120 may correct the illuminance based on the correction ratio.
  • the processor 120 applies a correction value (eg, a correction ratio) corrected in accordance with the direction of the light source to an illuminance calculation formula (eg, an illuminance calculation formula as shown in Equation 2).
  • a correction value eg, a correction ratio
  • an illuminance calculation formula eg, an illuminance calculation formula as shown in Equation 2
  • the processor 120 may correct an illuminance value measured in response to light acquired using the illuminance sensor 600 .
  • the processor 120 may vary the degree of correcting the illuminance value according to the correction ratio.
  • the larger the incident angle, the larger the dark area generated in the illuminance sensor 600 may be, and accordingly, the larger the incident angle, the larger the correction ratio and the larger the degree of correction of the illuminance value.
  • the processor 120 may correct the first illuminance value obtained through the illuminance sensor 600 to the second illuminance value when the incident angle of light falls within the first range (or first level).
  • the processor 120 determines the first illuminance value obtained through the illuminance sensor 600 when the incident angle of light falls within a second range (or second level) different from the first range (or first level). may be corrected with a third illuminance value different from the second illuminance value.
  • the processor 120 may determine the illuminance value based on an illuminance calculation formula such as the example of Equation 2. For example, the processor 120 may apply a coefficient (eg, a first correction ratio) having a first value to light having a first incident angle to ⁇ Equation 2>, and may apply a coefficient having a first value to light having a second incident angle. A coefficient having a second value (eg, a second correction ratio) may be applied to ⁇ Equation 2>.
  • a coefficient eg, a first correction ratio
  • the processor 120 may adjust the brightness of the display module 160 based on the corrected illuminance.
  • the processor 120 may obtain an illuminance value close to the illuminance of the actual electronic device 101 by considering the incident angle of light measured by the optical sensor 700, and thus the surroundings of the actual electronic device 101.
  • the brightness of the display module 1600 may be adjusted to suit the environment.
  • operations 1101 to 1111 may be repeatedly or periodically performed while a function for automatically adjusting the brightness of the display module 160 is being executed.
  • the processor 120 may operate to correct the illuminance by performing the operation of FIG. 11 based on whether a change in the illuminance value or a change in the posture of the electronic device 101 is detected. . For example, when a posture change of the electronic device 101 occurs, the incident angle of light projected onto the optical sensor 700 also changes, so the illuminance value may be corrected based on the new incident angle.
  • An operating method performed by the electronic device 101 includes an optical sensor (eg, the illuminance sensor 600 of FIGS. 6, 7, or 10) disposed in a form surrounding an illuminance sensor (eg, the illuminance sensor 600 of FIG. 6, 7, or 10). Obtaining a sensing value of incident light incident from an external light source through the optical sensor 700 of FIG. 6, FIG.
  • a plurality of optical sensors may be formed, and the plurality of optical sensors may be disposed in a symmetrical structure.
  • the operation of calculating the direction of the light source may include an operation of calculating the direction of the light source based on a criterion in which the light source is located in a direction perpendicular to the illuminance sensor and is incident.
  • the calculating of the direction of the light source may include obtaining data related to an incident angle of light shining onto the optical sensor from the optical sensor disposed outside the illuminance sensor to surround the illuminance sensor. and determining a direction of the light source based on data related to the incident angle of light, wherein the data related to the incident angle of light is information for determining whether the light source is photometric for the illuminance sensor, It may include information related to whether light is detected by the light sensor, the amount of light detected, and/or the intensity of light.
  • the operation of determining the correction ratio may include an operation of determining the correction ratio based on a ratio of an area illuminated by the light sensor according to the calculated photometry of the direction of the light source.
  • the operation of correcting the illuminance may include an operation of correcting the illuminance according to the direction of the light source by applying a correction ratio corrected corresponding to the direction of the light source to an illuminance calculation formula.
  • the operation of correcting the illuminance may include adjusting the brightness of the display module based on the corrected illuminance.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Telephone Function (AREA)

Abstract

Des modes de réalisation de la présente invention concernent un procédé et un dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique. Un dispositif électronique selon un mode de réalisation de la présente invention peut comprendre : un module d'affichage ; un capteur de lumière ambiante comprenant un ensemble de capteurs de lumière ambiante pour détecter une lumière incidente qui est incidente à partir d'une source de lumière externe, et un capteur optique ; une mémoire ; et un processeur. Le processeur peut fonctionner de manière à obtenir une valeur de détection de la lumière incidente au moyen du capteur optique. Le processeur peut fonctionner de manière à calculer la direction de la source de lumière sur la base de la valeur de détection. Le processeur peut fonctionner de façon à calculer le changement de rapport de la zone d'une photodiode de chaque canal du capteur de lumière ambiante recevant de la lumière à partir de la direction calculée. Le processeur peut fonctionner de façon à déterminer un rapport de correction par rapport à la direction de la source de lumière du capteur de lumière ambiante, sur la base du changement calculé dans le rapport. Le processeur peut fonctionner de façon à corriger la lumière ambiante correspondant à la direction de la source de lumière, sur la base du rapport de correction déterminé. Divers modes de réalisation sont possibles.
PCT/KR2022/015980 2021-12-06 2022-10-19 Procédé et dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique WO2023106614A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2021-0173201 2021-12-06
KR20210173201 2021-12-06
KR10-2022-0004875 2022-01-12
KR1020220004875A KR20230085038A (ko) 2021-12-06 2022-01-12 전자 장치에서 조도 측정의 정확도를 개선하기 위한 방법 및 장치

Publications (1)

Publication Number Publication Date
WO2023106614A1 true WO2023106614A1 (fr) 2023-06-15

Family

ID=86730641

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/015980 WO2023106614A1 (fr) 2021-12-06 2022-10-19 Procédé et dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique

Country Status (1)

Country Link
WO (1) WO2023106614A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100022791A (ko) * 2008-08-20 2010-03-03 삼성전자주식회사 광 감지회로, 이를 구비한 액정표시장치 및 이의 구동방법
US20120236297A1 (en) * 2011-03-16 2012-09-20 Seiko Epson Corporation Optical sensor and electronic apparatus
KR20170096565A (ko) * 2016-02-16 2017-08-24 삼성전자주식회사 전자 장치
KR20180036150A (ko) * 2016-09-30 2018-04-09 삼성전자주식회사 전자 장치에 있어서 분광 검출 장치 및 방법
KR20210087349A (ko) * 2020-01-02 2021-07-12 삼성전자주식회사 라이다 장치 및 그 동작 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100022791A (ko) * 2008-08-20 2010-03-03 삼성전자주식회사 광 감지회로, 이를 구비한 액정표시장치 및 이의 구동방법
US20120236297A1 (en) * 2011-03-16 2012-09-20 Seiko Epson Corporation Optical sensor and electronic apparatus
KR20170096565A (ko) * 2016-02-16 2017-08-24 삼성전자주식회사 전자 장치
KR20180036150A (ko) * 2016-09-30 2018-04-09 삼성전자주식회사 전자 장치에 있어서 분광 검출 장치 및 방법
KR20210087349A (ko) * 2020-01-02 2021-07-12 삼성전자주식회사 라이다 장치 및 그 동작 방법

Similar Documents

Publication Publication Date Title
WO2020101344A1 (fr) Dispositif électronique et procédé de détection d'éclairement basé sur des informations d'affichage sur un dispositif électronique
WO2019074330A1 (fr) Procédé d'obtention d'informations biométriques et dispositif électronique associé
WO2020171551A1 (fr) Dispositif électronique permettant de réguler la luminosité d'un écran
WO2021157908A1 (fr) Dispositif électronique et procédé de commande de la luminosité d'un écran
WO2021162244A1 (fr) Dispositif électronique mobile pliable capable de régler la luminosité d'un dispositif d'affichage par l'intermédiaire d'un capteur de lumière
WO2020071884A1 (fr) Dispositif électronique comprenant un capteur placé sous un écran d'affichage
EP4139914A1 (fr) Dispositif électronique comprenant un dispositif d'affichage
WO2021010737A1 (fr) Dispositif électronique comprenant un capteur optique monté sur la surface arrière d'un dispositif d'affichage
WO2019182408A1 (fr) Dispositif et procédé de compensation de changement de température dans un capteur de pression de jauge de contrainte et procédé d'exécution d'une pression de jauge de contrainte à partir d'un élément d'écran tactile
WO2022244955A1 (fr) Dispositif électronique comprenant un détecteur de proximité ayant une pluralité d'éléments de réception de lumière, et son procédé de commande
WO2022154379A1 (fr) Dispositif électronique et procédé de réglage de luminosité
WO2020036381A1 (fr) Dispositif électronique comprenant un élément de diffusion et un élément de réception de lumière obtenant une lumière diffusée par un élément de diffusion et son procédé de commande
WO2022025494A1 (fr) Dispositif électronique de commande de luminance de dispositif d'affichage et procédé de fonctionnement associé
WO2020111794A1 (fr) Dispositif électronique comprenant un panneau d'affichage comprenant des électrodes ayant des formes différentes pour des zones respectives
WO2023106614A1 (fr) Procédé et dispositif pour améliorer la précision de la mesure d'une lumière ambiante dans un dispositif électronique
WO2022182123A1 (fr) Dispositif électronique comprenant un capteur optique intégré dans un afficheur
WO2022050620A1 (fr) Circuit de détection et dispositif électronique le comprenant
WO2022039498A1 (fr) Appareil électronique comprenant un écran souple
WO2021071111A1 (fr) Dispositif électronique comprenant un détecteur de point, et procédé d'obtention d'informations biométriques utilisant ledit dispositif
WO2023017993A1 (fr) Dispositif électronique pour configurer la luminosité d'un écran à l'aide d'un capteur d'éclairement
WO2022239978A1 (fr) Dispositif électronique comprenant un capteur d'empreinte digitale et procédé
WO2023106712A1 (fr) Dispositif électronique et procédé de fonctionnement de celui-ci
WO2023128364A1 (fr) Panneau d'affichage pour caméra sous l'écran (udc), et dispositif électronique le comprenant
WO2023106711A1 (fr) Dispositif électronique comprenant un dispositif lidar et son procédé de fonctionnement
WO2023008854A1 (fr) Dispositif électronique comprenant un capteur optique intégré dans une unité d'affichage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22904448

Country of ref document: EP

Kind code of ref document: A1