WO2021162241A1

WO2021162241A1 - Method and device for controlling image sensor

Info

Publication number: WO2021162241A1
Application number: PCT/KR2020/019440
Authority: WO
Inventors: 강가왕; 강화영; 김동수; 이상민; 정재오
Original assignee: 삼성전자 주식회사
Priority date: 2020-02-10
Filing date: 2020-12-30
Publication date: 2021-08-19
Also published as: KR20210101416A

Abstract

An electronic device according to various embodiments of the present invention comprises an image sensor, and a processor functionally connected to the image sensor, wherein the image sensor may be configured to: acquire image data related to an external object; identify the object on the basis of the image data; divide the image data into a plurality of regions on the basis of the identified object; determine a weight for each of the plurality of divided regions; measure a brightness value of each of the plurality of regions; calculate an illumination value of the image data on the basis of the brightness value and the determined weight of each of the plurality of regions; and transmit the calculated illumination value to the processor.

Description

Image sensor control method and device

Various embodiments disclosed in this document relate to a method and apparatus for controlling an image sensor in an electronic device.

With the recent development of technology, electronic devices supporting various user functions, such as a smart phone and a personal computer (PC), have been released. Meanwhile, since these electronic devices include a camera, various functions related to the camera may be provided to the user.

In an electronic device including an image sensor, when the image sensor is driven with a value controlled by the processor of the electronic device, power consumption due to driving the image sensor may be large.

In the case of an image sensor operating by receiving a control signal from a processor of an electronic device, since it outputs a brightness value for a predetermined area, data affecting the determination of the illuminance value may be included, so the reliability of the determined illuminance value may be lowered. have.

According to various embodiments disclosed herein, an electronic device includes an image sensor and a processor operatively connected to the image sensor, wherein the image sensor acquires image data related to an external object, and based on the image data Identifies an object, divides the image data into a plurality of regions based on the identified object, determines a weight for each of the divided regions, and a brightness value for each of the plurality of regions , calculates an illuminance value of the image data based on a brightness value and a determined weight for each of the plurality of regions, and transmits the calculated illuminance value to the processor.

According to various embodiments disclosed in this document, an image sensor includes a memory, and a controller operatively connected to the memory, wherein the controller acquires image data, identifies an object included in the image data, and Classifying the image data into a plurality of regions based on an object, determining a weight for each of the divided regions, measuring a brightness value for each of the plurality of regions, and the plurality of regions Based on the brightness value and the determined weight for each of the illuminance values of the image data may be configured to be calculated.

According to various embodiments disclosed in this document, a storage medium storing instructions is configured to perform at least one operation by the at least one controller when the instructions are executed by the at least one controller, The operation may include obtaining image data related to an external object by using an image sensor functionally connected to the at least one controller, identifying the object based on the image data, and based on the identified object , dividing the image data into a plurality of regions, determining a weight for each of the divided regions, measuring a brightness value for each of the plurality of regions, and the plurality of regions The method may include calculating an illuminance value of the image data based on the brightness value and the determined weight for each of the illuminance values.

The electronic device according to various embodiments of the present disclosure may measure an illuminance value around the electronic device while the image sensor is driven with low power.

According to various embodiments of the present disclosure, the image sensor may be separated from the control of the processor of the electronic device to measure the illuminance value.

According to various embodiments of the present disclosure, the electronic device may improve the accuracy of the illuminance value by using the image sensor, and may drive the image sensor with low power.

According to various embodiments of the present disclosure, since the illuminance value can be measured through the image sensor, the image sensor also functions as the illuminance sensor, thereby reducing the need for a separate illuminance sensor. As the need for a separate illuminance sensor is reduced, material costs can be reduced and design freedom can be secured.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

2 is a block diagram of an electronic device according to various embodiments of the present disclosure;

3 is an operation flowchart of an image sensor according to various embodiments of the present disclosure;

4 is an operation flowchart of a processor and an image sensor of an electronic device according to various embodiments of the present disclosure;

5A and 5B are diagrams illustrating a method for an image sensor to measure an illuminance value of image data according to various embodiments of the present disclosure;

6A and 6B are diagrams illustrating a method in which an image sensor measures an illuminance value of image data according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. there is.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

According to various embodiments, the electronic device 101 may include a plurality of camera modules 180 each having different properties (eg, angle of view) or functions. In this case, for example, the plurality of camera modules 180 may include at least one of a wide-angle camera, a telephoto camera, and an IR camera (eg, a time of flight camera, a structured light camera). For example, a plurality of camera modules 180 including lenses having different angles of view are configured, and the electronic device may control to change the angle of view according to a user's selection. According to an embodiment, at least one of the plurality of camera modules 180 may be a front camera, and at least the other may be a rear camera.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 and 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more of the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

Referring to FIG. 2 , an electronic device 101 according to various embodiments includes an image sensor 210 , a processor 220 (eg, the processor 120 of FIG. 1 ), or a display 230 (eg, the display of FIG. 1 ). device 160). Even if some of the configuration shown in FIG. 2 is omitted or substituted, there will be no hindrance to implementing the various embodiments disclosed in this document.

The image sensor 210 according to various embodiments may be a component of a camera (eg, the camera module 180 of FIG. 1 ) included in the electronic device 101 . For example, the image sensor 210 may receive power from a power management module (eg, the power management module 188 of FIG. 1 ) to generate image data. The image sensor 210 may transmit the generated image data to another component (eg, the processor 220 ) of the electronic device 101 .

The image sensor 210 according to various embodiments may include a sensor array 211 , a controller 213 , or a memory 215 .

The sensor array 211 according to various embodiments may be a pixel sensor that converts light received through a lens of a camera into an electrical signal to generate image data. The sensor array 211 may amplify a current generated due to, for example, a photoelectric effect of a light receiving element. The sensor array 211 may include, for example, a plurality of two-dimensionally arranged pixels P(i, j); where i and j indicate positions of pixels, i is a row number, and j is may be a column number). For example, at least some of the pixels may include, respectively, a photoelectric transformation element (or a position sensitive detector (PSD)) and a plurality of transistors (eg, a reset transistor, a transfer transistor, a selection transistor, and a driver). transistors) may be included. Also, the sensor array 211 may include a plurality of column lines. Each of the column lines may be electrically connected to pixels arranged in a column direction. The sensor array 211 may be, for example, a CMOS sensor manufactured by complementary metal-oxide-semiconductor (CMOS) technology. Alternatively, the sensor array 211 may include, for example, a charged coupled device (CCD) sensor. The controller 213 according to various embodiments may control and/or control respective components of the image sensor 210 . Alternatively, as a configuration capable of performing communication-related calculations or data processing, each component of the image sensor 210 may be operatively connected.

The memory 215 according to various embodiments may store various data. The data may include, for example, image data generated by the image sensor 210 . Also, the data may include, for example, control information related to image data (eg, a weight, a brightness value, an illuminance value, etc.).

The memory 215 according to various embodiments may be, for example, a buffer.

The memory 215 according to various embodiments may temporarily store at least a portion of an image acquired through the sensor array 211 for a next image processing operation. For example, when image acquisition is delayed depending on the shutter or a plurality of images are acquired at high speed, the acquired original image (eg, Bayer-patterned image or high-resolution image) is stored in the memory 215 and , a copy image corresponding thereto (eg, a low-resolution image) may be previewed through the display 230 . Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a portion of the original image stored in the memory 215 may be acquired and processed by, for example, the controller 213 . According to an embodiment, the memory 215 may be configured as at least a part of the memory 130 of FIG. 1 or as a separate memory operated independently of the memory 130 of FIG. 1 . The processor 220 according to various embodiments is a configuration capable of performing an operation or data processing related to control and/or communication of each component of the electronic device 101 , and includes a configuration and/or a configuration of the processor 120 of FIG. 1 . Or it may include at least some of the functions.

The processor 220 according to various embodiments may be configured as a separate processor operated independently of the controller 213 . When the processor 220 is operated independently of the controller 213 , the processor 220 uses at least one piece of control information processed by the controller 213 to display an image acquired through the sensor array 211 . It may be displayed on the display 230 as it is or after further processing. Also, the processor 220 may adjust the brightness of the display 230 using at least one piece of control information processed by the controller 213 . For example, the processor 220 may check (eg, determine) an illuminance value around the electronic device based on the control information obtained from the controller 213 , and based on the checked illuminance value, You can adjust the brightness.

The processor 220 may be operatively connected to, for example, components of the electronic device 101 .

The display 230 according to various embodiments may display various screens based on the control of the processor 220 . According to various embodiments of the present disclosure, the display 230 may be implemented in the form of a touch sensor panel (TSP) capable of recognizing contact or proximity (eg, hovering) of various external objects. .

The image sensor 210 according to various embodiments may obtain an image corresponding to the external object by converting light emitted or reflected from an external object (eg, a subject) into an electrical signal. According to an embodiment, the image sensor 210 may include, for example, a red-green-blue (RGB) sensor, a black and white (BW) sensor, an infrared (IR) sensor, or an ultraviolet (UV) sensor. It may include one image sensor among these other image sensors, a plurality of image sensors having the same property, or a plurality of image sensors having different properties.

The image sensor 210 according to various embodiments may be an image sensor 210 that can be driven in a low power mode. For example, the image sensor 210 may operate in a software standby mode even when the camera does not operate (eg, operates in the background). The image sensor 210 may, for example, reduce the number of frames per second (FPS) of input image data, use sub-sampling, or reduce data bits. It may be driven in the low power mode through at least one method. The image sensor 210 according to various embodiments may be always on while operating in a low power mode.

The image sensor 210 according to various embodiments may perform an ambient light sensor (ALS) function. The ambient light sensor function may be, for example, a function of acquiring an illuminance value around the sensor through a brightness value of acquired image data. For example, the processor 220 may obtain an illuminance value from the image sensor 210 to adjust the brightness of the display 230 .

The image sensor 210 according to various embodiments may be driven under the control of the processor 220 or may be driven by itself without the control of the processor 220 . For example, the image sensor 210 may be always driven in the low power mode without the control of the processor 220 , and may detect an object included in the image data by analyzing image data obtained in the low power mode.

The controller 213 according to various embodiments may be operatively or functionally connected to, for example, components of an electronic device (eg, the electronic device 101 of FIG. 1 ).

The controller 213 according to various embodiments may acquire image data through the sensor array 211 . The controller 213 according to various embodiments may identify an object included in the acquired image data. The identified object may be, for example, a light source, an object (object), and/or a person (eg, a face or body).

The controller 213 according to various embodiments may identify a light source included in image data. The controller 213 may measure, for example, brightness values of a plurality of consecutive image data. The controller 213 is configured to, for example, control a phenomenon (eg, flicker) designated using at least one of a brightness value, a difference in brightness values, and/or a periodicity of a difference in brightness values of a plurality of consecutive image data. occurrence can be determined. The controller 213 may determine that flicker has occurred, for example, when the brightness values of a plurality of consecutive image data change with a specific period. When flicker occurs, the controller 213 may determine that a light source (eg, a fluorescent lamp) is included in the image data. The controller 213 may identify an object existing at a location where the flicker occurs in the image data as a light source. The controller 213 identifies the light source, for example, based on the proportion of the area occupied by the object in the image (eg, the saturation of the image), and/or the number of objects whose brightness value is greater than a specified number (eg, 60). can do. Also, the controller 213 may identify the light source by determining whether, for example, saturation and/or brightness values of the image are included in a specified range (eg, 60 to 80 ).

The controller 213 according to various embodiments may analyze the acquired image data to determine whether the location of the electronic device 101 is indoors or outdoors.

The controller 213 according to various embodiments may measure a contrast ratio of a plurality of consecutive image data. For example, the controller 213 determines that the electronic device (eg, the electronic device 101 of FIG. 1 ) is located outdoors when the measured contrast ratio is equal to or greater than a preset threshold value (eg, has a high contrast ratio). Also, when it is less than a preset threshold value (eg, when it has a low contrast ratio), it may be determined that the electronic device 101 is located indoors. The controller 213 according to various embodiments may determine a sampling rate of the image sensor 210 based on the determined position of the electronic device 101 .

[Table 1] below is, for example, a table showing the results of the image sensor 210 recognizing a scene and/or a light source in various situations.

According to [Table 1], brightness can be divided into high, medium, and low. When brightness is expressed as 0 to 100, it can be expressed as high if it is 80 or more, medium if it is 60 or more and less than 80, and low if it is less than 60. have. Contrast ratio can be divided into high, medium, and low. Like brightness, when expressed as 0 to 100, it can be expressed as high if it is 60 or more, medium if it is 30 or more and less than 60, and low if it is 0 or more and less than 30. According to various embodiments, the performance of the sensor array 211 constituting the image sensor 210, the performance of the controller 213 (eg, the number of frames per second; It may be determined in consideration of at least one of the number of sub-sampling and the number of displayed data bits). For example, when the low-priced sensor array 211 is used and the performance is not good, the standard for brightness may be lowered. In [Table 1], brightness is divided into 3 levels and contrast ratio is divided into 3 levels, but it can be further subdivided.

	밝기 (brightness) (0~100)brightness (brightness) (0-100)	명암비 (contrast) (0~100)contrast ratio (contrast) (0-100)	플리커 발생 여부 (flicker)Whether flicker occurs (flicker)	광원 존재 여부 (light source)presence of light source (light source)
Case A (실외)Case A (outdoor)	High (예: 85)High (Example: 85)	High (예: 67)High (Example: 67)	XX	XX
Case B (실내)Case B (indoor)	Medium (예: 70)Medium (Example: 70)	Low (예: 25)Low (Example: 25)	XX	--
Case C (실내)Case C (indoor)	Medium (예: 65)Medium (Example: 65)	Low (예: 15)Low (Example: 15)	OO	OO

Referring to Table 1, Case A is a case in which the electronic device 101 including the image sensor 210 is located outdoors. In case A, as a result of the controller 213 measuring the brightness value and contrast ratio of the image data, it is confirmed that the brightness value in the range specified as high (eg 85) and the contrast ratio in the range specified as high (eg 67) were measured can In case A, as a result of the controller 213 identifying the difference in the brightness values and the periodicity of the difference between a plurality of consecutive image data, it can be confirmed that flicker does not occur. Using the above data, the controller 213 may determine that the electronic device 101 is located outdoors and that the light source does not exist in the image data. In this case, since the controller 213 determines that the surrounding environment is a high-illuminance outdoor environment, the sampling rate of the image sensor 210 can be minimized.

Case B is a case in which the electronic device 101 including the image sensor 210 is located indoors. In case B, as a result of the controller 213 measuring the brightness value and contrast ratio of the image data, it is determined that the brightness value in the range specified as medium (eg 70) and the contrast ratio of the range value specified as low (eg 25) were measured. can be checked In case B, as a result of the controller 213 identifying the difference in the brightness values and the periodicity of the difference between a plurality of consecutive image data, it can be confirmed that flicker does not occur. Using the above data, the controller 213 may determine that the electronic device 101 is located indoors and the light source is not a problem. In this case, since the controller 213 determines that the surrounding environment is a low-illuminance indoor environment in which flicker does not occur, the sampling rate of the image sensor 210 may be increased.

Case C is a case in which the electronic device 101 including the image sensor 210 is located indoors. In case C, as a result of the controller 213 measuring the brightness value and contrast ratio of the image data, it is confirmed that the brightness value in the range specified as medium (eg 65) and the contrast ratio in the range specified as low (eg 15) were measured can In case C, as a result of the controller 213 identifying the difference in brightness values and the periodicity of the difference between a plurality of consecutive image data, it can be confirmed that flicker has occurred. Using the above data, the controller 213 may determine that the electronic device 101 is located indoors and a light source exists in the image data. In this case, since the controller 213 determines that the surrounding environment is a low-illuminance indoor environment in which a light source exists, it is possible to increase the sampling rate of the image sensor 210 and reduce the brightness fluctuation of image data due to flicker. can be corrected.

The controller 213 according to various embodiments may identify a designated object (eg, a person) among objects included in the image data. For example, the controller 213 may identify a person included in the image data. The controller 213 according to various embodiments may recognize a human face included in the image data through face recognition. The controller 213 may detect, for example, the position of the face and/or the angle of the face in the image data. The controller 213 according to various embodiments may recognize the upper body of a person included in the image data through omega (Ω) shape recognition.

The controller 213 according to various embodiments may divide the acquired image data into a plurality of regions. The controller 213 may divide the image data into, for example, an area including the identified object and an area not including the identified object. The controller 213 according to various embodiments may determine the number of a plurality of regions to be divided based on an area occupied by an object identified on the image data. The controller 213 may select one of the predetermined division methods, for example, based on an area occupied by the identified object. The predetermined division method may include, for example, 2*2, 3*3, 4*4, 16*16 division method, and of course, various division methods may be applied in addition. For example, if there is one identified object and the size of the identified object occupies 25% of the total area of the image data, the controller 213 selects a 2*2 division method and divides the image data into a specified division shape (eg, : It can be divided into a total of 4 areas consisting of a rectangular division shape).

The controller 213 according to various embodiments may determine the number of a plurality of regions to be divided based on the shape of the object identified on the image data. The controller 213, for example, when the shape of the identified object is a polygon (eg, a square, a pentagon), the controller 213, the same or similar shape of the divided shape (eg, the shape of the identified object) : It can be divided into a plurality of regions (not shown) consisting of a quadrangular division shape, a pentagonal division shape).

According to various embodiments, the controller 213 may change the reliability of the illuminance value based on the low power level of the image sensor (eg, the image sensor 210 ). For example, the controller 213 may change the low power level to further reduce power consumed by the image sensor 210 , and may change the reliability of the illuminance value based on the changed low power level. For example, the controller 213 may set the first reliability (eg, more than 90%) in the first low-power stage, and set the second reliability (eg, less than 50% to less than 90%) in the second low-power stage. have. In an embodiment, the controller 213 may determine the number of a plurality of regions to be divided based on the changed reliability. For example, the controller 213 may set the 16*16 division method in the case of the first reliability, and may set the 4*4 division method in the case of the second reliability.

The controller 213 according to various embodiments may determine a weight for each of a plurality of divided regions. The weight may be, for example, a weight applied to an area brightness value in order to accurately measure an illuminance value. The controller 213 determines a weight of at least one area in which the identified object is located among the plurality of areas as a first value, and determines the weight of at least one area in which the identified object is located among the plurality of areas, and determines the weight of at least one area among the plurality of areas except for the at least one area (eg, the identified object). It is possible to determine the weight of regions in which is not located) as a second value greater than the first value. The controller 213 may calculate the illuminance value with high reliability (eg, 90% or more) by setting the weight of the region that affects (eg, error) on the determination of the illuminance value to a small value. For example, the controller 213 may set the weight of an area in which the identified object is located among the plurality of areas to a value smaller than a specified value, and set the weight of an area in which the identified object is not located among the plurality of areas. It can be set to a value greater than the specified value. For example, the controller 213 sets the weight of the region in which the identified object is located among the plurality of regions to 0, and sets the illuminance value of the image data except for the region in which the identified object is located among the plurality of regions. You can also calculate The controller 213 according to various embodiments may calculate the illuminance value of the image data without considering the weights by setting the weights of all regions to 0.

The controller 213 according to various embodiments may measure a brightness value of each of a plurality of regions.

The image sensor 210 according to various embodiments may control an acquisition range of data (eg, image data) for determining an illuminance value when performing an ambient light sensor function. For example, the image sensor 210 may increase the number of frames per second (FPS) of acquired image data to calculate an illuminance value with high reliability (eg, 90% or more), and based on a plurality of data The illuminance value can be determined. According to an embodiment, the range in which the image sensor 210 acquires data related to the ambient light sensor function is not limited to the described embodiment, and the data acquisition range may be changed according to various algorithms.

The controller 213 according to various embodiments may calculate an illuminance value of the image data based on a brightness value and/or a determined weight for each of the plurality of regions. The controller 213 may apply, for example, a weight determined to a brightness value measured for each of the plurality of areas, and output it as an illuminance value. The calculated illuminance value may be output as simple numeric data. For example, the controller 213 may calculate the illuminance value as a byte unit to output the illuminance value in the low power mode.

The controller 213 according to various embodiments may transmit the calculated illuminance value to the processor 220 of the electronic device 101 .

The processor 220 of the electronic device 101 according to various embodiments may control the brightness of the display 230 based on the illuminance value received through the image sensor 210 . For example, when the received illuminance value is less than a preset threshold illuminance value, the brightness of the display 230 may be set low, and when the received illuminance value is equal to or greater than the preset threshold illuminance value, the brightness of the display 230 may be set high.

The controller 213 according to various embodiments may adjust the sampling rate according to a change in the position of the identified object. The controller 213 may, for example, identify an object included in a plurality of image data. The controller 213 may determine whether the position of the identified object on two consecutive image data among the plurality of image data has changed by more than a preset threshold value. The controller 213 may determine the sampling rate based on the determined result.

The controller 213 according to various embodiments may determine the sampling rate as a relatively high value in response to a change in the position of the identified object by more than a preset threshold value. For example, when the position of the identified object changes by more than a preset threshold value, the controller 213 may determine that the movement is large and determine that the illuminance environment may change. In this case, the controller 213 may increase the sampling rate.

The controller 213 according to various embodiments may determine the sampling rate as a relatively low value in response to a change in the position of the identified object to be less than a preset threshold value. For example, when the position of the identified object changes to less than a preset threshold value, the controller 213 may determine that the movement is small and determine that the illuminance environment does not change. In this case, the controller 213 may lower the sampling rate.

Referring to the operation flowchart 300 , the controller 213 of the image sensor (eg, the image sensor 210 of FIG. 2 ) according to various embodiments may acquire image data in operation 301 . The controller (eg, the controller 213 of FIG. 2 ) may acquire image data through, for example, a sensor array (eg, the sensor array 211 of FIG. 2 ).

The controller 213 according to various embodiments may identify an object included in the image data in operation 303 . The controller 213 may identify, for example, a person or a light source included in the image data. For example, the controller 213 may measure the brightness values of a plurality of consecutive image data to determine whether flicker has occurred, and in response to determining that the flicker has occurred, identify an object at a location where the flicker occurs as a light source. . The controller 213 may identify a person's face or upper body through, for example, face recognition or omega shape recognition.

The controller 213 according to various embodiments may divide the image data into a plurality of regions in operation 305 . For example, the controller 213 may divide the image data into an area including the identified object and an area not including the identified object. For example, the controller 213 may divide the image data into a plurality of regions by selecting one of a predetermined division method based on an area occupied by an object identified on the image data.

The controller 213 according to various embodiments may determine a weight for each of the plurality of regions based on the identified object in operation 307 . The controller 213 may determine a weight for each of the plurality of regions based on the position of the identified object. The weight may be a weight applied to the area brightness value in order to accurately measure the illuminance value. For example, the controller 213 may set the weight of an area in which the identified object is located among the plurality of areas to a small value, and set the weight of an area in which the identified object is not located among the plurality of areas to a large value. can be set.

In operation 309 , the controller 213 according to various embodiments may measure a brightness value of each of the plurality of regions.

In operation 311 , the controller 213 according to various embodiments may calculate an illuminance value of image data based on a brightness value of each of the plurality of areas and a weight determined for each of the plurality of areas.

The controller 213 according to various embodiments may output the calculated illuminance value in operation 313 . For example, the controller 213 may transmit the calculated illuminance value to the processor 220 of the electronic device 101 .

The controller 213 according to various embodiments may calculate an illuminance value of the image data except for some operations in operations 303 to 311 . For example, after operation 305 , the controller 213 may calculate the illuminance value of the image data based on the brightness value of each of the plurality of regions in operation 309 without using a weight for each of the plurality of regions. can

Referring to the operation flowchart 400 , when the electronic device (eg, the electronic device 101 of FIG. 1 ) according to various embodiments is powered on, in

operations

401 and 403 , a processor (eg, the processor 220 of FIG. 2 ) is turned on. )) and an image sensor (eg, the image sensor 210 of FIG. 2 ) may be powered on to turn on the power.

The processor 220 according to various embodiments may start driving the system in operation 405 . In operation 407 , the image sensor 210 according to various embodiments may start driving a camera and drive it in a low power mode. The image sensor 210 may operate in a low power mode including, for example, a software standby mode state. In this case, the image sensor 210 may be always on while the camera including the image sensor 210 operates in the background.

In operation 409 , the image sensor 210 according to various embodiments may acquire image data while operating in a low power mode.

The image sensor 210 according to various embodiments may calculate an optimized illuminance value using image data in operation 411 . The optimized illuminance value may be, for example, the method described with reference to FIG. 3 . The image sensor 210 may, for example, identify an object included in the image data, divide the image data into a plurality of regions based on the identified object, and determine a weight of each of the plurality of regions. In this case, the brightness value of each of the plurality of areas may be measured, and an optimized illuminance value of the image data may be calculated based on the brightness value and the weight value of each of the plurality of areas.

The image sensor 210 according to various embodiments may transmit the calculated illuminance value to the processor 220 in operation 413 .

The processor 220 according to various embodiments may adjust the brightness of a display (eg, the display 230 of FIG. 2 ) based on the received illuminance value in operation 415 . For example, when the received illuminance value is less than a preset threshold illuminance value, the brightness of the display 230 may be set low, and when the received illuminance value is equal to or greater than the preset threshold illuminance value, the brightness of the display 230 may be set high.

According to various embodiments, the operations (eg, 301 to 313 , 401 to 425 ) described in the process or method shown in FIGS. 3 and 4 may be performed sequentially, in parallel, iteratively, or in a heuristic manner. . For example, they may be executed in a different order, some operations may be omitted, or other operations may be added. According to an embodiment, after calculating the optimized illuminance value (eg, the first illuminance value), the image sensor 210 may further acquire additional image data, and based on the additional image data, the additional illuminance value ( For example, the second illuminance value) can be calculated. The image sensor 210 may calculate a third illuminance value using, for example, the first illuminance value and the second illuminance value, and transmit the third illuminance value to the processor 220 .

Referring to FIG. 5A , an image sensor (eg, the image sensor 210 of FIG. 2 ) according to various embodiments may acquire image data and identify an object included in the image data. The image sensor 210 may identify the human face 510 in the image data through, for example, face recognition.

The image sensor 210 according to various embodiments may divide image data into a plurality of regions based on the identified human face 510 . The image sensor 210 may be divided into, for example, an area 520 including the human face 510 and an area 530 not including the human face 510 . The area 530 not including the human face 510 may refer to, for example, an area excluding the area 520 including the human face 510 among image data. The region 520 including the human face may be set, for example, to match the border of the identified human face, or may be set to a shape (eg, square, circular) region corresponding to the size of the identified human face. have. In the case of classifying the figure area corresponding to the identified object size, power consumption of the image sensor 210 may be reduced by reducing the amount of data processing.

Referring to FIG. 5B , the image sensor 210 according to various embodiments sets the weight of the region 520 including the human face to a small value and increases the weight of the region 530 not including the human face to a large value. It can be set as a value. For example, the image sensor 210 sets the weight of the area 520 including the human face to 0, so that the area 520 including the human face (eg, the first area) is excluded, and the human face is selected by the image sensor 210 . The illuminance value of the image data may be calculated using only the brightness value of the region 530 (eg, the second region) not included.

Referring to FIG. 6A , an image sensor (eg, the image sensor 210 of FIG. 2 ) according to various embodiments may acquire image data and identify a plurality of objects included in the image data. The image sensor 210 may identify the human face 710 in the image data through, for example, face recognition. The image sensor 210 detects the light sources 720a to 720i in the image data using, for example, at least one of a brightness value of a plurality of consecutive image data, a difference in brightness values, or a periodicity of a difference in brightness values. can be identified.

Referring to FIG. 6B , the image sensor 210 according to various embodiments may divide the acquired image data into a plurality of regions based on the identified object. The controller 213 may select one of the predetermined division methods, for example, based on an area occupied by the identified object. 6B shows image data in a total of 16

regions

731a, 731b, 731c, 731d, 733a, 733b, 733c, 733d, 735a, 735b, 735c, 735d, 737a, 737b, 737c, and 737d using a 4*4 division method. ) is a diagram showing an embodiment divided by.

The image sensor 210 according to various embodiments may determine a weight for each of a plurality of divided regions. For example, the image sensor 210 may include

regions

733a, 733b, 733c, 733d,

region

735a, 735b, region 735c, and region 735d where the human face 710 and the light sources 720a to 720i are located. The weight of can be set to a small value. The image sensor 210 includes

regions

731a, 731b, 731c, 731d, 737a, 737b, 737c, and 737d where the human face 710 and the light sources 720a to 720i are not located. The weight can be set to a large value. For example, the image sensor 210 sets the weights of the

regions

733a, 733b, 733c, 733d, 735a, 735b, 735c, and 735d including the human face 710 and the light sources 720a to 720i to 0. , it is also possible to calculate the illuminance value of the image data using only the brightness values of the

regions

731a, 731b, 731c, 731d, 737a, 737b, 737c, and 737d that do not include the human face 710 and the light sources 720a to 720i. .

The electronic device 101 according to various embodiments of the present disclosure includes an image sensor 210 and a processor 220 functionally connected to the image sensor, and the image sensor 210 receives image data related to an external object. Acquire (301), identify the object based on the image data (303), divide the image data into a plurality of regions (305) based on the identified object, and divide the plurality of regions determining a weight for each of the regions (307), measuring a brightness value for each of the plurality of regions (309), and based on the brightness value for each of the plurality of regions and the determined weight, and calculate ( 311 ) an illuminance value, and transmit ( 313 ) the calculated illuminance value to the processor.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure determines a weight of at least one region 520 in which the identified object is located among the plurality of regions as a first value, The weight of the regions 530 other than the at least one region among regions may be determined as a second value greater than the first value.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure may be configured to determine the number of the plurality of regions based on an area occupied by the identified object on the image data.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure may operate in a low power mode, wherein the low power mode is at least one of a method of lowering the number of frames per second, a method of using sub-sampling, or a method of reducing data bits. It may be a mode using one method.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure measures brightness values of a plurality of consecutive image data, and determines whether flicker occurs based on the measured brightness values of the plurality of image data and, in response to determining that the flicker has occurred, identify an object at a location where the flicker occurs as a light source.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure determines whether the flicker occurs based on at least one of a brightness value of the plurality of measured image data, a difference in brightness values, or a periodicity of a difference in brightness values. may be configured to determine

The image sensor 210 of the electronic device according to various embodiments of the present disclosure may be configured to measure a contrast ratio of the plurality of consecutive image data and determine a position of the electronic device based on the measured contrast ratio. have.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure may be configured to determine a sampling rate of the image sensor based on the determined location of the electronic device.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure identifies an object included in a plurality of image data, and on two consecutive image data among the plurality of image data, the identified object It may be configured to determine whether the position of ' has changed by more than a preset threshold value, and to determine a sampling rate based on a result of the determination.

The image sensor 210 of the electronic device according to various embodiments of the present disclosure determines the sampling rate to be a relatively high value in response to a change in the position of the identified object by more than a preset threshold value, and In response to a change in the position of the identified object to be less than a preset threshold value, the sampling rate may be determined as a relatively low value.

The electronic device 101 according to various embodiments of the present disclosure further includes a display 160 , and the processor 220 controls the display of the display based on the illuminance value obtained through the image sensor 210 . It can be configured to adjust the brightness.

The image sensor 210 according to various embodiments of the present disclosure includes a memory 215 and a controller 213 functionally connected to the memory, and the controller 213 acquires image data (301), and Identify an object included in the image data (303), divide the image data into a plurality of regions based on the identified object (305), and determine a weight for each of the divided regions ( 307), measure a brightness value for each of the plurality of areas (309), and calculate (311) an illuminance value of the image data based on the brightness value and the determined weight for each of the plurality of areas can be configured.

The controller 213 of the image sensor according to various embodiments of the present disclosure may be configured to transmit the calculated illuminance value to the processor 220 of the electronic device.

The controller 213 of the image sensor according to various embodiments of the present disclosure determines, as a first value, a weight of at least one region 520 in which the identified object is located among the plurality of regions, and the plurality of regions It may be configured to determine the weight of the remaining regions 530 except for the at least one region as a second value greater than the first value.

The controller 213 of the image sensor according to various embodiments of the present disclosure may be configured to determine the number of the plurality of regions based on an area occupied by the identified object on the image data.

The image sensor 210 according to various embodiments of the present disclosure may operate in a low-power mode, wherein the low-power mode is at least one of a method of lowering the number of frames per second, a method of using sub-sampling, and a method of reducing data bits. It may be a mode using .

The controller 213 of the image sensor according to various embodiments of the present disclosure measures the brightness values of a plurality of consecutive image data, and determines whether flicker occurs based on the brightness values of the measured plurality of image data. , and in response to determining that the flicker has occurred, identify an object at a location where the flicker occurs as a light source.

The controller 213 of the image sensor according to various embodiments of the present disclosure may be configured to measure a contrast ratio of the plurality of consecutive image data and determine the position of the electronic device based on the measured contrast ratio .

The controller 213 of the image sensor according to various embodiments of the present disclosure may be configured to determine a sampling rate based on the determined location of the electronic device.

The controller 213 of the image sensor according to various embodiments of the present disclosure identifies an object included in a plurality of image data, and selects the identified object on two consecutive image data among the plurality of image data. It may be configured to determine whether the position has changed by more than a preset threshold value, and to determine a sampling rate based on a result of the determination.

In the storage medium 215 for storing instructions according to various embodiments of the present invention, the instructions are configured to perform at least one operation by the at least one controller 213 when executed by the at least one controller. , the at least one operation is an operation 301 of obtaining image data related to an external object by using an image sensor 210 functionally connected to the at least one controller, and based on the image data, An operation of identifying (303), an operation of dividing the image data into a plurality of regions based on the identified object (305), an operation of determining a weight for each of the plurality of divided regions (307); an operation (309) of measuring a brightness value for each of the plurality of areas, and an operation (311) of calculating an illuminance value of the image data based on the brightness value and the determined weight for each of the plurality of areas; may include

At least one operation of the storage medium 215 according to various embodiments of the present disclosure may further include an operation of transmitting the calculated illuminance value to the processor 220 functionally connected to the at least one controller 213. can

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "A; Each of the phrases "at least one of B, or C" may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other such components, and refer to those components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims

In an electronic device,

image sensor; and

A processor functionally connected to the image sensor,

the image sensor

Acquire image data related to an external object,

identify the object based on the image data;

Based on the identified object, the image data is divided into a plurality of regions,

Determining a weight for each of the plurality of divided regions,

Measuring a brightness value for each of the plurality of areas,

calculating an illuminance value of the image data based on a brightness value and a determined weight for each of the plurality of regions, and

and transmit the calculated illuminance value to the processor.
According to claim 1,

the image sensor

A weight of at least one area in which the identified object is located among the plurality of areas is determined as a first value, and weights of areas other than the at least one area among the plurality of areas are greater than the first value an electronic device configured to determine the second value.
According to claim 1,

the image sensor

and determine the number of the plurality of regions based on an area occupied by the identified object on the image data.
According to claim 1,

The image sensor operates in a low power mode,

The low power mode is a mode using at least one of a method of lowering the number of frames per second, a method of using sub-sampling, and a method of reducing data bits.
According to claim 1,

the image sensor

Measuring the brightness values of a plurality of consecutive image data,

Based on the brightness values of the measured plurality of image data, it is determined whether flicker occurs, and

and in response to determining that the flicker has occurred, identify an object at a location where the flicker occurs as a light source.
6. The method of claim 5,

the image sensor

and determine whether the flicker occurs based on at least one of a brightness value of the plurality of measured image data, a difference in brightness values, or a periodicity of a difference in brightness values.
6. The method of claim 5,

the image sensor

Measuring the contrast ratio of the plurality of consecutive image data, and

and determine a position of the electronic device based on the measured contrast ratio.
8. The method of claim 7,

the image sensor

and determine a sampling rate of the image sensor based on the determined position of the electronic device.
According to claim 1,

the image sensor

Identifies an object included in a plurality of image data,

It is determined whether the position of the identified object has changed by more than a preset threshold value on two consecutive image data among the plurality of image data, and

and determine a sampling rate based on a result of the determination.
10. The method of claim 9,

the image sensor

In response to a change in the position of the identified object by more than a preset threshold, determining the sampling rate as a relatively high value, and

and determine the sampling rate as a relatively low value in response to a change in the position of the identified object to be less than a preset threshold value.
According to claim 1,

further comprising a display,

The processor is

and to adjust the brightness of the display based on the illuminance value obtained through the image sensor.
In the image sensor,

Memory; and

a controller operatively connected to the memory;

the controller is

acquiring image data;

Identifies an object included in the image data,

dividing the image data into a plurality of regions based on the identified object,

Determining a weight for each of the plurality of divided regions,

measuring a brightness value for each of the plurality of regions, and

and calculate an illuminance value of the image data based on the determined weight and the brightness value for each of the plurality of regions.
13. The method of claim 12,

the controller is

an image sensor configured to transmit the calculated illuminance value to a processor of an electronic device.
13. The method of claim 12,

the controller is

A weight of at least one area in which the identified object is located among the plurality of areas is determined as a first value, and weights of areas other than the at least one area among the plurality of areas are greater than the first value. an image sensor configured to determine with the second value.
13. The method of claim 12,

the controller is

and determine the number of the plurality of regions based on an area occupied by the identified object on the image data.