KR20210078656A - Method for providing white balance and electronic device for supporting the same - Google Patents

Abstract

The present invention relates to a method for providing white balance to provide a reliable image and an electronic device supporting the same. According to various embodiments of the present invention, the electronic device comprises an image sensor, a processor operatively coupled to the image sensor, a processor coupled to the processor, and a memory connected to the processor and storing a table including white balance gains for a plurality of color temperatures and a plurality of delta UVs. The memory stores instructions allowing the processor, during execution, to acquire a first image through the image sensor; determine a first white balance gain on the basis of the first image; determine at least one delta UV related to the first white balance gain on the basis of the table and the first white balance gain; check a first color temperature input from a user; determine a second white balance gain on the basis of the table, the first color temperature, and the at least one delta UV; and acquire a second image by applying the second white balance gain to the first image.

Description

METHOD FOR PROVIDING WHITE BALANCE AND ELECTRONIC DEVICE FOR SUPPORTING THE SAME

Various embodiments of the present disclosure relate to a method of providing a white balance and an electronic device supporting the same.

Humans have color constancy in which the white of the subject is perceived as white in response to the light source. For example, a person may perceive white as white regardless of the type of light source (eg, a white lamp, a fluorescent lamp, sunlight, etc.).

On the other hand, an electronic device (eg, a digital camera) may acquire images having different colors for the same subject according to a color temperature of a light source. The electronic device provides a white balance function to compensate for a color difference caused by a color temperature of a light source. For example, the electronic device provides a function of automatically setting (or adjusting) a white balance or setting a white balance according to a color temperature input by a user (or manually).

The electronic device sets the white balance based on the color temperature of the light source. For example, when the electronic device sets the white balance based on the color temperature input by the user, the color temperature (or the correlated color of the light source) on the same black body locus as the color temperature input by the user A white balance gain corresponding to a temperature (correlated color temperature (CCT)) is used.

When the electronic device sets the white balance in consideration of only the color temperature on the blackbody locus, a problem in which the color of an image acquired by the electronic device is distorted may occur. In order to solve the problem that the color of the image is distorted, the electronic device may need a user input for adjusting (eg, fine-tuning) the color of the image. In order for the electronic device to accurately set the white balance, information on (isothermal) chromaticity difference (eg, delta uv) may be required in addition to the color temperature of the light source. A light source (eg artificial light) may have a different color temperature and chromaticity difference (eg delta uv) depending on, for example, the luminescent material and/or radiation efficiency.

Various embodiments of the present invention consider the delta uv of the light source (or adaptive to the delta uv of the light source) based on data (eg, a table) defining a correlation between color temperature, delta uv, and/or white balance gain. ), a method of providing a white balance capable of setting a white balance, and an electronic device supporting the same. Also, various embodiments may provide a method and an electronic device for providing white balance in an electronic device.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

An electronic device according to various embodiments of the present disclosure includes an image sensor, a processor operatively connected to the image sensor, and a white color for a plurality of color temperatures and a plurality of delta uvs connected to the processor and a memory storing a table including white balance gains, wherein the memory, when executed, causes the processor to acquire a first image through the image sensor, and A first white balance gain is determined based on a first image, and at least one delta uv related to the first white balance gain is determined based on the table and the first white balance gain, and a first ascertaining a color temperature, determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv, and applying the second white balance gain to the first image , instructions for obtaining the second image may be stored.

According to various embodiments of the present disclosure, a method of providing a white balance in an electronic device includes: acquiring a first image through an image sensor of the electronic device; and calculating a first white balance gain based on the first image an operation of determining, including white balance gains for a plurality of color temperatures and a plurality of delta uvs, and related to the first white balance gain based on a table stored in the memory of the electronic device and the first white balance gain Determining at least one delta uv, determining a first color temperature input from a user, determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv and obtaining a second image by applying the second white balance gain to the first image.

An electronic device according to various embodiments of the present disclosure includes a camera, a memory for storing a color temperature, a delta uv related to the color temperature, and a plurality of white balance gains, and a processor functionally connected to the camera and the memory and, the processor acquires a first image using the camera, identifies a first white balance gain based on the first image, and includes a color temperature set in the camera, the delta uv, and the first white balance. a second white balance gain may be determined based on the gain and a plurality of white balance gains stored in the memory, and a second image obtained by applying the second white balance gain to the first image may be generated. .

A method for providing a white balance according to various embodiments of the present disclosure and an electronic device supporting the same may provide a more reliable image by setting the white balance in consideration of the delta uv of a light source. In addition, the electronic device may provide white balance without a user input for finely adjusting the color of the image, thereby improving the usability of the electronic device.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram of a camera module according to various embodiments of the present disclosure;
3A and 3B are diagrams for explaining data for providing white balance, according to various embodiments.
4 is a flowchart illustrating a method of providing white balance, according to various embodiments.
5A and 5B are exemplary diagrams for explaining a method of providing a white balance, according to various embodiments.
6 is a flowchart illustrating a method of providing white balance, according to various embodiments.
7 is a flowchart illustrating a method of providing an image, according to various embodiments.
8 is a flowchart illustrating a method of providing white balance, according to various embodiments.
9 is an exemplary diagram for explaining a method of providing white balance, according to various embodiments.
10 is an exemplary diagram for explaining a method of providing a white balance according to a white balance mode of a camera functionally connected to an electronic device, according to various embodiments

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can operate independently or together with the main processor , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used for the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 388 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the electronic devices 102 and 104 may be the same or a different type of the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be executed by one or more of the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram 200 of a camera module 180, according to various embodiments. Referring to FIG. 2 , the camera module 180 includes a lens assembly 210 , a flash 220 , an image sensor 230 , an image stabilizer 240 , a memory 250 (eg, a buffer memory), or an image signal processor. (260). The lens assembly 210 may collect light emitted from a subject, which is an image to be captured. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210 . In this case, the camera module 180 may be, for example, a dual camera, a 360 degree camera, or a spherical camera. The plurality of lens assemblies 210 may have the same lens properties (eg, angle of view, focal length, autofocus, f number, or optical zoom), or at least one lens assembly may have at least one lens assembly and at least another lens lens assembly. It can have one different lens property. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens. The flash 220 may emit a light source used to enhance light emitted from the subject. The flash 220 may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp.

The image sensor 230 may acquire an image corresponding to the subject by converting light transmitted from the subject through the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 is, for example, one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, the same It may include a plurality of image sensors having a property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented as, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

The image stabilizer 240 responds to the movement of the camera module 180 or the electronic device 101 including the same, and at least partially compensates for a negative effect (eg, image shake) caused by the movement on a photographed image. At least one lens or image sensor 230 included in the assembly 210 may be moved or controlled in a specific direction (eg, read-out timing is adjusted, etc.). According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer, and a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 . ) can be used to detect the movement.

The memory 250 may temporarily store at least a portion of the image acquired through the image sensor 230 for a next image processing operation. For example, when image acquisition is delayed according to the shutter or a plurality of images are acquired at high speed, the acquired original image (eg, a high-resolution image) is stored in the memory 250 and a corresponding copy thereof An image (eg, a low-resolution image) may be previewed through the display device 160 . Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a part of the original image stored in the memory 250 may be obtained and processed by, for example, the image signal processor 260 . According to an embodiment, the memory 250 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .

The image signal processor 260 performs image processing (eg, depth map generation, 3D modeling, panorama generation, feature point extraction, Image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening) may be performed. Additionally or alternatively, an image signal processor ( The 260 may perform control (eg, exposure time control, readout timing control, etc.) on at least one (eg, image sensor 230 ) among components included in the camera module 180. Image The image processed by the signal processor 260 is stored back in the memory 250 for further processing, or an external component of the camera module 180 (eg, the memory 130 , the display device 160 , the electronic device 102 ). ), the electronic device 104 , or the server 108. According to an embodiment, the image signal processor 260 is configured as at least a part of the processor 120 or is independent of the processor 120 . In the case of a separate processor, the images processed by the image signal processor 260 are as they are by the processor 120 or after additional image processing is performed by the display device 160 can be displayed through

According to an embodiment, the electronic device 101 may include two or more camera modules 180 each having different properties or functions. In this case, for example, at least one camera module 180 may be a wide-angle camera or a front camera, and at least one other camera module may be a telephoto camera or a rear camera.

3A and 3B are diagrams for explaining data (eg, a table) for providing white balance, according to various embodiments.

3A and 3B , in one embodiment, FIG. 3A shows a correlation between color temperature, delta uv, and white balance gain (hereinafter, to be used interchangeably with 'WB gain') It may be a graph 310 representing

Hereinafter, delta uv (or delta u'v') may be defined, for example, as the degree and direction of deviation from the blackbody trajectory. Also, delta uv may be defined, for example, as the difference between the chromaticity of a point on the blackbody locus and the chromaticity of a light source at the same color temperature (or on an isothermal line) as the one point on the blackbody trajectory. Also, delta uv may be referred to as 'isothermal chromaticity difference'.

Hereinafter, the white balance gain may be a gain (or gain) obtained (or calculated) based on RGB (red, green, blue) data (or RGB signal) of an image obtained from an image sensor. For example, the white balance gain may include adjusting the gain of each (or each channel) of RGB data (or RGB signal) according to the color temperature. In an embodiment, the white balance gain may be a gain to be applied to set (or adjust) the white balance of the image obtained from the image sensor. In an embodiment, the white balance gain may be expressed as a coordinate by an R (red) gain and a B (blue) gain. For example, a horizontal axis of the graph 310 may mean an R gain (Rgain of FIG. 3A ), and a vertical axis may mean a B gain (Bgain of FIG. 3A ). The R gain may be, for example, a reciprocal of a ratio of R (red) data to G (green) data of an image obtained from the image sensor. The B gain may be, for example, a reciprocal of a ratio of B (red) data to G data of an image obtained from the image sensor. Hereinafter, a method of determining (or calculating) the white balance gain will be described in detail later. In one embodiment, in FIG. 3A , the first line 321-1 may represent white balance gains on the blackbody trajectory. For example, the first line 321-1 may indicate white balance gains corresponding to a case in which delta uv (or delta uv data) is 0. In an embodiment, the second line 321 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005. In an embodiment, the third line 321-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005). In an embodiment, the fourth line 321-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010). In an embodiment, the first line 321-1 to the fourth line 321-4 are not limited to the illustrated embodiment, but the first line 321-1 to the fourth line 321-4 according to various embodiments. In addition to the lines 321-4, additional lines (not shown) may be included.

In an embodiment, in FIG. 3A , each of the plurality of lines 331-1 to 331-9 may represent white balance gains corresponding to the same color temperature (or the same correlated color temperature). For example, the white balance gain on the first line 331-1 among the plurality of lines (eg, the first line 331-1 to the ninth line 331-9) is 2000 K ( kelvin) (or absolute temperature). As another example, the white balance gain on the ninth line 331-9 among the plurality of lines (eg, the first line 331-1 to the ninth line 331-9) is 10000 K as the same color temperature. may represent white balance gains corresponding to . White, for example, may have a color temperature between about 3000K and 25000K, and a color temperature between 5000K and 10000K may be identified as a general white range. In an embodiment, the plurality of lines 331-1 to 331-9 may be determined based on at least a color temperature range (eg, 2000K to 10000K) or an interval of color temperature. The plurality of lines 331-1 to 331-9 is not limited to the illustrated embodiment, but an additional line (not shown) in addition to the plurality of lines 331-1 to 331-9 according to various embodiments. may include.

In an embodiment, in FIG. 3A , a symbol 'o' may indicate a white balance gain (or a coordinate of a white balance gain) corresponding to a color temperature and delta uv. For example, the symbol 341 may be a white balance gain corresponding to a case where the color temperature is 3000K and the delta uv is 0.005.

In one embodiment, a plurality of symbols corresponding to the color temperature and delta uv may be defined in the graph 310, and based on the numerical value, interval, or range of the color temperature and the delta uv, the graph 310 The number of symbols in may be changed.

In one embodiment, in FIG. 3B , table 320 (or look-up table) may be a table defining a correlation between color temperature, delta uv, and white balance gain. The table 320 may be, for example, a table including a _{plurality of white balance gains WB 1} to WB ₃₆ corresponding to a plurality of color temperatures and a plurality of delta uvs. In one embodiment, in table 320, A represents when delta uv equals -0.005, B represents when delta uv equals 0, C represents when delta uv equals 0.005, and D represents when delta uv equals 0.010. can indicate However, the present invention is not limited thereto. For example, although the table 320 exemplifies that the interval between delta uvs is set to 0.005, delta uvs may be set at an interval larger or smaller than 0.005 in the table. For another example, the table 320 illustrates that the range of delta uvs is set in the range of -0.005 to 0.010, but the range of delta uvs is, for example, -0.005 or more (eg -0.004) or It can be set in the range from small (eg -0.003) delta uv to 0.010 or more (eg 0.011) or small (eg 0.009) delta uv. Also, the interval of the delta uvs may be, for example, an interval smaller than 0.005 (eg 0.001) or an interval greater than 0.005 (eg 0.010). For example, when the interval between delta uvs is 0.010, A of the graph 320 may be set to -0.010, B may be set to 0, C may be set to 0.010, and D may be set to 0.020. In addition, although the intervals A to D are exemplified as specified intervals, the intervals of A to D may be different from each other. For example, the interval between A to C may be set to 0.005, and the interval from C to D may be set to 0.010. Accordingly, A may be set to -0.005, B may be set to 0, C may be set to 0.005, and D may be set to 0.015.

In an embodiment, among the plurality of white balance gains WB ₁ to WB ₃₆ , when the color temperature is 2000K, the first white balance gain set WB ₁ , WB ₂ , WB ₃ , WB _{4 according to delta uv} ) may be included. In one embodiment, when delta uv is -0.005, according to the color temperature (2000K to 10000K), the second white balance gain set (WB ₁ , WB ₅ , WB ₉ , WB ₁₃ , WB ₁₇ , WB ₂₁ , WB _{25 )} , WB ₂₉ , WB ₃₃ ) may be included. In an embodiment, the electronic device (eg, the electronic device 200 of FIG. 2 ) may perform a white balance operation based on the first white balance gain set or the second white balance gain set. , the table 320 may be a table corresponding to the graph 310 of FIG. 3A . For example, the white balance gain corresponding to the symbol 341 of FIG. 3A may be _{WB 7} as the white balance gain corresponding to the case where the color temperature is 3000K and the delta uv is 0.005 in the table 320 of FIG. 3B. .

In one embodiment, the table 320 is configured in a color temperature range (eg, 2000K to 10000K) guaranteed by (or implementable in the electronic device 101 ) by the electronic device 101 (eg, the camera module 180 ). It can be (or built). However, the present invention is not limited thereto.

In one embodiment, the table 320 may be constructed through experimentation (or measurement). For example, the table may be configured by measuring the color temperature, delta uv, and white balance gain of the light source using measuring equipment in an environment with a light source.

In one embodiment, table 320 may be stored in memory 130 (eg, memory 250 ).

Hereinafter, a method for providing white balance based on the table 320 will be described in detail with reference to FIGS. 4 to 10 .

The electronic device 101 according to various embodiments of the present disclosure includes an image sensor 230 , a processor 120 functionally connected to the image sensor 230 , and a plurality of colors connected to the processor 120 . a memory 130 storing a table 320 including white balance gains for color temperatures and a plurality of delta uvs; ), when executed, the processor 120 acquires a first image through the image sensor 230, determines a first white balance gain based on the first image, and the table 320 and At least one delta uv related to the first white balance gain is determined based on the first white balance gain, a first color temperature input from a user is checked, the table 320, the first color temperature , and determining a second white balance gain based on the at least one delta uv, and applying the second white balance gain to the first image to obtain a second image.

In various embodiments, the instructions determine, by the processor 120 , the delta uv as the at least one delta uv when there is a delta uv corresponding to the first white balance gain in the table 320 . can make it

In various embodiments, the instructions may cause the processor 120 to determine, as the second white balance gain, a white balance gain corresponding to the first color temperature and the delta uv in the table 320 . have.

In various embodiments, the instructions include, when the processor 120 does not have a delta uv corresponding to the first white balance gain in the table 320 , sets the first white balance gain to the table 320 . identify the at least two white balance gains, such that they are on a line formed by at least two adjacent white balance gains corresponding to the same color temperature, and a first corresponding to each of the at least two white balance gains a first for determining a delta uv and a second delta uv as the at least one delta uv, and for determining the second white balance gain based on the first white balance gain and the at least two white balance gains You can let it determine the gain ratio.

In various embodiments, the instructions are configured by the processor 120 based on the table 320, the first color temperature, the first delta uv, the second delta uv, and the first gain ratio. The second white balance gain may be determined.

In various embodiments, the instructions include, when the processor 120 does not have a delta uv corresponding to the first white balance gain in the table 320 , sets the first white balance gain to the table 320 . 1-1 white balance gain and 1-2 white balance gain immediately adjacent corresponding to the 1-1 color temperature, corresponding to a 1-2 color temperature immediately preceding or immediately following the 1-1 color temperature, The 1-3th white balance gain corresponding to a delta uv equal to the 1-1 white balance gain, and the 1-th white balance gain corresponding to the 1-2 color temperature and corresponding to a delta uv equal to the 1-2th white balance gain the 1-1th white balance gain, the 1-2th white balance gain, the 1-3th white balance gain, and the 1-4th white balance to be in an area within a rectangle formed by the 4th white balance gain A gain is checked, and a third delta uv corresponding to the 1-1 white balance gain and the 1-3 white balance gain and a third delta uv corresponding to the 1-2 white balance gain and the 1-4 white balance gain are obtained. A fourth delta uv is determined as the at least one delta uv, and is applied to the first white balance gain, the 1-2 white balance gain, the 1-3 white balance gain, and the 1-4 white balance gain. Based on this, a first gain ratio for determining the second white balance gain may be determined.

In various embodiments, the instructions are configured by the processor 120 based on the table 320, the first color temperature, the third delta uv, the fourth delta uv, and the first gain ratio. The second white balance gain may be determined.

In various embodiments, the instructions include, by the processor 120 , further identifying a second color temperature corresponding to the first white balance gain, the table 320 , the first color temperature, and the at least one The second white balance gain may be determined based on delta uv and a color temperature difference between the first color temperature and the second color temperature.

In various embodiments, the instructions are configured by the processor 120, based on the table 320, the first color temperature, and the at least one delta uv, when the color temperature difference is greater than or equal to a specified color temperature difference. The second white balance gain may be determined by moving the determined white balance gain in the white balance gain direction corresponding to the blackbody locus along the isothermal line.

In various embodiments, the electronic device 101 further includes a display (eg, a display device 160 ), and the instructions include: the processor 120 receiving a user input for executing a camera application; When the user input is received, the second white balance gain is applied to each of a plurality of image frames included in the first image, and the second white balance gain is applied to the plurality of image frames to which the second white balance gain is applied. Display the second image including each as a live view image through the display (eg, the display device 160 ), receive a user input for image capture, and the image sensor 230 By applying the second white balance gain to the image obtained from , a third image may be obtained, and the obtained third image may be stored in the memory 130 .

The electronic device 101 according to various embodiments of the present disclosure includes a camera (eg, the camera module 180 ), a color temperature, a delta uv related to the color temperature, and a memory 130 for storing a plurality of white balance gains. ), and a processor 120 functionally connected to the camera (eg, camera module 180) and the memory 130, wherein the processor 120 includes the camera (eg, camera module 180). to obtain a first image, check a first white balance gain based on the first image, and determine the color temperature set in the camera (eg, the camera module 180 ), the delta uv, and the first white determine a second white balance gain based on the balance gain and a plurality of white balance gains stored in the memory 130 , and generate a second image in which the second white balance gain is applied to the first image can be set.

In various embodiments, the delta uv includes a plurality of delta uvs, and the processor 120 is configured to identify, based on the first white balance gain, at least one delta uv related to the first white balance gain. can be set.

4 is a flowchart 400 for explaining a method of providing white balance, according to various embodiments.

Referring to FIG. 4 , in operation 401 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may acquire a first image through the image sensor 230 .

In an embodiment, the processor 120 (eg, the image signal processor 260 ) performs interpolation processing on electrical image data received from the image sensor 230 to obtain red, green, and blue RGB data. Hereinafter, RGB data will be referred to as 'first image data', and an image constructed based on the first image data will be referred to as 'first image'.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) performs a correlated double sampling (CDS) operation, automatic gain control (AGC), and A/D (analog to digital) conversion operation may be further performed,

In operation 403 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine a first white balance gain based on a first image (or first image data).

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine a white (or gray, or achromatic) region in the first image based on the first image data. . For example, the processor 120 may convert RGB data of each of a plurality of regions (or blocks or patches) of the first image of one image frame, R data, G Data and B data may be integrated (or integrated) respectively. For example, when the first image includes the first region to the ninth region, the processor 120 may determine the R data integration value, the G data integration value, and the B data integration value for each of the first to ninth regions. can be determined (or calculated). The processor 120 may determine a white area among the plurality of areas based on the integrated R data value, the G data integrated value, and the B data integrated value of each of the plurality of areas. For example, the processor 120 may generate R/G (eg, G data integration) of each of the plurality of regions based on the integrated R data value, the G data integration value, and the B data integration value of each of the plurality of regions. It is possible to determine the ratio of the R data total value to the value) and B/G (eg the ratio of the B data total value to the G data total value). The processor 120 may determine, among the plurality of regions, an area within a range in which R/G and B/G are designated (eg, a coordinate range designated from R/G and B/G of the blackbody locus) as the white area. However, the method for the processor 120 to determine the white area is not limited to the above-described example.

In an embodiment, although it is described that the white area is determined based on RGB data obtained by interpolation of image data obtained from the image sensor 230 in the above-described embodiments, the present invention is not limited thereto. For example, the processor 120 may determine the white area using the same or similar method to the above-described method of determining the white area, based on image data obtained from the image sensor 230 before the interpolation process. .

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the reciprocal of each of R/G and B/G of the region determined as the white region as the first white balance gain. However, the method of determining the first white balance gain is not limited to the method of determining the first white balance gain based on R/G and B/G of the region determined as the above-described white region.

In an embodiment, when the processor 120 (eg, the image signal processor 260 ) continuously acquires a plurality of first images (or a plurality of first image data) from the image sensor 230 , the plurality of It is possible to determine first white balance gains for each of the first images of . For example, when obtaining a plurality of image frames constituting a video from the image sensor 230 , the processor 120 may determine first white balance gains for each of the plurality of image frames. have. In an embodiment, the processor 120 may store the determined first white balance gain in the memory 130 (eg, the memory 230 ). For example, when determining first white balance gains for each of the plurality of image frames, the processor 120 may store the determined first white balance gains in the memory 130 .

In operation 405 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table 320 and the first white balance gain, at least one delta associated with the first white balance gain uv can be determined.

In one embodiment, the processor 120 (eg, image signal processor 260 ) provides a white balance gain equal to the first white balance gain (or the coordinates of the first white balance gain (eg, (Rgain, Bgain))). If in this table 320, one delta uv corresponding to the white balance gain equal to the first white balance gain in the table 320 is determined (eg, determined) as the delta uv associated with the first white balance gain. can For example, referring to the table 320 of FIG. 3B , when it is determined _{that the first white balance gain is WB 7 , the processor 120 determines C corresponding to WB 7} in the table 320 (eg, 0.005). may be determined as delta uv related to the first white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in the table 320 , but the first white balance gain is in the table 320 . On a line (e.g., fairly straight line) formed by two immediately adjacent (here, 'immediately adjacent' means that the corresponding delta uvs in table 320 are immediately adjacent) corresponding to the same color temperature It can be seen that the two white balance gains, The processor 120 may determine, for example, two delta uvs respectively corresponding to the two white balance gains as delta uvs related to the first white balance gain. In an embodiment, the processor 120 is configured to determine a ratio for determining a second white balance gain, which will be described later, based on the first white balance gain and the two determined (eg, confirmed) white balances. A 'first gain ratio') may be further determined (eg, determined). A method of determining the first gain ratio will be described later in detail with reference to FIG. 5B .

For example, referring to the table 320 of FIG. 3B , the processor 120 (eg, the image signal processor 260 ) checks that the first white balance gain and the table 320 do not have the same white balance gain. can The processor 120 may, according to one embodiment, in the table 320 , a fairly straight line formed by _{two immediately adjacent WB 11} and WB ₁₂ corresponding to a color temperature equal to the first white balance gain (eg 4000K). You can see the two WB ₁₁ and WB ₁₂ , which are on top. The processor 120 may determine C (eg, 0.005) and D (eg, 0.010) corresponding to the _{two WB 11} and WB _{12 , respectively, as delta uvs related to the first white balance gain.} In an embodiment, the processor 120 may further determine the first gain ratio based _{on the first white balance gain and WB 11} and WB _{12 .}

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured such that there is no white balance gain in the table 320 equal to the first white balance gain, but the first white balance gain is 1-1 white balance gain and 1-2 white balance gain immediately adjacent corresponding to the 1-1 color temperature, corresponding to a 1-2 color temperature immediately preceding or immediately following the 1-1 color temperature, The 1-3th white balance gain corresponding to the delta uv equal to the 1-1th white balance gain, and the 1-2th white balance gain corresponding to the 1-2th color temperature as the color temperature equal to the 1-3th white balance gain Corresponding to 1-1 white balance gain and 1-3 white balance gain, to be in an area within a rectangle (eg substantially parallelogram) formed by 1-4th white balance gain corresponding to delta uv equal to gain A delta uv corresponding to the first white balance gain and the first and second white balance gain and a delta uv corresponding to the 1-4th white balance gain may be determined as delta uv related to the first white balance gain. In an embodiment, the processor 120 is configured to perform a first white balance gain and the determined four white balances (eg, 1-1 white balance gain, 1-2 white balance gain, 1-3 white balance gain, 1- 4 white balance gain), a first gain ratio may be further determined.

For example, referring to the table 320 of FIG. 3B , the processor 120 (eg, the image signal processor 260 ) checks that the first white balance gain and the table 320 do not have the same white balance gain. can The processor 120 has the first white balance gain, WB ₁₁ and WB _{12 corresponding to 4000K in the table 320, and WB 15} corresponding to C and the same _{as WB 11} and corresponding to 5000K as a color temperature following 4000K, _{and WB 11} , WB ₁₂ , WB ₁₅ , and WB ₁₆ , which are within a rectangle formed by _{WB 16} corresponding to 5000K and corresponding to D equal _{to WB 12} . The processor 120 may determine C corresponding to _{WB 11} and WB _{15 and D corresponding to WB 12} and WB ₁₆ as delta uvs related to the first white balance gain. In an embodiment, the processor 120 may further determine the first gain ratio based _{on the first white balance gain and WB 11} , WB ₁₂ , WB ₁₅ , and WB _{16 .}

In operation 407 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may identify a color temperature (hereinafter, referred to as a 'user input color temperature') input by the user.

In an embodiment, the processor 120 (eg, the main processor 121 ) may display an interface for receiving a color temperature input from a user through a display (eg, the display device 160 ). When a color temperature is input by the user using the interface, the processor 120 (eg, the image signal processor 260 ) may check the input color temperature.

In operation 409 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to generate a second white balance gain based on the table 320 , the user input color temperature, and the at least one delta uv. can be decided

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, based on (or with reference to the table 320 ), the user input color temperature and the user input color temperature and the table 320 within the table 320 . A white balance gain corresponding to at least one delta uv may be identified. The processor 120 may determine the checked white balance gain as the second white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, in operation 405 , when one delta uv is determined to be a delta uv related to the first white balance gain, a user input in the table 320 . A white balance gain corresponding to the color temperature and the one delta uv may be determined as the second white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, in operation 405 , determine the two delta uvs as the delta uvs related to the first white balance gain in the table 320 . The second white balance gain may be determined based on the two delta uvs, the user input color temperature, and the first gain ratio. For example, if the two delta uvs are determined to be delta uvs related to the first white balance gain in operation 405 , the processor 120 may correspond to the user input color temperature in the table 320 and set the two delta uvs in the table 320 . Two white balance gains corresponding to each can be identified. The processor 120 may determine the second white balance gain based on the two checked white balances and the first gain ratio.

In operation 411 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) obtains a second image by applying a second white balance gain to the first image (or first image data). can do.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) multiplies the RGB data obtained by interpolating the image data obtained from the image sensor 230 by a second white balance gain in operation 401 . A second image may be acquired. For example, in the interpolated R data, G data, and B data of each pixel of the image sensor 230 , the processor 120 multiplies the R data by the R gain of the second white balance gain, and adds the B data to the R data. By multiplying the B gain, the second image may be obtained.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may further perform various image processing on the second image. For example, the processor 120 may further perform at least one of scaling the second image or performing gamma correction or color correction on the second image. However, the image processing performed by the processor 120 is not limited to the above-described example.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may convert the second image into an image of a specified form (or format). For example, the processor 120 may convert the second image into a joint photographic experts group (JPEG) type image. However, the form of the image into which the second image is converted is not limited to JPEG.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may store the converted image in the memory 130 (eg, the memory 250 ).

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may display the second image or an image converted from the second image through a display (eg, the display device 160 ). For example, in response to acquiring the second image, the processor 120 may display the second image through a display (eg, the display device 160 ).

5A and 5B are exemplary diagrams for explaining a method of providing a white balance, according to various embodiments.

5A and 5B , in one embodiment, in a graph (eg, graph 510 of FIG. 5A and graph 520 of FIG. 5B ), a first line 521-1 is a white balance on a blackbody locus. gains can be expressed. For example, the first line 521-1 may represent white balance gains corresponding to a case in which delta uv is 0 (or B in the table 320 of FIG. 3B ). In an embodiment, the second line 521 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005 (or A in the table 320 of FIG. 3B ). In one embodiment, the third line 521-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005) (or C in FIG. 3B table 320 ). In one embodiment, the fourth line 521-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010) (or D in FIG. 3B table 320 ). For example, the horizontal axis of the graph 510 may indicate the R gain (Rgain of FIG. 3A ), and the vertical axis may indicate the B gain (Bgain of FIG. 3A ). R gain may include, for example, a range of 0 to 3, and B gain may include, for example, a range of 0 to 5. It is not limited to the illustrated embodiment, and the ranges of the R gain and the B gain may be extended according to various embodiments.

In one embodiment, in FIGS. 5A and 5B , each of the plurality of lines (eg, the first line 531-1 to the ninth line 531-9) has the same color temperature (or the same correlated color temperature). may represent white balance gains corresponding to . For example, the white balance gains on the first line 531-1 may represent white balance gains corresponding to 2000 K (kelvin) (or absolute temperature) as the same color temperature. As another example, the white balance gains on the ninth line 531 - 9 may represent white balance gains corresponding to 10000K as the same color temperature.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the first white balance gain based on the first image data (or the first image) obtained from the image sensor 230 . have. For example, in FIG. 5A , the processor 120 may determine the white balance gain (or coordinates) 541-1 as the first white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ) and calculates at least one delta uv associated with the first white balance gain. can decide For example, in FIG. 5A , the processor 120 determines that the white balance gain (or coordinates) 541-1 determined as the first white balance gain is WB ₇ , and a table (eg, the table 320 of FIG. 3B ) )), it can be confirmed that the delta uv corresponding _{to WB 7 is C.}

In an embodiment, the processor 120 (eg, the main processor 121 ) may check the color temperature input by the user. For example, the processor 120 may determine that the user input color temperature is 6000K corresponding to the line 531-5 (eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K).

In one embodiment, processor 120 (eg, image signal processor 260 ) refers to a table (eg, table 320 in FIG. 3B ), and a delta associated with the user input color temperature and the first white balance gain. A second white balance gain corresponding to uv may be determined. For example, when the user input color temperature is 6000K and the _{delta uv associated with WB 7 as the first white balance gain is C, the processor 120 sets WB 19} corresponding to 6000K and C in the table 320 to the second It can be determined as the white balance gain.

In FIG. 5B , in one embodiment, the processor 120 (eg, the image signal processor 260 ) performs a first white balance based on first image data (or a first image) obtained from the image sensor 230 . gain can be determined. For example, in FIG. 5B , the processor 120 may determine the white balance gain (or coordinates) 551 as the first white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) may check that the white balance gain is not in the same white balance gain as the white balance gain 511 in the table (eg, the table 320 of FIG. 3B ). have. The processor 120, for example, in the graph 520 or a table (eg, the table 320 of FIG. 3B ), the white balance gain 551 is adjacent to other white balance gains (eg, the white balance gain 551 ) -1), white balance gain 551-1, white balance gain 551-3, and white balance gain 551-4) ), the white balance gain 551-2, the white balance gain 551-3, and the white balance gain 551-4 may be determined (eg, confirmed).

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may confirm that the delta uv corresponding to the white balance gain 551-1 and the white balance gain 551-3 is C, It can be confirmed that delta uv corresponding to the white balance gain 551-2 and the white balance gain 551-4 is D.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) includes a white balance gain 551-1, a white balance gain 551-2, a white balance gain 551-3, and a white balance The first gain ratio may be determined based on the gains 551-4 and the white balance gain 551 . For example, in FIG. 5B , a white balance gain 551-1, a white balance gain 551-2, a white balance gain 551-3, and a white balance gain 551-4 are four parallelograms. A white balance gain 551 that is a vertex and determined as the first white balance gain is a line segment connecting the white balance gain 551-1 and the white balance gain 551-2, the white balance gain 551-3, and the white It can be assumed that the balance gain 551-4 is substantially parallel to the line segment connecting it and is on the line segment 551-5. The processor 120 may determine, for example, a ratio (eg, b/a or a:b in FIG. 5B ) for externally dividing the line segment 551 - 5 as the first gain ratio.

In an embodiment, the processor 120 (eg, the main processor 121 ) may check the color temperature input by the user. For example, the processor 120 may confirm that the user input color temperature is 6000K corresponding to the fifth line 531-5 (eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K). have.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ), and refers to a plurality of values related to a user input color temperature and a first white balance gain. The second white balance gain may be determined based on the delta uvs of , and the first gain ratio. For example, the processor 120 may determine that the white balance gains corresponding to the color temperature of 6000K and corresponding to each of delta uv C and delta uv D are the white balance gain 552-1 and the white balance gain 552-2. can It may be assumed that the white balance gain 552-1 and the white balance gain 552-2 form a line segment (or substantially straight line) 552-3. In an embodiment, the processor 120 may determine a white balance gain 552 that divides the line segment 552 - 3 by a first gain ratio (eg, b/a) as the second white balance gain.

In FIG. 5B , an example of using the four white balance gains 551-1, 551-2, 551-3, and 551-4 for determining the delta uvs and the first gain ratio has been described, but the present invention is not limited thereto. In one embodiment, unlike FIG. 5B , when the first white balance gain is on a line segment (or substantially straight line) formed by the two white balance gains, the processor 120 (eg, the image signal processor 260 ) )) may determine the two delta uvs and the first gain ratio based on the first white balance gain and the two white balance gains forming the line segment. For example, in FIG. 5B , when the first white balance gain is the white balance gain 556 on a line segment formed by the white balance gain 551-1 and the white balance gain 551-2, the white balance gain 551 -1) and delta uvs C and D corresponding to each of the white balance gain 551 - 2 may be determined (eg, confirmed) as delta uvs related to the first white balance gain. In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to include a line segment formed by the white balance gain 551-1 and the white balance gain 551-2, the white balance gain 556 . A ratio (eg, d/c or c:d) that is externalized by .

6 is a flowchart 600 for explaining a method of providing white balance, according to various embodiments.

Referring to FIG. 6 , in operation 601 , in an embodiment, the processor 120 (eg, the main processor 121 ) may execute a camera application based on a user input.

In operation 603 , in an embodiment, the processor 120 (eg, the main processor 121 ) may determine whether a white balance mode set in the camera application is a manual mode.

In an embodiment, in response to the execution of the camera application, the processor 120 (eg, the main processor 121 ) may determine whether a white balance mode set in the camera application is a manual mode.

In an embodiment, the 'manual mode' may be a mode in which a white balance of a camera (or image) can be set (or adjusted) according to a color temperature input by a user.

In an embodiment, the 'auto mode (or auto mode)' may be a mode in which the white balance of the camera can be set (or adjusted) based on an automatic white balance algorithm. For example, the automatic white balance algorithm performs the white balance so that the ratio of the R data integration value and the G data integration value of the white region and the ratio of the B data integration value and the G data integration value in the first image obtained from the image becomes 1. It may be an algorithm that sets (or adjusts) the gain. However, the automatic white balance algorithm is not limited to the above-described example.

If it is determined in operation 603 that the white balance mode is not the manual mode, the processor 120 (eg, the main processor 121 ), for example, operation 605 may be performed.

In operation 605 , in an embodiment, the processor 120 (eg, the main processor 121 ), if it is determined in operation 603 that the white balance mode is an automatic mode rather than a manual mode, the processor 120 (eg, image The signal processor 260 may determine the third white balance gain in the automatic mode. For example, the processor 120 may obtain an image (or image data) from the image sensor 230 and determine the third white balance gain using an automatic white balance algorithm based on the obtained image.

In operation 607 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may acquire a third image by applying a third white balance gain to the image acquired from the image sensor 230 . have.

When it is determined in operation 603 that the white balance mode is the manual mode, the processor 120 (eg, the main processor 121 ), for example, operation 609 may be performed.

In operation 609 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine a first white balance gain based on the first image obtained from the image sensor 230 .

In operation 611 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table (eg, the table 320 of FIG. 3B ) and the first white balance gain, the first white At least one delta uv related to the balance gain can be determined (eg, confirmed).

In operation 613 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may identify a color temperature input by the user.

In operation 615 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) may store the table (eg, the table 320 in FIG. 3B ), the user input color temperature, and the at least one delta uv. Based on this, the second white balance gain may be determined.

In operation 617 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) obtains a second image by applying a second white balance gain to the first image (or first image data). can do.

Examples of operations 609 to 617 of FIG. 6 are at least partially the same as or similar to the examples of operations 403 to 411 of FIG. 4 , and thus a detailed description thereof will be omitted.

In operation 619 , in an embodiment, the processor 120 (eg, the main processor 121 ) may display the acquired image through a display (eg, the display device 160 ). For example, the processor 120 (eg, the main processor 121 ) may display the acquired second image through a display (eg, the display device 160 ) when the white balance mode is the manual mode. As another example, when the white balance mode is the automatic mode, the processor 120 may display the acquired third image through a display (eg, the display device 160 ).

Although not shown in FIG. 6 , in one embodiment, the operations of FIG. 6 display a still image (or capture image) or operations for displaying a live view (or preview) image. It may correspond to the actions to be performed. For example, the image displayed in operation 619 may be a live view image or a still image. The image displayed in operation 619 is not limited to the described embodiment, and according to various embodiments, the image displayed in operation 619 may include an image in a different form (eg, augmented reality (AR) image, composite image). can

7 is a flowchart 700 for explaining a method of providing an image (eg, a still image) according to various embodiments of the present disclosure.

Referring to FIG. 7 , in operation 701 , in an embodiment, the processor 120 (eg, the main processor 121 ) performs an image (eg, a plurality of first images including the first image) in the live view mode. ) may be displayed through a display (eg, the display device 160 ).

For example, when the white balance mode is the manual mode, the processor 120 (eg, the main processor 121 ) may display the plurality of first images through a display (eg, the display device 160 ). A plurality of second images including the second image to which the second white balance gain is applied may be continuously displayed.

As another example, when the white balance mode is the manual mode, the processor 120 (eg, the main processor 121 ) may display the plurality of first images through a display (eg, the display device 160 ). A plurality of first images may be continuously displayed without applying a second white balance gain to .

In operation 703 , in an embodiment, the processor 120 (eg, the main processor 121 ) may receive a user input for capturing an image. For example, the processor 120 may receive a user input for acquiring a still image (or a captured image) while displaying the image through a display (eg, the display device 160 ) in the live view mode. .

In operation 705 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may identify a second white balance gain. For example, the processor 120 may be configured to generate a second white balance gain associated with at least one of the plurality of second images displayed in the live view mode (eg, a second white balance gain applied to the first image to obtain the second image). 2 white balance gain).

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may use a plurality of images in determining the second white balance gain. For example, the processor 120 may check the second white balance gain by using a plurality of designated images among a plurality of second images displayed in the live view mode. The second white balance gain may be confirmed by using the 2-1 image to which the second white balance gain is first applied among the plurality of second images and the 2-2 image at the point in time when a user input for image capture is generated. For example, the processor 120 may identify intermediate data (eg, average data) of the white balance gain of the 2-1 th image and the white balance gain of the 2-2 th image as the second white balance gain. Also, the processor 120 may store, for example, data related to the white balance gain of the 2-1 th image and the white balance gain of the 2-2 th image in the memory 130 .

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may use an image at a specified time in determining the second white balance gain. For example, the processor 120 may use an image of an intermediate time point (eg, a center view point) between a time point at which the second white balance gain is first applied and a time point at which a user input is generated among the plurality of second images, You can check the balance gain. The time-related information may be pre-stored in the memory 130 , and the processor 120 may identify the second white balance gain by using the time-related information stored in the memory 130 .

In operation 707 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may obtain a still image by applying a second white balance gain to the image.

For example, the processor 120 (eg, the image signal processor 260 ) calculates a second white balance gain for an image displayed in the live view mode or an image having a higher resolution than an image displayed in the live view mode. By applying it, a still image can be obtained.

Although not shown in FIG. 7 , when receiving a user input for image capture, the processor 120 may display a second image displayed in the live view mode and to which the second white balance gain is applied through the display.

Although not shown in FIG. 7 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may store the acquired still image in the memory 130 .

8 is a flowchart 800 for explaining a method of providing white balance, according to various embodiments.

Referring to FIG. 8 , in operation 801 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may acquire a first image through the image sensor 230 .

In operation 803 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine a first white balance gain based on the first image obtained from the image sensor 230 .

In operation 805 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table (eg, the table 320 of FIG. 3B ) and the first white balance gain, the first white At least one delta uv related to the balance gain may be determined.

Examples of operations 801 to 805 of FIG. 8 are at least partially identical to or similar to those of operations 401 to 405 of FIG. 4 , and thus detailed descriptions thereof will be omitted.

In operation 807 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) selects a first color temperature (hereinafter, referred to as a 'first color temperature') corresponding to the first white balance gain. can decide

In one embodiment, the processor 120 (eg, the image signal processor 260 ) stores a first white balance gain (or a white balance gain equal to the first white balance gain) into a table (eg, table 320 in FIG. 3B ). )), a color temperature corresponding to the same white balance gain as the first white balance gain in a table (eg, the table 320 of FIG. 3B ) may be determined as the first color temperature. For example, referring to the table 320 of FIG. 3B , when it is determined _{that the first white balance gain is WB 7} , the processor 120 sets the color temperature 3000K corresponding to _{WB 7 in the table 320 to the first color.} It can be determined as temperature.

In one embodiment, the processor 120 (eg, image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in a table (eg, table 320 in FIG. 3B ), but the first white the two white balances, such that the balance gain is on a line (eg, a line segment) formed by two immediately adjacent white balance gains corresponding to the same color temperature in a table (eg, table 320 in FIG. 3B ). You can check the gains. The processor 120 may determine the color temperature corresponding to the two white balance gains as the first color temperature. For example, referring to the table 320 of FIG. 3B , the processor 120 may confirm that the first white balance gain and the table 320 do not have the same white balance gain. The processor 120 is configured such that the first white balance gain is on a substantially (substantially) straight line formed by the _{two immediately adjacent WB 11} and WB _{12 corresponding to the same color temperature in the table 320 . 11} and WB ₁₂ can be found. The processor 120 may determine the color temperature 4000K corresponding to the _{two WB 11} and WB _{12 as the first color temperature.}

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in a table (eg, table 320 in FIG. 3B ), but the first white The balance gain is a value of the immediately adjacent 1-1 white balance gain and the 1-2 white balance gain corresponding to the 1-1 color temperature in the table 320 of FIG. 3B , the 1-1 color temperature. 1-3th white balance gain corresponding to the immediately preceding or immediately following 1-2th color temperature and corresponding to delta uv equal to the 1-1th white balance gain, and the same color temperature as the 1-3th white balance gain ( Example: to be in an area within a rectangle (e.g. substantially parallelogram) formed by a 1-4th white balance gain corresponding to a delta uv corresponding to the 1-2th color temperature) and equal to the 1-2th white balance gain. , the 1-1 th white balance gain, the 1-2 th white balance gain, the 1-3 th white balance gain, and the 1-4 th white balance gain may be checked. The processor 120 receives, from the first white balance gain, a line segment formed by the 1-1 white balance gain corresponding to the 1-1 color temperature and the 1-2 white balance gain and the 1-2 color temperature. between the ratio of distances to each of the line segments formed by the corresponding 1-3th white balance gain and 1-4th white balance gain, and the difference from the 1-1th color temperature and the difference from the 1-2th color temperature A color temperature, such that the ratios are equal, can be determined as the first color temperature.

In operation 809 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may identify a second color temperature (hereinafter, referred to as a 'second color temperature') input by the user.

In operation 811 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) calculates the color temperature difference between the first color temperature and the second color temperature (hereinafter referred to as a 'color temperature difference'). can be checked

In operation 813 , in an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the second white balance gain in consideration of the color temperature difference.

In one embodiment, the processor 120 (eg, image signal processor 260 ) is configured to: based on a table (eg, table 320 in FIG. 3B ), a second color temperature, and at least one delta uv, 2-1 You can determine the white balance gain. For example, the processor 120 may determine the 2-1 th white balance gain through embodiments that are at least partially identical to or similar to the embodiments described in operation 409 of FIG. 4 .

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may adjust the 2-1 th white balance gain when the color temperature difference is greater than or equal to a specified color temperature difference (eg, 1000K). For example, the processor 120 (eg, the image signal processor 260 ) may not adjust the 2-1 white balance gain when the color temperature difference is less than 1000K as the designated color temperature difference. The processor 120 (eg, the image signal processor 260 ) may adjust the 2-1 th white balance gain when the color temperature difference is 1000K or more as the designated color temperature difference.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is greater than or equal to the specified difference, the 2-1 th white balance gain is the white balance corresponding to the blackbody locus along the isothermal line. The 2-1 white balance gain may be adjusted to move in the gain direction.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is equal to or greater than the specified color temperature difference, the 2-1 th white balance gain corresponding to the color temperature difference (or the color temperature difference) By the amount of the white balance gain (specified according to the temperature difference), the 2-1 th white balance gain may be adjusted so that the 2-1 th white balance gain moves along the isothermal line in the white balance gain direction corresponding to the blackbody locus. In an embodiment, the processor 120 (eg, the image signal processor 260 ) determines the degree (or amount of change) by which the 2-1 th white balance gain is adjusted, delta uv (or the amount of change) corresponding to the first white balance gain. The color temperature difference ( delta uv corresponding to the 2-1 white balance gain) obtained by subtracting the specified color temperature difference (eg 1000K) from the color temperature difference (eg 2000K) between the first color temperature and the second color temperature Example: The 2-1 th white balance gain may be adjusted to correspond to the delta uv change amount reduced by a ratio corresponding to 1000K). For example, the processor 120 (eg, the image signal processor 260 ) has a delta uv corresponding to the first white balance gain of 0.010, a specified color temperature difference of 1000K, and the first color temperature and the second color. When the color temperature difference between the temperatures is 2000K, the white balance gain moved in the direction of the blackbody locus along the isothermal line of the second color temperature by delta uv 0.005 corresponding to 50% of the delta uv 0.010 corresponding to the first white balance gain to adjust the 2-1 white balance gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the adjusted 2-1 th white balance gain as the second white balance gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the 2-1 th white balance gain as the second white balance gain when the color temperature difference is smaller than the specified difference.

Although not shown in FIG. 8 , in one embodiment, the processor 120 (eg, the image signal processor 260 ), the processor 120 considers the color temperature difference and delta uv corresponding to the first white balance gain. Thus, the second white balance gain may be determined.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to: when the color temperature difference is greater than or equal to the specified difference and the delta uv corresponding to the first white balance gain is outside the specified delta uv range (eg: (delta uv is less than or equal to -0.0025 or greater than or equal to 0.0025), the 2-1th white balance gain may be adjusted so that the 2-1th white balance gain moves along the isothermal line in the white balance gain direction corresponding to the blackbody locus. However, the present invention is not limited thereto, and the 2-1 white balance gain may be adjusted based on whether the color temperature difference is equal to or greater than a specified difference regardless of the delta uv size corresponding to the first white balance gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to perform the 2-1th step, when the color temperature difference is greater than or equal to the specified difference and the delta uv corresponding to the first white balance gain is greater than or equal to the specified delta uv so that the 2-1 white balance gain is shifted in the direction of the white balance gain corresponding to the black body locus along the isothermal line by the white balance gain corresponding to the color temperature difference (or designated according to the color temperature difference) , the 2-1 white balance gain can be adjusted.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the adjusted 2-1 th white balance gain as the second white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) provides a sense of stability to the user by adjusting the 2-1 white balance gain in the direction of the white balance gain on the blackbody locus based on the color temperature difference. An image that can be transmitted can be obtained.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, when a color temperature difference is less than a specified difference or a delta uv corresponding to a first white balance gain is less than a specified delta uv, The 2-1 white balance gain may be determined as the second white balance gain.

However, the method of determining the second white balance gain by adjusting the 2-1 white balance gain is not limited to the above-described example. For example, the processor 120 (eg, the image signal processor 260 ) is configured to perform the second-second operation even when the color temperature difference is smaller than the specified difference and the delta uv corresponding to the first white balance gain is greater than or equal to the specified delta uv. As the 1st white balance gain is the white balance gain corresponding to the color temperature difference (or specified according to the color temperature difference), the 2-1 white balance gain moves along the isothermal line in the direction of the white balance gain corresponding to the blackbody locus As much as possible, the 2-1 th white balance gain may be adjusted.

In operation 815 , in one embodiment, the processor 120 (eg, the image signal processor 260 ) obtains a second image by applying a second white balance gain to the first image (or first image data). can do. Since the embodiments of operation 815 are at least partially the same as or similar to the embodiments of operation 411 of FIG. 4 , a detailed description thereof will be omitted.

The operations (eg, 401 to 411, 601 to 619, 701 to 707, or 801 to 815) described in the process or method shown in FIGS. 4 and 6 to 8 are sequential, parallel, iterative, or heuristic. It can be done in one way. For example, they may be executed in a different order, some operations may be omitted, or other operations may be added. According to an embodiment, the electronic device may acquire a plurality of images using a plurality of cameras, and may identify and apply a white balance gain using the plurality of images. For example, the 1-1 white balance gain of the 1-1 image acquired through the first camera (eg, front camera) and the 1-2 image acquired through the second camera (eg, rear camera) A second white balance gain may be determined using the 1-2 white balance gain, and a second image may be obtained by applying the determined second white balance to the 1-1 image and/or the 1-2 image. can

9 is an exemplary diagram 900 for explaining a method of providing white balance, according to various embodiments.

Referring to FIG. 9 , in one embodiment, line 921-1 may represent white balance gains on a blackbody trajectory. For example, the line 921-1 may indicate white balance gains corresponding to a case in which delta uv is 0 (or B of a table (eg, table 320 of FIG. 3B )). In one embodiment, line 921 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005 (or A of a table (eg, table 320 in FIG. 3B )). Lines 921-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005) (or C of a table (eg, table 320 of FIG. 3B )). Lines 921-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010) (or D of a table (eg, table 320 in FIG. 3B )).

In one embodiment, in FIG. 9 , each of the lines (eg, the first line 931-1 to the ninth line 931-9) has a white balance corresponding to the same color temperature (or the same correlated color temperature). gains can be expressed. For example, the white balance gains on the first line 931-1 may represent white balance gains corresponding to 2000 K (kelvin) (or absolute temperature) as the same color temperature. As another example, the white balance gains on the ninth line 931 - 9 may represent white balance gains corresponding to 10000K as the same color temperature. In an embodiment, the horizontal axis of the graph 900 may mean the R gain, and the vertical axis may mean the B gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the first white balance gain based on the first image data (or the first image) obtained from the image sensor 230 . have. For example, in FIG. 9 , the processor 120 may determine the white balance gain (or coordinates) 941-1 as the first white balance gain.

In one embodiment, the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ) and calculates at least one delta uv associated with the first white balance gain. can decide For example, in FIG. 9 , the processor 120 determines that the white balance gain (or coordinates) 941-1 determined as the first white balance gain is WB ₇ , and a table (eg, the table 320 of FIG. 3B ) )), it can be confirmed that the delta uv corresponding _{to WB 7 is C.}

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine a first color temperature corresponding to the first white balance gain. For example, in FIG. 9 , 3000K corresponding to the white balance gain 941-1 determined as the first white balance gain may be determined as the first color temperature corresponding to the first white balance gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may identify a color temperature difference between the first color temperature and the second color temperature input by the user.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the second white balance gain in consideration of the color temperature difference.

In one embodiment, the processor 120 (eg, image signal processor 260 ) is configured to: based on a table (eg, table 320 of FIG. 3B ), a second color temperature, and at least one delta uv, 2-1 You can determine the white balance gain. For example, the processor 120 may determine the 2-1 th white balance gain through embodiments that are at least partially identical to or similar to the embodiments described in operation 409 of FIG. 4 .

In an embodiment, the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is greater than or equal to the specified difference, the 2-1 th white balance gain is the white balance corresponding to the blackbody locus along the isothermal line. The 2-1 white balance gain may be adjusted to move in the gain direction.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) determines the degree (or amount of change) by which the 2-1 th white balance gain is adjusted, delta uv (or the amount of change) corresponding to the first white balance gain. The color temperature difference ( delta uv corresponding to the 2-1 white balance gain) obtained by subtracting the specified color temperature difference (eg 1000K) from the color temperature difference (eg 2000K) between the first color temperature and the second color temperature Example: The 2-1 white balance gain may be adjusted to correspond to the delta uv change amount reduced by a ratio corresponding to 1000K).

For example, when the first color temperature is 3000K, the second color temperature is 7000K, and the specified color temperature difference is 3000K, the processor 120 may generate a table (eg, the table 320 of FIG. 3B ), the second color temperature , and at least one delta uv, the white balance gain 941-3 may be determined as the 2-1 th white balance gain. The processor 120 may confirm that the difference between the first color temperature and the second color temperature is 3000K or more, which is designated as 4000K, and the delta uv corresponding to the white balance gain 941-1 is 0.005. The processor 120 may determine that the color temperature difference obtained by subtracting the specified color temperature difference of 3000K from the color temperature difference of 4000K is 1000K. The processor 120 may reduce the white balance gain 941-3 by a ratio corresponding to the color temperature difference 1000K obtained by subtracting the delta uv 0.005 corresponding to the white balance gain 941-1, for example, The white balance gain 941-3 may be adjusted to decrease (or shift) in the direction of the white balance gain 941-5 corresponding to the blackbody locus along the second color temperature by delta uv 0.0025. The processor 120 may determine the white balance gain 941-4 to which the white balance gain 941-3 is adjusted as the second white balance gain.

In an embodiment, the processor 120 (eg, the image signal processor 260 ) may determine the 2-1 th white balance gain as the second white balance gain when the color temperature difference is smaller than the specified difference. For example, if the first color temperature is 3000K, the second color temperature is 5000K, and the specified color temperature difference is 3000K, the processor 120 may store the table 320, the second color temperature, and the at least one delta uv. The white balance gain 941 - 2 (or the 2-1 th white balance gain) determined based on the above may be determined as the second white balance gain.

10 is an exemplary diagram for explaining a method of providing a white balance according to a white balance mode of a camera functionally connected to the electronic device 101, according to various embodiments of the present disclosure.

Referring to FIG. 10 , according to an embodiment, FIG. 10A may represent a case in which white balance is set in an automatic mode.

In an embodiment, the object 1011 may be an object related to white balance setting. In an embodiment, the processor 120 (eg, the main processor 121 ) may change the white balance mode from the automatic mode to the manual mode when an input for the object 1011 is received from the user in the automatic mode. . In one embodiment, text 1013 may indicate the current white balance mode and color temperature.

In an embodiment, the processor 120 (eg, the main processor 121 ) may display the screen 1010 to which the white balance gain set in the automatic mode is applied through the display (eg, the display device 160 ). have.

In an embodiment, (b) of FIG. 10 may represent a case in which white balance is set in the manual mode.

In an embodiment, the object 1021 may be an object related to white balance setting. In an embodiment, when an input for the object 1021 is received from a user in the manual mode, the processor 120 may change the white balance mode from the manual mode to the automatic mode. In one embodiment, text 1023 may represent a color temperature input by a user. In one embodiment, the object 1025 may indicate that the current white balance mode is a manual mode.

In an embodiment, the user may input a color temperature into the electronic device 101 using a bar 1024 . For example, when the user drags the movable object 1026 on the bar 1024 , the processor 120 (eg, the image signal processor 260 ) moves to the position of the object 1026 on the bar 1024 . You can check the corresponding color temperature.

In an embodiment, the processor 120, as in the examples described with reference to FIGS. 4 to 9 , applies a white balance gain ( ) to be applied to the first image obtained from the image sensor 230 according to the color temperature input by the user. Example: A second image (eg, the screen 1020) obtained by determining a second white balance gain) and applying the determined white balance gain to the first image is displayed through a display (eg, the display device 160) can do.

According to various embodiments of the present disclosure, a method for providing white balance in an electronic device 101 includes acquiring a first image through an image sensor 230 of the electronic device 101 , the first image a table 320 including white balance gains for a plurality of color temperatures and a plurality of delta uvs and stored in the memory 130 of the electronic device 101 and Determining at least one delta uv related to the first white balance gain based on the first white balance gain, checking a first color temperature input from a user, the table 320, and the first determining a second white balance gain based on a color temperature and the at least one delta uv, and applying the second white balance gain to the first image to obtain a second image. can do.

In various embodiments, the determining of the at least one delta uv related to the first white balance gain may include determining the delta uv when there is a delta uv corresponding to the first white balance gain in the table 320 . It may include the operation of determining as the at least one delta uv.

In various embodiments, the determining of the second white balance gain includes determining, as the second white balance gain, a white balance gain corresponding to the first color temperature and the delta uv in the table 320 . may include.

In various embodiments, the determining of the at least one delta uv related to the first white balance gain may include, when there is no delta uv corresponding to the first white balance gain in the table 320 , the first white identifying the at least two white balance gains, such that the balance gain is on a line formed by at least two adjacent white balance gains corresponding to the same color temperature in the table (320); determining a first delta uv and a second delta uv corresponding to each of the balance gains as the at least one delta uv, and based on the first white balance gain and the at least two white balance gains, the second 2 and determining a first gain ratio for determining the white balance gain.

In various embodiments, the determining of the second white balance gain may be performed based on the table 320 , the first color temperature, the first delta uv, the second delta uv, and the first gain ratio. and determining the second white balance gain.

In various embodiments, the determining of the at least one delta uv related to the first white balance gain may include, when there is no delta uv corresponding to the first white balance gain in the table 320 , the first white In the table 320, the 1-1th white balance gain and the 1-2th white balance gain that are immediately adjacent to the 1-1th color temperature corresponding to the 1-1th color temperature, and the 1-1th white balance gain immediately preceding or immediately following the 1-1th color temperature The 1-3th white balance gain corresponding to the 1-2 color temperature and corresponding to the delta uv equal to the 1-1 white balance gain, and the 1-2th white balance gain corresponding to the 1-2 color temperature and the same the 1-1 th white balance gain, the 1-2 th white balance gain, the 1-3 th white balance gain to be in an area within a rectangle formed by the 1-4 th white balance gain corresponding to delta uv; and confirming the 1-4th white balance gain, the third delta uv corresponding to the 1-1th white balance gain and the 1-3th white balance gain, the 1-2th white balance gain, and the first determining a fourth delta uv corresponding to the 1-4 white balance gain as the at least one delta uv, and the first white balance gain, the 1-2 white balance gain, and the 1-3 white balance gain and determining a first gain ratio for determining the second white balance gain based on the 1-4th white balance gain.

In various embodiments, the determining of the second white balance gain may be performed based on the table 320 , the first color temperature, the third delta uv, the fourth delta uv, and the first gain ratio. and determining the second white balance gain.

In various embodiments, the method further comprises: determining a second color temperature corresponding to the first white balance gain, in the table 320, the first color temperature, and the at least one delta uv. Based on the operation of determining the second white balance gain, the table 320, the first color temperature, the at least one delta uv, and a color temperature difference between the first color temperature and the second color temperature based on the second white balance gain, the method may include determining the second white balance gain.

In various embodiments, the determining of the second white balance gain based on the table 320 , the first color temperature, and the at least one delta uv may include: when the color temperature difference is greater than or equal to a specified color temperature difference , by moving the white balance gain determined based on the table 320 , the first color temperature, and the at least one delta uv in the white balance gain direction corresponding to the blackbody locus along the isothermal line, the second and determining a white balance gain.

In various embodiments, the method includes receiving a user input for executing a camera application, and when receiving the user input, the second white balance gain for each of a plurality of image frames included in the first image applying the second image including each of the plurality of image frames to which the second white balance gain is applied, as a live view image, the display of the electronic device 101 (eg, a display device ( 160)), receiving a user input for capturing an image, and obtaining a third image by applying the second white balance gain to the image acquired from the image sensor 230 , and storing the obtained third image in the memory 130 .

In addition, the structure of the data used in the above-described embodiment of the present invention may be recorded in a computer-readable recording medium through various means. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (eg, a ROM, a floppy disk, a hard disk, etc.) and an optically readable medium (eg, a CD-ROM, a DVD, etc.).

So far, with respect to the present invention, the preferred embodiments have been looked at. Those of ordinary skill in the art to which the present invention pertains will understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments are to be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

101, 102, 104: electronic device 108: server

Claims (20)

In an electronic device,
image sensor;
a processor operatively connected to the image sensor; and
It is connected to the processor and includes a memory storing a table including white balance gains for a plurality of color temperatures and a plurality of delta uvs,
The memory, when executed, the processor
acquiring a first image through the image sensor,
determining a first white balance gain based on the first image;
determining at least one delta uv related to the first white balance gain based on the table and the first white balance gain;
Check the first color temperature input from the user,
determine a second white balance gain based on the table, the first color temperature, and the at least one delta uv; and
and storing instructions for obtaining a second image by applying the second white balance gain to the first image.
The method of claim 1,
The instructions, the processor,
and determine the delta uv as the at least one delta uv when there is a delta uv corresponding to the first white balance gain in the table.
3. The method of claim 2,
The instructions, the processor,
and determine a white balance gain corresponding to the first color temperature and the delta uv in the table as the second white balance gain.
The method of claim 1,
The instructions, the processor,
When there is no delta uv corresponding to the first white balance gain in the table, the first white balance gain is on a line formed by at least two adjacent white balance gains corresponding to the same color temperature in the table check the at least two white balance gains,
determining a first delta uv and a second delta uv corresponding to each of the at least two white balance gains as the at least one delta uv, and
and determine a first gain ratio for determining the second white balance gain based on the first white balance gain and the at least two white balance gains.
5. The method of claim 4,
The instructions, the processor,
and determine the second white balance gain based on the table, the first color temperature, the first delta uv, the second delta uv, and the first gain ratio.
The method of claim 1,
The instructions, the processor,
When there is no delta uv corresponding to the first white balance gain in the table, the first white balance gain corresponds to the immediately adjacent 1-1 white balance gain and the first white balance gain corresponding to the 1-1 color temperature in the table. -2 white balance gain, the 1-3th white balance gain corresponding to the 1-2th color temperature immediately preceding or immediately following the 1-1th color temperature and corresponding to the delta uv equal to the 1-1th white balance gain , and the 1-1 white balance to be in an area within a rectangle formed by the 1-4th white balance gain corresponding to the 1-2 color temperature and corresponding to a delta uv equal to the 1-2th white balance gain. check the gain, the 1-2 th white balance gain, the 1-3 th white balance gain, and the 1-4 th white balance gain;
a third delta uv corresponding to the 1-1 white balance gain and the 1-3 white balance gain and a fourth delta uv corresponding to the 1-2 white balance gain and the 1-4 white balance gain determined as said at least one delta uv,
a first method for determining the second white balance gain based on the first white balance gain, the 1-2 white balance gain, the 1-3 white balance gain, and the 1-4 white balance gain An electronic device that allows to determine a gain ratio.
7. The method of claim 6,
The instructions, the processor,
and determine the second white balance gain based on the table, the first color temperature, the third delta uv, the fourth delta uv, and the first gain ratio.
The method of claim 1,
The instructions, the processor,
further confirming a second color temperature corresponding to the first white balance gain;
and determine the second white balance gain based on the table, the first color temperature, the at least one delta uv, and a color temperature difference between the first color temperature and the second color temperature.
9. The method of claim 8,
The instructions, the processor,
When the color temperature difference is greater than or equal to the specified color temperature difference, a white balance gain determined based on the table, the first color temperature, and the at least one delta uv is a white balance gain corresponding to a blackbody locus along an isothermal line. direction to determine the second white balance gain.
The method of claim 1,
further comprising a display,
The instructions, the processor,
Receive user input for running the camera application,
When the user input is received, the second white balance gain is applied to each of a plurality of image frames included in the first image;
display the second image including each of the plurality of image frames to which the second white balance gain is applied as a live view image through the display;
receive user input for image capture;
obtaining a third image by applying the second white balance gain to the image obtained from the image sensor;
an electronic device to store the acquired third image in the memory.
A method for providing white balance in an electronic device, the method comprising:
acquiring a first image through an image sensor of the electronic device;
determining a first white balance gain based on the first image;
at least one delta related to the first white balance gain based on a table including white balance gains for a plurality of color temperatures and a plurality of delta uvs and stored in a memory of the electronic device and the first white balance gain action to determine uv;
checking the first color temperature input by the user;
determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv; and
and obtaining a second image by applying the second white balance gain to the first image.
12. The method of claim 11,
The operation of determining at least one delta uv related to the first white balance gain includes:
and determining the delta uv as the at least one delta uv when there is a delta uv corresponding to the first white balance gain in the table.
13. The method of claim 12,
The operation of determining the second white balance gain includes:
and determining, as the second white balance gain, a white balance gain corresponding to the first color temperature and the delta uv in the table.
12. The method of claim 11,
The operation of determining at least one delta uv related to the first white balance gain includes:
When there is no delta uv corresponding to the first white balance gain in the table, the first white balance gain is on a line formed by at least two adjacent white balance gains corresponding to the same color temperature in the table checking the at least two white balance gains;
determining a first delta uv and a second delta uv corresponding to each of the at least two white balance gains as the at least one delta uv; and
and determining a first gain ratio for determining the second white balance gain based on the first white balance gain and the at least two white balance gains.
15. The method of claim 14,
The operation of determining the second white balance gain includes:
and determining the second white balance gain based on the table, the first color temperature, the first delta uv, the second delta uv, and the first gain ratio.
12. The method of claim 11,
and checking a second color temperature corresponding to the first white balance gain;
The operation of determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv includes:
determining the second white balance gain based on the table, the first color temperature, the at least one delta uv, and a color temperature difference between the first color temperature and the second color temperature .
17. The method of claim 16,
The operation of determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv includes:
When the color temperature difference is greater than or equal to the specified color temperature difference, a white balance gain determined based on the table, the first color temperature, and the at least one delta uv is a white balance gain corresponding to a blackbody locus along an isothermal line. and determining the second white balance gain by moving in a direction.
12. The method of claim 11,
receiving a user input for executing a camera application;
applying the second white balance gain to each of a plurality of image frames included in the first image when the user input is received;
displaying the second image including each of the plurality of image frames to which the second white balance gain is applied as a live view image through the display of the electronic device;
receiving a user input for capturing an image;
acquiring a third image by applying the second white balance gain to the image acquired from the image sensor; and
The method further comprising the operation of storing the obtained third image in the memory.
In an electronic device,
camera;
a memory for storing a color temperature, a delta uv associated with the color temperature, and a plurality of white balance gains;
a processor operatively connected to the camera and the memory, wherein the processor comprises:
Acquire a first image using the camera,
check a first white balance gain based on the first image;
determining a second white balance gain based on the color temperature set in the camera, the delta uv, the first white balance gain, and a plurality of white balance gains stored in the memory; and
An electronic device configured to generate a second image to which the second white balance gain is applied to the first image.
20. The method of claim 19, wherein the delta uv comprises a plurality of delta uvs, and the processor comprises:
The electronic device is configured to identify at least one delta uv related to the first white balance gain based on the first white balance gain.

Images