WO2021125645A1 - Procédé de fourniture d'équilibrage des blancs et dispositif électronique prenant en charge celui-ci - Google Patents

Procédé de fourniture d'équilibrage des blancs et dispositif électronique prenant en charge celui-ci Download PDF

Info

Publication number
WO2021125645A1
WO2021125645A1 PCT/KR2020/017656 KR2020017656W WO2021125645A1 WO 2021125645 A1 WO2021125645 A1 WO 2021125645A1 KR 2020017656 W KR2020017656 W KR 2020017656W WO 2021125645 A1 WO2021125645 A1 WO 2021125645A1
Authority
WO
WIPO (PCT)
Prior art keywords
white balance
balance gain
delta
image
color temperature
Prior art date
Application number
PCT/KR2020/017656
Other languages
English (en)
Korean (ko)
Inventor
이순권
고성식
김대원
오세택
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2021125645A1 publication Critical patent/WO2021125645A1/fr

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces

Definitions

  • Various embodiments of the present disclosure relate to a method of providing a white balance and an electronic device supporting the same.
  • Humans have color constancy in which the white of the subject is perceived as white in response to the light source. For example, a person may perceive white as white regardless of the type of light source (eg, a white lamp, a fluorescent lamp, sunlight, etc.).
  • a white lamp e.g., a white lamp, a fluorescent lamp, sunlight, etc.
  • an electronic device may acquire images having different colors for the same subject according to a color temperature of a light source.
  • the electronic device provides a white balance function to compensate for a color difference caused by a color temperature of a light source.
  • the electronic device provides a function of automatically setting (or adjusting) a white balance or setting a white balance according to a color temperature input by a user (or manually).
  • the electronic device sets the white balance based on the color temperature of the light source. For example, when the electronic device sets the white balance based on the color temperature input by the user, the color temperature (or the correlated color of the light source) on the same black body locus as the color temperature input by the user A white balance gain corresponding to a temperature (correlated color temperature (CCT)) is used.
  • CCT correlated color temperature
  • the electronic device When the electronic device sets the white balance in consideration of only the color temperature on the blackbody locus, a problem in which the color of an image acquired by the electronic device is distorted may occur.
  • the electronic device may need a user input for adjusting (eg, fine-tuning) the color of the image.
  • information on (isothermal) chromaticity difference eg, delta uv
  • a light source eg artificial light
  • Various embodiments of the present invention consider the delta uv of the light source (or adaptive to the delta uv of the light source) based on data (eg, a table) defining a correlation between color temperature, delta uv, and/or white balance gain. ), a method of providing a white balance capable of setting a white balance, and an electronic device supporting the same. Also, various embodiments may provide a method and an electronic device for providing white balance in an electronic device.
  • An electronic device includes an image sensor, a processor operatively connected to the image sensor, and a white color for a plurality of color temperatures and a plurality of delta uvs connected to the processor and a memory storing a table including white balance gains, wherein the memory, when executed, causes the processor to acquire a first image through the image sensor, and A first white balance gain is determined based on a first image, and at least one delta uv related to the first white balance gain is determined based on the table and the first white balance gain, and a first ascertaining a color temperature, determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv, and applying the second white balance gain to the first image , instructions for obtaining the second image may be stored.
  • a method of providing a white balance in an electronic device includes: acquiring a first image through an image sensor of the electronic device; and calculating a first white balance gain based on the first image an operation of determining, including white balance gains for a plurality of color temperatures and a plurality of delta uvs, and related to the first white balance gain based on a table stored in the memory of the electronic device and the first white balance gain Determining at least one delta uv, determining a first color temperature input from a user, determining a second white balance gain based on the table, the first color temperature, and the at least one delta uv and obtaining a second image by applying the second white balance gain to the first image.
  • An electronic device includes a camera, a memory for storing a color temperature, a delta uv related to the color temperature, and a plurality of white balance gains, and a processor functionally connected to the camera and the memory and, the processor acquires a first image using the camera, identifies a first white balance gain based on the first image, and includes a color temperature set in the camera, the delta uv, and the first white balance.
  • a second white balance gain may be determined based on the gain and a plurality of white balance gains stored in the memory, and a second image obtained by applying the second white balance gain to the first image may be generated.
  • a method for providing a white balance according to various embodiments of the present disclosure and an electronic device supporting the same may provide a more reliable image by setting the white balance in consideration of the delta uv of a light source.
  • the electronic device may provide white balance without a user input for finely adjusting the color of the image, thereby improving the usability of the electronic device.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure
  • FIG. 2 is a block diagram of a camera module according to various embodiments of the present disclosure.
  • 3A and 3B are diagrams for explaining data for providing white balance, according to various embodiments.
  • FIG. 4 is a flowchart illustrating a method of providing white balance, according to various embodiments.
  • 5A and 5B are exemplary diagrams for explaining a method of providing a white balance, according to various embodiments.
  • FIG. 6 is a flowchart illustrating a method of providing white balance, according to various embodiments.
  • FIG. 7 is a flowchart illustrating a method of providing an image, according to various embodiments.
  • FIG. 8 is a flowchart illustrating a method of providing white balance, according to various embodiments.
  • FIG. 9 is an exemplary diagram for explaining a method of providing white balance, according to various embodiments.
  • FIG. 10 is an exemplary diagram for explaining a method of providing a white balance according to a white balance mode of a camera functionally connected to an electronic device, according to various embodiments of the present disclosure
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).
  • the sensor module 176 eg, a fingerprint sensor, an iris sensor, or an illuminance sensor
  • the processor 120 for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the nonvolatile memory 134 .
  • software eg, a program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the nonvolatile memory 134 .
  • the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can be operated independently or together with the main processor 121 , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .
  • a main processor 121 eg, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, an image signal processor
  • the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function.
  • the auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .
  • the auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the coprocessor 123 eg, an image signal processor or a communication processor
  • may be implemented as part of another functionally related component eg, the camera module 180 or the communication module 190. have.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).
  • the sound output device 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output device 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device.
  • the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • an external electronic device eg, a sound output device 155
  • the sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more designated protocols that may be used for the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 388 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module).
  • a wireless communication module 192 eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 194 eg, : It may include a local area network (LAN) communication module, or a power line communication module.
  • a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN).
  • a computer network eg, a telecommunication network such as a LAN or WAN.
  • These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other.
  • the wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • the electronic device 101 may be identified and authenticated.
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, RFIC
  • other than the radiator may be additionally formed as a part of the antenna module 197 .
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the electronic devices 102 and 104 may be the same or a different type of the electronic device 101 .
  • all or part of the operations performed by the electronic device 101 may be executed by one or more of the external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • the one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing, distributed computing, or client-server computing technology may be used.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101).
  • a machine eg, electronic device 101
  • the processor eg, the processor 120
  • the device eg, the electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be provided as included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones).
  • a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component eg, a module or a program of the above-described components may include a singular or a plurality of entities.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.
  • the camera module 180 includes a lens assembly 210 , a flash 220 , an image sensor 230 , an image stabilizer 240 , a memory 250 (eg, a buffer memory), or an image signal processor. (260).
  • the lens assembly 210 may collect light emitted from a subject, which is an image to be captured.
  • the lens assembly 210 may include one or more lenses.
  • the camera module 180 may include a plurality of lens assemblies 210 . In this case, the camera module 180 may be, for example, a dual camera, a 360 degree camera, or a spherical camera.
  • the plurality of lens assemblies 210 may have the same lens properties (eg, angle of view, focal length, autofocus, f number, or optical zoom), or at least one lens assembly may have at least one lens assembly and at least another lens lens assembly. It can have one different lens property.
  • the lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.
  • the flash 220 may emit a light source used to enhance light emitted from the subject.
  • the flash 220 may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp.
  • RGB red-green-blue
  • the image sensor 230 may acquire an image corresponding to the subject by converting light transmitted from the subject through the lens assembly 210 into an electrical signal.
  • the image sensor 230 is, for example, one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, the same It may include a plurality of image sensors having a property, or a plurality of image sensors having different properties.
  • Each image sensor included in the image sensor 230 may be implemented as, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.
  • CCD charged coupled device
  • CMOS complementary metal oxide semiconductor
  • the image stabilizer 240 responds to the movement of the camera module 180 or the electronic device 101 including the same, and at least partially compensates for a negative effect (eg, image shake) caused by the movement on a photographed image.
  • At least one lens or image sensor 230 included in the assembly 210 may be moved or controlled in a specific direction (eg, read-out timing is adjusted, etc.).
  • the image stabilizer 240 may be implemented as, for example, an optical image stabilizer, and a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 . ) can be used to detect the movement.
  • the memory 250 may temporarily store at least a portion of the image acquired through the image sensor 230 for a next image processing operation. For example, when image acquisition is delayed according to the shutter or a plurality of images are acquired at high speed, the acquired original image (eg, a high-resolution image) is stored in the memory 250 and a corresponding copy thereof An image (eg, a low-resolution image) may be previewed through the display device 160 . Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a part of the original image stored in the memory 250 may be obtained and processed by, for example, the image signal processor 260 . According to an embodiment, the memory 250 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .
  • the image signal processor 260 performs image processing (eg, depth map generation, 3D modeling, panorama generation, feature point extraction, Image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening) may be performed. Additionally or alternatively, an image signal processor ( The 260 may perform control (eg, exposure time control, readout timing control, etc.) on at least one (eg, image sensor 230 ) among components included in the camera module 180. Image The image processed by the signal processor 260 is stored back in the memory 250 for further processing, or an external component of the camera module 180 (eg, the memory 130 , the display device 160 , the electronic device 102 ). ), the electronic device 104 , or the server 108.
  • image processing eg, depth map generation, 3D modeling, panorama generation, feature point extraction, Image synthesis, or image compensation
  • image compensation e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening
  • image compensation
  • the image signal processor 260 is configured as at least a part of the processor 120 or is independent of the processor 120 . In the case of a separate processor, the images processed by the image signal processor 260 are as they are by the processor 120 or after additional image processing is performed by the display device 160 can be displayed through
  • the electronic device 101 may include two or more camera modules 180 each having different properties or functions.
  • at least one camera module 180 may be a wide-angle camera or a front camera
  • at least one other camera module may be a telephoto camera or a rear camera.
  • 3A and 3B are diagrams for explaining data (eg, a table) for providing white balance, according to various embodiments.
  • FIG. 3A shows a correlation between color temperature, delta uv, and white balance gain (hereinafter, to be used interchangeably with 'WB gain') It may be a graph 310 representing
  • delta uv (or delta u'v') may be defined, for example, as the degree and direction of deviation from the blackbody trajectory.
  • delta uv may be defined as the difference between, for example, the chromaticity of a point on the blackbody locus and the chromaticity of a light source at the same color temperature (or on an isothermal line) as the point on the blackbody trajectory.
  • delta uv may be referred to as 'isothermal chromaticity difference'.
  • the white balance gain may be a gain (or gain) obtained (or calculated) based on RGB (red, green, blue) data (or RGB signal) of an image obtained from an image sensor.
  • the white balance gain may include adjusting the gain of each (or each channel) of RGB data (or RGB signal) according to the color temperature.
  • the white balance gain may be a gain to be applied to set (or adjust) the white balance of the image obtained from the image sensor.
  • the white balance gain may be expressed as a coordinate by an R (red) gain and a B (blue) gain.
  • a horizontal axis of the graph 310 may mean an R gain (Rgain of FIG.
  • a vertical axis may mean a B gain (Bgain of FIG. 3A ).
  • the R gain may be, for example, a reciprocal of a ratio of R (red) data to G (green) data of an image obtained from the image sensor.
  • the B gain may be, for example, a reciprocal of a ratio of B (red) data to G data of an image obtained from the image sensor.
  • a method of determining (or calculating) the white balance gain will be described in detail later.
  • the first line 321-1 may represent white balance gains on the blackbody trajectory.
  • the first line 321-1 may indicate white balance gains corresponding to a case in which delta uv (or delta uv data) is 0.
  • the second line 321 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005.
  • the third line 321-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005).
  • the fourth line 321-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010).
  • the first line 321-1 to the fourth line 321-4 are not limited to the illustrated embodiment, but the first line 321-1 to the fourth line 321-4 according to various embodiments. In addition to the lines 321-4, additional lines (not shown) may be included.
  • each of the plurality of lines 331-1 to 331-9 may represent white balance gains corresponding to the same color temperature (or the same correlated color temperature).
  • the white balance gain on the first line 331-1 among the plurality of lines is 2000 K ( kelvin) (or absolute temperature).
  • the white balance gain on the ninth line 331-9 among the plurality of lines is 10000 K as the same color temperature.
  • White for example, may have a color temperature between about 3000K and 25000K, and a color temperature between 5000K and 10000K may be identified as a general white range.
  • the plurality of lines 331-1 to 331-9 may be determined based on at least a color temperature range (eg, 2000K to 10000K) or an interval of color temperature.
  • the plurality of lines 331-1 to 331-9 is not limited to the illustrated embodiment, but an additional line (not shown) in addition to the plurality of lines 331-1 to 331-9 according to various embodiments. may include.
  • a symbol 'o' may indicate a white balance gain (or a coordinate of a white balance gain) corresponding to a color temperature and delta uv.
  • the symbol 341 may be a white balance gain corresponding to a case where the color temperature is 3000K and the delta uv is 0.005.
  • a plurality of symbols corresponding to the color temperature and delta uv may be defined in the graph 310, and based on the numerical value, interval, or range of the color temperature and the delta uv, the graph 310 The number of symbols in may be changed.
  • table 320 may be a table defining a correlation between color temperature, delta uv, and white balance gain.
  • the table 320 may be, for example, a table including a plurality of white balance gains WB 1 to WB 36 corresponding to a plurality of color temperatures and a plurality of delta uvs.
  • A represents when delta uv equals -0.005
  • B represents when delta uv equals 0
  • C represents when delta uv equals 0.005
  • D represents when delta uv equals 0.010.
  • the present invention is not limited thereto.
  • the table 320 exemplifies that the interval between delta uvs is set to 0.005
  • the delta uvs may be set at an interval larger or smaller than 0.005 in the table.
  • the table 320 illustrates that the range of delta uvs is set in the range of -0.005 to 0.010, but the range of delta uvs is, for example, -0.005 or more (eg -0.004) or It can be set in the range from small (eg -0.003) delta uv to 0.010 or more (eg 0.011) or small (eg 0.009) delta uv.
  • the interval of the delta uvs may be, for example, an interval smaller than 0.005 (eg 0.001) or an interval greater than 0.005 (eg 0.010).
  • a of the graph 320 may be set to -0.010
  • B may be set to 0
  • C may be set to 0.010
  • D may be set to 0.020.
  • the intervals A to D are exemplified as specified intervals, the intervals of A to D may be different from each other.
  • the interval between A to C may be set to 0.005, and the interval from C to D may be set to 0.010. Accordingly, A may be set to -0.005, B may be set to 0, C may be set to 0.005, and D may be set to 0.015.
  • the first white balance gain set WB 1 , WB 2 , WB 3 , WB 4 according to delta uv may be included.
  • the second white balance gain set (WB 1 , WB 5 , WB 9 , WB 13 , WB 17 , WB 21 , WB 25 ) , WB 29 , WB 33 ) may be included.
  • the electronic device eg, the electronic device 200 of FIG.
  • the table 320 may be a table corresponding to the graph 310 of FIG. 3A .
  • the white balance gain corresponding to the symbol 341 of FIG. 3A may be WB 7 as the white balance gain corresponding to the case where the color temperature is 3000K and the delta uv is 0.005 in the table 320 of FIG. 3B. .
  • the table 320 is configured in a color temperature range (eg, 2000K to 10000K) guaranteed by (or implementable in the electronic device 101 ) by the electronic device 101 (eg, the camera module 180 ). It can be (or built). However, the present invention is not limited thereto.
  • the table 320 may be constructed through experimentation (or measurement).
  • the table may be configured by measuring the color temperature, delta uv, and white balance gain of the light source using measuring equipment in an environment with a light source.
  • table 320 may be stored in memory 130 (eg, memory 250 ).
  • the electronic device 101 includes an image sensor 230 , a processor 120 functionally connected to the image sensor 230 , and a plurality of colors connected to the processor 120 .
  • a memory 130 storing a table 320 including white balance gains for color temperatures and a plurality of delta uvs; ), when executed, the processor 120 acquires a first image through the image sensor 230, determines a first white balance gain based on the first image, and the table 320 and At least one delta uv related to the first white balance gain is determined based on the first white balance gain, a first color temperature input from a user is checked, the table 320, the first color temperature , and determining a second white balance gain based on the at least one delta uv, and applying the second white balance gain to the first image to obtain a second image.
  • the instructions determine, by the processor 120 , the delta uv as the at least one delta uv when there is a delta uv corresponding to the first white balance gain in the table 320 . can make it
  • the instructions may cause the processor 120 to determine, as the second white balance gain, a white balance gain corresponding to the first color temperature and the delta uv in the table 320 . have.
  • the instructions include, when the processor 120 does not have a delta uv corresponding to the first white balance gain in the table 320 , sets the first white balance gain to the table 320 .
  • the instructions are configured by the processor 120 based on the table 320, the first color temperature, the first delta uv, the second delta uv, and the first gain ratio.
  • the second white balance gain may be determined.
  • the instructions include, when the processor 120 does not have a delta uv corresponding to the first white balance gain in the table 320 , sets the first white balance gain to the table 320 .
  • 1-1 white balance gain and 1-2 white balance gain immediately adjacent corresponding to the 1-1 color temperature, corresponding to a 1-2 color temperature immediately preceding or immediately following the 1-1 color temperature,
  • the 1-3 th white balance gain corresponding to a delta uv equal to the 1-1 th white balance gain
  • the 1-1th white balance gain, the 1-2th white balance gain, the 1-3th white balance gain, and the 1-4th white balance to be in an area within a rectangle formed by the 4th white balance gain
  • a gain is checked, and a third delta uv corresponding to the 1-1 white balance gain and the 1-3 white balance gain and a third delta uv corresponding to the 1-2 white balance gain
  • a fourth delta uv is determined as the at least one delta uv, and is applied to the first white balance gain, the 1-2 white balance gain, the 1-3 white balance gain, and the 1-4 white balance gain. Based on this, a first gain ratio for determining the second white balance gain may be determined.
  • the instructions are configured by the processor 120 based on the table 320, the first color temperature, the third delta uv, the fourth delta uv, and the first gain ratio.
  • the second white balance gain may be determined.
  • the instructions include, by the processor 120 , further identifying a second color temperature corresponding to the first white balance gain, the table 320 , the first color temperature, and the at least one The second white balance gain may be determined based on delta uv and a color temperature difference between the first color temperature and the second color temperature.
  • the instructions are configured by the processor 120, based on the table 320, the first color temperature, and the at least one delta uv, when the color temperature difference is greater than or equal to a specified color temperature difference.
  • the second white balance gain may be determined by moving the determined white balance gain in the white balance gain direction corresponding to the blackbody locus along the isothermal line.
  • the electronic device 101 further includes a display (eg, a display device 160 ), and the instructions include: the processor 120 receiving a user input for executing a camera application; When the user input is received, the second white balance gain is applied to each of a plurality of image frames included in the first image, and the second white balance gain is applied to the plurality of image frames to which the second white balance gain is applied.
  • a third image may be obtained, and the obtained third image may be stored in the memory 130 .
  • the electronic device 101 includes a camera (eg, the camera module 180 ), a color temperature, a delta uv related to the color temperature, and a memory 130 for storing a plurality of white balance gains. ), and a processor 120 functionally connected to the camera (eg, camera module 180) and the memory 130, wherein the processor 120 includes the camera (eg, camera module 180).
  • the camera e.g. the camera module 180
  • the delta uv, and the first white determine a second white balance gain based on the balance gain and a plurality of white balance gains stored in the memory 130 , and generate a second image in which the second white balance gain is applied to the first image can be set.
  • the delta uv includes a plurality of delta uvs
  • the processor 120 is configured to identify, based on the first white balance gain, at least one delta uv related to the first white balance gain. can be set.
  • FIG. 4 is a flowchart 400 for explaining a method of providing white balance, according to various embodiments.
  • the processor 120 may acquire a first image through the image sensor 230 .
  • the processor 120 (eg, the image signal processor 260 ) performs interpolation processing on electrical image data received from the image sensor 230 to obtain red, green, and blue RGB data.
  • RGB data will be referred to as 'first image data'
  • an image constructed based on the first image data will be referred to as 'first image'.
  • the processor 120 eg, the image signal processor 260 performs a correlated double sampling (CDS) operation, automatic gain control (AGC), and A/D (analog to digital) conversion operation may be further performed,
  • CDS correlated double sampling
  • AGC automatic gain control
  • A/D analog to digital
  • the processor 120 may determine a first white balance gain based on a first image (or first image data).
  • the processor 120 may determine a white (or gray, or achromatic) region in the first image based on the first image data. .
  • the processor 120 may convert RGB data of each of a plurality of regions (or blocks or patches) of the first image of one image frame, R data, G Data and B data may be integrated (or integrated) respectively.
  • the processor 120 may determine the R data integration value, the G data integration value, and the B data integration value for each of the first to ninth regions. can be determined (or calculated).
  • the processor 120 may determine a white area among the plurality of areas based on the integrated R data value, the G data integrated value, and the B data integrated value of each of the plurality of areas. For example, the processor 120 may generate R/G (eg, G data integration) of each of the plurality of regions based on the integrated R data value, the G data integration value, and the B data integration value of each of the plurality of regions. It is possible to determine the ratio of the R data total value to the value) and B/G (eg the ratio of the B data total value to the G data total value).
  • R/G eg, G data integration
  • the processor 120 may determine, among the plurality of regions, an area within a range in which R/G and B/G are designated (eg, a coordinate range designated from R/G and B/G of the blackbody locus) as the white area.
  • a range in which R/G and B/G are designated eg, a coordinate range designated from R/G and B/G of the blackbody locus
  • the method for the processor 120 to determine the white area is not limited to the above-described example.
  • the white area is determined based on RGB data obtained by interpolation of image data obtained from the image sensor 230 in the above-described embodiments
  • the present invention is not limited thereto.
  • the processor 120 may determine the white area using the same or similar method to the above-described method of determining the white area, based on image data obtained from the image sensor 230 before the interpolation process. .
  • the processor 120 may determine the reciprocal of each of R/G and B/G of the region determined as the white region as the first white balance gain.
  • the method of determining the first white balance gain is not limited to the method of determining the first white balance gain based on R/G and B/G of the region determined as the above-described white region.
  • the processor 120 when the processor 120 (eg, the image signal processor 260 ) continuously acquires a plurality of first images (or a plurality of first image data) from the image sensor 230 , the plurality of It is possible to determine first white balance gains for each of the first images of . For example, when obtaining a plurality of image frames constituting a video from the image sensor 230 , the processor 120 may determine first white balance gains for each of the plurality of image frames. have. In an embodiment, the processor 120 may store the determined first white balance gain in the memory 130 (eg, the memory 230 ). For example, when determining first white balance gains for each of the plurality of image frames, the processor 120 may store the determined first white balance gains in the memory 130 .
  • the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table 320 and the first white balance gain, at least one delta associated with the first white balance gain uv can be determined.
  • the processor 120 (eg, image signal processor 260 ) provides a white balance gain equal to the first white balance gain (or the coordinates of the first white balance gain (eg, (Rgain, Bgain))). If in this table 320, one delta uv corresponding to the white balance gain equal to the first white balance gain in the table 320 is determined (eg, determined) as the delta uv associated with the first white balance gain.
  • the processor 120 determines C corresponding to WB 7 in the table 320 (eg, 0.005). may be determined as delta uv related to the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in the table 320 , but the first white balance gain is in the table 320 .
  • a white balance gain equal to the first white balance gain is not in the table 320 , but the first white balance gain is in the table 320 .
  • On a line e.g., fairly straight line
  • two immediately adjacent here, 'immediately adjacent' means that the corresponding delta uvs in table 320 are immediately adjacent
  • the processor 120 may determine, for example, two delta uvs respectively corresponding to the two white balance gains as delta uvs related to the first white balance gain.
  • the processor 120 is configured to determine a ratio for determining a second white balance gain, which will be described later, based on the first white balance gain and the two determined (eg, confirmed) white balances.
  • a 'first gain ratio') may be further determined (eg, determined).
  • a method of determining the first gain ratio will be described later in detail with reference to FIG. 5B .
  • the processor 120 (eg, the image signal processor 260 ) checks that the first white balance gain and the table 320 do not have the same white balance gain.
  • the processor 120 may, according to one embodiment, in the table 320 , a fairly straight line formed by two immediately adjacent WB 11 and WB 12 corresponding to a color temperature equal to the first white balance gain (eg 4000K). You can see the two WB 11 and WB 12 , which are on top.
  • the processor 120 may determine C (eg, 0.005) and D (eg, 0.010) corresponding to the two WB 11 and WB 12 , respectively, as delta uvs related to the first white balance gain.
  • the processor 120 may further determine the first gain ratio based on the first white balance gain and WB 11 and WB 12 .
  • the processor 120 (eg, the image signal processor 260 ) is configured such that there is no white balance gain in the table 320 equal to the first white balance gain, but the first white balance gain is 1-1 white balance gain and 1-2 white balance gain immediately adjacent corresponding to the 1-1 color temperature, corresponding to a 1-2 color temperature immediately preceding or immediately following the 1-1 color temperature,
  • Corresponding to 1-1 white balance gain and 1-3 white balance gain to be in an area within a rectangle (eg substantially parallelogram) formed by 1-4th white balance gain corresponding to delta uv equal to gain
  • a delta uv corresponding to the first white balance gain and the first and second white balance gain and a delta uv corresponding to the 1-4th white balance gain may be determined as delta uv related to the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) checks that the first white balance gain and the table 320 do not have the same white balance gain.
  • the processor 120 has the first white balance gain, WB 11 and WB 12 corresponding to 4000K in the table 320, and WB 15 corresponding to C and the same as WB 11 and corresponding to 5000K as a color temperature following 4000K, and WB 11 , WB 12 , WB 15 , and WB 16 , which are within a rectangle formed by WB 16 corresponding to 5000K and corresponding to D equal to WB 12 .
  • the processor 120 may determine C corresponding to WB 11 and WB 15 and D corresponding to WB 12 and WB 16 as delta uvs related to the first white balance gain. In an embodiment, the processor 120 may further determine the first gain ratio based on the first white balance gain and WB 11 , WB 12 , WB 15 , and WB 16 .
  • the processor 120 may identify a color temperature (hereinafter, referred to as a 'user input color temperature') input by the user.
  • the processor 120 may display an interface for receiving a color temperature input from a user through a display (eg, the display device 160 ).
  • a display eg, the display device 160
  • the processor 120 eg, the image signal processor 260
  • the processor 120 may check the input color temperature.
  • the processor 120 (eg, the image signal processor 260 ) is configured to generate a second white balance gain based on the table 320 , the user input color temperature, and the at least one delta uv. can be decided
  • the processor 120 (eg, the image signal processor 260 ) is configured to, based on (or with reference to the table 320 ), the user input color temperature and the user input color temperature and the table 320 within the table 320 .
  • a white balance gain corresponding to at least one delta uv may be identified.
  • the processor 120 may determine the checked white balance gain as the second white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) is configured to, in operation 405 , when one delta uv is determined to be a delta uv related to the first white balance gain, a user input in the table 320 .
  • a white balance gain corresponding to the color temperature and the one delta uv may be determined as the second white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) is configured to, in operation 405 , determine the two delta uvs as the delta uvs related to the first white balance gain in the table 320 .
  • the second white balance gain may be determined based on the two delta uvs, the user input color temperature, and the first gain ratio. For example, if the two delta uvs are determined to be delta uvs related to the first white balance gain in operation 405 , the processor 120 may correspond to the user input color temperature in the table 320 and set the two delta uvs in the table 320 . Two white balance gains corresponding to each can be identified.
  • the processor 120 may determine the second white balance gain based on the two checked white balances and the first gain ratio.
  • the processor 120 obtains a second image by applying a second white balance gain to the first image (or first image data). can do.
  • the processor 120 multiplies the RGB data obtained by interpolating the image data obtained from the image sensor 230 by a second white balance gain in operation 401 .
  • a second image may be acquired.
  • the processor 120 multiplies the R data by the R gain of the second white balance gain, and adds the B data to the R data. By multiplying the B gain, the second image may be obtained.
  • the processor 120 may further perform various image processing on the second image.
  • the processor 120 may further perform at least one of scaling the second image or performing gamma correction or color correction on the second image.
  • the image processing performed by the processor 120 is not limited to the above-described example.
  • the processor 120 may convert the second image into an image of a specified form (or format).
  • the processor 120 may convert the second image into a joint photographic experts group (JPEG) type image.
  • JPEG joint photographic experts group
  • the form of the image into which the second image is converted is not limited to JPEG.
  • the processor 120 may store the converted image in the memory 130 (eg, the memory 250 ).
  • the processor 120 may display the second image or an image converted from the second image through a display (eg, the display device 160 ). For example, in response to acquiring the second image, the processor 120 may display the second image through a display (eg, the display device 160 ).
  • 5A and 5B are exemplary diagrams for explaining a method of providing a white balance, according to various embodiments.
  • a first line 521-1 is a white balance on a blackbody locus. gains can be expressed.
  • the first line 521-1 may represent white balance gains corresponding to a case in which delta uv is 0 (or B in the table 320 of FIG. 3B ).
  • the second line 521 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005 (or A in the table 320 of FIG. 3B ).
  • the third line 521-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005) (or C in FIG. 3B table 320 ).
  • the fourth line 521-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010) (or D in FIG. 3B table 320 ).
  • a horizontal axis of the graph 510 may indicate an R gain (Rgain of FIG. 3A )
  • a vertical axis may indicate a B gain (Bgain of FIG. 3A ).
  • R gain may include, for example, a range of 0 to 3
  • B gain may include, for example, a range of 0 to 5. It is not limited to the illustrated embodiment, and the ranges of the R gain and the B gain may be extended according to various embodiments.
  • each of the plurality of lines has the same color temperature (or the same correlated color temperature).
  • the white balance gains on the first line 531-1 may represent white balance gains corresponding to 2000 K (kelvin) (or absolute temperature) as the same color temperature.
  • the white balance gains on the ninth line 531 - 9 may represent white balance gains corresponding to 10000K as the same color temperature.
  • the processor 120 may determine the first white balance gain based on the first image data (or the first image) obtained from the image sensor 230 . have. For example, in FIG. 5A , the processor 120 may determine the white balance gain (or coordinates) 541-1 as the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ) and calculates at least one delta uv associated with the first white balance gain. can decide For example, in FIG. 5A , the processor 120 determines that the white balance gain (or coordinates) 541-1 determined as the first white balance gain is WB 7 , and a table (eg, the table 320 of FIG. 3B ) )), it can be confirmed that the delta uv corresponding to WB 7 is C.
  • the processor 120 may check the color temperature input by the user. For example, the processor 120 may determine that the user input color temperature is 6000K corresponding to the line 531-5 (eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K).
  • the line 531-5 eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K.
  • processor 120 (eg, image signal processor 260 ) refers to a table (eg, table 320 in FIG. 3B ), and a delta associated with the user input color temperature and the first white balance gain.
  • a second white balance gain corresponding to uv may be determined. For example, when the user input color temperature is 6000K and the delta uv associated with WB 7 as the first white balance gain is C, the processor 120 sets WB 19 corresponding to 6000K and C in the table 320 to the second It can be determined as the white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) performs a first white balance based on first image data (or a first image) obtained from the image sensor 230 .
  • gain can be determined.
  • the processor 120 may determine the white balance gain (or coordinates) 551 as the first white balance gain.
  • the processor 120 may check that the white balance gain is not in the same white balance gain as the white balance gain 511 in the table (eg, the table 320 of FIG. 3B ). have.
  • the processor 120 for example, in the graph 520 or a table (eg, the table 320 of FIG. 3B ), the white balance gain 551 is adjacent to other white balance gains (eg, the white balance gain 551 ) -1), white balance gain 551-1, white balance gain 551-3, and white balance gain 551-4) ), the white balance gain 551-2, the white balance gain 551-3, and the white balance gain 551-4 may be determined (eg, confirmed).
  • the processor 120 may confirm that the delta uv corresponding to the white balance gain 551-1 and the white balance gain 551-3 is C, It can be confirmed that delta uv corresponding to the white balance gain 551-2 and the white balance gain 551-4 is D.
  • the processor 120 (eg, the image signal processor 260 ) includes a white balance gain 551-1, a white balance gain 551-2, a white balance gain 551-3, and a white balance
  • the first gain ratio may be determined based on the gains 551-4 and the white balance gain 551 .
  • a white balance gain 551-1, a white balance gain 551-2, a white balance gain 551-3, and a white balance gain 551-4 are four parallelograms.
  • the white balance gain 551 which is a vertex and determined as the first white balance gain, is a line segment connecting the white balance gain 551-1 and the white balance gain 551-2, the white balance gain 551-3, and the white It can be assumed that the balance gain 551-4 is substantially parallel to the line segment connecting it and is on the line segment 551-5.
  • the processor 120 may determine, for example, a ratio (eg, b/a or a:b in FIG. 5B ) for externally dividing the line segment 551 - 5 as the first gain ratio.
  • the processor 120 may check the color temperature input by the user. For example, the processor 120 may confirm that the user input color temperature is 6000K corresponding to the fifth line 531-5 (eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K). have.
  • the fifth line 531-5 eg, an isothermal line (or an isothermal line) corresponding to a color temperature of 6000K.
  • the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ), and refers to a plurality of values related to a user input color temperature and a first white balance gain.
  • the second white balance gain may be determined based on the delta uvs of , and the first gain ratio.
  • the processor 120 may determine that the white balance gains corresponding to the color temperature of 6000K and respectively corresponding to delta uv C and delta uv D are the white balance gain 552-1 and the white balance gain 552-2. can It may be assumed that the white balance gain 552-1 and the white balance gain 552-2 form a line segment (or substantially straight line) 552-3.
  • the processor 120 may determine a white balance gain 552 that divides the line segment 552 - 3 by a first gain ratio (eg, b/a) as the second white balance gain.
  • the processor 120 may determine the two delta uvs and the first gain ratio based on the first white balance gain and the two white balance gains forming the line segment. For example, in FIG.
  • the white balance gain 551 -1) and delta uvs C and D corresponding to each of the white balance gain 551 - 2 may be determined (eg, confirmed) as delta uvs related to the first white balance gain.
  • the processor 120 eg, the image signal processor 260
  • the white balance gain 556 is configured to include a line segment formed by the white balance gain 551-1 and the white balance gain 551-2, the white balance gain 556 .
  • a ratio (eg, d/c or c:d) that is externalized by ? may be determined as the first gain ratio.
  • FIG. 6 is a flowchart 600 for explaining a method of providing white balance, according to various embodiments.
  • the processor 120 may execute a camera application based on a user input.
  • the processor 120 may determine whether a white balance mode set in the camera application is a manual mode.
  • the processor 120 may determine whether a white balance mode set in the camera application is a manual mode in response to the execution of the camera application.
  • the 'manual mode' may be a mode in which a white balance of a camera (or image) can be set (or adjusted) according to a color temperature input by a user.
  • the 'auto mode (or auto mode)' may be a mode in which the white balance of the camera can be set (or adjusted) based on an automatic white balance algorithm.
  • the automatic white balance algorithm performs the white balance so that the ratio of the R data integration value and the G data integration value of the white region and the ratio of the B data integration value and the G data integration value in the first image obtained from the image becomes 1. It may be an algorithm that sets (or adjusts) the gain.
  • the automatic white balance algorithm is not limited to the above-described example.
  • operation 605 may be performed.
  • the processor 120 eg, the main processor 121 , if it is determined in operation 603 that the white balance mode is an automatic mode rather than a manual mode, the processor 120 (eg, image The signal processor 260 may determine the third white balance gain in the automatic mode. For example, the processor 120 may obtain an image (or image data) from the image sensor 230 and determine the third white balance gain using an automatic white balance algorithm based on the obtained image.
  • the processor 120 may acquire a third image by applying a third white balance gain to the image acquired from the image sensor 230 . have.
  • the processor 120 eg, the main processor 121
  • operation 609 may be performed.
  • the processor 120 may determine a first white balance gain based on the first image obtained from the image sensor 230 .
  • the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table (eg, the table 320 of FIG. 3B ) and the first white balance gain, the first white At least one delta uv related to the balance gain can be determined (eg, confirmed).
  • the processor 120 may identify a color temperature input by the user.
  • the processor 120 may store the table (eg, the table 320 in FIG. 3B ), the user input color temperature, and the at least one delta uv. Based on this, the second white balance gain may be determined.
  • the processor 120 obtains a second image by applying a second white balance gain to the first image (or first image data). can do.
  • Examples of operations 609 to 617 of FIG. 6 are at least partially the same as or similar to the examples of operations 403 to 411 of FIG. 4 , and thus a detailed description thereof will be omitted.
  • the processor 120 may display the acquired image through a display (eg, the display device 160 ).
  • the processor 120 eg, the main processor 121
  • the processor 120 may display the acquired second image through a display (eg, the display device 160 ) when the white balance mode is the manual mode.
  • the processor 120 may display the acquired third image through a display (eg, the display device 160 ).
  • the operations of FIG. 6 display a still image (or capture image) or operations for displaying a live view (or preview) image. It may correspond to the actions to be performed.
  • the image displayed in operation 619 may be a live view image or a still image.
  • the image displayed in operation 619 is not limited to the described embodiment, and according to various embodiments, the image displayed in operation 619 may include an image in a different form (eg, augmented reality (AR) image, composite image).
  • AR augmented reality
  • FIG. 7 is a flowchart 700 for explaining a method of providing an image (eg, a still image) according to various embodiments of the present disclosure.
  • the processor 120 (eg, the main processor 121 ) performs an image (eg, a plurality of first images including the first image) in the live view mode. ) may be displayed through a display (eg, the display device 160 ).
  • the processor 120 may display the plurality of first images through a display (eg, the display device 160 ).
  • a plurality of second images including the second image to which the second white balance gain is applied may be continuously displayed.
  • the processor 120 may display the plurality of first images through a display (eg, the display device 160 ).
  • a plurality of first images may be continuously displayed without applying a second white balance gain to .
  • the processor 120 may receive a user input for capturing an image.
  • the processor 120 may receive a user input for acquiring a still image (or a captured image) while displaying the image through a display (eg, the display device 160 ) in the live view mode. .
  • the processor 120 may identify a second white balance gain.
  • the processor 120 may be configured to generate a second white balance gain associated with at least one of the plurality of second images displayed in the live view mode (eg, a second white balance gain applied to the first image to obtain the second image). 2 white balance gain).
  • the processor 120 may use a plurality of images in determining the second white balance gain. For example, the processor 120 may check the second white balance gain by using a plurality of designated images among a plurality of second images displayed in the live view mode. The second white balance gain may be confirmed by using the 2-1 image to which the second white balance gain is first applied among the plurality of second images and the 2-2 image at the point in time when a user input for image capture is generated. For example, the processor 120 may identify intermediate data (eg, average data) between the white balance gain of the 2-1 th image and the white balance gain of the 2-2 th image as the second white balance gain. In addition, the processor 120 may store, for example, data related to the white balance gain of the 2-1 th image and the white balance gain of the 2-2 th image in the memory 130 .
  • intermediate data eg, average data
  • the processor 120 may use an image at a specified time in determining the second white balance gain.
  • the processor 120 may use an image of an intermediate time point (eg, a center view point) between a time point at which the second white balance gain is first applied and a time point at which a user input is generated among the plurality of second images, You can check the balance gain.
  • the time-related information may be pre-stored in the memory 130 , and the processor 120 may identify the second white balance gain by using the time-related information stored in the memory 130 .
  • the processor 120 may obtain a still image by applying a second white balance gain to the image.
  • the processor 120 calculates a second white balance gain for an image displayed in the live view mode or an image having a higher resolution than an image displayed in the live view mode. By applying it, a still image can be obtained.
  • the processor 120 may display a second image displayed in the live view mode and to which the second white balance gain is applied through the display.
  • the processor 120 may store the acquired still image in the memory 130 .
  • FIG. 8 is a flowchart 800 for explaining a method of providing white balance, according to various embodiments.
  • the processor 120 may acquire a first image through the image sensor 230 .
  • the processor 120 may determine a first white balance gain based on the first image obtained from the image sensor 230 .
  • the processor 120 (eg, the image signal processor 260 ) is configured to: based on the table (eg, the table 320 of FIG. 3B ) and the first white balance gain, the first white At least one delta uv related to the balance gain may be determined.
  • Examples of operations 801 to 805 of FIG. 8 are at least partially the same as or similar to the examples of operations 401 to 405 of FIG. 4 , and thus a detailed description thereof will be omitted.
  • the processor 120 selects a first color temperature (hereinafter, referred to as a 'first color temperature') corresponding to the first white balance gain. can decide a first color temperature (hereinafter, referred to as a 'first color temperature') corresponding to the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) stores a first white balance gain (or a white balance gain equal to the first white balance gain) into a table (eg, table 320 in FIG. 3B ). )), a color temperature corresponding to the same white balance gain as the first white balance gain in a table (eg, the table 320 of FIG. 3B ) may be determined as the first color temperature. For example, referring to the table 320 of FIG. 3B , when it is determined that the first white balance gain is WB 7 , the processor 120 sets the color temperature 3000K corresponding to WB 7 in the table 320 to the first color. It can be determined as temperature.
  • the processor 120 (eg, image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in a table (eg, table 320 in FIG. 3B ), but the first white the two white balances, such that the balance gain is on a line (eg, a line segment) formed by two immediately adjacent white balance gains corresponding to the same color temperature in a table (eg, table 320 in FIG. 3B ). You can check the gains.
  • the processor 120 may determine a color temperature corresponding to the two white balance gains as the first color temperature. For example, referring to the table 320 of FIG. 3B , the processor 120 may confirm that the first white balance gain and the table 320 do not have the same white balance gain.
  • the processor 120 is configured such that the first white balance gain is on a substantially (substantially) straight line formed by the two immediately adjacent WB 11 and WB 12 corresponding to the same color temperature in the table 320 . 11 and WB 12 can be found.
  • the processor 120 may determine the color temperature 4000K corresponding to the two WB 11 and WB 12 as the first color temperature.
  • the processor 120 (eg, image signal processor 260 ) is configured such that a white balance gain equal to the first white balance gain is not in a table (eg, table 320 in FIG. 3B ), but the first white The balance gain is a value of the immediately adjacent 1-1 white balance gain and the 1-2 white balance gain corresponding to the 1-1 color temperature in the table 320 of FIG. 3B , the 1-1 color temperature.
  • the processor 120 receives, from the first white balance gain, a line segment formed by the 1-1 white balance gain corresponding to the 1-1 color temperature and the 1-2 white balance gain and the 1-2 color temperature.
  • a color temperature such that the ratios are equal, can be determined as the first color temperature.
  • the processor 120 may identify a second color temperature (hereinafter, referred to as a 'second color temperature') input by the user.
  • the processor 120 calculates the color temperature difference between the first color temperature and the second color temperature (hereinafter referred to as a 'color temperature difference'). can be checked
  • the processor 120 may determine the second white balance gain in consideration of the color temperature difference.
  • the processor 120 (eg, image signal processor 260 ) is configured to: based on a table (eg, table 320 of FIG. 3B ), a second color temperature, and at least one delta uv, 2-1 You can determine the white balance gain.
  • the processor 120 may determine the 2-1 th white balance gain through embodiments that are at least partially identical to or similar to the embodiments described in operation 409 of FIG. 4 .
  • the processor 120 may adjust the 2-1 th white balance gain when the color temperature difference is greater than or equal to a specified color temperature difference (eg, 1000K). For example, the processor 120 (eg, the image signal processor 260 ) may not adjust the 2-1 white balance gain when the color temperature difference is less than 1000K as the designated color temperature difference. The processor 120 (eg, the image signal processor 260 ) may adjust the 2-1 th white balance gain when the color temperature difference is 1000K or more as the designated color temperature difference.
  • a specified color temperature difference eg, 1000K
  • the processor 120 may adjust the 2-1 th white balance gain when the color temperature difference is 1000K or more as the designated color temperature difference.
  • the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is greater than or equal to the specified difference, the 2-1 th white balance gain is the white balance corresponding to the blackbody locus along the isothermal line.
  • the 2-1 white balance gain may be adjusted to move in the gain direction.
  • the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is equal to or greater than the specified color temperature difference, the 2-1 th white balance gain corresponding to the color temperature difference (or the color temperature difference). By the amount of the white balance gain (specified according to the temperature difference), the 2-1 th white balance gain may be adjusted so that the 2-1 th white balance gain moves along the isothermal line in the white balance gain direction corresponding to the blackbody locus. In an embodiment, the processor 120 (eg, the image signal processor 260 ) determines the degree (or amount of change) by which the 2-1 th white balance gain is adjusted, delta uv (or the amount of change) corresponding to the first white balance gain.
  • the color temperature difference ( delta uv corresponding to the 2-1 white balance gain) obtained by subtracting the specified color temperature difference (eg 1000K) from the color temperature difference (eg 2000K) between the first color temperature and the second color temperature
  • the 2-1 th white balance gain may be adjusted to correspond to the delta uv change amount reduced by a ratio corresponding to 1000K).
  • the processor 120 eg, the image signal processor 260
  • the white balance gain shifted in the blackbody locus along the isothermal line of the second color temperature by delta uv 0.005 corresponding to 50% of the delta uv 0.010 corresponding to the first white balance gain to adjust the 2-1 white balance gain.
  • the processor 120 may determine the adjusted 2-1 th white balance gain as the second white balance gain.
  • the processor 120 may determine the 2-1 th white balance gain as the second white balance gain when the color temperature difference is smaller than the specified difference.
  • the processor 120 (eg, the image signal processor 260 ), the processor 120 considers the color temperature difference and delta uv corresponding to the first white balance gain. Thus, the second white balance gain may be determined.
  • the processor 120 (eg, the image signal processor 260 ) is configured to: when the color temperature difference is greater than or equal to the specified difference and the delta uv corresponding to the first white balance gain is outside the specified delta uv range (eg: delta uv is less than or equal to -0.0025 or greater than or equal to 0.0025), the 2-1 white balance gain may be adjusted so that the 2-1 white balance gain moves along the isothermal line in the white balance gain direction corresponding to the blackbody locus.
  • the present invention is not limited thereto, and the 2-1 white balance gain may be adjusted based on whether the color temperature difference is equal to or greater than a specified difference regardless of the delta uv size corresponding to the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) is configured to perform the 2-1th step, when the color temperature difference is equal to or greater than the specified difference and the delta uv corresponding to the first white balance gain is equal to or greater than the specified delta uv. so that the 2-1 white balance gain is shifted in the direction of the white balance gain corresponding to the black body locus along the isothermal line by the white balance gain corresponding to the color temperature difference (or designated according to the color temperature difference) , the 2-1 white balance gain can be adjusted.
  • the processor 120 may determine the adjusted 2-1 th white balance gain as the second white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) provides a sense of stability to the user by adjusting the 2-1 white balance gain in the direction of the white balance gain on the blackbody locus based on the color temperature difference. An image that can be transmitted can be obtained.
  • the processor 120 (eg, the image signal processor 260 ) is configured to, when a color temperature difference is less than a specified difference or a delta uv corresponding to a first white balance gain is less than a specified delta uv,
  • the 2-1 white balance gain may be determined as the second white balance gain.
  • the method of determining the second white balance gain by adjusting the 2-1 white balance gain is not limited to the above-described example.
  • the processor 120 eg, the image signal processor 260
  • the processor 120 is configured to operate the second-second As the 1st white balance gain is the white balance gain corresponding to the color temperature difference (or specified according to the color temperature difference), the 2-1 white balance gain moves along the isothermal line in the direction of the white balance gain corresponding to the blackbody locus As much as possible, the 2-1 th white balance gain may be adjusted.
  • the processor 120 obtains a second image by applying a second white balance gain to the first image (or first image data). can do. Since the embodiments of operation 815 are at least partly the same as or similar to the embodiments of operation 411 of FIG.
  • the operations (eg, 401 to 411, 601 to 619, 701 to 707, or 801 to 815) described in the process or method shown in FIGS. 4 and 6 to 8 are sequential, parallel, iterative, or heuristic. It can be done in one way. For example, they may be executed in a different order, some operations may be omitted, or other operations may be added.
  • the electronic device may acquire a plurality of images using a plurality of cameras, and may identify and apply a white balance gain using the plurality of images.
  • a second white balance gain may be determined using the 1-2 white balance gain, and a second image may be obtained by applying the determined second white balance to the 1-1 image and/or the 1-2 image.
  • FIG. 9 is an exemplary diagram 900 for explaining a method of providing white balance, according to various embodiments.
  • line 921-1 may represent white balance gains on a blackbody trajectory.
  • the line 921-1 may indicate white balance gains corresponding to a case in which delta uv is 0 (or B of a table (eg, table 320 of FIG. 3B )).
  • line 921 - 2 may represent white balance gains corresponding to a case where delta uv is -0.005 (or A of a table (eg, table 320 in FIG. 3B )).
  • Lines 921-3 may represent white balance gains corresponding to a case where delta uv is 0.005 (or +0.005) (or C of a table (eg, table 320 of FIG. 3B )).
  • Lines 921-4 may represent white balance gains corresponding to a case where delta uv is 0.010 (or +0.010) (or D of a table (eg, table 320 in FIG. 3B )).
  • each of the lines has a white balance corresponding to the same color temperature (or the same correlated color temperature). gains can be expressed.
  • the white balance gain on the first line 931-1 may represent white balance gains corresponding to 2000 K (kelvin) (or absolute temperature) as the same color temperature.
  • the white balance gains on the ninth line 931 - 9 may represent white balance gains corresponding to 10000K as the same color temperature.
  • the horizontal axis of the graph 900 may mean the R gain
  • the vertical axis may mean the B gain.
  • the processor 120 may determine the first white balance gain based on the first image data (or the first image) obtained from the image sensor 230 . have. For example, in FIG. 9 , the processor 120 may determine the white balance gain (or coordinates) 941-1 as the first white balance gain.
  • the processor 120 (eg, the image signal processor 260 ) refers to a table (eg, the table 320 of FIG. 3B ) and calculates at least one delta uv associated with the first white balance gain. can decide For example, in FIG. 9 , the processor 120 determines that the white balance gain (or coordinates) 941-1 determined as the first white balance gain is WB 7 , and a table (eg, the table 320 of FIG. 3B ) )), it can be confirmed that the delta uv corresponding to WB 7 is C.
  • the processor 120 may determine a first color temperature corresponding to the first white balance gain. For example, in FIG. 9 , 3000K corresponding to the white balance gain 941-1 determined as the first white balance gain may be determined as the first color temperature corresponding to the first white balance gain.
  • the processor 120 may identify a color temperature difference between the first color temperature and the second color temperature input by the user.
  • the processor 120 may determine the second white balance gain in consideration of the color temperature difference.
  • the processor 120 (eg, image signal processor 260 ) is configured to: based on a table (eg, table 320 of FIG. 3B ), a second color temperature, and at least one delta uv, 2-1 You can determine the white balance gain.
  • the processor 120 may determine the 2-1 th white balance gain through embodiments that are at least partially identical to or similar to the embodiments described in operation 409 of FIG. 4 .
  • the processor 120 (eg, the image signal processor 260 ) is configured to, when the color temperature difference is greater than or equal to the specified difference, the 2-1 th white balance gain is the white balance corresponding to the blackbody locus along the isothermal line.
  • the 2-1 white balance gain may be adjusted to move in the gain direction.
  • the processor 120 determines the degree (or amount of change) by which the 2-1 th white balance gain is adjusted, delta uv (or the amount of change) corresponding to the first white balance gain.
  • the color temperature difference ( delta uv corresponding to the 2-1 white balance gain) obtained by subtracting the specified color temperature difference (eg 1000K) from the color temperature difference (eg 2000K) between the first color temperature and the second color temperature Example:
  • the 2-1 th white balance gain may be adjusted to correspond to the delta uv change amount reduced by a ratio corresponding to 1000K).
  • the processor 120 may generate a table (eg, the table 320 of FIG. 3B ), the second color temperature , and at least one delta uv, the white balance gain 941-3 may be determined as a 2-1 th white balance gain.
  • the processor 120 may confirm that the difference between the first color temperature and the second color temperature is 3000K or more, which is designated as 4000K, and the delta uv corresponding to the white balance gain 941-1 is 0.005.
  • the processor 120 may determine that the color temperature difference obtained by subtracting the specified color temperature difference of 3000K from the color temperature difference of 4000K is 1000K.
  • the processor 120 may reduce the white balance gain 941-3 by a ratio corresponding to the color temperature difference 1000K obtained by subtracting the delta uv 0.005 corresponding to the white balance gain 941-1, for example,
  • the white balance gain 941-3 may be adjusted to decrease (or shift) in the direction of the white balance gain 941-5 corresponding to the blackbody locus along the second color temperature by delta uv 0.0025.
  • the processor 120 may determine the white balance gain 941-4 to which the white balance gain 941-3 is adjusted as the second white balance gain.
  • the processor 120 may determine the 2-1 th white balance gain as the second white balance gain when the color temperature difference is smaller than the specified difference. For example, if the first color temperature is 3000K, the second color temperature is 5000K, and the specified color temperature difference is 3000K, the processor 120 may store the table 320, the second color temperature, and the at least one delta uv. The white balance gain 941 - 2 (or the 2-1 th white balance gain) determined based on the above may be determined as the second white balance gain.
  • FIG. 10 is an exemplary diagram for explaining a method of providing a white balance according to a white balance mode of a camera functionally connected to the electronic device 101, according to various embodiments of the present disclosure.
  • FIG. 10A may represent a case in which white balance is set in an automatic mode.
  • the object 1011 may be an object related to white balance setting.
  • the processor 120 eg, the main processor 121
  • text 1013 may indicate the current white balance mode and color temperature.
  • the processor 120 may display the screen 1010 to which the white balance gain set in the automatic mode is applied through the display (eg, the display device 160 ). have.
  • (b) of FIG. 10 may represent a case in which white balance is set in the manual mode.
  • the object 1021 may be an object related to white balance setting.
  • the processor 120 may change the white balance mode from the manual mode to the automatic mode.
  • text 1023 may represent a color temperature input by a user.
  • the object 1025 may indicate that the current white balance mode is a manual mode.
  • the user may input a color temperature into the electronic device 101 using a bar 1024 .
  • the processor 120 eg, the image signal processor 260
  • the processor 120 moves to the position of the object 1026 on the bar 1024 . You can check the corresponding color temperature.
  • the processor 120 applies a white balance gain ( ) to be applied to the first image obtained from the image sensor 230 according to the color temperature input by the user.
  • a white balance gain ( ) to be applied to the first image obtained from the image sensor 230 according to the color temperature input by the user.
  • a second image (eg, the screen 1020) obtained by determining a second white balance gain) and applying the determined white balance gain to the first image is displayed through a display (eg, the display device 160) can do.
  • a method for providing white balance in an electronic device 101 includes acquiring a first image through an image sensor 230 of the electronic device 101 , the first image a table 320 including white balance gains for a plurality of color temperatures and a plurality of delta uvs and stored in the memory 130 of the electronic device 101 and Determining at least one delta uv related to the first white balance gain based on the first white balance gain, checking a first color temperature input from a user, the table 320, and the first determining a second white balance gain based on a color temperature and the at least one delta uv, and applying the second white balance gain to the first image to obtain a second image. can do.
  • the determining of the at least one delta uv related to the first white balance gain may include determining the delta uv when there is a delta uv corresponding to the first white balance gain in the table 320 . It may include an operation of determining the at least one delta uv.
  • the determining of the second white balance gain includes determining, as the second white balance gain, a white balance gain corresponding to the first color temperature and the delta uv in the table 320 . may include.
  • the determining of the at least one delta uv related to the first white balance gain may include, when there is no delta uv corresponding to the first white balance gain in the table 320 , the first white identifying the at least two white balance gains, such that the balance gain is on a line formed by at least two adjacent white balance gains corresponding to the same color temperature in the table (320); determining a first delta uv and a second delta uv corresponding to each of the balance gains as the at least one delta uv, and based on the first white balance gain and the at least two white balance gains, the second 2 and determining a first gain ratio for determining the white balance gain.
  • the determining of the second white balance gain may be performed based on the table 320 , the first color temperature, the first delta uv, the second delta uv, and the first gain ratio. and determining the second white balance gain.
  • the determining of the at least one delta uv related to the first white balance gain may include, when there is no delta uv corresponding to the first white balance gain in the table 320 , the first white In the table 320, the 1-1th white balance gain and the 1-2th white balance gain that are immediately adjacent to the 1-1th color temperature corresponding to the 1-1th color temperature, and the 1-1th white balance gain immediately preceding or immediately following the 1-1th color temperature
  • the 1-3th white balance gain corresponding to the 1-2 color temperature and corresponding to the delta uv equal to the 1-1 white balance gain, and the 1-2th white balance gain corresponding to the 1-2 color temperature and the same the 1-1 th white balance gain, the 1-2 th white balance gain, the 1-3 th white balance gain to be in an area within a rectangle formed by the 1-4 th white balance gain corresponding to delta uv; and confirming the 1-4th white balance gain, a 3rd delta uv corresponding to the 1-1th white balance gain and the 1-3th
  • the determining of the second white balance gain may be performed based on the table 320 , the first color temperature, the third delta uv, the fourth delta uv, and the first gain ratio. and determining the second white balance gain.
  • the method further comprises: determining a second color temperature corresponding to the first white balance gain, in the table 320, the first color temperature, and the at least one delta uv. Based on the operation of determining the second white balance gain, the table 320, the first color temperature, the at least one delta uv, and a color temperature difference between the first color temperature and the second color temperature based on the second white balance gain, the method may include determining the second white balance gain.
  • the determining of the second white balance gain based on the table 320 , the first color temperature, and the at least one delta uv may include: when the color temperature difference is greater than or equal to a specified color temperature difference , by moving the white balance gain determined based on the table 320 , the first color temperature, and the at least one delta uv in the white balance gain direction corresponding to the blackbody locus along the isothermal line, the second and determining a white balance gain.
  • the method includes receiving a user input for executing a camera application, and when receiving the user input, the second white balance gain for each of a plurality of image frames included in the first image applying the second image including each of the plurality of image frames to which the second white balance gain is applied, as a live view image, the display of the electronic device 101 (eg, a display device ( 160)), receiving a user input for capturing an image, and obtaining a third image by applying the second white balance gain to the image acquired from the image sensor 230 , and storing the obtained third image in the memory 130 .
  • the display of the electronic device 101 eg, a display device ( 160)
  • receiving a user input for capturing an image and obtaining a third image by applying the second white balance gain to the image acquired from the image sensor 230 , and storing the obtained third image in the memory 130 .
  • the structure of the data used in the above-described embodiment of the present invention may be recorded in a computer-readable recording medium through various means.
  • the computer-readable recording medium includes a storage medium such as a magnetic storage medium (eg, a ROM, a floppy disk, a hard disk, etc.) and an optically readable medium (eg, a CD-ROM, a DVD, etc.).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

Un dispositif électronique selon divers modes de réalisation de la présente invention peut comprendre : un capteur d'image ; un processeur connecté fonctionnellement au capteur d'image ; et une mémoire qui est connectée au processeur et stocke une table comprenant des gains d'équilibrage des blancs pour une pluralité de delta UV et une pluralité de températures de couleur, la mémoire stockant des instructions qui, lorsqu'elles sont exécutées, font effectuer les opérations suivantes par le processeur : acquérir une première image par l'intermédiaire du capteur d'image ; déterminer un premier gain d'équilibrage des blancs en fonction de la première image ; déterminer au moins un delta UV associé au premier gain d'équilibrage des blancs en fonction de la table et du premier gain d'équilibrage des blancs ; vérifier une première entrée de température de couleur par un utilisateur ; déterminer un deuxième gain d'équilibrage des blancs en fonction de la table, de la première température de couleur et du ou des delta UV ; et acquérir une deuxième image en appliquant le deuxième gain d'équilibrage des blancs à la première image.
PCT/KR2020/017656 2019-12-19 2020-12-04 Procédé de fourniture d'équilibrage des blancs et dispositif électronique prenant en charge celui-ci WO2021125645A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2019-0170310 2019-12-19
KR1020190170310A KR20210078656A (ko) 2019-12-19 2019-12-19 화이트 밸런스를 제공하는 방법 및 이를 지원하는 전자 장치

Publications (1)

Publication Number Publication Date
WO2021125645A1 true WO2021125645A1 (fr) 2021-06-24

Family

ID=76478457

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/017656 WO2021125645A1 (fr) 2019-12-19 2020-12-04 Procédé de fourniture d'équilibrage des blancs et dispositif électronique prenant en charge celui-ci

Country Status (2)

Country Link
KR (1) KR20210078656A (fr)
WO (1) WO2021125645A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023022331A1 (fr) * 2021-08-18 2023-02-23 삼성전자 주식회사 Procédé de fourniture d'image, et dispositif électronique le prenant en charge
US11706532B2 (en) 2021-08-18 2023-07-18 Samsung Electronics Co., Ltd. Method for providing image and electronic device supporting the same
CN114630095B (zh) * 2022-03-15 2024-02-09 锐迪科创微电子(北京)有限公司 目标场景图像的自动白平衡方法及装置、终端

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8089528B2 (en) * 2007-10-22 2012-01-03 Sony Corporation Color signal processing circuit, image pickup apparatus, and color signal processing method
KR101356516B1 (ko) * 2007-10-24 2014-01-29 엘지전자 주식회사 주변 광원에 의한 화이트 밸런스 보상 장치 및 방법
KR20180019177A (ko) * 2015-10-16 2018-02-23 구글 엘엘씨 적외선 및/또는 자외선 신호들을 사용하는 자동 화이트 밸런스
KR101903626B1 (ko) * 2014-04-29 2018-10-04 인텔 코포레이션 로우 이미지 데이터의 색도 측정을 이용한 자동 화이트 밸런싱

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8089528B2 (en) * 2007-10-22 2012-01-03 Sony Corporation Color signal processing circuit, image pickup apparatus, and color signal processing method
KR101356516B1 (ko) * 2007-10-24 2014-01-29 엘지전자 주식회사 주변 광원에 의한 화이트 밸런스 보상 장치 및 방법
KR101903626B1 (ko) * 2014-04-29 2018-10-04 인텔 코포레이션 로우 이미지 데이터의 색도 측정을 이용한 자동 화이트 밸런싱
KR20180019177A (ko) * 2015-10-16 2018-02-23 구글 엘엘씨 적외선 및/또는 자외선 신호들을 사용하는 자동 화이트 밸런스

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHOI KYUNG-AH: "User Preferred White Point Adjustment for Displays under Varying Illumination Chromaticities", MASTER THESIS, 1 January 2014 (2014-01-01), pages 1 - 100, XP055823272 *

Also Published As

Publication number Publication date
KR20210078656A (ko) 2021-06-29

Similar Documents

Publication Publication Date Title
WO2021125645A1 (fr) Procédé de fourniture d'équilibrage des blancs et dispositif électronique prenant en charge celui-ci
WO2020091262A1 (fr) Procédé de traitement d'image à l'aide d'un réseau neuronal artificiel, et dispositif électronique le prenant en charge
WO2021141445A1 (fr) Procédé d'amélioration de la qualité d'image dans un scénario de zoom avec une seule caméra, et dispositif électronique comprenant celui-ci
WO2019017641A1 (fr) Dispositif électronique, et procédé de compression d'image de dispositif électronique
WO2019164185A1 (fr) Dispositif électronique et procédé de correction d'une image corrigée selon un premier programme de traitement d'image, selon un second programme de traitement d'image dans un dispositif électronique externe
WO2020032497A1 (fr) Procédé et appareil permettant d'incorporer un motif de bruit dans une image sur laquelle un traitement par flou a été effectué
WO2020180157A1 (fr) Dispositif électronique et procédé permettant de régler une couleur de données d'image à l'aide d'un capteur infrarouge
WO2019143050A1 (fr) Dispositif électronique et procédé de commande de mise au point automatique de caméra
WO2020159262A1 (fr) Dispositif électronique et procédé de traitement de données de ligne incluses dans des données de trame d'image dans de multiples intervalles
WO2021141287A1 (fr) Dispositif électronique permettant de fournir une prévisualisation de caméra et procédé correspondant
WO2022102972A1 (fr) Dispositif électronique comprenant un capteur d'image et son procédé de fonctionnement
WO2021157954A1 (fr) Procédé d'enregistrement vidéo mettant en oeuvre une pluralité de caméras, et dispositif associé
EP3939247A1 (fr) Dispositif électronique et procédé permettant de commander une caméra à l'aide d'un dispositif électronique externe
WO2019208915A1 (fr) Dispositif électronique pour acquérir une image au moyen d'une pluralité de caméras par ajustage de la position d'un dispositif extérieur, et procédé associé
WO2020231156A1 (fr) Dispositif électronique et procédé d'acquisition d'informations biométriques en utilisant une lumière d'affichage
EP4046199A1 (fr) Dispositif électronique comprenant un capteur d'image et son procédé de fonctionnement
WO2019017586A1 (fr) Procédé de transmission de données d'image et de données associées à la commande de capture d'image, sur la base de la taille de données d'image et de la taille de données associées à la commande de capture d'image, et dispositif électronique le prenant en charge
WO2019059635A1 (fr) Dispositif électronique pour fournir une fonction en utilisant une image rvb et une image ir acquises par l'intermédiaire d'un capteur d'image
WO2019054626A1 (fr) Dispositif électronique, et procédé permettant d'obtenir des données d'un second capteur d'image au moyen d'un signal fourni par un premier capteur d'image
WO2020190030A1 (fr) Dispositif électronique de génération d'image composite et procédé associé
WO2019160262A1 (fr) Dispositif électronique et procédé pour traiter une image au moyen d'un dispositif électronique
WO2019107769A1 (fr) Dispositif électronique destiné à compresser sélectivement des données d'image conformément à une vitesse de lecture d'un capteur d'image, et son procédé de fonctionnement
WO2021210875A1 (fr) Dispositif électronique permettant de détecter un défaut dans une image sur la base d'une différence entre des sous-images acquises par un capteur à photodiodes multiples, et son procédé de fonctionnement
WO2022139238A1 (fr) Procédé de fourniture d'image et dispositif électronique le prenant en charge
WO2022108201A1 (fr) Procédé de fourniture d'image et dispositif électronique le prenant en charge

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20902285

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20902285

Country of ref document: EP

Kind code of ref document: A1