KR102555276B1 - Image processing method and electronic device supporting the same - Google Patents

Abstract

An electronic device comprising: a display for outputting an image, a memory for storing the image, and a processor functionally connected to the display and the memory, wherein the processor extracts an illumination component and a reflection component from the image; In the first region of the image having a first grayscale value or less, the illumination component and the reflection component are set to a first gain value and a second gain value, respectively, and in a second region of the image having a second grayscale value or more. Set the illumination component and the reflection component to a third gain value and a fourth gain value, respectively, and the first gain value and the second gain value are the third gain value and the fourth gain value, respectively. An electronic device characterized in that it is set differently is disclosed. In addition to this, various embodiments identified through the specification are possible.

Description

Image processing method and electronic device supporting the same

Embodiments disclosed in this document relate to an image processing method and an electronic device supporting the same.

Electronic devices such as smartphones may support various multimedia functions. For example, the electronic device may support functions such as photographing using a camera, displaying a photo file, or playing a video. To support such a multimedia function, an electronic device may include a display capable of displaying various contents.

The electronic device may process images received from various external image sources or stored therein according to various image processing processes. Also, the electronic device may display the processed image on its own display or transmit the processed image to an external display device so that the processed image is displayed on the external display.

Meanwhile, the electronic device may apply a technology for maximally expressing a range of light in reality, such as high dynamic range (HDR), in order to overcome a difference between a background or subject actually viewed by a user and an image captured therefrom. In HDR, the range of expression of data captured by a display or camera (e.g., the range of gradation) is wider than that of SDR (standard dynamic range), so HDR images can express bright areas brighter and dark areas darker than SDR images. can

In an image having a grayscale range lower than that of an HDR image, such as an SDR image, a dark portion (dark region) of the image may not be visually recognized.

Embodiments disclosed in this document are images in which at least one of an illumination gain and a reflection gain is differently applied for each gray level of an image in order to solve the above problems and the problems raised in this document. A processing method and an electronic device supporting the processing method may be provided.

An electronic device according to an embodiment disclosed in this document includes a display for outputting an image, a memory for storing the image, and a processor functionally connected to the display and the memory. An illumination component and a reflection component are extracted, and in a first region of the image having a first grayscale value or less, the illumination component and the reflection component are set to a first gain value and a second gain value, respectively, and a second grayscale value The illumination component and the reflection component in the second region of the image having an anomaly are set to a third gain value and a fourth gain value, respectively, and the first gain value and the second gain value are respectively the third gain value. It may be set differently from the gain value and the fourth gain value.

An image processing method according to an embodiment disclosed in this document includes an operation of acquiring an image, an operation of extracting an illumination component and a reflection component from the image, and an operation of extracting an illumination component and a reflection component from the image, and in a first region of the image having a first grayscale value or less, A first gain value and a second gain value are set for the illumination component and the reflection component, respectively, and a third gain is set for each of the illumination component and the reflection component in the second region of the image having a second grayscale value or higher. value and a fourth gain value, wherein the first gain value and the second gain value may be set to be different from the third gain value and the fourth gain value, respectively.

An electronic device according to an embodiment disclosed in this document includes a housing, a touch screen display exposed through one surface of the housing, a display driver IC (DDI) included in the display or electrically connected to the display, and the DDI. An application processor electrically connected to the application processor, and a memory electrically connected to the application processor, wherein the DDI, when executed, receives image data including a plurality of frames processed by the application processor from the memory; Acquiring illumination components and reflection components of the plurality of frames, determining whether the acquired illumination components are equal to or greater than a first reference value, and selecting one of a plurality of gain values based on the determination of whether the obtained illumination components are greater than or equal to a first reference value. The illumination components are processed using one gain value, it is determined whether the acquired reflection components are equal to or greater than a second reference value, and one of a plurality of gain values is selected based on the determination of whether the obtained reflection components are greater than or equal to a second reference value. It may store instructions for processing the reflective components using a gain value of , and displaying an image including the processed lighting components and reflective components on the display.

According to the embodiments disclosed in this document, by adjusting at least one of the illumination component gain and the reflection component gain for each gradation of the image, the visibility of a dark part (eg, an area having a low gradation value) of the image is increased to output an SDR image. It can give an effect similar to that of outputting an HDR image when

In addition to this, various effects identified directly or indirectly through this document may be provided.

1A is a block diagram of an electronic device according to an exemplary embodiment.
Figure 1b is a device block diagram of a processor and a display according to an embodiment.
2 is a diagram illustrating a method of operating an electronic device related to image processing according to an exemplary embodiment.
3 is a diagram for explaining an illumination component and a reflection component of an image according to an exemplary embodiment.
4 is a diagram for explaining an image processing method according to an exemplary embodiment.
5 is a diagram for explaining a method of applying a reflection component gain for each gray level according to an exemplary embodiment.
6A is a diagram for explaining a method of applying an illumination component gain for each gray level according to an exemplary embodiment.
6B is a diagram for explaining another method of applying an illumination component gain for each gray level according to an exemplary embodiment.
7 is a diagram for explaining a gray level of an image according to an exemplary embodiment.
8 is a diagram for explaining an effect according to image processing according to an exemplary embodiment.
9 is a diagram illustrating an electronic device in a network environment according to an embodiment.
10 is a block diagram of an electronic device according to an exemplary embodiment.
11 is a block diagram of a program module according to an embodiment.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that this is not intended to limit the present invention to the specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, like reference numerals may be used for like elements.

In this document, expressions such as "has", "may have", "includes", or "may include" refer to the presence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this document, expressions such as "A or B", "at least one of A and/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" as used herein may modify various elements, in any order and/or importance, and may refer to one element as another. It is used to distinguish from components, but does not limit the components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first element may be called a second element, and similarly, the second element may also be renamed to the first element.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component). On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, third components) do not exist between the other components.

As used in this document, the expression "configured to" means "suitable for", "having the capacity to", depending on the situation. ", "designed to", "adapted to", "made to", or "capable of" can be used interchangeably. The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware. Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured (or set) to perform A, B, and C" may include a dedicated processor (eg, an embedded processor) to perform those operations, or one or more software programs stored in a memory device that executes By doing so, it may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the technical field described in this document. Among the terms used in this document, the terms defined in general dictionaries may be interpreted as having the same or similar meaning to the meaning in the context of the related art, and unless explicitly defined in this document, in an ideal or excessively formal meaning. not interpreted In some cases, even terms defined in this document cannot be interpreted to exclude the embodiments of this document.

An electronic device according to various embodiments of the present document may include, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, Desktop PC, laptop PC, netbook computer, workstation, server, personal digital assistant (PDA), portable multimedia player (PMP), MP3 player, mobile medical device, It may include at least one of a camera or a wearable device. According to various embodiments, the wearable device is an accessory type (eg, a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted-device (HMD)), a fabric or a clothing integral type ( For example, it may include at least one of an electronic clothing), a body attachment type (eg, a skin pad or tattoo), or a body implant type (eg, an implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances include, for example, televisions, DVD players (Digital Video Disk players), audio systems, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, and home automation. Home automation control panel, security control panel, TV box (e.g. Samsung HomeSync™, Apple TV™, or Google TV™), game console (e.g. Xbox™, PlayStation™), electronics It may include at least one of a dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various types of medical devices (e.g., various portable medical measuring devices (blood glucose meter, heart rate monitor, blood pressure monitor, body temperature monitor, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), camera, or ultrasonicator, etc.), navigation device, satellite navigation system (GNSS (Global Navigation Satellite System)), EDR (event data recorder), FDR (flight data recorder), automotive infotainment ) devices, marine electronics (e.g. marine navigation systems, gyrocompasses, etc.), avionics, security devices, automotive head units, industrial or home robots, automatic teller's machines (ATMs) of financial institutions , point of sales (POS) in stores, or internet of things devices (e.g. light bulbs, sensors, electric or gas meters, sprinklers, smoke alarms, thermostats, street lights, toasters) , Exercise equipment, hot water tank, heater, boiler, etc.) may include at least one.

According to some embodiments, the electronic device may be a piece of furniture or a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, radio wave measuring devices, etc.) may include at least one. In various embodiments, the electronic device may be one or a combination of more than one of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. In addition, the electronic device according to the embodiment of this document is not limited to the above-described devices, and may include new electronic devices according to technological development.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

1A is a block diagram of an electronic device according to an exemplary embodiment.

Referring to FIG. 1A according to various embodiments of the present disclosure, an electronic device 100 may include a processor 110, an image processing module 130, a memory 150, and a display 170. However, the configuration of the electronic device 100 is not limited thereto. At least one of the above-described components may be omitted, and at least one other component may be further included. For example, the electronic device 100 may further include an input/output interface, a communication interface, or a camera.

According to various embodiments, the input/output interface may serve as an interface capable of transferring commands or data input from a user or other external device to other component(s) of the electronic device 100 . Also, the input/output interface may output commands or data received from other element(s) of the electronic device 100 to a user or other external device.

According to various embodiments, the communication interface may establish communication between the electronic device 100 and an external device. For example, the communication interface may be connected to a network through wireless communication or wired communication to communicate with the external device.

According to various embodiments, the camera may capture still images and moving images. The camera may include, for example, an imaging device. The imaging device may include, for example, a lens that receives image light of a subject and forms an image, an aperture that controls the amount of light passing through the lens, and an image sensor exposed for a certain period of time by the light passing through the lens. It may include at least one of a shutter that opens and closes, an image sensor that receives an image formed by the lens as an optical signal, and an internal memory. The internal memory may store captured images. According to an embodiment, the internal memory may store an image captured through the image sensor before operating the shutter. In some embodiments, the image stored in the internal memory may be output to the display 170 as a preview image by the processor 110 .

According to various embodiments, the processor 110 may execute calculations or data processing related to control and/or communication of at least one other component of the electronic device 100 . The processor 110 may control a plurality of hardware or software components connected to the processor 110 by driving, for example, an operating system or an application program, and may perform various data processing and calculations. The processor 110 loads and processes commands or data received from at least one of the other components (eg, non-volatile memory) into the volatile memory, and stores various data in the non-volatile memory. there is.

According to one embodiment, the processor 110 includes one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). can do. The processor 110 may be implemented as, for example, a system on chip (SoC). According to one embodiment, the processor 100 may further include a graphic processing unit (GPU) and/or an image signal processor.

According to various embodiments, the image processing module 130 may perform an operation to overcome a difference between a real background or subject recognized by the user's eyes and a captured image. For example, when outputting an SDR image, the image processing module 130 may perform image processing so that the SDR image can be recognized by a user as an HDR image.

According to one embodiment, the image processing module 130 extracts an illumination component and a reflection component from an image, and a gain for the illumination component (hereinafter referred to as an illumination gain). And a gain for the reflection component (hereinafter referred to as a reflection component gain) may be applied to improve grayscale expression of the image. Accordingly, the image can express the range of light in reality to the maximum extent.

According to one embodiment, the image processing module 130 may extract an illumination component from an image using a low pass filter. Also, the image processing module 130 may extract a reflection component by removing the illumination component from the image.

According to an embodiment, the image processing module 130 extracts the illumination component and reflection component of a specific pixel included in the image, and converts the image into a plurality of pixels of a specified size (eg, 64x64 pixels, 128x128 pixels, or 256x256 pixels). After dividing into areas (eg, blocks) and calculating the average brightness of each area, the brightness of the pixel, the average brightness of the area including the pixel and the area adjacent to the area, and the distance information between the pixel and the adjacent area An illumination component of the pixel may be calculated using a light source, or the like. For example, the image processing module 130 may calculate an illumination component of each pixel included in the image using interpolation. Also, the image processing module 130 may extract a reflection component by removing the illumination component from the image. In this case, the image processing module 130 may use a designated mathematical algorithm to fine-tune an operation in a low grayscale portion to which human vision reacts sensitively. As an example, the image processing module 130 subtracts the value obtained by converting the data of the lighting component to the logarithmic scale from the value obtained by converting the data of the image to the logarithmic scale, and returns the result of the subtraction operation to an exponent. The reflection component can be obtained by converting to an exponential form.

According to an embodiment, the image processing module 130 may apply an illumination component gain and a reflection component gain to an illumination component and a reflection component of an image, respectively, and combine the illumination component and the reflection component to which the gain is applied. Through this, the user can recognize an image having a lower grayscale range than the HDR image as an HDR image. For example, the image processing module 130 multiplies a value obtained by multiplying the illumination component gain by a value obtained by converting the data of the illumination component into a log scale and multiplied by the reflection component gain by a value obtained by converting the data of the reflection component into a log scale. The output image may be obtained by summing the values and converting the summed values into an exponential form.

According to an embodiment, when the image processing module 130 sets at least one of the illumination component gain and the specular component gain to a specified value or more in order to improve the gradation expressiveness of a dark portion (eg, a low gradation region) of an image. , The expression of gray level can be improved in the low gray level area, but the gray level value is saturated in the high gray level area (e.g., the gray level value of adjacent areas approaches the maximum value of gray level, so the gray level expression power between the areas becomes similar, so the boundary of the image is expressed. (Hereinafter referred to as a grayscale clipping phenomenon) may occur.

According to an embodiment, in order to solve a grayscale clipping phenomenon, the image processing module 130 may differently apply at least one of an illumination component gain and a reflection component gain for each grayscale of an image. For example, the image processing module 130 may set the reflection component gain to be greater in a low grayscale area than in a high grayscale area. Accordingly, it is possible to improve the visibility of an image by preventing clipping of a gray level from occurring in a high gray level area and increasing gray level expression power in a low gray level area. As another example, the image processing module 130 may set the illumination component gain to be greater in a high grayscale area than in a low grayscale area. Accordingly, an effect of increasing the contrast of the entire image may be obtained. As another example, the image processing module 130 may set the illumination component gain to be greater in a low grayscale area than in a high grayscale area. Accordingly, grayscale expression in a low grayscale region may be improved.

According to an embodiment, when the image processing module 130 applies the illumination component gain and the reflection component gain for each gray level of the image, the gray level for the setting is set not only for the first gray level or the second gray level, but also for several other gray levels. Also, the illumination component gain and reflection component gain can be set differently.

According to various embodiments, the image processing module 130 sets at least one of the illumination component gain and the reflection component gain to be smaller as the illuminance of the display 170 is lower, and the image processing module 130 sets the lower the illuminance of the display 170 is. At least one of the illumination component gain and the reflection component gain may be set higher. The image processing module 130 may use a sensor (eg, an illuminance sensor) disposed on the same surface as the display 170 to measure the illuminance reflected on the display 170 . However, it is not limited thereto. According to various embodiments, the image processing module 130 may use a sensor disposed on a different surface (eg, a rear surface) than the camera included in the electronic device 100 or the display 170 . In some embodiments, the image processing module 130 may increase the luminance of the display 170 panel itself.

According to various embodiments, the image processing module 130 may remove dark noise, which may be generated by setting at least one of the illumination component gain and the reflection component gain high, by using a noise reduction filter or the like. As another example, the image processing module 130 may increase the saturation of at least a part of the image in order to prevent a desaturation phenomenon that may occur by setting at least one of the illumination component gain and the reflection component gain high. .

According to an embodiment, the image processing module 130 may change the color temperature while setting at least one of the illumination component gain and the reflection component gain to be large or small. For example, the image processing module 130 may lower the color temperature to add a comfortable effect to the image or increase the color temperature to add a cool effect to the image.

According to an embodiment, the image processing module 130 increases the sharpness of the image by using a detail filter (or sharpness filter) while setting at least one of the illumination component gain and the reflection component gain to be large or small. can increase The detail filter may, for example, detect an edge area of an image and sharpen the detected edge area.

According to one embodiment, the image processing module 130 may be provided in a form included in the processor 110 or may be provided in a form independent of the processor 110 . When provided in a form independent of the processor 110, the image processing module 130 may communicate with the processor 110 to receive an image processing command or data from the processor 110. In some embodiments, the image processing module 130 may be included in a driving circuit of the display 170, for example, a display drive IC (DDI). The DDI may be included in the display 170 or electrically connected to the display 170 .

According to various embodiments, the memory 150 may store commands or data related to at least one other component of the electronic device 100 . According to one embodiment, the memory 150 may store software and/or programs. Also, the memory 150 may store images received from an external device or images captured by a camera installed in the electronic device 100 .

According to various embodiments, the memory 150 may include volatile and/or non-volatile memory. The memory 150 may include, for example, an internal memory or an external memory. Built-in memory includes, for example, volatile memory (e.g. DRAM (dynamic RAM), SRAM (static RAM), SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g. OTPROM (one time programmable ROM), PROM(programmable ROM), EPROM(erasable and programmable ROM), EEPROM(electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g. NAND flash) Or it may include at least one of a NOR flash, etc.), a hard drive, or a solid state drive (SSD).

According to various embodiments, the display 170 may display various contents (eg, text, image, video, icon, or symbol) to the user. For example, the display 170 may output an image stored in the memory 150, for example, an image captured by a camera or an image received from an external device, on a screen.

The display 170 may be, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or a microelectromechanical system. (microelectromechanical systems (MEMS)) displays, or electronic paper (electronic paper) displays.

According to one embodiment, the display 170 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body. . In some embodiments, the display 170 may be implemented as flexible, transparent, or wearable.

According to one embodiment, the electronic device 100 may include a housing forming an exterior of the electronic device 100 . The housing may include, for example, a front surface, a rear surface, and a side part partially surrounding a space between the front surface and the rear surface. The housing may be provided to fix and support at least some components of the electronic device 100 . For example, the processor 110, the image processing module 130, the memory 150, or the display 170 may be seated and fixed inside the housing. Also, at least a portion of the housing may be made of a transparent material (eg, glass), and a screen output on the display 170 may be displayed to the outside through the transparent area of the housing. For example, at least a portion of the display 170 may be exposed through one surface of the housing.

Figure 1b is a device block diagram of a processor and a display according to an embodiment.

According to various embodiments, the image processing module 130 of FIG. 1A may be included in a display driving IC (DDI) 171 included in the display unit 170 (eg, the display 170). In this case, when the processor 110 transmits image information to the display driving IC 171, the image processing module 130 in the display driving IC 171 processes the image information and outputs an image through the panel 173. can

According to various embodiments, the image processing module 130 may be included in the processor 110 instead of the display driving IC 171 . In this case, the image processed in real time by the image processing module 110 may be transmitted to the display driving IC 171 .

As described above, according to various embodiments, an electronic device (eg, the electronic device 100) includes a display (eg, the display 170) for outputting an image, and a memory (eg, a memory (eg, the memory (eg, the display 170)) for storing the image. 150)), and a processor (eg, the processor 110) functionally connected to the display and the memory, wherein the processor extracts an illumination component and a reflection component from the image, and displays the image having a first grayscale value or less. In the first region of the image, the illumination component and the reflection component are set to a first gain value and a second gain value, respectively, and the illumination component and the reflection component in the second region of the image having a second grayscale value or more are set. Each component may be set to a third gain value and a fourth gain value, and the first gain value and the second gain value may be set to be different from the third gain value and the fourth gain value, respectively.

According to various embodiments, the processor may set the first gain value to be greater than the third gain value.

According to various embodiments, the processor may set the first gain value to be smaller than the third gain value.

According to various embodiments, the processor may set the second gain value to be greater than the fourth gain value.

According to various embodiments, the processor sets at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to be smaller as the illuminance reflected on the display decreases, and the At least one of the first gain value, the second gain value, the third gain value, and the fourth gain value may be set to increase as the illuminance reflected on the display increases.

According to various embodiments, the processor may increase the luminance of a panel of the display.

According to various embodiments, the processor performs noise reduction on the image when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more. Filters can be applied.

According to various embodiments of the present disclosure, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more, the processor adjusts the saturation of the image. can increase

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be greater than or equal to a specified size, the processor determines the size of the image for the image. You can change the color temperature.

According to various embodiments, the processor may, for the image, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be equal to or less than a specified size. A sharpness filter can be applied.

According to various embodiments, an electronic device (eg, the electronic device 100) may include a housing, a touch screen display (eg, the display 170) exposed through one surface of the housing, included in the display, or electrically connected to the display. A display driver IC (DDI) (eg, DDI 171) connected to the DDI, an application processor (eg, processor 110) electrically connected to the DDI, and a memory (eg, memory 150) electrically connected to the application processor ), wherein the DDI, upon execution, receives image data including a plurality of frames, processed by the application processor, from the memory, and determines illumination components and reflections of the plurality of frames. Acquiring reflection components, determining whether a gradation of the obtained illumination component is greater than or equal to a first reference value, and based on the determination whether or not the gradation of the obtained illumination component is greater than or equal to a first reference value, a gain value selected from among a plurality of gain values. The illumination components are processed using , it is determined whether the gray level of the obtained reflection component is greater than or equal to a second reference, and one gain selected from among a plurality of gain values is determined based on the determination of whether or not the gradation of the obtained reflection component is greater than or equal to a second criterion. Instructions for processing the reflective components using values and displaying an image including the processed lighting components and reflective components on the display may be stored.

According to various embodiments of the present disclosure, the instructions may include processing the acquired illumination components using the first gain value when the obtained illumination components are equal to or greater than the first reference value, and When it is less than the first criterion, the obtained illumination component may be processed using a second gain value greater than the first gain value.

2 is a diagram illustrating a method of operating an electronic device related to image processing according to an exemplary embodiment.

Referring to FIG. 2 according to various embodiments of the present disclosure, in operation 210, an electronic device (eg, the electronic device 100) may obtain an image. According to one embodiment, the electronic device may obtain an image captured through a camera included in the electronic device. As another example, the electronic device may obtain an image from an external device connected to the electronic device through a communication interface. In some embodiments, the electronic device may obtain an image stored in memory.

According to various embodiments, in operation 230, the electronic device may extract an illumination component and a reflection component from the image. According to one embodiment, the electronic device may extract the illumination component from an image using a low-pass filter. Also, the electronic device may extract the reflection component by removing the illumination component from the image.

According to various embodiments of the present disclosure, in operation 250, the electronic device may set a gain value for the illumination component (eg, an illumination component gain) and a gain value for the reflection component (eg, a reflection component gain). According to an embodiment, the electronic device may differently set at least one of the illumination component gain and the reflection component gain for each gray level of the image. For example, the electronic device may set the reflection component gain to be greater in a low grayscale region of an image than in a high grayscale region of an image. As another example, the electronic device may set the gain of the illumination component to be greater in the high grayscale region of the image than in the low grayscale region of the image. As another example, the electronic device may set the gain of the illumination component to be greater in the low grayscale region of the image than in the high grayscale region of the image. In some embodiments, the electronic device divides an image into a plurality of blocks having a specified size (eg, 64x64 pixels, 128x128 pixels, or 256x256 pixels), and sets at least one of the illumination component gain and the specular component gain to be different for each block. may be

According to various embodiments, the electronic device sets at least one of the illumination component gain and the reflection component gain to be smaller as the illuminance of the display (eg, the display 170) is lower, and as the illuminance of the display is higher At least one of the illumination component gain and the reflection component gain may be set higher. As another example, the electronic device may increase the luminance of the display panel itself.

According to various embodiments of the present disclosure, the electronic device may remove dark noise, which may be generated by setting at least one of the illumination component gain and the reflection component gain high, by using a noise reduction filter or the like. As another example, the electronic device may improve the saturation of at least a partial region of the image in order to prevent a desaturation phenomenon that may occur by setting at least one of the illumination component gain and the reflection component gain high.

According to various embodiments of the present disclosure, the electronic device may change the color temperature while setting at least one of the illumination component gain and the reflection component gain to be large or small. In some embodiments, the electronic device may improve image quality through image filter processing while setting at least one of the illumination component gain and the reflection component gain to be large or small. For example, a sharpness of an image may be increased using a detail filter, or a noise prominence effect due to an increase in gain (eg, illumination component gain or reflection component gain) may be reduced through a noise reduction filter or the like.

According to various embodiments, in operation 270, the electronic device may output an image. For example, the electronic device may output an output image to the display in which the illumination component gain is applied to the illumination component of the image and the reflection component gain is applied to the reflection component of the image.

As described above, according to various embodiments, an image processing method of an electronic device including a display includes an operation of obtaining an image, an operation of extracting an illumination component and a reflection component from the image, and the operation of extracting a first grayscale value or less. In the first region of the image, the illumination component and the reflection component are set to a first gain value and a second gain value, respectively, and the illumination component and the reflection component in the second region of the image having a second grayscale value or more are set. and setting the components to a third gain value and a fourth gain value, respectively, wherein the first gain value and the second gain value may be set to be different from the third gain value and the fourth gain value, respectively. there is.

According to various embodiments of the present disclosure, the setting operation may include setting the first gain value to be greater than the third gain value.

According to various embodiments of the present disclosure, the setting operation may include setting the first gain value to be smaller than the third gain value.

According to various embodiments of the present disclosure, the setting operation may include setting the second gain value to be greater than the fourth gain value.

According to various embodiments of the present disclosure, the setting operation may include setting at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to be smaller as the illuminance reflected on the display decreases. , setting at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to increase as the illuminance reflected on the display increases.

According to various embodiments, the image processing method may further include an operation of increasing luminance of a panel of the display.

According to various embodiments, the image processing method may be performed on the image when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more. An operation of applying a noise reduction filter may be further included.

According to various embodiments of the present disclosure, the image processing method may perform processing of the image when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more. An operation of increasing saturation may be further included.

According to various embodiments, the image processing method may perform the image processing method when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be equal to or greater than or equal to a specified size. An operation of changing a color temperature for may be further included.

According to various embodiments, the image processing method may perform the image processing method when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be equal to or greater than or equal to a specified size. An operation of applying a sharpness filter to may be further included.

3 is a diagram for explaining an illumination component and a reflection component of an image according to an exemplary embodiment.

Referring to FIG. 3 according to various embodiments of the present disclosure, an electronic device (eg, the electronic device 100) may extract an illumination component and a reflection component from an image 310. For example, the electronic device may extract the illumination component from an image using a low-pass filter, and extract the reflection component by removing the illumination component from the image. The illustrated figure shows an image 330 from which an illumination component is extracted from an input image 310 and an image 350 from which a reflection component is extracted. The illustrated figure shows an example of the result of extracting the illumination component and the reflection component from the input image 310, and the image 330 of the illumination component and the image 350 of the reflection component extracted as a result according to the input image 310 Those skilled in the art will readily understand that this may vary.

4 is a diagram for explaining an image processing method according to an exemplary embodiment.

Referring to FIG. 4 according to various embodiments of the present disclosure, an electronic device (eg, the electronic device 100 ) may extract an illumination component 411 and a reflection component 413 from an input image 410 . According to an embodiment, in extracting the illumination component 411 and reflection component 413 of a specific pixel included in the input image 410, the electronic device divides the input image 410 into a plurality of regions, and each region After calculating the average brightness of the pixel, the lighting component 411 of the pixel is calculated using the brightness of the pixel, the average brightness of the area including the pixel and the area adjacent to the area, and distance information between the pixel and the area adjacent to the pixel. can do. The electronic device subtracts the value obtained by converting the data of the lighting component 411 into a log scale from the value obtained by converting the data of the input image 410 into a log scale, and converts the result of the subtraction operation back into an exponential form. The reflection component 413 of the pixel can be obtained. The electronic device designates a value obtained by converting the data of the lighting component 411 to a log scale as another lighting component 411, and converts the data of the input image 410 into a log scale to a value converted into a log scale. A value obtained by subtracting the value of the illumination component 411 may be designated as another reflection component 413 of the pixel.

According to an embodiment, the electronic device provides a first gain value (eg, illumination component gain) 431 and a second gain value (eg, reflection component gain) to the extracted illumination component 411 and reflection component 413, respectively. (433) can be applied. For example, the electronic device may multiply the illumination component 411 by the first gain value 431 and the reflection component 413 by the second gain value 433 . The electronic device sums a value obtained by multiplying the illumination component 411 by the first gain value 431 and a value obtained by multiplying the reflection component 413 by the second gain value 433, and converts the summed value into an exponential form, thereby outputting the result. An image 450 may be acquired.

5 is a diagram for explaining a method of applying a reflection component gain for each gray level according to an exemplary embodiment.

Referring to FIG. 5 according to various embodiments of the present disclosure, an electronic device (eg, the electronic device 100) may apply a reflection component gain differently for each gray level of an image. As shown in the illustrated graph 500, the electronic device may set a reflection component gain greater in the low grayscale region of the image than in the high grayscale region of the image. In the graph 500, the first reflection component gain 510 is a value applied in the electronic device according to the prior art, and the second reflection component gain 530 is a value applied in the electronic device according to the present invention. However, the first reflection component gain 510 and the second reflection component gain 530 included in the graph 500 should be understood as an example showing that the reflection component gain can be set differently for each gray level. Those skilled in the art will easily understand that the fact that the first reflection component gain 510 included in the graph 500 has a constant value regardless of the gray level is only an example.

As shown in the graph 500, the electronic device amplifies the contrast ratio of fine brightness information with low visibility in the low gradation area of the image compared to the high gradation area, so that the brightness and gradation expression in the low gradation area is high. You can improve more than in the area.

6A is a diagram for explaining a method of applying a lighting component gain for each gradation according to an exemplary embodiment, and FIG. 6B is a diagram for explaining another method of applying a lighting component gain for each gradation according to an exemplary embodiment.

Referring to FIGS. 6A and 6B according to various embodiments of the present disclosure, an electronic device (eg, the electronic device 100) may apply different lighting component gains for each gray level of an image. As in graph 1 610, the electronic device may set the gain of the lighting component to be greater in the low grayscale region of the image than in the high grayscale region of the image. As in the second graph 630, the electronic device may set the gain of the lighting component to be greater in the high grayscale region of the image than in the low grayscale region of the image. In the first graph 610, the first illumination component gain 611 is a value applied in the electronic device according to the prior art, and the second illumination component gain 613 is a value applied in the electronic device according to the present invention. In the second graph 630, the third illumination component gain 631 is a value applied in the electronic device according to the prior art, and the fourth illumination component gain 633 is a value applied in the electronic device according to the present invention. However, the first illumination component gain 611 and the second illumination component gain 613 included in the first graph 610, and the third illumination component gain 631 and the fourth illumination component gain 631 included in the second graph 630. The lighting component gain 633 should be understood as an example showing that the lighting component gain can be set differently for each gray level. It is only an example that the first illumination component gain 611 included in the first graph 610 and the second illumination component gain 631 included in the second graph 630 have a constant value regardless of the gray level. A person skilled in the art will readily understand.

According to various embodiments, as shown in the first graph 610, the electronic device provides an illumination component gain (eg, a second illumination component gain 613 in the low grayscale region) to improve grayscale expression in the low grayscale region of the image. )) can be set larger than the high gradation area. Alternatively, as shown in the graph 500 of FIG. 5, the electronic device applies a reflection component gain (eg, the second reflection component gain 530) so that the brightness and grayscale expressive power in the low grayscale region of the image are higher than those in the high grayscale region. In the case of further improvement, as in the second graph 630, the light component gain (eg, the fourth light component gain 633) in the low grayscale area is compared with the high grayscale area to increase the overall contrast ratio of the entire image. You can also set it small.

7 is a diagram for explaining a gray level of an image according to an exemplary embodiment.

Referring to FIG. 7 according to various embodiments of the present disclosure, an electronic device (eg, the electronic device 100) may prevent an image from being crushed due to clipping of a grayscale in a high grayscale region of an image 700. At least one of the illumination component gain and the specular component gain may be adjusted. For example, the electronic device sets the change rate of the illumination component and the reflection component to be small (e.g., a gain value) so that the gray level is not clipped in an area with a high gray level, such as the sun 710 or the cloud 730. can be set close to 1). In an intermediate grayscale region, such as a mountain 750, the electronic device may use at least one of the illumination component gain and the reflection component gain below a designated grayscale value (eg, 96 grayscale) to preserve local grayscale expressiveness between intermediate grayscales. One is adjusted (eg, the gain value is set greater than or less than 1), and the gain value may be set close to 1 above the designated grayscale value. The electronic device sets at least one of the illumination component gain and the reflection component gain larger than that of the high grayscale region in order to improve the expressiveness of the grayscale having minute brightness information in the low grayscale region, such as the shadow 770. can

8 is a diagram for explaining an effect according to image processing according to an exemplary embodiment.

According to various embodiments of the present disclosure, referring to FIG. 8 , compared to the first image 810 before image processing, the second image 830 after image processing has improved gradation expression in dark areas (eg, low gradation areas). It can be seen that the visibility increases. For example, it can be confirmed that trees and flowers, which are difficult to see in dark areas in the left and right areas of the first image 810, are clearly visible in the second image 830.

9 is a diagram illustrating an electronic device in a network environment according to an embodiment.

Referring to FIG. 9 , an electronic device 901 according to various embodiments is an external device (eg, a first external electronic device 902 , a second external electronic device 904 , or a server 906 ) and a network 962 ) or may be connected to each other through short-range communication 964. The electronic device 901 may include a bus 910, a processor 920, a memory 930, an input/output interface 950, a display 960, and a communication interface 970. In some embodiments, the electronic device 901 may omit at least one of the components or may additionally include other components.

Bus 910 may include, for example, circuitry that connects components 910 - 970 to each other and carries communications (eg, control messages and/or data) between components.

The processor 920 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 920 may, for example, execute calculations or data processing related to control and/or communication of at least one other component of the electronic device 901 .

Memory 930 may include volatile and/or non-volatile memory. The memory 930 may store, for example, commands or data related to at least one other component of the electronic device 901 . According to one embodiment, the memory 930 may store software and/or programs 940 . The program 940 includes, for example, a kernel 941, middleware 943, an application programming interface (API) 945, and/or an application program (or "application") 947, etc. can include At least a part of the kernel 941, middleware 943, or API 945 may be referred to as an operating system (OS).

Kernel 941, for example, provides system resources (eg, middleware 943, API 945, or application program 947) used to execute operations or functions implemented in other programs (eg, middleware 943). : The bus 910, the processor 920, or the memory 930, etc.) may be controlled or managed. In addition, the kernel 941 may provide an interface capable of controlling or managing system resources by accessing individual components of the electronic device 901 from the middleware 943, API 945, or application program 947. can

The middleware 943 may perform an intermediary role so that, for example, the API 945 or the application program 947 communicates with the kernel 941 to exchange data. Also, the middleware 943 may process one or more task requests received from the application program 947 according to priority. For example, the middleware 943 may use system resources (eg, the bus 910, the processor 920, or the memory 930, etc.) of the electronic device 901 for at least one of the application programs 947. Prioritize and process the one or more work requests.

The API 945 is an interface for the application 947 to control functions provided by the kernel 941 or the middleware 943, for example, file control, window control, image processing, or text. It may include at least one interface or function (eg, command) for control.

The input/output interface 950 may serve as an interface capable of transferring commands or data input from a user or other external device to other component(s) of the electronic device 901 . Also, the input/output interface 950 may output commands or data received from other component(s) of the electronic device 901 to a user or other external device.

The display 960 may be, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or a microelectromechanical device. systems (microelectromechanical systems (MEMS)) displays, or electronic paper (electronic paper) displays. The display 960 may display, for example, various contents (eg, text, image, video, icon, symbol, etc.) to the user. The display 960 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

The communication interface 970 establishes communication between the electronic device 901 and an external device (eg, the first external electronic device 902 , the second external electronic device 904 , or the server 906 ). can For example, the communication interface 970 may be connected to the network 962 through wireless or wired communication to communicate with the external device (eg, the second external electronic device 904 or the server 906).

Wireless communication is, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) may include cellular communication using at least one of the like. According to one embodiment, wireless communication, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee (Zigbee), NFC (near field communication), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) and a body area network (BAN). According to one embodiment, wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter “Beidou”) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), power line communication, or plain old telephone service (POTS). there is. Network 162 may include at least one of a telecommunication network, for example, a computer network (eg, LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 902 and 904 may be the same as or different from the electronic device 901 . According to one embodiment, server 906 may include a group of one or more servers. According to various embodiments, all or some of the operations executed in the electronic device 901 may be executed in one or more electronic devices (eg, the electronic devices 902 and 904 or the server 906). According to one embodiment, when the electronic device 901 needs to perform a certain function or service automatically or upon request, the electronic device 901 instead of or in addition to executing the function or service by itself, At least some related functions may be requested from another device (eg, the electronic device 902 or 904 or the server 906). Another electronic device (eg, the electronic device 902 or 904 or the server 906 ) may execute the requested function or additional function and deliver the result to the electronic device 901 . The electronic device 901 may provide the requested function or service by directly or additionally processing the received result. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

10 is a block diagram of an electronic device according to an exemplary embodiment.

Referring to FIG. 10 , the electronic device 1001 may include, for example, all or part of the electronic device 901 shown in FIG. 9 . The electronic device 1001 includes one or more processors (eg, AP) 1010, a communication module 1020, a subscriber identification module 1024, a memory 1030, a sensor module 1040, an input device 1050, a display ( 1060), an interface 1070, an audio module 1080, a camera module 1091, a power management module 1095, a battery 1096, an indicator 1097, and a motor 1098.

The processor 1010 may control a plurality of hardware or software components connected to the processor 1010 by driving, for example, an operating system or an application program, and may perform various data processing and operations. The processor 1010 may be implemented as, for example, a system on chip (SoC). According to one embodiment, the processor 1010 may further include a graphic processing unit (GPU) and/or an image signal processor. The processor 1010 may include at least some of the components shown in FIG. 10 (eg, the cellular module 1021). The processor 1010 loads and processes commands or data received from at least one of the other components (eg, non-volatile memory) into the volatile memory, and stores various data in the non-volatile memory. there is.

The communication module 1020 may have the same or similar configuration as the communication interface 970 of FIG. 9 . The communication module 1020 includes, for example, a cellular module 1021, a Wi-Fi module 1023, a Bluetooth (BT) module 1025, a GNSS module 1027 (eg, a GPS module, a Glonass module, a Beidou module) , or Galileo module), an NFC module 1028, and a radio frequency (RF) module 1029.

The cellular module 1021 may provide, for example, a voice call, a video call, a text service, or an Internet service through a communication network. According to one embodiment, the cellular module 1021 may identify and authenticate the electronic device 1001 within a communication network using the subscriber identification module (eg, SIM card) 1024 . According to one embodiment, the cellular module 1021 may perform at least some of the functions that the processor 1010 may provide. According to one embodiment, the cellular module 1021 may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of the cellular module 1021, the Wi-Fi module 1023, the Bluetooth module 1025, the GNSS module 1027, or the NFC module 1028 are one may be included in an IC (integrated chip) or an IC package.

The RF module 1029 may transmit and receive communication signals (eg, RF signals), for example. The RF module 1029 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 1021, the Wi-Fi module 1023, the Bluetooth module 1025, the GNSS module 1027, or the NFC module 1028 transmits an RF signal through a separate RF module. can send and receive.

The subscriber identification module 1024 may include, for example, a card including the subscriber identification module and/or an embedded SIM, and unique identification information (eg, integrated circuit card identifier (ICCID)) or Subscriber information (eg, international mobile subscriber identity (IMSI)) may be included.

The memory 1030 (eg, the memory 930) may include, for example, an internal memory 1032 or an external memory 1034. The built-in memory 1032 includes, for example, volatile memory (eg, DRAM, SRAM, or SDRAM, etc.), non-volatile memory (eg, OTPROM (one time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM). , a flash memory, a hard drive, or a solid state drive (SSD).

The external memory 1034 is a flash drive, for example, compact flash (CF), secure digital (SD), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC) , or a memory stick. The external memory 1034 may be functionally and/or physically connected to the electronic device 1001 through various interfaces.

The sensor module 1040 may, for example, measure a physical quantity or detect an operating state of the electronic device 1001 and convert the measured or sensed information into an electrical signal. The sensor module 1040 includes, for example, a gesture sensor 1040A, a gyro sensor 1040B, an air pressure sensor 1040C, a magnetic sensor 1040D, an acceleration sensor 1040E, a grip sensor 1040F, and a proximity sensor ( 1040G), color sensor (1040H) (e.g. RGB (red, green, blue) sensor), bio sensor (1040I), temperature/humidity sensor (1040J), light sensor (1040K), or UV (ultra violet) ) may include at least one of the sensors 1040M. Additionally or alternatively, the sensor module 1040 may include, for example, an e-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, It may include an IR (infrared) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module 1040 may further include a control circuit for controlling one or more sensors included therein. In some embodiments, the electronic device 1001 further includes a processor configured to control the sensor module 1040 as part of the processor 1010 or separately, while the processor 1010 is in a sleep state, The sensor module 1040 may be controlled.

The input device 1050 may include, for example, a touch panel 1052, a (digital) pen sensor 1054, a key 1056, or an ultrasonic input device 1058. The touch panel 1052 may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, or an ultrasonic type. Also, the touch panel 1052 may further include a control circuit. The touch panel 1052 may further include a tactile layer to provide a tactile response to the user.

The (digital) pen sensor 1054 may be, for example, part of a touch panel or may include a separate sheet for recognition. Keys 1056 may include, for example, physical buttons, optical keys, or keypads. The ultrasonic input device 1058 may detect ultrasonic waves generated from an input tool through a microphone (eg, the microphone 1088) and check data corresponding to the detected ultrasonic waves.

The display 1060 (eg, the display 960) may include a panel 1062, a hologram device 1064, a projector 1066, and/or a control circuit for controlling them. Panel 1062 may be implemented to be flexible, transparent, or wearable, for example. The panel 1062 may include the touch panel 1052 and one or more modules. According to one embodiment, the panel 1062 may include a pressure sensor (or force sensor) capable of measuring the strength of a user's touch pressure. The pressure sensor may be implemented integrally with the touch panel 1052 or may be implemented as one or more sensors separate from the touch panel 1052 . The hologram device 1064 may display a 3D image in the air using interference of light. The projector 1066 may display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device 1001, for example.

Interface 1070 may include, for example, HDMI 1072, USB 1074, optical interface 1076, or D-sub (D-subminiature) 1078. Interface 1070 may be included in, for example, communication interface 970 shown in FIG. 9 . Additionally or alternatively, the interface 1070 may include, for example, a mobile high-definition link (MHL) interface, an SD card/multi-media card (MMC) interface, or an infrared data association (IrDA) compliant interface. there is.

The audio module 1080 may, for example, convert a sound and an electrical signal in both directions. At least some components of the audio module 1080 may be included in the input/output interface 950 shown in FIG. 9 , for example. The audio module 1080 may process sound information input or output through, for example, the speaker 1082, the receiver 1084, the earphone 1086, or the microphone 1088.

The camera module 1091 is, for example, a device capable of capturing still images and moving images. According to one embodiment, the camera module 1091 includes one or more image sensors (eg, a front sensor or a rear sensor), a lens, and an image signal processor (ISP). , or a flash (eg, LED or xenon lamp, etc.).

The power management module 1095 may manage power of the electronic device 1001 , for example. According to one embodiment, the power management module 1095 may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. A PMIC may have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonance circuit, or a rectifier. there is. The battery gauge may measure, for example, remaining capacity of the battery 1096, voltage, current, or temperature during charging. Battery 1096 may include, for example, a rechargeable battery and/or a solar cell.

The indicator 1097 may indicate a specific state of the electronic device 1001 or a part thereof (eg, the processor 1010), for example, a booting state, a message state, or a charging state. The motor 1098 may convert electrical signals into mechanical vibrations and generate vibrations or haptic effects. The electronic device 1001 is, for example, a mobile TV supporting device capable of processing media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo ^TM (e.g., : GPU) may be included.

Each of the components described in this document may be composed of one or more components, and the name of the corresponding component may vary depending on the type of electronic device. In various embodiments, an electronic device (eg, the electronic device 1001) is configured as a single entity by omitting some components, further including additional components, or combining some of the components. The functions of the previous corresponding components may be performed identically.

11 is a block diagram of a program module according to an embodiment.

According to one embodiment, the program module 1110 (eg, the program 940) is an operating system (OS) that controls resources related to an electronic device (eg, the electronic device 901) and/or is driven on the operating system. It may include various applications (eg, the application program 947). The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM .

Referring to FIG. 11 , the program module 1110 includes a kernel 1120 (eg kernel 941), middleware 1130 (eg middleware 943), API 1160 (eg API 945) , and/or the application 1170 (eg, the application program 947). At least a part of the program module 1110 may be preloaded on the electronic device or may be downloaded from an external electronic device (eg, the electronic device 902 or 904, the server 906, etc.).

Kernel 1120 may include, for example, system resource manager 1121 and/or device driver 1123 . The system resource manager 1121 may control, allocate, or recover system resources. According to one embodiment, the system resource manager 1121 may include a process management unit, a memory management unit, or a file system management unit. The device driver 1123 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an inter-process communication (IPC) driver. can

The middleware 1130, for example, provides functions commonly required by the application 1170 or provides various functions through the API 1160 so that the application 1170 can efficiently use limited system resources inside the electronic device. Functions may be provided to the application 1170 . According to one embodiment, the middleware 1130 includes a runtime library 1135, an application manager 1141, a window manager 1142, a multimedia manager 1143, a resource manager 1144, a power manager 1145, a database manager ( 1146), package manager 1147, connectivity manager 1148, notification manager 1149, location manager 1150, graphic manager 1151, security manager 1152, or extended screen manager ( 1153) may include at least one.

The runtime library 1135 may include, for example, a library module used by a compiler to add new functions through a programming language while the application 1170 is being executed. The runtime library 1135 may perform input/output management, memory management, or arithmetic function processing.

The application manager 1141 may manage the life cycle of the application 1170 , for example. The window manager 1142 may manage GUI resources used in the screen. The multimedia manager 1143 may determine a format necessary for reproducing media files, and encode or decode the media files using a codec suitable for the format. The resource manager 1144 may manage a source code of the application 1170 or a memory space. The power manager 1145 may manage, for example, battery capacity or power, and provide power information necessary for the operation of the electronic device. According to one embodiment, the power manager 1145 may interoperate with a basic input/output system (BIOS). The database manager 1146 may create, search, or change a database to be used in the application 1170 , for example. The package manager 1147 may manage installation or update of applications distributed in the form of package files.

The connectivity manager 1148 may manage wireless connections, for example. The notification manager 1149 may provide a user with an event such as an arrival message, an appointment, or proximity notification. The location manager 1150 may manage location information of an electronic device, for example. The graphic manager 1151 may manage, for example, graphic effects to be provided to users or user interfaces related thereto. Security manager 1152 may provide system security or user authentication, for example. The extended screen manager 1153 may, for example, determine an area of the display in which graphics are to be displayed. According to one embodiment, the extended screen manager 1153 may manage information to be provided through the area of the display in which graphics are determined to be displayed, graphic effects, or user interfaces related thereto.

According to one embodiment, the middleware 1130 may include a telephony manager for managing voice or video call functions of an electronic device or a middleware module capable of forming a combination of functions of the aforementioned components. . According to one embodiment, the middleware 1130 may provide modules specialized for each type of operating system. The middleware 1130 may dynamically delete some existing components or add new components.

The API 1160 is, for example, a set of API programming functions, and may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one API set can be provided for each platform, and in the case of Tizen, two or more API sets can be provided for each platform.

The application 1170 includes, for example, a home 1171, a dialer 1172, an SMS/MMS 1173, an instant message (IM) 1174, a browser 1175, a camera 1176, and an alarm 1177. , Contacts (1178), Voice Dial (1179), Email (1180), Calendar (1181), Media Player (1182), Album (1183), Watch (1184), Health Care (e.g. measuring exercise or blood sugar, etc.) , or environmental information (eg, air pressure, humidity, or temperature information) providing applications.

According to one embodiment, the application 1170 may include an information exchange application capable of supporting information exchange between an electronic device and an external electronic device. The information exchange application may include, for example, a notification relay application for delivering specific information to an external electronic device or a device management application for managing an external electronic device. For example, the notification relay application may transmit notification information generated by another application of the electronic device to an external electronic device or may receive notification information from the external electronic device and provide the notification information to the user. The device management application is, for example, a function of an external electronic device communicating with the electronic device (eg, turn-on/turn-off of the external electronic device itself (or some component parts) or display brightness (or resolution)). adjustment), or an application operating in an external electronic device may be installed, deleted, or updated.

According to one embodiment, the application 1170 may include an application designated according to the attributes of an external electronic device (eg, a health management application of a mobile medical device). According to one embodiment, the application 1170 may include an application received from an external electronic device.

At least part of the program module 1110 may be implemented (eg, executed) in software, firmware, hardware (eg, the processor 1010), or a combination of at least two of them, and a module for performing one or more functions; It can include a program, routine, set of instructions, or process.

The term "module" used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A “module” may be an integrally constructed component or a minimal unit or part thereof that performs one or more functions. A "module" may be implemented mechanically or electronically, for example, a known or future developed application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or A programmable logic device may be included.

At least some of the devices (eg, modules or functions thereof) or methods (eg, operations) according to various embodiments are instructions stored in a computer-readable storage medium (eg, the memory 930) in the form of program modules. can be implemented as When the command is executed by a processor (eg, the processor 920), the processor may perform a function corresponding to the command.

Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magneto-optical media (e.g. floptical disks), built-in memory, etc.) The instruction may include code generated by a compiler or code executable by an interpreter.

A module or program module according to various embodiments may include at least one or more of the aforementioned components, some may be omitted, or other components may be further included. According to various embodiments, operations performed by modules, program modules, or other components are sequentially, parallelly, repetitively, or heuristically executed, or at least some operations are executed in a different order, are omitted, or other operations are added. It can be.

And the embodiments disclosed in this document are presented for explanation and understanding of the disclosed technical content, and do not limit the scope of the present invention. Therefore, the scope of this document should be construed to include all changes or various other embodiments based on the technical spirit of the present invention.

Claims (22)

In electronic devices,
a display for outputting an image;
a memory for storing the image; and,
A processor configured to extract illumination components and reflection components from the image, set gain values to the extracted illumination components and reflection components, and output the image including the illumination components and reflection components with set gain values;
the processor,
If the image is a non-HDR image having a second grayscale range smaller than the first grayscale range of a high dynamic range (HDR) image, the non-HDR image is output like the HDR image,
In a first region of the non-HDR image corresponding to a first grayscale value, a first gain value and a second gain value are set for the illumination component and the reflection component, respectively;
In the second region of the non-HDR image corresponding to a second grayscale value lower than the first grayscale value, a third gain value having a value greater than or less than the first gain value is set for the illumination component. and setting a fourth gain value having a value greater than the second gain value for the reflection component. The method of claim 1,
Further comprising a display driver IC (DDI) included in the display or electrically connected to the display,
the processor,
An electronic device configured to set gain values to the illumination component and the reflection component by the DDI. delete delete The method of claim 1,
the processor,
At least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be smaller as the illuminance reflected on the display decreases;
The electronic device of claim 1 , wherein at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set larger as the illuminance reflected on the display increases. The method of claim 1,
the processor,
An electronic device characterized by increasing the luminance of a panel of the display. The method of claim 1,
When at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more,
the processor,
An electronic device that processes at least one of applying a noise reduction filter to the non-HDR image, increasing saturation of the non-HDR image, changing a color temperature of the non-HDR image, or applying a sharpness filter to the non-HDR image. delete delete delete In the image processing method of an electronic device including a display,
Obtaining an image;
extracting an illumination component and a reflection component from the image; and
Setting gain values to the extracted illumination component and reflection component, and outputting the image including the illumination component and reflection component with set gain values;
If the image is a non-HDR image having a second grayscale range smaller than the first grayscale range of a high dynamic range (HDR) image, the non-HDR image is output like the HDR image;
In a first region of the non-HDR image corresponding to a first grayscale value, a first gain value and a second gain value are set for the illumination component and the reflection component, respectively;
In the second region of the non-HDR image corresponding to a second grayscale value lower than the first grayscale value, a third gain value having a value greater than or less than the first gain value is set for the lighting component. and setting a fourth gain value having a greater value than the second gain value for the reflection component. delete delete delete The method of claim 11,
The setting operation is
At least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be smaller as the illumination intensity through the display decreases, and as the illumination intensity through the display increases, the first gain value increases. and setting at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to a large value. The method of claim 11,
Image processing method characterized in that it further comprises an operation of increasing the luminance of the panel of the display. The method of claim 11,
Applying a noise reduction filter to the non-HDR image when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a specified size or more; The image processing method further comprising at least one of increasing saturation of the non-HDR image, changing a color temperature of the non-HDR image, or applying a sharpness filter to the non-HDR image. . delete delete delete delete delete

Images