KR20180013400A - Image processing method and electronic device supporting the same - Google Patents

Abstract

The present invention relates to an electronic device which comprises a display for outputting an image, a memory for storing the image, and a processor functionally connected with the display and the memory. The processor extracts an illumination component and a reflection component from the image, respectively sets the illumination component and the reflection component as first and second gain values in a first area of the image which has a value not greater than a first gradation value, respectively sets the illumination element and the reflection element as third and fourth gain values in a second area of the image which has a value not smaller than a second gradation value, and respectively sets the first and second gains different from the third and fourth gains. Additionally, various embodiments figured out through the statement are possible.

Description

Technical Field [0001] The present invention relates to an image processing method and an electronic device supporting the same,

The embodiments disclosed herein relate to an image processing method and an electronic device supporting the same.

Electronic devices such as smart phones can support various multimedia functions. For example, the electronic device can support functions such as photographing with a camera, displaying a photo file, or playing a moving image. To support such a multimedia function, an electronic device may include a display capable of displaying various contents.

An electronic device can process an image received from various external image sources or stored in its own according to various image processing processes. In addition, the electronic device may display the processed image on its own display or transmit it to an external display device so that the processed image is displayed on the external display.

In order to overcome the difference between the background actually viewed by the user or the image captured by the user, the electronic device can apply a technique for expressing the range of the real light as much as possible, for example, HDR (high dynamic range). Because HDR is wider than SDR (standard dynamic range), HDR image is SDR image compared to SDR image. Therefore, bright area of image is brighter and dark area is darker than SDR .

In an image having a gradation range lower than that of the HDR image such as an SDR image, the dark part of the image may not be well visible.

In order to solve the above-mentioned problems and the problems raised in the present document, the embodiments disclosed in this document are directed to a method and apparatus for detecting at least one of an illumination gain and a reflectance gain, A processing method and an electronic apparatus supporting the same can be provided.

An electronic device according to an embodiment disclosed herein includes a display for outputting an image, a memory for storing the image, and a processor operatively associated with the display and the memory, And a first gain value and a second gain value are respectively set for the illumination component and the reflection component in a first region of the image having a first gradation value or less, and the second gradation value Wherein the first gain value and the second gain value are set to a third gain value and a fourth gain value, respectively, for the illumination component and the reflection component in a second region of the image having the first and second gain values, And may be set differently from the gain value and the fourth gain value.

According to an embodiment of the present invention, there is provided an image processing method including: acquiring an image; extracting an illumination component and a reflection component from the image; and extracting, from a first region of the image having a first tone value or less, And a third gain for the illumination component and the reflection component in a second region of the image having a second grayscale value or more, respectively, for the illumination component and the reflection component, respectively, And a fourth gain value, wherein the first gain value and the second gain value may be set differently from the third gain value and the fourth gain value, respectively.

An electronic device according to an embodiment disclosed herein includes a housing, a touch screen display exposed through one side of the housing, a display driver IC (DDI) contained in or electrically connected to the display, a DDI And a memory electrically coupled to the application processor, wherein the DDI, when executed, receives image data from the memory, the image data including a plurality of frames processed by the application processor, The method comprising: obtaining illumination components and reflection components of the plurality of frames, determining whether the acquired illumination components are above a first reference, and selecting, based on the determination whether the acquired illumination components are above a first reference, By using one gain value, And determining, based on the determination of whether or not the obtained reflection components are greater than or equal to the second reference, using the gain value of the selected one of the plurality of gain values, And display instructions to display on the display an image containing the processed illumination components and the reflected components.

According to the embodiments disclosed in this document, by adjusting at least one of the illumination component gain and the reflection component gain for each gradation of an image, the visibility of a dark part (e.g., a region having a low gradation value) of the image is increased to output an SDR image It is possible to provide an effect similar to that of outputting the HDR image.

In addition, various effects can be provided that are directly or indirectly understood through this document.

1A is a block diagram of an electronic device according to one embodiment.
1B is a block diagram of a device and a processor according to one embodiment.
2 is a diagram illustrating a method of operating an electronic device related to image processing according to an exemplary embodiment.
3 is a diagram for explaining an illumination component and a reflection component of an image according to an embodiment.
4 is a diagram for explaining an image processing method according to an embodiment.
FIG. 5 is a view for explaining a method of applying the reflection component gains according to an embodiment.
FIG. 6A is a diagram for explaining a method of applying an illumination component gain according to an exemplary embodiment.
FIG. 6B is a diagram for explaining another method of applying the illumination component gain for each gradation according to an exemplary embodiment.
7 is a view for explaining gradation of an image according to an embodiment.
8 is a diagram for explaining an effect of image processing according to an embodiment.
9 is a diagram illustrating an electronic device in a network environment in accordance with one embodiment.
10 is a block diagram of an electronic device according to one embodiment.
11 is a block diagram of a program module in accordance with one embodiment.

Various embodiments of the invention will now be described with reference to the accompanying drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes various modifications, equivalents, and / or alternatives of the embodiments of the invention. In connection with the description of the drawings, like reference numerals may be used for similar components.

In this document, the expressions "have," "may," "include," or "include" may be used to denote the presence of a feature (eg, a numerical value, a function, Quot ;, and does not exclude the presence of additional features.

In this document, the expressions "A or B," "at least one of A and / or B," or "one or more of A and / or B," etc. may include all possible combinations of the listed items . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) Or (3) at least one A and at least one B all together.

The expressions "first," " second, "" first, " or "second ", etc. used in this document may describe various components, It is used to distinguish the components and does not limit the components. For example, the first user equipment and the second user equipment may represent different user equipment, regardless of order or importance. For example, without departing from the scope of the rights described in this document, the first component can be named as the second component, and similarly the second component can also be named as the first component.

(Or functionally or communicatively) coupled with / to "another component (eg, a second component), or a component (eg, a second component) Quot; connected to ", it is to be understood that any such element may be directly connected to the other element or may be connected through another element (e.g., a third element). On the other hand, when it is mentioned that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component) It can be understood that there is no other component (e.g., a third component) between other components.

As used herein, the phrase " configured to " (or set) to be "adapted to, " To be designed to, "" adapted to, "" made to, "or" capable of ". The term " configured (or set) to "may not necessarily mean " specifically designed to" Instead, in some situations, the expression "configured to" may mean that the device can "do " with other devices or components. For example, a processor configured (or configured) to perform the phrases "A, B, and C" may be a processor dedicated to performing the operation (e.g., an embedded processor), or one or more software programs To a generic-purpose processor (e.g., a CPU or an application processor) that can perform the corresponding operations.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art. The general predefined terms used in this document may be interpreted in the same or similar sense as the contextual meanings of the related art and are intended to mean either ideally or in an excessively formal sense It is not interpreted. In some cases, even the terms defined in this document can not be construed as excluding the embodiments of this document.

An electronic device in accordance with various embodiments of the present document may be, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, Such as a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP) A camera, or a wearable device. According to various embodiments, the wearable device may be of the type of accessory (e.g., a watch, a ring, a bracelet, a bracelet, a necklace, a pair of glasses, a contact lens or a head-mounted-device (HMD) (E. G., Electronic apparel), a body attachment type (e. G., A skin pad or tattoo), or a bioimplantable type (e.g., implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances include, for example, televisions, DVD players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set- (Such as a home automation control panel, a security control panel, a TV box such as Samsung HomeSync ™, Apple TV ™ or Google TV ™), a game console (eg Xbox ™, PlayStation ™) A dictionary, an electronic key, a camcorder, or an electronic frame.

In an alternative embodiment, the electronic device may be any of a variety of medical devices (e.g., various portable medical measurement devices such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA) Navigation system, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), infotainment (infotainment) ) Automotive electronic equipment (eg marine navigation systems, gyro compass, etc.), avionics, security devices, head units for vehicles, industrial or home robots, automatic teller's machines (ATMs) Point of sale, or internet of things (eg, light bulbs, various sensors, electrical or gas meters, sprinkler devices, fire alarms, thermostats, street lights, A toaster, a fitness equipment, a hot water tank, a heater, a boiler, and the like).

According to some embodiments, the electronic device is a piece of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, Water, electricity, gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. Further, the electronic device according to the embodiment of the present document is not limited to the above-described devices, and may include a new electronic device according to technological advancement.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic apparatus according to various embodiments will now be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

1A is a block diagram of an electronic device according to one embodiment.

1A, an electronic device 100 may include a processor 110, an image processing module 130, a memory 150, and a display 170, according to various embodiments of the present invention. However, the configuration of the electronic device 100 is not limited thereto. At least one of the above-described components may be omitted, and at least one other component may be further included. As an example, the electronic device 100 may further include an input / output interface, a communication interface, or a camera.

According to various embodiments, the input / output interface may serve as an interface through which commands or data entered from a user or other external device may be communicated to other component (s) of the electronic device 100. The input / output interface may also output commands or data received from other component (s) of electronic device 100 to a user or other external device.

According to various embodiments, the communication interface may establish communication between the electronic device 100 and an external device. For example, the communication interface may be connected to the network via wireless communication or wired communication to communicate with the external device.

According to various embodiments, the camera may capture a still image and a moving image. The camera may include, for example, an imaging device. For example, the image pickup device may include a lens that receives image light of an object and images the image light into an image, a diaphragm that controls the amount of light passing through the lens, An image sensor that receives an image formed on the lens as an optical signal, and an internal memory. The internal memory may store photographed images. According to one embodiment, the internal memory may store an image captured through the image sensor before operating the shutter. In some embodiments, the image stored in the internal memory may be output to the display 170 as a preview image by the processor 110.

According to various embodiments, the processor 110 may perform operations and data processing related to control and / or communication of at least one other component of the electronic device 100. The processor 110 may, for example, operate an operating system or an application program to control a plurality of hardware or software components connected to the processor 110, and may perform various data processing and operations. Processor 110 may load or process instructions or data received from at least one of the other components (e.g., non-volatile memory) into volatile memory and store the various data in non-volatile memory have.

According to one embodiment, the processor 110 includes one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP) can do. The processor 110 may be implemented with, for example, a system on chip (SoC). According to one embodiment, the processor 100 may further include a graphics processing unit (GPU) and / or an image signal processor.

According to various embodiments, the image processing module 130 may perform an operation to overcome a difference between an actual background recognized by the user's eyes or a subject and a captured image thereof. For example, when outputting the SDR image, the image processing module 130 may perform image processing so that the SDR image can be recognized by the user like the HDR image.

According to one embodiment, the image processing module 130 extracts an illumination component and a reflectance component from an image and obtains a gain (hereinafter referred to as an illumination gain) And a gain for the reflection component (hereinafter referred to as a reflection component gain), respectively, to enhance the gradation of the image. Accordingly, the image can express the range of light in the real world as much as possible.

According to one embodiment, the image processing module 130 may extract an illumination component from an image using a low pass filter. Also, the image processing module 130 may extract the reflection component by removing the illumination component from the image.

According to one embodiment, in extracting the illumination component and the reflection component of a specific pixel included in an image, the image processing module 130 may extract an image from a plurality of (for example, 64x64 pixels, 128x128 pixels, or 256x256 pixels) (E.g., a block), calculates the average brightness of each region, and calculates the brightness of the pixel, the average brightness of the region adjacent to the region containing the pixel, and the distance information between the pixel and the adjacent region Or the like can be used to calculate the illumination component of the pixel. For example, the image processing module 130 may calculate an illumination component of each pixel included in the image using interpolation. Also, the image processing module 130 may extract the reflection component by removing the illumination component from the image. In this case, the image processing module 130 may use a specified mathematical algorithm to fine-tune the operation in the low-gradation portion in which human vision is sensitive. For example, the image processing module 130 subtracts a value obtained by converting the data of the illumination component into a logarithm, subtracts the value obtained by converting the data of the image into a logarithmic scale, And the reflection component can be obtained by converting to an exponential form.

According to one embodiment, the image processing module 130 may apply the illumination component gain and the reflection component gain to the illumination component and the reflection component of the image, respectively, and may combine the illumination component and the reflection component to which the gain is applied. Through this, the user can recognize an image having a gradation range lower than that of the HDR image as an HDR image. For example, the image processing module 130 may multiply the value obtained by multiplying the value obtained by converting the data of the illumination component into the log scale by the illumination component gain and the value obtained by converting the data of the reflection component into the log scale, And the output image can be obtained by summing the values and converting the summed value into the exponential form.

According to one embodiment, when the image processing module 130 sets at least one of the illumination component gain and the reflection component gain to be higher than or equal to a specified value in order to improve the gradation expressing power of a dark part (e.g., a low gradation area) , The gradation expressing ability can be improved in the low gradation region, but the phenomenon that the gradation value is saturated in the high gradation region (for example, the gradation value of the adjacent regions is close to the maximum gradation value, (Hereinafter referred to as " gradation clipping phenomenon ").

According to one embodiment, in order to solve the clipping phenomenon of the gradation, the image processing module 130 may apply at least one of the illumination component gain and the reflection component gain differently according to the gradation of the image. For example, the image processing module 130 may set the reflection component gain to be larger in the low gradation region than in the high gradation region. Thus, it is possible to improve the visibility of the image by increasing the gradation expressing power in the low gradation region while preventing the clipping phenomenon of the gradation in the high gradation region. As another example, the image processing module 130 may set the gain of the illumination component larger in the high gradation region than in the low gradation region. As a result, the effect of increasing the contrast of the entire image can be obtained. As another example, the image processing module 130 may set the gain of the illumination component larger in the low gradation region than in the high gradation region. Thus, the gradation expressing power in the low gradation region can be improved.

According to one embodiment, when applying an illumination component gain and a reflection component gain for each gradation of an image, the image processing module 130 may set the gradation for the setting to not only the first gradation, The illumination component gain and the reflection component gain can be set differently.

According to various embodiments, the image processing module 130 may set at least one of the illumination component gain and the reflection component gain to be smaller as the illuminance directed to the display 170 is lower, At least one of the illumination component gain and the reflection component gain can be set larger. The image processing module 130 may use a sensor (e.g., an illuminance sensor) disposed on the same side of the display 170 to measure the illuminance to the display 170. However, the present invention is not limited thereto. According to various embodiments, the image processing module 130 may use a camera included in the electronic device 100 or a sensor disposed on a different surface (e.g., the back surface) than the display 170. [ In some embodiments, the image processing module 130 may increase the brightness of the display 170 itself.

According to various embodiments, the image processing module 130 may remove the dark portion noise that may occur by setting at least one of the illumination component gain and the reflection component gain to a large value using a noise reduction filter or the like. As another example, the image processing module 130 may increase the saturation for at least some areas of the image to prevent saturation degradation that may occur by setting at least one of the illumination component gain and the reflection component gain large .

According to one embodiment, the image processing module 130 may change the color temperature while setting at least one of the illumination component gain and the reflection component gain to be large or small. For example, the image processing module 130 may reduce the color temperature and add a comfortable effect to the image, or increase the color temperature to add a cool effect to the image.

According to one embodiment, the image processing module 130 sets the sharpness of the image using a detail filter (or a sharpness filter) while setting at least one of the illumination component gain and the reflection component gain to be large or small. . The detail filter can detect, for example, an edge region of an image and process the detected edge region clearly.

According to one embodiment, the image processing module 130 may be included in the processor 110 or may be provided separately from the processor 110. [ When the image processing module 130 is provided independently of the processor 110, the image processing module 130 may communicate with the processor 110 to receive commands or data for image processing from the processor 110. [ In some embodiments, the image processing module 130 may be included in a display circuit 170, such as a display driver IC (DDI). The DDI may be included in the display 170 or may be electrically connected to the display 170.

According to various embodiments, the memory 150 may store instructions or data related to at least one other component of the electronic device 100. According to one embodiment, the memory 150 may store software and / or programs. In addition, the memory 150 may store images received from an external device or images photographed through a camera installed in the electronic device 100, and the like.

According to various embodiments, the memory 150 may include volatile and / or non-volatile memory. The memory 150 may include, for example, an internal memory or an external memory. Internal memory may include, for example, volatile memory (e.g., dynamic RAM, SRAM, or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., OTPROM programmable ROM, programmable ROM, erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash) Or NOR flash), a hard drive, or a solid state drive (SSD).

According to various embodiments, the display 170 may display various content (e.g., text, images, video, icons, or symbols, etc.) to the user. For example, the display 170 may output an image stored in the memory 150, for example, an image captured through a camera or an image received from an external device.

Display 170 may include, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light emitting diode (OLED) a microelectromechanical systems (MEMS) display, or an electronic paper display.

According to one embodiment, the display 170 may include a touch screen and may receive touch, gesture, proximity, or hovering input using, for example, an electronic pen or a portion of the user's body . In some embodiments, the display 170 may be embodied as being flexible, transparent, or wearable.

According to one embodiment, the electronic device 100 may include a housing forming the appearance of the electronic device 100. The housing may include, for example, a front surface, a rear surface, and a side surface that partially surrounds the space between the front surface and the rear surface. The housing may be provided such that at least some of the components of the electronic device 100 can be fixed and supported. For example, the processor 110, the image processing module 130, the memory 150, or the display 170 may be seated and fixed inside the housing. In addition, at least a part of the housing may be formed of a transparent material (for example, glass), and a screen output to the display 170 may be displayed outside through the transparent region of the housing. For example, at least a portion of the display 170 may be exposed through one side of the housing.

1B is a block diagram of a device and a processor according to one embodiment.

According to various embodiments, the image processing module 130 of FIG. 1A may be included in a display drive IC (DDI) 171 included in the display portion 170 (e.g., display 170). In this case, when the processor 110 transmits the image information to the display driving IC 171, the image processing module 130 in the display driving IC 171 processes the image information and outputs the image through the panel 173 .

According to various embodiments, the image processing module 130 may be included in the processor 110, rather than the display driver IC 171. In this case, the image processed in real time by the image processing module 110 may be transmitted to the display driving IC 171. [

As described above, according to various embodiments, an electronic device (e.g., electronic device 100) may include a display (e.g., display 170) for outputting an image, a memory 150), and a processor (e.g., processor (110)) operatively associated with the display and the memory, the processor extracting illumination and reflection components from the image, The first gain value and the second gain value are respectively set for the illumination component and the reflection component in the first region of the image, and the first gain value and the second gain value are set for the illumination component and the reflection component in the second region of the image, Component and a fourth gain value, respectively, and the first gain value and the second gain value may be set differently from the third gain value and the fourth gain value, respectively.

According to various embodiments, the processor may set the first gain value to be greater than the third gain value.

According to various embodiments, the processor may set the first gain value to be less than the third gain value.

According to various embodiments, the processor may set the second gain value to be larger than the fourth gain value.

According to various embodiments, the processor sets at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value smaller as the illuminance to the display is lower, At least one of the first gain value, the second gain value, the third gain value, and the fourth gain value may be set to be larger as the illuminance reflected by the display is higher.

According to various embodiments, the processor may increase the brightness of the panel of the display.

According to various embodiments, the processor is configured to perform a noise reduction on the image if at least one of the first gain value, the second gain value, the third gain value, A filter can be applied.

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or more, .

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size, You can change the color temperature.

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size, A sharpness filter can be applied.

According to various embodiments, an electronic device (e.g., electronic device 100) may include a housing, a touch screen display (e.g., display 170) exposed through one side of the housing, (E.g., memory 150) electrically coupled to the application processor, such as a display driver IC (DDI) (e.g., DDI 171) coupled to the DDI, Wherein the DDI is configured to receive, at run time, image data, including a plurality of frames, processed by the application processor from the memory and to provide illumination components and reflections of the plurality of frames Acquiring reflectance components, determining whether the gradation of the obtained illumination component is greater than or equal to a first reference, Processing the illumination components using a gain value of a selected one of the plurality of gain values based on a determination as to whether or not the gradation of the obtained reflection component is equal to or more than one reference, Processing the reflection components using a gain value of a selected one of a plurality of gain values based on the determination of whether or not the second reference value is greater than or equal to a second reference value and displaying an image including the processed illumination components and reflection components on the display Quot; < / RTI >

According to various embodiments, the instructions are for the DDI to process the obtained illumination component using the first gain value if the acquired illumination components are greater than or equal to the first reference, And to process the obtained illumination component using a second gain value larger than the first gain value when the first reference value is less than the first reference value.

2 is a diagram illustrating a method of operating an electronic device related to image processing according to an exemplary embodiment.

2, in accordance with various embodiments of the present invention, at operation 210, an electronic device (e.g., electronic device 100) may acquire an image. According to one embodiment, the electronic device can acquire an image photographed through a camera included in the electronic device. As another example, an electronic device may acquire an image from an external device connected to the electronic device through a communication interface. In some embodiments, the electronic device may acquire images stored in memory.

According to various embodiments, at operation 230, the electronic device may extract the illumination component and the reflection component from the image. According to one embodiment, the electronic device may extract the illumination component from the image using a low pass filter. Further, the electronic device can extract the reflection component by removing the illumination component from the image.

According to various embodiments, at operation 250, the electronic device may set a gain value (e.g., illumination gain) for the illumination component and a gain value (e.g., a reflection component gain) for the reflection component. According to one embodiment, the electronic device may set at least one of the illumination component gain and the reflection component gain differently for each gradation of an image. For example, the electronic device can set the reflection component gain larger in the low gradation region than in the high gradation region of the image. As another example, the electronic device may set the illumination component gain to be larger in the high grayscale region than in the low grayscale region of the image. As another example, the electronic device may set the illumination component gain larger in the low gradation region than in the high gradation region of the image. In some embodiments, the electronic device divides the image into a plurality of blocks of a predetermined size (e.g., 64x64 pixels, 128x128 pixels, or 256x256 pixels) and sets at least one of the illumination component gain and the reflection component gain different for each block It is possible.

According to various embodiments, the electronic device is configured to set at least one of the illumination component gain and the reflection component gain to be smaller as the illuminance directed to the display (e.g., display 170) is lower, and the higher the illuminance At least one of the illumination component gain and the reflection component gain can be set larger. As another example, the electronic device may increase the brightness of the display panel itself.

According to various embodiments, the electronic device can remove the dark portion noise that may occur by setting at least one of the illumination component gain and the reflection component gain large using a noise reduction filter or the like. As another example, the electronic device may improve the saturation for at least some areas of the image to prevent saturation degradation that may occur by setting at least one of the illumination component gain and the reflection component gain high.

According to various embodiments, the electronic device may change the color temperature while setting at least one of the illumination component gain and the reflection component gain large or small. In some embodiments, the electronic device can improve the image quality of the image through the image filter processing while setting at least one of the illumination component gain and the reflection component gain large or small. For example, the sharpness of an image may be increased by using a detail filter, or a noise reduction effect due to an increase in gain (for example, an illumination component gain or a reflection component gain) may be reduced through a noise reduction filter or the like.

According to various embodiments, at operation 270, the electronic device may output an image. For example, the electronic device can output the output image to the display, to which the illumination component gain is applied to the illumination component of the image and the reflection component gain is applied to the reflection component of the image.

As described above, according to various embodiments, an image processing method of an electronic device including a display includes an operation of acquiring an image, an operation of extracting an illumination component and a reflection component from the image, The first gain value and the second gain value are respectively set for the illumination component and the reflection component in the first region of the image, and the first gain value and the second gain value are set for the illumination component and the reflection component in the second region of the image, Wherein the first gain value and the second gain value may be set differently from the third gain value and the fourth gain value, respectively, wherein the first gain value and the second gain value are set to a third gain value and a fourth gain value, have.

According to various embodiments, the setting operation may include setting the first gain value to be greater than the third gain value.

According to various embodiments, the setting operation may include setting the first gain value to be less than the third gain value.

According to various embodiments, the setting operation may comprise setting the second gain value to be greater than the fourth gain value.

According to various embodiments, the setting operation sets at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to be smaller as the illuminance to the display is lower And setting at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to be larger as the illuminance toward the display is higher.

According to various embodiments, the image processing method may further include increasing the brightness of the panel of the display.

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or larger, And applying a noise reduction filter.

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or larger, And may further include an operation of increasing saturation.

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size, Lt; RTI ID = 0.0 > color temperature < / RTI >

According to various embodiments, when at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size, Lt; RTI ID = 0.0 > a < / RTI > sharpness filter.

3 is a diagram for explaining an illumination component and a reflection component of an image according to an embodiment.

Referring to FIG. 3, in accordance with various embodiments of the present invention, an electronic device (e. G., Electronic device 100) may extract an illumination component and a reflection component from image 310. For example, the electronic device may extract the illumination component from an image using a low-pass filter, and extract the reflection component by removing the illumination component from the image. The drawing shows an image 330 in which an illumination component is extracted from an input image 310 and an image 350 in which a reflection component is extracted. The figure shows an example of the result of extracting the illumination component and the reflection component from the input image 310. The image 330 of the illumination component and the image 350 of the reflection component extracted as a result according to the input image 310, It will be readily appreciated by those skilled in the art that the invention may be different.

4 is a diagram for explaining an image processing method according to an embodiment.

4, an electronic device (e.g., electronic device 100) may extract an illumination component 411 and a reflection component 413 from an input image 410, according to various embodiments of the present invention. According to one embodiment, in extracting the illumination component 411 and the reflection component 413 of a specific pixel included in the input image 410, the electronic device divides the input image 410 into a plurality of areas, And calculates an illumination component 411 of the pixel using the brightness of the pixel, the average brightness of the area adjacent to the area including the pixel, and the distance information between the pixel and the adjacent area, can do. The electronic device subtracts the value obtained by converting the data of the illumination component 411 to the log scale from the value obtained by converting the data of the input image 410 to the log scale, and converts the subtracted result value back to the exponential form, It is possible to obtain the reflection component 413 of the pixel. The electronic device designates the value obtained by converting the data of the illumination component 411 to the log scale as another illumination component 411 and converts the value of the input image 410 into the log scale to convert it into the log scale A value obtained by subtracting the value of the illumination component 411 may be designated as another reflection component 413 of the pixel.

According to one embodiment, the electronic device includes a first gain value (e.g., illumination component gain) 431 and a second gain value (e.g., a reflective component gain) 431 for the extracted illumination component 411 and the reflected component 413, respectively. (433) can be applied. For example, the electronic device may multiply the illumination component 411 by the first gain 431 and the reflected component 413 by the second gain 433. [ The electronic device adds the value obtained by multiplying the illumination component 411 by the first gain value 431 and the value obtained by multiplying the reflection component 413 by the second gain value 433 and by converting the summed value into the exponential form, The image 450 can be acquired.

FIG. 5 is a view for explaining a method of applying the reflection component gains according to an embodiment.

Referring to FIG. 5, in accordance with various embodiments of the present invention, an electronic device (e.g., electronic device 100) may apply a reflection component gain differently for each gray level of an image. As in the graph 500 shown, the electronic device can set the reflection component gain in the low grayscale region to be larger than the high grayscale region of the image. The first reflective component gain 510 in the graph 500 is a value applied in a prior art electronic device and the second reflective component gain 530 is a value applied in an electronic device according to the present invention. However, the first reflection component gain 510 and the second reflection component gain 530 included in the graph 500 should be understood as an example showing that the reflection component gain can be set differently for each gradation. Those skilled in the art will readily understand that the first reflection component gain 510 included in the graph 500 has only a constant value regardless of the gradation.

As shown in the graph 500, the electronic device amplifies the contrast ratio of the minute brightness information with low visibility in the low gradation region of the image to a larger extent as compared with the high gradation region, so that the brightness and gradation expression power in the low gradation region becomes high gradation Can be improved more than in the region.

FIG. 6A is a view for explaining a method of applying an illumination component gain according to an embodiment of the present invention, and FIG. 6B is a diagram for explaining another method of applying an illumination component gain according to an embodiment.

6A and 6B, according to various embodiments of the present invention, an electronic device (e.g., electronic device 100) may apply an illumination component gain differently for each gray level of an image. The electronic device may set the gain of the illumination component in the low gradation region to be larger than that in the high gradation region of the image as in the one graph 610. [ The electronic device may set the gain of the illumination component higher in the high gradation area than in the low gradation area of the image as in the second graph 630. [ In the first graph 610, the first illumination gain 611 is a value applied in a prior art electronic device, and the second illumination gain 613 is a value applied in an electronic device according to the present invention. In the second graph 630, the third illumination gain 631 is a value applied in the electronic device according to the prior art, and the fourth illumination gain 633 is a value applied in the electronic device according to the present invention. However, the first illumination component gain 611 and the second illumination component gain 613 included in the first graph 610 and the third illumination component gain 631 included in the second graph 630, The illumination component gain 633 should be understood as an example showing that the illumination component gain can be set differently for each gradation. It is to be noted that the first illumination component gain 611 included in the first graph 610 and the second illumination component gain 631 included in the second graph 630 have constant values regardless of the gradation level Those skilled in the art will readily understand.

According to various embodiments, the electronic device may include an illumination component gain in the low grayscale region (e.g., a second illumination component gain 613 ) Can be set larger in comparison with the high gradation region. Alternatively, the electronic device may be configured such that the reflection component gain (e.g., the second reflection component gain 530) is applied as in the graph 500 of FIG. 5 so that the brightness and gradation expression in the low gradation region of the image The luminance component gain (for example, the fourth illumination component gain 633) in the low gradation region is increased in comparison with the high gradation region in order to increase the overall contrast ratio of the entire image as in the second graph 630 It can be set small.

7 is a view for explaining gradation of an image according to an embodiment.

Referring to FIG. 7, in accordance with various embodiments of the present invention, an electronic device (e.g., electronic device 100) may be used to prevent an image from being cluttered due to grayscale clipping in the high grayscale region of image 700 At least one of the illumination component gain and the reflection component gain can be adjusted. For example, the electronic device may be configured such that the rate of change of the illumination component and the reflection component is set small such that the gradation is not clipped in the high gradation area such as the sun (sun) 710, the cloud 730, Can be set close to 1). In order to utilize local gradation expressiveness between halftones in an intermediate gradation region such as a mountain 750, an electronic device is required to have at least a luminance component gain and a reflection component gain of less than a specified gradation value (for example, 96 gradations) (For example, the gain value is set to be larger than 1 or smaller than 1), and the gain value can be set to be closer to 1 than the specified tone value. The electronic device may set at least one of the illumination component gain and the reflection component gain larger than the high gradation area in order to improve the expression power of the gradation having the minute brightness information in the low gradation area such as the shadow 770 .

8 is a diagram for explaining an effect of image processing according to an embodiment.

8, according to various embodiments of the present invention, the second image 830 after the image processing, compared with the first image 810 before the image processing, is improved in gradation expressing power in a dark area (e.g., a low gradation area) It can be confirmed that the visibility is increased. For example, it can be seen that trees and flowers that are not well visible in the dark areas existing in the left and right areas of the first image 810 are well visible in the second image 830.

9 is a diagram illustrating an electronic device in a network environment in accordance with one embodiment.

9, an electronic device 901 in various embodiments may communicate with an external device (e.g., a first external electronic device 902, a second external electronic device 904, or a server 906) ) Or a local area communication 964. [ The electronic device 901 may include a bus 910, a processor 920, a memory 930, an input / output interface 950, a display 960, and a communication interface 970. In some embodiments, the electronic device 901 may omit at least one of the components or additionally include other components.

The bus 910 may include circuitry, for example, for connecting the components 910-970 to each other and for communicating (e.g., control messages and / or data) between the components.

Processor 920 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 920 may perform operations or data processing relating to, for example, control and / or communication of at least one other component of the electronic device 901. [

Memory 930 may include volatile and / or non-volatile memory. The memory 930 may store instructions or data related to at least one other component of the electronic device 901, for example. According to one embodiment, memory 930 may store software and / or programs 940. [ The program 940 may include, for example, a kernel 941, a middleware 943, an application programming interface (API) 945, and / or an application program . ≪ / RTI > At least a portion of the kernel 941, middleware 943, or API 945 may be referred to as an operating system (OS).

The kernel 941 may include system resources (e. G., ≪ / RTI > e. G., Used to execute operations or functions implemented in other programs (e.g., middleware 943, API 945, or application program 947) : Bus 910, processor 920, or memory 930). The kernel 941 also provides an interface for controlling or managing system resources by accessing individual components of the electronic device 901 in the middleware 943, API 945, or application program 947 .

The middleware 943 can perform an intermediary role such that the API 945 or the application program 947 communicates with the kernel 941 to exchange data. Further, the middleware 943 can process one or more task requests received from the application program 947 according to the priority order. For example, middleware 943 may use system resources (e.g., bus 910, processor 920, or memory 930) of electronic device 901 in at least one of application programs 947 Prioritize, and process the one or more task requests.

The API 945 is an interface for the application 947 to control the functions provided by the kernel 941 or the middleware 943. The API 945 is used to control the functions of the application 947 such as file control, Control or the like, for example, instructions.

The input / output interface 950 may serve as an interface through which commands or data entered from, for example, a user or other external device can be communicated to another component (s) of the electronic device 901. Input / output interface 950 may also output commands or data received from other component (s) of electronic device 901 to a user or other external device.

The display 960 can be, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic LED (OLED) System, a microelectromechanical systems (MEMS) display, or an electronic paper display. Display 960 may display various content (e.g., text, image, video, icon, or symbol, etc.) to a user, for example. Display 960 may include a touch screen and may receive touch, gesture, proximity, or hovering input, for example, using an electronic pen or a portion of the user's body.

The communication interface 970 is used to establish communication between the electronic device 901 and an external device such as the first external electronic device 902, the second external electronic device 904, or the server 906 . For example, the communication interface 970 may be connected to the network 962 via wireless or wired communication to communicate with the external device (e.g., the second external electronic device 904 or the server 906).

The wireless communication may include, for example, LTE, LTE-A (LTE Advance), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro) System for Mobile Communications), and the like. According to one embodiment, the wireless communication may be wireless communication, such as wireless fidelity (WiFi), Bluetooth, Bluetooth low power (BLE), Zigbee, NFC, Magnetic Secure Transmission, Frequency (RF), or body area network (BAN). According to one embodiment, the wireless communication may comprise a GNSS. GNSS may be, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System (Beidou) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" can be used interchangeably with "GNSS ". The wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232), a power line communication or a plain old telephone service have. Network 162 may include at least one of a telecommunications network, e.g., a computer network (e.g., LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 902 and 904 may be the same or a different kind of device as the electronic device 901. According to one embodiment, the server 906 may include one or more groups of servers. According to various embodiments, all or a portion of the operations performed in the electronic device 901 may be performed in another electronic device or multiple electronic devices (e.g., electronic device 902, 904, or server 906). According to one embodiment, in the event that the electronic device 901 has to perform certain functions or services automatically or on demand, the electronic device 901 may, instead of or in addition to executing the function or service itself, (E.g., electronic device 902, 904, or server 906) at least some of the associated functionality. Other electronic devices (e. G., Electronic device 902,904, or server 906) may execute the requested function or additional function and deliver the result to electronic device 901. [ The electronic device 901 may process the received result as is or additionally to provide the requested function or service. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

10 is a block diagram of an electronic device according to one embodiment.

Referring to Fig. 10, the electronic device 1001 may include all or part of the electronic device 901 shown in Fig. 9, for example. Electronic device 1001 includes one or more processors (e.g., AP) 1010, a communication module 1020, a subscriber identification module 1024, a memory 1030, a sensor module 1040, an input device 1050, a display 1060, an interface 1070, an audio module 1080, a camera module 1091, a power management module 1095, a battery 1096, an indicator 1097, and a motor 1098.

The processor 1010 can control a plurality of hardware or software components connected to the processor 1010, for example, by driving an operating system or an application program, and can perform various data processing and operations. The processor 1010 may be implemented with, for example, a system on chip (SoC). According to one embodiment, the processor 1010 may further include a graphics processing unit (GPU) and / or an image signal processor. Processor 1010 may include at least a portion (e.g., cellular module 1021) of the components shown in FIG. Processor 1010 may load or process instructions or data received from at least one of the other components (e.g., non-volatile memory) into volatile memory and store the various data in non-volatile memory have.

The communication module 1020 may have the same or similar configuration as the communication interface 970 of Fig. The communication module 1020 may include a cellular module 1021, a Wi-Fi module 1023, a Bluetooth module 1025, a GNSS module 1027 (e.g., a GPS module, a Glonass module, a Beidou module , Or a Galileo module), an NFC module 1028, and a radio frequency (RF) module 1029.

The cellular module 1021 may provide voice calls, video calls, text services, or Internet services, for example, over a communication network. According to one embodiment, cellular module 1021 may utilize a subscriber identity module (e.g., a SIM card) 1024 to perform the identification and authentication of electronic device 1001 within the communication network. According to one embodiment, the cellular module 1021 may perform at least some of the functions that the processor 1010 may provide. According to one embodiment, the cellular module 1021 may include a communications processor (CP). At least some (e.g., two or more) of the cellular module 1021, the Wi-Fi module 1023, the Bluetooth module 1025, the GNSS module 1027, or the NFC module 1028, according to some embodiments, 0.0 > IC < / RTI >

The RF module 1029 can, for example, send and receive communication signals (e.g., RF signals). The RF module 1029 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 1021, the Wi-Fi module 1023, the Bluetooth module 1025, the GNSS module 1027, or the NFC module 1028, Lt; / RTI >

The subscriber identity module 1024 may include, for example, a card containing a subscriber identity module and / or an embedded SIM and may include unique identification information (e.g., an integrated circuit card identifier (ICCID) Subscriber information (e.g., international mobile subscriber identity (IMSI)).

Memory 1030 (e.g., memory 930) may include, for example, internal memory 1032 or external memory 1034. The built-in memory 1032 may be a non-volatile memory (e.g., an OTPROM, a PROM, an EPROM, an EEPROM, a mask ROM, a flash ROM , A flash memory, a hard drive, or a solid state drive (SSD).

The external memory 1034 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro-SD, a mini-SD, an extreme digital (xD) , A memory stick, or the like. The external memory 1034 may be functionally and / or physically connected to the electronic device 1001 via various interfaces.

The sensor module 1040 may, for example, measure a physical quantity or sense an operating state of the electronic device 1001 and convert the measured or sensed information into an electrical signal. The sensor module 1040 includes a gesture sensor 1040A, a gyro sensor 1040B, an air pressure sensor 1040C, a magnetic sensor 1040D, an acceleration sensor 1040E, a grip sensor 1040F, 1040G), a color sensor 1040H (e.g., an RGB (red, green, blue) sensor), a living body sensor 1040I, a temperature / humidity sensor 1040J, a luminance sensor 1040K, ) Sensor 1040M. ≪ / RTI > Additionally or alternatively, the sensor module 1040 may include, for example, an e-nose sensor, an electromyograph (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram An infrared (IR) sensor, an iris sensor, and / or a fingerprint sensor. The sensor module 1040 may further include a control circuit for controlling at least one sensor included therein. In some embodiments, the electronic device 1001 further includes a processor configured to control the sensor module 1040, either as part of the processor 1010 or separately, so that while the processor 1010 is in a sleep state, The sensor module 1040 can be controlled.

The input device 1050 may include, for example, a touch panel 1052, a (digital) pen sensor 1054, a key 1056, or an ultrasonic input device 1058. As the touch panel 1052, for example, at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type can be used. Further, the touch panel 1052 may further include a control circuit. The touch panel 1052 may further include a tactile layer to provide a tactile response to the user.

 (Digital) pen sensor 1054 may be part of, for example, a touch panel or may include a separate sheet of identification. Key 1056 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 1058 can sense the ultrasonic wave generated from the input tool through the microphone (e.g., the microphone 1088) and check the data corresponding to the ultrasonic wave detected.

Display 1060 (e.g., display 960) may include panel 1062, hologram device 1064, projector 1066, and / or control circuitry for controlling them. The panel 1062 can be implemented, for example, flexibly, transparently, or wearably. The panel 1062 may be composed of a touch panel 1052 and one or more modules. According to one embodiment, the panel 1062 may include a pressure sensor (or force sensor) capable of measuring the intensity of the pressure on the user's touch. The pressure sensor may be integrated with the touch panel 1052 or may be implemented by one or more sensors separate from the touch panel 1052. The hologram apparatus 1064 can display stereoscopic images in the air using the interference of light. The projector 1066 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 1001.

The interface 1070 may include, for example, an HDMI 1072, a USB 1074, an optical interface 1076, or a D-sub (D-subminiature) 1078. The interface 1070 may be included in the communication interface 970 shown in Fig. 9, for example. Additionally or alternatively, the interface 1070 may include, for example, a mobile high-definition link (MHL) interface, an SD card / MMC (multi-media card) interface, or an IrDA have.

The audio module 1080 can, for example, bidirectionally convert sound and electrical signals. At least some of the components of the audio module 1080 may be included, for example, in the input / output interface 950 shown in FIG. The audio module 1080 can process sound information input or output through, for example, a speaker 1082, a receiver 1084, an earphone 1086, a microphone 1088, or the like.

The camera module 1091 is, for example, a device capable of capturing still images and moving images, and according to an embodiment, one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP) , Or flash (e.g., an LED or xenon lamp, etc.).

The power management module 1095 can manage the power of the electronic device 1001, for example. According to one embodiment, the power management module 1095 may include a power management integrated circuit (PMIC), a charging IC, or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging scheme may include, for example, a magnetic resonance scheme, a magnetic induction scheme, or an electromagnetic wave scheme, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonant circuit, have. The battery gauge can measure, for example, the remaining amount of the battery 1096, the voltage during charging, the current, or the temperature. The battery 1096 may include, for example, a rechargeable battery and / or a solar cell.

The indicator 1097 may indicate a particular state of the electronic device 1001 or a portion thereof (e.g., processor 1010), e.g., a boot state, a message state, or a state of charge. The motor 1098 can convert an electrical signal to mechanical vibration, and can cause vibration, haptic effect, or the like. Electronic device 1001 is, for example, DMB Mobile TV-enabled devices capable of handling media data in accordance with standards such as (digital multimedia broadcasting), DVB (digital video broadcasting), or MediaFLO (mediaFlo ^TM) (for example, : GPU).

Each of the components described in this document may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. In various embodiments, an electronic device (e. G., Electronic device 1001) may have some components omitted, or may further include additional components, or some of the components may be combined into one entity, The functions of the preceding components can be performed in the same manner.

11 is a block diagram of a program module in accordance with one embodiment.

According to one embodiment, program module 1110 (e.g., program 940) may be an operating system (OS) that controls resources associated with an electronic device (e.g., electronic device 901) And may include various applications (e.g., application programs 947). The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM .

11, the program module 1110 includes a kernel 1120 (e.g., a kernel 941), a middleware 1130 (e.g., middleware 943), an API 1160 (e.g., API 945) , And / or an application 1170 (e.g., an application program 947). At least a portion of the program module 1110 may be preloaded on the electronic device or downloaded from an external electronic device (e.g., electronic device 902, 904, server 906, etc.).

The kernel 1120 may include, for example, a system resource manager 1121 and / or a device driver 1123. The system resource manager 1121 can perform control, assignment, or recovery of system resources. According to one embodiment, the system resource manager 1121 may include a process management unit, a memory management unit, or a file system management unit. The device driver 1123 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an inter- .

The middleware 1130 may provide various functions commonly required by the application 1170 or may be provided through the API 1160 in various ways to enable the application 1170 to efficiently use limited system resources within the electronic device. Functions may be provided to the application (1170). According to one embodiment, the middleware 1130 includes a runtime library 1135, an application manager 1141, a window manager 1142, a multimedia manager 1143, a resource manager 1144, a power manager 1145, a database manager 1146, a package manager 1147, a connectivity manager 1148, a notification manager 1149, a location manager 1150, a graphic manager 1151, a security manager 1152, 1153, < / RTI >

The runtime library 1135 may include, for example, a library module used by the compiler to add new functionality via a programming language while the application 1170 is running. The runtime library 1135 may perform input / output management, memory management, or arithmetic function processing.

The application manager 1141 can manage the life cycle of the application 1170, for example. The window manager 1142 can manage GUI resources used in the screen. The multimedia manager 1143 can recognize the format required for playing the media files and can perform encoding or decoding of the media file using a codec according to the format. The resource manager 1144 can manage the source code of the application 1170 or the space of the memory. The power manager 1145 can manage the capacity or power of the battery, for example, and can provide the power information necessary for the operation of the electronic device. According to one embodiment, the power manager 1145 may interoperate with a basic input / output system (BIOS). The database manager 1146 may create, retrieve, or modify, for example, a database to be used in the application 1170. The package manager 1147 can manage installation or update of an application distributed in the form of a package file.

The connectivity manager 1148 may, for example, manage the wireless connection. The notification manager 1149 may provide an event to the user, for example, an arrival message, an appointment, a proximity notification, and the like. The location manager 1150 can manage the location information of the electronic device, for example. The graphic manager 1151 may, for example, manage graphical effects to be presented to the user or a user interface associated therewith. Security manager 1152 may provide, for example, system security or user authentication. The extended screen manager 1153 may, for example, determine the area of the display on which the graphic is to be displayed. According to one embodiment, the extended screen manager 1153 may manage information, graphical effects, or a user interface associated therewith that is to be provided over an area of the display determined to be graphical.

According to one embodiment, the middleware 1130 may include a telephony manager for managing the voice or video call functionality of the electronic device, or a middleware module capable of forming a combination of the functions of the above-described components . According to one embodiment, the middleware 1130 can provide a module specialized for each type of operating system. The middleware 1130 may dynamically delete some existing components or add new ones.

The API 1160 can be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide a single API set for each platform, and for Tizen, you can provide two or more API sets for each platform.

The application 1170 may include a home 1171, a dialer 1172, an SMS / MMS 1173, an instant message 1174, a browser 1175, a camera 1176, an alarm 1177, Contact 1178, voice dial 1179, email 1180, calendar 1181, media player 1182, album 1183, watch 1184, healthcare (e.g., measuring exercise or blood glucose) , Or environmental information (e.g., air pressure, humidity, or temperature information) application.

According to one embodiment, the application 1170 may include an information exchange application capable of supporting information exchange between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for communicating specific information to an external electronic device, or a device management application for managing an external electronic device. For example, the notification relay application may transmit notification information generated in another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide the notification information to the user. The device management application may, for example, control the turn-on / turn-off or brightness (or resolution) of an external electronic device in communication with the electronic device (e.g., the external electronic device itself Control), or install, delete, or update an application running on an external electronic device.

According to one embodiment, the application 1170 may include an application (e.g., a healthcare application of a mobile medical device) designated according to the attributes of the external electronic device. According to one embodiment, the application 1170 may include an application received from an external electronic device.

At least some of the program modules 1110 may be implemented (e.g., executed) in software, firmware, hardware (e.g., processor 1010), or a combination of at least two of the foregoing, Program, routine, instruction set or process.

As used herein, the term "module " includes units comprised of hardware, software, or firmware and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. A "module" may be an integrally constructed component or a minimum unit or part thereof that performs one or more functions. "Module" may be implemented either mechanically or electronically, for example, by application-specific integrated circuit (ASIC) chips, field-programmable gate arrays (FPGAs) And may include programmable logic devices.

At least some of the devices (e.g., modules or functions thereof) or methods (e.g., operations) according to various embodiments may include instructions stored in a computer readable storage medium (e.g., memory 930) . ≪ / RTI > When the instruction is executed by a processor (e.g., processor 920), the processor may perform a function corresponding to the instruction.

The computer-readable recording medium may be a hard disk, a floppy disk, a magnetic medium such as a magnetic tape, an optical recording medium such as a CD-ROM, a DVD, a magnetic-optical medium such as a floppy disk, The instructions may include code generated by the compiler or code that may be executed by the interpreter.

Modules or program modules according to various embodiments may include at least one or more of the elements described above, some of which may be omitted, or other elements. Operations performed by modules, program modules, or other components, in accordance with various embodiments, may be performed sequentially, in parallel, repetitively, or heuristically, or at least some operations may be performed in a different order, .

And the embodiments disclosed in this document are provided for the explanation and understanding of the disclosed technical contents, and do not limit the scope of the present invention. Accordingly, the scope of this document should be interpreted to include all modifications based on the technical idea of the present invention or various other embodiments.

Claims (22)

In an electronic device,
A display for outputting an image;
A memory for storing the image; And
A processor operably coupled to the display and the memory,
The processor comprising:
Extracting an illumination component and a reflection component from the image,
The first gain value and the second gain value are set for the illumination component and the reflection component in the first region of the image having the first tone value or less,
A third gain value and a fourth gain value are respectively set for the illumination component and the reflection component in the second region of the image having the second tone value or more,
Wherein the first gain value and the second gain value are set differently from the third gain value and the fourth gain value, respectively. The method according to claim 1,
The processor comprising:
And sets the first gain value to be larger than the third gain value. The method according to claim 1,
The processor comprising:
And sets the first gain value to be smaller than the third gain value. The method according to claim 1,
The processor comprising:
And sets the second gain value to be larger than the fourth gain value. The method according to claim 1,
The processor comprising:
Wherein at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be smaller as the illuminance to the display is lower,
Wherein at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be larger as the illuminance displayed on the display is higher. The method according to claim 1,
The processor comprising:
Thereby increasing the brightness of the panel of the display. The method according to claim 1,
The processor comprising:
And applying a noise reduction filter to the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or more. Device. The method according to claim 1,
The processor comprising:
And increases the saturation for the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or more. The method according to claim 1,
The processor comprising:
And changes the color temperature for the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size. Device. The method according to claim 1,
The processor comprising:
Wherein if the at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size, a sharpness filter is applied to the image Electronic device. 1. An image processing method of an electronic device including a display,
Obtaining an image;
Extracting an illumination component and a reflection component from the image; And
A first gain value and a second gain value are respectively set for the illumination component and the reflection component in a first region of the image having a first tone value or less and a second gain value is set for a second region of the image having a second tone value or more, To a third gain value and a fourth gain value, respectively, for the illumination component and the reflection component in the second image,
Wherein the first gain value and the second gain value are set differently from the third gain value and the fourth gain value, respectively. The method of claim 11,
In the setting operation,
And setting the first gain value to be larger than the third gain value. The method of claim 11,
In the setting operation,
And setting the first gain value to be smaller than the third gain value. The method of claim 11,
In the setting operation,
And setting the second gain value to be larger than the fourth gain value. The method of claim 11,
In the setting operation,
Wherein at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to be smaller as the illuminance displayed on the display is lower, and as the illuminance reflected on the display is higher, And setting at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value to be larger. The method of claim 11,
Further comprising increasing the brightness of the panel of the display. The method of claim 11,
Further comprising applying a noise reduction filter to the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or greater And the image processing method. The method of claim 11,
And increasing saturation of the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a predetermined size or more . The method of claim 11,
Further comprising changing the color temperature for the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a designated size And the image processing method. The method of claim 11,
Further comprising applying a sharpness filter to the image if at least one of the first gain value, the second gain value, the third gain value, and the fourth gain value is set to a value greater than or equal to a specified size The image processing method comprising: In an electronic device,
housing;
A touch screen display exposed through one side of the housing;
A display driver IC (DDI) included in the display or electrically connected to the display;
An application processor electrically coupled to the DDI; And
And a memory electrically coupled to the application processor,
The DDI, when executed,
Receiving image data from the memory, the image data including a plurality of frames processed by the application processor,
Acquiring illumination components and reflectance components of the plurality of frames,
Determining whether the gradation of the obtained illumination component is greater than or equal to a first reference,
Processing the illumination components using a gain value of a selected one of a plurality of gain values based on a determination as to whether or not the reference value is greater than or equal to the first reference value,
Determining whether the gradation of the obtained reflection component is equal to or higher than a second reference,
Processing the reflection components using a gain value of a selected one of the plurality of gain values based on the determination as to whether or not the second reference value is greater than or equal to the second reference value,
And stores instructions to cause the display to display an image containing the processed illumination components and reflection components. 23. The method of claim 21,
The instructions cause the DDI to,
Processing the acquired illumination component using the first gain value if the acquired illumination components are greater than or equal to the first reference value,
And to process the obtained illumination component by using a second gain value larger than the first gain value when the obtained illumination components are less than the first reference value.

Images