KR20190084652A - Electronic device and control method thereof - Google Patents

Abstract

An electronic device is disclosed. According to an embodiment of the present invention, the electronic device comprises: an input unit; and a processor configured to obtain ratio information of a first pixel area including a skin color from a received content when the content is received through the input unit, obtain object information included in a second pixel area including a first color, which is preset through frequency analysis of the content, identify a context of the content based on the ratio information of the first pixel area and the object information included in the second pixel area, and process the content based on content processing information corresponding to the identified context.

Description

[0001] DESCRIPTION [0002] ELECTRONIC DEVICE AND CONTROL METHOD [0003]

The present invention relates to an electronic device for processing contents and a control method thereof.

As the information age progresses, users who use contents are increasing. Accordingly, various kinds of contents are being provided on-line or off-line.

However, while various kinds of contents are provided, a method of processing contents of electronic devices capable of having a display has a limited problem. In other words, there is a problem that a relation between a reproduced image and a color output from an electronic device is poor and a user's viewing immersion degree is lowered because the image is expressed in some colors set by the manufacturer irrespective of an input image.

Accordingly, there has been a demand for a method for processing contents more realistically based on images output from an electronic device in accordance with the intention of a video producer.

An object of the present invention is to provide an electronic device for identifying the context of content and processing content based on context-based content processing information and a control method thereof.

An electronic device according to an exemplary embodiment of the present invention may acquire ratio information of a first pixel area including a skin color in the received content when the content is received through the input unit and the input unit, Acquires object information included in a second pixel region including a first color that is predetermined through the first pixel region and identifies the context of the content based on ratio information of the first pixel region and object information included in the second pixel region And a processor for processing the content based on the content processing information corresponding to the identified context.

Meanwhile, the processor may identify at least one of season information on the background of the content and genre information of the content based on the ratio information of the first pixel region and the object information included in the second pixel region .

If the second pixel region includes a color related to a plurality of seasons and the shape of the object included in the second pixel region is a predetermined first object shape, If the shape of the object included in the second pixel area is a predetermined second object shape, a season as the background of the content can be identified as a second season.

If the ratio of the first pixel region is equal to or greater than a predetermined first threshold value and the shape of the object included in the second pixel region is a predetermined first object shape, If the ratio of the first pixel region is less than a predetermined first threshold value and the shape of the object included in the second pixel region is a predetermined second object shape, Can be identified as the second season.

In this case, the processor may be configured such that the ratio of the first pixel region is less than a predetermined first threshold value, the shape of the object included in the second pixel region is a predetermined second object shape, If the ratio of the third pixel region including the color is greater than or equal to a predetermined second threshold value, a season as the background of the content can be identified as the second season.

Meanwhile, the processor may identify a motion amount of a fourth pixel region including a predetermined third color in the content, identify a shape of the object included in the fourth pixel region based on the motion amount, The season as the background of the content can be identified based on the shape of the object.

In addition, the processor may identify a location that is the background of the content based on at least one of brightness and saturation of a fourth pixel region including a predetermined third color in the content, As the background of the season.

On the other hand, the processor identifies the content genre corresponding to the ratio information of the first pixel region and the object information included in the second pixel region, based on the skin color ratio and the representative object shape information corresponding to each content genre can do.

Meanwhile, the processor may perform at least one of content processing and audio processing of the content based on the content processing information, and the content processing may include at least one of a color temperature adjustment, a sharpness processing, and a noise processing.

An electronic device control method according to an exemplary embodiment of the present invention includes receiving content, obtaining ratio information of a first pixel region including a skin color in the received content, Acquiring object information included in a second pixel area including a first color set therein, identifying the context of the content based on ratio information of the first pixel area and object information included in the second pixel area And processing the content based on the content processing information corresponding to the identified context.

The step of identifying the context of the content may further include a step of identifying at least one of season information as a background of the content and genre information of the content based on ratio information of the first pixel area and object information included in the second pixel area One can be identified.

In addition, the step of identifying the context of the content may include a step of, when the second pixel region includes colors related to a plurality of seasons, if the shape of the object included in the second pixel region is a predetermined first object shape, A season as a background of the content can be identified as a second season if the shape of the object included in the second pixel area is a predetermined second object shape.

If the ratio of the first pixel region is equal to or greater than a predetermined first threshold value and the shape of the object included in the second pixel region is a predetermined first object shape, If the ratio of the first pixel region is less than a predetermined first threshold value and the shape of the object included in the second pixel region is a predetermined second object shape, And identifying a season as a background of the content as a second season.

In this case, the step of discriminating in the second season may be performed in such a manner that the ratio of the first pixel region is less than a predetermined first threshold value, the shape of the object contained in the second pixel region is a predetermined second object shape, If the ratio of the third pixel region including the second color related to the two seasons is equal to or greater than a predetermined second threshold value, the season as the background of the content can be identified as the second season.

The identifying of the context of the content may include identifying a shape of an object included in the fourth pixel area based on a motion amount of a fourth pixel area including a predetermined third color in the content, Based on the shape of the content, as the background of the content.

The step of identifying the context of the content may further include identifying a location of the content based on at least one of brightness and saturation of a fourth pixel region including a predetermined third color in the content, May be identified as the season of the background of the content.

The step of identifying the context of the content may further include the step of determining the ratio of the first pixel area and the object information included in the second pixel area based on the skin color ratio and the representative object shape information corresponding to each content genre The corresponding content genre can be identified.

The processing of the content may include at least one of content processing and audio processing of the content, and the content processing may include at least one of color temperature adjustment, sharpness processing, and noise processing.

A non-transitory computer readable medium storing computer instructions for causing an electronic device to perform an operation when executed by a processor of an electronic device, in accordance with an embodiment of the present invention, Acquiring ratio information of a first pixel region including a skin color in the received content, acquiring object information included in a second pixel region including a predetermined first color through frequency analysis of the content Identifying the context of the content based on the ratio information of the first pixel region and the object information included in the second pixel region, and determining the content based on the identified content processing information And the like.

As described above, according to various embodiments of the present invention, the content processed according to the context of the received content is output in accordance with the intention of the content creator, thereby increasing the content viewing intention of the user .

FIG. 1 is a view for explaining a content-processed screen of a received content according to an embodiment of the present invention.
2 is a block diagram for explaining a configuration of an electronic device according to an embodiment of the present invention.
3 is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present invention.
4 is a diagram illustrating a content processing algorithm performed by a processor according to an embodiment of the present invention.
FIG. 5 is a view for explaining a method of acquiring ratio information on a skin color area included in contents according to an embodiment of the present invention.
FIG. 6A is a view for explaining a method of acquiring object information for a first color region included in contents according to an embodiment of the present invention, and FIG. 6B is a diagram for explaining a frequency analysis method.
7 is a view for explaining a method of acquiring object information for a third color area included in contents according to an embodiment of the present invention.
8 is a view for explaining a method of acquiring ratio information for a second color area included in contents according to an embodiment of the present invention.
9 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The terminology used herein will be briefly described, and the present disclosure will be described in detail.

The terms used in the embodiments of the present disclosure have selected the currently widely used generic terms possible in light of the functions in this disclosure, but these may vary depending on the intentions or precedents of those skilled in the art, the emergence of new technologies, and the like . Also, in certain cases, there may be a term chosen arbitrarily by the applicant, in which case the meaning shall be stated in detail in the description of the relevant disclosure. Accordingly, the terms used in this disclosure should be defined based on the meaning of the term rather than on the name of the term, and throughout the present disclosure.

The embodiments of the present disclosure are capable of various transformations and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise", "comprising" and the like are used to specify that there is a stated feature, number, step, operation, element, component, or combination thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In this disclosure, "module" or "module " performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software. Also, a plurality of " modules "or a plurality of" parts "may be implemented as at least one processor (not shown) integrated into at least one module, except" module " .

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. In order that the present disclosure may be more fully understood, the same reference numbers are used throughout the specification to refer to the same or like parts.

FIG. 1 is a view for explaining a content-processed screen of a received content according to an embodiment of the present invention.

The electronic device 100 may be implemented by various devices such as a computer, a TV, a set-top box, a smart phone, and a smart watch. For example, it is possible to use an analog TV, a digital TV, a 3D TV, a smart TV, an LED TV, an OLED TV, a plasma TV, a monitor, a curved TV having a screen with a fixed curvature, a flexible TV, a bended TV having a screen with a fixed curvature, and / or a curvature-variable TV capable of changing the curvature of the current screen by a received user input, but the present invention is not limited thereto.

As an example, the electronic device 100 may be implemented as an electronic device having a display as shown. When a display is provided, the image can be processed to directly output the content-processed image through the display provided in the electronic device 100.

As another example, the electronic device 100 may be implemented to process the received video content and provide the content-processed video data to an external display device. As another example, the image stored in the electronic device may be provided to an external display.

As another example, the electronic device 100 may process at least one of the received video and audio and output at least one of the processed video and audio.

The electronic device 100 according to an embodiment of the present invention can identify the context of the received content and perform content processing based on the context-based content processing information.

Generally, since the electronic device 100 outputs an image according to a color setting predetermined by a maker or the like when the electronic device 100 is manufactured, the electronic device 100 can be expressed in a color irrelevant to the intention of the image producer. For example, when the color temperature setting of the electronic device 100 is high, since the background of the image is blue in the background despite the summer, it does not match with the content atmosphere and the user can feel a sense of heterogeneity. As another example, if the color temperature setting of the electronic device 100 is low, the user may experience a sense of heterogeneity because the red video image is output even though the content image is related to the winter Olympics.

Accordingly, the electronic device 100 can identify the context of the received content, for example, the season as the background of the image, the genre of the image, the climate of the image, and perform content processing based thereon.

In particular, according to an embodiment of the present invention, the context of the received content can be identified based on the skin color ratio and the object information included in the received content. Hereinafter, various embodiments of the present invention will be described with reference to the drawings. Explain in detail.

As another example, the electronic device 100 may identify the context of the received content and process at least one of video and audio based thereon.

2 is a block diagram for explaining a configuration of an electronic device according to an embodiment of the present invention.

The electronic device 100 according to an embodiment of the present invention may include an input unit 110 and a processor 120.

The input unit 110 may receive the content, and may receive at least one of video and audio of the content. In this case, the content may include various contents such as terrestrial broadcast, cable broadcast, video file, IPTV content, and still image.

According to an example, the input unit 110 can receive content processing information for each context, and can perform content processing based on the received content processing information. The content processing information may include at least one of video processing information and audio processing information.

Processor 120 controls the overall operation of electronic device 100.

According to an embodiment of the present invention, the processor 120 may be implemented as a digital signal processor (DSP), a microprocessor, or a TCON (Time Controller) for processing digital signals, But are not limited to, a central processing unit (CPU), a microcontroller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP) (CPU), an ARM processor, and the like. The processor 120 may also include one or more of a system on chip (SoC), a large scale integration ), Or may be implemented in the form of an FPGA (Field Programmable Gate Array).

According to an embodiment of the present invention, when the content is received through the input unit 110, the processor 120 may obtain ratio information of the first pixel region including the skin color in the received content.

In one example, the processor 120 may identify a first pixel region that includes a skin color based on each pixel value contained in the received content. Here, the skin color may be apricot, white, yellow, brown, black, or the like representing human skin. However, the present invention is not limited thereto, and the hues within the predetermined similar ranges may be included in the skin color according to an embodiment of the present invention.

In addition, the processor 120 may acquire object information included in a second pixel region including a predetermined first color through frequency analysis of the content.

Specifically, an area including a specific shape is identified through frequency analysis of the image included in the received content, an area including a predetermined first color is identified through color analysis of the image, and a predetermined first color The object information included in the second pixel area including the second pixel area can be obtained.

The processor 120 may obtain a frequency value for each pixel through frequency analysis of the entire pixel region of the received content, and may divide the entire pixel region into a plurality of regions of a predetermined size. Subsequently, the processor 120 may identify at least one pixel region including a specific shape based on the frequency information included in each of the plurality of regions.

For example, the processor 120 may identify the leaf of the softwood when the frequency value changes to a high frequency in the region having the green included in the entire image of the specific frame, If it changes, it can be identified as leaf of hardwood. Accordingly, object information indicating a conifer or a broad-leafed tree can be obtained.

Thereafter, the processor 120 may identify the context of the content based on the ratio information of the first pixel region and the object information included in the second pixel region.

According to an example, the information for identifying the context of each received content may be received to identify the ratio information of the first pixel region and the context information of the image matched to the object information included in the second pixel region. Here, the context of the image can be classified according to the characteristics of the image such as the season as the background of the image, the genre of the image, the climate of the image, and the like.

Specifically, when the second pixel region includes colors related to a plurality of seasons and the shape of the object included in the second pixel region is a predetermined first object shape, Is identified as the first season, and if the shape of the object included in the second pixel area is the predetermined second object shape, the season in which the background of the received content becomes the second season can be identified.

For example, softwoods have green leaves in cold weather, while hardwoods do not have green leaves in winter. Accordingly, when the green color is included in the second pixel region and the shape of the leaves included in the second pixel region is a shape of a broad-leafed tree, the processor 120 determines that the season as the background of the received content is a relatively hot season If the shape of the leaves included in the second pixel area is the shape of the softwood, the season as the background of the received content can be identified as autumn or winter, which is a relatively cold season.

The processor 120 according to an exemplary embodiment of the present invention may be configured such that the ratio value included in the ratio information of the first pixel region is less than a predetermined value and the shape of the object included in the second pixel region is a predetermined first object shape , It can be identified that the season as the background of the content is the first season (for example, summer).

In this case, when the amount of change in the frequency value included in the object information included in the second pixel area is less than a predetermined value, the processor 120 can identify the object as being a predetermined first object shape. For example, in the case of broad-leaved trees, the variation of the frequency value is relatively small because the leaf area is large.

When the ratio value included in the ratio information of the first pixel area is equal to or greater than a preset value and the shape of the object included in the second pixel area is a predetermined second object shape, Can be identified as being the second season (e. G., Winter).

In this case, when the amount of change in the frequency value included in the object information included in the second pixel region is equal to or greater than a predetermined value, the processor 120 can identify the second object shape as a predetermined second object shape. For example, in the case of conifers, the area of leaves is narrow and the number of leaves is large, so that the variation of the frequency value is relatively large.

Meanwhile, the processor 120 according to an embodiment of the present invention may be configured such that the ratio of the first pixel region is equal to or greater than a predetermined first threshold value, the shape of the object included in the second pixel region is a predetermined second object shape, If the ratio of the third pixel region including the second color related to the season is greater than or equal to a predetermined second threshold value, the season as the background of the content can be identified as the second season.

For example, if the ratio of the third pixel region including the white color, which is a color associated with the entire winter of the specific frame, is equal to or greater than a predetermined threshold value, the season as the background of the received content can be identified as winter.

Meanwhile, the processor 120 according to an exemplary embodiment of the present invention identifies a motion amount of a fourth pixel region including a predetermined third color in the received content, and outputs the motion amount of the fourth pixel region to the fourth pixel region Identify the shape of the included object, and identify the season as the background of the content based on the shape of the object.

For example, if the image of a sandy beach and ocean appears in the image, it is possible to identify the season as the background of the image as summer. Accordingly, the amount of motion in the fourth pixel region including the blue color is identified, the shape of the object included in the fourth pixel region is identified as the shape of the sea, and the season as the background of the image is identified as summer . At the same time, the amount of motion in the pixel region including the yellow-based color is identified, and when the amount of motion is almost zero, the object shape is identified as sand, and the season can be identified as summer.

Here, the motion amount refers to the degree to which a plurality of pixels are displayed in a plurality of similar colors in an image. For example, when there is a sea in the image, the processor 120 determines whether the sea It is possible to identify the presence of a sea in the image.

Meanwhile, the processor 120 according to an embodiment of the present invention identifies a place where the received content becomes the background of the content based on at least one of the brightness and the saturation of the fourth pixel region including the predetermined third color , The seasons associated with the place can be identified by identification as seasons that are the background of the content.

For example, the sea color of South Korea is relatively dark, while the sea color of South Korea is warmer than that of relatively bright cyan. Areas with different climates often have different sea colors.

Accordingly, the processor 120 identifies a location in the Southeast Asia region as a background of a fourth pixel region including, for example, a relatively bright cyan-based color, and identifies the region as a background of Southeast Asia It can be identified as the summer of the season.

That is, the processor 120 can determine the context for processing the received content by obtaining the ratio information of the first pixel region and the object information of the second pixel region, which are the context determination criteria, in the received content.

Meanwhile, the processor 120 according to an embodiment of the present invention can identify genre information of contents as well as season information as a background of received contents.

For example, based on the ratio information of the first pixel area including the skin color, it can be discriminated that wearing a soccer jersey and a long sock according to the degree of exposure of the skin by a person appearing in the image.

At the same time, based on the object information included in the second pixel area including white color, it is possible to identify that the soccer ball object is continuously displayed at the center of the screen, and it is also included in the second pixel area including the green color It is possible to identify that the screen background is the soccer field.

Accordingly, the processor 120 can identify that the context of the video being output is related to the soccer game.

On the other hand, the context that the processor 120 can identify is not limited to this, and may include all contexts that can be identified based on the skin color. As an example, the processor 120 may identify that a video, such as a game, a sport, a movie, etc., is being displayed.

On the other hand, according to another embodiment, based on the ratio information of the previously stored first pixel area and the information for matching the context corresponding to each value of the object information included in the second pixel area, And the object information may be matched to the information stored in the storage 110 to identify the context.

According to one embodiment of the present invention, the processor 120 may obtain content processing information based on the identified context, and may process content received based on the obtained content processing information. In this case, the content processing information includes information received through the input unit 110 or information stored in the storage.

The content processing information for each context of the image may include at least one of color adjustment information, sharpness adjustment information, noise adjustment information, and color temperature adjustment information, for example, as content processing information for processing an image optimally in the context . Such content processing information can be obtained based on experiments, algorithms, formulas, and the like. However, the content processing information for each context of an image can be calculated in real time based on an algorithm, an expression, or the like by the processor 120 described later.

In one example, the processor 120 may process the received content based on seasonal content processing information. For example, when the season of the content is summer, the processor 120 may reduce the color temperature and provide the viewer with a warm atmosphere image. In addition, it is possible to reduce the sharpness of the received content, process the noise softer, process the image smoothly, and allow the viewer to feel as if the amblyopia is rising.

Meanwhile, the processor 120 may perform content processing based on the skin color ratio and object information corresponding to the context. For example, if the background of the image is summer, the skin color ratio may be relatively higher than in winter, and such seasonal skin color information may be stored. Here, the skin color information may be a threshold value for identifying whether the background of the image is the corresponding season, but the present invention is not limited thereto.

The object information may be object information representative of the maritime context. For example, when the background of the image is summer, the representative object is a wave, and in winter, a representative object is an eye. In this case, the object information may include the shape, color, and the like of the representative object. However, the object information does not necessarily include only the representative object information, but may include various object information that can infer the context.

Meanwhile, in the above-described embodiment, the region including the skin color is described as being recognized as one body region. However, according to another embodiment of the present invention, the region including the skin color is recognized as each human body region, Lt; RTI ID = 0.0 > context. ≪ / RTI >

For example, when a person wearing a bathing suit exists in the received content, the area including the skin color may include the entire upper body, legs, and feet in addition to the face. Accordingly, the ratio of the pixel region of the skin color included in the other body region to the pixel region occupied by the human face region relatively can be large. As another example, when a person wearing a coat and a muffler is present in the received content, the area including the skin color among the entire pixel area may be composed of only the face area. Accordingly, the ratio of the pixel region of the skin color included in the other body region to the pixel region occupied by the human face region relatively can be small.

3 is a view for explaining a detailed configuration of an electronic device according to an embodiment of the present invention.

The electronic device 100 according to an embodiment of the present invention may include an input unit 110, a processor 120, a storage 130, and an output unit 140.

The input unit 110 may include a tuner 111, a communication unit 112, and an interface unit 113.

The electronic device 100 according to an embodiment of the present invention receives content based on a content broadcast signal received from the tuner 111 or receives content based on online video information received from the communication unit 112 , And can receive content from an external device via the interface unit 113. [

The tuner 111 can receive video, audio, and data in a frequency band corresponding to a channel number corresponding to a user input.

The tuner 111 can receive broadcast signals from various sources such as terrestrial broadcast, cable broadcast, or satellite broadcast. The tuner 111 may receive broadcast signals from sources such as analog broadcasting or digital broadcasting from various sources.

The tuner 111 may be a separate device (e.g., a set-top box) having an all-in-one with the electronic device 100 or having a tuner unit electrically connected to the electronic device 100, top box, and a tuner connected to the interface unit 113).

The tuner 111 tunes only a frequency of a channel to be received by the electronic device 100 among many radio wave components through amplification, mixing, and resonance of a broadcast signal received by wire or wireless tuning. The broadcast signal may include video, audio, and additional data (e.g., an EPG (Electronic Program Guide).

The communication unit 112 can perform communication between the electronic device 100 and an external server. Specifically, the communication unit 112 can transmit / receive content data and content processing information to / from an external server, and transmit / receive a control command from a user. For example, the communication unit 112 may include a variety of communication devices such as an infrared (IR), a wireless fidelity (WI-FI), a bluetooth, a zigbee, a beacon, a near field communication, a WAN, Communication may be performed through a communication method.

The interface unit 113 can receive data from an external device. Specifically, the content data and the content processing information from the external device may include at least one input port. Each port may include, for example, DP, HDMI, RGB, DVI, Thunderbolt, MHL, AES / EBU, Optical, Coaxial,

Meanwhile, according to an embodiment of the present invention, the input content can be transmitted to an external server, and an external server can perform content processing. For example, an image input to at least one of the tuner 111, the communication unit 112, and the interface unit 113 of the electronic device 100 may be transmitted to the external server through the communication unit 112. The external server may perform content processing performed by the processor 120 and transmit the processed content to the electronic device 100 through the communication unit 112. [ The electronic device 100 can output the processed content from the external server via the output unit 140. [

The processor 120 includes a RAM 121, a ROM 122, a CPU 123, a GPU 124, and a bus 125. The RAM 121, the ROM 122, the CPU 123, the GPU 124, and the like may be connected to each other via a bus 125. The processor 120 may be implemented as a SoC (System On Chip).

The GPU 124 of the processor 120 may analyze the image and the CPU 123 may control the overall operation.

CPU 123 may perform the operations of processor 120 described with respect to FIG.

The GPU 124 may generate a screen including various objects such as an icon, an image, an image, and text when the booting of the electronic device 100 is completed. The GPU configuration may be configured in a separate configuration, such as a content processing unit, or may be implemented in a configuration such as SoC combined with a CPU in the processor 120. [

The ROM 122 stores a command set for booting the system and the like. The CPU 123 copies the O / S stored in the memory 110 to the RAM 121 in accordance with the command stored in the ROM 122, executes the O / S, . When the booting is completed, the CPU 123 copies various application programs stored in the memory 110 to the RAM 121, executes the application programs copied to the RAM 121, and performs various operations. The processor 120 may perform various operations using modules stored in the memory 110. [

The storage 130 stores various data required for operation of the electronic device 100.

In particular, the storage 130 stores data necessary for the processor 120 to perform various processes. For example, the storage 130 may be implemented as a memory embedded in the electronic device 100, or as a removable memory in the electronic device 100, depending on the purpose of data storage. For example, in the case of data for driving the electronic device 100, it is stored in a memory embedded in the electronic device 100, and in the case of data for the extended function of the electronic device 100, It can be stored in a possible memory. The memory embedded in the electronic device 100 may be implemented in the form of a nonvolatile memory, a volatile memory, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD) A memory card (for example, a micro SD card, a USB memory, etc.), an external memory (for example, a USB memory) connectable to a USB port, and the like.

The storage 130 according to an exemplary embodiment of the present invention may store content processing information for each context of content input to the electronic device 100. [

The output unit 140 may include a display 141 and a speaker 142.

The display 141 may display an image of the content on the electronic device 100 or an image of the content processed by the processor 120. [

The display 141 may be a variety of displays such as, for example, a liquid crystal display (LCD), an organic light-emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP) . ≪ / RTI > In this case, the electronic device 100 may be implemented as various types of display devices, for example, a TV, a large format display (LFD), a digital signage (digital signboard), a digital information display (DID) video wall, projector display, and the like.

The speaker 142 may output the voice of the content or the voice of the content processed by the processor 120. [

4 is a diagram for explaining a content processing algorithm performed by a processor according to an embodiment of the present invention.

The processor 120 according to an exemplary embodiment of the present invention analyzes the remaining color regions except for the white region and the white region included in the received content (S4100).

Specifically, the white region included in the received content and the remaining color regions other than the white color can be separated. The reason for separating the white and the remaining colors is that it is necessary to first process the content based on the white region and then process the remaining colors (for example, red, green, and blue) based on the content-processed white color It is because. However, in some cases, the step of analyzing the remaining color regions except for the white region and the white region may be omitted and is not indispensable.

The processor 120 according to an exemplary embodiment of the present invention analyzes at least one of a skin color region, a first color region, a second color region, and a third color region included in the received content (S4200). For example, the first color may include green, the second color may be blue, and the third color may be white.

In this case, the processor 120 identifies the first pixel region including the skin color in the content, analyzes the ratio information of the first pixel region in the region including the skin color among all the pixel regions (Step S4210) can do. A detailed description thereof will be described later with reference to FIG.

Meanwhile, the processor 120 analyzes the object information included in the second pixel region through frequency analysis of the second pixel region including the predetermined first color (e.g., green) in the content (S4220) Can be obtained. A detailed description thereof will be described later with reference to FIGS. 6A and 6B.

In addition, the processor 120 may analyze the fourth pixel region including the predetermined third color (e.g., blue) in the content (S4230) to obtain information for determining the context. A detailed description thereof will be given later with reference to FIG.

Meanwhile, the processor 120 may analyze the ratio of the third pixel region including a predetermined second color (e.g., white color) to a specific region in the content (S4240) to obtain the ratio. A detailed description thereof will be given later with reference to FIG.

The processor 120 according to an exemplary embodiment of the present invention analyzes the at least one of the skin color region, the first color region, the third color region, and the second color region included in the received content (S4200) The context can be identified (S4300). For example, the context may include at least one of the season of the background of the received content and the genre of the received content.

The processor 120 according to an embodiment of the present invention may perform content processing based on the identified context (S4400). Specifically, it is possible to perform appropriate content processing for each context of the received content. For example, content processing may be performed on the basis of the content processing information for each context stored in the storage 130 or the content processing information for each context received through the input unit 110. In another example, processor 120 may perform content processing algorithms to perform content processing algorithms without pre-stored information based on the identified context.

The content processing S4400 performed by the processor 120 may include color adjustment (S4410), sharpness adjustment (S4420), color temperature adjustment (S4430), and noise adjustment (S4440) of the received content.

For example, color adjustment S4410 may adjust the brightness or saturation of the received content, adjust the Cb or Cr coordinates in the YcbCr domain, or adjust at least one of H, S, and V in the HSV domain.

In addition, the sharpness adjustment (S4420) may perform a smoothing process, a blur process or a sharpness process on an outline of an object or a background included in the image.

On the other hand, the color temperature adjustment (S4430) can enhance the red color by lowering the color temperature of the image or enhancing the blue color by increasing the color temperature of the image.

In addition, the noise adjustment (S4440) can reduce the noise of the image to smoothly express the object or the background included in the image, or increase the noise of the image to sharpen the object or the background.

On the other hand, although not shown, the content processing (S4400) may include voice processing of the received content. In one example, the voice processing may process various information such as the size of the voice, the frequency of the voice, the channel of the voice, etc., based on the context of the content identified by the processor 120.

FIG. 5 is a view for explaining a method of acquiring ratio information on a skin color area included in contents according to an embodiment of the present invention.

The processor 120 according to an embodiment of the present invention can identify an area corresponding to the skin color in all the received contents (S4211). In this case, the skin color may be a predetermined color, and the predetermined color may be a general human skin color such as white, apricot, brown, or black. However, the present invention is not limited to this example, and may include all colors capable of expressing a human skin color.

Thereafter, the processor 120 may identify the face region of the person included in the received content (S4212). In this case, the processor 120 may use various algorithms for recognizing the face of a person. For example, if the shape of the eye, the nose, and the mouth is included in the round shape of the area corresponding to the skin color, it can be recognized as a human face. Processor 120 may then identify (S4213) a pixel that is a skin color within the identified face region.

Meanwhile, the processor 120 may identify (S4214) a pixel in a skin color region in a specific frame of the received content.

Accordingly, the processor 120 can acquire the ratio of the number of pixels of the skin color area obtained in the entire specific frame to the number of pixels of the skin color area in the face area (S4215). That is, if an image having a skin color in a specific frame has a smaller ratio value than that of a face other than a face, and the image having a skin color in a specific frame has many other images than the face, the obtained ratio value may be large.

FIG. 6A is a view for explaining a method of acquiring object information for a first color area included in contents according to an embodiment of the present invention. Referring to FIG.

The processor 120 according to an embodiment of the present invention may identify an area corresponding to the first color in all the received contents (S4211). In this case, the first color may be a predetermined color, and the predetermined color may be a general leaf color such as green, greenish brown, or brown. However, the present invention is not limited to these examples, and may include all colors capable of expressing the color of the leaves.

Thereafter, the processor 120 may perform frequency analysis (S4222) on every color in a specific frame of the received content. Details will be described with reference to FIG. 6B.

6B is a diagram for explaining a frequency analysis method.

Specifically, the frequency analysis method is a method for determining the shape of an object in an image of a specific frame. For example, when an image including two different colors is displayed on a 5 * 5 screen as shown, frequency analysis is performed for each pixel line, so that the first color and the second color have different frequency values So that a frequency spectrum can be obtained. The shape of the object displayed on the screen can be identified based on the frequency spectrum obtained on the plurality of pixel lines.

For example, if there is an image of a leaf of softwood, performing a frequency analysis may change the frequency value to a higher frequency. There are many thin leaves in softwoods. Conversely, if there is an image of a leaf of a broad-leaved tree, then frequency analysis can be performed to change the frequency value to a lower frequency. Because broad leaves have relatively fewer leaves than conifers. Accordingly, the processor 120 can identify the shape of the leaves according to the frequency of the frequency value.

That is, the processor 120 can acquire information on the object shape displayed on the display through frequency analysis.

Referring again to FIG. 6A, the processor 120 can divide a specific frame into a predetermined plurality of regions (S4223), and identify frequency information obtained by the above-described frequency analysis method for each region (S4224) .

Meanwhile, the processor 120 may identify an area that is a first color in a specific frame of the received content (S4225). Thereafter, the entire image of the specific frame can be divided into predetermined regions (S4226), and the pixel information, which is the first color for each divided region, can be identified (S4227).

Accordingly, the processor 120 can obtain the object information included in the region including the first color using the frequency information and the pixel information of the first color, which are divided by each region. For example, in a region including green, a wide-shaped leaf shape can be identified based on frequency information, thereby obtaining object information called a green hardwood.

7 is a view for explaining a method of acquiring object information about a third color area included in contents according to an embodiment of the present invention.

The processor 120 according to an embodiment of the present invention can identify an area corresponding to the third color in all the received contents (S4231). In this case, the third color may be a predetermined color, and the predetermined color may be general sea color such as navy color, blue color, sky blue color, and cyan color. However, the present invention is not limited to this example. For example, a value obtained by adding an R code value and a G code value in an RGB code may be a blue system color which is smaller than a B code value, and includes all colors capable of expressing a sea color can do.

Thereafter, the processor 120 can divide a specific frame into a predetermined plurality of regions (S4232), and obtains a motion amount for a region having a third color in each divided region (S4233). In this case, the processor 120 can acquire the amount of motion based on the amount of change in each pixel color in the region of the third color.

Thereafter, the processor 120 can identify whether the image of the region which is the third color is an image for the sea, based on the amount of motion for the region which is the third color.

In another embodiment, the processor 120 may identify a third color region, divide a particular frame into a plurality of predetermined regions, and perform frequency analysis on each divided region to identify object information. Thus, the context may be determined based on the identified object information and the identified third color.

8 is a view for explaining a method of acquiring ratio information for a second color area included in contents according to an embodiment of the present invention.

The processor 120 according to an exemplary embodiment of the present invention may divide a specific frame of the received content into a predetermined plurality of regions (S4241).

After that, the processor 120 identifies information on the flat surface existing in the image by each divided area (S4242), and identifies information about the pixels including the second color in the specific frame by each area (S4243).

Accordingly, the processor 120 may identify (S4244) the number of pixels including the second color on the flat surface included in the specific frame based on the identified information.

Thereafter, the processor 120 may obtain (S4245) a positive proportion of the pixels containing the second color contained in the flat surface area, for the amount of pixels containing the second color contained in the specific frame image have. For example, the second color may include white, and in the case of a frame with a lot of snow on the road or car roof, the amount of white pixels contained in a flat road or flat car roof relative to the amount of white pixels in the entire image Is high, a high ratio value can be obtained.

Accordingly, the processor 120 can identify the context of the image based on the information obtained through the processes of FIGS. 4 to 8, and can perform content processing according to the identified context.

For example, when the number of pixels of the skin color region in the face region is small and the number of pixels of the skin color acquired in the entire specific frame is large, the processor 120 identifies that the ratio value is large, A cyan color which includes information corresponding to a conifer, and which identifies an object in the third color gamut as a sea and a third color as a tropical color of the sea; and the amount of the second color pixel contained in the specific frame image The processor 120 identifies the context of the image as being summer or tropical, thereby increasing the color temperature, or increasing the temperature of the haze, It is possible to perform a smoothing process such as ascending. In addition, the processor 120 may perform voice processing such as voice size, voice frequency, and voice channel.

9 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.

According to an embodiment of the present invention, the electronic device 100 may receive the content (S910). Thereafter, the ratio information of the first pixel region including the skin color may be obtained from the received content (S920).

Thereafter, the object information included in the second pixel region including the predetermined first color may be obtained (S930) through frequency analysis of the received content. Here, the frequency analysis means frequency analysis of the content image, specifically, the same as that described above with reference to FIG. 6B.

In addition, the context of the content can be identified based on the ratio information of the first pixel region and the object information included in the second pixel region (S940). Here, the context may include season, genre, etc. of the image.

Thereafter, the content can be processed (S950) based on the content processing information corresponding to the identified context. Here, the content processing information includes pre-stored information or information input from the outside.

Meanwhile, at least some of the methods according to various embodiments of the present invention described above can be implemented in the form of an application that can be installed in an existing electronic device.

In addition, at least some of the methods according to various embodiments of the present invention described above may be implemented with software upgrades, or hardware upgrades, for existing electronic devices.

In addition, at least some of the various embodiments of the present invention described above may be performed through an embedded server provided in the electronic device, or an external server of the electronic device.

On the other hand, at least some of the various embodiments described above may be implemented in a recording medium that can be read by a computer or similar device using software, hardware, or a combination thereof . In some cases, at least some of the embodiments described herein may be implemented by the processor itself. According to a software implementation, at least some of the embodiments, such as the procedures and functions described herein, may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

Meanwhile, the computer instructions for performing the processing operations of the electronic device according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in the non-volatile computer-readable medium cause the particular device to perform the processing operations in the electronic device according to the various embodiments described above when executed by the processor of the particular device.

Non-transitory computer readable media is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the device. Specific examples of non-transitory computer readable media include CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it is to be understood that the disclosure is not limited to the specific embodiments thereof, It will be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present disclosure.

100: Electronic device
110: input unit
120: Processor

Claims (19)

An input unit; And
Acquiring ratio information of a first pixel region including a skin color from the received content when the content is received through the input unit,
Acquiring object information included in a second pixel region including a predetermined first color through frequency analysis of the content,
A processor for identifying the context of the content based on ratio information of the first pixel region and object information included in the second pixel region and processing the content based on the content processing information corresponding to the identified context; ≪ / RTI > The method according to claim 1,
The processor comprising:
And season information of the content and genre information of the content based on ratio information of the first pixel area and object information included in the second pixel area. The method according to claim 1,
The processor comprising:
If the second pixel region includes a color related to a plurality of seasons, if the shape of the object included in the second pixel region is a predetermined first object shape, a season as a background of the content is identified as a first season And identifies a season as a background of the content as a second season if the shape of the object included in the second pixel area is a predetermined second object shape. The method according to claim 1,
The processor comprising:
If the ratio of the first pixel area is equal to or greater than a predetermined first threshold value and the shape of the object included in the second pixel area is a predetermined first object shape, a season as the background of the content is identified as a first season ,
If the ratio of the first pixel area is less than a predetermined first threshold value and the shape of the object included in the second pixel area is a predetermined second object shape, a season as a background of the content is identified as a second season , An electronic device. 5. The method of claim 4,
The processor comprising:
Wherein the ratio of the first pixel region is less than a predetermined first threshold value and the shape of the object contained in the second pixel region is a predetermined second object shape and includes a second color associated with the second season And identifies the season as the background of the content as the second season if the ratio of the region is greater than or equal to a predetermined second threshold value. The method according to claim 1,
The processor comprising:
Identifying a motion amount of a fourth pixel region including a predetermined third color in the content, identifying a shape of the object included in the fourth pixel region based on the motion amount, Identifying a season as a background of the content. The method according to claim 1,
The processor comprising:
Identifying a place to be a background of the content based on at least one of a brightness and a saturation of a fourth pixel region including a predetermined third color in the content and a season associated with the place as a background of the content Electronic device. The method according to claim 1,
The processor comprising:
And identifies the content genre corresponding to the ratio information of the first pixel region and the object information included in the second pixel region, based on the skin color ratio and the representative object shape information corresponding to each content genre. The method according to claim 1,
The processor comprising:
Performing at least one of content processing and audio processing of the content based on the content processing information,
Wherein the content processing includes at least one of a color temperature adjustment, a sharpness processing, and a noise processing. A method for controlling an electronic device,
Receiving content;
Obtaining ratio information of a first pixel area including a skin color in the received content;
Acquiring object information included in a second pixel region including a first color that is predetermined through frequency analysis of the content;
Identifying a context of the content based on ratio information of the first pixel region and object information included in the second pixel region; And
And processing the content based on the content processing information corresponding to the identified context. 11. The method of claim 10,
Wherein the step of identifying the context of the content comprises the step of determining at least one of the season information of the content and the genre information of the content based on the ratio information of the first pixel area and the object information included in the second pixel area Identifying a control method. 11. The method of claim 10,
The step of identifying the context of the content may include: when the second pixel region includes colors related to a plurality of seasons, if the shape of the object included in the second pixel region is a predetermined first object shape, Is identified as the first season, and when the shape of the object included in the second pixel area is the predetermined second object shape, the season as the background of the content is identified as the second season. 11. The method of claim 10,
Wherein the step of identifying the context of the content comprises: if the ratio of the first pixel region is equal to or greater than a predetermined first threshold value and the shape of the object included in the second pixel region is a predetermined first object shape, Identifying a season as a first season; And
If the ratio of the first pixel area is less than a predetermined first threshold value and the shape of the object included in the second pixel area is a predetermined second object shape, a season as a background of the content is identified as a second season The method comprising: 14. The method of claim 13,
Wherein identifying in the second season comprises:
Wherein the ratio of the first pixel region is less than a predetermined first threshold value and the shape of the object contained in the second pixel region is a predetermined second object shape and includes a second color associated with the second season And identifies a season as a background of the content as the second season if the ratio of the region is greater than or equal to a predetermined second threshold value. 11. The method of claim 10,
Wherein identifying the context of the content comprises: identifying a shape of an object included in the fourth pixel area based on a motion amount of a fourth pixel region including a third color predetermined in the content; As a background of the content. 11. The method of claim 10,
Wherein identifying the context of the content comprises: identifying a location that is a background of the content based on at least one of brightness and saturation of a fourth pixel region including a predetermined third color in the content; And identifying a season as a season that is a background of the content. 11. The method of claim 10,
The step of identifying the context of the content may further include the step of determining the ratio of the ratio of the first pixel area and the object information included in the second pixel area based on the skin color ratio and the representative object shape information corresponding to each content genre And identifying a content genre. 11. The method of claim 10,
The step of processing the content may include at least one of content processing and audio processing of the content,
Wherein the content processing includes at least one of a color temperature adjustment, a sharpness processing, and a noise processing. 17. A non-transitory computer readable medium storing computer instructions for causing an electronic device to perform an action when executed by a processor of the electronic device,
Receiving content;
Obtaining ratio information of a first pixel area including a skin color in the received content;
Acquiring object information included in a second pixel region including a first color that is predetermined through frequency analysis of the content;
Identifying a context of the content based on ratio information of the first pixel region and object information included in the second pixel region; And
And processing the content based on the content processing information corresponding to the identified context.

Images