KR20170083889A - Display apparagus and operation method of the same - Google Patents

Abstract

A display unit, and at least one content constituting a graphics frame, decoding and realizing the obtained real image content, and converting the real image content processed in the image quality into other contents constituting the graphic frame And a control unit configured to acquire the graphic frame by combining and output the obtained graphic frame to the display unit.

Description

[0001] DISPLAY APPARATUS AND OPERATION METHOD OF THE SAME [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device and an operation method thereof, and more particularly to a display device and an operation method thereof capable of improving the image quality of the display device.

The display device is a device having a function of displaying an image that the user can view. For example, a television (TV) apparatus, which is an example of a display apparatus, has only functioned to receive a broadcast signal transmitted from a broadcast station in a unidirectional manner and display a broadcast image. However, the present display device has a function of displaying broadcast images received from a broadcasting station, as well as a function of providing it. Accordingly, the display quality of the display device may be degraded due to various data displayed on the display device.

An object of the present disclosure is to provide a display device and an operation method thereof that can improve the image quality of a display device.

A display device according to some embodiments includes a display portion, a processor, a memory, and one or more programs stored in the memory and executed by the processor, wherein the one or more programs include one or more of the one or more content Acquiring the real image content, decoding and image-processing the obtained real image content, combining the real image content processed with the other content constituting the graphic frame to obtain the graphic frame, And one or more instructions for outputting a frame to the display unit.

The real image content may include representative image content for displaying still image content or video content.

The real image content may include a Joint Photographic Experts Group (JPEG) file or a JPG file.

The one or more programs may further include instructions for performing the image quality processing by using a predetermined conversion table in color space conversion for changing the obtained real image content from YCbCr to RGB.

The image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction.

The one or more programs may further include instructions for mixing a video frame for video content with the graphics frame to obtain a mixed frame and outputting the mixed frame to the display unit

A method of operating a display device according to some embodiments includes the steps of obtaining a real image content among one or more contents constituting a graphic frame, decoding and realizing the real image content obtained, Acquiring the graphics frame by combining the content with other content constituting the graphics frame, and outputting the obtained graphics frame.

The real image content may include representative image content for displaying still image content or video content.

The real image content may include a JPEG file or a JPG file.

The decoding and image quality processing of the obtained real image content may perform the image quality processing by using a predetermined conversion table for color space conversion for changing the obtained real image content from YCbCr to RGB.

The image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction.

The method of operating the display device may further include mixing a video frame for video content and the graphic frame to obtain a mixed frame, and outputting the mixed frame.

1 shows a display device according to some embodiments.
2 is an illustration of a graphics frame acquired by a display device according to some embodiments.
3 shows a method of acquiring a graphic frame in a display device according to some embodiments.
4 is a diagram for explaining a graphics plane in which graphic frames are stored.
5 is a diagram for explaining a video frame and a graphic frame.
6 is an illustration of a mixing of video frame graphics frames of a display device according to some embodiments.
7 is an illustration of a screen of a display device according to some embodiments.
8 is a block diagram of a display device according to some embodiments.
9 is a diagram for explaining the operation of the display device according to some embodiments.
10 is another block diagram of a display device according to some embodiments.
11 is a flowchart of a method of operating a display device according to some embodiments.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. In the drawings, the same reference numerals are used to denote like elements throughout the specification for the purpose of clearly illustrating the present disclosure.

Although the terms used in this disclosure have been described in general terms that are currently used in consideration of the functions referred to in this disclosure, they are intended to encompass various other terms depending on the intention or circumstance of the skilled artisan, . Accordingly, the terms used in the present disclosure should not be construed as merely the names of the terms, but rather on the meaning of the terms and throughout the present disclosure.

Also, the terms first, second, etc. may be used to describe various elements, but the elements should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another.

Moreover, the terms used in this disclosure are used only to describe specific embodiments and are not intended to be limiting of the present disclosure. The singular expressions include plural meanings unless the context clearly dictates singular. In addition, throughout the specification, when a part is referred to as being "connected" to another part, it is not limited to a case where it is "directly connected", but also an "electrically connected" . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, and in particular, the words "above" and similar indications used in the claims may refer to both singular and plural. Further, if there is no description explicitly specifying the order of the steps describing the method according to the present disclosure, the steps described may be performed in any suitable order. The present disclosure is not limited by the order of description of the steps described.

The phrases "in some embodiments" or "in one embodiment" appearing in various places in this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented with various numbers of hardware and / or software configurations that perform particular functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or by circuit configurations for a given function. Also, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented with algorithms running on one or more processors. In addition, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing, and the like. Terms such as "mechanism," "element," "means," and " configuration "and the like are widely used and are not limited to mechanical and physical configurations.

Also, the connection lines or connection members between the components shown in the figures are merely illustrative of functional connections and / or physical or circuit connections. In practical devices, connections between components can be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail with reference to the accompanying drawings.

1 shows a display device according to some embodiments.

Referring to FIG. 1, the display apparatus 100 may be an apparatus configured to output audio / video (A / V) content. The display apparatus 100 may output the video content 11 of the A / V content to a screen and output the audio content to a sound output unit included in the display apparatus 100 or a speaker connected to the display apparatus 100 .

The A / V content may be real-time broadcast content or non-real-time A / V content. For example, non-real-time A / V content may be A / V content provided as a VOD (Video On Demand) service. Display device 100 may receive A / V content from an A / V content provider. The display device 100 can receive or download the A / V content by streaming. For example, the A / V content provider may be a broadcast service provider, a VOD service provider, or the like.

The display device 100 can receive broadcast signals and broadcast-related information from outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The display device 100 may receive A / V content via a broadcast channel or the Internet. Alternatively, the display device 100 may receive A / V content from an external device connected by wire or wirelessly. Alternatively, the A / V content may be stored in the memory included in the display device 100. [

The display apparatus 100 may further output one or more graphics contents 12, 13, 14 in addition to the video content 11 on the screen. The graphic contents 12, 13, and 14 are various information that can be output as a real image, a text, a graphic image, and the like on the screen of the display device 100. For example, the graphic contents 12, 13 and 14 may include an OSD (on screen display) menu, program information, an EPG (Electronic Program Guide), an application icon, an application window, a UI Subtitle corresponding to video content 11, information associated with video content 11, a web browsing window, and the like. However, the graphics contents 12, 13, and 14 are not limited thereto.

The display apparatus 100 can divide the screen and output the video content 11 and the graphics contents 12, 13, and 14 without overlapping. Alternatively, the display device 100 may superimpose the graphic content 12, 13, 14 on the video content 11 and output it. The display device 100 outputs a part of the graphics contents 12, 13 and 14 outputted on one screen without overlapping with the video content 11 and the other part outputs the graphics contents 12, You may. For example, the display apparatus 100 may display the caption corresponding to the video content 11 among the graphic contents 12, 13 and 14, the graphic content corresponding to the information associated with the video content 11, Can be output on the above. However, the screen of the display device 100 of FIG. 1 is only an example, and does not limit the output method of the video content 11 and the graphics content 12, 13,

The graphics content 12,13,14 may include a real image content 12, a graphic image content 13, a font content 14, and so on.

The real image content 12 may be representative image content for representing still image content or video content. For example, the still image content may be a live-action image. The representative image content for representing the video content may be a representative frame image of the video content or a thumbnail image of the video content. Actual image content 12 may include JPG files compressed in JPEG (Joint Photographic Experts Group) format, JPEG files, and the like.

The graphic image content 13 may be an artificially created image rather than a real image. The graphic image content 13 may include a PNG file compressed in PNG (Portable Network Graphics) format. The font content 14 may be a text image having attributes such as a particular size and style of a typeface. The graphical image content 13 may include characters that do not have font attributes.

Display device 100 may obtain various graphics content 12, 13, 14. The display device 100 may obtain the graphic contents 12, 13, 14 through a broadcast channel or the Internet. Alternatively, the display device 100 may obtain the graphics content 12, 13, 14 from the memory included in the display device 100. [ For example, the embedded UI may be stored in memory.

 The display apparatus 100 may acquire some of the graphic contents 12, 13, and 14 output on one screen through a broadcast channel or the Internet, and a part of the graphic contents 12, 13 and 14 may be acquired from the memory.

The display device 100 may obtain one or more graphics content 12,13,14 to output one or more graphics content 12,13,14 on a screen. , 14) to obtain a graphic frame.

2 is an illustration of a graphics frame acquired by a display device according to some embodiments.

Referring to FIG. 2, the display device may combine one or more graphics content (12, 13, 14) to obtain a graphics frame (20). 1, the graphics contents 12, 13, and 14 may be files of different formats, respectively. In addition, the display device can obtain the graphic contents 12, 13, 14 from various sources such as a network, an external device, a built-in memory, and the like.

3 shows a method of acquiring a graphic frame in a display device according to some embodiments.

Referring to FIG. 3, a display device may obtain one or more graphics content (12, 13, 14). The display device may divide one or more graphic content (12, 13, 14) into a real image content (12) and an unrealized graphic content (13, 14). The non-real-time graphic contents 13 and 14 may be graphical image contents, font contents, and the like described in FIG.

The display device can decode and process the real image content 12 (S11). The display device may decode the unrealistic graphic content 13, 14 (S12). The display device can obtain the graphic frame by combining the decoded and image-processed real image content 12 and the non-real-time graphic content 13 and 14 (S13).

According to some embodiments, the display device can prevent image quality deterioration by acquiring a graphics frame obtained by subjecting only the real image content 12 to image processing.

Unsupervised graphic content 13, 14 can be distinguished from real image content 12 in that it is an artificially created image. In addition, the unimported graphic content 13, 14 can include primarily lossless compressed (e.g., PNG) files. On the other hand, the real image content 12 may include lossy compressed (e.g., JPEG) files.

Since the real image content 12 has different properties from the non-real image graphic contents 13 and 14, it may cause deterioration of image quality when displayed together with graphic frames.

According to some embodiments, the display device may distinguish the real image graphic 12 from the other content 13, 14, and only the real image graphic 12 may be image-processed. The display device can prevent the distortion of the other contents 13 and 14 while improving the image quality of the real image graphic 12 by processing only the real image graphic 12. Thus, the overall picture quality of the graphic frame 20 can be improved. That is, the display device selectively processes the image quality in decoding according to the type of the graphics contents constituting the graphic frame, thereby improving the image quality.

The display device may distinguish the real image content 12 from the other content 13,14 based on the file format of the acquired one or more contents. For example, the display device can distinguish the contents of a JPG file or a JPEG file by the real image graphic 12.

The display device may simultaneously perform decoding and image quality processing on the real image content 12, or may decode the real image content 12 and then perform image quality processing. That is, the image quality processing may be performed together with decoding, or may be performed after decoding and post processing.

First, the display device performs the decoding and image quality processing for the real image content 12 at the same time as follows.

The display device may perform color space conversion to change the real image content 12 from YCbCr to RGB upon decoding. The display device can perform image quality processing by using a predetermined conversion table in the color space conversion of the real image content 12. [

The standard relationship of RGB and YCbCr is shown in Equation 1 below.

[Equation 1]

R = Y + 1.40200 X Cr

G = Y - 0.34414 X Cb - 0.71414 X Cr

B = Y + 1.77200 X Cb

The predetermined conversion table in the color space conversion of the real image content 12 may be a table whose coefficients are adjusted in Equation (1). The conversion table for the real image content 12 can be experimentally obtained by outputting a test pattern on the screen of the display device. The conversion table may vary depending on the panel characteristics of the display device.

When a predetermined conversion table is used in the color space conversion of the real image content 12, the display device can perform one of the decoding processes called color space conversion and image quality processing at the same time. Thus, the display device can improve picture quality without the need for additional hardware configuration or overhead of additional computation. In addition, since additional operations are not required, the time required for the process of acquiring a graphic frame does not increase. Therefore, the user's feeling performance of the display device may not be deteriorated.

The display device can decode the real image content 12 and perform image quality processing with various post-processing. Examples of image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction. However, the image quality processing method performed by the display device is not limited to the illustrated example. The display device can perform image quality processing after decoding and various post-processing.

As an example of the case where some embodiments are not applied, the display device can acquire a graphic frame without image quality processing on all the contents constituting the graphic frame. If the display device outputs the graphic frame as it is, the user will feel deterioration of the image quality of the real image content 12 on the screen. The cause of image deterioration may be that the real image content 12 is a file that is losslessly compressed.

As another example of the case where some embodiments are not applied, the display apparatus can obtain the graphic frame without image quality processing of all of the contents, and then process and output the entire graphic frame. In this case, the image quality of the real image content 12 is improved, but distortion may occur in the non-real image graphic contents 13 and 14.

As another example of the case where some embodiments are not applied, after the display device acquires a graphic frame without image quality processing of all of the contents, it is determined which area in the graphic frame is the real image graphic 12 and which area is the non- (13, 14), and can process only the area corresponding to the graphic content (12). At this time, the display device requires a judgment algorithm for distinguishing a specific area in the graphic frame. This requires additional hardware configuration, increases the computational complexity, and may incur additional costs.

On the other hand, according to some embodiments, the display device may decode and image the real image content 12 and combine with other content to obtain a graphics frame, thereby improving the image quality without additional overhead.

The display device can obtain a graphics frame by drawing a graphics frame on the graphics plane. The graphics plane may temporarily store graphics frames.

4 is a diagram for explaining a graphics plane in which graphic frames are stored.

Referring to FIG. 4, the graphics plane 220 may store the graphics frame 20. The graphics plane 220 may be a buffer for acquiring and storing the graphic frame 20 to be displayed on the screen. The display device 100 may draw the graphics frame 20 on the graphics plane 220. Drawing the graphics frame 20 on the graphics plane 220 may mean writing the pixel values on each of the pixels that make up the graphics frame 20 to the graphics plane 220. That is, drawing the graphic frame 20 may mean storing the graphic frame 20.

The graphics frame 20 may be composed of a plurality of pixels. Each of the plurality of pixels may have a pixel value. The pixel value may be RGB data. RGB data can be represented by (R, G, B). Here, R, G, and B are red data, green data, and blue data, respectively. For example, when each data is represented by 8 bits, red, green, and blue each have one level of 256 levels. The red, green, and blue colors represented by the respective levels can be mixed to express colors. For example, if the RGB data is (255, 255, 255), it indicates white, and when the RGB data is (0, 0, 0), it indicates black.

The display device may acquire the graphics frame 20 by combining one or more pieces of content with the graphics plane 220 to draw.

The result of the decoding and image processing of the real image content by the display device may include RGB data. In addition, the display device may also include RGB data as a result of decoding unrealistic graphic content. The display device may determine the location of the pixel to be drawn in the graphic frame 20 for each graphical content. The display device can acquire the graphic frame 20 by combining the graphics contents by writing RGB data at the position of the determined pixel for each graphic content. When the display device draws the graphics frame 20, the graphics frame 20 may be temporarily stored in the graphics plane 220. The display device can output the acquired graphic frame 20 to the screen. Once the graphics frame 20 is output, the display device may draw the next graphics frame to the graphics plane 220.

However, as described with reference to FIG. 1, the display apparatus 100 can display the video content 11 together with the graphic contents 12, 13, and 14 on the screen. The display device 100 may output a video frame on the screen together with the graphics frame 20 obtained by combining the graphics contents 12, 13,

5 is a diagram for explaining a video frame and a graphic frame.

5, the display device acquires a plurality of video frames FR1, FR2, FR3, FR4, and FR5 through video processing such as acquiring video content (11 in FIG. 1) and decoding video content . The display device can acquire the video content as a file in MPEG (Moving Picture Experts Group) format, but is not limited thereto.

The display apparatus can output a plurality of video frames FR1, FR2, FR3, FR4, FR5 at a frame rate. The frame rate is the number of video frames output per second.

The display device may store video frames FR1, FR2, FR3, FR4, FR5 in the video plane. The video plane may be a buffer for acquiring and storing video frames (FR1, FR2, FR3, FR4, FR5) to be displayed on the screen of the display device. One video plane may store one video frame. When the display device includes one video plane, the display device can store the next frame (e.g., FR2) on the video plane when it outputs the current video frame (e.g., FR1). The display device may include a plurality of video planes.

Since each of the graphic frames GFR1 and GFR2 can be obtained with the contents described in Figs. 2 to 4, redundant description will be omitted.

The display device can separately acquire and process the plurality of video frames FR1, FR2, FR3, FR4, FR5 and graphics frames GFR1, GFR2.

The display device can mix and output the video frames FR1, FR2, FR3, FR4, FR5 and the graphic frames GFR1, GFR2 together. Video frames FR1, FR2 and FR3 may be mixed with graphic frame GFR1 and video frames FR4 and FR5 may be mixed with graphic frame GFR2.

The graphic frames GFR1 and GFR2 are not constant in time to switch from the current frame (for example, GFR1) to the next frame (for example, GFR2) in comparison with the video frames FR1, FR2, FR3, FR4 and FR5 .

Although not shown in FIG. 5, if the display device does not have a video frame to be output together with the graphic frame, the display device can output only the graphic frame to the screen.

6 is an illustration of a mixing of video frame graphics frames of a display device according to some embodiments.

Referring to FIG. 6, the display device may obtain a video frame 31 for the video content 11. The display device may obtain a graphics frame 32 that combines one or more graphics content (12, 13, 14).

The display device can mix the video frame 31 and the graphics frame 32 to obtain the frame 33. [ The display device can output the obtained frame 33 to the screen.

The decoding and image quality processing for the real image content 12 to obtain the graphics frame 32 can be applied as described above. Thus, the display device can provide an image with improved image quality for the real image content 12.

7 is an illustration of a screen of a display device according to some embodiments.

Referring to FIG. 7, the display apparatus 100 may output a graphic frame combined with one or more graphics contents 12-1, 12-2, 13, and 14 to a screen. The display apparatus 100 can output only a graphic frame if there is no video content. The graphic contents 12-1, 12-2, 13 and 14 may include real image content 12-1 and 12-2, graphic image content 13, font content 14 and the like.

Actual image content 12-1, 12-2 may be representative image content for representing video content. The display apparatus 100 may receive a user input from the control apparatus 300 for selecting one still image content 12-1. The display device 100 may output the video content 11 corresponding to the selected real image content 12-1. The display device 100 can acquire the frame in which the video content 11 is outputted as the frame 33 in Fig.

The control device 300 is a device that can control the display device 100 remotely. The user can instruct the control device 300 to output the video content 11 corresponding to the real image content 12-1. In addition, the control device 300 can be used to turn on / off the power of the display device 100, change the channel, adjust the volume, select the type of broadcasting such as terrestrial broadcasting / cable broadcasting / satellite broadcasting, Or setting the environment of the display device 100. The display device 100 may be controlled in various ways. The control device 300 may be, but not limited to, a TV remote control, a pointing remote control, a mouse, a motion recognizer, and the like. The control device 300 shown in FIG. 7 is merely an example, and any type of control device can be used as long as it is an apparatus that can control the display device 100.

8 is a block diagram of a display device according to some embodiments.

8, the display apparatus 100 may include a display unit 110, a memory 120, and a control unit 130. [

The display unit 110 may output a frame in which the video frame, the graphic frame, or the video frame and the graphic frame acquired by the controller 130 are mixed.

The memory 120 may store one or more programs to be executed by the control unit 130. [ The one or more programs may include one or more instructions. Memory 120 may include a buffer, such as a graphics plane, a video plane.

The control unit 130 may include one or more processors to control the operation of the components of the display device 100 as a whole.

The control unit 130 may obtain the real image content among the one or more contents constituting the graphic frame. The control unit 130 may decode and image the acquired real image content, and may combine the real image content with the other content to obtain a graphic frame. The control unit 130 may output the acquired graphic frame to the display unit 110. [

The control unit 130 may acquire a video frame for the video content, mix the acquired video frame with the graphic frame, and output the mixed video frame to the display unit 110. [

The real image content may include representative image content for representing still image content or video content. The real image content may include a JPEG file or a JPG file.

The control unit 130 can perform image quality processing by using a predetermined conversion table for color space conversion in which the obtained real image content is changed from YCbCr to RGB. In addition, the image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction.

The control unit 130 may mix the video frame and the graphic frame for the video content to obtain a mixed frame and output the mixed frame to the display unit 110. [

The control unit 130 may perform operations performed by the display device described above with reference to FIG.

9 is a diagram for explaining the operation of the display device according to some embodiments.

Referring to FIG. 9, the display device can acquire video content, font data, PNG files, and JPG files. The font data, the PNG, the file, and the JPG file may be the contents constituting the graphic frame. However, this is only an example, and various combinations of the contents constituting the graphic frame may be possible.

The display device can decode the video content to the video decoder 201. [ The display device can process the decoded video content. The display device may store the decoded video content in video plane 210 as a video frame.

The display device can identify the format of each of the contents making up the graphics frame. The display device can decode according to the format of each content. The font data can be decoded by the font engine 202 and the PNG file can be decoded by the PNG decoder 203. [

The display apparatus can decode and process the JPG file by the JPG decoder 204 including the enhancer.

The display device can draw the graphic frame on the graphic plane 230 by combining the decoded font data, the decoded PNG file, the decoded and the JPG file subjected to the quality processing through the GPU (Graphic Processing Unit) 220. Therefore, the picture quality can be improved only for the JPG file, and the graphic frame which is not distorted for the font data or the PNG file can be obtained.

The mixer 240 of the display device may mix the video frames stored in the video plane 210 and the graphics frames stored in the graphics plane 230 to obtain frames. The display device can output the mixed frame to the screen.

The video decoder 201, the font engine 202, the PNG decoder 203 and the JPG decoder 204 may be programs executed by the control unit 130 of the display device 100 of Fig. 8, 120, < / RTI >

The GPU 220 and the mixer 240 may be included in the control unit 130 of FIG. 8 or may be controlled by the control unit 130.

The video plane 210 and the graphics plane 230 are buffers, respectively, and may be included in the memory 120 of Fig.

9 is intended to illustrate a method of operation of a display device according to some embodiments, and some embodiments are not limited to Fig.

10 is another block diagram of a display device according to some embodiments. The display device 1000 of Fig. 10 may be another example of the display device 100 of Fig. However, not all of the components shown in Fig. 10 are essential components of the display apparatus 1000. Fig. The display device 1000 may be implemented by more components than the components shown in Fig. 10, or the display device 1000 may be implemented by fewer components than those shown in Fig.

10, a display device 1000 includes a user input unit 1100, an output unit 1200, a control unit 1300, a sensing unit 1400, a communication unit 1500, an A / V input unit 1600, (1700).

The user input unit 1100 means means for receiving data for controlling the display device 1000. [ The user input unit 1100 may receive a user input for controlling the display device 1000. [ For example, the user input unit 1100 may include a key pad, a dome switch, a touch pad (contact type capacitance type, pressure type resistive type, infrared ray detection type, surface ultrasonic wave conduction type, A tension measuring method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto. Also, for example, the user input unit 1100 may be an interface for receiving a user input signal from an external input device (not shown).

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, an acoustic output unit 1220, and a vibration motor 1230 have.

The display unit 1210 displays data to be processed in the display device 1000. The display unit 1210 may output a frame in which a video frame, a graphic frame, or a video frame and a graphic frame obtained from the control unit 1300 are mixed.

Meanwhile, when the display unit 1210 and the touch pad have a layer structure and are configured as a touch screen, the display unit 1210 can be used as an input device in addition to the output device. The display unit 1210 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display A 3D display, and an electrophoretic display. The display apparatus 1000 may include two or more display units 1210 according to an embodiment of the display apparatus 1000. At this time, the two or more display units 1210 may be arranged to face each other using a hinge.

The audio output unit 1220 outputs audio content received from the communication unit 1500 or stored in the memory 1700. The sound output unit 1220 outputs sound signals related to the functions (e.g., call signal reception sound, message reception sound, alarm sound) performed in the display apparatus 1000. [ The sound output unit 1220 may include a speaker, a buzzer, and the like.

The vibration motor 1230 can output a vibration signal. For example, the vibration motor 1230 may output a vibration signal corresponding to an output of audio content or video content (e.g., a call signal reception tone, a message reception tone, etc.). In addition, the vibration motor 1230 may output a vibration signal when a touch is input to the touch screen.

The control unit 1300 typically controls the overall operation of the display device 1000. The control unit 1300 may control other components in the display apparatus 1000 in order to execute the operation of the display apparatus 1000 described above. For example, the control unit 1300 may include a user input unit 1100, an output unit 1200, a sensing unit 1400, a communication unit 1500, an A / V input unit 1600 ) Can be generally controlled.

In detail, the control unit 1300 may obtain the real image content among the one or more contents constituting the graphic frame. The control unit 1300 may decode and image the acquired real image content, and may combine the real image content with the other content to obtain a graphic frame. The control unit 1300 may output the acquired graphic frame to the display unit 1210.

The control unit 1300 may acquire a video frame for the video content, mix the acquired video frame with a graphic frame, and output the mixed video frame to the display unit 1210.

The control unit 1300 can perform image quality processing by using a predetermined conversion table for color space conversion for changing the obtained real image content from YCbCr to RGB. In addition, the image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction.

The control unit 1300 may mix the video frame and the graphics frame for the video content to obtain a mixed frame, and output the mixed frame to the display unit 1210.

The control unit 1300 may perform operations performed by the display device described above with reference to FIG.

The sensing unit 1400 may sense the state of the display device 1000 or the state around the display device 1000 and may transmit the sensed information to the controller 1300. [

The sensing unit 1400 includes a magnetism sensor 1410, an acceleration sensor 1420, an on / humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, (GPS) 1460, an air pressure sensor 1470, a proximity sensor 1480, and an RGB sensor (illuminance sensor) 1490, for example. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

The communication unit 1500 may include a local communication unit 1510, a mobile communication unit 1520, and a broadcast receiving unit 1530.

The short-range wireless communication unit 1510 includes a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a Near Field Communication unit, a WLAN communication unit, a Zigbee communication unit, IrDA, an infrared data association) communication unit, a WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant + communication unit, and the like.

The mobile communication unit 1520 transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The broadcast receiving unit 1530 receives broadcast signals and / or broadcast-related information from outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel.

The A / V (Audio / Video) input unit 1600 is for inputting an audio signal or a video signal, and may include a camera 1610, a microphone 1620, and the like. The camera 1610 can obtain a still image or a moving image through the image sensor in a video communication mode or a photographing mode. The image captured through the image sensor can be processed through the control unit 1300 or a separate image processing unit (not shown).

The still image or moving image processed by the camera 1610 may be stored in the memory 1700 or may be transmitted to the outside through the communication unit 1500.

The microphone 1620 receives an external acoustic signal and processes it as electrical voice data. For example, the microphone 1620 may receive acoustic signals from an external device or speaker. The microphone 1620 may use various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The memory 1700 may store a program for processing and controlling the control unit 1300 and may store data input to or output from the display apparatus 1000. [

The memory 1700 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , An optical disc, and the like.

Programs stored in the memory 1700 can be classified into a plurality of modules according to their functions, for example, a UI module 1710, a touch screen module 1720, a notification module 1730, .

The UI module 1710 can provide a specialized UI, a GUI, and the like that are interlocked with the display device 1000 for each application. The touch screen module 1720 senses a touch gesture on the user's touch screen and can transmit information on the touch gesture to the control unit 1300. [ The touch screen module 1720 according to some embodiments may recognize and analyze the touch code. The touch screen module 1720 may be configured as separate hardware including a controller.

Various sensors may be provided in or near the touch screen to sense the touch or near touch of the touch screen. An example of a sensor for sensing the touch of the touch screen is a tactile sensor. A tactile sensor is a sensor that detects the contact of a specific object with a degree or more that a person feels. The tactile sensor can detect various information such as the roughness of the contact surface, the rigidity of the contact object, and the temperature of the contact point.

In addition, a proximity sensor is an example of a sensor for sensing the touch of the touch screen.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. The user's touch gestures can include tap, touch & hold, double tap, drag, panning, flick, drag and drop, swipe, and the like.

The notification module 1730 may generate a signal for notifying the occurrence of an event of the display apparatus 1000. [ Examples of events generated in the display device 1000 include call signal reception, message reception, key signal input, schedule notification, and the like. The notification module 1730 may output a notification signal in the form of a video content through the display unit 1210 or may output a notification signal in the form of an audio signal through the audio output unit 1220, It is possible to output a notification signal in the form of a vibration signal.

11 is a flowchart of a method of operating a display device according to some embodiments.

Referring to FIG. 11, the display device may acquire real image content among one or more contents constituting the graphic frame (S110). The display device can decode and process the acquired real image content (S120). The display device can acquire a graphic frame by combining the image-processed real image content with other content constituting the graphic frame (S130). The display device may output the acquired graphic frame (S140).

The real image content may include representative image content for representing still image content or video content. The real image content may include a JPEG file or a JPG file.

The display device can perform the image quality processing by using a predetermined conversion table in color space conversion for changing the obtained real image content from YCbCr to RGB.

The image quality processing may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction.

The display device may mix the video and graphics frames for the video content to obtain the mixed frames and output the mixed frames.

The operation method of the display device of FIG. 11 can be performed in the display devices 100 and 1000 of the previous drawings. Therefore, the operation performed by the display device previously described with reference to Fig. 11 can be further performed without duplication.

Meanwhile, some of the above-described embodiments may be embodied in a general-purpose digital computer which can be embodied as a program that can be executed by a computer and operates the program using a computer-readable recording medium.

The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM,

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims (13)

A display unit;
A processor;
A memory; And
And one or more programs stored in the memory and executed by the processor,
The one or more programs,
Acquiring real image content of one or more contents constituting a graphic frame,
Decodes and realizes the acquired real image content,
Acquiring the graphic image frame by combining the real image content processed with the image quality with other content constituting the graphic frame,
And one or more instructions for outputting the acquired graphic frame to the display unit. The method according to claim 1,
Wherein the real image content comprises representative image content for displaying still image content or video content. The method according to claim 1,
Wherein the real image content includes a Joint Photographic Experts Group (JPEG) file or a JPG file. The method according to claim 1,
The one or more programs,
Further comprising instructions for performing the image quality processing by using a predetermined conversion table in color space conversion for changing the obtained real image content from YCbCr to RGB. The method according to claim 1,
Wherein the image quality processing includes at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction. The method according to claim 1,
The one or more programs,
Further comprising instructions for mixing the video frame for video content with the graphics frame to obtain a mixed frame, and outputting the mixed frame to the display unit. Acquiring real image content of one or more contents constituting a graphics frame;
Decoding and realizing the obtained real image content;
Acquiring the graphics frame by combining the real image content processed with the image quality with other content constituting the graphics frame; And
And outputting the acquired graphics frame. 8. The method of claim 7,
Wherein the real image content comprises representative image content for displaying still image content or video content. 8. The method of claim 7,
Wherein the real image content includes a JPEG file or a JPG file. 8. The method of claim 7,
The decoding and image quality processing of the obtained real image content,
And performs the image quality processing by using a predetermined conversion table for color space conversion in which the obtained real image content is changed from YCbCr to RGB. 8. The method of claim 7,
Wherein the image quality processing includes at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction. 8. The method of claim 7,
Mixing a video frame for video content and the graphics frame to obtain a mixed frame; And
And outputting the mixed frame. A computer-readable recording medium having recorded thereon a program for implementing the method of any one of claims 7 to 12.

Images