KR20170098637A - Image processing device and Image display apparatus including the same - Google Patents

Abstract

The present invention relates to an image processing apparatus and an image display apparatus including the same. According to an embodiment of the present invention, the image processing apparatus includes: a processor for setting the frame resolution for graphic image frames; a graphic processing unit rendering a current image frame in accordance with the set frame resolution; and a scaler executing a scaling operation on the current rendered image frame. The processor executes a control operation to execute a frame resolution varying operation and a sharpness process on the graphic image frames based on a change in the graphic image frames. Accordingly, the present invention can alleviate the image quality deterioration while reducing power consumption in a graphic image processing operation.

Description

TECHNICAL FIELD The present invention relates to an image processing apparatus and an image display apparatus having the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and an image display apparatus having the same, and more particularly, to an image processing apparatus capable of improving image quality deterioration while reducing power consumption during graphic image processing, .

The video display device is a device having a function of providing an image that a user can view. The user can view various images through the video display device.

In particular, when an application such as a game is executed, the video display device can generate a graphic image based on the game data and display the generated graphic image.

On the other hand, various attempts have been made in hardware and software to implement the complex functions of graphic image processing.

An object of the present invention is to provide an image processing apparatus capable of improving image quality deterioration while reducing power consumption during graphic image processing, and a video display apparatus having the same.

According to an aspect of the present invention, there is provided an image processing apparatus including a processor for setting a frame resolution for a graphic image frame, a graphics processor for rendering a current image frame according to a set frame resolution, And a scaler for performing scaling on the rendered current image frame, wherein the processor controls to perform frame resolution variable, and sharpness processing of the graphic image frame based on the amount of change for the graphic image frame.

According to another aspect of the present invention, there is provided an image display apparatus including a processor for setting a frame resolution for a graphic image frame, a graphic processor for rendering a current image frame according to a set frame resolution, And a scaler for performing scaling on the rendered current image frame, and the processor controls to perform frame resolution variable, and sharpness processing of the graphic image frame based on the amount of change for the graphic image frame.

According to an embodiment of the present invention, an image processing apparatus includes a processor for setting a frame resolution for a graphic image frame, a graphics processing unit for performing rendering on a current image frame according to a set frame resolution, Wherein the processor controls to perform a frame resolution variable and a sharpness process of a graphic image frame based on a variation amount with respect to the graphic image frame so that the power consumption It is possible to improve deterioration of image quality.

Particularly, the image processing apparatus reduces the frame resolution of the graphic image frame and increases the sharpness while performing up-scaling as the amount of change with respect to the graphic image frame becomes larger, thereby reducing the power consumption in processing the graphic image, .

Particularly, power consumption in the graphics processing unit can be reduced.

FIG. 1 illustrates execution of a game application in a video display device according to an embodiment of the present invention.
2 is an example of a block diagram of the video display device of FIG.
Figure 3 is an example of an internal block diagram of the processor of Figure 2;
4A to 4B show various examples of the image processing apparatus provided in the image display apparatus of FIG.
5 illustrates an example of an internal block diagram of an image processing apparatus according to an embodiment of the present invention.
Figs. 6 to 9C are drawings referred to for explanation of the image processing apparatus of Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The video display device described in the present specification may be applied to various devices such as a mobile phone, a smart phone, a notebook computer, a TV, a monitor, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP , A navigation computer, a tablet computer, an e-book terminal, a wearable device such as a smart watch, and the like.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

FIG. 1 illustrates execution of a game application in a video display device according to an embodiment of the present invention.

Referring to the drawings, the video display device 100 of FIG. 1 can display a game image on the display 180 by executing a game application.

To this end, the image display apparatus 100 generates a graphic image frame using the graphic data and displays the graphic image frame on the display 180 when the game application is executed.

On the other hand, when signal processing for a graphic image is performed every frame, power consumption in the image display apparatus 100 is significantly increased.

Particularly, when the image display apparatus 100 displays a graphic image using power from an internal battery, the battery usage due to power consumption increases.

In order to solve this problem, the present invention proposes a method for improving image quality deterioration while reducing power consumption during graphic image processing.

Accordingly, the image display apparatus 100 according to an embodiment of the present invention includes a processor for setting a frame resolution for a graphic image frame, a graphics processing unit for rendering a current image frame according to a set frame resolution, And a scaler for performing scaling on the rendered current image frame, wherein the processor controls to perform a frame resolution variable, and sharpness process, of the graphical image frame, based on the amount of change for the graphical image frame, It is possible to improve image deterioration while reducing power consumption during processing.

Meanwhile, the image display apparatus 100 according to an exemplary embodiment of the present invention reduces the frame resolution of the graphic image frame, increases the sharpness, and performs the upscaling as the change amount of the graphic image frame increases, It is possible to improve image deterioration while reducing power consumption during processing. Particularly, power consumption in the graphics processing unit can be reduced.

Meanwhile, the above-described graphic image may be a concept including a game image, a user interface image, a web screen image, an application screen image, and the like.

A method for processing graphic images in the image display apparatus 100 according to an embodiment of the present invention will be described in detail with reference to FIG. 5 and the following figures.

2 is an example of a block diagram of the video display device of FIG.

2, the image display apparatus 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 125, a processor 170, and a power supply unit 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms.

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 is a module for wireless Internet access, and the wireless Internet module 115 can be built in or externally attached to the image display device 100. [ WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display 180. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external audio signal by a microphone in an audio reception mode, for example, a communication mode, a recording mode, or a voice recognition mode, and processes the audio signal as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may use various noise reduction algorithms for eliminating noise generated in receiving an external audio signal.

On the other hand, the plurality of microphones 123 may be arranged at different positions. The audio signal received at each microphone can be processed as an audio signal at the processor 170 or the like.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a user's pressing or touching operation. Also, the user input unit 130 may be a jog wheel for rotating a key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display 180 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the image display apparatus 100 such as the open / close state of the image display apparatus 100, the position of the image display apparatus 100, And a sensing signal for controlling the sensor. For example, when the video display device 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether power is supplied to the power supply unit 190, whether the interface unit 125 is connected to an external device, and the like can be handled.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The proximity sensor 141 can detect the presence of an object approaching the image display device 100 or an object existing in the vicinity of the image display device 100 without mechanical contact. The proximity sensor 141 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field, or a rate of change in capacitance. The proximity sensor 141 may be equipped with two or more sensors according to the configuration.

The pressure sensor 143 can detect whether pressure is applied to the image display device 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a position where the pressure of the image display device 100 is required depending on the use environment. If the pressure sensor 143 is installed on the display 180, a touch input via the display 180 and a pressure touch with a larger pressure than the touch input, according to the signal output from the pressure sensor 143, Input can be identified. In addition, the magnitude of the pressure applied to the display 180 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143.

The motion sensor 145 detects the position, motion, and the like of the image display device 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology.

The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various kinds. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display 180, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display 180 displays and outputs information processed in the image display apparatus 100. [ For example, when the video display device 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the image display apparatus 100 is in the video communication mode or the image capture mode, the captured or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display 180 and the touch pad have a mutual layer structure to constitute a touch screen, the display 180 may be used as an input device capable of inputting information by a user's touch in addition to the output device .

If the display 180 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to the internal bus of the image display apparatus 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touchscreen panel controller processes the signals and then transmits corresponding data to the processor 170 to enable the processor 170 to determine whether the touch input was present and which area of the touch screen was touched.

The display 180 may be composed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-Paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power is turned off and the battery life of the image display apparatus 100 is short It can be maintained for a long time. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display 180 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). In addition, there may be two or more displays 180 depending on the implementation of the image display apparatus 100. For example, the image display apparatus 100 may include an external display (not shown) and an internal display (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs audio signals related to functions performed in the image display apparatus 100, for example, call signal reception tones, message reception tones, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the image display apparatus 100. [ Examples of events occurring in the video display device 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. A signal for notifying the occurrence of an event in the image display apparatus 100 may also be output through the display 180 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, A variety of tactile effects such as an effect of stimulation through the contact of the electrode (eletrode), an effect of stimulation by electrostatic force, and an effect of cold / warm reproduction using a device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 157 may include two or more haptic modules 157 according to the configuration of the image display device 100.

The memory 160 may store a program for processing and controlling the processor 170 and may have functions for temporarily storing input or output data (e.g., a phone book, a message, a still image, a moving picture, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > Also, the image display apparatus 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 125 serves as an interface with all the external devices connected to the video display device 100. Wireless data ports, a memory card, a SIM (Subscriber Identification Module) card, a UIM (User Identity Module) card, A card socket such as a card, an audio I / O (input / output) terminal, a video I / O (input / output) terminal and an earphone. The interface unit 125 receives data from the external device or receives power from the external device and transmits the data to each component in the image display device 100 so that data in the image display device 100 is transmitted to the external device .

The interface unit 125 may be a path through which power from the cradle connected to the image display apparatus 100 is supplied to the image display apparatus 100 when the image display apparatus 100 is connected to an external cradle, May be a path through which the image is displayed to the image display apparatus 100.

The processor 170 typically controls the operation of the respective parts to control the overall operation of the image display device 100. For example, voice communication, data communication, video communication, and the like. In addition, the processor 170 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware within the processor 170 or separately from the processor 170 in software. Meanwhile, the processor 170 may include an application processor (not shown) for driving an application. Or an application processor (not shown) may be provided separately from the processor 170.

The power supply unit 190 receives external power and internal power under the control of the processor 170 and supplies power necessary for operation of the respective components.

The image display apparatus 100 having such a configuration is configured to be operable in a communication system capable of transmitting data through a frame or a packet including a wired / wireless communication system and a satellite-based communication system .

Figure 3 is an example of an internal block diagram of the processor of Figure 2;

The processor 170 according to an exemplary embodiment of the present invention includes a demultiplexer 310, an image processor 320, a graphics processor 340, a mixer 345, a frame rate converter 350, and a formatter 360. An audio processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 130.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 325 can include a decoder of various standards. For example, a 3D image decoder for MPEG-2, H, and H.264 decoders, a color image and a depth image, and a decoder for a multi-view image may be provided.

The graphic processing unit 340 generates a graphic signal according to a user input or itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated graphic signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon. In addition, the generated graphic signal may include a 2D object or a 3D object.

The graphic processing unit 340 can generate a pointer that can be displayed on the display based on the pointing signal input from the remote control device 200. [ In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generating unit 240 may include such a pointing signal processing unit (not shown). Of course, a pointing signal processing unit (not shown) may be provided separately from the OSD generating unit 240.

The mixer 345 may mix the graphic signal generated by the graphic processing unit 340 and the decoded video signal processed by the image processing unit 320. The mixed video signal is supplied to a frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the frame rate without conversion.

The formatter 360 may arrange the left eye image frame and the right eye image frame of the frame rate-converted 3D image. Then, the left eye glass of the 3D viewing apparatus (not shown) and the synchronization signal Vsync for opening the right eye glass can be output.

On the other hand, the formatter 360 may convert the format of the input video signal into a video signal for display on a display and output the video signal.

In addition, the formatter 360 can change the format of the 3D video signal. For example, in various 3D formats such as Side by Side, Top / Down, Frame Sequential, Interlaced, and Checker Box formats, It can be changed to any one format.

Meanwhile, the formatter 360 may convert the 2D video signal into a 3D video signal. For example, according to a 3D image generation algorithm, an edge or a selectable object is detected in a 2D image signal, and an object or a selectable object according to the detected edge is separated into a 3D image signal and is generated . At this time, the generated 3D image signal can be separated into the left eye image signal L and the right eye image signal R, as described above.

Although not shown in the drawing, it is also possible that a 3D processor (not shown) for 3-dimensional effect signal processing is further disposed after the formatter 360. The 3D processor (not shown) can process the brightness, tint, and color of the image signal to improve the 3D effect. For example, it is possible to perform signal processing such as making the near field clear and the far field blurring. On the other hand, the functions of such a 3D processor can be merged into the formatter 360 or merged into the image processing unit 320. [

Meanwhile, the audio processing unit (not shown) in the processor 170 can perform the audio processing of the demultiplexed audio signal. To this end, the audio processing unit (not shown) may include various decoders.

In addition, an audio processing unit (not shown) in the processor 170 can process a base, a treble, a volume control, and the like.

The data processor (not shown) in the processor 170 may perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be electronic program guide information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

Meanwhile, a block diagram of the processor 170 shown in FIG. 3 is a block diagram for one embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the processor 170 that is actually implemented.

In particular, the frame rate conversion unit 350 and the formatter 360 are not provided in the processor 170, and may be separately provided, or may be separately provided as one module.

4A to 4B show various examples of the image processing apparatus provided in the image display apparatus of FIG.

4A, the image processing apparatus 410a includes a processor 170 for setting a frame rate for a graphic image frame, a graphics processor (e.g., a processor) 170 for rendering a current image frame according to a set frame resolution 340 and a scaler 355 for performing scaling on the rendered current image frame.

On the other hand, the image processing apparatus 410a may further include a memory 460 for storing a frame rate for a previous image frame.

Meanwhile, the graphic processing unit 340 outputs the rendered graphic image frame, and the display 180 can display the graphic image.

Referring to FIG. 4A, a processor 170, a graphics processing unit 340, a memory 460, and a scaler 355 may be separately provided in the image processing apparatus 410a.

On the other hand, the processor 170 can control to perform frame resolution variable, and sharpness processing, of the graphic image frame, based on the amount of change for the graphic image frame.

On the other hand, the processor 170 controls such that the larger the amount of change to the graphic image frame, the lower the frame resolution of the graphic image frame, the higher the sharpness, and the scaler 355 performs the upscaling. As a result, it is possible to improve the image quality deterioration while reducing power consumption in the processing of the graphic image.

In particular, the processor 170 outputs frame resolution variable information and a sharpness parameter for the graphic image frame, based on the amount of change for the graphic image frame, and the graphics processing unit 340 outputs the frame resolution variable information for the graphic image frame, Based on the information and the sharpness parameter, the frame resolution can be varied, and the sharpness-processed rendering of the current image frame can be performed.

Meanwhile, the processor 170 may calculate the amount of change for the graphic image frame based on at least one of object movement, texture change, or light change in the graphic data.

On the other hand, the processor 170 can calculate an object movement amount in the graphic data based on a motion view projection (Model View Projection and MVP) matrix. At this time, the objects in the graphic data may include a set of tree structures.

Next, referring to FIG. 4B, the image processing apparatus 410b of FIG. 4B is provided with a graphic processing unit 340 in the processor 170, which is distinguished from the image processing apparatus 410a of FIG. 4A. The operation in each unit is the same as that in Fig. 4A, and a description thereof will be omitted.

Next, referring to FIG. 4C, the image processing apparatus 410c of FIG. 4C is provided with a graphics processing unit 340 and a memory 460 in a processor 170, and distinguishes the image processing apparatus 410a of FIG. do. The operation in each unit is the same as that in Fig. 4A, and a description thereof will be omitted.

5 illustrates an example of an internal block diagram of an image processing apparatus according to an embodiment of the present invention.

5, the image processing apparatus 410 includes a processor 170 for setting a frame resolution for a graphic image frame, a graphics processor (not shown) for rendering a current image frame according to a set frame resolution 340 and a scaler 355 for performing scaling on the rendered current image frame.

On the other hand, based on the amount of change for the graphic image frame, it is possible to control the graphic image frame to perform frame resolution variable and sharpness processing. As a result, it is possible to improve the image quality deterioration while reducing power consumption in the processing of the graphic image.

On the other hand, the processor 170 includes an application section 171 for driving an application, a frame rate control section 173 for setting a frame rate for a graphic image frame, A variable dynamic rendering setting unit 179 and a GPU driver 174 for driving a graphics processing unit (GPU)

Meanwhile, the frame rate control unit 173 may be provided in a graphic library 172 in the processor 170.

On the other hand, the dynamic rendering setting unit 179 includes a change amount calculating unit 179a for calculating a change amount with respect to the graphic image frame, a resolution setting unit 179b for setting the resolution based on the amount of change with respect to the graphic image frame, And a sharpness parameter output unit 179c for outputting a sharpness parameter in accordance with the amount of change for the frame or the set resolution information.

Accordingly, the graphic processing unit 340 can perform a sharpness process, a variable frame resolution, and a graphic image frame according to the sharpness parameter and the set resolution information.

Meanwhile, the graphic processor 340 may include a frame renderer 341 for rendering a current image frame.

In particular, the frame renderer 341 can perform the frame resolution variable and sharpness processing of the graphic image frame according to the sharpness parameter and the set resolution information.

On the other hand, the processor 170 can control to perform frame resolution variable, and sharpness processing, of the graphic image frame, based on the amount of change for the graphic image frame.

On the other hand, the processor 170 controls such that the larger the amount of change to the graphic image frame, the lower the frame resolution of the graphic image frame, the higher the sharpness, and the scaler 355 performs the upscaling. As a result, it is possible to improve the image quality deterioration while reducing power consumption in the processing of the graphic image.

In particular, the processor 170 outputs frame resolution variable information and a sharpness parameter for the graphic image frame, based on the amount of change for the graphic image frame, and the graphics processing unit 340 outputs the frame resolution variable information for the graphic image frame, Based on the information and the sharpness parameter, the frame resolution can be varied, and the sharpness-processed rendering of the current image frame can be performed.

Meanwhile, the processor 170 may calculate the amount of change for the graphic image frame based on at least one of object movement, texture change, or light change in the graphic data.

On the other hand, the processor 170 can calculate an object movement amount in the graphic data based on a motion view projection (Model View Projection and MVP) matrix. At this time, the objects in the graphic data may include a set of tree structures.

Figs. 6 to 9C are drawings referred to for explanation of the image processing apparatus of Fig.

First, FIG. 6 illustrates a sequential graphical image frame.

Referring to the drawings, graphical image frames FR1 and FR2 are displayed, respectively, by graphical rendering in the normal mode without resolution adjustment at time T1 and T2 in Fig.

Next, at a time T3, it is illustrated that a graphic image frame FR3a whose resolution is lowered in the graphic processing unit 340 is output, and a graphic image frame FR3 which is upscaled by the scaler 355 is displayed.

On the other hand, in the graphic processing unit 340, if signal processing for sharpness is not performed separately, a blur may occur in an edge area in an image in the graphic image frame FR3 of T3.

At time T4 and T5, the graphic image frames FR4a and FR5a whose resolution is lowered and the sharpness signal processing is performed are output at the graphic processor 340, and the graphic image frames FR4a, FR5a) are displayed, respectively.

On the other hand, since the signal processing for sharpness is performed in the graphic processing unit 340, blur is not generated in the edge area of the image, and therefore image deterioration is reduced.

7 is a flowchart showing an operation method of the dynamic render setting unit of FIG.

First, the dynamic rendering setting unit 179 extracts an object in the current image frame (S710).

Next, the dynamic rendering setting unit 179 creates a bounding box data structure in the extracted object (S720).

Next, the change amount arithmetic operation unit 179a in the dynamic render setting unit 179 determines, based on a model view projection (MVP) matrix, a bounding box data structure, And the object movement amount in the graphic data is extracted (S732).

At this time, the object 800 in the graphic data may include a tree structure set as shown in FIG.

Next, the variation calculation unit 179a in the dynamic rendering setting unit 179 extracts a texture variation with respect to the previous graphic image frame with respect to the bounding box data structure (S733).

Next, the variation calculation unit 179a in the dynamic rendering setting unit 179 extracts a variation amount of light with respect to the previous graphic image frame with respect to the bounding box data structure (S734).

Next, the variation amount arithmetic unit 179a in the dynamic rendering setting unit 179 calculates a variation amount of the current graphic image frame (hereinafter referred to as a current graphic image frame) through a histogram, based on the extracted object moving amount, texture amount of change, (S740).

The variation calculation unit 179a in the dynamic rendering setting unit 179 may output a variation amount with respect to the current graphic image frame as compared with the previous graphic image frame.

Accordingly, the processor 170 can output the frame resolution variable information and the sharpness parameter for the graphic image frame, based on the amount of change for the graphic image frame.

The graphic processing unit 340 can perform rendering on the current image frame whose frame resolution is variable and sharpened based on the frame resolution variable information for the graphic image frame and the sharpness parameter.

Then, the scaler 355 can perform scaling according to the frame resolution variable. For example, if the frame resolution is low, the scaler 355 may perform up scaling.

Figures 9A-9C illustrate frame images displayed on a display.

First, FIG. 9A illustrates a graphical image 910 by graphical rendering in normal mode without resolution adjustment, such as graphical image frames FR1 and FR2 displayed at time T1 and T2 of FIG.

The graphical image 910 according to FIG. 9A does not generate blur in the edge areas 910a, 910b, and 910c, but performs rendering as it is without lowering the resolution, so that considerable power may be consumed.

Next, FIG. 9B illustrates a graphical image 920 in which the resolution is lowered and the upscaling is performed, such as the graphical image frame FR3 displayed at time T3 in FIG.

9B, the power consumption in the graphic processing unit 340 is reduced because the resolution is lowered and the upscaling is performed. However, in the graphics processing unit 340 or the like, signal processing for sharpness is performed separately Blur is generated in the edge areas 920a, 920b, and 920c.

Next, FIG. 9C shows a graphical image 930 in which the resolution is lowered, the sharpening process is performed, and the upscaling is performed, such as the graphic image frames FR4 and FR5 displayed at the time T4 and T5 in FIG. .

Since the graphic image 930 according to FIG. 9C is reduced in resolution, the sharpness process is performed, and the upscaling is performed, the power consumption in the graphic processing unit 340 is also reduced. Further, the edge areas 930a, 930b, The blur is also considerably reduced.

As a result, it is possible to improve the image quality deterioration while reducing power consumption in the processing of the graphic image.

Meanwhile, the operation method of the image processing apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (10)

A processor for setting a frame resolution for the graphic image frame;
A graphics processor for rendering a current image frame according to the set frame resolution;
And a scaler for performing scaling on the rendered current image frame,
The processor comprising:
And controls to perform frame resolution variable and sharpness processing of the graphic image frame based on the amount of change with respect to the graphic image frame. The method according to claim 1,
The processor comprising:
Wherein the control unit controls the frame resolution of the graphic image frame to be lower and the sharpness to be higher as the variation of the graphic image frame increases,
Wherein the scaler performs upscaling. The method according to claim 1,
The processor comprising:
And outputting frame resolution variable information and a sharpness parameter for the graphic image frame based on the amount of change with respect to the graphic image frame,
Wherein the graphic processing unit comprises:
Wherein the rendering unit performs rendering on the current image frame in which the frame resolution is variable and the sharpness is processed based on the frame resolution variable information for the graphic image frame and the sharpness parameter. The method according to claim 1,
The processor comprising:
And calculates a change amount for the graphic image frame based on at least one of object movement, texture change, or light change in the graphic data. 5. The method of claim 4,
The processor comprising:
And calculates an object movement amount in the graphic data based on a model view projection (MVP) matrix. 5. The method of claim 4,
Wherein the object in the graphic data comprises a set of tree structures. The method according to claim 1,
The processor comprising:
An application unit for driving an application;
A dynamic rendering setting unit that varies a frame resolution based on a variation amount of the graphic image frame;
And a driving unit for driving the graphic processing unit. 8. The method of claim 7,
Wherein the dynamic rendering setting unit comprises:
A change amount calculation unit for calculating a change amount for the graphic image frame;
A resolution setting unit configured to set a resolution based on a change amount of the graphic image frame; And
And a sharpness parameter output unit for outputting a sharpness parameter according to the amount of change or the set resolution information for the graphic image frame. 9. The method of claim 8,
Wherein the graphic processing unit comprises:
Wherein the image processing unit performs the frame resolution variable and the sharpness process of the graphic image frame according to the sharpness parameter and the set resolution information. A video display device comprising the image processing apparatus according to any one of claims 1 to 9.

Images