KR102271436B1 - Methof for removing image sticking in display device - Google Patents

Abstract

Disclosed is a method for removing an afterimage in a display device. A display device according to an embodiment of the present invention includes a display unit and a control unit, wherein the control unit executes an application for removing afterimages, controls the display unit to display a specific screen, and displays an afterimage area on the specific screen. , and adjusts the luminance of the display unit corresponding to the area around the detected afterimage area.

Description

How to remove an afterimage from a display device {METHOF FOR REMOVING IMAGE STICKING IN DISPLAY DEVICE}

The present invention relates to a display device and a method for removing an afterimage from the display device.

As a display device, a flat panel display such as a liquid crystal display (LCD), a plasma display panel (PDP), and an organic light emitting diode (OLED) display is mainly used.

In particular, recently, a display device including an OLED having advantages of high luminance and low power consumption and not having a separate backlight unit has been widely used. In particular, in the case of a display device including such an OLED, it is a key task to prevent the occurrence of a sticking afterimage.

1 is a view for explaining a problem of a display device including an OLED. FIG. 1A shows a TV 10 as an example of a display device, and FIG. 1B shows a mobile phone 20 as an example of a display device.

Referring to FIG. 1 , it can be seen that afterimages 11 and 22 appear on the screens of the display devices 10 and 20 , respectively. The afterimages 11 and 22 are generated due to deterioration of the OLED included in the display devices 10 and 20 and correspond to a fixed afterimage that cannot be removed unless the OLED is physically replaced. Although several algorithms have been introduced to prevent the occurrence of the afterimages 11 and 22, there is a problem in that it slows down the generation of the afterimage due to device degradation, but does not remove the generated afterimage.

SUMMARY OF THE INVENTION The present invention aims to solve the above and other problems. Another object of the present invention is to provide a method capable of removing an afterimage appearing on a screen of a display unit.

Another object of the present invention is to provide a method for removing an afterimage that enables a user to remove an afterimage appearing on a screen of a display unit while directly checking the user's eyes.

Another object of the present invention is to provide a method for removing an afterimage that allows receiving an image including an afterimage displayed on a screen of a display unit from another device and removing the afterimage using the image.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

A display device according to an embodiment of the present invention includes a display unit and a control unit, wherein the control unit executes an application for removing afterimages, controls the display unit to display a specific screen, and displays an afterimage area on the specific screen. , and adjusts the luminance of the display unit corresponding to the area around the detected afterimage area.

In addition, the display device according to an embodiment of the present invention includes a network interface unit capable of wireless communication with an external device, a display unit, and a control unit, and the control unit includes the network interface unit to connect wireless communication with a specific external device. control, execute an application for afterimage removal according to a preset condition, control the display unit to display a specific screen, and receive information related to an image corresponding to the specific screen from a specific external device to which the wireless communication is connected Controls the network interface unit, detects an afterimage area in the specific screen based on information related to the received image, and adjusts brightness of a display unit corresponding to a peripheral area of the detected afterimage area.

In addition, the display device according to an embodiment of the present invention includes a wireless communication unit capable of wireless communication with an external device, a camera, a display unit, and a control unit, wherein the control unit executes an application for removing an afterimage of the external device, Controls the wireless communication unit to connect a specific external device and wireless communication, activates the camera, and when a shooting command is detected, acquires an image using the activated camera, and transmits information related to the acquired image to the wireless The wireless communication unit is controlled to transmit the communication to a specific external device connected thereto.

According to at least one of the embodiments of the present invention, it is possible to provide a method for removing an afterimage that enables a user to remove the afterimage appearing on the screen of the display unit while directly checking the user's eyes.

In addition, according to at least one of the embodiments of the present invention, it is possible to provide a method for removing an afterimage that enables receiving an image including an afterimage displayed on the screen of the display unit from another device and removing the afterimage using the image. have.

Further scope of applicability of the present invention will become apparent from the following detailed description. However, it should be understood that the detailed description and specific embodiments such as preferred embodiments of the present invention are given by way of illustration only, since various changes and modifications within the spirit and scope of the present invention may be clearly understood by those skilled in the art.

1 is a view for explaining a problem of a display device including an OLED.
2 is a block diagram illustrating a mobile terminal as an example of a display device.
3 is a block diagram illustrating a multimedia device as another example of a display device.
4 is a block diagram illustrating a detailed configuration of the control unit of FIG. 3 according to an embodiment of the present invention.
5 is a diagram illustrating examples of a remote controller for controlling a multimedia device according to an embodiment of the present invention.
6 is a flowchart illustrating an example of a method of removing an afterimage from a display device according to an embodiment of the present invention.
7 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.
8 is a diagram for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.
9 is a diagram for explaining an example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.
10 is a diagram for explaining another example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.
11 is a diagram for explaining another example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.
12 is a diagram for explaining an example of a method of selecting a logo related to an afterimage displayed on a display unit in a multimedia device according to an embodiment of the present invention.
13 and 14 are diagrams for explaining an example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the multimedia device according to an embodiment of the present invention.
15 is a diagram for explaining another example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the multimedia device according to an embodiment of the present invention.
16 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.
17 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.
18 is a diagram for explaining an example of a method of selecting an indicator related to an afterimage displayed on a display unit in a mobile terminal according to an embodiment of the present invention.
19 is a diagram for explaining an example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the mobile terminal 100 according to an embodiment of the present invention.
FIG. 20 is a diagram for explaining another example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in a mobile terminal according to an embodiment of the present invention.
21 is a flowchart illustrating another example of a method of removing an afterimage from a display device according to an embodiment of the present invention.
22 and 23 are diagrams for explaining an example of a method of executing an afterimage removal application in a multimedia device according to an embodiment of the present invention.
24 is a diagram for explaining an example of a case in which an afterimage removal application is executed in a multimedia device as an example of a first display device according to an embodiment of the present invention.
25 is a diagram for explaining an example of a case in which an afterimage removal application is executed in a mobile terminal as an example of a second display device according to an embodiment of the present invention.
26 is a view for explaining an example of a screen output to the display unit when an application for removing an afterimage is executed in the mobile terminal according to an embodiment of the present invention.
27 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.
28 is a view for explaining an example of a screen output to the display unit when the afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.
29 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.
30 is a diagram for explaining an example of a guide message output to a display unit of a mobile terminal according to an embodiment of the present invention.
31 is a view for explaining an example of a screen output to a display unit of a multimedia device that is a target of afterimage removal when an application for afterimage removal is executed in a mobile terminal according to an embodiment of the present invention.
32 is a view for explaining an example of a screen output to the display unit of the mobile terminal when the screen of the multimedia device is photographed using the mobile terminal according to an embodiment of the present invention.
33 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.
34 is a diagram for explaining an example of a method for a user to select an afterimage area in a mobile terminal according to an embodiment of the present invention.
35 is a diagram for explaining an example of a method of selecting an afterimage area in a mobile terminal according to an embodiment of the present invention.
36 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.
37 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.
38 is a diagram for explaining an example of a method of transmitting image-related information from a mobile terminal to a multimedia device according to an embodiment of the present invention.
39 is a diagram for explaining an example of a screen output to a display unit of a multimedia device according to an embodiment of the present invention.
40 is a diagram for explaining an example of a method of removing an afterimage in a multimedia device according to an embodiment of the present invention.
41 is a view for explaining an example of a screen output to the display unit after the primary afterimage removal process is performed in the multimedia device according to an embodiment of the present invention.
42 is a diagram for explaining an example of a screen output to a display unit of a multimedia device according to an embodiment of the present invention.
43 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.
44 is a view for explaining an example of a screen output to the display unit after the afterimage removal process of the multimedia device is completed in the mobile terminal according to an embodiment of the present invention.
45 is a diagram illustrating an example of a screen output to the display unit of the first mobile terminal as an example of the first display device according to an embodiment of the present invention.
46 is a diagram illustrating an example of a screen output to a display unit of a second mobile terminal as an example of a second display device according to an embodiment of the present invention.
47 is a diagram illustrating an example of a screen output to a display unit of a second mobile terminal according to an embodiment of the present invention.
48 is a diagram for explaining an example of a method of removing an afterimage in the first mobile terminal according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "module" and "part" for the components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have a meaning or role distinct from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number, such as first, second, etc., may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as "comprises" or "have" are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The display device to be described in the present specification for removing the afterimage is a TV, smart TV, network TV, HBBTV (Hybrid Broadband Television), Internet TV, Web TV, IPTV (Internet Protocol) provided with a display unit including a light emitting element. Television), digital signage, desktop computer, mobile phone, smart phone, laptop computer, digital broadcasting terminal, PDA (personal digital assistants), PMP (portable multimedia player), navigation, slate PC (slate) PC), tablet PC, ultrabook, wearable device, for example, watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display), etc. can do. In addition, the display device may be implemented as a PDP, LCD, OLED, QD (quantum dot) display, QD LED display, or the like.

2 is a block diagram illustrating a mobile terminal as an example of a display device.

The mobile terminal 100 includes a wireless communication unit 110 , an input unit 120 , a sensing unit 140 , an output unit 150 , an interface unit 160 , a memory 170 , a control unit 180 , and a power supply unit 190 . and the like. The components shown in FIG. 2 are not essential for implementing the mobile terminal, so the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 among the components is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and the external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short-range communication module 114 , and a location information module 115 . .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 151 , a sound output unit 152 , a haptip module 153 , and an optical output unit 154 . can do. The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being formed integrally with the touch sensor. Such a touch screen may function as the user input unit 123 providing an input interface between the mobile terminal 100 and the user, and may provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100 . This interface unit 160, a wired / wireless headset port (port), an external charger port (port), a wired / wireless data port (port), a memory card (memory card) port, for connecting a device equipped with an identification module It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 160 , the mobile terminal 100 may perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100 . The memory 170 may store a plurality of application programs (application programs or applications) driven in the mobile terminal 100 , data for operation of the mobile terminal 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 100 . Meanwhile, the application program may be stored in the memory 170 , installed on the mobile terminal 100 , and driven to perform an operation (or function) of the mobile terminal by the controller 180 .

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 2 in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 with each other.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power to each component included in the mobile terminal 100 . The power supply 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate cooperatively with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170 .

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 as described above, the above-listed components will be described in more detail with reference to FIG. 2 .

First, referring to the wireless communication unit 110 , the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives a previously generated broadcast signal and/or broadcast-related information and transmits the received broadcast signal and/or broadcast-related information to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards (or broadcast methods, for example, ISO, IEC, DVB, ATSC, etc.) for transmitting and receiving digital broadcast signals, and the broadcast reception module 111 is configured to The digital broadcast signal may be received using a method suitable for technical standards set by technical standards.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112 .

The broadcast-related information may exist in various forms, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). A broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160 .

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced, etc.) transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed in accordance with the above.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100 . The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technologies, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112 .

The short-range communication module 114 is for short-range communication, and includes Bluetooth (BluetoothTM, RFID (Radio Frequency Identification), Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near). Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and at least one of Wireless USB (Wireless Universal Serial Bus) technologies may be used to support short-distance communication. , between the mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and another mobile terminal 100, or External servers) may support wireless communication between networks located in. The local area network may be wireless personal area networks.

Here, the other mobile terminal 100 is a wearable device capable of exchanging data (or interworking) with the mobile terminal 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass), HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 in the vicinity of the mobile terminal 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least a portion of data processed by the mobile terminal 100 to the short-range communication module ( 114) to transmit to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received in the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure as described above, various angles or focal points are applied to the mobile terminal 100 . A plurality of image information having a plurality of images may be input. Also, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or a running application program) being performed by the mobile terminal 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123 , the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . Such a user input unit 123 is a mechanical input means (or, a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. On the other hand, the virtual key or the visual key may be displayed on the touch screen while having various shapes, for example, a graphic, text ), an icon, a video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, functions, or operations related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or in the vicinity of the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) have. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor receives a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of a touch, an electrostatic capacitance at the time of a touch, etc. in which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, or the like.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a component separate from the controller 180 , or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different controls or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 100 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor are independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize location information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference between the time that the ultrasonic wave arrives using light as the reference signal.

On the other hand, the camera 121 as seen in the configuration of the input unit 120 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the movement of the sensing target close to the touch screen. More specifically, the photo sensor mounts photo diodes and transistors (TRs) in rows/columns and scans the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

In general, a 3D stereoscopic image consists of a left image (image for left eye) and a right image (image for right eye). Depending on the method in which the left and right images are merged into a 3D stereoscopic image, a top-down method in which the left and right images are arranged up and down in one frame, and the left and right images in one frame L-to-R (left-to-right, side by side) method, which arranges the pieces of the left and right images in a tile form, the checker board method, which arranges the left and right images in columns Alternatively, it is divided into an interlaced method in which a row is alternately arranged, and a time sequential (frame by frame) method in which a left image and a right image are displayed alternately by time.

In addition, the 3D thumbnail image may be generated as a single image by generating a left image thumbnail and a right image thumbnail from the left image and the right image of the original image frame, respectively, and combining them. In general, a thumbnail means a reduced image or a reduced still image. The generated left image thumbnail and right image thumbnail may be displayed with a left and right distance difference on the screen by a depth corresponding to the parallax between the left image and the right image, thereby representing a three-dimensional sense of space.

The left image and the right image necessary for realizing the 3D stereoscopic image may be displayed on the stereoscopic display unit by the stereoscopic processing unit. The stereoscopic processing unit receives a 3D image (an image of a reference view and an image of an extended view) and sets a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100 . The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by a user's selection or setting of the controller. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, an electrostatic force, etc. Various tactile effects can be generated, such as an effect caused by heat absorption and an effect by reproducing a feeling of cold and heat using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sensation such as a finger or arm. Two or more haptic modules 153 may be provided according to the configuration of the mobile terminal 100 .

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 100 . Examples of the event generated in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 100 , or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 160 .

On the other hand, the identification module is a chip storing various information for authenticating the usage right of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, the interface unit 160 is a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or is input from the cradle by a user. It may be a path through which various command signals are transmitted to the mobile terminal 100 . Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving image, etc.). The memory 170 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type (SSD), a silicon disk drive type (SDD), and a multimedia card micro type. ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the general operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice call, data communication, video call, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a plurality of the components described above by combining them.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

3 is a block diagram illustrating a multimedia device as another example of a display device.

The multimedia device 200 includes a receiving unit 210 , an external device interface unit 220 , a memory 230 , a display unit 240 , an audio output unit 250 , a power supply unit 260 , a control unit 270 , and a user. It may include an interface unit 280 and the like.

The receiver 210 may include at least one tuner 211 , a demodulator 212 , and a network interface unit 213 . However, in some cases, the receiver 210 may include the tuner 211 and the demodulator 212 , but may not include the network interface unit 213 , and vice versa. In addition, although not shown, the receiving unit 210 includes a multiplexer to multiplex the signal demodulated by the demodulator 212 through the tuner 211 and the signal received through the network interface unit 213 . You may. In addition, although not shown, the receiving unit 210 may include a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal that has passed through the network interface unit 213. .

The tuner 211 receives an RF broadcast signal by tuning a channel selected by a user or all channels stored in advance among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 211 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner 211 may process both a digital broadcast signal and an analog broadcast signal. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 211 may be directly input to the controller 270 .

Also, the tuner 211 may receive an RF broadcast signal of a single carrier or a multiple carrier. Meanwhile, the tuner 211 sequentially tunes and receives the RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna, and receives them as an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). frequency or baseband signal).

The demodulator 212 may receive and demodulate the digital IF signal DIF converted by the tuner 211 , and may perform channel decoding or the like. To this end, the demodulator 212 includes a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. - A Solomon decoder, etc. may be provided.

The demodulator 212 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal obtained by multiplexing an image signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 transport stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like are multiplexed.

The stream signal output from the demodulator 212 may be input to the controller 270 . The controller 270 may control demultiplexing, image/audio signal processing, and the like, and may control output of an image through the display unit 270 and audio through the audio output unit 250 .

The external device interface unit 220 provides an interface environment between the multimedia device 200 and various external devices. To this end, the external device interface unit 220 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

External device interface unit 220, DVD (Digital Versatile Disk), Blu-ray (Blu-ray), game device, camera, camcorder (Camcorder), computer (laptop), tablet PC, smart phone, Bluetooth device (Bluetooth) device) and an external device such as a cloud, and the like, may be connected via wired/wireless. The external device interface unit 220 transmits a signal including data such as an image, video, and voice input through a connected external device to the controller 270 of the multimedia device 200 . The controller 270 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 220 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), It may include a Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit may perform wireless communication with other digital devices. The multimedia device 100 is, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, Bluetooth (Bluetooth), RFID (Radio Frequency Identification), infrared communication (IrDA) , Infrared Data Association), UWB (Ultra Wideband), ZigBee, and DLNA (Digital Living Network Alliance) can be networked with other digital devices according to communication protocols.

Also, the external device interface unit 220 may be connected to the set-top-box (STB) and at least one of the above-described various terminals to perform input/output operations with the set-top-box (STB).

Meanwhile, the external device interface unit 220 may receive an application or an application list in an adjacent external device and transmit it to the controller 270 or the memory 230 .

The network interface unit 213 provides an interface for connecting the multimedia device 200 to a wired/wireless network including an Internet network. The network interface unit 213 may include, for example, an Ethernet (Ethernet) terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi- Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access, Bluetooth™), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB ( Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus), etc. are available.

The network interface unit 213 may transmit or receive data with another user or another digital device through the connected network or another network linked to the connected network. In particular, some content data stored in the multimedia device 200 may be transmitted to a selected user or a selected digital device among other users or other digital devices registered in advance in the multimedia device 200 .

Meanwhile, the network interface unit 213 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server. In addition, content or data provided by a content provider or network operator may be received. That is, it is possible to receive content such as a movie, advertisement, game, VOD, broadcast signal, etc. and information related thereto provided from the content provider or the network provider through the network. Also, it is possible to receive firmware update information and an update file provided by a network operator. It may also transmit data to the Internet or to a content provider or network operator.

Also, the network interface unit 213 may select and receive a desired application from among applications opened through a network.

The memory 230 may store a program for each signal processing and control in the controller 270 , or may store a signal-processed image, audio, or data signal.

Also, the memory 230 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 220 or the network interface unit 213 . The memory 230 may store information about a predetermined broadcast channel through a channel storage function.

The memory 230 may store an application or an application list input from the external device interface unit 220 or the network interface unit 213 .

In addition, the memory 230 may store various platforms to be described later.

The memory 230 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg, SD or XD memory). etc.), a RAM (RAM), and a ROM (EEPROM, etc.) may include at least one type of storage medium. The multimedia device 200 may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the memory 230 and provide them to the user. According to an embodiment, the memory 230 may be implemented by being included in the controller 270 .

The user interface unit 280 transmits a signal input by the user to the control unit 270 or transmits a signal of the control unit 270 to the user.

For example, the user interface unit 280 receives control signals such as power on/off, channel selection, and screen setting from the remote controller 300 according to various communication methods such as an RF communication method and an infrared (IR) communication method. Processing may be performed by receiving and processing, or transmitting a control signal of the controller 270 to the remote controller 300 .

Also, the user interface unit 280 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 270 .

The user interface unit 280 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 270, or transmits a signal of the control unit 270 to the sensing unit ( not shown) can be transmitted. Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The controller 270 demultiplexes a stream input through the tuner 211 , the demodulator 212 , or the external device interface 220 , or processes the demultiplexed signals to generate a signal for video or audio output. and output.

The image signal processed by the controller 270 may be input to the display unit 240 and displayed as an image corresponding to the image signal. Also, the image signal processed by the control unit 270 may be input to an external output device through the external device interface unit 220 .

The controller 270 may include a demultiplexer, an image processor, and the like.

The controller 270 may control the overall operation of the multimedia device 200 . For example, the controller 270 may control the tuner 211 to tune an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

The controller 270 may control the multimedia device 200 according to a user command input through the user interface unit 280 or an internal program. In particular, by accessing a network, a user can download a desired application or an application list into the multimedia device 200 .

For example, the controller 270 controls the tuner 211 to input a signal of a selected channel according to a predetermined channel selection command received through the user interface unit 280 . And it processes the video, audio or data signal of the selected channel. The control unit 270 allows the user-selected channel information to be output through the display unit 240 or the audio output unit 250 together with the processed image or audio signal.

As another example, the control unit 270 may control an external device input through the external device interface unit 220 according to an external device image reproduction command received through the user interface unit 280 , for example, a camera or camcorder. , so that an image signal or an audio signal can be output through the display unit 240 or the audio output unit 250 .

Meanwhile, the controller 270 may control the display 240 to display an image. For example, a broadcast image input through the tuner 211 , an external input image input through the external device interface unit 220 , an image input through the network interface unit 213 , or the memory 230 . The stored image may be controlled to be displayed on the display unit 240 . In this case, the image displayed on the display unit 240 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the controller 270 may control to reproduce the content. In this case, the content may be content stored in the multimedia device 200 , received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, when entering the application view item, the controller 270 may control to display an application or an application list downloadable from an internal or external network of the multimedia device 200 .

The controller 270 may control to install and drive an application downloaded from an external network along with various user interfaces. In addition, an image related to an executed application may be controlled to be displayed on the display unit 240 by a user's selection.

The display unit 240 converts the image signal, the data signal, the OSD signal processed by the controller 270, or the image signal and the data signal received from the external device interface unit 220 into R, G, and B signals, respectively. generate a drive signal.

The display unit 240 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

Meanwhile, the display unit 240 may be configured as a touch screen and used as an input device in addition to an output device.

The audio output unit 250 receives a signal processed by the control unit 270 , for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 250 may be implemented with various types of speakers.

Meanwhile, in order to detect the user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the multimedia device 200 . . The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 270 through the user interface unit 280 .

On the other hand, a photographing unit (not shown) for photographing the user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 270 .

The controller 270 may detect a user's gesture by individually or in combination with an image captured by a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

The power supply unit 260 supplies the corresponding power throughout the multimedia device 200 .

In particular, to supply power to the control unit 270 that can be implemented in the form of a system on chip (SoC), the display unit 240 for displaying an image, and the audio output unit 250 for outputting audio. can

To this end, the power supply unit 190 may include a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit 240 is implemented as a liquid crystal panel including a plurality of backlight lamps, an inverter capable of Pulse Width Modulation (PWM) operation for luminance variable or dimming driving (inverter) (not shown) may be further provided.

The remote controller 300 transmits a user input to the user interface unit 280 . To this end, the remote controller 300 may use Bluetooth (Bluetooth), Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the remote controller 300 may receive an image, audio or data signal output from the user interface unit 280 , and display it on the remote controller 300 or output voice or vibration.

The above-described multimedia device 200 may be a digital broadcast receiver capable of processing a digital broadcast signal of a fixed or mobile ATSC method or a DVB method.

In addition, the display device according to the present invention may omit some of the illustrated components as needed, or may further include non-illustrated components. Meanwhile, unlike the above, the display device does not include a tuner and a demodulator, and may receive and reproduce content through a network interface unit or an external device interface unit.

4 is a block diagram illustrating a detailed configuration of the control unit of FIG. 3 according to an embodiment of the present invention.

The controller 270 of the multimedia device 200 according to an embodiment of the present invention includes a demultiplexer 271 , an image processor 272 , an OSD generator 273 , a mixer 274 , and a frame rate. It may include a frame rate converter (FRC) 275 and a formatter 276 . In addition, although not shown, the control unit 270 may further include a voice processing unit and a data processing unit.

The demultiplexer 271 demultiplexes the input stream. For example, the demultiplexer 271 may demultiplex the input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 271 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit 272 performs image processing on the demultiplexed image signal. To this end, the image processing unit 272 may include an image decoder 272a and a scaler 272b.

The image decoder 272a decodes the demultiplexed image signal, and the scaler 272b scales the resolution of the decoded image signal to be output on the display unit.

The video decoder 272a may support various standards. For example, the video decoder 272a performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and when the video signal is encoded in the DMB (Digital Multimedia Broadcasting) method or the H.264 standard. In this case, the function of the H.264 decoder may be performed.

Meanwhile, the image signal decoded by the image processing unit 272 is input to the mixer 274 .

The OSD generator 273 generates OSD data according to a user input or by itself. For example, the OSD generating unit 155 generates data for displaying various data in the form of graphics or text on the screen of the display unit 240 based on the control signal of the user interface unit 280 . create The generated OSD data includes various data such as a user interface screen (eg, GUI) of the multimedia device 100, various menu screens, widgets, icons, and viewing rate information. do. The OSD generator 274 may generate data for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 274 mixes the OSD data generated by the OSD generator 155 and the image signal processed by the image processing unit and provides them to the formatter 276 . Since the decoded image signal and the OSD data are mixed, the OSD is overlaid and displayed on the broadcast image or the external input image.

The frame rate converter (FRC) 275 converts a frame rate of an input image. For example, the frame rate converter 275 may convert a frame rate of an input 60Hz image to have a frame rate of, for example, 120Hz or 240Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when the frame rate conversion unit 275 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or a second frame predicted from the first frame and the second frame is inserted. It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate converter 275 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when a separate frame conversion is not performed, the frame rate conversion unit 275 may be bypassed.

The formatter 276 changes the output of the input frame rate converter 275 to match the output format of the display unit. For example, the formatter 276 may output R, G, and B data signals, and these R, G, and B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. can be In addition, when the output of the input frame rate conversion unit 275 is a 3D video signal, the formatter 276 configures and outputs the 3D form in accordance with the output format of the display unit, thereby providing a 3D service through the display unit 240 . may support

Meanwhile, a voice processing unit (not shown) in the controller 270 may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing of various audio formats. As an example, even when the audio signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, it can be processed with a corresponding decoder.

Also, a voice processing unit (not shown) in the controller 270 may process a base, a treble, and a volume control.

A data processing unit (not shown) in the control unit 270 may perform data processing of the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program aired on each channel.

Meanwhile, the above-described multimedia device 200 is an example according to the present invention, and each component may be integrated, added, or omitted according to the specifications of the actually implemented display device. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, the function performed by each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

5 is a diagram illustrating examples of a remote controller for controlling a multimedia device according to an embodiment of the present invention.

In order to control the multimedia device 200 , a front panel (not shown) provided on the multimedia device 200 may be used or the remote controller 300 may be used.

The remote controller 300 is a user interface device (UID) capable of wired and wireless communication, and is mainly implemented for the purpose of controlling the multimedia device 200 . The remote controller 310 , the keyboard 330 , and the pointing device 320 . , a touch-pad, and the like may be included. In addition, although the purpose of controlling the multimedia device 200 is not, a mobile device such as a smart phone or a tablet PC capable of controlling the multimedia device 200 through mode switching may be included in the remote controller 300 .

The remote controller 300 includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA), RS, etc. It is possible to communicate with the multimedia device 200 by employing at least one or more communication protocols as needed.

The remote control 310 refers to a general input means provided with various key buttons necessary for controlling the multimedia device 200 .

The pointing device 320 is equipped with a gyro sensor to implement a pointer corresponding to the screen of the multimedia device 200 based on the user's movement, pressure, rotation, etc. ) to transmit a predetermined control command. The pointing device 320 may be named by various names, such as a magic remote control and a magic controller.

The keyboard 330, as the multimedia device 200 provides various services such as a web browser, an application, and a social network service (SNS) as an intelligent integrated digital device beyond the conventional broadcasting only, the control is possible only with the conventional remote control 310 It was not easy, so it was implemented to improve the convenience of inputting text, etc. by implementing it similar to a PC keyboard.

On the other hand, the remote controller 300 such as the remote controller 310, the pointing device 330, and the keyboard 320 is provided with a touchpad if necessary, so that text input, pointer movement, enlargement/reduction of pictures or videos, etc. are more convenient. and can be used for various control purposes.

Hereinafter, a method for removing an afterimage according to an embodiment of the present invention will be described with reference to FIGS. 6 to 48 .

6 is a flowchart illustrating an example of a method of removing an afterimage from a display device according to an embodiment of the present invention.

First, a case in which the display device is the mobile terminal 100 shown in FIG. 2 will be described as an example.

The controller 180 of the mobile terminal 100 executes an application for removing the afterimage (S401). When an afterimage is seen on the display unit 151 while the mobile terminal 100 is being used, the user may execute a menu for removing the afterimage.

The controller 180 displays the first screen for removing the afterimage on the display unit 151 (S402). The first screen may be a screen corresponding to the first wavelength range among the light of several wavelength ranges emitted from the display unit 151 . For example, the display unit 151 may include at least one of a blue light emitting device, a red light emitting device, and a green light emitting device, and includes at least one of a blue light emitting device, a red light emitting device, and a green light emitting device and a white light emitting device may be done by The afterimage removal process according to an embodiment of the present invention may be performed in a preset order for each of the R/G/B/W light emitting devices provided in the display unit 151 , or may be provided in the display unit 151 . It may be performed only for a light emitting device selected by a user among R/G/B/W light emitting devices. For example, when it is desired to remove the afterimage generated by the blue light emitting device, the controller 180 deactivates the light emitting devices emitting light of a different wavelength region and displays the first screen in which only the blue light emitting devices are activated. (151) can be output.

The controller 180 detects a first user command for selecting an afterimage area on the first screen (S403). The afterimage is generated because the area (eg, the light emitting device) of the display unit 151 does not exhibit its own luminance due to deterioration of the device, and the region corresponding to the deteriorated light emitting device on the first screen. An afterimage that can be perceived by the user may be seen. The first user command may correspond to a touch input through the touch screen when the display unit 151 is formed of a touch screen. The user may touch an area in which the afterimage appears on the first screen displayed on the display unit 151 .

For example, the afterimage displayed on the display unit 151 of the mobile terminal 100 is a first indicator indicating the reception sensitivity of a wireless signal displayed on a notification bar at the top of the screen, and a second indicator indicating the remaining battery capacity. , a third indicator indicating whether a wireless signal is being transmitted and received with an external server, a fourth indicator indicating whether the notification mode for notifying the occurrence of a specific event is a sound mode or a vibration mode, and a fifth indicator indicating a mobile operator, etc. or a sixth indicator indicating a menu for entering the main home screen displayed at the bottom of the screen, a seventh indicator indicating a menu for returning to the previous screen, and a menu for checking the history of applications used within a preset time It can correspond to the eighth indicator and the like.

According to an embodiment, the controller 180 may apply a correction algorithm or the like when the trajectory displayed on the display unit 151 is uneven by the first user command due to shaking of the user's hand or the like.

According to an embodiment, indicator-related information related to an indicator outputable to the display unit 151 may be stored in the memory 170 . Here, the indicator-related information may include at least one of first information regarding the shape of the indicator and second information related to a position where the indicator is displayed on the screen of the display unit 151 . Then, the controller 180 outputs a GUI including indicators corresponding to the indicator-related information stored in the memory 170 to the display unit 151, and the indicator-related information related to an indicator selected by a user command among the indicators. may be used to detect the afterimage area. Alternatively, according to an embodiment, logo related information related to a logo of a channel or a logo of a program that can be viewed through the mobile terminal 100 may be stored in the memory 170 , and the controller 180 may Logo related information related to the logo may be used to detect the afterimage area.

The controller 180 displays a first GUI for adjusting the luminance of the display unit 151 corresponding to the peripheral area of the afterimage area selected by the first user command on the display unit 151 (S404). Here, the display unit 151 corresponding to the peripheral area of the afterimage area may mean only the area of the display unit 151 corresponding to the boundary of the afterimage area, and a display corresponding to the peripheral area including the boundary of the afterimage area. It may also mean the area of the part 151 . The controller 180 detects the afterimage area generated on the display unit 151 based on the afterimage area selected by the first user command. Here, when the indicator selected by the user exists, the residual image region may be detected by referring to information related to the selected indicator together with the residual image region selected by the first user command. Then, the display unit 151 is controlled to display a first GUI for adjusting the luminance of the display unit 151 (eg, the luminance of the blue light emitting device) corresponding to the area around the detected afterimage area.

According to an embodiment, the first GUI may include an adjustment bar for adjusting the luminance of the display unit 151 corresponding to the peripheral area and an indicator movable on the adjustment bar. According to an embodiment, the first GUI may include a + menu icon and/or ? for adjusting the luminance of the display unit 151 corresponding to the surrounding area. It may also include a menu icon.

Alternatively, according to an embodiment, the first GUI includes a first menu for adjusting the luminance of the display unit 151 corresponding to the surrounding area to a preset first level and the display unit 151 corresponding to the surrounding area. It may include at least a second menu for adjusting the luminance of , to a second level lower than the first level.

The controller 180 adjusts the luminance of the display unit 151 corresponding to the surrounding area according to the second user command received through the first GUI (S405). The second user command may include a user command for moving an indicator included in the first GUI on a control bar, and include a + menu icon and/or ? It may include a user command for selecting a menu icon at least once, or a user command for selecting a first menu or a second menu included in the first GUI.

According to an embodiment, the controller 180 may adjust the luminance of the display unit 151 corresponding to a preset peripheral area of the detected afterimage area, and may adjust the luminance of the display unit 151 corresponding to the remaining area except for the detected afterimage area. The brightness of the display unit 151 may be adjusted. Here, the adjustment of the luminance of the display unit 151 means that the afterimage should not be recognized by the user's eyes, so the gain value so that the brightness of the display unit 151 corresponding to the area around the afterimage area is lower than the originally set level. may mean to control For example, the gain value may mean a value of average picture level (APL) data applied to the display unit 151 corresponding to the peripheral area of the afterimage area.

Then, the controller 180 maps the gain value to an area of the display unit 151 corresponding to a peripheral area of the afterimage area and stores it in the memory 170 .

The user may end the afterimage removal process or may re-perform the above-described steps for the second screen. The second screen may be a screen corresponding to the second wavelength range among light of various wavelength ranges emitted from the display unit 151 . For example, when the display unit 151 includes a light emitting device, the controller 180 disables the light emitting devices emitting light of a different wavelength region, and displays a second screen in which only the green light emitting devices are activated. 151) can be printed.

Meanwhile, a case in which the display device is the multimedia device 200 shown in FIG. 3 will be described as an example. The content overlapping with the above in relation to the case where the display device is the mobile terminal 100 will not be described again.

The controller 270 of the multimedia device 200 executes an application for removing the afterimage (S401). When an afterimage is seen on the display unit 240 while the multimedia device 200 is being used, the user may execute a menu for removing the afterimage.

The control unit 270 displays the first screen for removing the afterimage on the display unit 240 (S402). The first screen may be a screen corresponding to a first wavelength region among light of several wavelength regions emitted from the display unit 240 . For example, when the display unit 240 includes a light emitting device, the display unit 240 may include at least one of a blue light emitting device, a red light emitting device, and a green light emitting device, and a blue light emitting device and a red light emitting device. The device may include at least one of a green light emitting device and a white light emitting device. For example, when it is desired to remove the afterimage generated by the blue light emitting device, the controller 270 deactivates the light emitting devices emitting light of a different wavelength region and displays the first screen in which only the blue light emitting devices are activated. (240) can be output.

The controller 270 detects a first user command for selecting an afterimage area on the first screen (S403). The first user command may be transmitted from the remote controller 300 for controlling the multimedia device 200 . The user may select an afterimage area through a pointer corresponding to the movement of the remote controller 300 on the first screen displayed on the display unit 240 .

For example, the afterimage area displayed on the display unit 240 of the multimedia device 200 may correspond to a logo of a channel that can be viewed through the multimedia device 200 , a logo of a program transmitted through each channel, and the like.

According to an embodiment, logo related information related to a logo of a channel that can be viewed through the multimedia device 200 and a logo of a program transmitted through each channel may be stored in the memory 230 . Here, the logo-related information may include at least one of first information about the shape of the logo and second information related to a position where the logo is displayed on the screen of the display unit 240 . Then, the controller 180 outputs a GUI including logos corresponding to the logo-related information stored in the memory 230 to the display unit 240, and logo-related information related to a logo selected by a user command from among the logos. may be used to detect the afterimage area. Alternatively, according to an embodiment, indicator-related information related to an indicator outputable to the display unit 240 may be stored in the memory 230 . Here, the indicator outputable on the display unit 240 may mean an indicator displayed on the notification bar or menu bar at the top/bottom of the screen. The controller 270 may use indicator related information related to the indicator selected by the user to detect the afterimage area.

The controller 270 displays a first GUI for adjusting the luminance of the display unit 151 corresponding to the peripheral area of the afterimage area selected by the first user command on the display unit 240 (S404). Here, the display unit 240 corresponding to the peripheral area of the afterimage area may mean only the area of the display unit 240 corresponding to the boundary of the afterimage area, and a display corresponding to the peripheral area including the boundary of the afterimage area. It may also mean an area of the unit 240 . The controller 270 detects the afterimage area generated on the display unit 240 based on the afterimage area selected by the first user command. Here, when the logo selected by the user exists, the afterimage area may be detected by referring to information related to the selected logo together with the afterimage area selected by the first user command. Then, the display unit 240 is controlled to display a first GUI for adjusting the luminance of the display unit 240 corresponding to the area surrounding the detected afterimage area.

The controller 270 adjusts the luminance of the display unit 240 corresponding to the surrounding area according to the second user command received through the first GUI (S405). Then, the controller 270 maps the gain value to the display unit 240 corresponding to the peripheral region of the afterimage region and stores it in the memory 230 .

Hereinafter, an example of the afterimage removal method described above with reference to FIG. 6 will be described in detail with reference to FIGS. 7 to 16 , taking the case where the display device to be removed is the multimedia device 200 as an example. do.

7 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.

The controller 270 of the multimedia device 200 may execute an application for removing the afterimage and output the execution screen 410 to the display unit 240 . When an afterimage is seen on the display unit 240 while the multimedia device 200 is being used, the user may execute a menu for removing the afterimage.

In this embodiment, it is assumed that the display unit 240 includes a blue light emitting device, a red light emitting device, a green light emitting device, and a white light emitting device.

The afterimage removal process by the application for removing the afterimage may be performed in a preset order for each of the R/G/B/W light emitting devices included in the display unit 240 , or R included in the display unit 240 . It may be performed only for the light emitting device selected by the user among the /G/B/W light emitting devices. In this embodiment, it is assumed that the user performs the afterimage removal process only for the blue light emitting device and the green light emitting device.

8 is a diagram for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.

When the user selects the confirmation menu 411 on the execution screen 240 shown in FIG. 7 , the screen of FIG. 8 may be output on the display unit 240 . First, an afterimage removal process for the blue light emitting device will be described.

The controller 270 is configured to activate the first light emitting device (eg, a blue light emitting device) emitting light of a first wavelength region and a light emitting device (eg, G/R/ W light emitting device) may output the deactivated first screen 420 to the display unit 240 . In order to check the afterimage displayed by the first light emitting device, it is intended to check the first screen 420 when the first light emitting device is activated. In the present embodiment, it is assumed that an afterimage S of “LOGO” appears on the first screen 420 .

The controller 270 may control the display 240 to output a guide message 421 for selecting an afterimage area on the first screen 420 using the remote controller 300 . The user may select an afterimage area corresponding to the afterimage S by using the remote controller 300 .

9 is a diagram for explaining an example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.

Referring to FIG. 9 , a portion of the afterimage S displayed on the first screen 420 is enlarged.

The user may select the afterimage area using the pointer P corresponding to the movement of the remote controller 300 . For example, the afterimage area may be selected by allowing the pointer P to pass through the edge of the afterimage S while pressing a specific button provided in the remote controller 300 . According to an embodiment, a trajectory 421 corresponding to the movement of the pointer P may be displayed on a portion through which the pointer P passes while a specific button provided in the remote controller 300 is pressed. According to an embodiment, when the size of the afterimage S is too small to select the afterimage area using the remote controller 300 , the controller 270 may enlarge the display magnification of the first screen 420 . The display unit 240 may be controlled.

Alternatively, according to an embodiment, when the display magnification of the first screen 420 is enlarged, the controller 270 displays a grid pattern including several cells on the first screen 420 . The display unit 240 may be controlled. Each of the cells may correspond to each pixel of the image constituting the first screen 420 , or may correspond to two or four adjacent pixels among pixels of the image constituting the first screen 420 . A user can easily select an afterimage area by selecting a cell included in the grid pattern using the pointer P corresponding to the movement of the remote controller 300 .

Alternatively, according to an embodiment, when the display magnification of the first screen 420 is enlarged, the controller 270 enlarges a partial area of the first screen 420 including the point where the pointer P is located. to output the partially enlarged screen represented by this to the display unit 240 , and the partially enlarged screen may be overlaid and output on the first screen 420 in which the display magnification is not changed. Also, the position of the partially enlarged screen may be changed on the first screen 420 in response to the movement of the pointer P.

Alternatively, according to an embodiment, when the controller 270 enlarges the display magnification of the first screen 420 , the portion displayed by the enlarged first screen 420 on the display unit 240 has a display magnification. A graphic image for indicating which part of the entire part of the first screen 420 that has not been changed may be output to the display unit 240 . The graphic image may be overlaid on the display unit 240 and displayed on the enlarged first screen 420 and output.

10 is a diagram for explaining another example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.

Referring to FIG. 10 , a portion of the afterimage S displayed on the first screen 420 is enlarged.

The user may select the afterimage area using the pointer P corresponding to the movement of the remote controller 300 . However, in this case, it may be difficult to select the afterimage area to accurately reflect the actual afterimage S using the remote controller 300 due to shaking of the user's hand.

When the trajectory 421a displayed by the remote controller 300 is uneven as shown in (a) of FIG. 10 , the controller 270 applies a preset correction algorithm to the trajectory 421a in FIG. 10 . It can be corrected in the form of the trajectory 421b as shown in (b) of FIG. As an example, the control unit 270 may determine the user's intention to move the pointer P in a downward straight line based on the shape of the trajectory 421a, and a specific button provided in the remote controller 300 . A straight trajectory 421b linking the point at which the pointer P is positioned at the pressed point and the point at which the pointer P is positioned when the specific button is released may be output to the display unit 240 . .

11 is a diagram for explaining another example of a method of selecting an afterimage area using a remote controller in a multimedia device according to an embodiment of the present invention.

Referring to FIG. 11 , a portion of the afterimage S displayed on the first screen 420 is enlarged.

The user may select the afterimage area using the pointer P corresponding to the movement of the remote controller 300 . However, in this case, it may be difficult to select the afterimage area to accurately reflect the actual afterimage S using the remote controller 300 due to shaking of the user's hand.

The controller 270 may output a figure menu 430 that can be used by a user to the display unit 240 in order to make it easier to select an afterimage using the remote controller 300 . For example, in the figure menu 430 , a first menu 431 corresponding to a straight line, a second menu 432 corresponding to a curve, a third menu 433 corresponding to a rectangle, and a fourth menu corresponding to a circle are included. A menu 434 and the like may be included.

For example, the user may select the first menu 431 corresponding to a straight line by using the remote controller 300 , and in a state in which the first menu 431 is activated, The afterimage area may be selected using the corresponding pointer P.

As described above with reference to FIGS. 9 to 11 , when the user selects the afterimage area using the remote controller 300 and presses the OK button, the controller 270 may detect the afterimage area based on this.

Meanwhile, according to an embodiment of the present invention, the controller 270 may utilize information related to the logo selected by the user in detecting the afterimage area on the first screen 420 . This will be described with reference to FIG. 12 .

12 is a diagram for explaining an example of a method of selecting a logo related to an afterimage displayed on a display unit in a multimedia device according to an embodiment of the present invention.

The memory 230 of the multimedia device 200 may store logo-related information related to a logo of a channel that can be viewed through the multimedia device 200, a logo of a program transmitted through each channel, and the like. Here, the logo-related information may include at least one of first information about the shape of the logo and second information related to a position where the logo is displayed on the screen of the display unit 240 . The second information may include coordinate information for indicating where the logo is located on the screen of the display unit 240 . For example, the coordinate information may include accurate coordinate information for the entire region displayed as a logo, rather than information indicating in which region the logo is located on the screen of the display unit 240 .

In general, in the case of the same channel, the logo of a broadcasting station is displayed at the same position on the screen in most cases, and since this logo is expressed as a still image that does not move, the light emitting element of the display unit 240 on which the logo is displayed may be deteriorated. high portential. In addition, even in the case of the same program, since the logo of the program is displayed at the same position on the screen in most cases and the logo is also expressed as a still image that does not move, there is a risk of an afterimage due to deterioration of the corresponding light emitting device. Accordingly, logo related information related to a logo of a specific channel and logo related information related to a logo of a specific program are stored in the memory 230, and the controller 270 may use the stored logo related information to detect an afterimage area. .

Such logo-related information may be downloaded from an external server, and may be periodically or non-periodically updated. According to an embodiment, when logo-related information is included in EPG data in a broadcast signal, the controller 270 may parse the EPG data to obtain logo-related information.

The controller 270 may control the display 240 to display the GUI 440 including logos corresponding to logo-related information stored in the memory 230 . The GUI 440 may be output after the afterimage area is selected by the remote controller 300 as described above with reference to FIGS. 8 to 11 , or before the afterimage area is selected by the remote controller 300 . may be output, or may be output irrespective of the selection of the afterimage area by the remote controller 300 .

The GUI 440 may include a list of all logos corresponding to the logo-related information stored in the memory 230 , and if the afterimage area is selected by the remote controller 300 , the logo stored in the memory 230 . Among all logos corresponding to the related information, only a list of logos determined to be similar to the shape and location of the selected afterimage area may be included.

It is assumed that the user selects “LOGO” related to the afterimage S from among the logos included in the GUI 440 and selects the confirmation menu 441 . The control unit 270 may determine the shape of the “LOGO” and the location on the screen of the display unit 240 based on the logo-related information stored in the memory 230 .

For example, when the GUI 440 is output before or after the afterimage area is selected by the remote controller 300 as described above with reference to FIGS. 8 to 11 , the controller 270 controls the remote controller 300 . ), it is possible to more accurately detect the afterimage area corresponding to the afterimage S displayed on the first screen 420 based on the logo-related information stored in the memory 230 and the afterimage area selected by . According to an embodiment, before outputting the GUI 440 to the display unit 240 , the controller 270 detects an afterimage area based on the afterimage area selected by the remote controller 300 , and the detection A GUI including information on the residual image area may be output to the display unit 240 . For example, the information on the detected afterimage area may be information related to the detected afterimage area among the logo related information stored in the memory 230 , and may include characters, figures, It may be information corresponding to an icon, a logo, or the like. The GUI may include a guide message for the user to confirm whether the detected afterimage area matches the afterimage visible to the user. As another example, even when the GUI 440 is output without selecting an afterimage area by the remote controller 300 as described above with reference to FIGS. 8 to 11 , the controller 270 stores the memory 230 in the memory 230 . An afterimage area corresponding to the afterimage S displayed on the first screen 420 may be detected based on the stored logo related information.

13 and 14 are diagrams for explaining an example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the multimedia device according to an embodiment of the present invention.

Referring to FIG. 13 , when the afterimage area is detected, the controller 270 of the multimedia device 200 controls the luminance of the display unit 140 corresponding to the area surrounding the detected afterimage area (eg, The first GUI 450 for adjusting the brightness of the first light emitting device corresponding to the peripheral region of the detected afterimage region may be output to the display unit 240 .

For example, the first GUI 450 may include an adjustment bar 451 and an indicator 452 movable on the adjustment bar 451 to adjust the luminance of the first light emitting device corresponding to the peripheral area. have. When the indicator 452 moves to the right on the control bar 451 , the control unit 240 increases the luminance of the first light emitting device corresponding to the surrounding area, and the indicator 452 moves the control bar 451 to the right. When the image moves to the left, the luminance of the first light emitting device corresponding to the peripheral area may be reduced accordingly. Since the afterimage S is caused by the deterioration of the device, the corresponding light emitting device is unable to exert its luminance. to make it invisible. According to the embodiment, since the present embodiment is for removing the afterimage S, the indicator 452 moves on the adjustment bar 451 only in a direction for reducing the luminance of the first light emitting device corresponding to the peripheral area. To this end, the first GUI 450 may be implemented.

Referring to FIG. 14 , the user moves the indicator 452 on the control bar 451 until the afterimage S is no longer visible on the first screen 420 , so that the first light emitting device corresponding to the peripheral area You can adjust the luminance of

When the confirmation menu 453 in the first GUI 450 is selected, the control unit 270 sets a gain value corresponding to a point on the control bar 451 where the indicator 452 is located in the second corresponding to the peripheral area. 1 may be mapped to a light emitting device and stored in the memory 230 .

According to an embodiment, when the luminance of the display unit 240 selected by the first GUI 450 is lower than a preset level, the controller 270 provides the user with a screen of the display unit 240 corresponding to the afterimage area. You can also output a notification message (or warning message) that this may appear dark.

15 is a diagram for explaining another example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the multimedia device according to an embodiment of the present invention.

When the afterimage area is detected, the controller 270 of the multimedia device 100 is configured to control a luminance of the display unit 140 corresponding to a peripheral area of the detected afterimage area (eg, the detected afterimage area). The second GUI 460 for adjusting the luminance of the first light emitting device corresponding to the peripheral area of ? may be output to the display unit 240 .

For example, the second GUI 460 may include a first menu 461 for adjusting the luminance of the first light emitting device corresponding to the peripheral area to a preset first level, and to a second level lower than the first level. It may include a second menu 462 for adjusting and a third menu 463 for adjusting to a third level lower than the second level.

The control unit 270, the number of the afterimage removal process performed on the blue light emitting device so far, the time elapsed from the last afterimage removal process performed on the blue light emitting device until now, in the immediately preceding afterimage removal process performed on the blue light emitting device A gain value corresponding to each of the first level, the second level, and the third level may be determined in consideration of the applied gain value and the like. A gain value corresponding to each of the first level, the second level, and the third level may be different depending on the type of the light emitting device and when the afterimage removal process is performed.

If the user selects any one of the first menu 461, the second menu 462, and the third menu 463 and then selects the preview menu 464, the control unit 270 controls the menu corresponding to the selected menu. The luminance level of the first light emitting device corresponding to the peripheral area may be adjusted using the gain value, and a preview screen including the adjustment result may be output to the display unit 240 . The user decides which one of the first menu 461 , the second menu 462 , and the third menu 463 to finally select in consideration of the degree and presence of the afterimage S displayed on the preview screen. can When the user selects any one of the first menu 461 , the second menu 462 , and the third menu 463 and then selects the confirmation menu 465 , the controller 270 controls the gain corresponding to the selected menu. The value may be mapped to the first light emitting device corresponding to the peripheral area and stored in the memory 230 .

According to an exemplary embodiment, when the second menu 162 or the third menu 163 is selected through the second GUI 460 , the controller 270 provides the user with the display unit 240 corresponding to the afterimage area. It can also output a notification message (or warning message) that the screen may look dark.

16 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the multimedia device according to an embodiment of the present invention.

7, since the user has selected to perform the afterimage removal process for the blue light emitting device and the green light emitting device, as described above, after the afterimage removal process for the blue light emitting device is completed, the afterimage removal process for the green light emitting device may proceed. have.

The control unit 270 activates a second light emitting device (eg, a green light emitting device) emitting light of a second wavelength region and a light emitting device (eg, B/R/ W light emitting device) may output the deactivated second screen 470 to the display unit 240 . In the present embodiment, it is assumed that an afterimage S of “LOGO” appears on the second screen 470 .

The controller 270 may control the display 240 to output a guide message 471 for selecting an afterimage area on the second screen 470 using the remote controller 300 . The user may select an afterimage area corresponding to the afterimage S by using the remote controller 300 .

Since the subsequent process is the same as or similar to that described above with reference to FIGS. 9 to 15 , a detailed description thereof will be omitted.

Hereinafter, an example of the afterimage removal method described above with reference to FIG. 6 will be described in detail with reference to FIGS. 17 to 20 , taking the case where the display device to be removed is the mobile terminal 100 as an example. do. However, the content overlapping with the above in relation to FIGS. 7 to 16 will not be described in detail, and for the overlapping content, reference will be made to the above content.

17 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.

In the present embodiment, an afterimage removal process for the first light emitting device corresponding to the first wavelength range among the bladder devices emitting light of various wavelength ranges included in the display unit 151 will be described as an example.

The controller 180 of the mobile terminal 100 displays the first screen 510 in which the first light emitting device (eg, a blue light emitting device) is activated and the light emitting devices emitting light of other wavelength ranges are deactivated. It can output to the unit 151 . In the present embodiment, it is assumed that an afterimage T corresponding to an indicator indicating a menu for returning to a previous screen appears.

The controller 180 may control the display unit 151 to output a guide message 511 to select an afterimage area on the first screen 510 . The user may select an afterimage area corresponding to the afterimage T by touching the touch screen 151 . When the user touches the touch screen 151 to select the afterimage area, a trajectory corresponding to the touch input may be displayed on the display unit 151 . In some implementations, when the size of the afterimage T is small and it is difficult for the user to accurately touch the afterimage area with a hand, the controller 180 adjusts the display magnification of the first screen 510 according to a preset touch input. The display unit 151 may be controlled to enlarge. The controller 180 may detect the afterimage area displayed on the first screen 510 based on the afterimage area selected by the user's touch input.

Alternatively, according to an embodiment, when the display magnification of the first screen 510 is enlarged, the controller 180 displays a grid pattern including several cells on the first screen 510 . The display unit 151 may be controlled. Each of the cells may correspond to each pixel of the image constituting the first screen 510 or may correspond to two or four adjacent pixels among pixels of the image constituting the first screen 510 . A user may easily select an afterimage area by selecting a cell included in the grid pattern.

Alternatively, according to an embodiment, when the display magnification of the first screen 510 is enlarged, the controller 180 enlarges a partial area of the first screen 510 including the point where the pointer P is located. A partially enlarged screen represented by the 'A' may be output to the display unit 151, and the partially enlarged screen may be overlaid and output on the first screen 510 in which the display magnification is not changed. Also, the position of the partially enlarged screen may be changed on the first screen 510 in response to the movement of the pointer P.

Alternatively, according to an embodiment, when the controller 180 enlarges the display magnification of the first screen 510 , the portion displayed by the enlarged first screen 510 on the display unit 151 has a display magnification. A graphic image for indicating which part of the entire part of the first screen 510 that has not been changed may be output to the display unit 151 . The graphic image may be displayed on the display unit 151 by being overlaid on the enlarged portion of the first screen 510 and output. Of course, when the user selects the afterimage area, the same or similar contents described above with reference to FIGS.

Meanwhile, according to an embodiment of the present invention, the controller 180 may utilize information related to the indicator selected by the user in detecting the afterimage area on the first screen 510 . This will be described with reference to FIG. 18 .

18 is a diagram for explaining an example of a method of selecting an indicator related to an afterimage displayed on a display unit in a mobile terminal according to an embodiment of the present invention.

The memory 170 of the mobile terminal 100 may store indicator related information related to an indicator that can be output on the display unit 151 . Here, the indicator-related information may include at least one of first information regarding the shape of the indicator and second information related to a position where the indicator is displayed on the screen of the display unit 151 . The second information may include coordinate information for indicating where the indicator is located on the screen of the display unit 151 . For example, the coordinate information may include accurate coordinate information for the entire region displayed as the indicator, rather than information indicating in which region the indicator is located on the screen of the display unit 151 .

The indicator means a first indicator indicating the reception sensitivity of a wireless signal displayed on a notification bar at the top of the screen, a second indicator indicating the remaining battery capacity, and an external server and through which communication network the wireless signal is transmitted and received It may correspond to a third indicator indicating, a fourth indicator indicating whether the notification mode for notifying the occurrence of a specific event is a sound mode or a vibration mode, a fifth indicator indicating a mobile operator, etc., and entering the main home screen displayed at the bottom of the screen It may correspond to a sixth indicator indicating a menu for the user, a seventh indicator indicating a menu for returning to a previous screen, an eighth indicator corresponding to a menu for checking a history of applications used within a preset time, and the like.

In general, the same indicator may be displayed at the same position on the screen, and there is a high possibility that the light emitting device of the display unit 151 on which the indicator is displayed is deteriorated. Accordingly, indicator related information related to a specific indicator may be stored in the memory 170 , and the controller 180 may use the stored indicator related information to detect the afterimage area.

Such indicator-related information may be downloaded from an external server, and may be periodically or non-periodically updated.

In this embodiment, the case in which indicator-related information is stored in the memory 170 has been described as an example, but since the mobile terminal 100 may receive a broadcast signal, the logo-related information described above with respect to FIG. 12 is also stored in the memory ( 170) may be stored. In this case, the controller 180 may utilize logo related information corresponding to the logo selected by the user in detecting the afterimage area.

Similarly, in FIG. 12 , a case in which logo-related information is stored in the memory 230 of the multimedia device 200 has been described as an example, but indicator-related information corresponding to an indicator that can be output to the display unit 240 is also stored in the memory 230 . Of course, it may be stored. In this case, the controller 270 may utilize indicator-related information corresponding to the indicator selected by the user in detecting the afterimage area.

Referring back to FIG. 18 , the controller 180 may control the display unit 151 to display the GUI 520 including indicators corresponding to the indicator-related information stored in the memory 170 . As described above with reference to FIG. 17 , the GUI 520 may be output after the afterimage area is selected by the touch input, may be output before the afterimage area is selected by the touch input, or may be output by the touch input. It may be output irrespective of the selection of the afterimage area.

The GUI 520 may include a list of all indicators corresponding to the indicator-related information stored in the memory 170, and if the afterimage area is selected by a touch input, the indicator-related information stored in the memory 170 Among all the corresponding indicators, the selected afterimage area may include only a list of indicators determined to be similar in shape and location.

It is assumed that the user selects an indicator related to the afterimage T from among the indicators included in the GUI 520 and selects the confirmation menu 521 . The controller 180 may determine the shape of the selected indicator and the location on the screen of the display unit 151 based on the indicator-related information stored in the memory 170 .

For example, when the GUI 520 is output before or after the afterimage area is selected by the touch input as described above with reference to FIG. 17 , the controller 180 controls the afterimage area selected by the touch input and the memory Based on the indicator related information stored in 170 , the afterimage area corresponding to the afterimage T displayed on the first screen 510 may be more accurately detected. According to an embodiment, before outputting the GUI 520 to the display unit 151 , the controller 180 detects an afterimage area based on the afterimage area selected by a touch input, and the detected afterimage area A GUI including information on . . may be output to the display unit 151 . For example, the information on the detected afterimage area may be information related to the detected afterimage area among the logo related information stored in the memory 170 , and may include characters, figures, It may be information corresponding to an icon, an indicator, or the like. The GUI may include a guide message for the user to confirm whether the detected afterimage area matches the afterimage visible to the user.

As another example, even when the GUI 520 is output without selection of an afterimage area by a touch input as described above with reference to FIG. 17 , the controller 180 is based on the indicator-related information stored in the memory 170 . Thus, the afterimage area corresponding to the afterimage T displayed on the first screen 510 may be detected.

19 is a diagram for explaining an example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 19 , when the afterimage area is detected, the controller 180 of the mobile terminal 100 controls the first light emitting device to adjust the luminance of the first light emitting device corresponding to the area surrounding the detected afterimage area. The GUI 530 may be output to the display unit 151 .

For example, the first GUI 530 may include an adjustment bar 531 and an indicator 532 movable on the adjustment bar 531 to adjust the luminance of the first light emitting device corresponding to the peripheral area. have. When the indicator 532 moves to the right on the control bar 531 , the controller 180 increases the luminance of the first light emitting device corresponding to the peripheral region, and the indicator 532 moves the control bar 531 to the right. When the image moves to the left, the luminance of the first light emitting device corresponding to the peripheral area may be reduced accordingly.

The user may adjust the luminance of the first light emitting device corresponding to the peripheral area by moving the indicator 532 on the control bar 531 until the afterimage T is not visible on the first screen 510 . .

The controller 180 maps a gain value corresponding to a point on the control bar 451 at which the indicator 532 is finally positioned by the user with the first light emitting device corresponding to the peripheral area and stores it in the memory 170 . can

According to an embodiment, when the luminance of the display unit 151 selected by the first GUI 530 is lower than a preset level, the user is notified that the screen of the display unit 151 corresponding to the afterimage area may appear dark. A message (or warning message) can also be output.

FIG. 20 is a diagram for explaining another example of a GUI output to a display unit to remove an afterimage when an afterimage area is detected in a mobile terminal according to an embodiment of the present invention.

When the afterimage area is detected, the controller 180 of the mobile terminal 100 displays a second GUI 540 for adjusting the luminance of the first light emitting device corresponding to the area surrounding the detected afterimage area. It can output to the unit 151 .

For example, the second GUI 540 may include a first menu 541 for adjusting the luminance of the first light emitting device corresponding to the peripheral area to a preset first level, and to a second level lower than the first level. It may include a second menu 542 for adjusting and a third menu 543 for adjusting to a third level lower than the second level.

The controller 180 determines the number of afterimage removal processes performed on the blue light emitting device so far, the time elapsed from the last afterimage removal process performed on the blue light emitting device until now, and the immediately preceding afterimage removal process performed on the blue light emitting device. A gain value corresponding to each of the first level, the second level, and the third level may be determined in consideration of the applied gain value and the like. A gain value corresponding to each of the first level, the second level, and the third level may be different depending on the type of the light emitting device and when the afterimage removal process is performed.

When the user selects any one of the first menu 541, the second menu 542, and the third menu 543 and then selects the preview menu 544, the controller 180 controls the menu corresponding to the selected menu. The luminance level of the first light emitting device corresponding to the peripheral area may be adjusted using the gain value, and a preview screen including the adjustment result may be output to the display unit 151 . The user decides which one of the first menu 541 , the second menu 542 , and the third menu 543 to finally select in consideration of the degree and presence of the afterimage T displayed on the preview screen. can When the user selects any one of the first menu 541 , the second menu 542 , and the third menu 543 and then selects the confirmation menu 545 , the controller 180 controls the gain corresponding to the selected menu. The value may be mapped to the first light emitting device corresponding to the peripheral area and stored in the memory 230 .

According to an exemplary embodiment, when the second menu 542 or the third menu 543 is selected through the second GUI 540 , the controller 180 provides the user with the display unit 240 corresponding to the afterimage area. It can also output a notification message (or warning message) that the screen may look dark.

Similar to that described above with reference to FIGS. 17 to 20 , a user may also perform an afterimage removal process for light emitting devices corresponding to other wavelength ranges, and detailed description thereof will be omitted.

21 is a flowchart illustrating another example of a method of removing an afterimage from a display device according to an embodiment of the present invention. In FIG. 21 , a first display device is a device to be removed after an afterimage, and a second display device is an apparatus used to remove an afterimage of the first display device, which includes a camera and is interoperable with the first display device (eg, For example, it is assumed to be a paired or wirelessly connected device).

An application for removing the afterimage is executed on the first display device (S601). An execution screen of an application for removing an afterimage may be displayed on the display unit of the first display device. According to an embodiment, the application for removing the afterimage of the external device may be first executed in the second display device, and then the application for removing the afterimage may be executed also in the first display device according to a preset condition. The latter case will be described in more detail with reference to FIGS. 25 to 28 .

In the first display device, a first screen is displayed (S602). The first screen may be a screen corresponding to the first wavelength range among light of various wavelength ranges emitted from the display unit of the first display device. For example, the first display device may include at least one of a blue light emitting device, a red light emitting device, and a green light emitting device, and includes at least one of a blue light emitting device, a red light emitting device, and a green light emitting device and a white light emitting device may be done The afterimage removal process according to an embodiment of the present invention may be performed in a preset order for each of the R/G/B/W light emitting devices provided in the display unit of the first display device, and R provided in the display unit It may be performed only for the light emitting device selected by the user among the /G/B/W light emitting devices. For example, when it is desired to remove the afterimage generated by the blue light emitting device, the first display device deactivates the light emitting devices emitting light of a different wavelength region and displays the first screen in which only the blue light emitting devices are activated. can be printed on

According to an embodiment, when a preset signal transmitted from a second display device to which wireless communication is connected is detected, the first display device may execute an application for removing afterimages and output the first screen to the display unit .

The second display device activates the camera and acquires the first image by using the camera (S603). In this case, the first display device may output a guide message to the display unit to photograph the first screen using the camera of the second display device and to transmit the photographed image to the first display device.

For example, when the application for removing the afterimage is first executed on the first display device, the first display device discovers (searches) a device capable of wireless communication, and a device with a pre-connected history (second display device) ) or a first signal for connecting wireless communication for afterimage removal to a device (second display device) selected by the user from among the devices identified by the discovery. The second display device may receive the first signal, execute an afterimage removal application in response to the first signal, activate a camera, and display a preview image acquired by the camera on the display unit have.

As another example, when the application for removing the afterimage is first executed on the second display device, the second display device discovers a device capable of wireless communication, and has a pre-connected history (the first display device) or A second signal for connecting wireless communication for afterimage removal to a device (first display device) selected by the user among the devices identified by the discovery may be transmitted. The first display device may execute an afterimage removal application in response to the second signal and output the first screen to the display unit. In addition, the second display device may activate the camera and display the preview image acquired by the camera on the display unit.

According to an embodiment, when outputting the preview image, the second display device may output a guide message to photograph the first screen output to the first display device on the display unit.

Meanwhile, the first image may be an image including a first screen of the first display device, obtained by a camera of the second display device.

The second display device transmits information related to the first image acquired by the camera to the first display device (S604).

For example, the second display device outputs a first image to the display unit, detects a first signal for selecting a residual image region from the outputted first image, and receives information on the residual image region selected by the first signal. It may be included in the information related to the first image and transmitted to the first display device.

As another example, the second display device outputs a first image to the display unit, detects a second signal for selecting a logo and/or an indicator related to an afterimage included in the outputted first image, and the second signal Information about the logo and/or indicator selected by . may be included in the information related to the first image and transmitted to the first display device.

As another example, the second display device detects a region having a luminance less than or equal to a preset level in the first image, and includes luminance data of the detected region and the detected region in the first image. At least one of location data and shape data of the detected region in the first image may be included in information related to the first image and transmitted to the first display device.

According to the embodiment, an example in which the above three examples are combined is also possible.

The information related to the first image includes image data of an image corresponding to the first screen acquired by the camera of the second display device, a region estimated as an afterimage in the first image (eg, the selected region or the location data of the detected area), shape data of an area estimated as an afterimage in the first image (eg, the selected area or the detected area), and an area estimated as an afterimage in the first image (eg, It may include at least one of luminance data of the selected area or the detected area), data related to a logo of a specific channel, and data related to a specific indicator.

In addition, according to an embodiment, when the processing of predetermined image data is possible in the first display device, the first display device self-captures the first screen itself output to the first display device to obtain the first image may also be possible.

The first display device may receive the information related to the first image from the second display device, and may detect an afterimage area on the first screen based on the received information related to the first image (S605). The first display device is configured to detect a first area corresponding to the first screen from the first image based on image data of the first image included in information related to the first image, and from the detected first area A second area estimated to be an afterimage may be detected, and the afterimage area may be detected on the first screen based on a location (eg, relative location information) of the second area within the first area. In this case, the first display device may include location data of a region (eg, the selected region or the detected region) estimated to be an afterimage in the first image included in the information related to the first image, and the afterimage in the first image. At least one of shape data of a region estimated as ?, luminance data of a region estimated as an afterimage in the first image, data related to a logo of a specific channel, and data related to a specific indicator may be referred to.

Then, the first display device adjusts the luminance of the display unit corresponding to the peripheral area of the detected afterimage area (S606). That is, the first display device may adjust the luminance of the first light emitting device corresponding to the peripheral area of the detected afterimage area.

For example, the first display device may include, based on image data of the first image included in information related to the first image, a luminance of a display unit corresponding to the detected afterimage area in the first image and a periphery of the afterimage area. The luminance of the display unit corresponding to the area may be detected, and the luminance of the display unit corresponding to the peripheral area of the afterimage area may be adjusted so that a difference between the luminance corresponding to the afterimage area and the luminance of the peripheral area is reduced.

As another example, in the first display device, the difference between the luminance of the detected afterimage region and the luminance of the peripheral region is reduced based on luminance data of a region estimated as an afterimage included in the information related to the first image. The luminance of the display unit corresponding to the peripheral area of the detected afterimage area may be adjusted to do so.

In addition, the first display device may store a gain value used to adjust luminance of a display unit corresponding to the peripheral area in a memory.

Thereafter, the first display device may output the first screen in which the first light emitting device corresponding to the first wavelength region is activated again to the display unit. The user may check whether an afterimage remains on the re-output first screen, and if there is, perform steps S603 to 604 again to perform the afterimage removal process on the first light emitting device again. If there is no afterimage remaining on the re-output first screen, the user may terminate the afterimage removal application or proceed with the afterimage removal process for the light emitting device corresponding to a different wavelength region.

Hereinafter, an example of the afterimage removal method described above with reference to FIG. 21 when the first display device is the multimedia device 200 and the second display device is the mobile terminal 100 using FIGS. 22 to 44 will be described. It will be described in detail.

22 and 23 are diagrams for explaining an example of a method of executing an afterimage removal application in a multimedia device according to an embodiment of the present invention.

When a signal for executing the environment setting menu of the multimedia device 200 is sensed, the controller 270 of the multimedia device 200 outputs the GUI 700 as shown in FIG. 22 to the display unit 240 . can do. For example, the signal may be received from a remote controller or may be generated when a specific button provided on the exterior of the multimedia device 200 is selected.

The GUI 700 may include a menu list for setting an environment related to a predetermined function of the multimedia device 200 . For example, when the GUI 700 is displayed in response to the signal, the GUI 700 is a first menu list 710 for setting functions related to afterimage prevention/image/sound/network of the multimedia device 200 . ) may be included. When the afterimage prevention menu 711 in the first menu list 710 is selected, the controller 270 removes the afterimage generated on the display unit 240 or prevents the afterimage from occurring on the display unit 240 . A second menu list 720 for display may be included in the GUI 700 . For example, the second menu list 720 may be located on the right side of the first menu list 710 in the GUI 700 .

For example, when a signal for selecting the application menu 721 for removing the afterimage from the second menu list 720 is detected, the controller 270 may execute the application for removing the afterimage.

As another example, when a signal for selecting an application menu 721 for afterimage removal from among the second menu list 720 is detected, the controller 270 includes a third menu list 730 for detailed setting related to afterimage removal. ) may be included in the GUI 700 and displayed. For example, the third menu list 730 may be automatically generated using a menu 731 for removing an afterimage according to a user's manual selection in the multimedia device 200 itself and an external device interlocked with the multimedia device 200 . may include a menu 732 for removing the afterimage. According to an embodiment, the third menu list 730 may further include a menu 733 for setting a notification for removing the afterimage to the user. When a signal for selecting the menu 731 or the menu 732 from among the third menu list 730 is detected, the controller 270 executes an application for removing the afterimage and displays an execution screen related to the menu on the display unit. (240) can be output.

On the other hand, when a signal for selecting the menu 733 in the third menu list 730 is detected, the control unit 270 , as shown in FIG. 23 , is a fourth menu list for setting a notification for afterimage removal. 740 may be included in the GUI 700 and displayed. For example, the fourth menu list 740 may include a menu 741 for providing a notification to the user whenever a predetermined time elapses based on the actual viewing time of the multimedia device 200 and an afterimage removal application. A menu 742 for providing a notification to the user whenever a predetermined period elapses based on the elapsed date after the afterimage is removed may be included. When a signal for selecting the menu 741 from the fourth menu list 720 is detected, the control unit 270 sets to provide a notification for removing the afterimage to the user whenever a preset viewing time elapses, When a signal for selecting 742 is detected, it may be set to provide a notification for removing the afterimage to the user whenever a preset period has elapsed since afterimage removal was last performed. Each of the menus 741 and 742 includes edit icons 741a and 742b, and the user may edit the time or date, which is the basis of the notification period, by selecting the respective edit icons 741a and 742b.

24 is a diagram for explaining an example of a case in which an afterimage removal application is executed in a multimedia device as an example of a first display device according to an embodiment of the present invention.

In the present embodiment, it is assumed that the afterimage removal process is performed with respect to the first light emitting device (eg, blue light emitting device) corresponding to the first wavelength region, but as described above with reference to FIG. 7 , the display unit For each of the light emitting devices (eg, R/G/B/W light emitting devices) corresponding to the predetermined wavelength region included in 240 , an afterimage removal process is performed in a preset order or included in the display unit 240 . Of course, the afterimage removal process may be performed on a light emitting device selected by a user from among the light emitting devices (eg, R/G/B/W light emitting devices) corresponding to the predetermined wavelength region.

The controller 270 of the multimedia device 200 executes the afterimage removal application and outputs the first screen 810 to the display unit 240 . Of course, the screen 410 as described above with reference to FIG. 7 may be output to the display unit 240 before the first screen 810 . In the first screen 810 , the first light emitting devices corresponding to the first wavelength region included in the display unit 240 are activated and the light emitting devices corresponding to other wavelength regions included in the display unit 240 are deactivated. It could be a screen. In the present embodiment, it is assumed that an afterimage S of “LOGO” appears on the first screen 810 .

For example, when a command for executing the afterimage removal application is detected, the controller 270 may execute the afterimage removal application and output the first screen 810 to the display unit 240 . In this case, the controller 270 searches for an external device capable of wireless communication with the multimedia device 200 , and provides a device with a pre-connected history (mobile terminal 100 ) or a user among the devices identified by the search. A first signal for connecting wireless communication for afterimage removal to the selected device (mobile terminal 100 ) may be transmitted. According to an embodiment, the controller 270 uses the mobile terminal 100 interlocked with the multimedia device 200 to photograph the first screen 810 and a guide message to transmit the captured image to the multimedia device 200 . 811 may be output to the display unit 240 . Also, according to an embodiment, when the first signal is received from the multimedia device 200 , the controller 180 of the mobile terminal 100 automatically executes an application for removing the afterimage installed in the mobile terminal 100 . may be

As another example, when a second signal for connecting wireless communication for afterimage removal is received from an external device (mobile terminal 100 ), the controller 270 executes an afterimage removal application and performs the first screen 810 . may be output to the display unit 240 . The controller 270 may control the network interface unit 213 to connect the mobile terminal 100 and wireless communication in response to the second signal. In addition, the control unit 270 uses the mobile terminal 100 interlocked with the multimedia device 200 to photograph the first screen 810 , and a guide message 811 to transmit the captured image to the multimedia device 200 . ) may be output to the display unit 240 .

25 is a diagram for explaining an example of a case in which an afterimage removal application is executed in a mobile terminal as an example of a second display device according to an embodiment of the present invention.

According to an embodiment of the present invention, an application for removing an afterimage may be installed in the mobile terminal 100 . When the mobile terminal 100 is the first display device that is the target of the afterimage removal, the user can remove the afterimage formed on the display unit 151 of the mobile terminal 100 by using the application for removing the afterimage, When the mobile terminal 100 is the second display device used to remove the afterimage of the first display device, the user may remove the afterimage of the first display device by using an application for removing the afterimage.

On a home screen of the mobile terminal 100 or a menu screen in which icons of applications installed in the mobile terminal 100 are listed, an icon 900 of an application for removing afterimages is displayed. By selecting the icon 900 on the screen of the mobile terminal 100 , the user may execute an application for removing the afterimage.

According to an embodiment, when an application for removing an afterimage is first executed in the multimedia device 200 , and accordingly, a first signal for connecting wireless communication is transmitted from the multimedia device 200 to the mobile terminal 100 , the mobile terminal The controller 180 of 100 may control the wireless communication unit 110 to connect wireless communication with the multimedia device 200 in response to the first signal, and automatically execute an application for removing the afterimage.

26 is a view for explaining an example of a screen output to the display unit when an application for afterimage removal is executed in the mobile terminal according to an embodiment of the present invention.

When the application for removing the afterimage is executed, the controller 180 of the mobile terminal 100 may output the execution screen 1000 as shown in FIG. 26 to the display unit 151 . Depending on the embodiment, the execution screen 1000 may not be output. In particular, when the screen 410 as shown in FIG. 7 is output from the multimedia device 200 , the mobile terminal 100 may not output the execution screen 1000 . may be omitted.

The execution screen 1000 may be a screen for selecting a type of light emitting device to perform an afterimage removal process in the multimedia device 200 to be a target of afterimage removal using the mobile terminal 100 . Since the execution screen 100 is similar to the execution screen 410 described above with reference to FIG. 7 , a detailed description thereof will be omitted.

According to an embodiment, when the execution screen 1000 is output to the display unit 151 after wireless communication is connected between the multimedia device 200 and the mobile terminal 100 , the multimedia device 200 may display its own display unit. Information related to the light emitting device included in 240 may be transmitted to the mobile terminal 100 , and the control unit 180 of the mobile terminal 100 is based on the information related to the light emitting device transmitted from the multimedia device 200 . , the execution screen 1000 may be configured.

27 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.

When the application for removing the afterimage is executed, the controller 180 of the mobile terminal 100 controls the wireless communication unit 110 to search for an external device capable of wireless communication connection. According to an exemplary embodiment, the controller 180 may output a notification message 1110 to the display unit 151 to notify the user that an external device capable of wireless communication connection is being searched for afterimage removal.

The search for an external device capable of wireless communication connection of the mobile terminal 100 may be performed when the icon 900 corresponding to the application for afterimage removal is selected as described above with reference to FIG. 25 , and related to FIG. Therefore, it may be performed when a confirmation menu is selected after selecting the type of light emitting device for which afterimage removal is desired on the execution screen 1000 as described above. According to an embodiment, when the afterimage removal application is first executed in the multimedia device 200 and the application for removing the afterimage is executed in the mobile terminal 100 by a signal for wireless communication connection transmitted from the multimedia device 200 . , the search for an external device capable of wireless communication connection and output of the notification message 1110 may be omitted.

28 is a view for explaining an example of a screen output to the display unit when the afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.

When the application for removing the afterimage is executed, the controller 180 of the mobile terminal 100 controls the wireless communication unit 110 to connect wireless communication with a specific external device. According to an embodiment, the controller 180 may output a notification message 1120 for notifying the user that wireless communication with a specific external device is being connected to the display unit 151 .

When a specific external device having a history of wireless communication with the mobile terminal 100 exists, the controller 180 is configured to control the user select a specific external device from among the external devices searched as described above with reference to FIG. 27 . , or when the afterimage removal application is first executed in a specific external device and a signal for wireless communication connection transmitted from the specific external device is detected, the wireless communication unit 110 can be controlled to connect the wireless communication with the specific external device. have.

29 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.

When the application for removing the afterimage is executed, the controller 180 of the mobile terminal 100 activates the camera 121 and displays the preview image 1200 obtained by the camera 121 on the display unit 151 . can be printed out.

For example, as described above with reference to FIG. 25 , when the icon 900 corresponding to the application for removing the afterimage is selected, the controller 180 activates the camera 121 and The preview image 1200 may be output to the display unit 151 . Then, thereafter, the process as described above with reference to FIGS. 27 and 28 may be performed.

As another example, when the process described above with reference to FIGS. 27 and 28 is performed, the controller 180 activates the camera 121 and displays the preview image 1200 obtained by the camera 121 . It may be output to the display unit 151 .

According to an embodiment, the controller 180 may activate the camera 121 according to a user command for selecting an icon corresponding to the camera 121 in the screen of the mobile terminal 100 without selecting an application for removing the afterimage. may be

The user may obtain the first image by selecting the shooting menu 1210 after adjusting the position of the mobile terminal 100 so that the display unit 240 of the multimedia device 200 is located in the preview image 1200 . . The obtained first image may be transmitted to the multimedia device 200 and used to detect an afterimage area included in the display unit 240 of the multimedia device 200 . In order to accurately detect the afterimage area to match the actual afterimage S, it is preferable that the display unit 240 of the multimedia device 200 be positioned without distortion in the first image. To this end, on the display unit 151 of the mobile terminal 100 , a guide message guiding a correct method of taking a picture of the first screen 810 may be output. This will be described with reference to FIG. 30 .

30 is a diagram for explaining an example of a guide message output to a display unit of a mobile terminal according to an embodiment of the present invention.

The control unit 180 of the mobile terminal 100 transmits a guide message 1220 for guiding a correct method of taking a picture of the first screen 810 output to the display unit 240 of the multimedia device 200 to the display unit ( 151) can also be printed. The guide message 1220 may be displayed on the preview image 1200 of FIG. 29 or displayed before the preview image 1200 is output.

31 is a view for explaining an example of a screen output to a display unit of a multimedia device that is a target of afterimage removal when an application for afterimage removal is executed in a mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 connects a signal for wireless communication with a specific external device (ie, the multimedia device 200 ) to the multimedia device 200 when the application for removing the afterimage is executed. The wireless communication unit 110 may be controlled. The specific external device is, as described above with reference to FIG. 29 , a device having a history of wireless communication connection with the mobile terminal 100 or selected by a user from among external devices searched as described above with reference to FIG. 27 . It may be a device.

The control unit 270 of the multimedia device 200 controls the network interface unit 213 to connect wireless communication with the mobile terminal 100 in response to a signal for wireless communication connection transmitted from the mobile terminal 100, The first screen 810 may be output to the display unit 240 .

The first screen 810 may be a screen in which a light emitting device corresponding to an arbitrary wavelength region among the light emitting devices included in the display unit 240 is activated. According to an embodiment, as described above with reference to FIG. 26 , the type of the light emitting device to be performed the afterimage removal process is selected by the user, and information related to the selected light emitting device is transmitted from the mobile terminal 100 to the multimedia device 200 . is received, the controller 270 of the multimedia device 200 activates a light emitting device corresponding to a predetermined wavelength region among the light emitting devices included in the display unit 240 based on the received information related to the light emitting device. The displayed first screen 810 may be output to the display unit 240 .

Hereinafter, examples of a process of photographing the screen of the multimedia device 200 using the mobile terminal 100 and transmitting the captured image to the multimedia device 200 will be described in detail with reference to FIGS. 32 to 38 . decide to do

32 is a view for explaining an example of a screen output to the display unit of the mobile terminal when the screen of the multimedia device is photographed using the mobile terminal according to an embodiment of the present invention.

As described above with reference to FIG. 29 , the user selects the shooting menu 1210 after adjusting the position of the mobile terminal 100 so that the display unit 240 of the multimedia device 200 is located in the preview image 1200 . By selecting, the first image 1300 may be obtained.

Referring to FIG. 32 , the controller 180 of the mobile terminal 100 may output the acquired first image 1300 to the display unit 151 .

According to an embodiment, the controller 180 may detect a region corresponding to the display unit 240 of the multimedia device 200 in the first image 1300 . For example, the controller 180 corresponds to the display unit of the display device, which is a target of the afterimage removal from the image acquired through the camera 121 to remove the afterimage by using a contour detection algorithm stored in the memory 170 , etc. area can be detected.

The controller 180 detects an area corresponding to the display unit 151 of the multimedia device 200 in the first image 1300 and displays an indicator 1311 indicating the detected area on the display unit 151 ) can be printed. According to the embodiment, the user adjusts the size of the indicator 1311 by touching an arbitrary point of the indicator 1311 and dragging in and out, or by touching and dragging an arbitrary point of the indicator 1311, the indicator ( 1311) can be adjusted. Accordingly, when the area detected by the controller 180 does not match the area corresponding to the display unit 151 of the multimedia device 200 included in the actual first image 1300 , the user receives the indicator 1311 . ) may be adjusted to match an area corresponding to the display unit 151 of the multimedia device 200 included in the actual first image 1300 .

Alternatively, according to an embodiment, the controller 180 sets the indicator 1311 in the first image ( 1300 ) without detecting a region corresponding to the display unit 240 of the multimedia device 200 in the first image 1300 . The display unit 151 may be controlled to output to a predetermined area on the 1300 . Then, the user touches an arbitrary point of the indicator 1311 so that the indicator 1311 matches an area corresponding to the display unit 151 of the multimedia device 200 included in the actual first image 1300 . The size of the indicator 1311 may be adjusted by dragging in and out, or the position of the indicator 1311 may be adjusted by touching and dragging an arbitrary point of the indicator 1311 .

The controller 180 may store or temporarily store information about an area corresponding to the display unit 240 of the multimedia device 200 of the first image 1300 in the memory 170 .

When transmitting information related to the first image 1300 to the multimedia device 200 , as will be described later with reference to FIG. 38 , the controller 180 is a display unit of the multimedia device 200 among the first image 1300 . By transmitting information on the area corresponding to 240 to the multimedia device 200 , it may contribute to increasing accuracy in removing the afterimage from the multimedia device 200 .

Alternatively, according to an embodiment, the controller 180 outputs only the area finally selected by the indicator 1311 from among the first image 1300 to the display unit 151, and as will be described later with reference to FIG. When information related to one image 1300 is transmitted to the multimedia device 200, information related to the area finally selected by the indicator 1311 from among the first image 1300 is transmitted to the multimedia device 200 by transmitting the information to the multimedia device ( 200) may contribute to increasing the accuracy in removing the afterimage.

Meanwhile, according to an embodiment of the present invention, the user may directly select the afterimage area from the acquired first image 1300 . This will be described with reference to FIGS. 33 and 34 .

33 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 may output the first image 1300 acquired by the camera 121 to the display unit 151 . The first image 1300 may be a camera 121 photographing the first screen 610 output to the display unit 240 of the multimedia device 200 as described above, and according to an embodiment, FIG. As described above with reference to 32 , it may mean an area finally selected by the indicator 1311 from among the first images 1300 acquired by the camera 121 .

The first image 1300 acquired by the camera 121 may be transmitted to the multimedia device 200 and used to remove an afterimage of the display unit 240 of the multimedia device 200 . In this case, before the first image 1300 is transmitted from the mobile terminal 100 to the multimedia device 200 , the user may directly select an afterimage area from the first image 1300 .

According to an embodiment, the controller 180 may output a guide message 1400 to select an afterimage area from the captured image on the display unit 151 . The guide message 1400 may be output on the first image 1300 .

34 is a diagram for explaining an example of a method for a user to select an afterimage area in a mobile terminal according to an embodiment of the present invention.

When the confirmation menu 1410 in the guide message 1400 described above with reference to FIG. 33 is selected, the screen shown in FIG. 34 may be output to the display unit 151 .

The controller 180 of the mobile terminal 100 may output the first image 1300 to the display unit 151 and detect a signal (user command) for selecting the afterimage area in the first image 1300 . . For example, the user command may be a touch input received through the touch screen 151 .

According to an embodiment, when it is difficult to select an afterimage area because the size of the afterimage S included in the first image 1300 is small, the user enlarges the size by zooming the first image 1300 and then the afterimage area can also be selected. Since the selection of the afterimage area by the touch input is similar to that described above with reference to FIG. 17 , a detailed description thereof will be omitted.

When the selection of the afterimage area is completed, the controller 180 may store or temporarily store information on the selected afterimage area in the memory 170 .

Meanwhile, according to an embodiment of the present invention, the controller 180 of the mobile terminal 100 may analyze the acquired first image 1300 to detect the afterimage area. This will be described with reference to FIGS. 35 and 36 .

35 is a diagram for explaining an example of a method of selecting an afterimage area in a mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 may output the first image 1300 acquired by the camera 121 to the display unit 151 . The first image 1300 may be a camera 121 photographing the first screen 610 output to the display unit 240 of the multimedia device 200 as described above, and according to an embodiment, FIG. As described above with reference to 32 , it may mean an area finally selected by the indicator 1311 from among the first images 1300 acquired by the camera 121 .

The first image 1300 acquired by the camera 121 may be transmitted to the multimedia device 200 and used to remove an afterimage of the display unit 240 of the multimedia device 200 . In this case, before the first image 1300 is transmitted from the mobile terminal 100 to the multimedia device 200 , the controller 180 may detect an afterimage area included in the first image 1300 . That is, the controller 180 may detect a region estimated to be the afterimage S in the first image 1300 .

According to an embodiment, when the user directly selects the afterimage area from the first image 1300 as described above with reference to FIG. 34 , the controller 180 may not detect the afterimage area, and the user Even if the afterimage area is directly selected from the image 1300 , the afterimage area may be detected to increase the accuracy of afterimage removal, and the afterimage area can be detected regardless of whether the user directly selects the afterimage area from the first image 1300 . may be Alternatively, according to an embodiment, when the user directly selects the afterimage area from the first image 1300 as described above with reference to FIG. 34 , the controller 180 may be configured based on the information on the afterimage area selected by the user. The afterimage area may be detected in the first image 1300 .

For example, the controller 180 analyzes the luminance of the first image 1300 to detect a first region having a luminance equal to or less than a preset level in the first image 1300 , and the detected first region When the difference in luminance between the first area and the peripheral area of the first area is equal to or greater than a preset level, the first area may be detected as an afterimage area. The controller 180 may store or temporarily store the information on the first region in the memory 170 . For example, the information about the first region may include at least one of luminance data of the first region, position data where the first region is located in the first image 1300 , and shape data of the first region. have.

According to an embodiment, after detecting the afterimage area in the first image 1300 , the controller 180 may output a guide message allowing the user to check the detected afterimage area. This will be described with reference to FIG. 36 .

36 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.

As described above with reference to FIG. 35 , the controller 180 detects the afterimage area in the first image 1300 and displays a guide message 1600 for allowing the user to check the detected afterimage area on the display unit. (151) can be output. According to an embodiment, the controller 180 may output an outline, an arrow, and/or an indicator indicating the detected afterimage area on the first image 1300 .

For example, the user may directly correct at least a part of the afterimage area detected by the controller 180 by selecting the correction menu 1610 in the guide message 1600 . As another example, by selecting the re-detection menu 1620 in the guide message 1600 , the user may cause the controller 180 to detect the afterimage area again in the first image 1300 .

According to an embodiment, the controller 180 may output information about characters, figures, icons, logos, indicators, etc. corresponding to the detected afterimage area in the guide message 1600 . For example, the controller 180 may output a guide message 1600 including a phrase such as 'Is the detected afterimage LOGO?'.

Meanwhile, according to an embodiment of the present invention, the controller 180 of the mobile terminal 100 may allow the user to select a logo or indicator related to the afterimage. This will be described with reference to FIG. 37 .

37 is a diagram for explaining an example of a screen output to a display unit of a mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 may output a GUI for the user to select a logo/indicator related to the afterimage on the display unit 151 . In this embodiment, as an example, a GUI 1700 for selecting a logo related to an afterimage is illustrated. Since the GUI for selecting the indicator related to the afterimage is similar to that described above with reference to FIG. 18 , a description thereof will be omitted.

The memory 170 may store logo related information related to a logo of a predetermined channel, a logo of a program transmitted through each channel, and the like. Here, the logo-related information may include at least one of first information about the shape of the logo and second information related to a position where the logo is displayed on the screen. Since the description of the logo-related information is similar to that described above with reference to FIG. 17 , a detailed description thereof will be omitted.

When a specific logo is selected through the GUI 1700 , the controller 180 may store or temporarily store information related to the selected logo in the memory 170 .

The controller 180 may output the GUI 1700 after the user selects the afterimage area in the first image 1300 as described above with reference to FIGS. 33 and 34 , and related to FIGS. 33 and 34 . Thus, as described above, the GUI 1700 may be output before the user selects the afterimage area in the first image 1300 , and the GUI 1700 may be output before the first image 1200 or the first image 1300 is acquired. 1700 may be output, or the GUI 1700 may be output after detecting the afterimage area in the first image 1300 as described above with reference to FIGS. 35 and 36 , and FIGS. 35 and 36 . As described above with respect to 36 , the GUI 1700 may be output before the afterimage area is detected in the first image 1300 . The controller 180 may more accurately detect the afterimage area in the first image 1300 based on information related to the logo selected through the GUI 1700 .

According to an embodiment, when transmitting information related to the first image 1300 to the multimedia device 200 as will be described later with reference to FIG. 38 , the controller 180 is related to the logo selected through the GUI 1700 . By transmitting information to the multimedia device 200 , it may contribute to increasing accuracy in removing an afterimage from the multimedia device 200 .

38 is a diagram for explaining an example of a method of transmitting image-related information from a mobile terminal to a multimedia device according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 may control the wireless communication unit 110 to transmit information related to the first image 1300 acquired by the camera 121 to the multimedia device 200 . Here, the information related to the first image 1300 refers to image data of the first image 1300 acquired by the camera 121, an area estimated as an afterimage in the first image (eg, to the controller 180 ). Location data of the area detected by the user and/or the area selected by the user, and the area estimated as an afterimage in the first image (eg, the area detected by the controller 180 and/or the area selected by the user) ), luminance data of an area estimated as an afterimage in the first image (eg, an area detected by the controller 180 and/or an area selected by the user), data related to a logo of a specific channel, and It may include at least one of data related to a specific indicator.

According to an embodiment, the controller 180 may output a guide message 1800 for checking whether to transmit the first image 1300 to the multimedia device 200 on the display unit 151 . The guide message 1800 may be output after the first image 1300 is acquired, may be output after the afterimage area in the first image 1300 is selected by the user, and 1 After the afterimage area in the image 1300 is detected, it may be output, or it may be output after a logo/indicator related to the afterimage is selected by the user. The guide message 1800 may be output on the first image 1300 .

When the user selects the confirmation menu 1810 of the guide message 1800 , the controller 180 controls the wireless communication unit 110 to transmit information related to the first image 1300 to the multimedia device 200 . can

The multimedia device 200 may remove the afterimage included in the first screen 810 based on information related to the first image 1300 transmitted from the mobile terminal 100 . This will be described with reference to FIGS. 39 and 40 .

39 is a diagram for explaining an example of a screen output to a display unit of a multimedia device according to an embodiment of the present invention.

The control unit 270 of the multimedia device 200 controls the network interface unit 213 to receive information related to the first image 1300 transmitted from the mobile terminal 100 .

The controller 270 may output the first image 1300 to the display unit 240 based on the received information related to the first image 1300 . For example, the controller 270 may include, in the received information related to the first image 1300 , an area estimated as an afterimage in the first image (eg, an area detected by the controller 180 and/or a user location data of a region selected by ), shape data of a region estimated as an afterimage in the first image (eg, a region detected by the controller 180 and/or a region selected by the user), within the first image At least one of luminance data of an area estimated as an afterimage (eg, an area detected by the controller 180 and/or an area selected by the user), data related to a logo of a specific channel, and data related to a specific indicator If not included, the first image 1300 may be output to the display unit 240 , and the user may select an afterimage area from the first image 1300 . Since the method of selecting the afterimage area in the first image 1300 using the remote controller is similar to that described above with reference to FIGS. 8 to 11 , a detailed description thereof will be omitted. Also, according to an embodiment, the controller 270 may output the GUI 440 as described above with reference to FIG. 12 to the display unit 240 , and a detailed description thereof will be omitted.

According to an embodiment, the controller 270 may output a guide message 1900 for selecting an afterimage area to the display unit 240 using the remote controller.

40 is a diagram for explaining an example of a method of removing an afterimage in a multimedia device according to an embodiment of the present invention.

The controller 270 of the multimedia media device 200 may detect an afterimage area on the first screen 810 based on the received information related to the first image 1300 .

For example, the controller 270 may detect the afterimage area on the first screen 810 based on the afterimage area selected by the user as described above with reference to FIG. 39 .

As another example, the controller 270 may include an area estimated as an afterimage in the first image included in the received information related to the first image 1300 (eg, a region detected by the controller 180 and / or location data of a region selected by the user), shape data of a region estimated as an afterimage in the first image (eg, a region detected by the controller 180 and/or a region selected by the user); 1 Among the luminance data of a region estimated as an afterimage in the image (eg, the region detected by the controller 180 and/or the region selected by the user), data related to a logo of a specific channel, and data related to a specific indicator Based on at least one, the afterimage area may be detected on the first screen 810 .

In addition, the controller 270 may adjust the luminance of the display unit 240 corresponding to a peripheral area of the detected afterimage area. For example, the controller 270 may remove the afterimage S perceived by the user's eyes by reducing the luminance of the light emitting device corresponding to the peripheral area of the detected afterimage area.

For example, the controller 270 may adjust the luminance of the display unit 240 using the GUI as described above with reference to FIGS. 13 to 15 .

As another example, based on the image data of the first image 1300 included in the information related to the first image 1300 , the luminance of the afterimage area detected on the first screen 810 and the area around the afterimage area detects the luminance of and automatically adjusts the luminance of the display unit 240 corresponding to the area around the detected afterimage area so that the difference between the luminance of the detected afterimage area and the luminance of the surrounding area is reduced. have.

As another example, an area estimated as an afterimage in the first image included in the information related to the first image 1300 (eg, an area detected by the controller 180 and/or an area selected by a user) position data of , shape data of a region estimated as an afterimage in the first image (eg, a region detected by the controller 180 and/or a region selected by a user), and a region estimated as an afterimage in the first image Based on at least one of luminance data of (eg, the region detected by the controller 180 and/or the region selected by the user), data related to a logo of a specific channel, and data related to a specific indicator, The luminance of the display unit 240 corresponding to the peripheral region of the detected afterimage region may be automatically adjusted so that a difference between the luminance of the detected afterimage region and the luminance of the peripheral region is reduced.

41 is a view for explaining an example of a screen output to the display unit after the primary afterimage removal process is performed in the multimedia device according to an embodiment of the present invention.

The control unit 270 of the multimedia device 200 controls the first screen 810 on which the first light emitting device is activated after the brightness of the display unit 240 corresponding to the peripheral area of the detected afterimage area is adjusted. It can be output to the display unit 240 again. The afterimage S may not be visible on the re-output first screen 810 , and if the afterimage is not completely removed, the remaining afterimage S may be slightly blurred.

According to an embodiment, the controller 270 may output a guide message 2100 for guiding a subsequent process after the first afterimage removal process for the first light emitting device is completed to the display unit 240 . For example, in the guide message 2100, a first menu 2110 for performing a secondary afterimage removal process for a first light emitting device (eg, a blue light emitting device), another light emitting device (for example, A second menu 2120 for performing a secondary afterimage removal process for the green light emitting device) and a third menu 2130 for terminating an application for removing an afterimage may be included.

When the user selects the first menu 2110 in the guide message 2100, at least a part of the process described above with reference to FIGS. 22 to 40 may be performed again. According to an embodiment, when detecting the afterimage area of the first screen 810 in the secondary afterimage removal process for the first light emitting device, the controller 270 may be configured to: ), you can refer to the detected afterimage area. In addition, in determining the gain value used for luminance control of the display unit 240 corresponding to the peripheral region of the afterimage region of the first screen 810 in the secondary afterimage removal process for the first light emitting device, the existing primary A gain value used for adjusting the brightness of the display unit 240 corresponding to the peripheral area of the afterimage area of the first screen 810 of the afterimage removal process may be referred to.

When the user selects the second menu 2120 in the guide message 2100, at least a part of the process described above with reference to FIGS. 22 to 40 may be similarly performed for the second light emitting device. Since the description is similar to that described above with reference to FIGS. 22 to 40 except that the second light emitting device is applied instead of the first light emitting device, a detailed description thereof will be omitted.

When the user selects the third menu 2130 in the guide message 2100, the controller 270 may terminate the application for removing the afterimage.

Hereinafter, an example of an afterimage removal process for the second light emitting device included in the display unit 240 of the multimedia device 200 will be described with reference to FIGS. 42 to 44 . A detailed description of the content overlapping with the above in relation to FIGS. 21 to 41 will be omitted.

42 is a diagram for explaining an example of a screen output to a display unit of a multimedia device according to an embodiment of the present invention.

For example, the user selects a green light emitting device on the execution screen 410 of the application for removing the afterimage described above with reference to FIG. 7 , or the execution screen 1000 of the application for removing the afterimage described above with reference to FIG. 26 . When the user selects the green light emitting device in , or the afterimage removal process for the blue light emitting device is completed as described above with reference to FIGS. 22 to 40 , the second screen 2200 as shown in FIG. 42 is displayed. It may be output to the display unit 240 .

The controller 270 displays a second screen 2200 in which the second light emitting device (Green light emitting device) is activated among the light emitting devices included in the display unit 240 and other light emitting devices are deactivated on the display unit 240 . can be printed on In the present embodiment, it is assumed that an afterimage S of “LOGO” appears on the second screen 2200 .

According to an embodiment, the controller 270 guides the user to photograph the second screen 2200 using the mobile terminal 100 interlocked with the multimedia device 200 , and to transmit the captured image to the multimedia device 200 . A message 2210 may be output to the display unit 240 .

43 is a view for explaining an example of a screen output to the display unit when an afterimage removal application is executed in the mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 may activate the camera 121 and output the preview image 1200 obtained by the camera 121 to the display unit 151 . For example, when the second screen 2200 as shown in FIG. 42 is output to the display unit 240 , the control unit 270 of the multimedia device 200 transmits a preset first signal to the network interface to notify it. When the first signal is transmitted to the mobile terminal 100 through the unit 213, and the controller 180 of the mobile terminal 100 receives the first signal through the wireless communication unit 110, the camera 121 is activated and The preview image 1200 acquired by the camera 121 may be output to the display unit 151 . As another example, the controller 180 of the mobile terminal 100 controls the camera 121 when the information related to the first image 1300 is transmitted to the multimedia device 200 as described above with reference to FIG. 38 . It may be activated again, and the preview image 1200 acquired by the camera 121 may be output to the display unit 151 .

According to an embodiment, the controller 180 may output a guide message guiding a correct method of taking a picture of the second screen 2200 to the display unit 151 .

Since the afterimage removal process for the second light emitting device thereafter is similar to that described above with reference to FIGS. 22 and 41 , a detailed description thereof will be omitted.

According to an embodiment, when it is possible to perform the afterimage removal process by the self-capture of the first display device, the first display device may display R/G/B/W light emitting devices provided in the display unit in a preset order. After capturing an activated screen or capturing a screen in which a light emitting device selected by a user among R/G/B/W light emitting devices provided in the display unit is activated, and analyzing the luminance of the captured screen, an afterimage of each light emitting device You can proceed with the removal process. In this case, since it is the same as or similar to that described above with reference to FIGS. 21 to 31 except that the subject acquiring the first image is the first display device, not the second display device, self-capture of the first display device A detailed description of the afterimage removal process by In addition, when it is possible to perform the afterimage removal process by the self-capture of the first display device, the first display device performs the afterimage removal on each of all types of light emitting devices provided in the display unit when an application for removing the afterimage is executed. The removal process may be performed without a separate user instruction, or when a specific time reserved by the user is reached, the application for removing the afterimage may be automatically executed to perform the afterimage removal process for each light emitting device. In addition, if it is possible to perform the afterimage removal process by self-capture of the first display device, the afterimage removal process is periodically, non-periodically, or scheduled by the user regardless of power on/off of the first display device It can also be performed in the background at a specific time.

44 is a view for explaining an example of a screen output to the display unit after the afterimage removal process of the multimedia device is completed in the mobile terminal according to an embodiment of the present invention.

The control unit 180 of the mobile terminal 100 completes the afterimage removal process for all light emitting devices included in the display unit 240 of the multimedia device 200 , or displays the image on the display unit 240 of the multimedia device 200 . When the afterimage removal process for the type of light emitting device set by the user among the included light emitting devices is completed, a guide message 2300 informing the end of the application for removing the afterimage may be output to the display unit 151 .

When a separate confirmation command by the user is detected or a preset time has elapsed after the guide message 2300 is output, the controller 180 may terminate the application for removing the afterimage.

According to an embodiment, the controller 180 transmits a preset second signal to the multimedia device 200 when a separate confirmation command by the user is detected or a preset time has elapsed after the guide message 2300 is output. ) may control the wireless communication unit 110 to transmit. When the second signal is sensed through the network interface unit 213 , the controller 270 of the multimedia device 200 may automatically terminate the application for removing the afterimage without a separate user command.

Hereinafter, using FIGS. 45 to 48 , when the first display device is the first mobile terminal 100A and the second display device is the second mobile terminal 100B, the afterimage removal described above with reference to FIG. 21 . An example of the method will be specifically described. A detailed description of the content overlapping with the above in relation to FIGS. 21 to 44 will be omitted. 45 to 48 , it is almost similar to that described above with reference to FIGS. 22 to 44 , except that the first display device is the mobile terminal 100 and not the multimedia device 200 .

45 is a diagram illustrating an example of a screen output to the display unit of the first mobile terminal as an example of the first display device according to an embodiment of the present invention.

The controller 180A of the first mobile terminal 100A may output the first screen 2400 to the display unit 151A when the application for removing the afterimage is executed. The first screen 2400 may be a screen in which the first light emitting device corresponding to the first wavelength region among the light emitting devices included in the display unit 151A is activated.

According to an embodiment, the control unit 180A, a guide message for photographing the first screen 2400 using a device interlocked with the first mobile terminal 100A and transmitting the captured image to the first mobile terminal 100A 2410 may be output to the display unit 151A.

46 is a diagram illustrating an example of a screen output to a display unit of a second mobile terminal as an example of a second display device according to an embodiment of the present invention.

The controller 180B of the second mobile terminal 100B controls the wireless communication unit 110B to connect wireless communication with a specific external device (ie, the first mobile terminal 100A) when the application for removing the afterimage is executed. can be controlled The specific external device may be a device having a history of wireless communication connection with the second mobile terminal 100B, a device selected by a user from a search result of a device capable of wireless communication connection with the second mobile terminal 100B, etc. .

According to an embodiment, the controller 180B may output a notification message 2500 for notifying the user that wireless communication with a specific external device is being connected to the display unit 151B.

47 is a diagram illustrating an example of a screen output to a display unit of a second mobile terminal according to an embodiment of the present invention.

When the application for removing the afterimage is executed, the controller 180B of the second mobile terminal 100B activates the camera 121B and displays the preview image 2600 obtained by the camera 121B on the display unit 151B. ) can be printed.

According to an embodiment, the controller 180B transmits, to the display unit 151B, a guide message guiding a correct method of taking a picture of the first screen 2400 output on the display unit 151A of the first mobile terminal 100A. You can also print

48 is a diagram for explaining an example of a method of removing an afterimage in the first mobile terminal according to an embodiment of the present invention.

The controller 180A of the first mobile terminal 100A may detect the afterimage area on the first screen 2400 based on information related to the first image received from the second mobile terminal 100B. Since the detection method of the afterimage area is similar to that described above with reference to FIG. 40 , a detailed description thereof will be omitted.

In addition, the controller 180A may adjust the luminance of the display unit 151A corresponding to a peripheral area of the detected afterimage area. Since the luminance control method is similar to that described above with reference to FIG. 40, a detailed description thereof will be omitted.

According to at least one embodiment of the present invention, it is possible to provide a method for removing a sticking afterimage that can be recognized by a user on the screen of the display unit.

The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include a control unit of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

100: mobile terminal
200: multimedia device

Claims (20)

display unit; and
control unit; including;
The control unit is
Run the application for afterimage removal,
Control the display unit to display a specific screen,
Detect the afterimage area on the specific screen,
adjusting the luminance of the display unit corresponding to the area around the detected afterimage area;
controlling the display unit to display a first GUI for adjusting the luminance of the display unit corresponding to the peripheral area of the afterimage area;
The display device of claim 1, wherein brightness of a display unit corresponding to a peripheral area of the afterimage area is adjusted according to a first signal received through the first GUI. The method of claim 1,
The controller is configured to detect a second signal for selecting at least a part of the area on the specific screen, and detect the afterimage area based on the area selected by the second signal. The method of claim 1,
Further comprising; a memory for storing first information related to the indicator outputable to the display unit;
The first information includes at least one of information about a shape of an indicator and information about a position where the indicator is displayed on a screen of the display unit. 4. The method of claim 3,
The control unit is
controlling the display unit to display a second GUI including at least one indicator among indicators related to the first information stored in the memory;
detecting a third signal for selecting at least one of the indicators included in the second GUI;
and detecting the afterimage area based on first information related to the indicator selected by the third signal. The method of claim 1,
Further comprising; a memory for storing second information related to the logo of the channel viewable through the display device;
The second information includes at least one of information about a shape of a logo and information about a position where the logo is displayed on a screen of the display unit. 6. The method of claim 5,
The control unit is
controlling the display unit to display a third GUI including at least one logo among logos related to the second information stored in the memory;
detecting a fourth signal for selecting at least one of the logos included in the third GUI,
and detecting the afterimage area based on second information related to the logo selected by the fourth signal. delete The method of claim 1,
The first GUI includes a menu icon for adjusting the brightness of the display unit corresponding to the surrounding area,
The first signal includes at least one of a signal for selecting the menu icon at least once or a signal for moving the menu icon on a predetermined area of the first GUI. The method of claim 1,
The first GUI includes a first menu for adjusting the luminance of the display unit corresponding to the peripheral region to a first level and a second menu for adjusting the luminance of the display unit corresponding to the peripheral region to a second level lower than the first level. 2 A display device comprising at least a menu. The method of claim 1,
The display unit includes at least a first light emitting device corresponding to a first wavelength region and a second light emitting device corresponding to a second wavelength region, and the specific screen includes the first light emitting device among the first light emitting device and the second light emitting device. It is a screen in which the light emitting element is activated,
The control unit, the display device to adjust the brightness of the first light emitting element corresponding to the peripheral area of the afterimage area. a network interface unit capable of wireless communication with an external device;
display unit; and
control unit; including;
The control unit is
Controls the network interface unit to connect a specific external device and wireless communication,
Executes the application for afterimage removal according to preset conditions,
Control the display unit to display a specific screen,
controlling the network interface unit to receive information related to an image corresponding to the specific screen from a specific external device to which the wireless communication is connected;
Detect an afterimage area in the specific screen based on the information related to the received image,
adjusting the luminance of the display unit corresponding to the area around the detected afterimage area;
The preset condition is
A display device comprising at least one of a condition in which a signal for executing an application for removing the afterimage from a remote controller is received or a condition in which a preset signal is received from the specific external device through the network interface unit. 12. The method of claim 11,
The information related to the image may include image data of an image corresponding to the specific screen acquired by the camera of the specific external device, location data of a region estimated as an afterimage in the image, and a shape of a region estimated as an afterimage in the image. A display device comprising at least one of data, shape data of a region estimated as an afterimage in the image, luminance data of a region estimated as an afterimage in the image, data related to a logo of a specific channel, and data related to a specific indicator. delete 12. The method of claim 11,
The control unit controls the display unit to output a guide message to photograph the specific screen using the specific external device. 13. The method of claim 12,
When the information related to the image includes luminance data of a region estimated as an afterimage in the image,
The controller adjusts the luminance of the display unit corresponding to the peripheral region such that a difference between the luminance corresponding to the detected afterimage region and the luminance of the display unit corresponding to the peripheral region is less than or equal to a preset level based on the luminance data which is a display device. 12. The method of claim 11,
The control unit is
controlling the display unit to display a GUI for adjusting the luminance of the display unit corresponding to the peripheral area of the afterimage area;
The display device of claim 1, wherein brightness of a display unit corresponding to a peripheral area of the afterimage area is adjusted according to a first signal received through the GUI. a wireless communication unit capable of wireless communication with an external device;
camera;
display unit; and
control unit; including;
The control unit is
Run the application to remove the afterimage of the external device,
Control the wireless communication unit to connect a specific external device and wireless communication,
activate the camera;
When a shooting command is detected, an image is acquired using the activated camera,
A display device for controlling the wireless communication unit to transmit information related to the acquired image to a specific external device to which the wireless communication is connected. 18. The method of claim 17,
When the camera is activated, the control unit outputs a guide message to take a picture of the screen of the specific external device to the display unit. 18. The method of claim 17,
The control unit detects a region having a luminance below a preset level in the image,
The information related to the image includes at least one of luminance data of the detected region in the image, position data of the detected region in the image, and shape data of the detected region in the image. device. 18. The method of claim 17,
The control unit outputs the acquired image to the display unit, and detects a second signal for selecting an afterimage area from the output image,
The information related to the image includes information about a region selected by the second signal, a display device.

Images