KR102204622B1 - Display device, and controlling method thereof - Google Patents

Abstract

The present invention is a display device and a control method thereof, in which an error of a display panel is stored in a memory for each item, the display panel is sensed through a sensor unit, and when the sensor unit senses an error of the display panel, the display panel is referred to the memory. The summary is to count the number of toggles corresponding to the abnormal symptom of and control the display panel to display the counted number of toggles on the screen.

Description

Display device and controlling method thereof

The present invention relates to a display device and a control method thereof, and more particularly, to a display device capable of determining a cause of BDP occurrence by counting a BDP toggle signal of a display panel, and a control method thereof.

Recently, many users are using display devices such as smart TVs.

In particular, in the case of smart TVs, OLED panels are used. OLED panels are in the spotlight as a next-generation display to replace LCD, and many companies are working on it. The advantage of OLED is that because the device is a self-luminous device, unlike LCD, it does not require a backlight, and it can be thinned, light in weight, and provide clear readability even outdoors.

Since it is not a backlight method, the black screen can turn off the device at all, so the contrast ratio and color reproduction are very good. In particular, black can implement complete black, and the response speed is very good compared to LCD. In addition, when displaying a dark image, the power consumption of the device is reduced, so that power efficiency is good in an actual use environment.

In the case of the prior art, in the OLED panel, when BDP (Burnt detect protection) occurs, the BDP signal is simply changed from low to high and transmitted to the microcomputer, so that the user can only know that BDP has occurred, and the fundamental There is a problem that the user feels uncomfortable because the cause cannot be immediately known.

According to an embodiment of the present invention, when a problem occurs in a display panel, a display device in which a user can immediately know the cause of BDP by counting the number of toggles corresponding to an abnormal symptom of the display panel and displaying the number of toggles on the screen. It aims to provide the control method.

Another embodiment of the present invention is to provide a display device for counting the number of toggles differently for each abnormal symptom of a display panel, and a control method thereof.

Another embodiment of the present invention is to provide a display device that transmits a first signal indicating that a problem has occurred to a manufacturer server and a control method thereof when a sensor unit senses a problem of a display panel.

The technical problem to be achieved in the present invention is not limited to the above-mentioned technical problem, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present invention belongs from the following description. .

According to an embodiment of the present invention, a display device includes: a display panel 1540 including a plurality of pixels; A memory 1570 for storing abnormalities of the display panel for each item; A sensor unit 1550 for sensing the display panel; When the sensor unit senses an abnormality in the display panel, a control unit that refers to the memory to count the number of toggles corresponding to the abnormality symptom of the display panel, and controls the display panel to display the counted number of toggles on the screen ( 1530).

According to another embodiment of the present invention, a method of controlling a display device may include storing an abnormality of the display panel 1540 in a memory 1570 for each item; Sensing the display panel through a sensor unit; When the sensor unit 1550 senses an abnormality in the display panel, counting a number of toggles corresponding to an abnormality symptom in the display panel by referring to the memory; And controlling the display panel to display the counted number of toggles on the screen.

According to an embodiment of the present invention, when a problem occurs in the display panel, the number of toggles corresponding to an abnormal symptom of the display panel is counted, and the number of toggles is displayed on the screen so that the user can immediately know the cause of the BDP. Can improve.

According to another embodiment of the present invention, if a problem occurs in the field by counting the number of toggles differently for each abnormal symptom of the display panel, it is not necessary to re-test to determine the cause of the BDP again, and the cause of the problem is immediately known. Can and can improve user convenience because appropriate measures can be taken.

According to another embodiment of the present invention, when the sensor unit senses a problem with the display panel, the first signal indicating that the problem has occurred is transmitted to the manufacturer server, so that the manufacturer can identify the problem, thus improving user convenience. have.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a diagram schematically illustrating a service system including a digital device according to an embodiment of the present invention.
2 is a block diagram illustrating a digital device according to an embodiment of the present invention.
3 is a block diagram illustrating a digital device according to another embodiment of the present invention.
4 is a block diagram illustrating a digital device according to another embodiment of the present invention.
5 is a block diagram illustrating a detailed configuration of a control unit of FIGS. 2 to 4 according to an embodiment of the present invention.
6 is a diagram illustrating an input means connected to the digital device of FIGS. 2 to 4 according to an embodiment of the present invention.
7 is a diagram illustrating a webOS architecture according to an embodiment of the present invention.
8 is a diagram illustrating an architecture of a webOS device according to an embodiment of the present invention.
9 is a diagram illustrating a graphic composition flow in a webOS device according to an embodiment of the present invention.
10 is a diagram illustrating a media server according to an embodiment of the present invention.
11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention.
12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
13 is a diagram illustrating a control method of a remote control device that controls any one of image display devices according to embodiments of the present invention.
14 is an internal block diagram of a remote control device that controls any one of image display devices according to embodiments of the present invention.
15 is a configuration diagram of a display device according to an embodiment of the present invention.
16 is a diagram illustrating a method of controlling a display device according to an embodiment of the present invention.
17 is a diagram illustrating determining a cause of occurrence when BPD occurs in a display panel according to an embodiment of the present invention.
18 is a diagram illustrating counting the number of toggles based on an output voltage according to an embodiment of the present invention.
19 is a diagram illustrating a BDP case according to an embodiment of the present invention.
FIG. 20 is a diagram illustrating an embodiment of performing a toggle count when a BPD occurs in a display panel according to an embodiment of the present invention.
21 is a diagram illustrating an embodiment of displaying a first UI of a BDP toggle count according to an embodiment of the present invention.
22 is a diagram illustrating an embodiment of displaying a second UI of a BDP toggle count according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "unit" for the constituent elements used in the following description are simply given in consideration of ease of writing in the present specification, and the "module" and "unit" may be used interchangeably with each other.

On the other hand, the video display device described in the present specification is, for example, an intelligent video display device in which a computer support function is added to a broadcast reception function, and is faithful to a broadcast reception function and an Internet function is added, so that a handwritten input device, a touch screen Alternatively, a more convenient interface such as a space remote control can be provided. In addition, it is connected to the Internet and a computer with the support of wired or wireless Internet functions, and functions such as e-mail, web browsing, banking, or games can be performed. For these various functions, a standardized general-purpose OS can be used.

Accordingly, in the video display device described in the present invention, since various applications can be freely added or deleted, for example, on a general-purpose OS kernel, various user-friendly functions can be performed. The video display device may be more specifically, for example, a network TV, an HBBTV, a smart TV, or the like, and may be applied to a smart phone in some cases.

Further, embodiments of the present invention will be described in detail below with reference to the accompanying drawings and contents described in the accompanying drawings, but the present invention is not limited or limited by the embodiments.

The terms used in the present specification have selected general terms that are currently widely used as possible while considering functions in the present invention, but this may vary according to the intention or custom of a technician working in the art, or the emergence of new technologies. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in the description of the corresponding invention. Therefore, it should be noted that terms used in the present specification should be interpreted based on the actual meaning of the term and the entire contents of the present specification, not a simple name of the term.

Hereinafter, the term “digital device” described herein refers to, for example, transmitting, receiving, processing, and outputting data, content, service, application, etc. Includes all devices that perform at least one or more. The digital device can be paired or connected (hereinafter referred to as'pairing') with another digital device, an external server, etc. through a wired/wireless network, through which predetermined data is transmitted. Can send/receive. In this case, if necessary, the data may be appropriately converted before transmission/reception. The digital device includes, for example, a standing device such as Network TV, Hybrid Broadcast Broadband TV (HBBTV), Smart TV, Internet Protocol TV (IPTV), Personal Computer (PC), etc. Wow, a mobile device or handheld device such as a personal digital assistant (PDA), a smart phone, a tablet PC, and a notebook may all be included. In the present specification, a digital TV is illustrated in FIG. 2 to be described later in order to help an understanding of the present invention and for convenience of explanation by the applicant, and in FIG. 3, a mobile device is illustrated and described as an example of a digital device. In addition, the digital device described in the present specification may be a configuration having only a panel, a configuration such as a set-top box (STB), a device, a system, etc., may be a set configuration. .

Meanwhile, the "wired/wireless network" described in the present specification collectively refers to a communication network supporting various communication standards or protocols for pairing or/and data transmission/reception between digital devices or a digital device and an external server. These wired/wireless networks include all communication networks to be supported now or in the future according to the standard, and can support all of one or more communication protocols therefor. Such wired/wireless networks include, for example, USB (Universal Serial Bus), CVBS (Composite Video Banking Sync), Component, S-Video (analog), DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface), Networks for wired connection such as RGB and D-SUB, communication standards or protocols therefor, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), Zigbee (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE/LTE It may be formed by a network for wireless connection such as -A (Long Term Evolution/LTE-Advanced) and Wi-Fi Direct, and a communication standard or protocol therefor.

In addition, in the case of simply referring to a digital device in the present specification, the meaning may mean a fixed device or a mobile device depending on the context, or may be used as a meaning including both unless otherwise noted.

On the other hand, a digital device is an intelligent device that supports, for example, a broadcast reception function, a computer function or support, at least one external input, etc., through e-mail and web browsing through the wired/wireless network described above. , Banking, game, application, etc. may be supported. In addition, the digital device may include at least one input or control means (hereinafter, an interface for supporting'input means'), such as a handwritten input device, a touch-screen, and a spatial remote control. have.

In addition, the digital device may use a standardized general purpose OS (Operating System), but in particular, the digital device described in the present specification uses a web OS as an example. Therefore, digital devices can process adding, deleting, amending, and updating various services or applications on a general-purpose OS kernel or Linux kernel. It is possible, and through it, a more user-friendly environment can be configured and provided.

Meanwhile, the above-described digital device can receive and process an external input. In this case, the external input is connected to an external input device, that is, through a wired/wireless network, and transmits/receives data to be processed. And input means or digital devices. For example, the external input is HDMI (High-Definition Multimedia Interface), a game device such as a playstation or an X-Box, a smart phone, a tablet PC, a pocket photo. It includes all digital devices such as a printing device such as photo), a smart TV, and a Blu-ray device.

In addition, the term “server” described in the present specification refers to a digital device or system that supplies data to or receives data from the above-described digital device, that is, a client, and is also referred to as a processor. do. To the server, for example, a web server that provides a web page, web content or web service, a portal server, and advertising data Advertising server, content server providing content, SNS server providing SNS (Social Network Service), service server provided by manufacturer, video on demand (VoD) B. A service server that provides a multichannel video programming distributor (MVPD) for providing a streaming service, a pay service, etc. may be included.

In addition, in the following description, even when only an application is described for convenience of description, the meaning may be a meaning including not only an application but also a service based on the context. Also, the application may mean a web application according to the webOS platform.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating a service system including a digital device according to an embodiment of the present invention.

As shown in Fig. 1, the service system includes a content provider 10, a service provider 20, a network provider 30, and a Home Network End (HNED). User)(Customer)(40). Here, the HNED 40 includes, for example, the client 100, that is, a digital device according to the present invention.

The content provider 10 produces and provides various types of content. As shown in FIG. 1, a terrestrial broadcaster, a cable system operator (Cable SO) or MSO (Multiple SO), a satellite broadcaster, various Internet broadcasters, to the content provider 10, Personal content providers, etc. may be exemplified. Meanwhile, the content provider 10 may produce and provide various services or applications in addition to broadcast content.

The service provider 20 provides the content produced by the content provider 10 to the HNED 40 by service packetizing the content. For example, the service provider 20 packages at least one or more of contents produced by a first terrestrial broadcast, a second terrestrial broadcast, a cable MSO, a satellite broadcast, various Internet broadcasts, applications, etc. for a service, and the HNED Provides to 40.

The service provider 20 provides a service to the client 100 in a uni-cast or multi-cast method. Meanwhile, the service provider 20 may transmit data to a plurality of pre-registered clients 100 at once, and for this purpose, an Internet Group Management Protocol (IGMP) protocol or the like may be used.

The above-described content provider 10 and service provider 20 may be the same entity. For example, the content produced by the content provider 10 may be packaged as a service and provided to the HNED 40 to perform the function of the service provider 20 or vice versa.

The network provider 30 provides a network network for data exchange between the content provider 10 or/and the service provider 20 and the client 100.

As a consumer belonging to the HNED 40, the client 100 receives data by establishing, for example, a home network through the network provider 30, and provides data related to various services or applications such as VoD and streaming. You can also send/receive.

Meanwhile, the content provider 10 or/and the service provider 20 in the service system may use conditional access or content protection means to protect transmitted content. Accordingly, the client 100 may use a processing means such as a cable card (or Point of Deployment (POD)) or a downloadable CAS (DCAS) in response to the conditional reception or content protection.

In addition, the client 100 may also use a two-way service through a network. Accordingly, the client 100 may rather perform the role or function of a content provider, and the service provider 20 may receive it and transmit it to another client or the like.

In FIG. 1, the content provider 10 or/and the service provider 20 may be a server providing a service to be described later in this specification. In this case, the server may mean owning or including the network provider 30 as necessary. Even if not specifically mentioned below, services or service data include not only services or applications received from the outside, but also internal services or applications, and these services or applications are services for the client 100 based on Web OS. To application data.

2 is a block diagram illustrating a digital device according to an embodiment of the present invention.

The digital device described herein below corresponds to the client 100 of FIG. 1 described above.

The digital device 200 includes a network interface 201, a TCP/IP manager 202, a service delivery manager 203, an SI decoder 204, Demultiplexer 205, audio decoder 206, video decoder 207, display A/V and OSD module 208, service control manager (service control manager) (209), service discovery manager (210), SI & metadata DB (211), metadata manager (212), service manager (213), It is configured to include a UI manager 214 and the like.

The network interface unit 201 is an IP packet(s) (Internet Protocol(IP) packet(s)) or IP datagram(s) (IP datagram(s)) (hereinafter, IP packet(s)) through an access network network. )) is transmitted/received. For example, the network interface unit 201 may receive a service, an application, content, etc. from the service provider 20 of FIG. 1 through a network network.

The TCP/IP manager 202 transmits a packet between a source and a destination with respect to IP packets received by the digital device 200 and IP packets transmitted by the digital device 200. packet delivery). The TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205, the service discovery manager 210, the service control manager 209, and the metadata manager 212 ), and the like, outputs the classified packet(s).

The service delivery manager 203 is responsible for controlling received service data. For example, the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data. When transmitting the real-time streaming data using RTP, the service delivery manager 203 parses the received data packet according to RTP and transmits it to the demultiplexer 205 or is controlled by the service manager 213 It is stored in the SI & metadata database 211 according to. Then, the service delivery manager 203 feeds back the network reception information to the server providing the service using RTCP.

The demultiplexer 205 demultiplexes the received packet into audio, video, SI (System Information) data, and the like, and transmits the demultiplexed to the audio/video decoder 206/207 and the SI decoder 204, respectively.

The SI decoder 204 includes demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting-Service Information (DVB-SI), and Digital Television Terrestrial Multimedia (DTMB/CMMB). It decodes service information such as Broadcasting/Coding Mobile Multimedia Broadcasting). Further, the SI decoder 204 may store decoded service information in the SI & metadata database 211. The stored service information may be read and used according to the configuration at the request of a user, for example.

The audio/video decoders 206/207 decode each of the demultiplexed audio data and video data. The audio data and video data decoded in this way are provided to the user through the display unit 208.

The application manager includes, for example, a UI manager 214 and a service manager 213 and may perform a control function of the digital device 200. In other words, the application manager may manage the overall state of the digital device 200, provide a user interface (UI), and manage other managers.

The UI manager 214 provides a GUI (Graphic User Interface)/UI for a user using an OSD (On Screen Display), etc., and receives a key input from the user and performs a device operation according to the input. For example, the UI manager 214 transmits the key input signal to the service manager 213 when receiving a key input for channel selection from a user.

The service manager 213 controls managers associated with a service, such as a service delivery manager 203, a service discovery manager 210, a service control manager 209, and a metadata manager 212.

In addition, the service manager 213 generates a channel map and controls a channel selection or the like using the generated channel map according to a key input received from the UI manager 214. The service manager 213 receives service information from the SI decoder 204 and sets an audio/video packet identifier (PID) of the selected channel to the demultiplexer 205. The PID set in this way can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters audio data, video data, and SI data using the PID (PID or section filtering).

The service discovery manager 210 provides information necessary to select a service provider that provides a service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for a service using the information.

The service control manager 209 is responsible for service selection and control. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as an existing broadcasting method, and selects a service such as Video on Demand (VOD). RTSP is used to select and control services. The RTSP protocol may provide a trick mode for real-time streaming. In addition, the service control manager 209 may initialize and manage a session through the IMS gateway 250 using IMS (IP Multimedia Subsystem) and SIP (Session Initiation Protocol). The protocols are an exemplary embodiment, and other protocols may be used according to implementation examples.

The metadata manager 212 manages metadata associated with a service and stores the metadata in the SI & metadata database 211.

The SI & metadata database 211 contains service information decoded by the SI decoder 204, metadata managed by the metadata manager 212, and information necessary to select a service provider provided by the service discovery manager 210. Save it. In addition, the SI & metadata database 211 may store set-up data for the system and the like.

The SI & metadata database 211 may be implemented using a nonvolatile memory (Non-Volatile RAM: NVRAM) or a flash memory.

Meanwhile, the IMS gateway 250 is a gateway that collects functions necessary for accessing an IMS-based IPTV service.

3 is a block diagram illustrating a digital device according to another embodiment of the present invention.

While FIG. 2 described above has been described using a fixed device as an example of a digital device, FIG. 3 refers to a mobile device as another example of a digital device.

3, the mobile device 300 includes a wireless communication unit 310, an audio/video (A/V) input unit 320, a user input unit 330, a sensing unit 340, an output unit 350, and a memory. 360, an interface unit 370, a control unit 380, a power supply unit 390, and the like may be included.

Hereinafter, each component will be described in detail.

The wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and a wireless communication system or between the mobile device and a network in which the mobile device is located. For example, the wireless communication unit 310 may include a broadcast receiving module 311, a mobile communication module 312, a wireless Internet module 313, a short-range communication module 314, a location information module 315, and the like. .

The broadcast receiving module 311 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312.

Broadcast-related information may exist in various forms, for example, in the form of an electronic program guide (EPG) or an electronic service guide (ESG).

The broadcast receiving module 311 is, for example, ATSC, DVB-T (Digital Video Broadcasting-Terrestrial), DVB-S (Satellite), MediaFLO (Media Forward Link Only), DVB-H (Handheld), ISDB-T ( Integrated Services Digital Broadcast-Terrestrial) and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast receiving module 311 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The broadcast signal and/or broadcast related information received through the broadcast receiving module 311 may be stored in the memory 360.

The mobile communication module 312 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 313 may be built-in or external to the mobile device 300, including a module for wireless Internet access. As a wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), and the like may be used.

The short-range communication module 314 refers to a module for short-range communication. As short range communication technology, Bluetooth, RFID (Radio Frequency Identification), infrared data association (IrDA), UWB (Ultra Wideband), ZigBee, RS-232, RS-485, etc. can be used. I can.

The location information module 315 is a module for obtaining location information of the mobile device 300, and may be a Global Position System (GPS) module as an example.

The A/V input unit 320 is for inputting an audio or/and video signal, and may include a camera 321 and a microphone 322. The camera 321 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 351.

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310. Two or more cameras 321 may be provided depending on the use environment.

The microphone 322 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. In the case of a call mode, the processed voice data may be converted into a format that can be transmitted to a mobile communication base station through the mobile communication module 312 and then output. Various noise removal algorithms may be implemented in the microphone 322 to remove noise generated in the process of receiving an external sound signal.

The user input unit 330 generates input data for the user to control the operation of the terminal. The user input unit 330 may be composed of a key pad, a dome switch, a touch pad (positive pressure/electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 340, the current state of the mobile device 300, such as an open/closed state of the mobile device 300, a location of the mobile device 300, a user contact, a direction of the mobile device, and acceleration/deceleration of the mobile device. It detects and generates a sensing signal for controlling the operation of the mobile device 300. For example, when the mobile device 300 is moved or tilted, the position or tilt of the mobile device may be sensed. Also, whether the power supply unit 390 supplies power or whether the interface unit 370 is coupled to an external device may be sensed. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including near field communication (NFC) or the like.

The output unit 350 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 351, a sound output module 352, an alarm unit 353, and a haptic module 354. have.

The display unit 351 displays (outputs) information processed by the mobile device 300. For example, when the mobile device is in a call mode, a UI or GUI related to a call is displayed. When the mobile device 300 is in a video call mode or a photographing mode, a photographed or/and received image, UI, or GUI is displayed.

The display unit 351 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display ( flexible display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 351 may also be configured as a light transmission type structure. With this structure, the user can see objects located behind the terminal body through an area occupied by the display unit 351 of the terminal body.

Two or more display units 351 may exist depending on the implementation type of the mobile device 300. For example, in the mobile device 300, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces, respectively.

When the display unit 351 and a sensor (hereinafter referred to as'touch sensor') for detecting a touch operation form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 351 provides inputs other than the output device. It can also be used as a device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 351 or a capacitance generated at a specific portion of the display unit 351 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 380. As a result, the control unit 380 can know which region of the display unit 351 has been touched.

A proximity sensor 341 may be disposed in an inner area of the mobile device surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". A position at which a proximity touch is performed by a pointer on the touch screen means a position at which the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 352 may output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 352 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile device 300. The sound output module 352 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event of the mobile device 300. Examples of events that occur in mobile devices include call signal reception, message reception, key signal input, and touch input. The alarm unit 353 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, by vibration. The video signal or audio signal may also be output through the display unit 351 or the audio output module 352, so that they 351 and 352 may be classified as part of the alarm unit 353.

The haptic module 354 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 354 is vibration. The intensity and pattern of the vibration generated by the haptic module 354 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output. In addition to vibration, the haptic module 354, in addition to vibration, is a pin arrangement that moves vertically with respect to the contact skin surface, the blowing force or suction force of air through the injection or inlet, the grazing of the skin surface, contact of the electrode, and stimulation such as electrostatic force. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling/warm using an endothermic or exothermic element. The haptic module 354 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 354 may be provided depending on the configuration aspect of the mobile device 300.

The memory 360 may store a program for the operation of the controller 380 and may temporarily store input/output data (eg, phone book, message, still image, video, etc.). The memory 360 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 360 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, It may include at least one type of storage medium among magnetic disks and optical disks. The mobile device 300 may operate in connection with a web storage that performs a storage function of the memory 360 on the Internet.

The interface unit 370 serves as a passage for all external devices connected to the mobile device 300. The interface unit 370 receives data from an external device, receives power, and transmits it to each component inside the mobile device 300, or transmits data inside the mobile device 300 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video I/O port, an earphone port, etc. may be included in the interface unit 370.

The identification module is a chip that stores various types of information for authenticating the use rights of the mobile device 300, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module, USIM), etc. may be included. A device equipped with an identification module (hereinafter referred to as “identification device”) may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 200 through the port.

When the mobile device 300 is connected to an external cradle, the interface unit 370 becomes a path through which power from the cradle is supplied to the mobile device 300, or various types of input from the cradle by a user. It may be a path through which the command signal is transmitted to the mobile device. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.

The controller 380 generally controls the overall operation of the mobile device 300. The control unit 380 performs related control and processing for, for example, voice calls, data communication, and video calls. The controller 380 may also include a multimedia module 381 for playing multimedia. The multimedia module 381 may be implemented in the control unit 380 or may be implemented separately from the control unit 380. The control unit 380 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch-screen as characters and images, respectively.

The power supply unit 390 receives external power and internal power under the control of the control unit 380 and supplies power necessary for operation of each component.

The various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of a processor, controller, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases implementations described herein. Examples may be implemented by the control unit 380 itself.

According to software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented with a software application written in an appropriate programming language. Here, the software code may be stored in the memory 360 and executed by the controller 380.

4 is a block diagram illustrating a digital device according to another embodiment of the present invention.

Other examples of the digital device 400 include a broadcast reception unit 405, an external device interface unit 435, a storage unit 440, a user input interface unit 450, a control unit 470, a display unit 480, and audio. An output unit 485, a power supply unit 490, and a photographing unit (not shown) may be included. Here, the broadcast receiving unit 405 may include at least one tuner 410, a demodulator 420, and a network interface unit 430. However, in some cases, the broadcast reception unit 405 may include a tuner 410 and a demodulation unit 420 but may not include the network interface unit 430 and vice versa. Further, although the broadcast receiving unit 405 is not shown, a multiplexer is provided to provide a signal demodulated by the demodulation unit 420 through the tuner 410 and a signal received through the network interface unit 430. Can also be multiplexed. In addition, the broadcast receiving unit 425 is also not shown, but is provided with a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal that has passed through the network interface unit 430. I can.

The tuner 410 receives an RF broadcast signal by tuning a channel selected by a user or all previously stored channels among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 410 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, it is converted to a digital IF signal (DIF), and if the received RF broadcast signal is an analog broadcast signal, it is converted to an analog baseband video or audio signal (CVBS/SIF). That is, the tuner 410 may process both digital broadcast signals or analog broadcast signals. The analog baseband video or audio signal (CVBS/SIF) output from the tuner 410 may be directly input to the control unit 470.

Further, the tuner 410 may receive an RF broadcast signal of a single carrier or multiple carriers. Meanwhile, the tuner 410 sequentially tunes and receives RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna, and receives them, and receives them from an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). Frequency or baseband signal).

The demodulation unit 420 may receive and demodulate the digital IF signal DIF converted by the tuner 410, and may perform channel decoding or the like. To this end, the demodulation unit 420 is provided with a Trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. -Can be equipped with a Soloman decoder.

The demodulator 420 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal and a Dolby AC-3 standard audio signal are multiplexed.

The stream signal output from the demodulation unit 420 may be input to the control unit 470. The controller 470 may control demultiplexing, video/audio signal processing, and the like, and control output of an image through the display unit 480 and an audio output through the audio output unit 485.

The external device interface unit 435 provides an interfacing environment between the digital device 300 and various external devices. To this end, the external device interface unit 335 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 435 includes a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), a tablet PC, a smart phone, and a Bluetooth device. device) and external devices such as the cloud, etc. may be connected by wire or wirelessly. The external device interface unit 435 transmits a signal including data such as an image, video, and audio input through a connected external device to the control unit 470 of the digital device. The controller 470 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 435 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), so that video and audio signals from an external device can be input to the digital device 400. A Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like may be included.

The wireless communication unit may perform short-range wireless communication with other digital devices. The digital device 400 is, for example, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA). It can be networked with other digital devices according to a communication protocol such as.

In addition, the external device interface unit 435 may be connected through at least one of the set-top-box STB and the above-described various terminals to perform input/output operations with the set-top-box STB.

Meanwhile, the external device interface unit 435 may receive an application or an application list in an adjacent external device and transmit it to the controller 470 or the storage unit 440.

The network interface unit 430 provides an interface for connecting the digital device 400 to a wired/wireless network including an Internet network. The network interface unit 430 may include, for example, an Ethernet terminal for connection to a wired network, and for connection to a wireless network, for example, WLAN (Wireless LAN) (Wi- Fi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), and High Speed Downlink Packet Access (HSDPA) communication standards can be used.

The network interface unit 430 may transmit or receive data with another user or another digital device through a connected network or another network linked to the connected network. Particularly, some content data stored in the digital device 400 may be transmitted to another user registered in advance with the digital device 400, a selected user of other digital devices, or a selected digital device.

Meanwhile, the network interface unit 430 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received. In addition, content or data provided by a content provider or network operator may be received. That is, content such as movies, advertisements, games, VODs, and broadcast signals provided from a content provider or a network provider may be received through a network, and information related thereto. In addition, it is possible to receive update information and an update file of firmware provided by a network operator. It can also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 430 may select and receive a desired application from among applications opened through a network.

The storage unit 440 may store a program for processing and controlling each signal in the control unit 470, or may store signal-processed video, audio, or data signals.

In addition, the storage unit 440 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 435 or the network interface unit 430. The storage unit 440 may store information on a predetermined broadcast channel through a channel memory function.

The storage unit 440 may store an application or an application list input from the external device interface unit 435 or the network interface unit 330.

In addition, the storage unit 440 may store various platforms to be described later.

The storage unit 440 includes, for example, a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD Memory, etc.), RAM, and ROM (EEPROM, etc.). The digital device 400 may reproduce and provide a content file (movie file, still image file, music file, document file, application file, etc.) stored in the storage unit 440 to a user.

4 illustrates an embodiment in which the storage unit 440 is provided separately from the control unit 470, but the present invention is not limited thereto. In other words, the storage unit 440 may be included in the control unit 470.

The user input interface unit 450 transmits a signal input by a user to the controller 470 or transmits a signal from the controller 470 to the user.

For example, the user input interface unit 450 controls power on/off from the remote control device 500, channel selection, screen setting, etc. according to various communication methods such as an RF communication method and an infrared (IR) communication method. The signal may be received and processed, or a control signal of the controller 470 may be transmitted to the remote control device 500.

In addition, the user input interface unit 450 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 470.

The user input interface unit 450 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the controller 470, or transmits a signal from the controller 470 to the sensing unit. Can be transmitted to (not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, and a motion sensor.

The control unit 470 demultiplexes the stream input through the tuner 410, the demodulation unit 420, or the external device interface unit 435 or processes demultiplexed signals to generate a signal for video or audio output. And can be output.

The image signal processed by the controller 470 may be input to the display unit 480 and displayed as an image corresponding to the corresponding image signal. Also, the image signal processed by the controller 470 may be input to an external output device through the external device interface unit 435.

The audio signal processed by the controller 470 may be audio output to the audio output unit 485. Also, the voice signal processed by the controller 470 may be input to an external output device through the external device interface unit 435.

Although not shown in FIG. 4, the controller 470 may include a demultiplexer, an image processor, and the like.

The controller 470 may control the overall operation of the digital device 400. For example, the controller 470 may control the tuner 410 to tune an RF broadcast corresponding to a channel selected by a user or a previously stored channel.

The controller 470 may control the digital device 400 according to a user command or an internal program input through the user input interface 450. In particular, it is possible to access a network to download an application or an application list desired by the user into the digital device 400.

For example, the control unit 470 controls the tuner 410 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 450. And it processes the video, audio or data signal of the selected channel. The control unit 470 enables channel information selected by the user to be output through the display unit 480 or the audio output unit 485 together with the processed image or audio signal.

As another example, the control unit 470 may be input from an external device, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 450. The video signal or the audio signal can be output through the display unit 480 or the audio output unit 485.

Meanwhile, the controller 470 may control the display unit 480 to display an image. For example, a broadcast image input through the tuner 410, an external input image input through the external device interface unit 435, an image input through a network interface unit, or an image stored in the storage unit 440 , It can be controlled to be displayed on the display unit 480. In this case, the image displayed on the display unit 480 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the control unit 470 may control to play content. The content at this time may be content stored in the digital device 400, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, when entering the application view item, the controller 470 may control to display an application or a list of applications that can be downloaded from the digital device 300 or from an external network.

The controller 470 may control to install and run an application downloaded from an external network in addition to various user interfaces. In addition, according to the user's selection, it is possible to control the display unit 480 to display an image related to an executed application.

Meanwhile, although not shown in the drawing, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided.

The channel browsing processing unit receives the stream signal TS output from the demodulation unit 320 or the stream signal output from the external device interface unit 335 and extracts an image from the input stream signal to generate a thumbnail image. I can. The generated thumbnail image may be input to the controller 470 as it is or after being encoded. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 470. The controller 470 may display a thumbnail list including a plurality of thumbnail images on the display unit 480 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 480 converts an image signal, a data signal, an OSD signal processed by the control unit 470, or an image signal and a data signal received from the external device interface unit 435 into R, G, and B signals, respectively. Generate a drive signal.

The display unit 480 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

Meanwhile, the display unit 480 may be configured as a touch screen and used as an input device other than an output device.

The audio output unit 485 receives a signal processed by the control unit 470, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as audio. The audio output unit 485 may be implemented with various types of speakers.

Meanwhile, in order to detect a user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the digital device 400. . The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 3470 through the user input interface unit 450.

Meanwhile, a photographing unit (not shown) for photographing a user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 470.

The controller 470 may detect a user's gesture by combining or combining an image captured from a photographing unit (not shown) or a signal detected from a sensing unit (not shown).

The power supply unit 490 supplies corresponding power to the entire digital device 400.

In particular, power is supplied to the control unit 470 that can be implemented in the form of a System on Chip (SoC), the display unit 480 for image display, and the audio output unit 485 for audio output. I can.

To this end, the power supply unit 490 may include a converter (not shown) that converts AC power into DC power. On the other hand, for example, when the display unit 480 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter capable of operating a pulse width modulation (PWM) operation for variable brightness or dimming driving (inverter) (not shown) may be further provided.

The remote control device 500 transmits a user input to the user input interface unit 450. To this end, the remote control device 500 may use Bluetooth, Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the remote control device 500 may receive an image, audio or data signal output from the user input interface unit 450 and display it on the remote control device 500 or output a voice or vibration.

The digital device 400 described above may be a digital broadcast receiver capable of processing a digital broadcast signal of a fixed or mobile ATSC method or a DVB method.

In addition, the digital device according to the present invention may omit some of the illustrated configurations as necessary, or may further include a configuration not illustrated. Meanwhile, the digital device may not have a tuner and a demodulator, and may receive and play content through a network interface unit or an external device interface unit, unlike the above.

5 is a block diagram illustrating a detailed configuration of a control unit of FIGS. 2 to 4 according to an embodiment of the present invention.

An example of a control unit is a demultiplexer 510, an image processing unit 5520, an OSD generation unit 540, a mixer 550, a frame rate converter (FRC) 555, and A formatter 560 may be included. In addition, although not shown, the control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 510 demultiplexes an input stream. For example, the demultiplexer 510 may demultiplex input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 510 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit 420 performs image processing on the demultiplexed image signal. To this end, the image processing unit 420 may include an image decoder 425 and a scaler 435.

The image decoder 425 decodes the demultiplexed image signal, and the scaler 435 scales the resolution of the decoded image signal to be output from the display unit.

The video decoder 525 may support various standards. For example, the video decoder 525 functions as an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video signal is encoded in the Digital Multimedia Broadcasting (DMB) method or the H.264 standard. In this case, it may perform the function of an H.264 decoder.

Meanwhile, the image signal decoded by the image processing unit 520 is input to the mixer 450.

The OSD generator 540 generates OSD data by itself or according to a user input. For example, the OSD generation unit 440 generates data for displaying various types of data on the screen of the display unit 380 in the form of a graphic or text based on a control signal of the user input interface unit. The generated OSD data includes various data such as a user interface screen of a digital device, various menu screens, widgets, icons, and viewing rate information. The OSD generator 540 may also generate data for displaying a caption of a broadcast image or broadcast information based on EPG.

The mixer 550 mixes the OSD data generated by the OSD generation unit 540 with the image signal processed by the image processing unit and provides the mixture to the formatter 560. As the decoded video signal and OSD data are mixed, the OSD is displayed as an overlay on a broadcast video or an external input video.

The frame rate converter (FRC) 555 converts a frame rate of an input video. For example, the frame rate converter 555 may convert the frame rate of an input 60 Hz image to have a frame rate of, for example, 120 Hz or 240 Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when converting the frame rate from 60Hz to 120Hz, the frame rate converter 555 inserts the same first frame between the first frame and the second frame, or the first frame predicted from the first frame and the second frame. It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60Hz to 240Hz, the frame rate converter 555 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when separate frame conversion is not performed, the frame rate conversion unit 555 may be bypassed.

The formatter 560 changes the output of the input frame rate conversion unit 555 according to the output format of the display unit. For example, the formatter 560 may output R, G, B data signals, and these R, G, B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. Can be. In addition, when the output of the input frame rate converter 555 is a 3D image signal, the formatter 560 may support 3D service through the display unit by configuring and outputting in a 3D format suitable for an output format of the display unit.

Meanwhile, the voice processing unit (not shown) in the control unit may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing various audio formats. For example, even when a voice signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, a decoder corresponding thereto may be provided and processed.

In addition, a voice processing unit (not shown) in the control unit may process a base, a treble, and a volume control.

A data processing unit (not shown) in the control unit may perform data processing on the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcast on each channel.

Meanwhile, the above-described digital device is an example according to the present invention, and each component may be integrated, added, or omitted according to the specifications of the actual digital device. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, functions performed by each block are for explaining an embodiment of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

Meanwhile, the digital device may be an image signal processing device that performs signal processing of an image stored in the device or an input image. Other examples of the video signal processing device include a set-top box (STB) excluding the display unit 480 and the audio output unit 485 shown in FIG. 4, the above-described DVD player, Blu-ray player, game device, and computer. And the like may be further illustrated.

6 is a diagram illustrating an input means connected to the digital device of FIGS. 2 to 4 according to an embodiment of the present invention.

A front panel (not shown) or control means (input means) provided on the digital device 600 is used to control the digital device 600.

Meanwhile, the control means is a user interface device (UID) capable of wired and wireless communication, and is a remote control 610, a keyboard 630, a pointing device 620, which is mainly implemented for the control purpose of the digital device 600, A touch-pad or the like is included, but a control means for exclusive use of an external input connected to the digital device 600 may also be included. In addition, a mobile device such as a smart phone or a tablet PC that controls the digital device 600 through mode switching, etc., which is not for controlling the digital device 600 is also included in the control means. However, in this specification, for convenience, a pointing device is described as an example, but the present disclosure is not limited thereto.

Input means are communication protocols such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA), RS, etc. By employing at least one or more as necessary, it is possible to communicate with a digital device.

The remote control 610 refers to a conventional input means provided with various key buttons necessary for controlling the digital device 600.

The pointing device 620 implements a pointer corresponding to the screen of the digital device 600 based on the user's movement, pressure, rotation, etc. by mounting a gyro sensor, etc. ) To transmit a predetermined control command. The pointing device 620 may be named by various names such as a magic remote control and a magic controller.

The keyboard 630 is an intelligent integrated digital device that goes beyond the conventional broadcasting only and provides various services such as web browsers, applications, and SNS (Social Network Service), so that the conventional remote control 610 can be used alone to control the keyboard 630. It was not easy, and it was implemented to improve the convenience of inputting text, etc. by implementing it similar to the keyboard of a PC.

On the other hand, the control means such as the remote control 610, the pointing device 620, and the keyboard 630 are provided with a touch pad as necessary, so that text input, pointer movement, and enlargement/reduction of photos or videos are more convenient and various control purposes. Can be used for

The digital device described in this specification uses a webOS as an OS and/or a platform. Hereinafter, a webOS-based configuration or processing process such as an algorithm may be performed by the controller of the digital device. Here, the control unit is used in a broad sense including the control unit in FIGS. 2 to 5 described above. Therefore, in the following, for processing of services, applications, and contents based on or related to WebOS in a digital device, hardware or components including related software and firmware are used as a controller. Name and explain.

This webOS-based platform is for enhancing development independence and functional scalability by integrating services and applications based on, for example, Luna-service Bus, and application development based on web application framework. It can also increase productivity. In addition, it is possible to support multi-tasking by efficiently utilizing system resources and the like through WebOS process and resource management.

On the other hand, the webOS platform described in this specification can be used not only in fixed devices such as PCs, TVs, and set-top boxes (STBs), but also mobile devices such as mobile phones, smart phones, tablet PCs, notebooks, and wearable devices. .

The structure of software for digital devices is a single process and a closed product based on multi-threading technology with a monolithic structure dependent on the conventional problem solving and market. As a result, there was a difficulty in external application, and after that, we aimed to develop a new platform-based platform, and pursue cost innovation through chip-set replacement and efficiency of UI application and external application development, and layering and componentization. ) To have a 3-layered structure, add-on, single source product, and add-on structure for open application. In recent years, the software structure has been further developed to provide a modular architecture of functional units, a Web Open API (Application Programming Interface) for an eco-system, and a game engine. Modular design for a native open API, etc. is being made, and accordingly, it is created in a multi-process structure based on a service structure.

7 is a diagram illustrating a webOS architecture according to an embodiment of the present invention.

Referring to FIG. 7, the architecture of the webOS platform will be described as follows.

The platform can be broadly classified into a kernel, a system library-based Web OS core platform, an application, and a service.

The architecture of the WebOS platform is a layered structure, with OS at the bottom layer, system library(s) at the next layer, and applications at the top level.

First, the lowest layer may include a Linux kernel as an OS layer, and may include Linux as an OS of the digital device.

Above the OS layer, a Board Support Package (BSP) / Hardware Abstraction Layer (HAL) layer, a Web OS core modules layer, a service layer, and a Luna-Service bus layer Bus layer), Enyo framework/NDK (Native Developer Kit)/QT layer (Enyo framework/NDK/QT layer), and the application layer in the uppermost layer in sequence.

Meanwhile, some of the above-described webOS layer structures may be omitted, and a plurality of layers may be formed as one layer or, conversely, one layer may be formed as a plurality of layers.

The webOS core module layer is based on LSM (Luna Surface Manager) that manages surface windows, SAM (System & Application Manager) that manages application execution and execution status, and WebKit. Thus, it may include a Web Application Manager (WAM) that manages web applications and the like.

The LSM manages an application window displayed on the screen. The LSM manages the display hardware (Display HW), provides a buffer that can render content necessary for applications, and synthesizes the results of multiple applications on the screen. Can be printed.

The SAM manages execution policies for various conditions of systems and applications.

On the other hand, WAM is based on the Enyo Framework, as webOS can see a web application as a basic application.

The application's service use is performed through the Luna-service bus, and a service can be newly registered on the bus, and the application can find and use the service it needs.

The service layer may include services of various service levels, such as a TV service and a webOS service. Meanwhile, the webOS service may include a media server, Node.JS, and the like. In particular, the Node.JS service supports, for example, javascript.

WebOS service is a Linux process that implements function logic and can communicate over a bus. This can be largely divided into four parts, and services that are migrated from the TV process and existing TV to the webOS, or services that are differentiated by manufacturers, and are developed as webOS common services and JavaScript, and used through Node.js. It consists of a Node.js service.

The application layer may include all applications supported by a digital device, such as a TV application, a showcase application, a native application, and a web application.

Applications on the webOS may be classified into a web application, a PDK (Palm Development Kit) application, a QML (Qt Meta Language or Qt Modeling Language) application, and the like according to an implementation method.

The web application is based on a WebKit engine and is executed on a WAM runtime. Such web applications may be developed and executed based on the Enyo framework, or based on general HTML5, Cascading Style Sheets (CSS), and JavaScript.

The PDK application includes a native application developed in C/C++ based on a PDK provided for a third-party or external developer. The PDK refers to a set of development libraries and tools provided so that third parties such as games can develop native applications (C/C++). For example, the PDK application can be used in the development of an application whose performance is important.

The QML application is a Qt-based native application, and includes basic applications provided with the webOS platform, such as card view, home dashboard, and virtual keyboard. Here, QML is a mark-up language in the form of a script instead of C++.

Meanwhile, in the above, a native application refers to an application developed in C/C++, compiled, and executed in a binary form, and such a native application has the advantage of having a high execution speed.

8 is a diagram illustrating an architecture of a webOS device according to an embodiment of the present invention.

FIG. 8 is a block diagram based on the runtime of the webOS device, which can be understood with reference to the layered structure of FIG. 7.

Hereinafter, description will be made with reference to FIGS. 7 and 8.

Referring to FIG. 8, services, applications, and webOS core modules are included on a system OS (Linux) and system libraries, and communication between them may be performed through a Luna-service bus.

Node.js services based on HTML5, CSS, and java script, such as e-mail, contact, and calendar, logging, backup, and file notifications notify), database (DB), activity manager, system policy, audio daemon (AudioD: Audio Daemon), update, webOS services such as media server, EPG TV services such as (Electronic Program Guide), PVR (Personal Video Recorder), and data broadcasting, voice recognition, Now on, Notification, and search , Auto Content Recognition (ACR), Contents List Broswer (CBOX), wfdd, DMR, Remote Application, download, CP services such as SDPIF (Sony Philips Digital Interface Format), PDK applications, browser , Native applications such as QML applications, and UI-related TV applications and web applications based on the Enyo framework are processed through the aforementioned webOS core modules such as SAM, WAM, and LSM through the Luna-service bus. Meanwhile, in the above, TV applications and web applications may not necessarily be based on the Enyo framework or related to UI.

CBOX can manage the list and metadata of the contents of external devices such as USB, DLNA, and cloud connected to the TV. Meanwhile, the CBOX can output content listings of various content containers such as USB, DMS, DVR, and cloud as an integrated view. In addition, CBOX can display various types of content listings, such as pictures, music, and videos, and manage their metadata. In addition, the CBOX may output contents of an attached storage device in real-time. For example, when a storage device such as USB is plugged in, the CBOX must be able to immediately output a content list of the storage device. In this case, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate various connection protocols.

The SAM is intended to improve module complexity and improve scalability. For example, the existing system manager handles various functions such as system UI, window management, web application runtime, and constraints processing on UX in one process. Implementation complexity is reduced by clarifying the interface between them.

LSM supports independent development and integration of system UX implementations such as card view and launcher, and supports easy response to changes in product requirements. On the other hand, LSM enables multi-tasking by maximizing hardware resources (HW resources) when synthesizing multiple application screens such as App-on-App. Multi-window and 21:9 It can provide a window management mechanism for.

LSM supports the implementation of system UI based on QML and improves its development productivity. QML UX is based on MVC, and it is possible to easily compose a view of a screen layout and UI components, and to easily develop a code for handling user input. On the other hand, the interface between QML and the webOS component is made through the QML extension plug-in, and the graphic operation of the application can be based on the wayland protocol and luna-service call. have.

As described above, LSM is an abbreviation of Luna Surface Manager and functions as an application window compositor.

LSM combines independently developed applications and UI components on the screen and displays them. Relatedly, when components such as a Recents application, a showcase application, and a launcher application each render their own content, the LSM defines an output area and an interworking method as a compositor. In other words, the compositor LSM handles graphic synthesis, focus management, and input events. At this time, the LSM receives events, focus, and the like from an input manager. These input managers may include a remote controller, HID such as a mouse & keyboard, a joystick, a game pad, an application remote, and a pen touch.

As described above, LSM supports multiple window models, which can be executed simultaneously in all applications due to the system UI characteristics. Regarding, launcher, receipts, setting, notification, system keyboard, volume UI, search, finger gesture, Voice Recognition (STT (Sound to Text), TTS (Text to Text)) Sound), NLP (Natural Language Processing), etc.), pattern gesture (camera, MRCU (Mobile Radio Control Unit)), live menu, ACR (Auto Content Recognition), etc. can be supported by LSM. .

FIG. 9 is a diagram illustrating a graphic composition flow in a webOS device according to an embodiment of the present invention.

Referring to FIG. 9, graphic composition processing includes a web application manager 910 in charge of a UI process, a webkit 920 in charge of a web process, an LSM 930, and a graphic manager (GM). It can be done through 940.

When web application-based graphic data (or application) is generated as a UI process in the web application manager 910, the generated graphic data is transmitted to the LSM 930 if it is not a full-screen application. Meanwhile, the web application manager 910 receives the application generated by the web kit 920 to share a graphic processing unit (GPU) memory for graphic management between the UI process and the web process, and receives the application generated by the web kit 920 as described above, If it is not an application, it is transmitted to the LSM 930. In the case of a full-screen application above, the LSM 930 may be bypassed, and in this case, it may be directly transmitted to the graphic manager 940.

The LSM 930 transmits the received UI application to the Wayland Compositor via the Wayland surface, processes it properly in the Wayland compositor, and delivers it to the graphic manager. In this way, the graphic data transmitted from the LSM 930 is transmitted to the graphic manager compositor through the LSM GM surface of the graphic manager 940, for example.

Meanwhile, as described above, the full-screen application is directly transferred to the graphic manager 940 without passing through the LSM 930, and such an application is processed in the graphic manager compositor through the WAM GM surface.

The graphic manager processes all graphic data in the WebOS device, including data that has passed through the LSM GM surface and data through the WAM GM surface as described above, as well as the GM surface, such as a data broadcasting application and a caption application. It receives all the graphic data that has passed through and processes it to be properly output on the screen. Here, the function of the GM compositor is the same or similar to the above-described compositor.

10 is a diagram illustrating a media server according to an embodiment of the present invention, and FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.

The media server supports execution of various multimedia in digital devices and manages necessary resources. The media server can efficiently use hardware resources required for media play. For example, the media server requires audio/video hardware resources to execute multimedia, and manages the resource usage status and utilizes them efficiently. In general, a fixed device having a larger screen than a mobile device requires more hardware resources when executing multimedia, and must also have a faster encoding/decoding and graphic data transfer speed due to a large amount of data. On the other hand, the media server, in addition to streaming and file-based playback, includes broadcasting, recording and tuning tasks, recording at the same time as viewing, or displaying the sender and receiver screens at the same time during a video call. You should be able to handle the back. However, in the media server, hardware resources such as encoders, decoders, tuners, and display engines are limited on a per-chip-set basis, making it difficult to execute multiple tasks at the same time, for example, limiting usage scenarios or user selection. Is received and processed.

The media server can enhance system stability. This is because, for example, the playback pipeline in which an error occurred during media playback can be removed for each pipeline and restarted, thereby causing an error as described above. Even if it may not affect other media play. Such a pipeline is a chain that connects unit functions such as decoding, analysis, and output when a media playback request is requested, and necessary unit functions may vary according to a media type.

The media server may have extensibility, and for example, a new type of pipeline may be added without affecting the existing implementation method. For example, the media server may accommodate a camera pipeline, a video conference (Skype) pipeline, a third-party pipeline, and the like.

The media server can process general media playback and TV task execution as separate services, because the interface of the TV service is different from the media playback case. In the above, the media server supports operations such as setchannel, channelup, channeldown, channeltuning, and recordstart in relation to TV services, and supports operations such as play, pause, and stop in relation to general media playback. It supports operations and can be processed as separate services.

The media server can control or integrated management of resource management functions. Hardware resource allocation and retrieval in the device are integrated in the media server, and in particular, the TV service process delivers the running task and resource allocation status to the media server. Whenever each media is executed, the media server secures resources and executes the pipeline. Based on the status of the resources occupied by each pipeline, the media server allows execution according to priority (eg, policy) when requesting media execution and Retrieves resources from other pipelines, etc. Here, a predefined execution priority and necessary resource information for a specific request are managed by a policy manager, and the resource manager communicates with the policy manager to handle resource allocation and retrieval.

The media server may hold an identifier (ID) for all operations related to playback. For example, the media server may instruct a specific pipeline based on the identifier and issue a command. The media server may issue commands to the pipelines for playing more than one media.

The media server can be responsible for playing HTML 5 standard media.

In addition, in the media server, the separate service process of the TV pipeline may follow the TV restructuring range. The media server may be designed and implemented irrespective of the TV restructuring range. If the TV is not processed as a separate service, the entire TV may need to be re-executed when a problem occurs in a specific task.

The media server is also referred to as uMS, that is, a micro media server. Here, the media player is a media client, which is, for example, a web for HTML5 video tag, camera, TV, Skype, 2nd Screen, etc. It can mean a kit (Webkit).

In the media server, management of micro resources such as a resource manager and a policy manager is a core function. In relation to this, the media server also controls a playback control role for web standard media content. In this regard, the media server may also manage a pipeline controller resource.

Such a media server supports, for example, extensibility, reliability, and efficient resource usage.

In other words, uMS, that is, a media server, is a webOS device such as a cloud game, MVPD (pay service, etc.), a camera preview, a second screen, a resource such as Skype, and a TV resource. It manages and controls the use of resources for proper processing in the overall management and control so that efficient use is possible. Meanwhile, when each resource is used, for example, a pipeline is used, and the media server can generally manage and control the creation, deletion, and use of a pipeline for resource management.

Here, the pipeline is created when, for example, the media related to a task starts a series of tasks such as parsing a request, a decoding stream, and a video output. Can be. For example, in relation to TV services or applications, watching, recording, channel tuning, etc. are handled by receiving control over resource usage, etc., through pipelines created according to the respective requests. .

With reference to FIG. 10, the processing structure of the media server will be described in more detail as follows.

In FIG. 10, an application or service is connected to a media server 1020 through a Luna-service bus 1010, and the media server 1020 includes pipelines recreated through the Luna-service bus 1010. Connect and manage.

An application or service may have various clients according to its characteristics, and may exchange data with the media server 1020 or a pipeline through them.

The clients include, for example, a uMedia client (web kit) for connection with the media server 1020 and a resource manager (RM) client (C/C++).

The application including the uMedia client is connected to the media server 1020 as described above. In more detail, the uMedia client corresponds to, for example, a video object to be described later, and this client uses the media server 1020 to operate the video by request or the like.

Here, the video operation relates to a video state, and loading, unloading, play, playback, or reproduce, pause, stop, etc. are all states related to the video operation. May contain data. Each action or state of these videos can be processed through the creation of a separate pipeline. Accordingly, the uMedia client transmits state data related to the video operation to the pipeline manager 1022 in the media server.

The pipeline manager 1022 obtains information on a resource of a current device through data communication with the resource manager 1024 and requests allocation of a resource corresponding to the state data of the uMedia client. At this time, the pipeline manager 1022 or the resource manager 1024 controls resource allocation through data communication with the policy manager 1026 when necessary in relation to the resource allocation. For example, when there is no or insufficient resource to be allocated according to the request of the pipeline manager 1022 in the resource manager 1024, appropriate resource allocation may be performed according to the request according to the priority comparison of the policy manager 1026. I can.

Meanwhile, the pipeline manager 1022 requests the media pipeline controller 1028 to create a pipeline for an operation according to the request of the uMedia client with respect to the resource allocated according to the resource allocation of the resource manager 1024. .

The media pipeline controller 1028 creates a necessary pipeline under the control of the pipeline manager 1022. In the pipeline thus generated, as illustrated, not only a media pipeline and a camera pipeline, but also a pipeline related to play, pause, and stop may be generated. Meanwhile, the pipeline may include a pipeline for HTML5, web CP, smartshare playback, thumbnail extraction, NDK, cinema, Multimedia and Hypermedia Information Coding Experts Group (MHEG), and the like.

In addition, the pipeline may include, for example, a service-based pipeline (its own pipeline) and a URI-based pipeline (media pipeline).

Referring to FIG. 10, an application or service including an RM client may not be directly connected to the media server 1020. This is because an application or service may directly handle media. In other words, when an application or service directly processes media, it may not go through the media server. However, in this case, resource management is required for the creation and use of the pipeline, so the uMS connector functions. Meanwhile, when a resource management request for direct media processing of the application or service is received, the uMS connector communicates with the media server 1020 including the resource manager 1024. For this, the media server 1020 must also be equipped with a uMS connector.

Accordingly, the application or service can respond to the request of the RM client by receiving resource management of the resource manager 1024 through the uMS connector. These RM clients can handle services such as native CP, TV service, second screen, flash player, YouTube Medai Source Extensions (MSE), cloud games, and Skype. In this case, as described above, the resource manager 1024 may properly manage resources through data communication with the policy manager 1026 when necessary for resource management.

On the other hand, the URI-based pipeline is performed through the media server 1020 rather than the case of directly processing media like the above-described RM client. Such a URI-based pipeline may include a player factory, a Gstreamer, a streaming plug-in, a digital rights management (DRM) plug-in pipeline, and the like.

Meanwhile, an interface method between an application and media services may be as follows.

This is a method to interface using a service in a web application. This is a method of using Luna Call using PSB (Palm Service Bridge) and a method using Cordova, which extends the display to a video tag. In addition, there may be ways to use the HTML5 standard for video tags or media elements.

In addition, this is a method of interfacing by using a service in the PDK.

Or, it is a method of using a service in an existing CP. This can be used by extending the plug-in of the existing platform based on Luna for backward compatibility.

Finally, this is how to interface in the case of non-WebOS. In this case, you can interface by calling the Luna bus directly.

Seamless change is handled by a separate module (for example, TVWIN), which is a process to show the TV first on the screen without webOS and handle it seamlessly before or during booting of the webOS. . This is used for the purpose of providing a basic function of a TV service in order to quickly respond to a user's Power On request because the booting time of the webOS is slow. In addition, the module supports a seamless change, factory mode, etc. that provide fast booting and basic TV functions as part of the TV service process. In addition, the module may be responsible for switching from a non-webOS mode to a webOS mode.

Referring to FIG. 11, a processing structure of a media server is shown.

In this case, in FIG. 11, a solid box indicates a process processing configuration, and a dotted box may indicate an internal processing module during a process. Further, a solid arrow may indicate an inter-process call, that is, a Luna service call, and a dotted arrow may indicate a notification such as register/notify or a data flow.

A service or a web application or a PDK application (hereinafter referred to as an application) is connected to various service processing configurations through a Luna-service bus, through which the application is operated or operation is controlled.

The data processing path varies depending on the type of application. For example, if the application is image data related to a camera sensor, it is transmitted to the camera processing unit 1130 and processed. In this case, the camera processing unit 1130 processes image data of the received application, including a gesture and a face detection module. Here, the camera processing unit 1130 may process the data by creating a pipeline through the media server processing unit 1110, in the case of data that is requested by the user to select or automatically use a pipeline.

Alternatively, when the application includes audio data, the audio may be processed through the audio processing unit (AudioD) 1140 and the audio module (PulseAudio) 1150. For example, the audio processing unit 1140 processes audio data received from an application and transmits the processed audio data to the audio module 1150. In this case, the audio processing unit 1140 may include an audio policy manager to determine processing of audio data. The audio data processed in this way is processed by the audio module 1160. Meanwhile, the application may notify data related to audio data processing to the audio module 1160, which may also notify the audio module 1160 in a related pipeline. The audio module 1150 includes an Advanced Linux Sound Architecture (ALSA).

Alternatively, when the application contains or processes (hereinafter included) content on which DRM is applied, the corresponding content data is transmitted to the DRM service processing unit 1160, and the DRM service processing unit 1170 creates a DRM instance. Thus, the content data with DRM is processed. Meanwhile, the DRM service processing unit 1160 may be connected to and processed through a DRM pipeline in a media pipeline and a Luna-service bus to process the content data on which the DRM is applied.

Hereinafter, processing when the application is media data or TV service data (eg, broadcast data) will be described.

FIG. 12 is a diagram for describing in more detail only the media server processing unit and the TV service processing unit in FIG. 11 described above.

Therefore, hereinafter, it will be described with reference to FIGS. 11 and 12 together.

First, when the application includes TV service data, it is processed by the TV service processing unit 1120/1220.

Here, the TV service processing unit 1120 includes at least one of, for example, a DVR/channel manager, a broadcasting module, a TV pipeline manager, a TV resource manager, a data broadcasting module, an audio setting module, and a path manager. Alternatively, in FIG. 12, the TV service processing unit 1220 includes a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV MW (middleware)), a path manager, and a BSP ( For example, NetCast). Here, the service processing unit may mean a module including, for example, a TV pipeline manager, a TV resource manager, a TV policy manager, and a USM connector.

In the present specification, the TV service processor may have a configuration as shown in FIG. 11 or 12 or may be implemented as a combination of both, and some configurations may be omitted or some components not shown may be added.

The TV service processing unit (1120/1220) transmits the digital video recorder (DVR) or channel-related data to the DVR/channel manager based on the attribute or type of TV service data received from the application, and then transmits the data to the DVR/channel manager. It is transmitted to and processed by creating a TV pipeline. Meanwhile, when the property or type of the TV service data is broadcast content data, the TV service processing unit 1120 generates and processes a TV pipeline through a TV pipeline manager to process the data through a broadcast module.

Alternatively, a json (Javascript standard object notation) file or a file written in c is processed by a TV broadcast handler and transmitted to a TV pipeline manager through a TV broadcast interface to create and process a TV pipeline. In this case, the TV broadcast interface unit may transmit the data or file that has passed the TV broadcast handler to the TV pipeline manager based on the TV service policy and refer to the pipeline creation.

Meanwhile, the TV pipeline manager may receive control of the TV resource manager when generating one or more pipelines according to a TV pipeline generation request from a processing module or a manager within a TV service. Meanwhile, the TV resource manager may receive the control of the TV policy manager to request the status and allocation of resources allocated for TV service according to the TV pipeline creation request from the TV pipeline manager, and the media server processing unit 1110 /1210) and uMS connector for data communication. The resource manager in the media server processing unit 1110/1210 transmits the status of the resource for the current TV service and whether or not to be allocated according to the request of the TV resource manager. For example, as a result of checking the resource manager in the media server processing unit 1110/1210, if all resources for a TV service are already allocated, the TV resource manager may notify that all resources are currently allocated. At this time, the resource manager in the media server processing unit removes a predetermined TV pipeline according to a priority or a predetermined criterion among TV pipelines pre-allocated for TV service, along with the notification, and a TV pipeline for the requested TV service. Creation can also be requested or assigned. Alternatively, the TV resource manager may properly remove, add, or create a TV pipeline according to a status report of the resource manager in the media server processing unit 1110/1210.

Meanwhile, the BSP supports backward compatibility, for example, with existing digital devices.

The TV pipelines created in this way can be properly operated under the control of the path manager in the process. The path manager may determine or control a processing path or process of the pipelines in consideration of not only the TV pipeline but also the operation of the pipeline generated by the media server processing unit 1110/1210 during the processing.

Next, when the application includes media data rather than TV service data, it is processed by the media server processing unit 1110/1210. Here, the media server processing unit 1110/1210 includes a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, and the like. On the other hand, in the pipeline created under the control of the media pipeline manager and the media pipeline controller, a camera preview pipeline, a cloud game pipeline, and a media pipeline can be variously created. Meanwhile, the media pipeline may include a streaming protocol, an automatic/static gstreamer, and DRM, and the processing flow may be determined according to the control of the path manager. The detailed processing process in the media server processing unit 1110/1210 uses the description of FIG. 10 described above, and the description is not repeated here.

In this specification, the resource manager in the media server processing unit 1110/1210 may manage resources on a counter-based basis, for example.

13 is a diagram illustrating a control method of a remote control device that controls any one of image display devices according to embodiments of the present invention.

As illustrated in FIG. 13A, a pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right (FIG. 13(b)), back and forth (FIG. 13(c)). The pointer 205 displayed on the display unit 180 of the video display device corresponds to the movement of the remote control device 200. As shown in the figure, since the corresponding pointer 205 is moved and displayed according to movement in the 3D space, the remote control device 200 may be referred to as a space remote control.

13B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the image display device also moves to the left in response thereto.

Information on the movement of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The video display device may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The video display device may display the pointer 205 to correspond to the calculated coordinates.

13C illustrates a case in which the user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. Accordingly, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in and displayed in an enlarged manner. On the contrary, when the user moves the remote control device 200 to be close to the display unit 180, a selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size. On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

On the other hand, when a specific button in the remote control device 200 is pressed, recognition of vertical and horizontal movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, but only forward and backward movements may be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movement of the remote control device 200.

Meanwhile, the moving speed or moving direction of the pointer 205 may correspond to the moving speed or moving direction of the remote control device 200.

Meanwhile, in the present specification, a pointer refers to an object displayed on the display unit 180 in response to an operation of the remote control device 200. Accordingly, the pointer 205 can be used to make objects of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, and a thick outline. In addition, the pointer 205 may be displayed in correspondence with any one of a horizontal axis and a vertical axis on the display unit 180, as well as a plurality of points such as a line and a surface. Do.

14 is an internal block diagram of a remote control device that controls any one of image display devices according to embodiments of the present invention.

As shown in Fig. 14, the remote control device 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, and a storage unit 270. , It may include a control unit 280.

The wireless communication unit 225 transmits and receives signals to and from any one of the image display devices according to the embodiments of the present invention described above. Among the image display devices according to embodiments of the present invention, one image display device 100 will be described as an example.

In this embodiment, the remote control device 200 may include an RF module 221 capable of transmitting and receiving signals to and from the image display device 100 according to an RF communication standard. In addition, the remote control device 200 may include an IR module 223 capable of transmitting and receiving signals to and from the image display device 100 according to the IR communication standard.

In this embodiment, the remote control device 200 transmits a signal containing information about the motion of the remote control device 200 to the image display device 100 through the RF module 221.

In addition, the remote control device 200 may receive a signal transmitted from the image display device 100 through the RF module 221. In addition, the remote control device 200 may transmit commands regarding power on/off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as needed.

The user input unit 235 may include a keypad, a button, a touch pad, or a touch screen. A user may input a command related to the image display device 100 to the remote control device 200 by manipulating the user input unit 235. When the user input unit 235 includes a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through a push operation of the hard key button. When the user input unit 235 includes a touch screen, the user can input a command related to the image display device 100 to the remote control device 200 by touching a soft key on the touch screen. In addition, the user input unit 235 may include various types of input means that a user can manipulate, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243.

The gyro sensor 241 may sense information on the movement of the remote control device 200.

As an example, the gyro sensor 241 may sense information about the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 243 may sense information about a moving speed of the remote control device 200. Meanwhile, a distance measurement sensor may be further provided, thereby sensing a distance to the display unit 180.

The output unit 250 may output a video or audio signal corresponding to an operation of the user input unit 235 or a signal transmitted from the video display device 100. Through the output unit 250, the user may recognize whether the user input unit 235 is operated or whether the image display device 100 is controlled.

For example, the output unit 250 is an LED module 251 that lights up when a user input unit 235 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, a vibration module that generates vibration ( 253), a sound output module 255 for outputting sound, or a display module 257 for outputting an image may be provided.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 may reduce power waste by stopping power supply when the remote control device 200 is not moved for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control device 200. If the remote control device 200 transmits and receives signals wirelessly through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band. Send and receive. The control unit 280 of the remote control device 200 stores information on the video display device 100 paired with the remote control device 200 and a frequency band through which signals can be transmitted and received in the storage unit 270, and You can refer to it.

The controller 280 controls all matters related to the control of the remote control device 200. The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225. Can be transmitted to (100).

Hereinafter, embodiments related to a control method that can be implemented in a display device configured as described above will be described with reference to the accompanying drawings. It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential specificity of the present invention.

Further, hereinafter, embodiments of the present invention will be described by taking the display device shown in FIG. 15 as an example as a display device. However, it goes without saying that the display device according to an embodiment of the present invention may be implemented as the display device shown in FIGS. 1 to 14.

In addition, hereinafter, a display device and a control method thereof will be described in detail with reference to FIGS. 15 to 24. However, the person skilled in the art may supplementary interpretation of FIGS. 15 to 24 or modify the embodiments with reference to FIGS. 1 to 14 described previously.

15 is a configuration diagram of a display device according to an embodiment of the present invention.

Referring to FIG. 15, the display device 1500 includes a tuner 1510, a communication unit 1520, a control unit 1530, a display 1540, a speaker 1550, a microphone 1560, a memory 1570, and a camera 1580. ).

The tuner 1510 receives a broadcast signal from a broadcasting station.

The communication unit 1520 transmits and receives data to and from the external device 1600. The external device 1600 includes a manufacturer server.

The controller 1530 controls at least one of the tuner 1510, the communication unit 1520, the display 1540, and the sensor unit 1550.

When the sensor unit 1550 senses an abnormality in the display panel 1540, the control unit 1530 counts the number of toggles corresponding to the abnormality symptom of the display panel 1540 by referring to the memory 1570, and the display panel 1540 ) Controls to display the counted toggle count on the screen.

The display panel 1540 includes a plurality of pixels. In more detail, the display panel 1540 includes a pixel matrix composed of pixels formed in each area defined by the intersection of the gate lines GL and the data lines DL. Each of the pixels includes a liquid crystal cell Clc for controlling the amount of light transmission according to a pixel signal, and thin film transistors TFT for driving the liquid crystal cell Clc.

The sensor unit 1550 senses an abnormality in the display panel 1540.

The filter unit 1560 removes noise from the output signal from the display panel 1540.

The memory 1570 stores abnormalities of the display panel 1540 for each item. The memory 1570 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, It may include at least one type of storage medium among magnetic disks and optical disks. The display device 1500 may operate in connection with a web storage that performs a storage function of the memory 1570 on the Internet.

The memory 1570 may be designed to be built into the display panel 1540.

According to an embodiment of the present invention, when a problem occurs in the display panel, a signal indicating that the problem has occurred may be immediately transmitted to a manufacturer server.

The communication unit 1520 transmits and receives data to and from the external device 1600.

When the sensor unit 1550 senses an abnormality in the display panel 1540, the control unit 1530 controls the communication unit 1520 to transmit a first signal indicating a problem occurrence to the external device 1600.

The external device 1600 includes a manufacturer server and a mobile device connected to the display device 1500.

According to the present invention, when a problem occurs in the display panel, a signal indicating that the problem has occurred is immediately transmitted to the manufacturer's server, so that immediate action can be taken, thereby improving user convenience.

16 is a diagram illustrating a method of controlling a display device according to an embodiment of the present invention. The present invention is implemented by the control unit 1530.

The abnormality of the display panel 1540 is stored in the memory 1570 for each item (S1610).

The display panel 1540 is sensed through the sensor unit 1550 (S1620).

When the sensor unit 1550 senses an abnormality in the display panel (S1630), the number of toggles corresponding to the abnormality symptoms of the display panel 1540 is counted with reference to the memory 1570 (S1640).

If the sensor unit 1550 does not sense an abnormality in the display panel 1540, the display panel 1540 is again sensed through the sensor unit 1550 (S1620).

The display panel 1540 controls to display the counted toggle count on the screen (S1650).

17 is a diagram illustrating determining a cause of occurrence when BPD occurs in a display panel according to an embodiment of the present invention.

Referring to FIG. 17, first, the sensor unit 1550 periodically senses an abnormality in the display panel 1540. Specifically, the sensor unit 1550 periodically senses the cause of the BDP occurrence of the display panel 1540. Here, BDP stands for Burnt Detect Protection, which means that a problem has occurred in the display panel. The display panel 1540 includes an OLED display panel.

Next, when the sensor unit 1550 senses an abnormality in the display panel 1540, the control unit 1530 removes noise from the output signal from the display panel 1540.

The controller 1530 refers to the memory 1570 and counts the number of toggles corresponding to an abnormal symptom of the display panel 1540. That is, the control unit 1530 counts the number of toggles corresponding to the BDP case of the display panel 1540.

The control logic of the controller 1530 includes an OR-GATE, and outputs an output voltage Vin by varying the number of toggles corresponding to each BDP case. That is, the output voltage is output by varying the number of toggles for each BDP cause.

The control unit 1530 receives an output voltage through a Micom interrupt PIN as an input, performs an edge count, and counts the number of toggles.

The control unit 1530 includes a PMIC. Power management integrated circuit (PMIC) is an IC that manages power and distributes the required power appropriately to the characteristics of the circuit.

BDP case includes BDP by VGH overcurrent, BDP by VGLUD, BDP by VGL2 overcurrent, and Shut Down BDP. A description of the BDP case is described in FIG. 19.

18 is a diagram illustrating counting the number of toggles based on an output voltage according to an embodiment of the present invention. FIG. 18 includes FIGS. 18(a) and 18(b).

Fig. 18(a) is a diagram showing that a toggle signal is generated twice. Referring to FIG. 18A, the control unit 1530 receives an input signal from the sensor unit 1550 through a microcomputer interrupt pin, counts the edge of the input signal, and counts the number of toggles. The input signal may be a voltage input signal Vin. The maximum value of Vin is 3.3 V.

Next, the meaning of the number of toggles will be described. One toggle count means two edge counting.

For example, a first edge and a second edge are added to count one toggle count.

Next, the end of the number of toggles will be described.

Referring to FIG. 18A, the controller 1530 counts the number of toggles, and when the input signal remains in the high state 1810 for a predetermined time or longer, the counting of the number of toggles is terminated. The control unit 1530 ends the counting of the number of toggles and turns off the power.

18(b) is a diagram showing that the toggle signal is generated three times. Referring to FIG. 18B, the controller 1530 receives an input signal from the sensor unit 1550 through a microcomputer interrupt pin and counts the number of toggles by counting the edge of the input signal.

Referring to FIG. 18(b), the edge is generated 6 times, and the number of toggles is counted 3 times. The controller 1530 counts the number of toggles, and when the input signal remains in the high state 1820 for a predetermined time or longer, the counting of the number of toggles ends. The control unit 1530 ends the counting of the number of toggles and turns off the power.

19 is a diagram illustrating a BDP case according to an embodiment of the present invention.

Referring to FIG. 19, the first case is a BDP case that detects overcurrent when power is turned on. The number of toggles is 0.

The second case is a BDP case due to VGH overcurrent. The number of toggles is 1, where VGH is the gate-on voltage.

Case 3 is a BDP case due to VGL1 overcurrent. The number of toggles is 2 times. Here, VGL means a gate-off voltage. For example, VGL1 could be 700 mA. If the current magnitude exceeds 700 mA, the third case occurs.

Case 4 is a BDP case caused by VGL2 overcurrent. The number of toggles is 3 times. Here, VGL means a gate-off voltage. For example, VGL2 could be 950 mA. When the magnitude of the current exceeds 950 mA, the fourth case occurs.

Case 5 is a BDP case by VGLUD. The number of toggles is 4 times.

Case 6 is a BDP case by PMIC Shut Down. The number of toggles is 5 times. PMIC stands for Power Management Integrated Circuit, which means an IC that manages power and distributes the required power appropriately.

Case 7 is a BDP case by level shift, EPI Lock, and Sensing BDP. The number of toggles is 6 times.

When at least one of a BDP case by level shift, a BDP case by EPI lock, and a BDP case by sensing BDP occurs, the controller 1530 counts the number of toggles 6 times.

Here, EPI is an abbreviation of Embedded clock point-point interface and means a method in which the timing controller and the source drive IC perform one-to-one communication.

The memory 1570 stores each BDP case. When the sensor unit 1550 senses an abnormality in the display panel 1540, the control unit 1530 refers to the memory 1570 and counts the number of toggles corresponding to the abnormality symptom of the display panel 1540.

FIG. 20 is a diagram illustrating an example of performing a toggle count when a BPD occurs in a display panel according to an embodiment of the present invention.

Referring to FIG. 20, a gate driver 1542 shifts a gate start pulse (GSP) from a timing controller according to a gate shift clock (GSC) to the gate lines GL1 to GLm. The scan pulses having the gate-on voltage VGH from the power supply are sequentially supplied.

First, a problem occurs in the display panel 1540. The sensor unit 1550 periodically senses an abnormality in the display panel 1540. Specifically, the sensor unit 1550 periodically senses the cause of the BDP occurrence of the display panel 1540. Here, BDP is an abbreviation of burnt detect protection, which means that a problem has occurred in the display panel 1540. The display panel 1540 includes an OLED display panel.

Next, when the sensor unit 1550 senses an abnormality in the display panel 1540, the control unit 1530 removes noise from the output signal from the display panel 1540.

The controller 1530 refers to the memory 1570 and counts the number of toggles corresponding to an abnormal symptom of the display panel 1540. That is, the control unit 1530 counts the number of toggles corresponding to the BDP case of the display panel 1540.

The control logic of the controller 1530 includes an OR-GATE, and outputs an output voltage Vin by varying the number of corresponding toggles for each individual BDP case. That is, the output voltage is output by varying the number of toggles for each BDP cause.

The control unit 1530 receives an output voltage through a Micom interrupt PIN as an input, performs an edge count, and counts the number of toggles.

The control unit 1530 includes a PMIC. Power management integrated circuit (PMIC) is an IC that manages power and distributes necessary power appropriately to the characteristics of the circuit.

BDP case includes RT Sensing, overcurrent detection BDP in normal operation section, overcurrent detection BDP in power on-off RS section, BDP by VGL overcurrent, BDP by VGH overcurrent, and BDP by EPI lock check. A description of the BDP case is described in FIG. 19.

21 is a diagram illustrating an embodiment of displaying a first UI of a BDP toggle count according to an embodiment of the present invention.

Referring to FIG. 21, when the sensor unit 1550 senses an abnormality in the display panel 1540, the controller 1530 refers to the memory 1570 and counts the number of toggles corresponding to the abnormality symptoms of the display panel 1540. Then, the display panel 1540 is controlled to display the counted toggle count on the screen. Here, the display panel 1540 may be an OLED panel 2110.

When the BDP toggle count occurs 6 times, the control unit 1530 displays the toggle count 2120 of the display panel 1540 on the screen.

22 is a diagram illustrating an embodiment of displaying a second UI of a BDP toggle count according to an embodiment of the present invention.

Referring to FIG. 22, when the controller 1530 senses an abnormality in the display panel 1540 of the sensor unit 1550, the controller 1530 refers to the memory 1570 and counts the number of toggles corresponding to the abnormality symptom of the display panel 1540. , The display panel 1540 controls to display the counted toggle count on the screen. Here, the display panel 1540 may be an OLED panel.

Referring to FIG. 22, when the BDP toggle count occurs six times, the controller 1530 displays the six toggle count 2210 by the display panel 1540 on the screen.

According to an embodiment of the present invention, when a problem occurs in the display panel, the number of toggles corresponding to an abnormal symptom of the display panel is counted, and the number of toggles is displayed on the screen so that the user can immediately know the cause of the BDP. Can improve.

According to another embodiment of the present invention, when a problem occurs in the field by counting the number of toggles differently for each abnormal symptom of the display panel, it is not necessary to perform a reproduction test again to determine the cause of the BDP, and the cause of the problem is immediately known. Can and can improve user convenience because appropriate measures can be taken.

According to another embodiment of the present invention, when the sensor unit senses a problem with the display panel, the first signal indicating that the problem has occurred is transmitted to the manufacturer server, so that the manufacturer can identify the problem, thus improving user convenience. have.

The image display device and its operation method according to the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments are all or part of each embodiment so that various modifications can be made. May be configured by selectively combining.

Meanwhile, the method of operating a video display device of the present invention may be implemented as a code that can be read by a processor on a recording medium that can be read by a processor provided in the video display device. The processor-readable recording medium includes all types of recording devices that store data that can be read by the processor. Examples of recording media that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and also include those implemented in the form of carrier waves such as transmission through the Internet. . In addition, the recording medium readable by the processor may be distributed over a computer system connected through a network, so that code readable by the processor may be stored and executed in a distributed manner.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

1500: display device
1510: tuner 1520: communication unit
1530: control unit 1540: display panel
1550: sensor unit 1560: filter unit
1570: memory

Claims (12)

In the display device 1500,
A display panel 1540 including a plurality of pixels;
A memory 1570 for storing abnormalities of the display panel for each item;
A sensor unit 1550 for sensing the display panel; And
When the sensor unit senses the abnormality of the display panel, counting the number of toggles corresponding to the abnormality symptom of the display panel with reference to the memory,
Controlling the display panel to display the counted number of toggles on the screen,
Receiving an input signal from the sensor unit,
Including a control unit (1530) for counting the number of times the toggle by counting the edge of the input signal,
Display device. The method of claim 1, wherein the control unit
Counting the number of toggles differently for each abnormal symptom of the display panel,
Display device. delete The method of claim 1,
One of the number of times of the toggle means two times of edge counting.
Display device. The method of claim 1, wherein the control unit
Counting the number of times of the toggle, and if the input signal remains high for a predetermined time or longer, ending counting of the number of toggles,
Display device. The method of claim 1,
Further comprising a communication unit 1520 for transmitting and receiving data with an external device (manufacturer server),
When the sensor unit senses an abnormality in the display panel, the control unit controls the communication unit to transmit a first signal indicating an occurrence of an abnormality in the display panel to the external device,
Display device. In the control method of the display device,
Storing the abnormality of the display panel 1540 in the memory 1570 for each item (S1610);
Sensing the display panel through a sensor unit (S1620);
When the sensor unit 1550 senses the abnormality of the display panel (S1630), counting the number of toggles corresponding to the abnormality symptom of the display panel by referring to the memory (S1640);
Controlling the display panel to display the counted number of toggles on a screen (S1650);
Receiving an input signal from the sensor unit; And
Counting the number of toggles by counting the edge of the input signal
Control method of a display device comprising a. The method of claim 7,
Further comprising the step of counting the number of toggles differently for each abnormal symptom of the display panel,
Display device control method. delete The method of claim 7,
One of the number of times of the toggle means two times of edge counting.
Display device control method. The method of claim 7,
Counting the number of times of the toggle, and if the input signal remains high for a predetermined time or longer, terminating the counting of the number of toggles,
Display device control method. The method of claim 7,
When the sensor unit senses an abnormality in the display panel, the control unit further comprises controlling the communication unit to transmit a first signal indicating an occurrence of an abnormality in the display panel to an external device,
Display device control method.

Images