WO2020138730A1 - Dispositif d'affichage et procédé de commande associé - Google Patents

Dispositif d'affichage et procédé de commande associé Download PDF

Info

Publication number
WO2020138730A1
WO2020138730A1 PCT/KR2019/016272 KR2019016272W WO2020138730A1 WO 2020138730 A1 WO2020138730 A1 WO 2020138730A1 KR 2019016272 W KR2019016272 W KR 2019016272W WO 2020138730 A1 WO2020138730 A1 WO 2020138730A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
controller
displayed
user
text message
Prior art date
Application number
PCT/KR2019/016272
Other languages
English (en)
Korean (ko)
Inventor
허우범
최고운
김재욱
최수인
김태일
박은지
김소현
이상희
조연주
유환희
김도희
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Publication of WO2020138730A1 publication Critical patent/WO2020138730A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker

Definitions

  • the present invention relates to a digital device and a control method for allowing the use of a digital device to be implemented in consideration of user convenience.
  • the digital device is, for example, an apparatus having a function of receiving and processing a broadcast image that a user can watch.
  • the digital device displays, for example, a broadcast selected by a user among broadcast signals transmitted from a broadcasting station on a display.
  • broadcasting is shifting from analog broadcasting to digital broadcasting worldwide.
  • Digital broadcasting means broadcasting that transmits digital video and audio signals. Digital broadcasting is more resistant to external noise than analog broadcasting, so data loss is small, it is advantageous for error correction, and it has a high resolution and provides a clear screen. In addition, unlike digital broadcasting, digital broadcasting can provide interactive services.
  • the performance of the display device has been improved and the functions have been diversified.
  • video signals are simply received from broadcasting stations to watch broadcasts, and game play using various applications.
  • It is possible to perform various functions through video display devices such as listening to music and shopping on the Internet.
  • An embodiment of the present invention provides a user with an application for integrated management of a plurality of external devices connected to a digital device, and a digital device capable of integrally managing a plurality of external devices connected to the digital device through the application, and It is an object to provide the control method.
  • Another embodiment of the present invention is to provide a display device and a control method for controlling a user to display a message recommending content suitable for a user's preference when the user turns on the TV or when a specific program ends. The purpose.
  • Another embodiment of the present invention provides a display device and a control method for controlling to display a message suggesting useful functions such as a shortcut key and a user preference channel when a specific application is executed or when a specific setting value is changed It aims to do.
  • Another embodiment of the present invention is to provide a display device and a control method for controlling a user to display a message that introduces a useful function that the user is not sure about but uses a related function while watching a TV. .
  • a display device includes a display; A communication unit performing communication with two or more external devices connected to the display device by wire or wireless; And a controller for controlling a GUI (Graphic User Interface) for managing the external devices to be displayed on the display.
  • the controller includes the external devices classified into two or more groups based on a device type. It characterized in that the configuration of the GUI to be integrated management within.
  • a control method of a display device includes connecting two or more external devices to a display device by wire or wirelessly; And displaying a graphical user interface (GUI) for integrated management of the external devices on the display device, wherein the GUI includes the external devices classified into two or more groups based on a device type, and within the GUI. It is characterized by being configured to be integrated management.
  • GUI graphical user interface
  • an application for integrated management of a plurality of external devices connected to a digital device is provided to a user, and an advantage of integrated management of a plurality of external devices connected to the digital device is provided through the application.
  • the display device is controlled to display a message corresponding to the content of the user, an application or a function of the device, so that users can enjoy satisfactory content Since it can provide the user convenience can be improved.
  • a message including a guide for setting the display unit is displayed to improve user convenience.
  • FIG. 1 is a view schematically illustrating a service system including a digital device according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a digital device according to an embodiment of the present invention.
  • FIG. 3 is a block diagram illustrating a digital device according to another embodiment of the present invention.
  • FIG. 4 is a block diagram illustrating a digital device according to another embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention.
  • FIG. 6 is a diagram illustrating input means connected to the digital devices of FIGS. 2 to 4 according to an embodiment of the present invention.
  • FIG. 7 is a diagram illustrating a web OS architecture according to an embodiment of the present invention.
  • FIG. 8 is a diagram illustrating an architecture of a web OS device according to an embodiment of the present invention.
  • FIG. 9 is a diagram illustrating a graphic composition flow in a web OS device according to an embodiment of the present invention.
  • FIG. 10 is a diagram illustrating a media server according to an embodiment of the present invention.
  • FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention.
  • FIG. 12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
  • FIG. 13 is a diagram illustrating a control method of a remote control device that controls any one of video display devices according to embodiments of the present invention.
  • FIG. 14 is an internal block diagram of a remote control device controlling any one of video display devices according to embodiments of the present invention.
  • FIG. 15 is a block diagram of a multimedia device according to an embodiment of the present invention.
  • 16 to 19 are diagrams for explaining the overall configuration of the launcher according to an embodiment of the present invention.
  • 20 is a diagram illustrating functions corresponding to a plurality of sub-tiles belonging to a home dashboard tile according to an embodiment of the present invention.
  • 21 is a diagram illustrating a process in which a plurality of sub tiles belonging to a home dashboard tile are displayed in a two-stage launcher according to an embodiment of the present invention.
  • FIG. 22 is a diagram illustrating a configuration of a plurality of sub-tiles belonging to a home dashboard tile according to an embodiment of the present invention.
  • 23 is a diagram showing the configuration of an input sub-tile according to an embodiment of the present invention.
  • 24 is a diagram showing the configuration of a mobile sub-tile according to an embodiment of the present invention.
  • 25 is a view showing the configuration of an IoT sub-tile according to an embodiment of the present invention.
  • 26 is a view showing another example of an input sub-tile according to an embodiment of the present invention.
  • FIG. 27 is a diagram illustrating a process of executing a function related to a USB memory through an input sub-tile according to an embodiment of the present invention.
  • FIG. 28 is a diagram illustrating a process of disconnecting a USB memory through an input sub-tile according to an embodiment of the present invention.
  • 29 is a diagram illustrating a process of guiding a connection of a mobile device through a mobile sub-tile according to an embodiment of the present invention.
  • FIG. 30 is a diagram illustrating a process of executing a function related to a mobile device through a mobile sub-tile according to an embodiment of the present invention.
  • 31 is a diagram illustrating a process of connecting to another external device through a user guide sub-tile according to an embodiment of the present invention.
  • FIG. 32 is a diagram showing an execution screen of a home dashboard app according to an embodiment of the present invention.
  • FIG 33 is a diagram showing a network setting guide for IoT connection according to an embodiment of the present invention.
  • FIG. 34 is a diagram illustrating user authentication when connecting with an OCF type IoT device according to an embodiment of the present invention.
  • 35 is a diagram illustrating a process of providing corresponding detailed information when selecting a TV item in an input area according to an embodiment of the present invention.
  • FIG. 36 is a diagram illustrating a process of deleting an IPTV item-related app according to an embodiment of the present invention.
  • FIG. 37 is a diagram illustrating a process of providing corresponding detailed information when selecting a USB memory item in an input area according to an embodiment of the present invention.
  • FIG. 38 is a diagram illustrating a process of classifying and displaying first and second IoT items in an IoT area according to an embodiment of the present invention.
  • 39 to 41 are diagrams illustrating IoT items of a first Internet of Things method displayed in an IoT area according to an embodiment of the present invention.
  • FIG 42 and 43 are views illustrating IoT items of a second Internet of Things method displayed in an IoT area according to an embodiment of the present invention.
  • 44 is a diagram illustrating a process of editing each item in an execution screen of a home dashboard app according to an embodiment of the present invention.
  • 45 is a diagram illustrating a process of setting an IoT area according to an embodiment of the present invention.
  • 46 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
  • 47 is a diagram illustrating a text message displayed on a display device according to an embodiment of the present invention.
  • FIG. 48 is a diagram showing a text message displayed on a display device when a user turns on a power according to an embodiment of the present invention.
  • 49 is a diagram illustrating content recommendation when a user turns on a TV after collecting usage pattern data of a user display device according to another embodiment of the present invention.
  • 50 is a diagram for recommending content when a user repeatedly switches TV channels according to an embodiment of the present invention.
  • 51 is a diagram showing a shortcut key registration function for a channel frequently used by a user according to an embodiment of the present invention.
  • FIG. 52 is a diagram illustrating a recommendation of a Live OTT service at the end of a program according to an embodiment of the present invention.
  • 53 is a diagram for recommending content frequently viewed by a user at the end of a program according to an embodiment of the present invention.
  • 54 is a diagram for suggesting a shortcut key registration of a corresponding application to a user when entering a frequently used application according to another embodiment of the present invention.
  • FIG. 55 is a view showing that when a channel management application is entered, a user's preferred channel is registered, according to another embodiment of the present invention.
  • 56 is a diagram illustrating recommendation of a voice recognition function when an application is executed according to an embodiment of the present invention.
  • 57 is a diagram for recommending a sound quality setting change when a user changes a quality setting according to an embodiment of the present invention.
  • 58 is a diagram for recommending a quality setting change when a user changes a sound quality setting according to an embodiment of the present invention.
  • 59 is a view showing proposal of turning off a text message display function according to an embodiment of the present invention.
  • the video display device described in the present specification is, for example, an intelligent video display device in which a computer support function is added to a broadcast reception function, and while being faithful to the broadcast reception function, an Internet function or the like is added, a handwritten input device, touch screen Or, it may have a more convenient interface such as a space remote control. And, it is connected to the Internet and a computer with the support of a wired or wireless Internet function, and can perform functions such as email, web browsing, banking, or gaming. For these various functions, a standardized general-purpose OS can be used.
  • the video display device described in the present invention various applications can be freely added or deleted, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed.
  • the video display device may be, for example, a network TV, an HBBTV, a smart TV, and the like, and may be applied to a smartphone in some cases.
  • the term “digital device” described herein is, for example, transmitting, receiving, processing, and outputting data, content, service, application, and the like. All devices that perform at least one or more are included.
  • the digital device can be paired or connected (hereinafter referred to as'pairing') with another digital device, an external server, etc. through a wire/wireless network, through which the predetermined data is transmitted. You can send/receive. At this time, if necessary, the data can be converted appropriately before the transmission/reception.
  • the digital device includes, for example, a standing device such as a network TV, a HBBTV (Hybrid Broadcast Broadband TV), a smart TV, an IPTV (Internet Protocol TV), a personal computer (PC), and the like.
  • a mobile device such as a PDA (Personal Digital Assistant), a smart phone (Smart Phone), a tablet PC (Tablet PC), a notebook (Notebook), etc.
  • FIG. 2 shows and describes a digital TV
  • FIG. 3 shows a mobile device as an example of a digital device.
  • the digital device described in this specification may be a configuration having only a panel, or a configuration such as a set-top box (STB), a device, a system, etc., and a single SET configuration. .
  • STB set-top box
  • wireless/wireless network refers to a communication network that supports various communication standards or protocols for pairing and/or data transmission and reception between digital devices or digital devices and external servers.
  • a wired/wireless network includes all communication networks to be supported at present or in the future by a standard, and can support all one or more communication protocols therefor.
  • Such wired/wireless networks include, for example, Universal Serial Bus (USB), Composite Video Banking Sync (CVBS), Component, S-Video (analog), Digital Visual Interface (DVI), High Definition Multimedia Interface (HDMI), Network for wired connection such as RGB, D-SUB, and communication standards or protocols therefor, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), Zigbee (ZigBee), Digital Living Network Alliance (DLNA), Wireless LAN (WLAN) (Wi-Fi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), LTE/LTE -A (Long Term Evolution / LTE-Advanced), can be formed by a network for a wireless connection, such as Wi-Fi direct (direct) and communication standards or protocols therefor.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • the meaning may mean a fixed device or a mobile device depending on the context, and may be used to include both unless otherwise specified.
  • the digital device is an intelligent device that supports, for example, a broadcast reception function, a computer function or support, at least one external input, and the like, e-mail, web browsing through a wired/wireless network described above. , Banking, games, applications, and the like.
  • the digital device may include an interface for supporting at least one input or control means (hereinafter referred to as an'input means') such as a handwritten input device, a touch-screen, and a spatial remote control. have.
  • a digital device may use a standardized general-purpose operating system (OS), but particularly, the digital device described in this specification uses a web OS as an embodiment. Therefore, the digital device is capable of processing various services or applications such as adding, deleting, amending, and updating on a general-purpose OS kernel or Linux kernel. It is possible, through which a more user-friendly environment can be configured and provided.
  • OS general-purpose operating system
  • the digital device described in this specification uses a web OS as an embodiment. Therefore, the digital device is capable of processing various services or applications such as adding, deleting, amending, and updating on a general-purpose OS kernel or Linux kernel. It is possible, through which a more user-friendly environment can be configured and provided.
  • the above-described digital device can receive and process an external input.
  • the external input is connected to an external input device, that is, the above-mentioned digital device through a wired/wireless network to transmit/receive data.
  • Input means to digital devices.
  • a high-definition multimedia interface (HDMI) a game device such as a Playstation or an X-Box, a smart phone, a tablet PC, a pocket photo photo) and other digital devices such as a printing device, a smart TV, and a Blu-ray device.
  • HDMI high-definition multimedia interface
  • game device such as a Playstation or an X-Box
  • smart phone such as a smart phone, a tablet PC, a pocket photo photo
  • other digital devices such as a printing device, a smart TV, and a Blu-ray device.
  • server means a digital device or system that supplies data to or receives data from the above-mentioned digital device, that is, a client, and is also called a processor. do.
  • a web server a web server or a portal server that provides web pages, web content or web services, or advertising data is provided to the server.
  • Advertising server content server providing content
  • SNS server providing social network service (SNS)
  • SNS social network service
  • service server provided by manufacturer
  • video on demand (VoD) B video on demand
  • a service server that provides a multichannel video programming distributor (MVPD) for providing a streaming service and a pay service may be included.
  • MVPD multichannel video programming distributor
  • the meaning may include not only an application but also a service.
  • the application may refer to a web application according to the web OS platform.
  • FIG. 1 is a view schematically illustrating a service system including a digital device according to an embodiment of the present invention.
  • the service system includes a content provider 10, a service provider 20, a network provider 30, and a Home Network End (HNED).
  • HNED Home Network End
  • User Customer
  • the HNED 40 includes, for example, a client 100, that is, a digital device according to the present invention.
  • the content provider 10 produces and provides various content. As shown in FIG. 1, such a content provider 10 is a terrestrial broadcaster, a cable broadcaster (cable SO (System Operator) or multiple SO), a satellite broadcaster, various Internet broadcasters, Personal content providers, and the like. Meanwhile, the content provider 10 may produce and provide various services or applications in addition to broadcast content.
  • a content provider 10 is a terrestrial broadcaster, a cable broadcaster (cable SO (System Operator) or multiple SO), a satellite broadcaster, various Internet broadcasters, Personal content providers, and the like. Meanwhile, the content provider 10 may produce and provide various services or applications in addition to broadcast content.
  • the service provider 20 provides the HNED 40 with service packetizing the content produced by the content provider 10.
  • the service provider 20 packages at least one of contents produced by the first terrestrial broadcast, the second terrestrial broadcast, the cable MSO, the satellite broadcast, various Internet broadcasts, applications, etc., for the service, and this is HNED (40).
  • the service provider 20 provides services to the client 100 in a uni-cast or multi-cast manner. Meanwhile, the service provider 20 may transmit data to a plurality of pre-registered clients 100 at a time, and for this, an Internet Group Management Protocol (IGMP) protocol may be used.
  • IGMP Internet Group Management Protocol
  • the above-described content provider 10 and service provider 20 may be the same entity.
  • the content provided by the content provider 10 may be service packaged and provided to the HNED 40 to perform the function of the service provider 20 together or vice versa.
  • the network provider 30 provides a network network for data exchange between the content provider 10 or/and the service provider 20 and the client 100.
  • the client 100 receives data by constructing a home network, for example, through a network provider 30, and receives data related to various services or applications, such as VoD and streaming. You can also send/receive.
  • the content provider 10 or/and the service provider 20 in the service system may use conditional access or content protection means to protect transmitted content.
  • the client 100 may use a processing means such as a cable card (or POD: Point of Deployment), DCAS (Downloadable CAS), etc. in response to the restriction reception or content protection.
  • the client 100 can also use the interactive service through the network. Therefore, the client 100 may rather perform the role or function of the content provider, and the service provider 20 may receive it and transmit it to another client again.
  • the content provider 10 or/and the service provider 20 may be a server that provides a service described later in this specification.
  • the server may mean to own or include the network provider 30 as needed.
  • the service or service data includes not only the service or application received from the above-described external service, but also an internal service or application, and the service or application is a service for a web OS (Web OS) based client 100 To application data.
  • Web OS web OS
  • FIG. 2 is a block diagram illustrating a digital device according to an embodiment of the present invention.
  • the digital device described in this specification corresponds to the client 100 of FIG. 1 described above.
  • the digital device 200 includes a network interface 201, a TCP/IP manager 202, a service delivery manager 203, an SI decoder 204, Demultiplexer (demux or demultiplexer) 205, audio decoder (audio decoder) 206, video decoder (video decoder) 207, display unit (display A/V and OSD module) 208, service control manager (service control manager) 209, service discovery manager 210, SI&metadata DB 211, metadata manager 212, service manager 213, It comprises a UI manager 214 and the like.
  • the network interface unit 201 is an IP packet(s) (Internet Protocol(IP) packet(s)) or IP datagram(s) (IP datagram(s)) (hereinafter referred to as IP packet(s) through a network network to be accessed. )) is transmitted/received.
  • IP packet(s) Internet Protocol(IP) packet(s)
  • IP datagram(s) IP datagram(s)
  • the network interface unit 201 may receive a service, application, content, etc. from the service provider 20 of FIG. 1 through a network network.
  • the TCP/IP manager 202 transmits packets between IP packets received by the digital device 200 and IP packets transmitted by the digital device 200, that is, between a source and a destination ( packet delivery).
  • the TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205, the service discovery manager 210, the service control manager 209, and the metadata manager 212 ) And the like to output the classified packet(s).
  • the service delivery manager 203 is responsible for controlling received service data.
  • the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data.
  • the service delivery manager 203 parses the received data packet according to the RTP and transmits it to the demultiplexer 205 or control of the service manager 213 According to the SI & meta data database 211. Then, the service delivery manager 203 uses the RTCP to feed back the network reception information to a server providing a service.
  • the demultiplexer 205 demultiplexes the received packets into audio, video, and system information (SI) data, and transmits them to the audio/video decoders 206/207 and the SI decoder 204, respectively.
  • SI system information
  • the SI decoder 204 includes demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting-Service Information (DVB-SI), and Digital Television Terrestrial Multimedia (DTMB/CMMB). Decoding service information such as Broadcasting/Coding Mobile Multimedia Broadcasting). Also, the SI decoder 204 may store the decoded service information in the SI&metadata database 211. The stored service information may be read and used by the corresponding configuration, for example, by a user's request.
  • PSI Program Specific Information
  • PSIP Program and System Information Protocol
  • DVD-SI Digital Video Broadcasting-Service Information
  • DTMB/CMMB Digital Television Terrestrial Multimedia
  • Decoding service information such as Broadcasting/Coding Mobile Multimedia Broadcasting
  • the SI decoder 204 may store the decoded service information in the SI&metadata database 211. The stored service information may be read and used by the corresponding configuration, for example, by a
  • the audio/video decoder 206/207 decodes each demultiplexed audio data and video data.
  • the audio data and video data thus decoded are provided to the user through the display unit 208.
  • the application manager includes, for example, a UI manager 214 and a service manager 213, and may perform a control function of the digital device 200.
  • the application manager may manage the overall state of the digital device 200, provide a user interface (UI), and manage other managers.
  • UI user interface
  • the UI manager 214 provides a graphical user interface (GUI)/UI for a user using an OSD (On Screen Display) or the like, and receives a key input from a user to perform device operation according to the input. For example, when the UI manager 214 receives a key input for channel selection from a user, the UI manager 214 transmits the key input signal to the service manager 213.
  • GUI graphical user interface
  • OSD On Screen Display
  • the service manager 213 controls a manager associated with a service, such as a service delivery manager 203, a service discovery manager 210, a service control manager 209, and a metadata manager 212.
  • the service manager 213 generates a channel map and controls channel selection and the like using the generated channel map according to the key input received from the UI manager 214.
  • the service manager 213 receives service information from the SI decoder 204 and sets the audio/video PID (Packet Identifier) of the selected channel to the demultiplexer 205.
  • the PID set in this way can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters audio data, video data, and SI data using the PID (PID or section filtering).
  • the service discovery manager 210 provides information necessary to select a service provider providing a service. When a signal regarding channel selection is received from the service manager 213, the service discovery manager 210 uses the information to find a service.
  • the service control manager 209 is responsible for selecting and controlling services.
  • the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as an existing broadcasting method, and selects a service such as VOD (Video on Demand).
  • the RTSP is used to select and control services.
  • the RTSP protocol may provide a trick mode for real-time streaming.
  • the service control manager 209 may initialize and manage a session through the IMS gateway 250 using an IP Multimedia Subsystem (IMS) and a Session Initiation Protocol (SIP).
  • IMS IP Multimedia Subsystem
  • SIP Session Initiation Protocol
  • the metadata manager 212 manages metadata associated with the service and stores the metadata in the SI&metadata database 211.
  • the SI&metadata database 211 provides service information decoded by the SI decoder 204, metadata managed by the metadata manager 212, and information necessary to select a service provider provided by the service discovery manager 210. To save.
  • the SI&metadata database 211 may store set-up data and the like for the system.
  • the SI&metadata database 211 may be implemented using non-volatile memory (NVRAM) or flash memory.
  • the IMS gateway 250 is a gateway that collects functions necessary for accessing the IMS-based IPTV service.
  • FIG. 3 is a block diagram illustrating a digital device according to another embodiment of the present invention.
  • FIG. 3 illustrates a mobile device as another example of a digital device.
  • the mobile device 300 includes a wireless communication unit 310, an audio/video (A/V) input unit 320, a user input unit 330, a sensing unit 340, an output unit 350, and a memory 360, an interface unit 370, a control unit 380, and a power supply unit 390.
  • A/V audio/video
  • the wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and the wireless communication system or between the mobile device and the network where the mobile device is located.
  • the wireless communication unit 310 may include a broadcast reception module 311, a mobile communication module 312, a wireless Internet module 313, a short-range communication module 314, and a location information module 315. .
  • the broadcast reception module 311 receives broadcast signals and/or broadcast related information from an external broadcast management server through a broadcast channel.
  • the broadcast channel may include a satellite channel and a terrestrial channel.
  • the broadcast management server may refer to a server that generates and transmits broadcast signals and/or broadcast-related information or a server that receives previously generated broadcast signals and/or broadcast-related information and transmits them to a terminal.
  • the broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.
  • the broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider.
  • the broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312.
  • Broadcast-related information may exist in various forms, for example, an electronic program guide (EPG) or an electronic service guide (ESG).
  • EPG electronic program guide
  • ESG electronic service guide
  • the broadcast reception module 311 is, for example, ATSC, Digital Video Broadcasting-Terrestrial (DVB-T), DVB-S (Satellite), MediaFLO (Media Forward Link Only), DVB-H (Handheld), ISDB-T ( A digital broadcasting signal can be received using a digital broadcasting system such as Integrated Services Digital Broadcast-Terrestrial).
  • DVD-T Digital Video Broadcasting-Terrestrial
  • DVB-S Setellite
  • MediaFLO Media Forward Link Only
  • DVB-H Highandheld
  • ISDB-T A digital broadcasting signal can be received using a digital broadcasting system such as Integrated Services Digital Broadcast-Terrestrial.
  • the broadcast receiving module 311 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.
  • the broadcast signal and/or broadcast-related information received through the broadcast receiving module 311 may be stored in the memory 360.
  • the mobile communication module 312 transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to transmission and reception of a voice signal, a video call signal, or a text/multimedia message.
  • the wireless Internet module 313 may include a module for wireless Internet access, or may be built in or external to the mobile device 300.
  • Wireless Internet technology Wi-Fi
  • Wibro Wireless broadband
  • Wimax Worldwide Interoperability for Microwave Access
  • HSDPA High Speed Downlink Packet Access
  • the short-range communication module 314 refers to a module for short-range communication.
  • Bluetooth radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, RS-232, RS-485, etc. may be used as short range communication technology.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wideband
  • ZigBee ZigBee
  • RS-232 RS-485, etc.
  • the location information module 315 is a module for obtaining location information of the mobile device 300, and may use, for example, a Global Position System (GPS) module.
  • GPS Global Position System
  • the A/V input unit 320 is for inputting an audio or/and video signal, which may include a camera 321 and a microphone 322.
  • the camera 321 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode.
  • the processed image frame may be displayed on the display unit 351.
  • the image frames processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310. Two or more cameras 321 may be provided according to the use environment.
  • the microphone 322 receives an external sound signal by a microphone in a call mode or a recording mode, a voice recognition mode, etc., and processes it as electrical voice data.
  • the processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 312 and output.
  • the microphone 322 may be implemented with various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.
  • the user input unit 330 generates input data for the user to control the operation of the terminal.
  • the user input unit 330 may be configured with a key pad, a dome switch, a touch pad (static pressure/power outage), a jog wheel, a jog switch, or the like.
  • the sensing unit 340 displays the current state of the mobile device 300, such as an open/closed state of the mobile device 300, a location of the mobile device 300, presence or absence of user contact, orientation of the mobile device, acceleration/deceleration of the mobile device, and the like. It senses and generates a sensing signal for controlling the operation of the mobile device 300. For example, when the mobile device 300 is moved or tilted, the position or tilt of the mobile device may be sensed. In addition, it is also possible to sense whether the power supply unit 390 is supplied with power or whether the interface unit 370 is coupled with an external device. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including Near Field Communication (NFC).
  • NFC Near Field Communication
  • the output unit 350 is for generating output related to vision, hearing, or tactile sense, and may include a display unit 351, an audio output module 352, an alarm unit 353, and a haptic module 354. have.
  • the display unit 351 displays (outputs) information processed by the mobile device 300. For example, when the mobile device is in a call mode, it displays a UI or GUI related to the call. When the mobile device 300 is in a video call mode or a photographing mode, a photographed and/or received video or UI, GUI is displayed.
  • the display unit 351 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display ( flexible display), and a 3D display.
  • LCD liquid crystal display
  • TFT LCD thin film transistor-liquid crystal display
  • OLED organic light-emitting diode
  • flexible display flexible display
  • 3D display 3D display
  • Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparant OLED).
  • the rear structure of the display unit 351 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 351 of the terminal body.
  • Two or more display units 351 may exist depending on the implementation form of the mobile device 300.
  • a plurality of display units may be spaced apart from one surface or integrally disposed on the mobile device 300, or may be disposed on different surfaces.
  • the display unit 351 and a sensor that senses a touch operation form a mutual layer structure (hereinafter, referred to as a “touch screen”)
  • the display unit 351 inputs in addition to an output device. It can also be used as a device.
  • the touch sensor may have, for example, a form of a touch film, a touch sheet, and a touch pad.
  • the touch sensor may be configured to convert changes in pressure applied to a specific portion of the display unit 351 or capacitance generated in a specific portion of the display unit 351 into an electrical input signal.
  • the touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of touch.
  • the control unit 380 can know which area of the display unit 351 has been touched, and the like.
  • a proximity sensor 341 may be disposed in an inner area of the mobile device surrounded by the touch screen or near the touch screen.
  • the proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared light without mechanical contact.
  • Proximity sensors have a longer lifespan and higher utilization than contact sensors.
  • the proximity sensor examples include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor.
  • the touch screen When the touch screen is capacitive, it is configured to detect the proximity of the pointer due to a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.
  • proximity touch an action of causing the pointer to be recognized as being located on the touch screen without touching the pointer on the touch screen
  • touch touch The act of actually touching the pointer on the screen
  • location on the touch screen that is a proximity touch with a pointer means a location where the pointer is perpendicular to the touch screen when the pointer is touched close.
  • the proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.
  • a proximity touch and a proximity touch pattern eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.
  • the audio output module 352 may output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like.
  • the sound output module 352 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed by the mobile device 300.
  • the sound output module 352 may include a receiver, a speaker, a buzzer, and the like.
  • the alarm unit 353 outputs a signal for notifying the occurrence of the event of the mobile device 300. Examples of events generated in the mobile device include call signal reception, message reception, key signal input, and touch input.
  • the alarm unit 353 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, vibration.
  • the video signal or the audio signal may also be output through the display unit 351 or the audio output module 352, so that they 351 and 352 may be classified as part of the alarm unit 353.
  • the haptic module 354 generates various tactile effects that the user can feel.
  • a typical example of the tactile effect generated by the haptic module 354 is vibration.
  • the intensity and pattern of vibration generated by the haptic module 354 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.
  • the haptic module 354 is used for stimulation such as pin arrangement that vertically moves with respect to the contact skin surface, jet or suction power of air through a jet or intake, grazing on the skin surface, contact with an electrode, and electrostatic force. It can generate various tactile effects, such as the effect by, and the effect by reproducing the cold/warm feeling using an endothermic or heat generating element.
  • the haptic module 354 may not only transmit the tactile effect through direct contact, but may also implement the user to feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 354 may be provided according to a configuration aspect of the mobile device 300.
  • the memory 360 may store a program for the operation of the control unit 380, and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.).
  • the memory 360 may store data related to various patterns of vibration and sound that are output upon touch input on the touch screen.
  • the memory 360 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, It may include a storage medium of at least one of a magnetic disk and an optical disk.
  • the mobile device 300 may operate in connection with a web storage that performs a storage function of the memory 360 on the Internet.
  • the interface unit 370 serves as a passage with all external devices connected to the mobile device 300.
  • the interface unit 370 receives data from an external device, receives power, transfers it to each component inside the mobile device 300, or allows data inside the mobile device 300 to be transmitted to the external device.
  • wired/wireless headset port, external charger port, wired/wireless data port, memory card port, port for connecting devices equipped with an identification module, audio input/output (I/O) port, A video I/O port, an earphone port, and the like may be included in the interface unit 370.
  • the identification module is a chip that stores various information for authenticating the usage rights of the mobile device 300, a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM).
  • the device provided with the identification module (hereinafter referred to as'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the terminal 200 through a port.
  • the interface unit 370 When the mobile device 300 is connected to an external cradle, the interface unit 370 becomes a passage through which power from the cradle is supplied to the mobile device 300, or various input by the user from the cradle.
  • a command signal may be a passage to the mobile device.
  • Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.
  • the control unit 380 typically controls the overall operation of the mobile device 300.
  • the control unit 380 performs, for example, related control and processing for voice calls, data communication, video calls, and the like.
  • the control unit 380 may include a multimedia module 381 for multimedia playback.
  • the multimedia module 381 may be implemented in the control unit 380 or may be implemented separately from the control unit 380.
  • the control unit 380 may perform a pattern recognition process capable of recognizing handwriting input or picture drawing input performed on a touch-screen as characters and images, respectively.
  • the power supply unit 390 receives external power and internal power under control of the control unit 380 and supplies power required for the operation of each component.
  • the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and electrical units for performing other functions. Examples may be implemented by the control unit 380 itself.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • embodiments such as procedures and functions described herein may be implemented as separate software modules.
  • Each of the software modules can perform one or more functions and operations described herein.
  • Software code can be implemented in a software application written in an appropriate programming language.
  • the software code may be stored in the memory 360 and executed by the control unit 380.
  • FIG. 4 is a block diagram illustrating a digital device according to another embodiment of the present invention.
  • the digital device 400 include a broadcast receiving unit 405, an external device interface unit 435, a storage unit 440, a user input interface unit 450, a control unit 470, a display unit 480, audio It may include an output unit 485, a power supply unit 490 and a photographing unit (not shown).
  • the broadcast reception unit 405 may include at least one tuner 410, a demodulation unit 420, and a network interface unit 430. However, in some cases, the broadcast reception unit 405 includes a tuner 410 and a demodulation unit 420, but may not include the network interface unit 430, and vice versa.
  • a signal demodulated by the demodulator 420 via the tuner 410 and a signal received through the network interface unit 430 by having a multiplexer is provided. Can also be multiplexed.
  • a demultiplexer is provided to demultiplex the multiplexed signal or demultiplex the demodulated signal or the signal that has passed through the network interface unit 430. Can.
  • the tuner 410 receives an RF broadcast signal by tuning a channel selected by a user or all pre-stored channels among radio frequency (RF) broadcast signals received through an antenna. In addition, the tuner 410 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.
  • IF intermediate frequency
  • the tuner 410 can process both digital broadcast signals or analog broadcast signals.
  • the analog baseband video or audio signal (CVBS/SIF) output from the tuner 410 may be directly input to the controller 470.
  • the tuner 410 may receive a single carrier (single carrier) or multiple carriers (multiple carrier) RF broadcast signal. Meanwhile, the tuner 410 sequentially tunes and receives RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna, and receives them as an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). Frequency or baseband signal).
  • DIF Digital Intermediate
  • the demodulator 420 may receive and demodulate the digital IF signal DIF converted by the tuner 410, and perform channel decoding and the like. To this end, the demodulator 420 includes a trellis decoder, a de-interleaver, a reed-solomon decoder, or a convolution decoder, de-interleaver, and read. -It can be equipped with a solo decoder.
  • the demodulator 420 may output a stream signal TS after demodulation and channel decoding.
  • the stream signal may be a video signal, an audio signal or a data signal multiplexed.
  • the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like are multiplexed.
  • TS MPEG-2 Transport Stream
  • the stream signal output from the demodulator 420 may be input to the controller 470.
  • the control unit 470 may control demultiplexing, video/audio signal processing, and the like, and control an image output through the display unit 480 and an audio output unit through the audio output unit 485.
  • the external device interface unit 435 provides an interfacing environment between the digital device 300 and various external devices.
  • the external device interface unit 335 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).
  • the external device interface unit 435 includes a Digital Versatile Disk (DVD), Blu-ray, game device, camera, camcorder, computer (laptop), tablet PC, smartphone, and Bluetooth device (Bluetooth). device), an external device such as a cloud, and the like can be connected by wire/wireless.
  • the external device interface unit 435 transmits a signal including data, such as image, video, and voice input through the connected external device to the controller 470 of the digital device.
  • the control unit 470 may control the processed image, video, audio, etc. to be output to a connected external device.
  • the external device interface unit 435 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).
  • A/V input/output unit USB terminal, CVBS (Composite Video Banking Sync) terminal, component terminal, S-video terminal (analog), so that video and audio signals from external devices can be input to the digital device 400. It may include a digital visual interface (DVI) terminal, a high definition multimedia interface (HDMI) terminal, an RGB terminal, and a D-SUB terminal.
  • DVI digital visual interface
  • HDMI high definition multimedia interface
  • RGB RGB terminal
  • D-SUB terminal D-SUB terminal
  • the wireless communication unit may perform short-range wireless communication with other digital devices.
  • the digital device 400 is, for example, Bluetooth (Bluetooth), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) It may be networked with other digital devices according to a communication protocol such as.
  • the external device interface unit 435 may be connected to the set-top box STB and at least one of the various terminals described above to perform input/output operations with the set-top box STB.
  • the external device interface unit 435 may receive an application or an application list in an adjacent external device and transmit it to the control unit 470 or the storage unit 440.
  • the network interface unit 430 provides an interface for connecting the digital device 400 to a wired/wireless network including an Internet network.
  • the network interface unit 430 may include, for example, an Ethernet terminal or the like for connection with a wired network, and for example, a wireless LAN (WLAN) (Wi-) for connection with a wireless network.
  • WLAN wireless LAN
  • Wibro Wireless broadband
  • Wimax Worldwide Interoperability for Microwave Access
  • HSDPA High Speed Downlink Packet Access
  • the network interface unit 430 may transmit or receive data with other users or other digital devices through a connected network or another network linked to the connected network.
  • some content data stored in the digital device 400 may be transmitted to another user registered in advance in the digital device 400 or to a selected user or selected digital device among other digital devices.
  • the network interface unit 430 may access a predetermined web page through a connected network or another network linked to the connected network. That is, it is possible to connect to a predetermined web page through a network and transmit or receive data with the corresponding server.
  • content or data provided by a content provider or a network operator may be received. That is, it is possible to receive content and related information such as a movie, advertisement, game, VOD, broadcast signal provided from a content provider or a network provider through a network.
  • content and related information such as a movie, advertisement, game, VOD, broadcast signal provided from a content provider or a network provider through a network.
  • the network interface unit 430 may select and receive a desired application from among applications opened through the network.
  • the storage unit 440 may store programs for processing and controlling each signal in the control unit 470, or may store signal-processed video, audio, or data signals.
  • the storage unit 440 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 435 or the network interface unit 430.
  • the storage unit 440 may store information regarding a predetermined broadcast channel through a channel storage function.
  • the storage unit 440 may store an application or application list input from the external device interface unit 435 or the network interface unit 330.
  • the storage unit 440 may store various platforms described later.
  • the storage unit 440 may be, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (for example, SD or XD) Memory, etc.), RAM (RAM), and ROM (EEPROM, etc.).
  • the digital device 400 may play and provide content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 440 to the user.
  • FIG 4 illustrates an embodiment in which the storage unit 440 is provided separately from the control unit 470, the present invention is not limited thereto. In other words, the storage unit 440 may be included in the control unit 470.
  • the user input interface unit 450 transmits a signal input by the user to the control unit 470 or a signal from the control unit 470 to the user.
  • the user input interface unit 450 controls power on/off, channel selection, screen setting, etc. from the remote control device 500 according to various communication methods such as an RF communication method and an infrared (IR) communication method.
  • the signal may be received and processed or the control signal of the control unit 470 may be transmitted to the remote control device 500.
  • the user input interface unit 450 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 470.
  • a local key such as a power key, a channel key, a volume key, and a set value
  • the user input interface unit 450 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 470 or senses a signal from the control unit 470 (Not shown).
  • the sensing unit may include a touch sensor, a voice sensor, a position sensor, and a motion sensor.
  • the control unit 470 de-multiplexes the stream input through the tuner 410, the demodulator 420, or the external device interface unit 435 or processes the demultiplexed signals to generate a signal for video or audio output. And output.
  • the image signal processed by the control unit 470 may be input to the display unit 480 and displayed as an image corresponding to the image signal. Also, the image signal processed by the control unit 470 may be input to an external output device through the external device interface unit 435.
  • the audio signal processed by the control unit 470 may be audio output to the audio output unit 485.
  • the voice signal processed by the control unit 470 may be input to the external output device through the external device interface unit 435.
  • control unit 470 may include a demultiplexing unit, an image processing unit, and the like.
  • the controller 470 may control the overall operation of the digital device 400.
  • the control unit 470 may control the tuner 410 to tune an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.
  • the control unit 470 may control the digital device 400 by a user command input through the user input interface unit 450 or an internal program. In particular, it is possible to access a network so that a user can download a desired application or application list into the digital device 400.
  • control unit 470 controls the tuner 410 such that a signal of a selected channel is input according to a predetermined channel selection command received through the user input interface unit 450. And it processes the video, audio or data signal of the selected channel.
  • the control unit 470 allows the user to select the channel information selected by the user and output the processed image or audio signal through the display unit 480 or the audio output unit 485.
  • control unit 470 may be input from an external device input through the external device interface unit 435, for example, a camera or camcorder, according to an external device image playback command received through the user input interface unit 450.
  • the video signal or the audio signal can be output through the display unit 480 or the audio output unit 485.
  • control unit 470 may control the display unit 480 to display an image.
  • It can be controlled to be displayed on the display unit 480.
  • the image displayed on the display unit 480 may be a still image or a video, and may be a 2D video or a 3D video.
  • control unit 470 may control to play content.
  • the content at this time may be content stored in the digital device 400, or received broadcast content, or external input content input from the outside.
  • the content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.
  • the controller 470 may control to display a list of applications or applications that can be downloaded from the digital device 300 or from an external network.
  • the control unit 470 may control to install and operate an application downloaded from an external network along with various user interfaces. In addition, by selecting the user, it is possible to control an image related to an application to be executed to be displayed on the display unit 480.
  • a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal is further provided.
  • the channel browsing processing unit receives a stream signal TS output from the demodulator 320 or a stream signal output from the external device interface unit 335, extracts an image from the input stream signal, and generates a thumbnail image.
  • the generated thumbnail image may be input as it is or as encoded.
  • the generated thumbnail image may be encoded in a stream form and input to the control unit 470.
  • the controller 470 may display a list of thumbnails having a plurality of thumbnail images on the display unit 480 using the input thumbnail images. Meanwhile, thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.
  • the display unit 480 converts the image signal, data signal, OSD signal, or image signal received from the external device interface unit 435 processed by the control unit 470 into R, G, and B signals, respectively. Generate a drive signal.
  • the display unit 480 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.
  • the display unit 480 may be configured as a touch screen and used as an input device in addition to the output device.
  • the audio output unit 485 receives a signal processed by the control unit 470, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio.
  • the audio output unit 485 may be implemented as various types of speakers.
  • a sensing unit having at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the digital device 400. .
  • the signal detected by the sensing unit may be transmitted to the control unit 3470 through the user input interface unit 450.
  • a photographing unit (not shown) for photographing a user may be further provided. Image information photographed by the photographing unit (not shown) may be input to the control unit 470.
  • the control unit 470 may detect a user's gesture by individually or in combination with an image captured by the photographing unit (not shown) or a signal detected from the sensing unit (not shown).
  • the power supply unit 490 supplies corresponding power throughout the digital device 400.
  • control unit 470 can be implemented in the form of a System on Chip (SoC), a display unit 480 for displaying images, and an audio output unit 485 for audio output.
  • SoC System on Chip
  • display unit 480 for displaying images
  • audio output unit 485 for audio output.
  • the power supply unit 490 may include a converter (not shown) that converts AC power into DC power.
  • a converter not shown
  • an inverter capable of PWM (Pulse Width Modulation) operation for variable luminance or dimming driving (Inverter) may be further provided.
  • the remote control device 500 transmits a user input to the user input interface unit 450.
  • the remote control device 500 may use Bluetooth, Radio Frequency (RF) communication, Infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.
  • RF Radio Frequency
  • IR Infrared
  • UWB Ultra Wideband
  • ZigBee ZigBee
  • the remote control device 500 may receive an image, audio or data signal output from the user input interface unit 450, display it on the remote control device 500, or output voice or vibration.
  • the above-described digital device 400 may be a digital broadcast receiver capable of processing a fixed or mobile ATSC type or DVB type digital broadcast signal.
  • the digital device according to the present invention may further omit some components or further include components that are not shown on the contrary, as necessary.
  • the digital device does not have a tuner and a demodulator, and may receive and play content through a network interface unit or an external device interface unit.
  • FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention.
  • control unit examples include a voice processing unit and a data processing unit.
  • the demultiplexing unit 510 demultiplexes the input stream.
  • the demultiplexer 510 may demultiplex the input MPEG-2 TS video, audio, and data signals.
  • the stream signal input to the demultiplexer 510 may be a stream signal output from a tuner or demodulator or an external device interface unit.
  • the image processing unit 420 performs image processing of the demultiplexed image signal.
  • the image processing unit 420 may include an image decoder 425 and a scaler 435.
  • the video decoder 425 decodes the demultiplexed video signal, and the scaler 435 scales the resolution of the decoded video signal to be output from the display unit.
  • the video decoder 525 may support various standards.
  • the video decoder 525 performs the function of the MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video signal is encoded in the Digital Multimedia Broadcasting (DMB) method or the H.264 standard.
  • DMB Digital Multimedia Broadcasting
  • H.264 the function of the H.264 decoder can be performed.
  • the video signal decoded by the video processing unit 520 is input to the mixer 450.
  • the OSD generation unit 540 generates OSD data according to a user input or by itself. For example, the OSD generating unit 440 generates data for displaying various data in the form of a graphic or text on the screen of the display unit 380 based on the control signal of the user input interface unit.
  • the generated OSD data includes various data such as a user interface screen of a digital device, various menu screens, widgets, icons, and viewing rate information.
  • the OSD generator 540 may generate data for displaying subtitles of broadcast images or broadcast information based on EPG.
  • the mixer 550 mixes the OSD data generated by the OSD generator 540 and the image signal processed by the image processor to provide the formatter 560. Because the decoded video signal and the OSD data are mixed, the OSD is displayed overlaid on a broadcast video or an external input video.
  • a frame rate converter (FRC) 555 converts a frame rate of an input video.
  • the frame rate converter 555 may convert a frame rate of an input 60 Hz image to have a frame rate of, for example, 120 Hz or 240 Hz according to the output frequency of the display unit.
  • various methods may exist in the method for converting the frame rate. For example, when the frame rate converter 555 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or the first frame and the second frame are predicted from the first frame. It can be converted by inserting 3 frames.
  • the frame rate converter 555 converts the frame rate from 60 Hz to 240 Hz, three or more identical frames or predicted frames may be inserted and converted between existing frames. Meanwhile, if a separate frame conversion is not performed, the frame rate conversion unit 555 may be bypassed.
  • the formatter 560 changes the output of the input frame rate conversion unit 555 to match the output format of the display unit.
  • the formatter 560 may output R, G, and B data signals, and these R, G, and B data signals may be output as a low voltage differential signal (LVDS) or a mini-LVDS Can be.
  • LVDS low voltage differential signal
  • the formatter 560 may configure and output a 3D format according to the output format of the display unit, thereby supporting 3D service through the display unit.
  • a voice processing unit (not shown) in the control unit may perform voice processing of a demultiplexed voice signal.
  • the voice processing unit (not shown) may support various audio formats. For example, even when an audio signal is encoded in formats such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, a decoder corresponding thereto may be provided and processed.
  • the voice processing unit (not shown) in the control unit may process a base, treble, volume control, and the like.
  • the data processing unit (not shown) in the control unit may perform data processing of the demultiplexed data signal.
  • the data processing unit can decode the demultiplexed data signal even when it is encoded.
  • the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcast on each channel.
  • each component may be integrated, added, or omitted depending on the specification of the actual digital device. That is, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components.
  • the function performed in each block is for explaining an embodiment of the present invention, the specific operation or device does not limit the scope of the present invention.
  • the digital device may be an image signal processing device that performs signal processing of an image stored in the device or an input image.
  • the display unit 480 and the audio output unit 485 shown in FIG. 4 are excluded from the set-top box (STB), the above-described DVD player, Blu-ray player, game device, computer And the like can be further exemplified.
  • FIG. 6 is a diagram illustrating input means connected to the digital devices of FIGS. 2 to 4 according to an embodiment of the present invention.
  • a front panel (not shown) or control means (input means) provided on the digital device 600 is used to control the digital device 600.
  • control means is a user interface device (UID; User Interface Device) capable of wired and wireless communication, and is mainly implemented for the control purpose of the digital device 600, a remote control 610, a keyboard 630, a pointing device 620, A touch-pad or the like is included, but control means dedicated to external input connected to the digital device 600 may also be included.
  • control means also includes a mobile device such as a smart phone or a tablet PC that controls the digital device 600 through mode switching or the like, although it is not intended to control the digital device 600.
  • a pointing device is described as an example, but is not limited thereto.
  • the input means are communication protocols such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA), RS, etc. If necessary, at least one is employed to communicate with the digital device.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • UWB Ultra Wideband
  • DLNA Digital Living Network Alliance
  • RS Digital Living Network Alliance
  • the remote controller 610 refers to a conventional input means equipped with various key buttons necessary for controlling the digital device 600.
  • the pointing device 620 is equipped with a gyro sensor or the like to implement a pointer corresponding to the screen of the digital device 600 based on the user's movement, pressure, rotation, and the like, thereby implementing the digital device 600 ) To a certain control command.
  • the pointing device 620 may be named with various names such as a magic remote controller and a magic controller.
  • the keyboard 630 is an intelligent integrated digital device that provides a variety of services such as a web browser, an application, and a social network service (SNS) beyond the digital device 600 providing only a conventional broadcast, so that the control with the conventional remote controller 610 alone It was not easy, and it was implemented to promote the convenience of inputting text, etc., by implementing it similar to a PC keyboard.
  • SNS social network service
  • control means such as the remote control 610, the pointing device 620, and the keyboard 630 are provided with a touch pad as necessary, thereby providing more convenient and various control purposes such as text input, pointer movement, and enlargement/reduction of pictures or videos. Can be used in.
  • the digital device described in this specification uses a web OS as an OS and/or platform.
  • a processing procedure such as a configuration or an algorithm based on WebOS may be performed by the control unit of the above-described digital device.
  • the control unit includes the control unit in FIGS. 2 to 5 described above and is used as a broad concept. Therefore, hereinafter, for processing webOS-based or related services, applications, content, etc. in a digital device, hardware or components, including related software, firmware, and the like, are controlled by a controller.
  • a controller explained by name.
  • the webOS-based platform is intended to enhance development independence and functional scalability by integrating services, applications, etc., for example, based on a Luna-service bus, and developing applications based on a web application framework. Productivity can also be increased. In addition, multi-tasking can be supported by efficiently utilizing system resources through web OS processes and resource management.
  • the web OS platform described in this specification can be used in mobile devices such as mobile phones, smart phones, tablet pcs, notebooks, wearable devices, as well as fixed devices such as PCs, TVs, and set-top boxes (STBs). .
  • the structure of software for digital devices is a single process and a closed product based on multi-threading with a conventional problem-solving and market-dependent monolithic structure.
  • Layering & componentization To have a three-layered structure, an add-on structure for add-on, single source products, and open applications.
  • the software structure has been further improved to provide a modular architecture of functional units, a Web Open API (Application Programming Interface) for an eco-system, and a game engine.
  • a modular design for a native open API or the like is being made, and accordingly, it is generated as a multi-process structure based on a service structure.
  • FIG. 7 is a diagram illustrating a web OS architecture according to an embodiment of the present invention.
  • the platform can be roughly divided into a kernel, a system library-based Web OS core platform, an application, and a service.
  • the architecture of the WebOS platform is a layered structure, with the OS at the lowest layer, the system library(s) at the next layer, and the applications at the top.
  • the lowest layer may include a Linux kernel as an OS layer and Linux as an OS of the digital device.
  • a BSP Battery Support Package
  • HAL Hardware Abstraction Layer
  • Web OS core modules layer a Web OS core modules layer
  • service layer a service layer
  • a Luna-Service bus layer Li-Service Bus layer
  • Nyo framework/NDK Native Developer ⁇ Kit
  • QT layer Enyo framework/NDK/QT layer
  • web OS layer structures may be omitted, and a plurality of layers may be layered or a layer may be a plurality of layer structures.
  • the webOS core module layer is based on Luna Surface Manager (LSM) that manages surface windows, SAM (System & Application Manage) that manages execution and execution status of applications, and WebKit. It may include a Web Application Manager (WAM) for managing web applications.
  • LSM Luna Surface Manager
  • SAM System & Application Manage
  • WAM Web Application Manager
  • the LSM manages an application window displayed on the screen.
  • the LSM controls the display hardware (Display HW), provides a buffer for applications to render necessary content, and composites the results rendered by multiple applications on the screen.
  • Display HW Display HW
  • the SAM manages execution policies for various conditions of the system and application.
  • WAM the web OS can view the web application (Web App) as a basic application, and is based on the Enyo Framework.
  • the service use of the application is performed through a Luna-service bus, and the service can be newly registered on the bus, and the application can also find and use the service it needs.
  • the service layer may include various service level services such as TV service and WebOS service.
  • the web OS service may include a media server, Node.JS, etc.
  • the Node.JS service supports, for example, JavaScript.
  • the WebOS service is a Linux process that implements function logic and can communicate over the bus. It can be largely divided into four parts, TV processes and services that are migrated to WebOS from existing TVs or services that are manufacturer differentiated services, webOS common services and JavaScript, and used through Node.js. It consists of Node.js service.
  • the application layer may include all applications that can be supported by a digital device, such as a TV application, a showcase application, a native application, and a web application.
  • Applications on the web OS can be classified into a web application (Web Application), a Palm Development Kit (PDK) application, and a Qt Meta Language or Qt Modeling Language (QML) application depending on the implementation method.
  • Web Application Web Application
  • PDK Palm Development Kit
  • QML Qt Modeling Language
  • the web application is based on a WebKit engine and is executed on the WAM runtime.
  • the web application may be based on the ENYO framework, or developed and executed based on general HTML5, Cascading Style Sheets (CSS), and JavaScript.
  • the PDK application includes a native application developed in C/C++ based on a PDK provided for a third-party or external developer.
  • the PDK refers to a set of development libraries and tools provided for third parties such as games to develop native applications (C/C++).
  • C/C++ native applications
  • PDK applications can be used to develop applications where performance is important.
  • the QML application is a native application based on Qt, and includes a basic application provided with a web OS platform such as a card view, a home dashboard, and a virtual keyboard.
  • QML is a script-type mark-up language instead of C++.
  • the native application refers to an application developed and compiled in C/C++ and executed in a binary form, and such a native application has an advantage of fast execution speed.
  • FIG. 8 is a diagram illustrating an architecture of a web OS device according to an embodiment of the present invention.
  • FIG. 8 is a block diagram based on a runtime of a web OS device, which can be understood by referring to the layered structure of FIG. 7.
  • services and applications and WebOS core modules are included on a system OS (Linux) and system libraries, and communication between them may be performed through a Luna-service bus.
  • system OS Linux
  • system libraries Linux
  • communication between them may be performed through a Luna-service bus.
  • Node.js services based on HTML5, CSS, and JavaScript including e-mail, contact, calendar, logging, backup, and file notify webOS services such as notify, database (DB), activity manager, system policy, audio daemon (AudioDmon), update, media server, etc., EPG TV services such as (Electronic Program Guide), PVR (Personal Video Recorder), data broadcasting, voice recognition, Now on, Notification, search CP services such as Auto Content Recognition (ARC), Contents List Broswer (CBOX), wfdd, DMR, Remote Application, Download, SDPIF (Sony Philips Digital Interface Format), PDK applications, browser , Native applications such as QML applications, and UI-related TV applications and web applications based on the Enyo framework are processed through web OS core modules such as SAM, WAM, and LSM described above through the Luna-service bus. Meanwhile, in the above, TV applications and web applications may not necessarily be based on the Enyo framework or UI.
  • CBOX can manage the list and metadata of the contents of external devices such as USB, DLNA, and cloud connected to the TV. Meanwhile, CBOX can output content listings of various content containers, such as USB, DMS, DVR, cloud, etc., as an integrated view. In addition, CBOX can display various types of content listings such as pictures, music, and videos, and manage their metadata. In addition, the CBOX can output the contents of the attached storage in real-time. For example, when a storage device such as USB is plugged in, the CBOX should be able to immediately output a list of contents of the storage device. At this time, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate a variety of connection protocols.
  • the SAM is intended to improve module complexity and improve scalability.
  • the existing system manager handles several functions such as system UI, window management, web application runtime, and constraint processing on UX in a single process.
  • the implementation complexity is reduced.
  • LSM supports system UX implementation such as card view and launcher to be independently developed and integrated, and supports to easily respond to changes in product requirements.
  • LSM in the case of compositing multiple application screens such as app-on-apps, makes full use of hardware resources (HW resource) to enable multi-tasking, such as multi-window (multi-window) and 21:9. It can provide a window management mechanism (window management mechanism) for.
  • LSM supports the implementation of system UI based on QML, and improves the development productivity.
  • QML UX is based on MVC, so it is easy to construct views for screen layout and UI components, and it is also easy to develop code for processing user input.
  • the interface between the QML and the webOS component is done through the QML extension plug-in, and the graphic operation of the application can be based on the wayland protocol, luna-service call, etc. have.
  • LSM is an abbreviation of Luna Surface Manager, as described above, and functions as an application window compositor.
  • LSM composes and outputs independently developed applications and UI components on the screen.
  • the LSM defines an output area, an interworking method, etc. as a compositor.
  • the compositor LSM handles graphic composition, focus management, and input events.
  • the LSM receives events, focus, and the like from the input manager.
  • Such input managers may include a remote controller, HID such as a mouse & keyboard, joystick, game pad, application remote, pen touch, and the like.
  • the LSM supports multiple window models, which can be executed simultaneously in all applications due to the system UI characteristics.
  • Launcher Recents, Settings, Notification, System Keyboard, Volume UI, Search, Finger gesture, Voice Recognition (STT (Sound to Text), TTS (Text to) LSM can support Sound), NLP (Natural Language Processing), etc., pattern gesture (camera, Mobile Radio Control Unit (MRCU)), Live menu, ACR (Auto Content Recognition), etc. .
  • FIG. 9 is a diagram illustrating a graphic composition flow in a web OS device according to an embodiment of the present invention.
  • the graphic composition processing includes a web application manager 910 in charge of a UI process, a webkit 920 in charge of a web process, a LSM 930 and a graphic manager (GM) 940.
  • the web application-based graphic data (or application) is generated as a UI process in the web application manager 910
  • the generated graphic data is not a full-screen application
  • the web application manager 910 receives the application generated by the web kit 920 to share the graphic processing unit (GPU) memory for graphic management between the UI process and the web process, and this is a full-screen as described above. If it is not an application, it is delivered to the LSM 930. In the case of the full-screen application, the LSM 930 may be bypassed, and in this case, it may be directly transferred to the graphic manager 940.
  • GPU graphic processing unit
  • the LSM 930 transmits the received UI application via the Wayland surface to the Wayland Compositor, and processes it appropriately in the Wayland Compositor and delivers it to the graphic manager.
  • the graphic data transmitted from the LSM 930 is transmitted to the graphic manager compositor through the LSM GM surface of the graphic manager 940, for example.
  • the full-screen application is delivered directly to the graphic manager 940 without going through the LSM 930, which is processed by the graphic manager compositor through the WAM GM surface.
  • the graphic manager processes all graphic data in the webOS device, such as the data through the LSM GM surface described above, the data through the WAM GM surface, as well as the GM surface, such as a data broadcasting application and a caption application. All graphic data passed through is received and processed to be properly displayed on the screen.
  • the function of the GM compositor is the same or similar function to the compositor described above.
  • FIG. 10 is a view illustrating a media server according to an embodiment of the present invention
  • FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention
  • FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
  • the media server supports the execution of various multimedia in the digital device and manages necessary resources.
  • the media server can efficiently use hardware resources required for media play.
  • the media server requires audio/video hardware resources to execute multimedia, and can efficiently utilize the resource usage status.
  • a fixed device having a larger screen than a mobile device requires more hardware resources when executing multimedia, and the encoding/decoding and graphic data transfer speeds need to be fast due to a large amount of data.
  • the media server performs broadcasting, recording, and tuning tasks, recording simultaneously with viewing, or simultaneously displaying a sender and a receiver screen during a video call. It should be able to handle the back.
  • hardware resources such as an encoder, a decoder, a tuner, and a display engine are limited on a chip-set basis, making it difficult to execute multiple tasks at the same time. Process the input.
  • the media server can enhance system stability, for example, by removing and restarting a playback pipeline for which an error occurred during media playback for each pipeline, and thus generating an error as described above. This may not affect other media play.
  • This pipeline is a chain that connects each unit functions such as decoding, analysis, and output when requesting media playback, and required unit functions may be changed according to a media type.
  • the media server can have extensibility, for example, a new type of pipeline can be added without affecting the existing implementation.
  • the media server may accommodate a camera pipeline, a video conference (Skype) pipeline, a third-party pipeline, and the like.
  • the media server can process normal media playback and TV task execution as separate services because the interface of the TV service is different from the media playback case.
  • the media server supports operations such as setchannel, channelup, channeldown, channeltuning, recordstart, etc. in relation to TV service, and supports operations such as play, pause, stop, etc. in relation to general media playback, and is different for both. It supports operations and can be processed as a separate service.
  • the media server can control or integrate resource management functions.
  • the hardware resource allocation and retrieval in the device are integrated in the media server, and in particular, the TV service process delivers the running task and resource allocation status to the media server.
  • the media server secures resources each time each media is executed and the pipeline is executed. Based on the resource status occupied by each pipeline, the media server allows execution by priority (for example, policy) when requesting media execution and Resource recovery of other pipelines is performed.
  • priority for example, policy
  • the predefined execution priority and required resource information for a specific request are managed by a policy manager, and the resource manager communicates with the policy manager to process resource allocation, recovery, and the like.
  • the media server may have an identifier (ID) for all operations related to playback. For example, the media server may issue a command by instructing a specific pipeline based on the identifier. The media server may issue commands to the pipelines by dividing the two into two or more media.
  • ID identifier
  • the media server can be responsible for playing HTML 5 standard media.
  • the media server can follow the TV restructuring scope for the separate service process of the TV pipeline.
  • the media server may be designed and implemented regardless of the TV restructuring range. If the TV is not serviced separately, the entire TV may need to be re-run when a problem occurs in a specific task.
  • the media server is also called a uMS, that is, a micro media server.
  • the media player is a media client, which is, for example, the web for HTML5 video tags, cameras, TVs, Skype, second screens, and the like. It can mean a kit (Webkit).
  • the media server In the media server, management of micro resources such as a resource manager and a policy manager is a key function. In relation to this, the media server also controls a playback control role for web standard media content. In this regard, the media server may also manage pipeline controller resources.
  • the media server supports, for example, extensibility, reliability, and efficient resource usage.
  • uMS that is, the media server
  • uMS is a cloud game (cloud game), MVPD (pay service, etc.), camera preview (camera preview), second screen (2nd screen), skyOS, and other resources such as web OS devices such as TV resources
  • cloud game cloud game
  • MVPD pay service, etc.
  • camera preview camera preview
  • second screen 2nd screen
  • skyOS and other resources
  • web OS devices such as TV resources
  • each resource uses a pipeline, for example, when used, and the media server can overall manage and control the creation, deletion, and use of the pipeline for resource management.
  • a pipeline is generated when, for example, a media related to a task starts continuation of operations such as request, decoding stream, and video output. Can be. For example, in relation to a TV service or application, watching, recording, channel tuning, etc. are individually handled under control of resource usage through a pipeline generated according to the request. .
  • an application or service is connected to a media server 1020 and a Luna-service bus 1010, and the media server 1020 communicates with pipelines regenerated through the Luna-service bus 1010. Connected and managed.
  • the application or service has various clients according to its characteristics, and through which data can be exchanged with the media server 1020 or the pipeline.
  • the client includes, for example, a uMedia client (web kit) and a resource manager (RM) client (C/C++) for connecting with the media server 1020.
  • a uMedia client web kit
  • RM client resource manager
  • the application including the uMedia client is connected to the media server 1020 as described above. More specifically, the uMedia client corresponds to, for example, a video object to be described later, and the client uses the media server 1020 for the operation of the video by request or the like.
  • the video operation relates to a video state
  • loading, unloading, play, playback, reproduce, pause, stop, etc. are all states related to the video operation.
  • Data Each operation or state of this video can be processed through individual pipeline creation.
  • the uMedia client transmits state data related to the video operation to the pipeline manager 1022 in the media server.
  • the pipeline manager 1022 acquires information about a resource of the current device through data communication with the resource manager 1024 and requests allocation of a resource corresponding to the status data of the uMedia client. At this time, the pipeline manager 1022 or the resource manager 1024 controls the resource allocation through data communication with the policy manager 1026 when necessary. For example, when the resource manager 1024 has no or insufficient resources to allocate at the request of the pipeline manager 1022, appropriate resource allocation or the like is made according to the request according to the priority comparison of the policy manager 1026 or the like. Can.
  • the pipeline manager 1022 requests the media pipeline controller 1028 to create a pipeline for an operation according to the request of the uMedia client for the resource allocated according to the resource allocation of the resource manager 1024. .
  • the media pipeline controller 1028 creates a necessary pipeline under the control of the pipeline manager 1022. As shown in the pipeline, the media pipeline and the camera pipeline, as well as pipelines related to playback, pause, pause, etc. may be created in the pipeline. Meanwhile, the pipeline may include a pipeline for HTML5, web CP, smartshare playback, thumbnail extraction, NDK, cinema, Multimedia and Hypermedia Information coding Experts Group (MHEG), and the like.
  • the pipeline may include a pipeline for HTML5, web CP, smartshare playback, thumbnail extraction, NDK, cinema, Multimedia and Hypermedia Information coding Experts Group (MHEG), and the like.
  • the pipeline may include, for example, a service-based pipeline (own pipeline) and a URI-based pipeline (media pipeline).
  • an application or service including an RM client may not be directly connected to the media server 1020. This is because the application or service may directly handle the media. In other words, when an application or service directly processes media, it may not go through a media server. However, at this time, resource management is required for pipeline creation and its use. For this, the uMS connector functions. Meanwhile, when a resource management request for direct media processing of the application or service is received, the uMS connector communicates with the media server 1020 including the resource manager 1024. To this end, the media server 1020 should also be provided with a uMS connector.
  • an application or service may respond to a request of an RM client by receiving resource management of the resource manager 1024 through the uMS connector.
  • RM clients can handle services such as native CP, TV service, second screen, flash player, YouTube medium source extensions (MSE), cloud games, and Skype.
  • MSE medium source extensions
  • the resource manager 1024 may manage resources through data communication with the policy manager 1026 when necessary for resource management.
  • the URI-based pipeline is made through the media server 1020, not in the case of directly processing media like the RM client described above.
  • the URI-based pipeline may include a player factory, a Gstreamer, a streaming plug-in, and a digital rights management (DRM) plug-in pipeline.
  • DRM digital rights management
  • an interface method between an application and media services may be as follows.
  • This is a method of interfacing with a service in a web application.
  • This is a Luna Call using the PSB (Palm Service Bridge), and a method using Cordova, which extends the display to video tags.
  • PSB Purm Service Bridge
  • Cordova which extends the display to video tags.
  • there may be a way to use the HTML5 standard for video tags or media elements.
  • the seamless change is processed by a separate module (for example, TVWIN), which is a process for displaying and displaying the TV on the screen without webOS first and seamlessly, before or during booting of the webOS. .
  • TVWIN a separate module
  • This is used for the purpose of first providing the basic function of the TV service for quick response to a user's Power On request because the booting time of the WebOS is late.
  • the module supports a firmware change, factory mode, etc. that provide fast booting and basic TV functions as part of the TV service process.
  • the module may be in charge of switching from Non-WebOS mode to WebOS mode.
  • the solid line box indicates a process processing configuration
  • the dotted line box indicates an internal processing module during the process.
  • a solid arrow indicates an inter-process call, that is, a Luna service call
  • a dotted arrow indicates a notification or data flow such as register/notify.
  • the service or web application or PDK application (hereinafter referred to as an application) is connected to various service processing components through a Luna-service bus, through which the application operates or is controlled.
  • the data processing path varies depending on the type of application. For example, when the application is image data related to a camera sensor, it is transmitted to the camera processor 1130 for processing. At this time, the camera processor 1130 processes image data of the received application, including a gesture, a face detection module, and the like.
  • the camera processing unit 1130 may process the data by creating a pipeline through the media server processing unit 1110, for example, in the case of data that is required by the user or automatically using a pipeline.
  • the audio may be processed through an audio processing unit (AudioD) 1140 and an audio module (PulseAudio) 1150.
  • the audio processing unit 1140 processes audio data received from an application and transmits it to the audio module 1150.
  • the audio processing unit 1140 may determine the processing of audio data, including an audio policy manager.
  • the audio data processed in this way is processed by the audio module 1160.
  • the application may notify data related to audio data processing to the audio module 1160, which may notify the audio module 1160 in an associated pipeline.
  • the audio module 1150 includes an Advanced Linux Sound Architecture (ALSA).
  • ALSA Advanced Linux Sound Architecture
  • the corresponding content data is transmitted to the DRM service processing unit 1160, and the DRM service processing unit 1170 creates a DRM instance.
  • the DRM service processing unit 1160 may be connected to and process the DRM pipeline in the media pipeline through the Luna-service bus for processing of the DRM-hung content data.
  • FIG. 12 is a view for explaining in more detail only the media server processing unit and the TV service processing unit in FIG. 11 described above.
  • the application when the application includes TV service data, it is processed by the TV service processor 1120/1220.
  • the TV service processing unit 1120 includes, for example, at least one of a DVR/channel manager, a broadcasting module, a TV pipeline manager, a TV resource manager, a data broadcasting module, an audio configuration module, and a route manager.
  • the TV service processing unit 1220 in FIG. 12 includes a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV middleware), a route manager, and a BSP ( For example, NetCast).
  • the service processing unit may mean, for example, a module including a TV pipeline manager, a TV resource manager, a TV policy manager, and a USM connector.
  • the TV service processing unit may have a configuration as illustrated in FIG. 11 or 12 or may be implemented in a combination of both, and some components may be omitted or some components not shown may be added.
  • the TV service processing unit 1120/1220 transmits to the DVR/channel manager in case of digital video recorder (DVR) or channel-related data based on the attribute or type of TV service data received from the application, and then back to the TV pipeline manager To the TV pipeline and process it.
  • the TV service processor 1120 when the attribute or type of the TV service data is broadcast content data, the TV service processor 1120 generates and processes the TV pipeline through the TV pipeline manager to process the data through the broadcast module.
  • a json (Javascript standard object notation) file or a file written in c is processed by the TV broadcast handler and transmitted to the TV pipeline manager through the TV broadcast interface unit to generate and process the TV pipeline.
  • the TV broadcast interface unit may transmit data or files that have passed through the TV broadcast handler to the TV pipeline manager based on the TV service policy for reference when creating the pipeline.
  • the TV pipeline manager may be under the control of the TV resource manager in creating one or more pipelines according to a TV pipeline generation request from a processing module or a manager in the TV service.
  • the TV resource manager may be under the control of the TV policy manager to request the status and allocation of resources allocated for the TV service according to the TV pipeline manager's request to create a TV pipeline, and the media server processor 1110 /1210) and uMS connector.
  • the resource manager in the media server processing unit 1110/1210 transmits the status and allocation of resources for the current TV service at the request of the TV resource manager. For example, as a result of checking the resource manager in the media server processing unit 1110/1210, if all the resources for the TV service have already been allocated, the TV resource manager may notify that all resources are currently allocated.
  • the resource manager in the media server processing unit along with the notify, removes a predetermined TV pipeline according to a priority or a predetermined criterion among TV pipelines allocated for a TV service, and the TV pipeline for the requested TV service. You can also request or allocate creation.
  • the TV resource manager may appropriately remove, add, or establish a TV pipeline in the TV resource manager according to the status report of the resource manager in the media server processing unit 1110/1210.
  • the BSP supports backward compatibility with, for example, existing digital devices.
  • the TV pipelines thus generated can be properly operated under the control of the route manager in the process.
  • the route manager may determine or control the processing route or process of the pipelines in consideration of the operation of the pipeline generated by the media server processor 1110/1210 as well as the TV pipeline in the process.
  • the media server processing unit 1110/1210 processes it.
  • the media server processing unit 1110/1210 includes a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, and the like.
  • the pipeline created under the control of the media pipeline manager and the media pipeline controller can be variously generated, such as a camera preview pipeline, a cloud game pipeline, and a media pipeline.
  • the media pipeline may include a streaming protocol, an auto/static gstreamer, DRM, etc., and the processing flow may be determined according to the control of the route manager.
  • the detailed processing process in the media server processing unit 1110/1210 uses the description of FIG. 10 described above, and is not described herein again.
  • the resource manager in the media server processor 1110/1210 may manage resources on a counter basis, for example.
  • FIG. 13 is a diagram illustrating a control method of a remote control device that controls any one of video display devices according to embodiments of the present invention.
  • a pointer 1301 corresponding to the remote control device 1310 is displayed on the display unit 1300.
  • the user can move or rotate the remote control device 1310 up and down, left and right (FIG. 13(b)), and front and rear (FIG. 13(c)).
  • the pointer 1301 displayed on the display unit 180 of the image display device corresponds to the movement of the remote control device 1310.
  • the remote control device 1310 may be referred to as a spatial remote controller because the corresponding pointer 1301 is moved and displayed according to movement in 3D space, as shown in the drawing.
  • FIG. 13B illustrates that when the user moves the remote control device 1310 to the left, the pointer 1301 displayed on the display unit 1300 of the image display device moves to the left correspondingly.
  • Information on the movement of the remote control device 1310 detected through the sensor of the remote control device 1310 is transmitted to the image display device.
  • the video display device may calculate the coordinates of the pointer 1301 from information on the movement of the remote control device 1310.
  • the image display device may display the pointer 1301 to correspond to the calculated coordinates.
  • FIG. 13C illustrates a case in which a user moves the remote control device 1310 away from the display unit 1300 while pressing a specific button in the remote control device 1310.
  • the selected area in the display unit 1300 corresponding to the pointer 1301 may be zoomed in and enlarged.
  • a selection area in the display unit 1300 corresponding to the pointer 1301 may be zoomed out and reduced.
  • the remote control device 1310 moves away from the display unit 1300, the selection area is zoomed out, and when the remote control device 1310 approaches the display unit 1300, the selection area may be zoomed in.
  • the moving speed or the moving direction of the pointer 1301 may correspond to the moving speed or the moving direction of the remote control device 1310.
  • the pointer in the present specification means an object displayed on the display unit 1300 in response to the operation of the remote control device 1310. Accordingly, various shapes of objects other than the arrow shape illustrated in the drawing are possible with the pointer 1301. For example, it may be a concept including points, cursors, prompts, and thick outlines.
  • the pointer 205 may be displayed corresponding to any one point of the horizontal axis and the vertical axis on the display unit 180, as well as a plurality of points such as a line and a surface. Do.
  • FIG. 14 is an internal block diagram of a remote control device controlling any one of video display devices according to embodiments of the present invention.
  • the remote control device 1400 includes a wireless communication unit 1425, a user input unit 1435, a sensor unit 1440, an output unit 1450, a power supply unit 1460, and a storage unit 1470. , May include a control unit 1480.
  • the wireless communication unit 1425 transmits and receives signals to any one of the video display devices according to the embodiments of the present invention described above.
  • video display devices according to embodiments of the present invention one video display device 1401 will be described as an example.
  • the remote control device 1400 may include an RF module 1421 capable of transmitting and receiving signals to and from the video display device 1401 according to the RF communication standard. Also, the remote control device 1400 may include an IR module 1423 capable of transmitting and receiving signals to and from the image display device 1401 according to the IR communication standard.
  • the remote control device 1400 transmits a signal including information on the movement of the remote control device 1400 to the image display device 1401 through the RF module 1421.
  • the remote control device 1400 may receive a signal transmitted by the image display device 1401 through the RF module 1421. In addition, the remote control device 1400 may transmit a command for power on/off, channel change, volume change, etc. to the image display device 1401 through the IR module 1421 as necessary.
  • the user input unit 1435 may include a keypad, a button, a touch pad, or a touch screen.
  • the user may input a command related to the image display device 1401 to the remote control device 1400 by operating the user input unit 1435.
  • the user input unit 1435 includes a hard key button
  • the user may input a command related to the image display device 1401 to the remote control device 1400 through a push operation of the hard key button.
  • the user input unit 1435 includes a touch screen
  • the user may input a command related to the image display device 1401 to the remote control device 1400 by touching a soft key on the touch screen.
  • the user input unit 1435 may include various types of input means that can be operated by a user, such as a scroll key or a jog key, and this embodiment does not limit the scope of the present invention.
  • the sensor unit 1440 may include a gyro sensor 1441 or an acceleration sensor 1443.
  • the gyro sensor 1441 may sense information on the movement of the remote control device 1400.
  • the gyro sensor 1441 may sense information on the operation of the remote control device 1400 based on the x, y, and z axes.
  • the acceleration sensor 1443 may sense information on the movement speed of the remote control device 1400 and the like. Meanwhile, a distance measuring sensor may be further provided, thereby sensing a distance from the display unit 1401.
  • the output unit 1450 may output an image or audio signal corresponding to manipulation of the user input unit 1435 or a signal transmitted from the image display device 1401. Through the output unit 1450, the user may recognize whether the user input unit 1435 is operated or whether the image display device 500 is controlled.
  • the output unit 1450 includes a LED module 1451 that is turned on when a user input unit 1435 is operated or a signal is transmitted and received through the wireless communication unit 1425, a vibration module that generates vibration ( 1453), an audio output module 1455 for outputting sound, or a display module 1457 for outputting an image.
  • the power supply 1460 supplies power to the remote control device 1400.
  • the power supply 1460 may reduce power waste by stopping power supply when the remote control device 1400 has not been moved for a predetermined period of time.
  • the power supply 1460 may resume power supply when a predetermined key provided in the remote control device 1400 is operated.
  • the storage unit 1470 may store various types of programs and application data required for control or operation of the remote control device 1400. If the remote control device 1400 transmits and receives signals wirelessly through the image display device 1401 and the RF module 1421, the remote control device 1400 and the image display device 1401 transmit signals through a predetermined frequency band. Send and receive.
  • the control unit 1480 may store and reference information on a frequency band capable of wirelessly transmitting and receiving a signal to and from a video display device 1401 paired with the remote control device 1400 in the storage unit 1470.
  • the control unit 1480 controls all matters related to the control of the remote control device 1400.
  • the control unit 1480 displays a signal corresponding to a predetermined key manipulation of the user input unit 1435 or a signal corresponding to the movement of the remote control device 1400 sensed by the sensor unit 1440 through the wireless communication unit 1425. (1401).
  • FIG. 15 the digital device shown in FIG. 15 as a digital device will be described as an example.
  • the digital device according to an embodiment of the present invention may be implemented with the digital devices shown in FIGS. 1 to 14.
  • FIGS. 15 to 45 the digital device and its control method will be described in detail.
  • a person skilled in the art may refer to FIGS. 1 to 14 previously described, and supplement or interpret the examples 15 to 45 or modify examples.
  • FIG. 15 is a configuration diagram of a display device according to an embodiment of the present invention.
  • the digital device 1500 includes a tuner 1510, a communication unit 1520, a controller 1530, a display 1540, a speaker 1550, a microphone 1560, a memory 1570, and a camera 1580 ).
  • the tuner 1510 receives a broadcast signal from a broadcasting station.
  • the communication unit 1520 communicates with at least one of an external server and an external remote control.
  • the display 1540 displays content included in the received broadcast signal on the screen.
  • the content is received from an external server or stored in the internal memory.
  • the speaker 1550 outputs a first sound generated when playing content.
  • the first sound may be a TV sound.
  • the microphone 1560 receives a second sound including a user voice command for controlling the operation of the digital device 1500 from the user, and receives the first sound from the speaker 1550. According to an embodiment of the present invention, the microphone 1560 may receive TV sound and a user's voice.
  • the memory 1570 stores various data related to the operation of the digital device 1500, applications providing specific functions, default content, and data.
  • the camera 1580 captures the front image of the digital device 1500 according to the control command of the controller 1530.
  • the controller 1530 controls at least one of a tuner 1510, a communication unit 1520, a display 1540, a speaker 1550, a microphone 1560, a memory 1570, and a camera 1580.
  • the launcher displayed on the home screen of the digital device 1500 according to a user's command input to the digital device 1500 is an application (also referred to as “App” for short) (or various menus/functions) ) It can mean a collection of searchable and shortcutable applications.
  • the application may be pre-built when the display device is shipped from the factory, or may be downloaded by accessing the Internet to an application providing server. For example, Internet surfing may be performed on a display device by accessing the Internet through a web browser application.
  • the launcher is a system app when shipped from the factory (e.g. Search, Mobile, Live, Recents), a stub app (e.g. Netflix, Amazon, YouTube, etc.), a preloaded app (pre-loaded app) (Eg, Gallery, Web browser, Photo & Video, Music, Content Store, etc.).
  • a system app when shipped from the factory (e.g. Search, Mobile, Live, Recents), a stub app (e.g. Netflix, Amazon, YouTube, etc.), a preloaded app (pre-loaded app) (Eg, Gallery, Web browser, Photo & Video, Music, Content Store, etc.).
  • the configuration of the launcher may be edited by the user.
  • the launcher will be described with reference to FIGS. 16 to 19.
  • 16 to 19 are diagrams for explaining the overall configuration of the launcher according to an embodiment of the present invention.
  • predetermined content 1000 may be displayed on the display 1540 of the digital device 1500.
  • the predetermined content may be one of a plurality of contents that the digital device 1500 can provide.
  • the predetermined content may be a broadcast screen in real-time broadcasting on-air through a broadcast channel, a multimedia screen received from a mobile device, or a multimedia screen received from a USB storage device, or a set-top box It may be a broadcast screen received through.
  • a user command may be input through the remote control device 200.
  • the user command may be that a specific button (for example, a “home screen” button) provided on the remote control device 200 is pressed.
  • the user command may be transmitted to the digital device 1500.
  • controller 1530 of the digital device 1500 may control the launcher 2000 to be displayed on the display 1540 as shown in FIG. 17.
  • the launcher 2000 may be displayed overlaid on a partial area of the entire display screen of the display device 1500. For example, it may be displayed on the lower part of the entire display screen. It may be displayed overlaid on the upper part, the right part, and the left part. It can even be displayed overlaid to cover the entire screen.
  • the right portion of the launcher 2000 is displayed It may not be. 21 illustrates a case where the right portion of the launcher 2000 is not displayed, and the portion may be scrolled and displayed by a user's scroll command.
  • the launcher 2000 may be composed of a first stage launcher 2000A and a second stage launcher 2000B.
  • the first stage launcher 2000A may be composed of a plurality of consecutive tiles. Each tile can be assigned one app or function (or menu). The tiles may be classified into a plurality of uses or types according to the nature of the assigned app or function. For example, the tiles may be classified into any one of a promotion tile, a system tile, a content primary tile, a preloaded tile, and a home editing tile by use or type. The tiles may be arranged for each use/type. The arrangement of the tiles may be changed by the user's editing.
  • each tile included in the first stage launcher 2000A may be referred to as a “first stage tile” if necessary.
  • One of the tiles may be focused or selected by the user.
  • a navigation pointer (or cursor, frame, indicator) is positioned on the desired tile through manipulation of a navigation key provided in the remote control device 200, or the desired tile is highlighted or Alternatively, when the remote control device 200 is a spatial remote control, it may mean that the spatial remote control pointer (or cursor, frame, indicator) is positioned on a desired tile through movement of the remote control device 200.
  • the fact that the desired tile is selected means that a user confirmation command is input through the remote control device 200 while the desired tile is in focus.
  • the user confirmation command may be input by pressing a specific button (for example, “OK” button) provided in the remote control device 200.
  • the promotional tile 2100 is a tile allocated for an advertisement that is refreshed and displayed each time a home screen is entered.
  • the promotion tile may not be included in the first launcher 200A when the promotion display is set to OFF by the user, when the promotion terms and conditions are not agreed, or when a network connection is not made.
  • the tile for the system is assigned a search (2200), a home dashboard (2300), a TV (2400), and a Recents function (2500) (recently used apps/function calls), respectively. It is a tile.
  • the controller 1530 of the digital device 1500 may control the integrated search screen to be displayed.
  • the controller 1530 may control the home dashboard screen to be displayed.
  • the home dashboard tile 2300 is a tile to which a home dashboard application for integrated management of a plurality of external devices wired or wirelessly connected to the digital device 1500 is allocated according to the present invention.
  • TV may be displayed on the TV tile 2400 or an STB name, a GIP name, or a live OTT name may be displayed.
  • the controller 1530 may control the screen of the source that has been viewed most recently to be displayed.
  • a screen shot of the most recent used app/function may be provided as the tile background image in the Resentz function tile 2500.
  • the title of the most recently used app/function may be displayed as text in the center of the tile. If the title is long, it may be displayed in a marquee manner. This can be applied to titles for other tiles as well.
  • the recall function tile when the recall function tile is focused, the phrase “No recent Activity” may be displayed.
  • the main content tile 2600 is a tile allocated for an app (or function) classified as main content by a manufacturer at the time of factory shipment.
  • a predetermined number of tiles (for example, as shown in FIG. 21, may be six, but is not limited to this) may be pre-prepared for the main content.
  • the app may be downloaded to the video display device when the entire factory is shipped.
  • the app may download only the title image for the tile to the video display device when shipped from the factory, and the title image may be displayed in the tile.
  • the controller 1530 may access the corresponding server to download the installation data of the app corresponding to the selected tile and install it on the digital device 1500.
  • the tile When an app is being installed, the tile may be guided by an app installation situation in the form of a progress bar.
  • the controller 1530 of the display device 1500 may control the entire screen being installed for the app to be displayed.
  • the preloaded tile 2700 is a tile allocated for an app or function preinstalled by the manufacturer at the time of factory shipment, for example, a gallery app, a web browser app, and a photo & video. Video) There may be an app.
  • the tile for home editing (not shown) is a tile allocated for an app or function for editing the configuration of the launcher.
  • the tile for home editing will be described later.
  • the horizontal length of the first stage launcher 2000A is longer than the total length of the entire screen of the display, only a part of the first stage launcher 2000A is displayed, and the remaining portions may not be displayed on the screen.
  • the first stage launcher 2000A is scrolled through manipulation of a navigation key provided in the remote control apparatus 200, so that the tile(s) of the first stage launcher 2000A that are not visible can be displayed while scrolling.
  • the remote control device 200 is a spatial remote control, as shown in FIG. 18, the left edge area 2010 or the right edge of the first stage launcher 2000A through the movement of the remote control device 200.
  • the pointer By placing the pointer in the area 2020, the first stage launcher 2000A can be scrolled to the left or right until the leftmost or rightmost tile appears.
  • one desired tile ie, the desired first stage tile of the first stage launcher 2000A will be described in more detail.
  • the controller 1530 may control the second stage launcher 2000B to be configured to match an app (or function) corresponding to the desired tile.
  • the two-stage launcher 2000B may be configured as tiles representing each.
  • each tile included in the two-stage launcher 2000B may be referred to as a “two-stage tile” if necessary.
  • the second stage launcher 2000B may be variable according to a tile selected from the first stage launcher 2000A.
  • the main contents of the first stage target app can be previewed as a tile by the user through the second stage launcher 2000B, the user can view the main contents of the first application even if the first stage target app is not selected and executed. You can also immediately select one of its main contents. This will be explained later.
  • the second stage launcher 2000B may not be displayed even when the desired tile is focused.
  • the second stage launcher 2000B may not be displayed while the first stage launcher 2000A is scrolled.
  • the configuration of the launcher 2000 may be changed as shown in FIG. 19.
  • the first stage launcher 2000A may be displayed to shrink in the vertical direction and/or the horizontal direction to occupy a smaller screen area. Then, text information in each tile in the first launcher 2000A may not be displayed or may be abbreviated.
  • the two-stage launcher 2000B may be enlarged in the vertical and/or horizontal directions to be displayed to occupy a larger screen area. Then, text information may be newly displayed or displayed in more detail in each tile in the two-stage launcher 2000B.
  • the display mode (for example, FIG. 17 or FIG. 18) of the launcher 2000 before the pointer moves to the second stage launcher 2000B is referred to as “first mode”, and the pointer is the second stage.
  • the display mode (for example, FIG. 19) of the launcher 2000 after moving to the launcher 2000B will be described as “second mode”.
  • the launcher 2000 may return to the first mode.
  • the title and/or information of the first stage target app of the first stage launcher 2000A may be displayed on the leftmost tile.
  • Tiles occupied by the main contents of the first stage target app may be arranged on the right side.
  • the controller 1530 may control the tile on the leftmost of the tiles occupied by the main contents to be focused by default, or the tile in which the pointer is located among them. have.
  • the horizontal length of the second-stage launcher 2000B is longer than the horizontal length of the entire display screen, only a part of the second-stage launcher 2000B is displayed, and the remaining portions may not be displayed on the screen.
  • the second stage launcher 2000B is scrolled through manipulation of a navigation key provided in the remote control apparatus 200, so that the tile(s) of the second stage launcher 2000B that is not visible can be displayed while scrolling. .
  • the remote control device 200 is a spatial remote control, as shown in FIG. 19, the left edge area 2030 of the two-stage launcher 2000B through the movement of the remote control device 200 or By placing the pointer in the right edge area 2040, the two-stage launcher 2000B can be scrolled to the left or right until the leftmost or rightmost tile appears.
  • the controller 1530 may control the content of the selected tile to be executed and displayed together with or instead of the real-time broadcast screen.
  • the controller 1530 displays the launcher 2000. As it disappears, the real-time broadcast screen can be controlled to be displayed.
  • 20 is a diagram illustrating functions corresponding to a plurality of sub-tiles belonging to a home dashboard tile according to an embodiment of the present invention.
  • a home dashboard tile is a tile to which an application for managing and managing a plurality of external devices currently connected to a display device 1500 in a single screen is integrated in one screen.
  • the integrated management means that information related to the plurality of external devices currently connected to the display device 1500 or wirelessly, operation control, and operation status can be checked or operated within a single screen. .
  • the plurality of external devices may be classified into a mobile device, an input device, and an Internet of Things (IoT) device according to the present invention.
  • IoT Internet of Things
  • the mobile device is a mobile terminal, a mobile phone, a smart phone (smart phone), a laptop computer (laptop computer), PDA (personal digital assistants), PMP (portable multimedia player), navigation, slate PC (slate PC), tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), a glass-type terminal (smart glass), a digital device 1500 such as a head mounted display (HMD)) And all electronic devices capable of wireless communication connection.
  • a smart phone smart phone
  • laptop computer laptop computer
  • PDA personal digital assistants
  • PMP portable multimedia player
  • navigation slate PC
  • slate PC slate PC
  • tablet PC tablet PC
  • ultrabook ultrabook
  • wearable device wearable device
  • wearable device for example, a watch-type terminal (smartwatch), a glass-type terminal (smart glass), a digital device 1500 such as a head mounted display (HMD)
  • HMD head mounted display
  • the input device RF antenna terminal, a plurality of HDMI terminals, a plurality of USB terminals, an optical output terminal, a composite terminal, all electronics that can be connected to the digital device 1500 through at least one of the LAN (LAN) terminal Devices.
  • LAN LAN
  • the IoT device may use at least one of a first Internet of Things method (eg, “LG thinQ”) provided by the manufacturer of the digital device 1500 or a second Internet of Things method provided by the Open Connectivity Foundation (OCF). It includes all household appliances (eg, refrigerators, air cleaners, washing machines, dryers, dishwashers, ovens, etc.) that are capable of wireless communication connection with the digital device 1500 through. That is, all household appliances connected by the first Internet of Things method are products of the same manufacturer as the digital device 1500 of the present invention.
  • a first Internet of Things method eg, “LG thinQ”
  • OCF Open Connectivity Foundation
  • the navigation pointer is located on the home dashboard tile in the first launcher through manipulation of the navigation keys provided on the remote control device 200, or the spatial remote control pointer is moved through the movement of the remote control device 200.
  • the controller 1530 considers that the home dashboard tile is selected, and a plurality of sub tiles belonging to the home dashboard tile in the second launcher are left/right or up/down. Display in the downward direction.
  • 21 is a diagram illustrating a process in which a plurality of sub tiles belonging to a home dashboard tile are displayed in a two-stage launcher according to an embodiment of the present invention.
  • the controller 1530 is provided with a navigation pointer on the home dashboard tile in a single-stage launcher through manipulation of a navigation key provided in the remote control device 200, or the remote control device 200
  • the spatial remote control pointer is positioned on the home dashboard tile through the movement of the plurality of sub tiles, belonging to the home dashboard tile 3100 are displayed by arranging them in the left/right direction in the second launcher.
  • the confirmation key (OK key) of the remote control device 200 is input. If possible, the display of the launcher (including the first and second stages) is terminated, and the execution screen of the home dashboard app allocated to the home dashboard tile 3100 is displayed. Descriptions related to the execution screen of the home dashboard app will be described later in detail in FIGS. 32 to 45 below.
  • the home dashboard tile 3100 displayed on the leftmost side of the two-stage launcher is provided as a shortcut tile of the home dashboard app.
  • a sub-tile to which a currently executing function is assigned may be displayed with a color icon of a specific color.
  • FIG. 21 shows that when a broadcast is received and output from a set-top box through an HDMI terminal, sub-tiles corresponding to the set-top box are displayed as color icons of a specific color.
  • the controller 1530 may visually feedback to the user that the specific sub-tile is currently selected by raising and displaying the specific sub-tile in the upward direction when a pointer is positioned on a specific sub-tile in the second launcher.
  • the mobile sub-tile 3110 representing the mobile device is located next to the home dashboard tile 3100, and the mobile sub-tile 3110 is an icon, device type, name, connection state and operation state of the corresponding mobile device. At least one of them may be displayed on the tile in the form of a preview or a thumbnail.
  • up to 10 mobile devices can be connected to the digital device, and when they are displayed as tiles, the recent connection order may be displayed close to the home dashboard tile 3100 as soon as possible.
  • the controller 1530 ends the display of the launcher regardless of the foreground app, and the mobile sub-tile.
  • the connection screen of the mobile device currently connected to the digital device 1500 represented by 3110 is displayed.
  • a screen sharing menu, a photo & video menu, and a music menu may be included in the connection screen of the mobile device, and the controller 1530 may perform mirror casting when the screen sharing menu is selected by the remote control device 200.
  • the controller 1530 may perform mirror casting when the screen sharing menu is selected by the remote control device 200.
  • the controller 1530 displays a list of photos & videos stored in the mobile device on the display 1540, and selects the photo selected from the list.
  • a video may be played and displayed on the display 1540 or a photo or video selected from the list may be displayed on the display 1540 by mirrorcasting the mobile device.
  • the controller 1530 displays a list of music files stored in the mobile device on the display 1540 and plays the music file selected from the list. By outputting it to the speaker 1550 or by allowing the mobile device to play a music file in the list, it can be streamed in real time and output to the speaker 1550.
  • each of the input sub tiles 3120 representing the input devices is located in the next order of the mobile sub tile 3110, and the input sub tiles 3120 are icons of the corresponding external device connected through the corresponding terminal, At least one of a device type, a name, a connection state, and an operation state may be displayed on a tile in a preview form or a thumbnail form.
  • a specific sub-tile 3121 among the input sub-tiles 3120 is selected through the remote control device 200, and an external device represented by the selected specific sub-tile 3121 is via a USB memory or DLNA.
  • an external device represented by the selected specific sub-tile 3121 is via a USB memory or DLNA.
  • the display of the launcher is ended, and a connection screen of the external device indicated by the specific sub-tile 3121 is displayed.
  • a photo & video menu, a music menu, and a recording menu may be included in the connection screen of the external device, and the controller 1530 may select the photo & video menu when the photo & video menu is selected by the remote control device 200.
  • a list of photos & videos stored in the display may be displayed on the display 1540, and a picture or video selected from the list may be played and displayed on the display 1540.
  • the controller 1530 displays a list of music files stored in the external device on the display 1540 and plays the music file selected from the list. Can be output to the speaker 1550.
  • the controller 1530 records content currently being played on the display 1540, and can store a file of the recorded content on the external device. have.
  • the IoT sub-tiles 3130 each representing IoT devices are located in the next sequence of the input sub-tiles 3120, and the IoT sub-tiles 3130 are the first Internet of Things (eg, “LG thinQ”) or OCF (Open Connectivity Foundation) provides at least one of icons, household appliance types, connection status and operation status of the household appliances connected to the digital device 1500 through at least one of the second Internet of Things methods. Or it can be displayed on the tile in the form of a thumbnail.
  • LG thinQ the first Internet of Things
  • OCF Open Connectivity Foundation
  • the specific IoT sub-tile 3131 indicates an inactive state in which the digital device 1500 is disconnected or has no response, and the controller 1530 has the specific IoT sub-tile 3131 in the remote control device When selected by (200), refreshes the device status information of the home appliance indicated by the specific IoT sub-tile 3131, and attempts communication connection with the home appliance again.
  • the air conditioner IoT sub-tile representing the air conditioner is turned on/off.
  • the status, the current temperature and the current operation mode may be displayed, and the power of the air conditioner may be turned on or off whenever the air conditioner IoT sub tile is selected.
  • the IoT device is a refrigerator
  • the controller 1530 is connected to the refrigerator by a first Internet of Things method (eg, “LG thinQ”), the current temperature of the refrigerator's refrigerator compartment in the refrigerator IoT sub-tile representing the refrigerator. And the freezer current temperature.
  • LG thinQ a first Internet of Things method
  • the washing machine IoT sub-tiles representing the washing machine remain until washing is completed. Time and current laundry course can be displayed.
  • the IoT device is a dryer
  • the controller 1530 is connected to the dryer by a first Internet of Things method (eg, “LG thinQ”)
  • LG thinQ a first Internet of Things method
  • the IoT device is a clothing styler
  • the controller 1530 is connected to the clothing styler by a first Internet of Things (eg, “LG thinQ”)
  • styling is completed on a styler IoT sub-tile representing the clothing styler. The remaining time to and the current styling course can be displayed.
  • the IoT device is an air purifier
  • the controller 1530 is connected to the air purifier by a first Internet of Things method (eg, “LG thinQ”)
  • fine dust is applied to the air purifier IoT sub-tile representing the air purifier.
  • the status very bad/bad/normal/good
  • the power of the air purifier can be turned on or off whenever the air purifier IoT sub-tile is selected.
  • the IoT device is a robot cleaner
  • the controller 1530 is connected to the robot cleaner and a first Internet of Things method (eg, “LG thinQ”)
  • the current state of the robot cleaner IoT sub-tile representing the robot cleaner is (Waiting/Charging) and the current operation mode when in operation can be displayed, and whenever the robot cleaner IoT sub-tile is selected, the robot cleaner can be turned on or paused.
  • the IoT device is an electric oven
  • the controller 1530 is connected to the electric oven and a first Internet of Things method (eg, “LG thinQ”), the current state of the electric oven IoT sub tile indicating the electric oven. And remaining time until cooking is completed.
  • LG thinQ a first Internet of Things method
  • the IoT device is a dishwasher
  • the controller 1530 is connected to the dishwasher by a first Internet of Things method (eg, “LG thinQ”), the current state of the dishwasher IoT sub-tile indicating the dishwasher. And the time remaining until the washing is completed.
  • LG thinQ a first Internet of Things method
  • the IoT device is an air conditioner
  • the controller 1530 is connected to the air conditioner and a second Internet of Things method provided by the Open Connectivity Foundation (OCF)
  • OCF Open Connectivity Foundation
  • the current temperature of the air conditioner is displayed on the air conditioner IoT sub-tile representing the air conditioner. It is displayed, and whenever the air conditioner IoT sub-tile is selected, the power of the air conditioner can be turned on or off.
  • the IoT device is a refrigerator
  • the controller 1530 is connected to the refrigerator by a second Internet of Things method provided by the Open Connectivity Foundation (OCF)
  • OCF Open Connectivity Foundation
  • the washing machine IoT sub-tiles representing the washing machine remain until washing is completed. Time and current laundry course can be displayed.
  • OCF Open Connectivity Foundation
  • the IoT device is a dryer
  • the controller 1530 is connected to the dryer and a second Internet of Things method provided by the Open Connectivity Foundation (OCF)
  • OCF Open Connectivity Foundation
  • the IoT device is a light
  • the controller 1530 is connected to the light by a second Internet of Things method provided by the Open Connectivity Foundation (OCF)
  • OCF Open Connectivity Foundation
  • the on/off state of the light can be displayed, and the light is Whenever the IoT sub-tile is selected, the light can be turned on or off.
  • the IoT device is a smart door lock
  • the controller 1530 is connected to the smart door lock and a second Internet of Things method provided by the Open Connectivity Foundation (OCF)
  • OCF Open Connectivity Foundation
  • the locked/open state of the smart door lock may be displayed.
  • the smart door lock IoT sub-tile is selected, the smart door lock may be locked or opened.
  • the smart plug can display the on/off status of the smart plug.
  • OCF Open Connectivity Foundation
  • the smart switch can display the on/off state of the smart switch.
  • OCF Open Connectivity Foundation
  • thermometer when the IoT device is a thermometer, and the controller 1530 is connected to the thermometer and a second Internet of Things method provided by the Open Connectivity Foundation (OCF), the temperature measured by the thermometer may be displayed.
  • OCF Open Connectivity Foundation
  • the tile of the last sequence is a user guide tile 3140 for connecting with another device
  • the controller 1530 has the user guide tile 3140 through the remote control device 200.
  • the display of the launcher ends and a user guide information window for guiding the other device connection method is displayed.
  • FIG. 22 is a diagram illustrating a configuration of a plurality of sub-tiles belonging to a home dashboard tile according to an embodiment of the present invention.
  • the sub-tile includes a first icon for distinguishing which of the mobile sub-tile, input sub-tile and IoT sub-tile, and the type and/or shape of the external device.
  • the second icon, the name of the corresponding external device, and at least one of a connection state, a connection method, and an operation state of the corresponding external device may be displayed inside a tile in a preview form or a thumbnail form. Accordingly, the user can check the type, name, connection status, connection method, and operation status of the corresponding external device at once through the sub-tile.
  • 23 is a diagram showing the configuration of an input sub-tile according to an embodiment of the present invention.
  • FIG. 23(a) shows a state in which the content of the external device is being output to the digital device 1500 after the external device is connected to the HDMI terminal, and the type of the external device and The color of the second icon representing the shape may be displayed as the first color.
  • FIG. 23(b) shows a state in which only an external device is connected to the HDMI terminal, and the color of the second icon indicating the type and/or shape of the external device is provided to feedback the state to the user. It can be displayed in a second color different from one color.
  • FIG. 23(c) shows a state in which an external device has been connected to the HDMI terminal in the past, and the color of the second icon indicating the type and/or shape of the external device is provided to feedback the state to the user.
  • a third color different from the first and second colors may be displayed.
  • a first hot key for displaying an input sub-tile among keys of the remote control device 200 is provided, and when the first hot key is input, the controller 1530 may display only the input sub-tiles in the two-stage launcher. have.
  • 24 is a diagram showing the configuration of a mobile sub-tile according to an embodiment of the present invention.
  • FIG. 24A illustrates a state in which a mobile device is authenticated and connected to the digital device 1500.
  • a name of a sub-tile belonging to the connected mobile device an icon representing the shape of the mobile device, a name of the mobile device, and a connection method with the mobile device may be displayed in the corresponding mobile sub-tile.
  • FIG. 24(b) shows that the digital device 1500 is connected to the mobile device, but is not registered because there is no operation of the connection procedure according to user manipulation or user authentication is not performed.
  • the sub-tile name of the unregistered mobile device an icon indicating that the mobile device is not registered, and information indicating a guide for registration with the mobile device can be displayed, and the controller
  • guide information that guides a user to a registration procedure with the mobile device may be displayed.
  • 25 is a view showing the configuration of an IoT sub-tile according to an embodiment of the present invention.
  • FIG. 25(a) shows that the IoT device is connected and registered to the digital device 1500 by the first Internet of Things (eg, “LG thinQ”) or the second Internet of Things provided by the Open Connectivity Foundation (OCF). It indicates the status, in this case, in the corresponding IoT sub-tile, the icon representing the Internet of Things method (LG thinQ or OCF) used for connection with the IoT device, the icon representing the shape of the IoT device, and the name of the IoT device and , It is possible to display the detailed operation status of functions provided by the IoT device.
  • LG thinQ the Internet of Things method
  • OCF Open Connectivity Foundation
  • FIG. 25(b) shows a state in which the IoT device is connected and registered to the digital device 1500 by the first Internet of Things method or the second Internet of Things method.
  • the icon representing the Internet of Things method (LG thinQ or OCF) used for connection with the IoT device, the icon representing the shape of the IoT device, the name of the IoT device, and the on or off state of the IoT device may be displayed.
  • (c) of FIG. 25 shows a state in which IoT devices are registered in the first IoT method or the second IoT method in the digital device 1500, but there is no response from the IoT device.
  • the icon representing the Internet of Things method (LG thinQ or OCF) used for connection with the IoT device the icon representing the shape of the IoT device, the name of the IoT device, and the IoT device are currently unresponsive (No Response).
  • FIG. 25(d) shows a state in which the IoT sub-tile of FIG. 25(c) is selected and the IoT device is registered again when a response comes from the IoT device indicated by the IoT sub-tile.
  • 26 is a view showing another example of an input sub-tile according to an embodiment of the present invention.
  • the controller 1530 additionally inputs the second input sub-tile 3200 indicating the second external device even when another second external device is connected to the first external device indicated by the first input sub-tile. Can also be displayed on a two-stage launcher.
  • an input sub-tile representing the joystick may be displayed on the second stage launcher.
  • FIG. 27 is a diagram illustrating a process of executing a function related to a USB memory through an input sub-tile according to an embodiment of the present invention.
  • the controller 1530 includes an input sub-tile 3300 indicating a specific USB memory connected to the current digital device 1500 among the sub-tiles displayed on the second launcher. 200), and when the confirmation key (OK) of the remote control device 200 is input, as shown in (b) of FIG. 27, the connection screen of the USB memory is displayed.
  • an eject icon for ejecting the USB memory may be further displayed on the input sub-tile 3300.
  • the controller 1530 guides information to inform the user that only the preset number of external devices can connect to the USB port. Can be output visually or audibly.
  • a photo & video menu 3310, a music menu 3320, and a recording menu 3330 may be included in the connection screen of the USB memory, and the controller 1530, when the photo & video menu 3310 is selected by the remote control device 200, displays a list of pictures and video files stored in the USB memory on the display 1540, and is selected from the list The photo or video may be played and displayed on the display 1540.
  • the controller 1530 displays a list of music files stored in the USB memory on the display 1540, and the music selected from the list The file can be played and output to the speaker 1550.
  • the controller 1530 records content currently being played on the display 1540, and the file of the recorded content is stored in the USB memory. Can be stored in.
  • the controller 1530 may end the display of the connection screen of the USB memory.
  • FIG. 28 is a diagram illustrating a process of disconnecting a USB memory through an input sub-tile according to an embodiment of the present invention.
  • the controller 1530 is the USB memory on the input sub-tile 3300 indicating a specific USB memory connected to the current digital device 1500 among the sub tiles displayed on the second launcher.
  • the eject icon 3340 for ejecting is displayed.
  • the input sub-tile 3300 representing the USB memory in the two-stage launcher is controlled to disappear, and information 3350 guiding the fact that the USB memory can be safely removed is displayed on the display 1540. Can be displayed.
  • the USB memory is a digital device 1500 after the information 3350 is displayed.
  • the USB memory may be reconnected to the digital device 1500.
  • 29 is a diagram illustrating a process of guiding a connection of a mobile device through a mobile sub-tile according to an embodiment of the present invention.
  • 29(a) shows that the digital device 1500 is connected to the mobile device, but is not registered because there is no operation of the connection procedure according to user manipulation or user authentication is not performed.
  • the controller 1530 registers with the mobile device as shown in FIG. 29(b). It can display guide information to guide the user.
  • FIG. 30 is a diagram illustrating a process of executing a function related to a mobile device through a mobile sub-tile according to an embodiment of the present invention.
  • the controller 1530 displays the display of the launcher when the confirmation key (OK key) of the remote control device 200 is input while the mobile sub-tile 3420 is selected.
  • the connection screen of the mobile device currently connected to the digital device 1500 represented by the mobile sub-tile 3420 is displayed.
  • a screen sharing menu 3430, a photo & video menu 3440, and a music menu 3450 may be included in the connection screen of the mobile device, and the screen sharing menu 3430 may be remotely controlled by the controller 1530.
  • the mirror cast function may be executed to receive screen data of the mobile device and display it on the display 1540.
  • the controller 1530 displays a list of photos & videos stored in the mobile device on the display 1540, and in the list, The selected photo or video may be played and displayed on the display 1540 or the mobile device may display the selected photo or video on the list and then mirror-cast it to display the display 1540.
  • the controller 1530 displays a list of music files stored in the mobile device on the display 1540, and the music selected from the list The file may be played and output to the speaker 1550, or a music file may be played by the mobile device in the list and then received in real time and output to the speaker 1550.
  • 31 is a diagram illustrating a process of connecting to another external device through a user guide sub-tile according to an embodiment of the present invention.
  • the sub-tile located at the rightmost side (or the last sequence number) in the second-stage launcher is the user guide sub-tile 3510, and the controller 1530 is the remote control device 200.
  • the display of the launcher ends, and the sub-tile in the second stage launcher is connected to the current digital device 1500. It may display a list of other external devices not included in.
  • the controller 1530 when the at least one other external device is selected from the list, the controller 1530 generates at least one sub-tile representing the selected at least one other external device, and generates the second launcher when the second launcher is displayed. At least one sub-tile may be displayed.
  • FIG. 32 is a diagram showing an execution screen of a home dashboard app according to an embodiment of the present invention.
  • the controller 1530 is the launcher when the confirmation key (OK key) of the remote control device 200 is input while the home dashboard tile 3100 is focused, as described in FIG. 21 above. Ends the display of, and displays the execution screen 4000 of the home dashboard app assigned to the home dashboard tile 3100.
  • the execution screen 4000 of the home dashboard app includes a mobile area 4000A in which mobile sub items corresponding to mobile sub tiles are displayed, and an input area 4000B in which input sub items corresponding to input sub tiles are displayed. And an IoT area 4000C in which IoT sub items corresponding to the IoT sub tiles are displayed.
  • the user can check at a glance all external devices currently connected to the digital device 1500 through the execution screen 4000 of the home dashboard app, and the mobile area 4000A, the input area 4000B, and the IoT area ( It is possible to control the operation interlocking with the external devices, the operation control of the external devices, and the operation state of the external devices through each item in 4000C).
  • “icon 1” in the upper right of FIG. 21 is an icon for editing the name and icon of external devices corresponding to each item, and “icon 2” is an icon for changing the settings of the home dashboard app, “Icon 3” is an icon for refreshing external devices currently connected to the digital device 1500.
  • a current channel mode, a channel number, a channel name, and a program name may be displayed in a broadcast item representing a broadcast received in real time through an RF antenna terminal or HDMI in the input area 4000B.
  • the name of the connected external device may be displayed in the corresponding item, and the HDMI terminal, component in the input area 4000B If there are no external devices connected to the terminal and the USB terminal, the corresponding terminal name and the not connected phrase may be displayed in the corresponding item.
  • IoT devices connected through a first Internet of Things method eg, “LG thinQ”
  • OCF Open Connectivity Foundation
  • IoT devices connected through the second IoT method may be displayed separately from each other.
  • an item of an IoT device that is registered in the IoT input area 4000C but is not activated (connected) may be displayed in an inactive state. That is, the activation is a case where the operation state of the corresponding IoT device is known, and the deactivation is a case when the operation state of the corresponding IoT device is unknown.
  • a pop-up window may be displayed on the execution screen 4000.
  • FIG 33 is a diagram showing a network setting guide for IoT connection according to an embodiment of the present invention.
  • the controller 1530 sets a network setting menu in the IoT area 4000C, as shown in FIG. 33(b). You can display a shortcut to go directly to.
  • an input window for inputting a user's agreement to use the IoT service may be displayed.
  • FIG. 34 is a diagram illustrating user authentication when connecting with an OCF type IoT device according to an embodiment of the present invention.
  • the controller 1530 is connected to a specific IoT device through a second Internet of Things (OCF) method, and an item corresponding to the IoT device is displayed before being displayed in the IoT input area 4000C.
  • OCF Internet of Things
  • an inquiry window 4100 for inquiring user consent for displaying the items of the IoT device and when a user consent is input through the inquiry window 4100, corresponds to the IoT device in the IoT area 4000C. You can display an item by activating it.
  • 35 is a diagram illustrating a process of providing corresponding detailed information when selecting a TV item in an input area according to an embodiment of the present invention.
  • the controller 1530 when the item representing the TV in the input area 4000B is selected, the controller 1530 includes detailed information about a broadcast program currently being received or received before the home dashboard app is executed.
  • a pop-up window 4200 may be displayed on the execution screen 4000.
  • the detailed information includes a broadcast channel name and a broadcast program name.
  • the pop-up window 4200 may include a picture reproduction guide (PIG) of the broadcast program along with the detailed information.
  • PAG picture reproduction guide
  • FIG. 36 is a diagram illustrating a process of deleting an IPTV item-related app according to an embodiment of the present invention.
  • the controller 1530 when the item representing the IPTV in the input area 4000B is selected, the controller 1530 includes a pop-up window including a list of apps related to the IPTV (eg, Sling TV, Netflix, etc.). If (4300) is displayed, and a specific app (eg, Sling TV) is selected from the list and the delete button 4310 is selected, an inquiry window 4320 inquiring about deletion of the selected app may be displayed.
  • apps related to the IPTV eg, Sling TV, Netflix, etc.
  • the controller 1530 deletes the selected app.
  • FIG. 37 is a diagram illustrating a process of providing corresponding detailed information when selecting a USB memory item in an input area according to an embodiment of the present invention.
  • the controller 1530 generates and displays a pop-up window 4400 when an item representing a USB memory in the input area 4000B is selected, and displays the USB in the pop-up window 4400.
  • the name of the USB memory the storage capacity in use compared to the total storage capacity of the USB memory
  • partition information of the USB memory a photo & video menu 4410, a music menu 4420, recording
  • the menu 4430, the eject menu 4440, and the format menu 4450 may be displayed.
  • the controller 1530 displays a list of pictures and video files stored in the USB memory on the display 1540 and selects from the list The displayed photo or video may be played and displayed on the display 1540.
  • the controller 1530 displays a list of music files stored in the USB memory on the display 1540, and the music selected from the list The file can be played and output to the speaker 1550.
  • the controller 1530 records content currently being played on the display 1540, and the file of the recorded content is stored in the USB memory. Can be stored in.
  • the controller 1530 releases the connection of the USB memory and an item corresponding to the USB memory in the input area 4000B. Control it to disappear.
  • the controller 1530 controls the USB memory to be invisible in the device list in all apps of the WebOS, but when the eject fails, the USB memory is added to the device list again. It can be controlled to be visible.
  • controller 1530 may immediately execute the eject operation when there is no function using the USB memory, but may generate and display a pop-up in which the eject operation proceeds when it takes a long time to perform the eject operation. have.
  • controller 1530 may generate and display a pop-up indicating this when the eject operation is successful.
  • the controller 1530 performs formatting on the USB memory and displays the storage capacity of the USB memory usable after the formatting. .
  • the controller 1530 may control the USB memory to be invisible in the device list in all apps of the web OS.
  • controller 1530 may display the deactivated process so that the eject menu 4440 and the format menu 4450 are not selected during the format operation.
  • the eject menu 4440 or the format menu 4450 is selected while the controller 1530 upgrades a specific software using the USB memory, the eject menu 4440 or format is re-installed after the software upgrade is completed.
  • a pop-up for instructing to eject or format the USB memory may be generated and displayed through the menu 4450.
  • the eject menu 4440 or the format menu 4450 is selected while the controller 1530 downloads or installs a specific app using the USB memory, the eject menu is re-installed after the download or installation of the specific app is completed.
  • a pop-up that guides to eject or format the USB memory may be generated and displayed through the 4440 or the format menu 4450.
  • the eject menu 4440 or the format menu 4450 is selected while the controller 1530 deletes a specific app in the USB memory, after the deletion of the specific app is completed, the eject menu 4440 or the format menu again. Through 4450, a pop-up to guide ejecting or formatting the USB memory may be generated and displayed.
  • the controller 1530 ejects again after the recording of the content is stopped or completed.
  • a pop-up that guides to eject or format the USB memory may be generated and displayed through the menu 4440 or the format menu 4450.
  • FIG. 38 is a diagram illustrating a process of classifying and displaying first and second IoT items in an IoT area according to an embodiment of the present invention.
  • the controller 1530 includes a first item 4510 indicating a first Internet of Things method in the IoT area 4000C when there are no IoT devices currently connected to the digital device 1500 and A second item 4520 indicating the second Internet of Things method is displayed.
  • the controller 1530 is logged in to an app that provides a first Internet of Things method and is connected to the first item 4510 when connected to an IoT device only through the first Internet of Things method.
  • Information about the IoT device is displayed, and the second item 4520 displays connection guide information of the second Internet of Things method.
  • the second item 4520 displays information about the connected IoT device
  • the first item ( 4510) displays information for inducing login of an app that provides the first Internet of Things method.
  • 39 to 41 are diagrams illustrating IoT items of a first Internet of Things method displayed in an IoT area according to an embodiment of the present invention.
  • the digital device 1500 according to the present invention and all IoT devices connected through the first Internet of Things method are all products of the same manufacturer, and they are connected to each other through an IoT app (LG Smart ThinQ) provided by the manufacturer. do.
  • the controller 1530 displays a first item 4611 indicating the refrigerator in the IoT area 4000C when the refrigerator is connected to the first Internet of Things method, and When 1 item 4611 is selected, a first pop-up window 4612 is generated and displayed, and as the details in the first pop-up window 4612, the current temperature of the freezer and the current temperature of the freezer are displayed. , A temperature control button of the refrigerator compartment, a temperature control button of the freezer, and a power saving setting button may be displayed.
  • the controller 1530 displays a second item 4621 indicating the washing machine in the IoT area 4000C when the washing machine and the first Internet of Things are connected.
  • a second pop-up window 4462 is generated and displayed, and as detailed information in the second pop-up window 4462, until washing of the washing machine is completed.
  • the remaining time and the current washing course may be displayed, and a button for remote control of the washing machine may be displayed.
  • a third item 4651 indicating the dryer is displayed in the IoT area 4000C. And, when the third item 4651 is selected, a third pop-up window 4632 is generated and displayed, and as the detailed information in the third pop-up window 4462, the remaining amount of drying of the dryer is completed.
  • the time and current drying course can be displayed, and a button for remote control of the dryer can be displayed.
  • the controller 1530 displays a fourth item 4641 representing the air conditioner in the IoT area 4000C when the air conditioner is connected to the first Internet of Things method.
  • a fourth pop-up window 4642 is generated and displayed, and as detailed information in the fourth pop-up window 4642, the operation mode of the air conditioner, wind strength, It is possible to display the air cleaning setting button, power saving setting button, fine dust information, ultra fine dust information, ultra fine dust information, and current temperature.
  • the controller 1530 when connected to the air cleaner and the first Internet of Things method, a fifth item (4651) indicating the air cleaner in the IoT area (4000C)
  • a fifth pop-up window 4652 is generated and displayed, and as detailed information in the fifth pop-up window 4652, an operation mode of the air purifier, Clean intensity, wind intensity, operation mode, fine dust information, ultra fine dust information, and ultra fine dust information can be displayed.
  • a sixth item 4641 indicating the dishwasher in the IoT area 4000C.
  • a sixth pop-up window 4662 is generated and displayed, and as a detailed information in the sixth pop-up window 4462, the current washing mode, the current state ( Washing, rinsing or drying), and the remaining time until washing is completed can be displayed.
  • a seventh item 4671 representing the clothing styler in the IoT area 4000C
  • a seventh pop-up window 4672 is generated and displayed, and as the detailed information in the seventh pop-up window 4672, the time remaining until styling is completed ,
  • a button for remotely controlling the current styling course and the clothing styler may be displayed.
  • FIG 42 and 43 are views illustrating IoT items of a second Internet of Things method displayed in an IoT area according to an embodiment of the present invention.
  • the controller 1530 displays the first item 4711 indicating the refrigerator in the IoT area 4000C when the refrigerator and the second Internet of Things (OCF) are connected.
  • a first pop-up window 4712 is generated and displayed, and as details in the first pop-up window 4712, the current temperature of the refrigerator in the refrigerator and the current temperature of the freezer And display information indicating that the refrigerator is connected by the second Internet of Things method.
  • the controller 1530 displays a second item 4472 representing the washing machine in the IoT area 4000C when the washing machine and the second Internet of Things are connected.
  • a second pop-up window 4472 is generated and displayed, and as the detailed information in the second pop-up window 4472, the remaining time until washing is completed, currently The laundry course and the washing machine may display information indicating that the second Internet of Things is connected.
  • the third item 4731 indicating the dryer is displayed in the IoT area 4000C.
  • a third pop-up window 4732 is generated and displayed, and as the detailed information in the third pop-up window 4732, the remaining time until completion of drying is currently
  • the drying course and the dryer may display information indicating that the second Internet of Things method is connected.
  • the controller 1530 displays a fourth item 4474 indicating the air conditioner in the IoT area 4000C when the air conditioner is connected to the second Internet of Things method.
  • a fourth pop-up window 4472 is generated and displayed, and as detailed information in the fourth pop-up window 4474, the current temperature of the air conditioner and the air conditioner
  • the temperature control button and the air conditioner may display information indicating that the second Internet of Things is connected.
  • the controller 1530 displays a fifth item 4771 representing the lighting in the IoT area 4000C when the lighting and the second Internet of Things are connected.
  • a fifth pop-up window 4572 is generated and displayed, and as detailed information in the fifth pop-up window 4572, the lighting on/off state and the Information indicating that the lighting is connected by the second Internet of Things method may be displayed.
  • a sixth item 4801 indicating the smart door lock in the IoT area 4000C. Is displayed, and when the sixth item 4701 is selected, a sixth pop-up window 4472 is generated and displayed, and as a detailed information in the sixth pop-up window 4472, the smart door lock is locked/opened. Status and information indicating that the smart door lock is connected by the second Internet of Things may be displayed.
  • a seventh item 4771 indicating the smart plug in the IoT area 4000C When the seventh item 471 is selected, a seventh pop-up window 4772 is generated and displayed, and as a detailed information in the seventh pop-up window 4772, the smart plug is turned on/off. Status and information indicating that the smart plug is connected to the second Internet of Things may be displayed.
  • the eighth item 4801 indicating the smart switch in the IoT area 4000C.
  • an eighth pop-up window 4802 is generated and displayed, and as detailed information in the eighth pop-up window 4802, the smart switch is turned on/off. Status and information indicating that the smart switch is connected to the second Internet of Things may be displayed.
  • the controller 1530 displays a ninth item 4791 indicating the thermometer in the IoT area 4000C when the thermometer and the second Internet of Things are connected.
  • a ninth pop-up window 4792 is generated and displayed, and as detailed information in the ninth pop-up window 4792, a temperature measured by the thermometer and a desired temperature And information indicating that the thermometer is connected by the second Internet of Things method.
  • 44 is a diagram illustrating a process of editing each item in an execution screen of a home dashboard app according to an embodiment of the present invention.
  • the cancel button 4810 is a button for canceling all the changes in the edit mode and exiting the edit mode
  • the save button 4820 is the change in the edit mode This button is for saving.
  • the controller 1530 deactivates the save button 4820 so that it cannot be selected when there is no change in the edit mode, and when one or more changes occur in the edit mode, the save button 4820 is selected. Can be activated.
  • a desired name can be input up to 30 characters for a desired external device through the input window, blank spaces are ignored in front of the first character, and multiple spaces between characters are displayed in one space.
  • controller 1530 may provide a toggle button 4830 that toggles hiding/display within each item when the edit mode is activated, and the user operates the toggle button 4830 for items that are not desired to be viewed. It can be hidden within the dashboard app's launch screen.
  • 45 is a diagram illustrating a process of setting an IoT area according to an embodiment of the present invention.
  • the IoT area setting window 4940 includes an account area for performing login/logout of an app (LG Smart ThinQ) that provides a first Internet of Things method, and a second Internet of Things (OCF). It includes a first toggle button for turning on/off whether to interoperate with an IoT device supporting the second button, and a second toggle button for turning on/off whether to receive an operation state of IoT devices from IoT devices.
  • LG Smart ThinQ login/logout of an app
  • OCF Internet of Things
  • FIGS. 46 to 59 a process of improving user convenience by providing an appropriate text message in a situation where the user may be interested based on a usage pattern of the user's display device will be described in detail.
  • those skilled in the art may refer to FIGS. 1 to 15 previously described, and supplemental analysis or modification of the embodiments of FIGS. 46 to 59 below.
  • the controller 1530 acquires a usage pattern of the user's display device 1500 from a user for a predetermined period of time, and when the obtained usage pattern of the user's display device 1500 satisfies a specific condition at a specific time point, the controller A text message 4710 including at least one of specific content included in content, a description related to the specific content, and a description of a specific function of the display device 1500 is displayed.
  • the specific time point means when the user operates the device or when there is a change in viewing content.
  • the specific point in time may be a point in time that does not interfere with the user's viewing. Detailed description of a specific point in time will be described later with reference to FIGS. 47 to 59.
  • the specific condition refers to a condition for displaying a text message 4710 on a display after a specific time point occurs.
  • the specific conditions may vary depending on the specific time point.
  • the text message 4710 is a message displayed on the display when the specific time point and specific condition are satisfied.
  • the text message 4710 is at least one of other content related to content, specific content included in the content, description related to the specific content, description of an application related to the content, and description of a specific function of the display device 1500 It may include.
  • the detailed description of the text message 4710 will be described later with reference to FIGS. 47 to 59.
  • the display 1540 displays content included in the received broadcast signal and the text message 100 on a screen.
  • the content is received from an external server or stored in the internal memory.
  • the memory 1570 stores data for the operation of the display device 1500, and the data may include a user's device usage pattern. Details of the user's device usage pattern and a method of obtaining it will be described later in FIG. 47.
  • 46 is a flowchart illustrating a method of controlling a display device 1500 according to an embodiment of the present invention. The present invention is performed by the controller 1530.
  • a broadcast signal is received from a broadcasting station through a tuner (S4610).
  • the content included in the received broadcast signal is displayed on the screen (S4620).
  • the content is received from the external server or stored in the internal memory.
  • the usage pattern of the user's display device 1500 is acquired from the user for a predetermined period of time (S4630).
  • a text message 4710 including at least one of the content including the specific content and a description of the specific function is displayed. It is displayed (S4650).
  • the displaying of the text message 4710 may further include determining whether a specific time point (not shown) and determining a specific condition (not shown).
  • the step of determining the specific time point and the step of determining the specific condition may be performed simultaneously, or any one may be performed first. A detailed process for determining whether to determine a specific time point and determining a specific condition will be described later.
  • the control method of the display device 1500 may further include a step (not shown) of confirming whether to activate a text message display function before acquiring a usage pattern of the user's display device 1500.
  • the control method of the display device 1500 may further include receiving a user input (not shown) through the communication unit after displaying the text message 4710.
  • 47 is a diagram illustrating a text message 100 displayed on a display device 1500 according to an embodiment of the present invention.
  • FIG. 47A is a diagram illustrating a text message 4710 displayed on a screen of the display device 1500.
  • 47B is a diagram showing the basic form and the extended form of the text message 4710.
  • FIG. 47C is a diagram illustrating a case in which the internal screen of the text message 4710 is scrolled.
  • the controller 1530 may include specific content included in the content, description related to the specific content, and A text message 4710 including at least one of descriptions of specific functions of the display device 1500 is displayed on the screen.
  • the text message 4710 can be divided into a basic form and an extended form.
  • the text message 4710 includes at least one of text content, an AI icon 4720 and an execution button 4730.
  • the controller 1530 displays the execution button 4730 differently from the text screen. If the selection input cannot be received from the user, the controller 1530 does not display the execution button 4730.
  • the text message 4710 includes at least one of text content, AI icon 4720, thumbnail 4740, and app execution button 4750. Includes one.
  • the app launch button 4750 may be replaced with a channel launch button 4730.
  • the text message 4710 may include up to six tiles.
  • the text message 4710 may include four thumbnails 4740 and two app launch buttons 4750.
  • the controller 1530 may further display the progressive bar 4471 at the bottom of the thumbnail 4740.
  • the progressive bar 4471 refers to the current playing time compared to the total playing time of the content. If there is no thumbnail 4740, the controller 1530 does not display the progressive bar 4471.
  • the controller 1530 displays a default text message 4710.
  • the controller 1530 recommends at least one of a channel program, a channel, a VOD service, a live OTT, and an app when a usage pattern of the user's display device 1500 satisfies a predetermined condition at this specific time based on a specific time. Can.
  • the controller 1530 displays a thumbnail 4740 and a program title.
  • the controller 1530 displays at least one of a channel logo and a channel name.
  • the controller 1530 displays a thumbnail 4740, an app execution button 4750, and a title.
  • the controller 1530 displays an app execution button 4750.
  • the controller 1530 may further display the title of the app.
  • the controller 1530 displays the app launch button 4750, where the cursor 4700a is over the app launch button 4750, the controller 1530 can further display the app's title. have.
  • the controller 1530 displays the tile 4740 including the thumbnail 4740 differently from the text screen.
  • the text message 4710 cannot receive a selection input from a user.
  • the controller 1530 scrolls the internal screen even if the text message 4710 is not selected. At this time, the controller 1530 scrolls the internal screen in units of lines like a prompt scroll.
  • the controller 1530 can scroll the thumbnail 4740, the app execution button 4750, and the vertical scroll function and the horizontal scroll function. You can do it all.
  • the controller 1530 receives an input for selecting a specific app execution button 4750 from the user, the controller 1530 executes a function corresponding to the specific application.
  • FIG. 48 is a diagram showing a text message 4710 displayed on a display device when a user turns on a power according to an embodiment of the present invention.
  • 48A is a diagram illustrating that the display device 1500 displays a text message 4710 when the power is turned on immediately after purchase of the display device 1500.
  • 48B is a diagram illustrating that the display device 1500 displays a text message 4710 when the user does not agree to the terms and conditions.
  • FIG. 48(c) is a diagram illustrating a text message 4710 displayed on the display device 1500 during data collection after agreement of the user's terms and conditions.
  • the specific point in time may be when the user turns on the display device 1500.
  • the specific condition may be when the power is first turned on immediately after the purchase of the display device 1500.
  • the controller 1530 may display a text message 4710 on the lower side of the display.
  • the text message content may be a message welcoming the user to use the TV.
  • the controller 1530 may display the text message 4710 only once when the TV power is turned on for the first time immediately after the purchase of the display device 1500.
  • the controller 1530 may no longer display the text message 4710 or permanently display it.
  • the controller 1530 may display the text message 100 again after factory reset of the display device 1500.
  • the controller 1530 may control the user from selecting the text message 4710.
  • the controller 1530 displays the user terms and conditions agreement page 4810 do.
  • the controller 1530 may further display a text message 4710, an execution button 4730, and an AI icon 4720.
  • the content of the text message 4710 may be a message suggesting the user's agreement to the terms and conditions.
  • the controller 1530 may display the text message 4710 once every two weeks.
  • the controller 1530 may no longer display the text message 4710. have.
  • time out means that a certain time has elapsed after the text message 4710 is displayed.
  • the controller 1530 may display the text message 4710 again after a certain period of time. For example, the controller 1530 may not display the text message 4710 for a period of time, and may display the text message 4710 again a month after the user last closes the text message 4710. .
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 may not permanently display the text message 4710.
  • the Magic Link UI screen 4820 may be displayed during data collection. Specifically, after agreement of the terms and conditions is completed, it may be a case in which data collection for a usage pattern of the user's display device 1500 is required.
  • the magic link means a function of displaying a video and a variety of information related to the currently viewed program on a part of the display.
  • the controller 1530 may display a text message 4710 suggesting to use a function to check a video and information associated with a currently viewed program on one side of the display. have.
  • the controller 1530 may further display a text message 4710, an execution button (not shown), and an AI icon 4720.
  • the controller 1530 may execute a magic link UI screen 4820 that includes a function for checking a video and information associated with a currently viewed program.
  • the controller 1530 may display the text message 4710 once a week.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case where the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 sends the text message 4710 You can display it again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 may not permanently display the text message 4710.
  • 49 is a diagram illustrating content recommendation when a user turns on a TV after collecting usage pattern data of the user display device 1500 according to another embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on the lower side of the display.
  • the text message 4710 may be a message recommending a program, channel, or application frequently viewed by a user.
  • the controller 1530 may additionally display any one or more of an AI icon 4720, an execution button (not shown), a thumbnail 4740, and an app execution button 4750.
  • the thumbnail 4740 is a program or channel currently received by the display device 1500, a program or channel received from a set-top box, or a thumbnail 4740 related to a program or channel preferred by a user among programs provided by a content provider.
  • the app launch button 4750 may be an app launch button related to an application frequently used by a user.
  • the controller 1530 may display a text message recommending content suitable for the user currently watching based on the viewing time zone and the type of viewing program. For example, if a mother watches a drama on a weekday morning, a family watches a news on a weekday afternoon, and a daughter watches a entertainment program on a weekend afternoon, the controller 1530 recommends content related to the drama on a weekday morning In addition, a text message recommending content related to the news on a weekday afternoon and content related to an entertainment program may be displayed on a weekend afternoon. Referring to FIG. 49, when the user selects the text message area 4710 as the pointer 4700a, the controller 1530 does not display anything. That is, it means that the text message area 4710 cannot be selected.
  • the controller 1530 when the user selects the thumbnail 4740, the controller 1530 is a channel on which the program related to the thumbnail 4740 or a program related to the thumbnail 4740 is being broadcasted. ) Is displayed. For example, when an input for selecting a Live/STB program/channel is received from a user, the controller 1530 displays a program and channel screen 4910 corresponding to the input.
  • the controller 1530 selects a thumbnail 4740, and when an application of a content provider related to the thumbnail 4740 is not installed, the controller 1530 displays an application screen 4920 of another content provider that can purchase the content. Display.
  • the controller 1530 selects a thumbnail 4740 by the user, and when an application of the content provider related to the thumbnail is installed, displays the corresponding program screen 4930 in the application of the content provider.
  • the controller 1530 may display an application launch screen 4950 associated with the app launch button 4750.
  • the controller 1530 displays a screen 4940 for installing an application related to the app execution button 4750 when a user selects the app execution button 4750, but an application related to the app execution button 4750 is not installed. ) Can be displayed.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case in which the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 may display the text message 4710 again after a month.
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 can halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • 50 is a diagram for recommending content when a user repeatedly switches TV channels according to an embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on the lower side of the display.
  • the controller 1530 may display a text message 4710 when a user switches a TV channel to enter a specific channel.
  • the text message 4710 includes a message recommending a program and a channel frequently viewed by a user.
  • the controller 1530 may additionally display the AI icon 4720 and thumbnail 4740 together with the text message 4710.
  • the contents of the thumbnail 4740 and the operation of the control unit 1530 according to the user's selection of the thumbnail 4740 have been described above, so a detailed description thereof will be omitted.
  • the controller 1530 may display a text message recommending content suitable for the user currently watching based on the viewing time zone and the type of viewing program. For example, if a mother watches a drama on a weekday morning, a family watches a news on a weekday afternoon, and a daughter watches a entertainment program on a weekend afternoon, the controller 1530 recommends content related to the drama on a weekday morning In addition, a text message recommending content related to the news on a weekday afternoon and content related to an entertainment program may be displayed on a weekend afternoon.
  • the controller 1530 does not display anything. That is, it means that the area where the text message 4710 is displayed cannot be selected.
  • the controller 1530 displays a program and channel screen 5010 corresponding to the input.
  • Live refers to a broadcast received in real time from the tuner 1510.
  • STB stands for set-top box.
  • the controller 1530 selects a thumbnail 4740 by the user, and when an application of the content provider associated with the thumbnail 4740 is installed, displays the corresponding program screen 5020 in the application of the content provider. .
  • the controller 1530 may display a text message 4710. For example, when the user moves 10 different channels within 30 minutes, the controller 1530 may display a text message 4710.
  • the controller 1530 may no longer display the text message 4710.
  • the controller 1530 may display the text message 4710 again after a month.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 can halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • 51 is a diagram showing a shortcut key registration function for a channel frequently used by a user according to an embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on the lower side of the display.
  • the text message 4710 may be a message suggesting that a channel frequently viewed by a user is registered as a shortcut key (not shown) of the remote controller.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710. When the user selects an execution button (not shown), the controller 1530 registers a channel frequently viewed by the user as a shortcut key.
  • the controller 1530 may display a text message 5110 indicating completion of the shortcut key registration.
  • the controller 1530 may display the text message 5110 in a toast-popup style on the upper right of the display.
  • the toast pop-up style refers to a style in which a text message 5110 suddenly appears on the screen and disappears from the screen when a predetermined time warns.
  • the content of the text message 5110 may be “channel 6 is registered to shortcut 1”.
  • the controller 1530 may display a text message 4710.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case in which the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 can halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • FIG. 52 is a diagram illustrating a recommendation of a Live OTT service at the end of a program according to an embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on one lower side of the display.
  • the text message 4710 may be a message recommending Live OTT suitable for a user's viewing pattern.
  • Live OTT Live over the top
  • Live OTT means a TV service that can be viewed through the Internet.
  • the controller 1530 may additionally display the AI icon 4720 and thumbnail 4740 together with the text message 4710.
  • the thumbnail 4740 may be a thumbnail 4740 related to the content of Live OTT that matches the user's viewing pattern.
  • the controller 1530 may display a text message recommending content suitable for the user currently watching based on the viewing time zone and the type of viewing program. For example, when a mother watches a drama on weekday mornings, a family watches news on weekdays afternoons, and a daughter watches entertainment programs on weekend afternoons, control unit 1530 recommends drama-related content on weekdays mornings In addition, a text message recommending content related to the news on a weekday afternoon and content related to an entertainment program may be displayed on a weekend afternoon.
  • the controller 1530 displays another application screen 5210 that can purchase the content of the corresponding OTT. ) Is displayed.
  • the controller 1530 displays the execution screen 5220 of the corresponding OTT application.
  • the controller 1530 may display a text message 4710 from a point in time when information about a live OTT mapped to content currently being viewed by a user is detected until a content currently being viewed is finished. In this case, if the text message 4710 related to the application of the same Live OTT is displayed more than once, the controller 1530 may no longer display the text message 4710 related to the application.
  • the controller 1530 When the text message 4710 related to the application of the same Live OTT is displayed 10 or more times, or when the application of Live OTT to be recommended is installed, the controller 1530 no longer displays the text message 4710 related to the application. It may not. Here, the controller 1530 may set a period for initializing the number of times the text message 4710 is displayed.
  • the controller 1530 may not permanently display the text message 4710 related to the recommended live OTT application.
  • 53 is a diagram for recommending content frequently viewed by a user at the end of a program according to an embodiment of the present invention.
  • the controller 1530 may display the text message 4710 on one side of the display.
  • the text message 4710 may be a message recommending content frequently viewed by a user.
  • the content frequently viewed by the user may be a program/channel of Live/STB or a program provided by a content provider.
  • the controller 1530 may additionally display the AI icon 4720 and thumbnail 4740 together with the text message 4710.
  • the thumbnail 4740 may be a thumbnail related to content frequently viewed by the user.
  • the controller 1530 may display a text message recommending content suitable for the user currently watching based on the viewing time zone and the type of viewing program. For example, if a mother watches a drama on a weekday morning, a family watches a news on a weekday afternoon, and a daughter watches a entertainment program on a weekend afternoon, the controller 1530 recommends content related to the drama on a weekday morning In addition, a text message recommending content related to the news on a weekday afternoon and content related to an entertainment program may be displayed on a weekend afternoon.
  • the controller 1530 displays a channel screen 5310 of Live/STB on which the corresponding content is being broadcast. .
  • the controller 1530 displays the selected program screen 5320 in the CP application.
  • the controller 1530 may display a text message 4710.
  • the electronic program guide (EPG) refers to a service that displays a schedule of TV broadcast programs on a television screen.
  • the controller 1530 may display the text message 4710 10 minutes before the end of the program the user is watching.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case in which the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 displays the text message 4710 ) Can be displayed again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller may halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • the controller 1530 When a text message 4710 recommending Live OTT and a text message 4710 recommending content frequently viewed by a user can be simultaneously displayed, the controller 1530 first displays the text message 100 recommending Live OTT. Then, before the next program termination, a text message 4710 recommending content frequently viewed by the user may be displayed.
  • 54 is a diagram for suggesting a shortcut key registration of a corresponding application to a user when entering a frequently used application according to another embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on the lower side of the display.
  • the application may be an application frequently used by a user.
  • the text message 4710 may be a message that suggests a shortcut key registration of an application frequently used by a user.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710. When the user selects an execution button (not shown), the controller 1530 registers an application frequently used by the user in a shortcut key.
  • the controller 1530 may display a text message 5410 indicating completion of the shortcut key registration.
  • the controller 1530 may display the text message 5410 in a toast pop-up format on the upper right of the display.
  • the content of the text message 5410 may be “The'Google map' has been registered to the '7' shortcut.”
  • the controller 1530 may display a text message 4710.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case in which the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 can halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • FIG. 55 is a view showing that when a channel management application is entered, a user's preferred channel is registered, according to another embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on one lower side of the display.
  • the channel management application may be an application for editing a list of channels preferred by a user.
  • the text message 4710 may be a message suggesting that a channel frequently viewed by a user is registered in a channel list preferred by the user.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710.
  • the controller 1530 registers channels frequently viewed by the user as a favorite channel.
  • the controller 1530 may generate a list of channels frequently viewed by the user as a group (not shown).
  • the controller 1530 may add channels frequently viewed by the user to the group.
  • the controller 1530 may display a text message 4710.
  • the channel manager refers to a function of editing a list of channels preferred by a user.
  • the controller 1530 may no longer display the text message 4710.
  • the user closes the text message 4710 it includes a case in which the user closes the text message 4710 by pressing a back button or an exit button on the remote control.
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 can halve the number of times the text message 4710 has been closed so far.
  • the number of times the text message 4710 is closed includes both the number of times the user closes the text message 4710 by operating the remote control and the number of times the text message 4710 is closed by a timeout.
  • 56 is a diagram illustrating recommending a voice recognition function when an application is executed according to an embodiment of the present invention.
  • the controller 1530 may display a text message 4710 on the lower side of the display. Also, the controller 1530 may additionally display the AI icon 4720 along with the text message 4710.
  • the application may be an application having a voice recognition function.
  • it could be an Amazon application.
  • the text message 4710 may be a message proposing to use the voice recognition function of the corresponding application.
  • the controller 1530 may display the Amazon application execution screen 5620.
  • the controller 1530 may display the text message 4710 until the number of times the user enters the application becomes five times from the first time the user enters the application.
  • the controller 1530 may no longer display the text message 4710.
  • the controller 1530 may display the text message 4710 again.
  • the controller 1530 may not permanently display the text message 4710.
  • the controller 1530 first displays a message recommending the voice recognition function of the application and When the next application is entered, a text message 4710 suggesting that the application be registered as a shortcut key may be displayed.
  • 57 is a diagram for recommending a sound quality setting change when a user changes a quality setting according to an embodiment of the present invention.
  • the controller 1530 may recommend the user to change the appropriate sound quality setting.
  • the quality setting or sound quality setting may be a setting that analyzes a genre of a program using AI and recommends a sound quality setting value suitable for the corresponding program genre.
  • the user changes the quality setting of the display device 1500
  • it may be a case where the user changes the quality setting using AI to off to on.
  • the sound quality setting using AI is set to an off value.
  • the controller 1530 may display a text message 4710 on one side of the lower display.
  • the controller 1530 may display the text message 4710 immediately after the image quality setting window disappears.
  • the text message 4710 may be a message proposing to change the sound quality setting related to the user.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710.
  • the controller 1530 displays a screen (not shown) for changing the sound quality setting value.
  • the controller 1530 may analyze the genre of the program using AI, and then recommend the sound quality setting value suitable for the corresponding program genre.
  • the controller 1530 displays a toast-pop message 5720 informing the user of the sound quality setting completion on the upper right of the display.
  • the contents of the toast-pop message 5720 may be “AI sound quality setting is turned on” (5730) or “AI sound quality setting is turned off.”
  • the controller 1530 displays the text message ( 100) may no longer be displayed.
  • the controller 1530 may not permanently display the text message 4710.
  • control unit 1530 may not permanently display the text message 4710.
  • 58 is a diagram for recommending a quality setting change when a user changes a sound quality setting according to an embodiment of the present invention.
  • the controller 1530 may recommend the user to change the appropriate image quality setting.
  • the quality setting or sound quality setting may be a setting that analyzes a genre of a program using AI and recommends a sound quality setting value suitable for the corresponding program genre.
  • the user changes the sound quality setting of the display device 1500 it may be a case where the user changes the sound quality setting using AI from off to on.
  • the image quality setting is not changed, it may be a case that the image quality setting using AI is set to an off value.
  • the controller 1530 may display a text message 4710 on one side of the lower display.
  • the controller 1530 may display the text message 100 immediately after the sound quality setting window 5810 disappears.
  • the text message 4710 may be a message proposing to change the image quality setting related to the user.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710.
  • the controller 1530 displays a screen (not shown) for changing the quality setting value.
  • the controller 1530 may analyze the genre of the program using AI, and then recommend the image quality setting value suitable for the corresponding program genre.
  • the controller 1530 may display a message 5820 notifying the user of the image quality setting completion in a toast pop-up format on the upper right of the display.
  • the content of the toast pop-up message 5820 may be “AI quality setting is turned on” (5830) or “AI quality setting is turned off.”
  • controller 1530 no longer displays the text message 4710, displays it again, and permanently does not display the text message 4710 is omitted in detail.
  • 59 is a view showing proposal of turning off a text message display function according to an embodiment of the present invention.
  • the controller 1530 may display the text message 4710 on one side of the bottom of the display.
  • the controller 1530 may display the text message 100 immediately after the content recommendation message is closed.
  • the content of the text message 4710 may be a message that suggests turning off the text message display function.
  • the controller 1530 may additionally display an AI icon 4720 and an execution button (not shown) along with the text message 4710.
  • the controller 1530 when the user selects an execution button (not shown), the controller 1530 turns off the function of displaying a text message 4710.
  • the controller 1530 displays a toast pop-up message 5910 indicating this on the top of the display.
  • the content of the toast pop-up message 5910 may be “The AI recommendation function has been deactivated.”.
  • the controller 1530 may display the text message 4710. For example, if the ratio of the number of times the text message 100 is displayed to the number of times the user selects the execution button or thumbnail 4740 of the text message 100 is less than a certain percentage, the controller 1530 sends the text message 4710 Can be displayed.
  • the controller 1530 may no longer display the text message 4710.
  • the controller 1530 can display the text message 4710 again. have.
  • the controller 1530 may not permanently display the text message 4710.
  • the display device control method of the present invention can be implemented as a code that can be read by the processor on a recording medium that can be read by the processor provided in the image display device.
  • the processor-readable recording medium includes all types of recording devices in which data that can be read by the processor are stored. Examples of the recording medium readable by the processor include a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also implemented in the form of a carrier wave such as transmission through the Internet. .
  • the processor-readable recording medium may be distributed over a networked computer system so that the processor-readable code is stored and executed in a distributed manner.
  • the present invention is used in a series of display device fields.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Selon un mode de réalisation, la présente invention concerne un dispositif d'affichage qui comprend : un affichage ; une unité de communication pour communiquer avec deux dispositifs externes ou plus connectés au dispositif d'affichage de manière filaire ou sans fil ; et un dispositif de commande pour effectuer une commande de façon à ce qu'une interface utilisateur graphique (GUI) pour gérer intégralement les dispositifs externes soit affichée sur l'affichage, le dispositif de commande configurant la GUI de façon à ce que les dispositifs externes soient classés en deux groupes ou plus sur la base du type de dispositif de façon à être gérés intégralement dans la GUI. Selon la présente invention, une application pour une gestion intégrée d'une pluralité de dispositifs externes connectés à un dispositif numérique est fournie à un utilisateur, et la pluralité de dispositifs externes connectés au dispositif numérique peuvent être gérées intégralement à travers l'application.
PCT/KR2019/016272 2018-12-24 2019-11-25 Dispositif d'affichage et procédé de commande associé WO2020138730A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2018-0168483 2018-12-24
KR20180168483 2018-12-24
KR20190000615 2019-01-03
KR10-2019-0000615 2019-01-03

Publications (1)

Publication Number Publication Date
WO2020138730A1 true WO2020138730A1 (fr) 2020-07-02

Family

ID=71128263

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/016272 WO2020138730A1 (fr) 2018-12-24 2019-11-25 Dispositif d'affichage et procédé de commande associé

Country Status (1)

Country Link
WO (1) WO2020138730A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040257337A1 (en) * 2003-04-04 2004-12-23 Canon Kabushiki Kaisha Display control device and method, and display system
KR20080066379A (ko) * 2007-01-12 2008-07-16 삼성전자주식회사 디스플레이장치와 그 외부기기 제어방법
KR20140074058A (ko) * 2012-12-07 2014-06-17 엘지전자 주식회사 서로 다른 데이터 타입 및 디바이스 타입의 적어도 2개 이상의 아이템을 컨트롤 하는 멀티미디어 디바이스 및 그 제어 방법
KR101472912B1 (ko) * 2007-09-03 2014-12-15 삼성전자주식회사 통합 리모트 컨트롤러 장치, 통합 리모콘 제어 시스템, 및그 제어 방법
KR20150100458A (ko) * 2014-02-24 2015-09-02 삼성전자주식회사 전자 장치 사이의 동기화

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040257337A1 (en) * 2003-04-04 2004-12-23 Canon Kabushiki Kaisha Display control device and method, and display system
KR20080066379A (ko) * 2007-01-12 2008-07-16 삼성전자주식회사 디스플레이장치와 그 외부기기 제어방법
KR101472912B1 (ko) * 2007-09-03 2014-12-15 삼성전자주식회사 통합 리모트 컨트롤러 장치, 통합 리모콘 제어 시스템, 및그 제어 방법
KR20140074058A (ko) * 2012-12-07 2014-06-17 엘지전자 주식회사 서로 다른 데이터 타입 및 디바이스 타입의 적어도 2개 이상의 아이템을 컨트롤 하는 멀티미디어 디바이스 및 그 제어 방법
KR20150100458A (ko) * 2014-02-24 2015-09-02 삼성전자주식회사 전자 장치 사이의 동기화

Similar Documents

Publication Publication Date Title
WO2015099343A1 (fr) Dispositif numérique et son procédé de commande
WO2017003022A1 (fr) Dispositif d'affichage et son procédé de commande
WO2012030024A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016085094A1 (fr) Dispositif multimédia et procédé de commande associé
WO2012015117A1 (fr) Procédé pour faire fonctionner un appareil d'affichage d'image
WO2011126202A1 (fr) Appareil d'affichage d'image et son procédé d'utilisation
WO2011136458A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016085070A1 (fr) Système de commande de dispositif, dispositif numérique, et procédé de commande pour commander ledit dispositif
WO2016186254A1 (fr) Panneau d'affichage et son procédé de commande
WO2012015116A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016104907A1 (fr) Dispositif numérique, et procédé de traitement de données par le même dispositif numérique
WO2016143965A1 (fr) Dispositif d'affichage, et procédé de commande correspondant
WO2016027933A1 (fr) Dispositif numérique et son procédé de commande
WO2012015118A1 (fr) Procédé de fonctionnement d'appareil d'affichage d'image
WO2012074197A1 (fr) Procédé de partage de messages dans dispositif d'affichage d'image et dispositif d'affichage d'image correspondant
WO2011159006A1 (fr) Appareil d'affichage d'image et procédé de fonctionnement associé
WO2012026666A2 (fr) Procédé de fourniture d'application de jeu et dispositif d'affichage d'image utilisant celui-ci
WO2011132840A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2012081803A1 (fr) Procédé de fourniture d'un menu d'applications dans un dispositif d'affichage d'images et dispositif d'affichage d'images selon celui-ci
WO2017034065A1 (fr) Dispositif d'affichage et son procédé de commande
WO2012026651A1 (fr) Procédé de synchronisation de contenus et dispositif d'affichage permettant le procédé
WO2012030025A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016175361A1 (fr) Dispositif d'affichage et son procédé de commande
WO2016175356A1 (fr) Dispositif numérique et procédé de commande de dispositif numérique
WO2017200215A1 (fr) Terminal mobile et procédé de commande de celui-ci

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19905508

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19905508

Country of ref document: EP

Kind code of ref document: A1