KR20160051332A - Digital device and method of processing data thereof - Google Patents

Abstract

Disclosed are a digital device and a data processing method by the digital device. The digital device according to an embodiment of the present invention comprises: a broadcast reception unit for receiving broadcast signals including content by tuning a first channel; a decoder for decoding the content from the broadcast signals; an output unit for outputting the decoded content; a user interface unit for receiving a channel conversion request; and a control unit for storing the outputted content according to a time-shift function, and for receiving and outputting broadcast signals including the content by tuning a second channel according to the channel conversion request, wherein the control unit stores, in server, the stored content according to a time-shift function. The digital device according to an embodiment of the present invention can share the content stored according to a time-shift function with at least one device, and allow a user to access to the content stored according to a time-shift function, thereby improving user convenience and product satisfaction.

Description

TECHNICAL FIELD [0001] The present invention relates to a digital device and a method for processing data in a digital device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital device, and more particularly, to a time shift function in a digital device and a processing related to the data processing.

The transition from analog broadcasting to digital broadcasting is being made. Digital broadcasting is stronger than external analog noise compared with conventional analog broadcasting, so data loss is small, error correction is advantageous, and resolution is high, thus providing a clearer picture. Unlike analog broadcasting, digital broadcasting also provides bidirectional services. In addition to the conventional medium such as terrestrial broadcasting, satellite and cable, IPTV broadcasting service providing real-time broadcasting and CoD (Content on Demand) services through IP (Internet Protocol) Services are also being provided.

Most televisions on the market today support the Recording / Timeshift function. The time shift refers to a function of rewinding a previously viewed image to be viewed again.

Since the time shift is mainly performed for a moving image, its capacity is large and it takes up a lot of storage space. As a result, an external large-capacity hard disk drive (HDD) is mainly used. Meanwhile, with respect to the present invention, the time shift is determined depending on the system resource of the digital device, such as its performance, multi-channel time shift, and the like. In other words, the time shift depends on the system resources of the digital device. Therefore, in using a digital device, even if the user desires to use the time shift function, he / she feels inconvenience because he or she can not use the desired content due to limitations of the system resources.

In order to solve the above problems, it is an object of the present invention to provide a method and apparatus for storing content stored according to a time shift function in a server, a device or the like capable of data communication, To share with other devices beyond that.

Another object of the present invention is to allow quick and convenient access to the time shift storage contents without sharing the time shift storage contents through data communication and without tuning a corresponding channel.

Another object of the present invention is to provide a system and method for reducing dependency on a system resource, such as an occupation of a system resource for time shift or a resource conflict, To be used.

It is still another object of the present invention to provide a method and apparatus for expanding a time shift such as a sustain timeshift function and a multi-channel timeshift function more functionally than conventional ones, Together we will improve product satisfaction.

The technical problem to be solved by the present invention is not limited to the above-described technical problems and other technical problems which are not mentioned can be clearly understood by those skilled in the art from the following description .

According to an aspect of the present invention, there is provided a method of processing data in a digital device, comprising: receiving a broadcast signal including content by tuning a first channel; decoding content from the broadcast signal; Outputting the content, time-shifting the output content, receiving a channel change request, tuning a second channel according to the change request, and receiving and outputting a broadcast signal including the content, The content to be stored in the time shift storage is stored in a server.

A digital device according to an exemplary embodiment of the present invention includes a broadcast receiver for tuning a first channel and receiving a broadcast signal including content, a decoder for decoding content from the broadcast signal, an output unit for outputting decoded content, And a control unit for controlling the user interface unit to receive the request and to control the time shift storage of the output content and to receive and output a broadcast signal including the content by tuning the second channel according to the switching request, Controls to store the time-shifted content to be stored in the server.

The solution according to the technical object to be achieved by the present invention is not limited to the above-mentioned solution, and other solutions not mentioned are clearly described from the following description to those skilled in the art to which the present invention belongs It can be understood.

According to the present invention, there are the following effects.

According to an embodiment of the present invention, the content stored according to the time shift function can be stored in a server, a device, etc., which can perform data communication, and can be shared with one or more other devices .

According to another embodiment of the present invention, the time shift storage contents can be shared through data communication and the time shift storage contents can be accessed quickly and conveniently without tuning the corresponding channel.

According to another embodiment of the present invention, there is an effect that the time shift function can be utilized by reducing the dependency on the system resources such as the occupation of the system resource for time shift or the resource conflict, or by expanding the system resource.

According to another embodiment of the present invention, time shifts such as a sustain time shift function and a multi-channel time shift function can be expanded functionally as compared with the related art, There is an effect.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a schematic diagram illustrating a service system including a digital device according to an exemplary embodiment of the present invention;
2 is a block diagram illustrating a digital device according to an embodiment of the present invention;
3 is a block diagram illustrating a digital device according to another embodiment of the present invention;
4 is a block diagram illustrating a digital device according to another embodiment of the present invention;
FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention; FIG.
Figure 6 illustrates an input means coupled to the digital device of Figures 2 through 4 according to one embodiment of the present invention;
FIG. 7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention; FIG.
8 is a diagram illustrating an architecture of a web OS device according to an embodiment of the present invention;
9 is a diagram illustrating a graphical composition flow in a web OS device according to an embodiment of the present invention;
10 is a diagram illustrating a media server according to an embodiment of the present invention;
11 is a diagram illustrating a configuration block of a media server according to an embodiment of the present invention;
12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention;
13 is a flowchart illustrating a service processing method in a digital device according to an embodiment of the present invention;
FIG. 14 is a view for explaining a time shift setting menu according to an embodiment of the present invention; FIG.
15 and 16 illustrate a time shift function using an external resource according to an embodiment of the present invention;
FIGS. 17 to 19 are flowcharts for explaining data processing in FIGS. 15 and 16 according to an embodiment of the present invention;
20 is a flowchart illustrating a time shift content output method according to an embodiment of the present invention;
21 is a flowchart illustrating an automatic time shift processing method according to an embodiment of the present invention; And
22 to 35 are diagrams for explaining a UI / UX scene related to advanced time shift data processing according to an embodiment of the present invention.

Hereinafter, various embodiments (s) of a digital device and a data processing method in the digital device according to the present invention will be described in detail with reference to the drawings.

The suffix "module "," part ", and the like for components used in the present specification are given only for ease of specification, and both may be used as needed. Also, even when described in ordinal numbers such as " 1st ", "2nd ", and the like, it is not limited to such terms or ordinal numbers.

In addition, although the terms used in the present specification have been selected from the general terms that are widely used in the present invention in consideration of the functions according to the technical idea of the present invention, they are not limited to the intentions or customs of the artisan skilled in the art, It can be different. However, in certain cases, some terms are arbitrarily selected by the applicant, which will be described in the related description section. Accordingly, it should be understood that the term is to be interpreted based not only on its name but on its practical meaning as well as on the contents described throughout this specification.

It is to be noted that the contents of the present specification and / or drawings are not intended to limit the scope of the present invention.

The term " digital device " as used herein refers to at least one of transmitting, receiving, processing, and outputting data, content, service, Includes all devices that perform. The digital device can be paired or connected (hereinafter, referred to as 'pairing') with another digital device, an external server, or the like through a wire / wireless network, Can be transmitted / received. At this time, if necessary, the data may be appropriately converted before the transmission / reception. The digital device may be a standing device such as a network TV, a Hybrid Broadcast Broadband TV (HBBTV), a Smart TV, an IPTV (Internet Protocol TV), a PC (Personal Computer) And a mobile device or handheld device such as a PDA (Personal Digital Assistant), a smart phone, a tablet PC, a notebook, and the like. In order to facilitate understanding of the present invention and to facilitate the description of the present invention, FIG. 2, which will be described later, describes a digital TV, and FIG. 3 illustrates and describes a mobile device as an embodiment of a digital device. In addition, the digital device described herein may be a digital signage, a monitor or a display device composed only of a panel, a set-top box (STB) Or may be part of one service system in conjunction with a server or the like.

The term " wired / wireless network " as used herein collectively refers to communication networks that support various communication standards or protocols for pairing and / or data transmission / reception between digital devices or digital devices and external servers. Such a wired / wireless network includes all of the communication networks to be supported by the standard now or in the future, and is capable of supporting one or more communication protocols therefor. Such a wired / wireless network includes, for example, a USB (Universal Serial Bus), a Composite Video Banking Sync (CVBS), a Component, an S-Video (Analog), a DVI (Digital Visual Interface) A communication standard or protocol for a wired connection such as an RGB or a D-SUB, a Bluetooth standard, a radio frequency identification (RFID), an infrared data association (IrDA), an ultra wideband (UWB) (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) A long term evolution (LTE-Advanced), and Wi-Fi direct, and a communication standard or protocol for the network.

In addition, when the term is simply referred to as a digital device in this specification, the meaning may mean a fixed device or a mobile device depending on the context, and may be used to mean both, unless specifically stated otherwise.

Meanwhile, a digital device is an intelligent device that supports, for example, a broadcast receiving function, a computer function or a support, at least one external input, and the like. The digital device may be an e-mail, web browsing, Banking, game, application, and so on. In addition, the digital device may include an interface for supporting at least one input or control means (hereinafter, " input means ") such as a handwriting input device, a touch- .

In addition, the digital device can use a standardized general-purpose OS (Operating System), but in particular, the digital device described in this specification uses Web OS (Web OS) as an embodiment. Therefore, a digital device can handle adding, deleting, amending, and updating various services or applications on a general-purpose OS kernel or a Linux kernel. And through which a more user-friendly environment can be constructed and provided.

Meanwhile, the above-described digital device can receive and process an external input. The external input is connected to an external input device, that is, the above-mentioned digital device via a wired / wireless network, And all input means or digital devices capable of being processed. For example, the external input may be a game device such as a high-definition multimedia interface (HDMI), a playstation or an X-Box, a smart phone, a tablet PC, a pocket photo devices such as digital cameras, printing devices, smart TVs, Blu-ray device devices and the like.

In addition, the term "server" as used herein refers to a digital device or system that supplies data to or receives data from a digital device, that is, a client, and may be referred to as a processor do. The server may include a portal server for providing a web page, a web content or a web service, an advertising server for providing advertising data, A content server providing content, an SNS server providing a social network service (SNS), a service server provided by a manufacturer, a video on demand (VoD) service or a streaming service And a service server that provides a Multichannel Video Programming Distributor (MVPD) and a pay service, for example.

In the following description, the term " application " refers only to an application, and the term " application " May refer to a web application.

A digital device according to an exemplary embodiment of the present invention includes a user interface for receiving a channel change request, a tuner for tuning a first channel, a broadcast signal including a first broadcast program, Tuners (tuners) for tuning a channel and receiving a broadcast signal including a second broadcast program, a memory for storing the first broadcast program in a time shift manner, a memory for storing the first broadcast program and the second broadcast program, An outputting module for outputting on the screen, and a controller for controlling the time shift storage of the first broadcast program of the first channel continuously while the second broadcast program is being output on the screen.

Here, the first channel and the second channel to be switched can be tuned by a first tuner among the tuners. If the second channel tuned by the channel change request is tuned by the first tuner, the first channel tunes through the second tuner of the tuners and receives the broadcast signal including the first broadcast program Can be processed. Further, the first channel is tuned by the first tuner, and the second channel requested to be switched is tuned by the second tuner.

The user interface unit may further receive a service or application execution request, and the control unit may control execution and output of the requested service or application, and when the service or application is output in the foreground, The first broadcast program of the first channel can be controlled to continuously store time shift in the background.

In addition, the controller may determine whether a resource conflict has occurred in at least one system resource for time shift storage of the first broadcast program, and if the at least one resource conflicts, It is possible to control to stop the shift storage. The control unit may determine that the at least one resource conflicts only when the resource utilization priority of at least one of a service and an application that wishes to use the conflicting system resource takes precedence over the TV service or the time shift function, So that the storage can be stopped. In addition, the control unit may control not to perform the time shift storage interruption when the conflicting system resources can be resource-shared. The control unit may transmit at least one of a time order thumbnail image and a guide message for the first broadcast program of the first channel stored in the time shift storage unit and a guide message for the first broadcast program, And outputting the program to a predetermined area of the second broadcast program output screen of the second channel. The guide message may include at least one of a first program use, an end, and a time shift storage end.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram illustrating a service system including a digital device according to an exemplary embodiment of the present invention.

1, a service system includes a content provider 10, a service provider 20, a network provider 30, and a Home Network End User (HNED) (Customer) 40. Here, the HNED 40 includes, for example, a client 100, i.e., a digital device according to the present invention.

The content provider 10 produces and provides various contents. As shown in FIG. 1, the content provider 10 may include a terrestrial broadcast sender, a cable SO (System Operator), a MSO (Multiple SO), a satellite broadcast sender, Personal content providers, and the like. On the other hand, the content provider 10 can produce and provide various services and applications in addition to the broadcast content.

The service provider 20 provides service packetizing of the content produced by the content provider 10 to the HNED 40. [ For example, the service provider 20 packages at least one of the first terrestrial broadcast, the second terrestrial broadcast, the cable MSO, the satellite broadcast, the various internet broadcast, and the contents produced by the application for service, (40).

The service provider 20 provides services to the client 100 in a uni-cast or multi-cast manner. Meanwhile, the service provider 20 can transmit data to a plurality of clients 100 registered in advance, and an Internet Group Management Protocol (IGMP) protocol can be used for this purpose.

The above-described content provider 10 and the service provider 20 may be the same entity. For example, the service provided by the content provider 10 may be packaged and provided to the HNED 40, thereby performing the function of the service provider 20 or vice versa.

The network provider 30 provides a network for exchanging data between the content provider 10 and / or the service provider 20 and the client 100.

The client 100 is a consumer belonging to the HNED 40. The client 100 constructs a home network through the network provider 30 to receive data and stores data related to various services and applications such as VoD and streaming / RTI >

Meanwhile, the content provider 10 or / and the service provider 20 in the service system can use conditional access or content protection means for protecting the content to be transmitted. Accordingly, the client 100 can use a processing means such as a cable card (or a POD: Point of Deployment), a DCAS (Downloadable CAS) or the like in response to the restriction reception or the content protection.

In addition, the client 100 can use the two-way service through the network. Accordingly, the client 100 may rather perform the function or role of the content provider, and the service provider 20 may receive the content and transmit the same to another client or the like.

In FIG. 1, the content provider 10 and / or the service provider 20 may be a server that provides a service described later in this specification. In this case, the server may also mean to own or include network provider 30 as needed. The service or service data includes an internal service or an application, as well as a service or an application received from the outside, and the service or the service includes a service for a Web OS-based client 100 Or application data.

2 is a block diagram illustrating a digital device according to an exemplary embodiment of the present invention.

The digital device described herein corresponds to the client 100 of FIG. 1 described above.

The digital device 200 includes a network interface 201, a TCP / IP manager 202, a service delivery manager 203, an SI decoder 204, A demultiplexer (demux or demultiplexer) 205, an audio decoder 206, a video decoder 207, a display A / V and OSD module 208, a service management manager 209, a service discovery manager 210, an SI & metadata DB 211, a metadata manager 212, a service manager 213, A UI manager 214, and the like.

The network interface unit 201 receives the IP packet (s) (IP packet (s)) or the IP datagram (s) ) Is transmitted / received. For example, the network interface unit 201 can receive services, applications, content, and the like from the service provider 20 of FIG. 1 through a network. SI information may be included in the additional information. Meanwhile, the network interface unit 201 may be replaced with a tuner.

The TCP / IP manager 202 determines whether the IP packets received by the digital device 200 and the IP packets transmitted by the digital device 200 are packet delivery (i.e., packet delivery) between a source and a destination packet delivery). The service discovery manager 210, the service control manager 209, the meta data manager 212, the service discovery manager 210, the service control manager 209, and the metadata manager 212. The TCP / IP manager 202 classifies the received packet (s) ) Or the like.

The service delivery manager 203 is responsible for controlling the received service data. For example, the service delivery manager 203 may use RTP / RTCP when controlling real-time streaming data. When the real-time streaming data is transmitted using the RTP, the service delivery manager 203 parses the received data packet according to the RTP and transmits the packet to the demultiplexing unit 205 or the control of the service manager 213 In the SI & meta data database 211. [ Then, the service delivery manager 203 feedbacks the network reception information to the server providing the service using RTCP.

The demultiplexer 205 demultiplexes the received packets into audio, video, SI (System Information) data, and transmits them to the audio / video decoder 206/207 and the SI decoder 204, respectively.

The SI decoder 204 decodes the demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting Service Information (DVB-SI), Digital Television Terrestrial Multimedia Broadcasting / Coding Mobile Multimedia Broadcasting). Also, the SI decoder 204 may store the decoded service information in the SI & meta data database 211. The stored service information can be read out and used by the corresponding configuration, for example, by a user's request.

The audio / video decoder 206/207 decodes each demultiplexed audio data and video data. The decoded audio data and video data are provided to the user through the display unit 208. [

The application manager may include, for example, the UI manager 214 and the service manager 213 and may perform the functions of the controller of the digital device 200. [ In other words, the application manager can manage the overall state of the digital device 200, provide a user interface (UI), and manage other managers.

The UI manager 214 provides a GUI (Graphic User Interface) / UI for a user using an OSD (On Screen Display) or the like, and receives a key input from a user to perform a device operation according to the input. For example, the UI manager 214 transmits the key input signal to the service manager 213 upon receipt of a key input from the user regarding channel selection.

The service manager 213 controls the manager associated with the service such as the service delivery manager 203, the service discovery manager 210, the service control manager 209, and the metadata manager 212.

The service manager 213 also generates a channel map and controls the selection of a channel using the generated channel map according to the key input received from the UI manager 214. [ The service manager 213 receives the service information from the SI decoder 204 and sets an audio / video PID (Packet Identifier) of the selected channel in the demultiplexer 205. The PID thus set can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters (PID or section) audio data, video data, and SI data using the PID.

The service discovery manager 210 provides information necessary for selecting a service provider that provides the service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for the service using the information.

The service control manager 209 is responsible for selection and control of services. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as an existing broadcasting system, and selects a service such as VOD (Video on Demand) , RTSP is used to select and control services. The RTSP protocol may provide a trick mode for real-time streaming. In addition, the service control manager 209 can initialize and manage a session through the IMS gateway 250 using an IP Multimedia Subsystem (IMS) and a Session Initiation Protocol (SIP). The protocols are one embodiment, and other protocols may be used, depending on the implementation.

The metadata manager 212 manages the metadata associated with the service and stores the metadata in the SI & metadata database 211.

The SI & meta data database 211 stores service information decoded by the SI decoder 204, meta data managed by the meta data manager 212, and information necessary for selecting a service provider provided by the service discovery manager 210 . In addition, the SI & meta data database 211 may store set-up data for the system and the like.

The SI & meta data database 211 may be implemented using a non-volatile RAM (NVRAM) or a flash memory.

Meanwhile, the IMS gateway 250 is a gateway that collects functions necessary for accessing the IMS-based IPTV service.

3 is a block diagram illustrating a digital device according to another embodiment of the present invention.

If the above-described Fig. 2 is described with an example of a digital device as a fixing device, Fig. 3 shows a mobile device as another embodiment of a digital device.

3, the mobile device 300 includes a wireless communication unit 310, an A / V input unit 320, a user input unit 330, a sensing unit 340, an output unit 350, A memory 360, an interface unit 370, a control unit 380, a power supply unit 390, and the like.

Hereinafter, each component will be described in detail.

The wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and the wireless communication system or between the mobile device and the network in which the mobile device is located. For example, the wireless communication unit 310 may include a broadcast receiving module 311, a mobile communication module 312, a wireless Internet module 313, a short range communication module 314, and a location information module 315 .

The broadcast receiving module 311 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312.

The broadcast-related information may exist in various forms, for example, in the form of an EPG (Electronic Program Guide) or an ESG (Electronic Service Guide).

The broadcast receiving module 311 may be, for example, an ATSC, a Digital Video Broadcasting-Terrestrial (DVB-T), a Satellite (DVB-S), a Media Forward Link Only And Integrated Services Digital Broadcast-Terrestrial (DRS). Of course, the broadcast receiving module 311 may be adapted to not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 311 may be stored in the memory 360.

The mobile communication module 312 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 313 may be embedded or external to the mobile device 300, including a module for wireless Internet access. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 314 is a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IRDA), Ultra Wideband (UWB), ZigBee, RS-232 and RS-485 are used as short range communication technology. .

The position information module 315 is a module for acquiring position information of the mobile device 300, and may be a GPS (Global Position System) module.

The A / V input unit 320 is for inputting audio and / or video signals. The A / V input unit 320 may include a camera 321 and a microphone 322. The camera 321 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display section 351. [

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside via the wireless communication unit 310. [ At least two cameras 321 may be provided depending on the use environment.

The microphone 322 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 312 in the case of the communication mode, and output. The microphone 322 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 330 generates input data for user's operation control of the terminal. The user input unit 330 may include a key pad, a dome switch, a touch pad (static pressure / static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 340 senses the current state of the mobile device 300 such as the open / closed state of the mobile device 300, the position of the mobile device 300, the user's contact, the orientation of the mobile device, And generates a sensing signal for controlling the operation of the mobile device 300. For example, when the mobile device 300 is moved or tilted, it may sense the position, slope, etc. of the mobile device. It is also possible to sense whether power is supplied to the power supply unit 390, whether the interface unit 370 is connected to an external device, and the like. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including NFC (Near Field Communication).

The output unit 350 may include a display unit 351, an acoustic output module 352, an alarm unit 353, and a haptic module 354 for generating output related to visual, auditory, have.

The display unit 351 displays (outputs) information processed by the mobile device 300. [ For example, if the mobile device is in call mode, it displays a UI or GUI associated with the call. When the mobile device 300 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 351 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) flexible display, and a three-dimensional display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display portion 351 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 351 of the terminal body.

There may be two or more display units 351 depending on the implementation of the mobile device 300. [ For example, in the mobile device 300, the plurality of display portions may be spaced apart or integrally arranged on one surface, and may be disposed on different surfaces, respectively.

The display unit 351 includes a display unit 351 and a display unit 351. When the display unit 351 and the sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure It can also be used as a device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display portion 351 or a capacitance generated in a specific portion of the display portion 351 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits corresponding data to the controller 380. Thus, the control unit 380 can know which area of the display unit 351 is touched or the like.

A proximity sensor 341 may be disposed in the interior area of the mobile device or in proximity to the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 352 can output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 352 also outputs sound signals associated with functions performed on the mobile device 300 (e.g., call signal receive tones, message receive tones, etc.). The sound output module 352 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event of the mobile device 300. [ Examples of events that occur in the mobile device include receiving a call signal, receiving a message, inputting a key signal, and touch input. The alarm unit 353 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 351 or the audio output module 352 so that they may be classified as a part of the alarm unit 353.

The haptic module 354 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 354 is vibration. The intensity and pattern of the vibration generated by the haptic module 354 are controllable. For example, different vibrations may be synthesized and output or sequentially output. In addition to the vibration, the haptic module 354 may be arranged in a variety of ways, such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, Various effects such as an effect of heat generation and an effect of reproducing a cool / warm feeling using a heat absorbing or heatable element can be generated. The haptic module 354 can be implemented not only to transmit the tactile effect through direct contact but also to allow the user to feel the tactile effect through the muscular sensation of a finger or an arm. More than one haptic module 354 may be provided according to the configuration of the mobile device 300.

The memory 360 may store a program for the operation of the control unit 380 and temporarily store input / output data (e.g., phone book, message, still image, moving picture, etc.). The memory 360 may store data related to vibration and sound of various patterns output during touch input on the touch screen.

The memory 360 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk. The mobile device 300 may operate in association with a web storage that performs storage functions of the memory 360 on the Internet.

The interface unit 370 serves as a pathway to all the external devices connected to the mobile device 300. The interface unit 370 receives data from an external device or receives power from the external device and transfers the data to each component in the mobile device 300 or transmits data in the mobile device 300 to an external device. For example, it may be provided with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port connecting a device with an identification module, an audio I / O port, A video I / O port, an earphone port, and the like may be included in the interface unit 370.

The identification module is a chip for storing various information for authenticating the usage right of the mobile device 300 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. A device having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 200 through the port.

The interface unit 370 may be a communication path through which the power from the cradle is supplied to the mobile device 300 when the mobile device 300 is connected to an external cradle, A command signal may be the path through which it is communicated to the mobile device. The various command signals or the power supply input from the cradle may be operated with a signal for recognizing that the mobile device is correctly mounted on the cradle.

The control unit 380 typically controls the overall operation of the mobile device 300. The control unit 380 performs related control and processing, for example, for voice call, data communication, video call, and the like. The control unit 380 may include a multimedia module 381 for multimedia playback. The multimedia module 381 may be implemented in the control unit 380 or separately from the control unit 380. The control unit 380 can perform pattern recognition processing for recognizing the handwriting input or the drawing input performed on the touch-screen as characters and images, respectively.

The power supply unit 390 receives external power and internal power under the control of the controller 380 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and an electrical unit for performing other functions. In some cases, the implementation described herein Examples may be implemented by the control unit 380 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Here, the software code is stored in the memory 360 and can be executed by the control unit 380. [

4 is a block diagram illustrating a digital device according to another embodiment of the present invention.

Another example of the digital device 400 includes a broadcast receiving unit 405, an external device interface unit 435, a storage unit 440, a user input interface unit 450, a control unit 470, a display unit 480, An output unit 485, a power supply unit 490, and a photographing unit (not shown). The broadcast receiver 405 may include at least one tuner 410, a demodulator 420, and a network interface 430. In some cases, the broadcast receiver 405 may include a tuner 410 and a demodulator 420, but may not include the network interface 430, or vice versa. The broadcast receiving unit 405 may include a multiplexer to receive a demodulated signal from the demodulator 420 via the tuner 410 and a signal received via the network interface 430, May be multiplexed. In addition, although not shown, the broadcast receiver 425 includes a demultiplexer to demultiplex the multiplexed signals, demultiplex the demodulated signals or the signals passed through the network interface 430 .

The tuner 410 tunes a channel selected by the user or all pre-stored channels of an RF (Radio Frequency) broadcast signal received through the antenna, and receives the RF broadcast signal. In addition, the tuner 410 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, the signal is converted into a digital IF signal (DIF). If the received RF broadcast signal is an analog broadcast signal, the signal is converted into an analog baseband image or a voice signal (CVBS / SIF). That is, the tuner 410 can process both a digital broadcast signal and an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 410 can be directly input to the controller 470.

In addition, the tuner 410 can receive RF broadcast signals of a single carrier or a multiple carrier. Meanwhile, the tuner 410 sequentially tunes and receives RF broadcast signals of all the broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna, converts the RF broadcast signals into intermediate frequency signals or baseband signals (DIF: Digital Intermediate Frequency or baseband signal).

The demodulator 420 may receive and demodulate the digital IF signal DIF converted by the tuner 410 and perform channel decoding. For this, the demodulator 420 may include a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or a convolution decoder, a deinterleaver, - Solomon decoder and the like.

The demodulation unit 420 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like.

The stream signal output from the demodulation unit 420 may be input to the control unit 470. The control unit 470 controls demultiplexing, video / audio signal processing, and the like, and controls the output of audio through the display unit 480 and audio through the audio output unit 485.

The external device interface unit 435 provides an interface environment between the digital device 300 and various external devices. To this end, the external device interface unit 335 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 435 may be a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (notebook), a tablet PC, a smart phone, device, an external device such as a cloud, or the like. The external device interface unit 435 transmits a signal including data such as image, image, and voice input through the connected external device to the control unit 470 of the digital device. The control unit 470 can control the processed image, image, voice, and the like to be output to the external device to which the data signal is connected. To this end, the external device interface unit 435 may further include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog) terminal, A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with another digital device. The digital device 400 may be a Bluetooth device such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (UDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) Lt; RTI ID = 0.0 > and / or < / RTI > other communication protocols.

Also, the external device interface unit 435 may be connected to the set-top box STB through at least one of the various terminals described above to perform input / output operations with the set-top box STB.

Meanwhile, the external device interface unit 435 may receive an application or an application list in an adjacent external device, and may transmit the received application or application list to the control unit 470 or the storage unit 440.

The network interface unit 430 provides an interface for connecting the digital device 400 to a wired / wireless network including the Internet network. The network interface unit 430 may include an Ethernet terminal or the like for connection with a wired network and may be a WLAN (Wireless LAN) (Wi- Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 430 can transmit or receive data to another user or another digital device via the connected network or another network linked to the connected network. In particular, some of the content data stored in the digital device 400 can be transmitted to a selected user or selected one of other users or other digital devices previously registered with the digital device 400. [

Meanwhile, the network interface unit 430 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive content and related information such as movies, advertisements, games, VOD, broadcasting signals, etc., provided from a content provider or a network provider through a network. In addition, it can receive update information and an update file of firmware provided by the network operator. It may also transmit data to the Internet or to a content provider or network operator.

In addition, the network interface unit 430 can select and receive a desired application from the open applications through the network.

The storage unit 440 may store a program for each signal processing and control in the control unit 470 or may store a signal-processed video, audio, or data signal.

The storage unit 440 may also function for temporarily storing video, audio, or data signals input from the external device interface unit 435 or the network interface unit 430. [ The storage unit 440 can store information on a predetermined broadcast channel through the channel memory function.

The storage unit 440 may store a list of applications or applications input from the external device interface unit 435 or the network interface unit 330.

In addition, the storage unit 440 may store various platforms described later.

The storage unit 440 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD Memory, etc.), RAM (RAM), and ROM (EEPROM, etc.). The digital device 400 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 440 to a user.

4 illustrates an embodiment in which the storage unit 440 is provided separately from the control unit 470, the present invention is not limited thereto. In other words, the storage unit 440 may be included in the control unit 470.

The user input interface unit 450 transfers a signal input by the user to the controller 470 or a signal from the controller 470 to the user.

For example, the user input interface unit 450 may control power on / off, channel selection, screen setting, etc. from the remote control device 500 according to various communication methods such as an RF communication method and an infrared (IR) And may transmit the control signal of the control unit 470 to the remote control device 500. [

In addition, the user input interface unit 450 can transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 470.

The user input interface unit 450 transmits a control signal input from a sensing unit (not shown) that senses a gesture of a user to the control unit 470 or transmits a signal of the control unit 470 to a sensing unit (Not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 470 demultiplexes the streams input through the tuner 410, the demodulation unit 420, or the external device interface unit 435 or processes the demultiplexed signals to generate a signal for video or audio output And can output.

The video signal processed by the control unit 470 may be input to the display unit 480 and displayed as an image corresponding to the video signal. The video signal processed by the controller 470 may be input to the external output device through the external device interface unit 435. [

The audio signal processed by the control unit 470 may be audio-output to the audio output unit 485. The voice signal processed by the control unit 470 may be input to the external output device through the external device interface unit 435. [

Although not shown in FIG. 4, the control unit 470 may include a demultiplexing unit, an image processing unit, and the like.

The control unit 470 can control the overall operation of the digital device 400. [ For example, the controller 470 may control the tuner 410 to control tuning of a RF broadcast corresponding to a channel selected by the user or a previously stored channel.

The control unit 470 can control the digital device 400 by a user command or an internal program input through the user input interface unit 450. [ In particular, the user can access the network and allow a user to download a desired application or application list into the digital device 400.

For example, the control unit 470 controls the tuner 410 so that a signal of a selected channel is input according to a predetermined channel selection command received through the user input interface unit 450. And processes video, audio or data signals of the selected channel. The control unit 470 allows the display unit 480 or the audio output unit 485 to output the video or audio signal processed by the user through the channel information selected by the user.

The control unit 470 may be connected to the external device interface unit 435 through an external device such as a camera or a camcorder in accordance with an external device video playback command received through the user input interface unit 450. [ So that the video signal or the audio signal of the video signal can be output through the display unit 480 or the audio output unit 485.

On the other hand, the control unit 470 can control the display unit 480 to display an image. For example, a broadcast image input through the tuner 410, an external input image input through the external device interface unit 435, an image input through the network interface unit, or an image stored in the storage unit 440 , And display on the display unit 480. At this time, the image displayed on the display unit 480 may be a still image or a moving image, and may be a 2D image or a 3D image.

In addition, the control unit 470 can control to reproduce the content. The content at this time may be the content stored in the digital device 400, or the received broadcast content, or an external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

On the other hand, when entering the application view item, the control unit 470 can control to display a list of applications or applications that can be downloaded from the digital device 300 or from an external network.

The control unit 470, in addition to various user interfaces, can control to install and drive an application downloaded from the external network. In addition, by the user's selection, it is possible to control the display unit 480 to display an image related to the executed application.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided.

The channel browsing processing unit receives a stream signal TS output from the demodulation unit 320 or a stream signal output from the external device interface unit 335 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be encoded as it is or may be input to the controller 470. In addition, the generated thumbnail image may be encoded in a stream form and input to the controller 470. The control unit 470 may display a thumbnail list having a plurality of thumbnail images on the display unit 480 using the input thumbnail images. On the other hand, the thumbnail images in this thumbnail list can be updated in sequence or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 480 converts an image signal, a data signal, an OSD signal processed by the control unit 470 or a video signal and a data signal received from the external device interface unit 435 into R, G, and B signals, respectively Thereby generating a driving signal.

The display unit 480 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

Meanwhile, the display unit 480 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 485 receives a signal processed by the control unit 470, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The audio output unit 485 may be implemented by various types of speakers.

In order to detect the gesture of the user, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further included in the digital device 400 . A signal sensed by a sensing unit (not shown) may be transmitted to the controller 3470 through the user input interface unit 450.

On the other hand, a photographing unit (not shown) for photographing a user may be further provided. The image information photographed by the photographing unit (not shown) may be input to the control unit 470.

The control unit 470 may detect the gesture of the user by combining the images photographed by the photographing unit (not shown) or the sensed signals from the sensing unit (not shown).

The power supply unit 490 supplies the corresponding power to the digital device 400.

Particularly, it is possible to supply power to a control unit 470, a display unit 480 for displaying an image, and an audio output unit 485 for audio output, which can be implemented in the form of a system on chip (SoC) .

To this end, the power supply unit 490 may include a converter (not shown) for converting AC power to DC power. Meanwhile, for example, when the display unit 480 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM (Pulse Width Modulation) operation for variable luminance or dimming driving and an inverter (not shown).

The remote control device 500 transmits the user input to the user input interface unit 450. To this end, the remote control device 500 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote control device 500 can receive the video, audio, or data signal output from the user input interface unit 450 and display it on the remote control device 500 or output sound or vibration.

The digital device 400 may be a digital broadcast receiver capable of processing digital broadcast signals of a fixed or mobile ATSC scheme or a DVB scheme.

In addition, the digital device according to the present invention may further include a configuration that omits some of the configuration shown in FIG. On the other hand, unlike the above, the digital device does not have a tuner and a demodulator, and can receive and reproduce the content through the network interface unit or the external device interface unit.

FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention. Referring to FIG.

An example of the control unit includes a demultiplexer 510, an image processor 5520, an OSD generator 540, a mixer 550, a frame rate converter (FRC) 555, And may include a formatter 560. The control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 510 demultiplexes the input stream. For example, the demultiplexer 510 may demultiplex the received MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 510 may be a stream signal output from a tuner, a demodulator, or an external device interface.

The image processing unit 420 performs image processing of the demultiplexed image signal. To this end, the image processing unit 420 may include a video decoder 425 and a scaler 435.

The video decoder 425 decodes the demultiplexed video signal, and the scaler 435 scales the decoded video signal so that the resolution of the decoded video signal can be output from the display unit.

The video decoder 525 may support various standards. For example, the video decoder 525 performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video decoder 525 encodes the video signal in the DMB (Digital Multimedia Broadcasting) It can perform the function of the H.264 decoder.

On the other hand, the video signal decoded by the video processor 520 is input to the mixer 450.

The OSD generation unit 540 generates OSD data according to a user input or by itself. For example, the OSD generating unit 440 generates data for displaying various data in graphic or text form on the screen of the display unit 380 based on the control signal of the user input interface unit. The generated OSD data includes various data such as a user interface screen of a digital device, various menu screens, a widget, an icon, and viewing rate information. The OSD generation unit 540 may generate data for displaying broadcast information based on the caption of the broadcast image or the EPG.

The mixer 550 mixes the OSD data generated by the OSD generator 540 and the image signal processed by the image processor, and provides the mixed image to the formatter 560. The decoded video signal and the OSD data are mixed and the OSD is overlaid on the broadcast video or the external input video.

A frame rate conversion unit (FRC) 555 converts a frame rate of an input image. For example, the frame rate conversion unit 555 may convert the frame rate of the input 60 Hz image to have a frame rate of 120 Hz or 240 Hz, for example, in accordance with the output frequency of the display unit. As described above, there are various methods for converting the frame rate. For example, when converting the frame rate from 60 Hz to 120 Hz, the frame rate conversion unit 555 may insert the same first frame between the first frame and the second frame, Three frames can be inserted. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate conversion unit 555 may insert and convert three or more identical frames or predicted frames between existing frames. On the other hand, when the frame conversion is not performed, the frame rate conversion unit 555 may be bypassed.

The formatter 560 changes the output of the input frame rate conversion unit 555 to match the output format of the display unit. For example, the formatter 560 may output R, G, and B data signals, and the R, G, and B data signals may be output as low voltage differential signals (LVDS) or mini-LVDS . If the output of the input frame rate converter 555 is a 3D video signal, the formatter 560 may configure and output the 3D format according to the output format of the display unit to support the 3D service through the display unit.

On the other hand, the voice processing unit (not shown) in the control unit can perform the voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing various audio formats. For example, when the audio signal is a moving picture expert group (MPEG) -2, an MPEG-4, an AAC (Advanced Audio Codec), a HE-AAC (High Efficiency-AAC) Coding) or the like, it is possible to perform processing with a corresponding decoder.

In addition, the voice processing unit (not shown) in the control unit can process the base, the treble, the volume control, and the like.

A data processing unit (not shown) in the control unit can perform data processing of the demultiplexed data signal. For example, the data processing unit can decode the demultiplexed data signal even when it is coded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

On the other hand, the above-described digital device is an example according to the present invention, and each component can be integrated, added, or omitted according to specifications of a digital device actually implemented. That is, if necessary, two or more components may be combined into one component, or one component may be divided into two or more components. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and devices thereof do not limit the scope of rights of the present invention.

Meanwhile, the digital device may be an image signal processing device that performs signal processing of an image stored in the device or an input image. Other examples of the video signal processing device include a set-top box (STB), a DVD player, a Blu-ray player, a game device, a computer Etc. can be further exemplified.

FIG. 6 is a diagram illustrating input means coupled to the digital device of FIGS. 2 through 4 according to one embodiment of the present invention.

A front panel (not shown) or a control means (input means) provided on the digital device 600 is used to control the digital device 600.

The control means includes a remote controller 610, a keyboard 630, a pointing device 620, and a keyboard 620, which are mainly implemented for the purpose of controlling the digital device 600, as a user interface device (UID) A touch pad, or the like, but may also include control means dedicated to external input connected to the digital device 600. [ In addition, a control device may include a mobile device such as a smart phone, a tablet PC, or the like that controls the digital device 600 through a mode switching or the like, although it is not a control object of the digital device 600. In the following description, a pointing device will be described as an example, but the present invention is not limited thereto.

The input means may be a communication protocol such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (UDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) At least one can be employed as needed to communicate with the digital device.

The remote controller 610 is a conventional input device having various key buttons necessary for controlling the digital device 600. [

The pointing device 620 may include a gyro sensor or the like to implement a corresponding pointer on the screen of the digital device 600 based on the user's motion, The control command is transmitted. Such a pointing device 620 may be named with various names such as a magic remote controller, a magic controller, and the like.

Since the digital device 600 provides a variety of services such as a web browser, an application, and a social network service (SNS) as an intelligent integrated digital device beyond the conventional digital device 600 providing only conventional broadcasting, It is not easy, and it is implemented to complement input and realize input convenience such as text by implementing similar to PC keyboard.

On the other hand, the control means such as the remote control 610, the pointing device 620 and the keyboard 630 may be provided with a touch pad as required to provide more convenient and various control purposes such as text input, pointer movement, .

The digital device described in this specification uses a Web OS platform. Hereinafter, the processing such as the configuration or algorithm based on the web OS can be performed in the control unit of the above-described digital device or the like. Here, the control unit includes the control unit in FIGS. 2 to 5 described above and uses it as a broad concept. Accordingly, in order to process services, applications, contents, and the like related to the web OS in the digital device, the hardware and components including related software, firmware, and the like are controlled by a controller Can be described by naming.

Such a web OS-based platform is intended to enhance development independence and function expandability by integrating services, applications, and the like based on, for example, a luna-service bus, Productivity can be increased. Also, multi-tasking can be supported by efficiently utilizing system resources and the like through a Web OS process and resource management.

Meanwhile, the web OS platform described in this specification can be used not only in fixed devices such as a PC, a TV, and a set-top box (STB) but also in mobile devices such as mobile phones, smart phones, tablet PCs, notebooks, wearable devices .

The structure of the software for digital devices is based on a single process and a closed product based on multi-threading with conventional problem solving and market-dependent monolithic structure, And has been pursuing new platform-based development since then, has pursued cost innovation through chip-set replacement, UI application and external application development efficiency, and developed layering and componentization Layer structure and an add-on structure for add-ons, single source products, and open applications. More recently, the software architecture provides a modular architecture for functional units, a Web Open API (Application Programming Interface) for echo-systems, and a game engine And a native open API (Native Open API), and thus, a multi-process structure based on a service structure is being created.

7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention.

Referring to FIG. 7, the architecture of the Web OS platform will be described as follows.

The platform can be largely divided into a kernel, a system library based Web OS core platform, an application, and a service.

The architecture of the Web OS platform is layered structure, with the OS at the lowest layer, the system library (s) at the next layer, and the applications at the top. First, the lowest layer includes a Linux kernel as an OS layer, and can include Linux as an OS of the digital device. The OS layer is provided with a BOS (Board Support Package) / HAL (Hardware Abstraction Layer) layer, a Web OS core modules layer, a service layer, a Luna-Service layer Bus layer, Native Developer's Kit (NDK) / QT layer (Enyo framework / NDK / QT layer), and Application layer in the uppermost layer. Meanwhile, some layers of the above-described web OS layer structure may be omitted, and a plurality of layers may be one layer, or one layer may be a plurality of layer structures. The web OS core module layer is based on LSM (Luna Surface Manager) for managing surface windows and the like, SAM (System & Application Manager) for managing the execution and execution status of applications, and WebKit And a WAM (Web Application Manager) for managing web applications and the like.

The LSM manages an application window displayed on the screen. The LSM is responsible for the display hardware (HW) and provides a buffer for rendering the contents necessary for the applications. The LSM composites the rendered results of a plurality of applications, Can be output.

The SAM manages various conditional execution policies of the system and the application.

WAM, on the other hand, is based on the Enyo Framework, which can be regarded as a basic application for web applications.

The use of an application's service is done via a luna-service bus, a new service can be registered on the bus, and an application can find and use the service it needs.

The service layer may include various service level services such as TV service and Web OS service. Meanwhile, the web OS service may include a media server, a Node.JS, and the like. In particular, the Node.JS service supports, for example, javascript.

Web OS services can communicate over a bus to a Linux process that implements function logic. It can be divided into four parts. It is developed from TV process and existing TV to Web OS, services that are differentiated by manufacturer, service which is manufacturer's common service and JavaScript, and is used through Node.js Node.js service.

The application layer may include all applications that can be supported in a digital device, such as a TV application, a showcase application, a native application, a web application, and the like.

An application on the Web OS can be classified into a web application, a PDK (Palm Development Kit) application, a QT (Qt Meta Language or Qt Modeling Language) application and the like according to an implementation method. The web application is based on a WebKit engine and is executed on a WAM runtime. These web applications can be based on the ENI framework, or they can be developed and run on a common HTML5, CSS (Cascading Style Sheets), or JavaScript based. The PDK application includes a native application developed in C / C ++ based on a PDK provided for third-party or external developers. The PDK refers to a development library and a tool set provided for a third party such as a game to develop a native application (C / C ++). For example, PDK applications can be used to develop applications where performance is critical. The QML application is a Qt-based native application and includes a basic application provided with a web OS platform such as a card view, a home dashboard, a virtual keyboard, and the like. Here, QML is a mark-up language in the form of a script instead of C ++. In the meantime, the native application is an application that is developed and compiled in C / C ++ and executed in a binary form. The native application has a high speed of execution.

FIG. 8 is a diagram illustrating an architecture of a Web OS device according to an exemplary embodiment of the present invention. Referring to FIG.

FIG. 8 is a block diagram based on the runtime of the Web OS device, which can be understood with reference to the layered structure of FIG.

The following description will be made with reference to FIGS. 7 and 8. FIG. Referring to FIG. 8, services and applications and WebOS core modules are included on the system OS (Linux) and system libraries, and communication between them can be done via the Luna-Service bus.

E-mail, contact, calendar, etc. Node.js services based on HTML5, CSS, java script, logging, backup, file notify notify, database (DB), activity manager, system policy, audio daemon (AudioD), update, media server, TV services such as Electronic Program Guide (PVD), Personal Video Recorder (PVR), data broadcasting, voice recognition, Now on, Notification, search, , CP services such as Auto Content Recognition (ACR), Contents List Browser (CBOX), wfdd, DMR, Remote Application, download, Sony Philips Digital Interface Format (SDPIF), PDK applications, , QML applications, etc. And the enyo framework based on the TV UI-related applications and web applications, Luna - made the process via the Web OS core modules, such as the aforementioned SAM, WAM, LSM via the service bus. Meanwhile, in the above, TV applications and web applications may not necessarily be UI-based or UI-related.

CBOX can manage the list and metadata of external device contents such as USB, DLNA, cloud etc. connected to TV. Meanwhile, the CBOX can output a content listing of various content containers such as a USB, a DMS, a DVR, a cloud, etc. to an integrated view. In addition, CBOX can display various types of content listings such as pictures, music, video, and manage the metadata. In addition, the CBOX can output the contents of the attached storage in real-time. For example, when a storage device such as a USB is plugged in, the CBOX must be able to immediately output the content list of the storage device. At this time, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate various connection protocols.

The SAM is intended to improve module complexity and scalability. For example, the existing system manager processes various functions such as system UI, window management, web application runtime, and UX constraint processing in one process to separate the main functions to solve the large implementation complexity, Clarify the implementation interface by clarifying the interface.

LSM supports independent development and integration of system UX implementations such as card view, launcher, etc., and supports easy modification of product requirements. Meanwhile, LSM enables multi-tasking by utilizing hardware resource (HW resource) when synthesizing a plurality of application screens such as an application on application, 21: 9, and so on. LSM supports implementation of system UI based on QML and improves its development productivity. Based on MVC, QML UX can easily construct views for layouts and UI components, and can easily develop code for handling user input. On the other hand, the interface between the QML and the Web OS component is via the QML extension plug-in, and the graphic operation of the application can be based on the wayland protocol, luna-service call, etc. have. LSM is an abbreviation of Luna Surface Manager, as described above, which functions as an Application Window Compositor. LSM synthesizes independently generated applications, UI components, etc. on the screen and outputs them. In this regard, when components such as recents applications, showcase applications, launcher applications, etc. render their own contents, the LSM defines the output area, interworking method, etc. as a compositor. In other words, the compositor LSM handles graphics synthesis, focus management, input events, and so on. At this time, the LSM receives events, focus, etc. from the input manager. These input managers can include HIDs such as remote controllers, mouse & keyboards, joysticks, game pads, application remotes, and pen touches. As such, LSM supports multiple window models, which can be performed simultaneously in all applications due to the nature of the system UI. In this regard, it is also possible to provide various functions such as launcher, resent, setting, notification, system keyboard, volume UI, search, finger gesture, Voice Recognition (STT (Sound to Text), TTS LSM can support a pattern gesture (camera, mobile radio control unit (MRCU), live menu, ACR (Auto Content Recognition), etc.) .

9 is a diagram illustrating a graphic composition flow in a web OS device according to an embodiment of the present invention.

9, the graphic composition processing includes a web application manager 910 responsible for the UI process, a webkit 920 responsible for the web process, an LSM 930, and a graphic manager (GM) Lt; RTI ID = 0.0 > 940 < / RTI >

When the web application-based graphic data (or application) is generated as a UI process in the web application manager 910, the generated graphic data is transferred to the LSM 930 if the generated graphic data is not a full-screen application. On the other hand, the web application manager 910 receives an application generated in the web kit 920 for sharing a GPU (Graphic Processing Unit) memory for graphic management between the UI process and the web process, If it is not an application, it transfers it to the LSM 930. In the case of the full-screen application, the LSM 930 may be bypassed and directly transmitted to the graphic manager 940.

The LSM 930 transmits the received UI application to the wayland compositor via the weir surface, and the weir composer appropriately processes the received UI application and transmits it to the graphic manager. The graphic data transmitted from the LSM 930 is transmitted to the graphic manager composer via the LSM GM surface of the graphic manager 940, for example.

On the other hand, the full-screen application is passed directly to the graphics manager 940 without going through the LSM 930, as described above, and this application is processed in the graphics manager compositor via the WAM GM surface. The graphical manager processes all the graphic data in the web OS device, including the data through the LSM GM surface described above, the data through the WAM GM surface, as well as the GM surface such as data broadcasting application, caption application, And processes the received graphic data appropriately on the screen. Here, the functions of the GM compositor are the same or similar to those of the compositor described above.

FIG. 10 is a view for explaining a media server according to an embodiment of the present invention, FIG. 11 is a view for explaining a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.

The media server supports the execution of various multimedia in the digital device and manages the necessary resources. The media server can efficiently use hardware resources required for media play. For example, the media server requires an audio / video hardware resource for multimedia execution and can efficiently utilize the resource usage status by managing it. In general, a fixed device having a larger screen than a mobile device needs more hardware resources to execute multimedia, and a large amount of data must be encoded / decoded and transmitted at a high speed. Meanwhile, the media server may perform tasks such as broadcasting, recording and tuning tasks in addition to streaming and file-based playback, recording simultaneously with viewing, or simultaneously displaying the sender and recipient screens at the time of video call And so on. However, the media server is limited in terms of hardware resources such as an encoder, a decoder, a tuner, and a display engine, and thus it is difficult to execute a plurality of tasks at the same time. For example, And processes it.

The media server may be robust in system stability because, for example, a pipeline in which an error occurs during media playback can be removed and restarted on a per-pipeline basis, Even if it does not affect other media play. Such a pipeline is a chain that links each unit function such as decoding, analysis, and output when a media reproduction request is made, and the necessary unit functions may be changed according to a media type and the like.

The media server may have extensibility, for example, adding new types of pipelines without affecting existing implementations. As an example, the media server may accommodate a camera pipeline, a video conference (Skype) pipeline, a third-party pipeline, and the like.

The media server can process general media playback and TV task execution as separate services because the interface of the TV service is different from the case of media playback. In the above description, the media server supports operations such as 'setchannel', 'channelup', 'channeldown', 'channeltuning', and 'recordstart' in relation to the TV service, ',' stop ', and so on, so that they can support different operations for both, and can be processed as separate services.

The media server can control or integrally manage the resource management function. The allocation and recall of hardware resources in the device are performed integrally in the media server. In particular, the TV service process transfers the running task and the resource allocation status to the media server. The media server obtains resources and executes the pipeline each time each media is executed, and permits execution by a priority (e.g., policy) of the media execution request, based on the resource status occupied by each pipeline, and And performs resource recall of other pipelines. Here, the predefined execution priority and necessary resource information for the specific request are managed by the policy manager, and the resource manager can communicate with the policy manager to process the resource allocation, the number of times, and the like.

The media server may have an identifier (ID) for all playback related operations. For example, the media server may issue a command to indicate a particular pipeline based on the identifier. The media server may separate the two into pipelines for playback of more than one media. The media server may be responsible for playback of the HTML 5 standard media.

In addition, the media server may follow the TV restructuring scope of the TV pipeline as a separate service process. The media server can be designed regardless of the TV restructuring scope. If the TV is not a separate service process, it may be necessary to re-execute the entire TV when there is a problem with a specific task.

The media server is also referred to as uMS, i.e., a micro media server. Here, the media player is a media client, which is a media client, for example, a web page for an HTML5 video tag, a camera, a TV, a Skype, a second screen, It can mean a kit (Webkit).

In the media server, management of micro resources such as a resource manager, a policy manager, and the like is a core function. In this regard, the media server also controls the playback control role for the web standard media content. In this regard, the media server may also manage pipeline controller resources.

Such a media server supports, for example, extensibility, reliability, efficient resource usage, and the like.

In other words, the uMS or media server may be a web OS device, such as a resource, such as a cloud game, a MVPD (pay service), a camera preview, a second screen, a Skype, And manage and control the use of resources for proper processing in an overall manner so as to enable efficient use. On the other hand, each resource uses, for example, a pipeline in its use, and the media server can manage and control the generation, deletion, and use of a pipeline for resource management as a whole. Here, the pipeline refers to, for example, when a media associated with a task starts a series of operations, such as parsing of a request, a decoding stream, and a video output, . For example, with respect to a TV service or an application, watching, recording, channel tuning, and the like are each individually handled under the control of resource utilization through a pipeline generated according to the request .

The processing structure and the like of the media server will be described in more detail with reference to FIG.

10, an application or service is connected to a media server 1020 via a luna-to-service bus 1010, and the media server 1020 is connected to pipelines generated again via the luna- Connected and managed.

The application or service can have various clients depending on its characteristics and can exchange data with the media server 1020 or the pipeline through it.

The client includes, for example, a uMedia client (web kit) and a RM (resource manager) client (C / C ++) for connection with the media server 1020.

The application including the uMedia client is connected to the media server 1020, as described above. More specifically, the uMedia client corresponds to, for example, a video object to be described later, and the client uses the media server 1020 for the operation of video by a request or the like. Here, the video operation relates to the video state, and the loading, unloading, play, playback, or reproduce, pause, stop, Data may be included. Each operation or state of such video can be processed through individual pipeline generation. Accordingly, the uMedia client sends the state data associated with the video operation to the pipeline manager 1022 in the media server.

The pipeline manager 1022 obtains information on resources of the current device through data communication with the resource manager 1024 and requests resource allocation corresponding to the state data of the uMedia client. At this time, the pipeline manager 1022 or the resource manager 1024 controls resource allocation through the data communication with the policy manager 1026 when necessary in connection with the resource allocation or the like. For example, when the resource manager 1024 requests or does not have resources to allocate according to the request of the pipeline manager 1022, appropriate resource allocation or the like is performed according to the request according to the priority comparison of the policy manager 1026 . On the other hand, the pipeline manager 1022 requests the media pipeline controller 1028 to generate a pipeline for an operation according to the request of the uMedia client with respect to resources allocated according to the resource allocation of the resource manager 1024 .

The media pipeline controller 1028 generates necessary pipelines under the control of the pipeline manager 1022. [ The generated pipeline can generate pipelines related to playback, pause, suspension, etc., as well as media pipelines and camera pipelines, as shown. The pipeline may include pipelines for HTML5, Web CP, smartshare playback, thumbnail extraction, NDK, Cinema, MHEG (Multimedia and Hypermedia Information Coding Experts Group), and the like.

In addition, the pipeline may include, for example, a service-based pipeline (its own pipeline) and a URI-based pipeline (media pipeline).

Referring to FIG. 10, an application or service including an RM client may not be directly connected to the media server 1020. This is because the application or service may directly process the media. In other words, if the application or service directly processes the media, it may not pass through the media server. However, at this time, uMS connectors need to manage resources for pipeline creation and use. Meanwhile, when receiving a resource management request for direct media processing of the application or service, the uMS connector communicates with the media server 1020 including the resource manager 1024. To this end, the media server 1020 also needs to have an uMS connector.

Accordingly, the application or service can respond to the request of the RM client by receiving the resource management of the resource manager 1024 through the uMS connector. These RM clients can handle services such as native CP, TV service, second screen, Flash player, YouTube Medai Source Extensions (MSE), cloud gaming, Skype. In this case, as described above, the resource manager 1024 can appropriately manage resources through data communication with the policy manager 1026 when necessary for resource management.

On the other hand, the URI-based pipeline is performed through the media server 1020 instead of processing the media directly as in the RM client described above. Such URI-based pipelines may include a player factory, a G streamer, a streaming plug-in, a DRM (Digital Rights Management) plug-in pipeline, and the like.

On the other hand, the interface method between application and media services may be as follows.

It is a way to interface with a service in a web application. This is a way of using Luna Call using the Palm Service Bridge (PSB), or using Cordova, which extends the display to video tags. In addition, there may be a method using the HTML5 standard for video tags or media elements. And, it is a method of interfacing with PDK using service. Alternatively, it is a method of using the service in the existing CP. It can be used to extend existing platform plug-ins based on Luna for backward compatibility.

Finally, it is a way to interface in the case of non-web OS. In this case, you can interface directly by calling the Luna bus.

Seamless change is handled by a separate module (for example TVWIN), which is a process for displaying the TV on the screen first and for streamlining without Web OS, to be. This is because the boot time of WebOS is delayed, so it is used to provide the basic function of the TV service first for quick response to the user's power on request. In addition, the module is part of the TV service process and supports quick boot and null change, which provides basic TV functions, and factory mode. In addition, the module may also switch from the Non-Web OS mode to the Web OS mode.

Referring to FIG. 11, a processing structure of a media server is shown.

11, the solid line box represents the process processing configuration, and the dashed box represents the internal processing module during the process. In addition, the solid line arrows represent inter-process calls, that is, Luna service calls, and the dotted arrows may represent notifications or data flows such as register / notify.

A service or a web application or a PDK application (hereinafter 'application') is connected to various service processing components via a luna-service bus, through which an application is operated or controlled.

The data processing path depends on the type of application. For example, when the application is image data related to the camera sensor, the image data is transmitted to the camera processing unit 1130 and processed. At this time, the camera processing unit 1130 processes image data of a received application including a gesture, a face detection module, and the like. Here, the camera processing unit 1130 can generate a pipeline through the media server processing unit 1110 and process the corresponding data if the user desires to use the pipeline or the like.

Alternatively, when the application includes audio data, the audio processing unit (AudioD) 1140 and the audio module (PulseAudio) 1150 can process the audio. For example, the audio processing unit 1140 processes the audio data received from the application and transmits the audio data to the audio module 1150. At this time, the audio processing unit 1140 may include an audio policy manager to determine processing of the audio data. The processed audio data is processed in the audio module 1160. Meanwhile, the application can notify the audio data processing related data to the audio module 1160, which can also perform the notification to the audio module 1160 in the associated pipeline. The audio module 1150 includes an Advanced Linux Sound Architecture (ALSA).

Alternatively, when the application includes or processes (includes) DRM-attached content, the DRM service processing unit 1170 transmits the content data to the DRM service processing unit 1160, and the DRM service processing unit 1170 generates a DRM instance And processes the DRM-enabled content data. Meanwhile, the DRM service processing unit 1160 may process the DRM pipeline in the media pipeline through the Luna-Service bus to process the DRM-applied content data.

Hereinafter, processing in the case where the application is media data or TV service data (e.g., broadcast data) will be described.

FIG. 12 shows only the media server processing unit and the TV service processing unit in FIG. 11 described above in more detail.

Therefore, the following description will be made with reference to FIGS. 11 and 12. FIG.

First, when the application includes TV service data, it is processed in the TV service processing unit 1120/1220.

The TV service processing unit 1120 includes at least one of a DVR / channel manager, a broadcasting module, a TV pipeline manager, a TV resource manager, a data broadcasting module, an audio setting module, and a path manager. 12, the TV service processing unit 1220 includes a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV MW (middleware)), a path manager, a BSP For example, NetCast). Here, the service processing unit may be a module including, for example, a TV pipeline manager, a TV resource manager, a TV policy manager, a USM connector, and the like.

In this specification, the TV service processing unit may have a configuration as shown in Fig. 11 or 12, or may be implemented by a combination of both, in which some configurations are omitted or some configurations not shown may be added.

The TV service processing unit 1120/1220 transmits the data to the DVR / channel manager in the case of DVR (Digital Video Recorder) or channel related data based on the attribute or type of the TV service data received from the application, To generate and process the TV pipeline. On the other hand, when the attribute or type of the TV service data is broadcast content data, the TV service processing unit 1120 generates and processes the TV pipeline through the TV pipeline manager for processing the corresponding data via the broadcasting module.

Alternatively, a json (JavaScript standard object notation) file or a file created in c is processed by a TV broadcast handler and transmitted to a TV pipeline manager through a TV broadcast interface to generate and process a TV pipeline. In this case, the TV broadcast interface unit may transmit the data or the file that has passed through the TV broadcast handler to the TV pipeline manager based on the TV service policy and refer to it when creating the pipeline.

Hereinafter, the processing in the TV service processing unit 1220 of FIG. 12, specifically, the process of the TV broadcast interface and below will be described in more detail.

The TV broadcast interface may also function as a controller of the TV service processing unit 1220. The TV broadcast interface requests pipeline creation to the TV pipeline manager, and the TV pipeline manager creates a TV pipeline and requests resources from the TV resource manager. The TV resource manager makes a resource request to the media server via the UMS connector and obtains it, and then returns it to the TV pipeline manager.

The TV pipeline manager arranges the returned resources in the generated TV pipeline and registers the pipeline information in the path manager. The TV pipeline manager then returns the result to the TV pipeline manager, which returns the pipeline to the TV broadcast interface.

The TV broadcast interface then communicates with the TV middleware (MW: MiddleWare) to request a channel change, and the result is returned from the TV middleware.

Through the above process, the TV service can be processed.

The TV pipeline manager can be controlled by the TV resource manager in generating one or more pipelines in response to a TV pipeline creation request from a processing module in a TV service, a manager, or the like. Meanwhile, the TV resource manager can be controlled by the TV policy manager to request the status and allocation of resources allocated for the TV service according to the TV pipeline creation request of the TV pipeline manager, and the media server processing unit 1110 / 1210) and uMS connectors. The resource manager in the media server processing unit 1110/1210 transmits the status of the current TV service, the allocation permission, etc. according to the request of the TV resource manager. For example, if a resource manager in the media server processing unit 1110/1210 confirms that all the resources for the TV service have already been allocated, the TV resource manager can notify that all the resources are currently allocated. At this time, the resource manager in the media server processing unit, together with the notify, removes a predetermined TV pipeline according to a priority or a predetermined criterion among the TV pipelines preliminarily allocated for the TV service and generates a TV pipeline for the requested TV service Or may be assigned. Alternatively, the TV resource manager can appropriately remove, add, or control the TV pipeline in the TV resource manager according to the status report of the resource manager in the media server processing unit 1110/1210.

Meanwhile, the BSP supports, for example, backward compatibility with existing digital devices.

The TV pipelines thus generated can be appropriately operated according to the control of the path manager in the process. The path manager can determine and control the processing path or process of the pipelines by considering not only the TV pipeline but also the operation of the pipeline generated by the media server processing unit 1110/1210.

Next, when the application includes media data, rather than TV service data, it is processed by the media server processing unit 1110/1210. Here, the media server processing units 1110 and 1210 include a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, and the like. On the other hand, the pipeline generated according to the control of the media pipeline manager and the media pipeline controller can be variously generated such as a camera preview pipeline, a cloud game pipeline, and a media pipeline. On the other hand, the media pipeline may include a streaming protocol, an auto / static gstreamer, and a DRM, which can be determined according to the control of the path manager. The specific processing in the media server processing units 1110 and / or 1210 cites the description of FIG. 10 described above, and will not be repeated here.

In this specification, the resource manager in the media server processing unit 1110/1210 can perform resource management with, for example, a counter base.

The media server design on the Web OS platform will be described in more detail as follows.

The media server is a media framework that supports third-party multimedia pipeline (s) to interface with the web OS platform. The media server may control, manage, isolate, deconflict, etc. the resources so that the third-party multimedia pipeline (s) may be compliant. Such a media server can be regarded as a platform module that provides a generalized API for an application to play media and can manage hardware resources and policies consistently. On the other hand, the design of the media server is in generalizing the media processing and reducing the complexity by separating related modules.

The core of such a media server is, for example, the integration of a service interface and a web OS UI. To this end, the media server controls the resource manager, the policy manager, the pipeline manager, and provides API access according to the resource manager query.

The uMS connector is the main API and SDK for interfacing client media pipeline processes with media servers. The Ums connector is an event and message about the interface. The client media pipelines implement client media pipeline state events to enable load, play, pause, seek, stop, unload, release_resource, acquire_resource, .

The uMedia API provides the C and C ++ APIs as media servers.

The media resource manager provides a method of describing the use of media hardware resources and pipeline client resources in a single simple configuration file. The media resource manager provides all the performance and information needed to implement default or third-party media policy management.

The media policy manager functions when the resource manager rejects the media pipeline due to resource conflicts. The policy manager can provide a consistent API and SDK to enable a third-party policy manager implementation. The policy manager supports media pipelines that match Least Recently Used (LRU) and may be used for one or more of the conflicted resources.

The pipeline manager tracks and maintains client media pipelines. The pipeline controller provides a consistent API to the pipeline manager to control and manage the client media pipelines.

The media server communicates with the resource manager and library calls, and the resource manager can communicate through the TV services, the media pipeline, and the Luna service bus.

The media resource manager may configure an entire configurable configuration file to disk live the media hardware and media client pipelines, detect resource conflicts, and collect all the information needed to implement the media policy management .

The media policy manager reads the policy_select and policy_action fields of the resource configuration file, the resource contention attempts to select the active pipeline described by the policy_select field, and issues a problem for outgoing / selected pipelines based on the policy_action field The issue. The selection function may be a parameter supported by a pipeline configuration setting entry. Policy actions are unload and release. All pipelines support the unload command to release all allocated resources. The pipeline can additionally support the release command to release specific resources. In the above, the release command is for fast switch pipelines that compete with common resources, and the unload command of all resources may not be required for the incoming pipeline and deconflict.

The pipeline manager manages the pipeline controller. The pipeline manager maintains a running queue of the pipeline controller and provides unique indexing for incoming messages from the application (s) via the media server.

The pipeline controller maintains the relationship of the associated media client pipeline process. The pipeline controller maintains all relevant states and provides the media client pipeline control interface to the pipeline manager. The pipeline client process is a separate process using the uMS connector to provide the control interface to the media server, and so on. Pipeline (client) media technology (Gstreamer, Stage Fright) can be completely separate and decoupled from media server management and services.

Hereinafter, a digital device according to the present invention and a service processing method in the digital device will be described in more detail.

In this specification, a method for storing contents stored according to a time shift function according to the present invention is stored in a server, a device or the like capable of data communication and is shared with one or more other devices. Here, the content includes a moving image such as a channel, a broadcast program, and still image. Hereinafter, for convenience of description, the content will be described in the present specification as a channel or a broadcast program as an embodiment. Also, according to the present invention, it is possible to quickly and conveniently access time-shift storage contents for a specific channel shared without tuning a channel through a system resource such as a tuner in a digital device. As described above, even if a system resource for time shift is occupied or a resource conflict or the like occurs during the use of the system, the present invention can reduce the dependence on the system resource, The time-shifting function is easily available at any time on the device. In addition, according to the present invention, the present invention can be applied to various modes or types of time shifts such as a sustain time shift function, a multi-channel time shift function, Can provide a further extended time shift, thereby improving the usability and product satisfaction.

With respect to the present invention, the time shift function is a function of buffering an image or a screen currently viewed by a user using the digital device, suggesting that the user can temporarily compensate the user when he / . Accordingly, the digital device according to the present invention supports a time shift function.

As described above, the use of the system resource of another digital device does not mean that the system resource is physically allocated, but merely uses (or borrows) the corresponding system resource of another digital device, . ≪ / RTI > It also includes the concept of accessing and utilizing the time-shifted stored content at the digital device via the other digital device.

Hereinafter, a service processing method in a digital device according to the present invention will be described in detail with reference to the accompanying drawings.

13 is a flowchart illustrating a service processing method in a digital device according to an embodiment of the present invention.

In step S1302, the digital device tunes a specific channel, i.e., the first channel, according to a user's request, and receives a broadcast signal including the first broadcast program.

The digital device demodulates the received broadcast signal, demultiplexes the audio, video, and SI data for the first broadcast program from the demodulated broadcast signal, and outputs the demultiplexed audio and video data to the SI data And decodes it. That is, the digital device decodes the first program data. The digital device outputs the decoded first broadcast program on the screen (S1304). At this time, the digital device stores the output first broadcast program in a time shift manner at the same time as or after the step S1304 (S1306).

After step S1306, the digital device can receive a channel change request from a user through a remote controller or the like (S1308).

The digital device tunes a corresponding channel, that is, a second channel according to the channel change request of the user, receives and decodes the broadcast signal including the second broadcast program, and outputs the decoded broadcast signal on the screen (S1310 / S1312).

In the above description, if the digital device includes a plurality of tuners, that is, a multi-tuner, the first channel and the second channel may be tuned by one tuner, that is, the same tuner, .

However, according to the present invention, the time shift storage channel or program may be a broadcast program of the first channel or channel even if the second channel is switched on the screen and outputted. In other words, while the first first channel is displayed on the screen and the time shift is stored, the time shift storage is continuously performed on the first channel even if the channel is switched according to the request of the user.

Meanwhile, when the first channel is tuned to the first tuner and the second channel is also tuned to the first tuner according to the channel change request, the time shift for the first channel is performed through the second tuner. However, with respect to the first channel, the time shift stored portion through the first tuner and the time shift stored portion through the second tuner may be stored in the same memory region.

In the above, the first broadcast program stored in the time shift storage may be stored in an external hard disk (HDD) or a server connected to the digital device. Here, the server may be any one of a service server, a mobile communication server, and a cloud server provided by the digital device manufacturer.

Meanwhile, the time shift storage may be performed on a channel basis or on a content basis of the channel. For example, when the time shift is performed on a channel-by-channel basis, the storage can be stopped or stopped according to an interrupt request such as a user request or a specific event for the channel. In the above, an interrupt such as the occurrence of a specific event may mean a resource conflict to be described later, a case where time shift data is stored in an allocated memory area or space, and the like. In the latter case, if the time shift storage is continuously performed, the previously stored time shift data should be deleted if a new area or space in the memory is allocated or a new memory is not allocated. Therefore, the time shift storage is temporarily suspended, When the storage capacity for the memory area exceeds a predetermined range, the guide data may be output to the user in advance and the user may confirm whether the time shift is continued or not. On the other hand, the time shift can be made in the content unit even within the channel, which can distinguish the content unit from the SI data or the actual audio / video data. If the content ends, the time shift can be automatically or manually stored You can use it by accepting. In the above case, as described above, guide data may be output on the screen to confirm whether to continue the time shift storage.

14 is a view for explaining a time shift setting menu according to an embodiment of the present invention.

14, the time shift setting menu 1410 according to the present invention may be configured to automatically set the time shift according to a menu request, a gesture, a voice, As shown in FIG.

On the other hand, the time-shift setting menu 1410 shown in Fig. 14 is provided as one item on a web launcher supported on the web OS platform, and is displayed on the screen as an overlay May be provided.

14, items of the time shift setting menu 1410 include an advanced time shift setting item 1420, a time shift storage space setting item 1430, resource use setting items 1440 and 1450, a peer- to-Peer use setting item 1460, a time shift file automatic update setting item 1470, and the like. However, it should be understood that the time shift setting menu items disclosed in this specification are not limited thereto, and one or more items necessary for performing the time shift function may be further included.

First, the advanced time shift setting item 1420 is for setting the time shift mode through on / off setting. The time shift mode may include a normal mode and a sustain mode. Like the conventional time shift function, the normal mode refers to a mode in which a screen viewed by a user regardless of a channel, that is, a screen provided by a digital device, is continuously followed up and stored in a time shift manner. Accordingly, when the channel is time-shifted in the first channel and the channel is switched to the second channel in the middle, the time shift is now time-shifted storage for the second channel instead of the first channel. Unlike the normal mode, the sustain mode refers to a case where the time shift function is sustained in spite of interrupts for a specific channel. That is, even if the channel is switched from the first channel to the second channel during time shift, the time shift storage is continuously performed on the first channel in the sustain mode. On the other hand, when the advanced time shift setting item 1420 is set to off in the above, the digital device operates in the normal mode, and when the advanced device is set to on, the digital device can operate in the sustain mode.

The time shift storage space setting item 1430 is for setting a position where a file to be time-shifted stored in a digital device is stored in either a normal mode or a time-shifted mode. The item 1430 may include an external storage device such as a hard disk (HDD) connected to the digital device and a server, or the like. Meanwhile, the server may include a service server, a mobile communication server, a cloud server, and the like provided by the above-described digital device manufacturer. On the other hand, the storage space of the time shift file need not necessarily be one, and a plurality of the external storage devices, servers, and the like may be set in combination.

The resource use setting items 1440 and 1450 are required to replace the limited system resources of the digital device or to use the limited resources when the system resources are insufficient or unavailable. This is for convenience in performing time shift function by allowing external resources to be used. Such use of external resources may be slightly different when using a home network or an external network. First, when it is desired to set a resource usage on a home network, a list of one or more digital devices connected to the home network and having a system resource for supporting the time shift function is output, The resource of the digital device belonging to the list can be used. On the other hand, in the case of setting a resource on a general external network, that is, on the Internet network, the on / off selection can be made. This may indicate the case of using the resource through the server described above. In other words, when the above-mentioned ON is set, system resources of other digital devices connected to the server are used through the server when the above-mentioned digital device can not use system resources. Meanwhile, the resource use setting items 1440 and 1450 may provide redundant or only one setting item. For example, in the case of duplicate setting, the setting items are first applied to the home network, but when it is not sufficient or unavailable, external resources of the Internet network can be used again. The reverse is also true. The use of an external system resource in the present specification does not directly borrow available system resources of a home network or other digital devices belonging to the Internet network but uses a time shift function in a digital device having the available system resources instead And the like. In other words, the available digital device can perform the time shift function after the guide for performing the time shift function through the server or the like even though the user does not request the time shift function to be performed. On the other hand, the use of the external system resource may include a request for performing the time shift function, as well as a request for time shift storage data stored in a server or another digital device.

The P2P usage setting item 1460 may or may not be associated with the items described above. Here, the P2P utilization refers to the time shift storage processing of the content in the P2P method in cooperation with other digital devices connected through a server or the like, rather than storing all the content in the time shift storage in the digital device at the time of performing the time shift function. As a result, the digital device can increase system resource utilization efficiency, power consumption efficiency, and the like. For example, some system resources related to performing a time shift function may continue to require system resources, but may not. In the latter case, the entire time shift function can be affected by a phenomenon such as system resource conflicts due to intermittent interrupts. Accordingly, in the interval during which the interrupt occurs through the P2P scheme, the time shift storage data of the other digital device can be used to increase the overall efficiency of the system and to meet the user's intention. Such a P2P function setting can be made overlappingly or individually with the above-described use of external resources or the like.

The time shift file automatic updating setting item 1470 is for setting whether or not the file (s) stored in the HDD / For example, when a broadcast program previously reserved by a corresponding digital device or a file that can not be time-shifted is uploaded to the server, the user can guide the list or the corresponding files and automatically download or stream the service according to the settings have.

15 and 16 are diagrams for explaining a time shift function using an external resource according to an embodiment of the present invention. FIGS. 17 to 19 are diagrams And is a flowchart showing the processing procedure.

Hereinafter, Fig. 15 to Fig. 19 show an embodiment for processing the case where the use of the system resource for performing the time shift function in the digital device is impossible, for example. Hereinafter, Figs. 15 to 19 will be described in more detail.

The digital device must secure the system resources necessary for performing the time shift function in response to the request for time shift when the content is output on the screen based on automatic or manual setting items or the like. This is because it can perform the time shift function. In other words, when the time shift request is received, the digital device determines availability of the system resource related to the time shift function.

If the system resource is available, the digital device requests allocation of the system resource and performs a time shift function based on the system resource allocated in response to the request.

On the other hand, if the system resource is not available, the digital device must respond to the time shift function execution request in any way.

Here, although the corresponding method may vary, in the present specification, a method using the external resource and a method using the P2P method will be described as an example. On the other hand, basically, when the system resource is not available, the digital device provides the guide data on the screen on the screen.

Referring to FIG. 15, a home network 1500 including a digital device 1510 and one or more digital devices is shown connected to an external server 1550. Here, the external server 1550 may be, for example, the service server, the portal server, or the cloud server described above. 15 illustrates an example in which system resources of other digital device (s) belonging to the home network 1500 are used when the digital device 1510 can not use a system resource for performing a time shift function It is.

16 illustrates a case where system resources of another digital device (s) are utilized through an external service server 1640 when the digital device 1610 can not use the system resources for performing the time shift function . At this time, FIG. 16 may include the home network 1500 of FIG. 15 described above. In FIG. 16, the description of the mobile terminal 1620 or the second digital device 1630 in the home network described above with reference to FIG. 15 and detailed description thereof is omitted. The service server 1640 ) And data communication are described in more detail. In other words, the home network system as shown in FIG. 15 may also be used in FIG. 16, which can be performed together with the contents described later.

In FIGS. 15 and 16, the server 1550 is for storing content that is time-shifted stored, and may be a configuration such as the service server 1620 mentioned in FIG. The server may store input time-shifted content in a predetermined space, and may generate and store address data for the stored space. When the server requests the time shift data stored in the digital device, the server may transmit the stored address data or service it in a streaming manner. The address data may be, for example, a URL (Uniform Resource Locator). When the digital device receives the URL data from the server, the digital device accesses the URL, downloads the stored time shift data, .

15 to 16, for example, when using a system resource of a plurality of digital devices, a time shift function may be performed according to, for example, the P2P method. At this time, the plurality of digital devices may include, for example, a corresponding digital device, that is, a digital device that requests use of system resources of other digital devices due to the inability to use system resources for performing the original time shift function.

First, referring to FIGS. 15 and 17, this will be described in more detail as follows.

When the time shift request is received, the digital device 1510 determines whether the system resource is available or not (S1702). The digital device 1510 determines whether a resource conflict occurs (S1704). If it is determined in step S1704 that the resource conflict occurs, the digital device 1510 compares the resource allocation priority of the time shift service with the service / application involved in the resource conflict generation (S1706). If it is determined in step S1706 that the resource allocation priority of the time shift service is lower than the service / application or the like, the digital device 1510 transmits the service / application and the corresponding resource (s) (Step S1708). Here, the step S1702 may be performed through at least one of the steps, and the order of determining the steps is not limited thereto. In other words, the digital device 1510 may perform step S1702 by changing the judgment order. If resource sharing is not possible in step S1708, the digital device 1510 may determine that the system resources for performing the time shift function in the device can not be used finally. However, in some cases, all or a part of the resource use determination step, that is, step S1702 may be omitted. The determination procedure in step S1702 may be changed depending on the device.

If it is determined that the system resource can not be finally used in the digital device 1510 as a result of the system resource utilization, the system resource of the other digital device in the home network 1500 of FIG. 15 can be used or borrowed.

The digital device 1510 transmits a system resource allocation or use request to one or more digital devices 1520 and 1540 belonging to the home network 1500 in operation S1810. At this time, the request transmission may be performed, for example, via a relay or gateway 1530 as occasion demands. Meanwhile, the repeater 1530 may perform necessary data conversion based on the device attribute or type of the digital device receiving the transmitted request.

The digital device 1510 parses the response data in response to the request transmission in step S1710 to receive response data regarding resource allocation from at least one digital device 1520 and 1540 in the home network, , 1540 (step S1712).

If it is determined in step S1712 that the system resource availability response is received from at least one of the digital devices 1520 and 1540 in the home network, a request to store the time shift is transmitted to the digital device in step S1714.

As a result of the determination in step S1712, if a response indicating that system resources are available from the plurality of digital devices 1520 and 1540 is received, either one of the digital devices may be selected, or a corresponding part may be provided to each digital device by a P2P method You can request a time shift save request.

Meanwhile, the digital device performing the time shift function in place of the digital device 1510 may transmit the time shift data directly to the server 1550 or may transmit the time shift data to the server 1550 ).

Next, referring to Figs. 16 and 17, more detailed description will be given below.

When the time shift request is received, the digital device 1610 determines whether or not the system resource is available (S1702). The digital device 1610 determines whether a resource conflict occurs (S1704). If it is determined in step S1704 that the resource conflict occurs, the digital device 1610 compares the resource allocation priority of the time shift service with the service / application involved in the resource conflict generation (S1706). If it is determined in step S1706 that the resource allocation priority of the time shift service is lower than that of the service / application, the digital device 1610 transmits the service / application and the corresponding resource (s) (Step S1708). Here, the step S1702 may be performed through at least one of the steps, and the order of determining the steps is not limited thereto. In other words, the digital device 1610 may perform step S1702 by changing the determination order. If resource sharing is not possible in step S1708, the digital device 1610 may determine that a system resource for performing a time shift function in the device is not available. This is the same as that described above with reference to Fig. 15, for example. However, in some cases, all or a part of the resource use determination step, that is, step S1702 may be omitted. The determination procedure in step S1702 may be changed depending on the device.

As a result of the determination as to system resource utilization, system resources of other digital devices in the home network 1500 shown in FIG. 15 may be used when the system resource is not finally available in the digital device 1610, Server 1620 can be used. The use of the home network 1500 and the service server 1620 may be performed concurrently.

The digital device 1610 transmits a system resource use request to the service server 1620 (S1710). Upon request of the digital device 1610, the service server 1620 searches the one or more connected digital devices for a digital device that can utilize the system resources for performing the time shift function according to the request. At this time, the digital device being searched includes a digital device which is time shift-stored in the time shift requested content. The service server 1620 responds with the search result to the requesting digital device 1610.

In step S1712, the digital device 1610 determines whether resource availability is available, i.e., time shift storage of the content is possible, from the response message of the service server 1620.

The digital device 1610 may be configured to send a response message from the service server 1620 to a digital device capable of allocating or utilizing system resources for performing a time shift function from at least one digital device connected to the service server 1620, If it is determined that the content exists, the service server 1620 transmits a time shift storage request for the content (S1714). Here, another digital device to which the system resource can be allocated may include, for example, a digital device belonging to the home network. In the meantime, the service server 1620 can immediately request time shift storage to the digital device available to the system resource according to the request received in the step S1714 or in the step S1710.

Thus, the content data stored in the digital device 1610 or other digital devices by time shifting can be stored in the servers 1550 and 1625.

On the other hand, as described above, when the plurality of digital devices 1630 to 1660 responds that the system resource for performing the time shift function is available, the service server 1620 transmits the content to the digital devices in a P2P manner To store the time-shifted control command. At this time, the service server 1620 may transmit the control command for the P2P method according to the determination, but may follow the request of the digital device 1610. [

18, if the digital device finally determines in step S1702 that the system can not use the system resource for performing the current time shift function in the device, the digital device stores the time shift in the server (or the service server) The content requested to be time-shifted is requested for the desired content (S1802). Here, the digital device refers to the digital device of FIG. 15 or 16.

The server confirms whether the corresponding content exists according to the time shift storage content request in step S1802 of the digital device. If the time shift content requested by the digital device exists, the server feeds the URL data stored in the digital device to the digital device. The digital device receives the requested time-shifted content based on the URL data (S1804). At this time, if the corresponding content exists in response to the request in step S1802, the server may transmit the time-shifted content to the digital device in a streaming manner instead of the URL data. If the digital device requests from a part of the time-shifted stored content, rather than the whole or the beginning part, it may provide it from that part as well.

In step S1804, the digital device decodes the received time-shifted content and outputs the decoded time-shifted content on the screen. At this time, the output may be outputted through the PIP screen instead of the main screen.

Meanwhile, the above-described FIG. 18 may be performed during or after the process of FIG. 17, or may be performed in place of FIG.

FIG. 19 is similar to FIG. 18. For example, if the current time shift function is performed in the digital device but the service / application of the digital device is not able to utilize the system resource any more as in step S1702 It may be that the process is shown.

If the digital device is no longer able to use the corresponding system resource in step S1702, the digital device transmits a request to the server to confirm whether there is a digital device performing a time-shift function for the corresponding content in another digital device connected to the server (S1902).

In response to the request of S1902, the server confirms the presence or absence of the digital device being time-shifted stored in the corresponding content, and responds the confirmation result to the corresponding digital device.

If the digital device is storing the time shift in another digital device according to the response of the server, the digital device outputs the fact that the digital device has stopped the time shift storage and stops storing the time shift (S1904). In the above, the time shift storage interruption can be continued without interruption depending on the user's choice, despite the response of the server. In this case, execution of another service / application requesting system resources is suspended.

If the digital device stops storing the time shift in step S1904, the digital device transmits a link request of the time shift storage content to the server in step S1906. At this time, in step S1906, the digital device may transmit only the contents of the interruption part to the server so that only the contents of the interruption part can be discerned.

On the other hand, the digital device may store time-shifted content in the server in the normal mode instead of the sustain time shift mode. However, in this case, when the digital device requests the time-shifted stored content, the server refers to the content stored in the time-shifted storage in the other digital device, and transmits the whole content including the portion not stored in the time- , The digital device can receive and process the entire content.

On the other hand, the server can update the data on the time-shifted storage content periodically / non-periodically, even if there is no request from the digital device, for a digital device that is at least once time shifted or is performing a time shift function . The updated data may be actual content data, or may be guide data for a time shift state or the like.

FIG. 20 is a flowchart illustrating a time shift content output method according to an embodiment of the present invention, and FIG. 21 is a flowchart illustrating a method of processing an automatic time shift according to an embodiment of the present invention.

Referring to FIG. 20, when a digital device requests time-shifted stored content from a server, the digital device outputs the requested time-shifted content, and can select a digital device to output the content.

The digital device outputs a list of digital devices capable of outputting time shift data on the screen (S2002). At this time, the list may be limited to digital devices in the home network, for example.

The digital device selects the time shift data output device (S2004), and controls transmission and output of the time shift data to the selected digital device (S2006).

The selected digital device may receive the time shift data directly from the server without going through the device.

The digital device may output time shift data together with the output on the screen of the digital device, regardless of the device selected as the output device.

21, when the digital device tunes and services one channel according to a request of the user or when the digital device is turned on, the setting of the user, the frequency of use of the user, and the channel / And at least one of attributes (S2102).

The digital device automatically determines whether the time shift function is activated based on the collected data (S2104).

If it is determined in step S2104 that the time shift function is automatically activated, the digital device determines whether the system resource is available for performing the time shift function in step S2106.

If the system resource is available as a result of the determination in step S2106, the digital device automatically stores the content in a time shift storage and stores the time shift in the server (S2108).

The digital device may provide the guide data on the screen in advance in step S2108, and may start the time shift function according to the user's selection.

On the other hand, the digital device may receive data including a list of contents being time-shifted stored in the server from the server, and output the received data to the screen.

22 to 34 are diagrams for explaining a UI / UX scene related to advanced time shift data processing according to an embodiment of the present invention.

22 to 34 described below provide data for the status, accessibility, and the like for the channel currently being watched in the current channel, that is, the sustain channel, according to the advanced time shift function according to the present invention, Gt; UI / UX < / RTI >

FIG. 22 illustrates a PIP scheme, for example. Referring to FIG. 22A, one time shift data 2222 for a sustain channel is provided in a predetermined area in a screen 2210 for a viewing channel in a PIP manner, and FIG. 22B is a view for providing a plurality of time shift data 2222, 2224, 2226) at the same time.

The time shift data provided by the PIP method may be a thumbnail image of a corresponding sustain channel screen, that is, a still image or a moving image. For example, since one PIP screen is provided in FIG. 22A, in this case, the time-shifted contents may be provided as a moving image after the user switches the channel, or a moving image for live broadcasting may be provided.

In this specification, an area, a screen, and the like described in a moving image in the present specification are used when a user places a pointer on a remote controller, hovering, or the like, and controls the moving image data such as time- A replay bar is provided to help the user ' s ease of use. The playback bar may provide various time data such as start time and end time of moving picture data. On the other hand, for a still image, a button for switching an image is output to a predetermined area in the still image area similar to the above-described playback bar, thereby providing convenience of image switching and selection of the user. The still image may be automatically switched at predetermined time intervals. In addition, in the case of selecting time shift data, the time shift channel data can be provided to the main screen in a housewife switching manner without a separate channel switching request. The selection may include gesture (including drag and drop) or selection through a menu item depending on the position, hovering, etc. of the pointer.

22A and 22B, the size and position of the PIP window for time shift data may be changed according to the setting of the user, or may be arbitrarily changed according to the request of the user.

When a plurality of time shift data 2222, 2224, and 2226 are provided at the same time as shown in FIG. 22B, each data may be provided based on, for example, a timeline of the corresponding sustain channel. In a similar manner, each window of FIG. 22B may be divided and driven by dividing the time-shifted data according to the number of windows. The time shift data processing method of FIG. 23 is similar to that of FIG. 22B described above. However, if FIG. 22B is a PIP scheme, as shown in FIG. 23, it is provided in a manner similar to a launcher, which is a home menu provided in a web OS platform, rather than a PIP scheme. This difference makes a difference, for example, in the request for the time shift data for the sustain channel provided on the current screen, the processing method, and the like. 23, a screen 2310 for the current viewing channel is provided on the main screen, and time shifted data 2332, 2334, 2336, and 2338 provided overlaid are provided on a time line basis 2322 and 2324 It is provided aligned at the bottom of the screen. The user can access the time shift data in the left / right direction or the like through the remote controller to view and select the time shift data of the more various time lines.

Hereinafter, FIGS. 24 to 28 also disclose how to process time shift data on the launcher screen provided by the Web OS platform, respectively.

Referring to FIG. 24, if there is a request through a user's remote controller while a broadcast image or the like is being output on the screen, the digital device overlaid the web launcher over the broadcast image or the like that is being output.

The web launcher is one of the menu screens of the digital device, and arranges and accesses the recency items and various application items so that they are intuitively recognizable.

If the sustain channel, i.e., the time shift channel, is accessible through the recency entry. Here, if the channel immediately before the current viewing channel is a time shift channel, the latest image of the time shift channel may be captured and provided on the recency item 2410 as shown in FIG. However, if the time shift channel is not the immediately previous channel, that is, if a plurality of other channels are switched after the time shift channel, a capture screen of the channel immediately before the current viewing channel (not the time shift channel) Item. However, even in this case, the time shift channel can be accessed by separately accessing the recency item. However, the recency item generally captures the broadcast video image immediately before the channel change, and the subsequent broadcast video image is not known. Accordingly, in the present invention, when the advanced time shift mode is operated, the time shift channel is preferentially given to the recency item and the corresponding data is provided. At this time, although provided on the recency item in some cases, unlike the conventional recency item, the time shift data may be continuously updated or may be provided not only as a still image but also as a moving image. In this case, the conventional recall item data can be accessed and accessed in the same manner as in the conventional method according to the selection. At this time, the time shift data can be processed so as to be able to identify that the corresponding data is time shift data in order to indicate that it is different from general recall data.

25, in the above-described FIG. 24 described above, if the corresponding time shift data 2410 is selected by access, that is, by a pointer located or hovering or by a user's voice or gesture, 2512, 2514, and 2516 may be provided on the upper portion thereof. The time shift association data 2512, 2514, and 2516 may be a timeline-based thumbnail image or a moving image. Alternatively, the time shift association data 2512, 2514, and 2516 may be data received from an external device such as a server in association with the time shift data. At this time, the data may be audio, video, and text data received from a broadcasting station providing the corresponding channel. Alternatively, if the server is a web service server such as a portal server, it may be a web page. In addition, the data may be implemented in a form in which the data described above are combined or mixed with each other. At this time, the time shift data 2410 may be implemented as still image or moving image data. Further, as described above, it is also possible to switch the playback bar or the main part when the corresponding area is accessed.

26 is a flowchart illustrating a method of providing a web launcher in a web launcher according to an exemplary embodiment of the present invention. Accessible. At this time, the time shift data 2610 may be embodied as still image or moving image data, and may further include a playback bar and a playback icon for playback control, as shown in FIG.

27 shows a scene providing association data 2712, 2714, and 2716 when the corresponding time shift data 2610 is accessed in a manner similar to FIG. 25 to FIG. The structure, implementation, and the like of the association data 2712, 2714, and 2716 are greatly different from those described above with reference to FIG.

FIG. 28 shows a case where a plurality of time shift data (2610 and 2810) are implemented in the form of a web application as shown in FIG.

The plurality of time shift data 2610 and 2810 may be time shift data for different sustain channels or time shift data for one sustain channel, for example. In the former case, the system resource of a digital device such as a tuner can be made within a usable range. The usable range also includes a case where resource sharing for system resources is possible. In the latter case, the time shift data is divided and implemented for the convenience of the user based on the time line.

On the other hand, in the case of Figs. 26 to 28, when the advanced time shift mode is set or operated in the digital device, the structure or item arrangement of the web launcher can be changed. In other words, the time shift data can be prioritized and processed so as to be accessible on the first screen of the called web launcher so that the time shift data can be recognized more easily and intuitively.

The various time shift data structures implemented in these Figures 22-28 automatically align and implement and provide in digital devices.

Hereinafter, Figs. 29 to 34 may be guide data provision for the implementation of the operation preceding or following Figs. 22 to 28 described above.

Referring to FIG. 29, when the base station game is being watched while the base station game is being played, when the channel is switched according to commercial broadcasting or the like, it is notified that the commercial is ended in the time-shifted channel and the game is started or restarted, And provides guide data 2910 related to switching and the like.

To this end, the controller of the digital device reads out data stored in the time shift channel in the time shift channel periodically or non-periodically from the memory, analyzes the read time shift data to determine whether the commercial broadcasting is finished, Data 2910 may be provided. Alternatively, the controller can parse the SI data provided from the server, such as a broadcasting station, to identify the end of commercial broadcasting based on the parsed SI data, and provide the guide data 2910 based thereon. This can be equally applied in connection with time shift data in the present specification. 30 to 34, which will be described later, guide data for time shift data can be provided in the above manner.

FIG. 30 may be the same as FIG. 29 described above, and guide data 3010 for reminding the user that there is a time shift channel at a predetermined period and providing convenience such as channel switching, . At this time, the channel change guide data 3010 may include not only time shift data but also a channel change guide for directly watching live broadcast.

FIG. 31 is an example of providing guide data 3110 about whether to set time shift for the current viewing channel in the case of switching to a time shift channel or another channel.

At this time, the guide data 3110 may be provided only in the time shift channel, for example, in addition to the current viewing channel, when the resources capable of performing the time shift function are sufficient. Alternatively, the guide data 3110 may be provided when the time shift function of the time shift channel is to be deactivated or turned off and to be time-shifted with respect to the current viewing channel.

Fig. 32 shows guide data 3210 for a scene for providing screen division. For example, the user may be provided with guide data 3210 for viewing the current channel and time shift channel simultaneously. In this case, when the screen is not divided, the digital device can divide the screen into two, three, or the like. In the case where the screen is not divided, it is possible to further guide whether or not to switch the channel as described above. In the case of dividing the screen, it is possible to provide two, three or four divisions depending on the number of time shift channels. In this case, the first divided screen is the current viewing screen, the second divided screen is the time-shifted channel screen, and the third divided screen, etc. May provide other services or application execution or associated data for the viewing channel or time shift channel. Alternatively, after the second division, divided data based on a time line of one time shift channel may be provided separately on each divided screen.

33, similar to FIG. 30, provides the guide data 3310 for switching to the live broadcast of the time shift channel, rather than accessing the time shift stored data with respect to the time shift channel.

34 shows that the advanced time shift mode can function as a content unit even in a channel even if it is set in the channel. On the basis of this, when the content started to store the first time shift is finally ended, Is an example of guide data 3410 about whether to save or end. In this case, if there is already set contents, the guide data 3410 may not be provided.

In addition, although not shown, when the time shift should be stopped or terminated according to a resource allocation or an execution request of an application having a high usage priority or a high usage priority according to an interrupt or the like during a time shift, have.

29 to 34, guide data for channel switching, screen division, and the like are illustrated, but it is also possible to provide guide data related to various functions that can be provided in a digital device. These functions can be various functions such as capture function, persistent storage function, and viewing reservation function.

35 is an example for providing the EPG data when the user requests the EPG or the like, while allowing the data to be processed during the time shift processing, the processing end, or the future to be identifiable. 35 is applicable to a channel browser, a favorite channel, other recording or time shift list in addition to the EPG, and can be processed to be distinguishable among time shift data. The attribute may mean, during the processing, end of processing, scheduled to be processed in the future, or the like.

The above-described FIGS. 22 to 35 can be made based on, for example, SI data for a broadcast program provided by a broadcasting station or a related server.

According to the present invention, the content stored according to the time shift function can be stored in a server or a device capable of data communication and can be shared with one or more other devices, and the time- So that it is possible to quickly and conveniently access the time-shift storage contents even if the corresponding channel is not tuned. Further, it is possible to reduce the dependence on the system resources such as the occupation of the system resources or the resource conflict for the time shift, Function can be utilized, and the time shift such as the sustain time shift function and the multi-channel time shift function can be expanded more functionally than the conventional one, and the convenience of use and the satisfaction of the product can be improved.

The digital device according to the present invention and the method for processing a service in the digital device can be applied to the configuration and method of the embodiments described above in a limited manner, All or some of them may be selectively combined.

Meanwhile, the operation method of the digital device of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the digital device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

201: network interface unit 202: TCP / IP manager
203: service delivery manager 204: SI decoder
205: Demultiplexer 206: Audio decoder
207: Video decoder 208:
209: Service Control Manager 210: Service Discovery Manager
211: SI & Metadata Database 212: Metadata Manager
213: service manager 214: UI manager

Claims (36)

A method of processing data in a digital device,
Tuning a first channel to receive a broadcast signal including content;
Decoding content from the broadcast signal;
Outputting the decoded content;
Storing the output content in a time shift manner;
Receiving a channel switching request; And
And tuning a second channel according to the switching request to receive and output a broadcast signal including the content,
Wherein the time shift stored content is stored in a server. The method according to claim 1,
Wherein the first channel and the second channel are connected to each other via a communication line,
Wherein the tuner is tuned through the same or another tuner. The method according to claim 1,
The server, in which the time-shifted content is stored,
A mobile communication server, and a cloud server provided by the digital device manufacturer. The method according to claim 1,
The time-
Wherein the time shift storage means stops the time shift storage when the content is finished. The method according to claim 1,
The time shift storage of the output content may include:
(Peer-to-Peer) method on all or a part of the output content based on at least one of the resource usage status of the digital device and the time shift storage of the corresponding content of the server Wherein the data processing method comprises: The method according to claim 1,
Receiving a time shift request; And
Further comprising the step of determining whether the system resource is available or not according to the time shift request. The method according to claim 6,
And when the system resource is not available as a result of the system resource availability determination, the system resource of another digital device connectable via the network is used. The method according to claim 6,
Requesting a content corresponding to the time shift request to the server;
Receiving the requested content from the server; And
And outputting the received time-shifted content on a screen. The method according to claim 6,
Transmitting, to the server, a request to confirm presence of another digital device being stored in the time shift for the content;
Stopping the time shift storage for the content if the other device exists;
Outputting the time shift storage interruption on the screen; And
And transmitting to the server a time-shift storage interruption and a content link request for a time-shifted portion stored in the digital device and a time-shifted portion stored by another digital device after the interruption. . 9. The method of claim 8,
The content received from the server,
Receiving a URL (Uniform Resource Locator) in which the content is time-shifted stored from the server, and accessing the URL to receive the content in a download or streaming manner. The method according to claim 6,
Transmitting a system resource use request to another digital device belonging to the home network and connectable thereto; And
Further comprising the step of transmitting a system resource use request to the server when it is difficult to use system resources of another digital device belonging to the home network and connectable thereto. 12. The method of claim 11,
The server comprises:
And transmits a time shift storage request for the content to one or more other digital devices belonging to the server in response to the system resource allocation request of the digital device. The method according to claim 1,
Receiving a request for viewing a time-shift storage content from a user; And
And receiving the content from the server upon receipt of the viewing request and outputting the received content. 14. The method of claim 13,
The content to be received and output,
Wherein the time shift in the digital device is executed in a normal mode and the entire content is received from the server even if the corresponding content is not time-shifted. The method according to claim 1,
Receiving time shift data for the content from the server; And
And outputting the received time shift data on a screen. The method according to claim 1,
Outputting a digital device list in a home network capable of outputting the time shift data;
Selecting a predetermined digital device from the list of digital devices in the output home network; And
And transmitting the time shift data to the selected digital device so as to output the time shift data. The method according to claim 1,
Determining whether to activate the time shift function automatically based on at least one of a setting of a user, a frequency of use of a user, and an attribute of a content;
Determining whether a system resource can be allocated for executing the time shift function if it is determined that the time shift function is activated; And
And outputting guide data on a screen according to a result of the resource allocation availability determination. The method according to claim 1,
Receiving data including a list of contents to be time-shifted stored from the server; And
And outputting the received data on a screen. In a digital device,
A broadcast receiver for tuning a first channel and receiving broadcast signals including content;
A decoder for decoding content from the broadcast signal;
An output unit for outputting the decoded content;
A user interface unit for receiving a channel switching request; And
And a controller for controlling the output of the content to be time-shifted and for tuning a second channel according to the switching request to receive and output a broadcast signal including the content, To the server. 20. The method of claim 19,
Wherein the first channel and the second channel are connected to each other via a communication line,
The tuner being tuned through the same or another tuner. 20. The method of claim 19,
The server, in which the time-shifted content is stored,
Wherein the digital device is one of a service server, a mobile communication server, and a cloud server provided by the digital device manufacturer. 20. The method of claim 19,
Wherein,
Controls the time shift in the content unit of the channel, and stops the time shift storage when the content is terminated. 20. The method of claim 19,
Wherein,
The content to be output is output in a peer-to-peer manner to all or a part of the output content based on at least one of the resource usage status of the digital device and the time shift storage of the corresponding content of the server And stores the time-shift data. 20. The method of claim 19,
The user interface unit receives the time shift request,
Wherein the controller determines whether or not to use the system resource according to the time shift request. 25. The method of claim 24,
Wherein,
And when the system resource is not available as a result of the system resource availability determination, requests use of system resources of another digital device connectable through the network. 25. The method of claim 24,
Wherein,
Requests the content corresponding to the time shift request to the server, and when the requested content is received from the server, controls to output the received time-shifted content on the screen. 25. The method of claim 24,
Wherein,
The control unit controls the server to transmit a request for confirming presence of another digital device that is time shifted to store the content, and stops the time shift storage of the content when the other device exists, And transmits to the server a content link request for a portion of the time shift storage interruption and a time shift storage portion of the digital device and a time shift storage portion of the digital device after the interruption, . 27. The method of claim 26,
The content received from the server,
Receives a URL (Uniform Resource Locator) in which the content is time-shifted from the server, and accesses the URL to receive the content in a downloading or streaming manner. 25. The method of claim 24,
Wherein,
And transmits a system resource use request to another digital device belonging to the home network and connectable to the home network and transmits a system resource use request to the server when it is difficult to use system resources of other connectable digital devices belonging to the home network A digital device characterized by. 30. The method of claim 29,
The server comprises:
And transmits a time shift storage request for the content to one or more other digital devices belonging to the server in response to the system resource allocation request of the digital device. 20. The method of claim 19,
Wherein,
And when receiving the viewing request of the time shift storage content from the user, receiving the viewing request and receiving the content from the server in response to the viewing request. 32. The method of claim 31,
The content to be received and output,
Wherein the time shift in the digital device is performed in a normal mode and the entire content is received from the server even if the corresponding content is not time-shifted. 20. The method of claim 19,
Receiving time shift data for the content from the server; And
And outputting the received time shift data on a screen. 20. The method of claim 19,
Wherein,
Generating a list of digital devices in the home network capable of outputting the time shift data, selecting a predetermined digital device from the digital device list in the output home network, transmitting the time shift data to the selected digital device, So as to control the operation of the digital device. 20. The method of claim 19,
Wherein,
Wherein the control unit determines whether to activate the time shift function automatically based on at least one of the setting of the user, the frequency of use of the user, and the attribute of the content. If it is determined that the time shift function is activated, Determines whether or not the resource allocation can be performed, and controls to output guide data on a screen according to a result of the resource allocation availability determination. 20. The method of claim 19,
Wherein,
And controls to output the received data on a screen when receiving data including a list of content to be stored in the time shift storage from the server.

Images