KR102443319B1 - Digital device and method for controlling the same - Google Patents

Abstract

The present invention discloses a digital device and a method for controlling the same. The digital device according to an embodiment of the present invention outputs a memory, an input interface for receiving a first application execution request, a menu display request, and menu item selection signals for a music application in the menu, and the first application execution screen Control to display on the sub screen, control to display the menu on the first application execution screen according to the menu display request, and control to display the menu on the first application execution screen according to the menu item selection signal for the music application a control unit for controlling the display of the first version of the music player, switching the first version of the music player to the second version of the music player according to a preset condition, and continuously displaying the first version of the music player on the first application execution screen; and an output unit, wherein the control unit controls such that a music file is played and audio data of the music file is output while the first version and the second version music player are provided.

Description

Digital device and its control method

The present invention relates to a digital device, and more particularly, to a technology for processing application data in a digital device equipped with a Web OS (Web OS) platform.

Following a standing device such as a personal computer (PC) and a television (TV), the development of a mobile device such as a smart phone and a tablet PC is dazzling. Fixed devices and mobile devices have been developed separately from each other in their respective domains, but their domains are becoming obscure with the recent boom in digital convergence.

In addition, with the development or environment change of such digital devices, the level of the user's eye level is also increasing, and there are many requests for supporting various and high-spec services or applications.

Unlike the application environment used in the conventional OS (Operation System), in the Web OS (Web OS), most contents exist in a host system of a remote service provider. Accordingly, the digital device equipped with the webOS must access the host system of the service provider located in the remote location each time in order to use the application. This has a problem in that it is inconvenient to use an application after the initial operation as well as an initial operation, for example, system booting, according to power-on of the digital device. For example, if there is a problem in the network environment or there is a constraint on system resources, it may cause inconvenience in booting the system or using the application.

In particular, the development of a solution for multi-tasking in a digital device has not been made quickly. For example, there is a problem in that a service for processing an audio file such as a music file together with a TV signal is not properly provided in a digital device other than an audio-only device.

The present invention has been devised to solve the above situation or problems, and it is an object of the present invention to provide a method for processing music file(s) that can be accessed through various paths in a digital device equipped with a webOS.

Another object of the present invention is to provide a method for using a music file on a digital device more easily and conveniently in the process of using one or more applications.

Another object of the present invention is to provide a user's convenience in using a music file by configuring and providing various user interfaces related to the use of a music application in a digital device.

Another object of the present invention is to inspire product satisfaction by maximizing users' convenience in using digital devices by providing diversity and convenience such as access, editing, and use of music files on digital devices.

The technical problems to be achieved in the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. .

Various embodiment(s) of a digital device and a control method thereof are disclosed herein.

The digital device according to an embodiment of the present invention outputs a memory, an input interface unit for receiving a first application execution request, a menu display request, and menu item selection signals for a music application in the menu, and the first application execution screen Control to display on the sub screen, control to display the menu on the first application execution screen according to the menu display request, and control to display the menu on the first application execution screen according to the menu item selection signal for the music application a control unit for controlling the display of the first version of the music player, switching the first version of the music player to the second version of the music player according to a preset condition, and continuously displaying the first version of the music player on the first application execution screen; and an output unit, wherein the control unit controls such that a music file is played and audio data of the music file is output while the first version and the second version music player are provided.

A method of controlling a digital device according to an embodiment of the present invention includes: displaying a first application execution screen on a screen; receiving a menu display request; displaying a menu on the first application execution screen; receiving a selection of a menu item for a music application from the displayed menu; displaying a first version of the music player on the first application execution screen according to the selection of the music application menu item; and according to a preset condition and converting the first version of the music player into the second version of the music player and continuously displaying the first version of the music player on the first application execution screen. Here, while the first version and the second version music player are provided, a music file is played and audio data of the music file is output.

The technical solutions obtainable in the present invention are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the art to which the present invention belongs from the description below. can be understood

The effects of the present invention are as follows.

According to one of the various embodiments of the present invention, there is an effect that a digital device equipped with a webOS can process music file(s) accessible through various paths.

According to another of various embodiments of the present invention, there is an effect that a music file can be used more easily and conveniently in the process of using one or more applications on a digital device.

According to another exemplary embodiment of the present invention, various user interfaces related to the use of a music application in a digital device are configured and provided to provide the user with convenience in using music files.

According to another embodiment of the various embodiments of the present invention, there is an effect of enhancing product satisfaction by maximizing the user's convenience in using a digital device by providing diversity and convenience such as access, editing, and use of music files on a digital device. .

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a diagram schematically illustrating a service system including a digital device according to an embodiment of the present invention;
2 is a block diagram illustrating a digital device according to an embodiment of the present invention;
3 is a block diagram illustrating a digital device according to another embodiment of the present invention;
4 is a block diagram illustrating a digital device according to another embodiment of the present invention;
5 is a block diagram illustrating the detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention;
6 is a view showing an input means connected to the digital device of FIGS. 2 to 4 according to an embodiment of the present invention;
7 is a diagram illustrating a webOS architecture according to an embodiment of the present invention;
8 is a diagram illustrating an architecture of a webOS device according to an embodiment of the present invention;
9 is a diagram illustrating a graphic composition flow in a webOS device according to an embodiment of the present invention;
10 is a diagram illustrating a media server according to an embodiment of the present invention;
11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention;
12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention;
13 is a diagram illustrating a detailed configuration module of a digital device related to the use of a music file according to an embodiment of the present invention;
14 and 15 are diagrams for explaining a method of reproducing audio data in a digital device according to an embodiment of the present invention;
16 to 20 are diagrams illustrating a list of music applications provided by a digital device according to an embodiment of the present invention;
21 is a diagram illustrating a method of searching for, using, etc. music files provided by a digital device according to another embodiment of the present invention;
22 to 23 are diagrams for explaining the use of a music application list and a music player according to an embodiment of the present invention;
24 to 27 are diagrams for explaining a music player according to an embodiment of the present invention, and
28 and 29 are flowcharts illustrating a method of using or reproducing a music file in a digital device according to the present invention.

Hereinafter, various embodiment(s) of a digital device and a method for processing application data in the digital device according to the present invention will be described in detail with reference to the drawings.

The suffixes "module", "part", etc. for the components used in this specification are given only in consideration of the ease of writing the specification, and both may be used interchangeably as necessary. In addition, even if it is described as an ordinal number such as "first-", "second-", etc., it is only for convenience of explanation of the term rather than meaning an order, and is not limited to such terms or ordinal numbers.

In addition, the terms used in the present specification are also selected as currently widely used general terms as possible in consideration of the function according to the technical idea of the present invention. may vary. However, in certain cases, there are terms arbitrarily selected by the applicant, but the meaning will be described in the related description. Therefore, it is clear that the term should be interpreted based on the actual meaning it has and the content described throughout this specification, not just the name.

On the other hand, the content described in this specification or / and drawings, as a preferred embodiment according to the present invention is not limited thereto, and the scope of the rights should be determined through the claims.

Hereinafter, the term “digital device” as used herein refers to, for example, transmitting, receiving, processing and outputting data, content, service, and application. Includes any device that does at least one or more. The digital device is capable of pairing or connecting (hereinafter referred to as 'pairing') with another digital device, an external server, and the like through a wire/wireless network, and transmits predetermined data through it. Can send/receive. In this case, if necessary, the data may be appropriately converted before transmission/reception. The digital device includes, for example, a network TV (Network TV), a Hybrid Broadcast Broadband TV (HBBTV), a smart TV (Smart TV), an Internet Protocol TV (IPTV), a standing device such as a Personal Computer (PC), etc. and a mobile device or handheld device such as a personal digital assistant (PDA), a smart phone, a tablet PC, a notebook, and the like. In the present specification, a digital TV (Digital TV) is illustrated in FIG. 2 and a mobile device is illustrated and described as an embodiment of a digital device in FIG. In addition, the digital device described in this specification may be a configuration having only a panel, a configuration such as a set-top box (STB), a device, a system, and the like, and may be a SET configuration. .

Meanwhile, the term “wired/wireless network” described in this specification refers to a communication network supporting various communication standards or protocols for pairing and/or data transmission/reception between digital devices or a digital device and an external server. These wired/wireless networks include all communication networks to be supported now or in the future according to the standard, and all of one or more communication protocols for it can be supported. Such wired / wireless networks include, for example, Universal Serial Bus (USB), Composite Video Banking Sync (CVBS), Component, S-Video (analog), Digital Visual Interface (DVI), High Definition Multimedia Interface (HDMI), Network for wired connection such as RGB and D-SUB, and communication standards and protocols for them, Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA: Infrared Data Association), UWB (Ultra Wideband), Zigbee (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE/LTE -A (Long Term Evolution/LTE-Advanced) or Wi-Fi Direct may be formed by a network for wireless connection and a communication standard or protocol for the same.

In addition, in the present specification, when only a digital device is named, the meaning may mean a fixed device or a mobile device depending on the context, and unless otherwise specified, it may be used in a meaning including both.

On the other hand, the digital device is an intelligent device that supports, for example, a broadcast reception function, a computer function or support, and at least one external input. , banking, games, applications, etc. may be supported. In addition, the digital device may include an interface for supporting at least one input or control means, such as a handwritten input device, a touch-screen, and a spatial remote controller.

In addition, the digital device may use a standardized general-purpose operating system (OS), but in particular, the digital device described in this specification uses a webOS as an embodiment. Therefore, the digital device can handle adding, deleting, amending, updating, etc. of various services or applications on the general-purpose OS kernel or Linux kernel. It is possible, and through it, a more user-friendly environment can be configured and provided.

On the other hand, the above-mentioned digital device may receive and process an external input. At this time, the external input is connected to the external input device, that is, the digital device described above through a wired/wireless network, and transmits/receives data to/from all processes that can be processed. input means or a digital device. For example, as the external input, a high-definition multimedia interface (HDMI), a game device such as a playstation or an X-box, a smartphone, a tablet PC, or a pocket photo (pocket) photo) and the like, and digital devices such as a printing device, a smart TV, and a Blu-ray device.

In addition, the term “server” as used herein refers to a digital device or system that supplies data to or receives data from the above-mentioned digital device, that is, a client, and is also referred to as a processor. do. To the server, for example, a web server or a portal server that provides a web page, a web content or a web service, or a web server that provides advertising data Advertising server, content server providing content, SNS server providing social network service (SNS), service server provided by a manufacturer, Video on Demand (VoD) or MVPD (Multichannel Video Programming Distributor) for providing a streaming service, a service server providing a pay service, etc. may be included.

In addition, in the present specification, even when only the application is described for convenience of description, the meaning may include not only the application but also the service based on the context thereof. Also, the application may mean a web application according to a webOS platform.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating a service system including a digital device according to an embodiment of the present invention.

Referring to FIG. 1 , the service system includes a content provider 10 , a service provider 20 , a network provider 30 and a Home Network End User (HNED). (Customer) (40). Here, the HNED 40 includes, for example, the client 100, that is, a digital device according to the present invention.

The content provider 10 produces and provides various types of content. As shown in FIG. 1, such a content provider 10 as a terrestrial broadcast transmitter, a cable broadcast operator (cable SO (System Operator)) or MSO (Multiple SO), a satellite broadcast transmitter, various Internet broadcast transmitters, personal content providers, etc. may be exemplified. Meanwhile, the content provider 10 may produce and provide various services or applications in addition to broadcast content.

The service provider 20 service-packages the content produced by the content provider 10 and provides it to the HNED 40 . For example, the service provider 20 packages at least one of the contents produced by the first terrestrial broadcast, the second terrestrial broadcast, cable MSO, satellite broadcast, various Internet broadcasts, applications, etc. for a service, and the HNED (40) is provided.

The service provider 20 provides a service to the client 100 in a uni-cast or multi-cast method. Meanwhile, the service provider 20 may transmit data to a plurality of pre-registered clients 100 at once. For this purpose, an Internet Group Management Protocol (IGMP) protocol or the like may be used.

The above-described content provider 10 and service provider 20 may be the same entity. For example, the service provider 20 may also perform the function of the service provider 20 by packaging the content produced by the content provider 10 and providing it to the HNED 40 , or vice versa.

The network provider 30 provides a network for exchanging data between the content provider 10 or/and the service provider 20 and the client 100 .

The client 100, as a consumer belonging to the HNED 40, receives data by, for example, building a home network through the network provider 30, and receives data related to various services or applications such as VoD and streaming. can also be sent/received.

Meanwhile, the content provider 10 and/or the service provider 20 in the service system may use conditional access or content protection means to protect transmitted content. Accordingly, the client 100 may use a processing means such as a CableCARD (or POD: Point of Deployment), DCAS (Downloadable CAS), etc. in response to the conditional access or content protection.

In addition, the client 100 may also use an interactive service through a network. Accordingly, the client 100 may rather perform the role or function of the content provider, and the service provider 20 may receive it and transmit it to another client or the like.

In FIG. 1 , the content provider 10 and/or the service provider 20 may be a server that provides a service to be described later in this specification. In this case, the server may mean owning or including the network provider 30 as needed. Hereinafter, even if not specifically mentioned, the service or service data includes an internal service or application as well as an external service or application received from the above, and these services or applications are webOS (Web OS)-based services for the client 100 . or application data.

2 is a block diagram illustrating a digital device according to an embodiment of the present invention.

The digital device according to an embodiment of the present invention outputs a memory, an input interface unit for receiving a first application execution request, a menu display request, and menu item selection signals for a music application in the menu, and the first application execution screen Control to display on the sub screen, control to display the menu on the first application execution screen according to the menu display request, and control to display the menu on the first application execution screen according to the menu item selection signal for the music application a control unit for controlling the display of the first version of the music player, switching the first version of the music player to the second version of the music player according to a preset condition, and continuously displaying the first version of the music player on the first application execution screen; and an output unit, wherein the control unit controls such that a music file is played and audio data of the music file is output while the first version and the second version music player are provided.

Hereinafter, the digital device described herein corresponds to the client 100 of FIG. 1 described above.

The digital device 200 includes a network interface 201 , a TCP/IP manager 202 , a service delivery manager 203 , an SI decoder 204 , Demultiplexer (demux or demultiplexer) 205, audio decoder (audio decoder) 206, video decoder (video decoder) 207, display unit (display A/V and OSD module) 208, service control manager (service control manager) 209, service discovery manager (210), SI & metadata database (SI&metadata DB) (211), metadata manager (metadata manager) (212), service manager (213), It is configured to include a UI manager 214 and the like.

The network interface unit 201 provides an IP packet(s) (Internet Protocol(IP) packet(s)) or IP datagram(s) (IP datagram(s)) (hereinafter referred to as IP packet(s) )) is transmitted/received. For example, the network interface unit 201 may receive a service, application, content, etc. from the service provider 20 of FIG. 1 through a network network.

The TCP/IP manager 202, for IP packets received to the digital device 200 and IP packets transmitted from the digital device 200, that is, packet transfer between a source (source) and a destination (destination) ( involved in packet delivery). The TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205 , the service discovery manager 210 , the service control manager 209 , and the metadata manager 212 . ) and output the classified packet(s).

The service delivery manager 203 is responsible for controlling the received service data. For example, the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data. When the real-time streaming data is transmitted using RTP, the service delivery manager 203 parses the received data packet according to the RTP and transmits it to the demultiplexer 205 or the control of the service manager 213 according to the SI&metadata database 211. Then, the service delivery manager 203 feeds back the network reception information to the server that provides the service using RTCP.

The demultiplexer 205 demultiplexes the received packet into audio, video, SI (System Information) data, and the like, and transmits it to the audio/video decoders 206/207 and the SI decoder 204, respectively.

The SI decoder 204 includes demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting-Service Information (DVB-SI), and Digital Television Terrestrial Multimedia (DTMB/CMMB). It decodes service information such as Broadcasting/Coding Mobile Multimedia Broadcasting). Also, the SI decoder 204 may store the decoded service information in the SI&metadata database 211 . The stored service information may be read and used according to a corresponding configuration according to a user's request, for example.

The audio/video decoder 206/207 decodes each demultiplexed audio data and video data. The decoded audio data and video data are provided to the user through the display unit 208 .

The application manager includes, for example, a UI manager 214 and a service manager 213 and may perform a control function of the digital device 200 . In other words, the application manager may manage the overall state of the digital device 200 , provide a user interface (UI), and manage other managers.

The UI manager 214 provides a graphical user interface (GUI)/UI for a user using an on screen display (OSD), etc., receives a key input from the user, and performs a device operation according to the input. For example, when receiving a key input for channel selection from the user, the UI manager 214 transmits the key input signal to the service manager 213 .

The service manager 213 controls a manager associated with a service, such as the service delivery manager 203 , the service discovery manager 210 , the service control manager 209 , and the metadata manager 212 .

Also, the service manager 213 generates a channel map and controls selection of a channel using the generated channel map according to a key input received from the UI manager 214 . The service manager 213 receives service information from the SI decoder 204 and sets an audio/video PID (Packet Identifier) of the selected channel in the demultiplexer 205 . The PID set in this way may be used in the above-described demultiplexing process. Accordingly, the demultiplexer 205 filters (PID or section filtering) audio data, video data, and SI data using the PID.

The service discovery manager 210 provides information necessary for selecting a service provider that provides a service. When receiving a channel selection signal from the service manager 213 , the service discovery manager 210 uses the information to find a service.

The service control manager 209 is in charge of service selection and control. For example, the service control manager 209 uses IGMP or RTSP when the user selects a live broadcasting service such as the existing broadcasting method, and selects a service such as VOD (Video on Demand). RTSP is used to select and control services. The RTSP protocol may provide a trick mode for real-time streaming. Also, the service control manager 209 may initialize and manage a session through the IMS gateway 250 using an IP Multimedia Subsystem (IMS) or a Session Initiation Protocol (SIP). The above protocols are only an example, and other protocols may be used according to implementation examples.

The metadata manager 212 manages metadata associated with a service and stores the metadata in the SI&metadata database 211 .

The SI&metadata database 211 stores service information decoded by the SI decoder 204, metadata managed by the metadata manager 212, and information necessary for selecting a service provider provided by the service discovery manager 210. Save. In addition, the SI&metadata database 211 may store set-up data for the system, and the like.

The SI&metadata database 211 may be implemented using a non-volatile memory (NVRAM), a flash memory, or the like.

On the other hand, the IMS gateway 250 is a gateway that collects functions necessary to access an IMS-based IPTV service.

3 is a block diagram illustrating a digital device according to another embodiment of the present invention.

While the above-described FIG. 2 illustrates a fixed device as an example of a digital device, FIG. 3 illustrates a mobile device as another example of a digital device.

Referring to FIG. 3 , the mobile device 300 includes a wireless communication unit 310 , an audio/video (A/V) input unit 320 , a user input unit 330 , a sensing unit 340 , an output unit 350 , It may include a memory 360 , an interface unit 370 , a control unit 380 , and a power supply unit 390 .

Hereinafter, each component will be described in detail as follows.

The wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and the wireless communication system or between the mobile device and a network in which the mobile device is located. For example, the wireless communication unit 310 may include a broadcast reception module 311 , a mobile communication module 312 , a wireless Internet module 313 , a short-range communication module 314 , and a location information module 315 . .

The broadcast reception module 311 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives a previously generated broadcast signal and/or broadcast-related information and transmits the received broadcast signal and/or broadcast-related information to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312 .

Broadcast-related information may exist in various forms, for example, in the form of an Electronic Program Guide (EPG) or an Electronic Service Guide (ESG).

The broadcast receiving module 311 is, for example, ATSC, Digital Video Broadcasting-Terrestrial (DVB-T), DVB-S (Satellite), MediaFLO (Media Forward Link Only), DVB-H (Handheld), ISDB-T ( A digital broadcast signal can be received using a digital broadcast system such as Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 311 may be configured to be suitable for other broadcast systems as well as the aforementioned digital broadcast system.

The broadcast signal and/or broadcast related information received through the broadcast reception module 311 may be stored in the memory 360 .

The mobile communication module 312 transmits/receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of a voice signal, a video call signal, or a text/multimedia message.

The wireless Internet module 313 may be built-in or external to the mobile device 300 , including a module for wireless Internet access. As wireless Internet technologies, wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used.

The short-range communication module 314 refers to a module for short-range communication. Bluetooth, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, RS-232, RS-485, etc. will be used as short range communication technologies. can

The location information module 315 is a module for obtaining location information of the mobile device 300 , and may be a global positioning system (GPS) module as an example.

The A/V input unit 320 is for inputting audio and/or video signals, and may include a camera 321 , a microphone 322 , and the like. The camera 321 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 351 .

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310 . Two or more cameras 321 may be provided according to the use environment.

The microphone 322 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 312 in the call mode and output. Various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 322 .

The user input unit 330 generates input data for the user to control the operation of the terminal. The user input unit 330 may include a key pad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 340 detects the current state of the mobile device 300, such as the open/closed state of the mobile device 300, the position of the mobile device 300, the presence or absence of user contact, the orientation of the mobile device, and acceleration/deceleration of the mobile device. It detects and generates a sensing signal for controlling the operation of the mobile device 300 . For example, when the mobile device 300 is moved or tilted, the position or tilt of the mobile device may be sensed. In addition, whether the power supply unit 390 is supplied with power, whether the interface unit 370 is coupled to an external device may also be sensed. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including near field communication (NFC) or the like.

The output unit 350 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 351 , a sound output module 352 , an alarm unit 353 , and a haptic module 354 , etc. have.

The display unit 351 displays (outputs) information processed by the mobile device 300 . For example, when the mobile device is in a call mode, a UI or GUI related to a call is displayed. When the mobile device 300 is in the video call mode or the photographing mode, the photographed and/or received image, UI, and GUI are displayed.

The display unit 351 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( flexible display) and at least one of a three-dimensional display.

Some of these displays may be of a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is a TOLED (Transparant OLED). The rear structure of the display unit 351 may also be configured as a light-transmitting structure. With this structure, the user can see an object located at the rear of the terminal body through the area occupied by the display unit 351 of the terminal body.

Two or more display units 351 may exist according to an implementation form of the mobile device 300 . For example, in the mobile device 300 , a plurality of display units may be spaced apart or disposed integrally on one surface, or may be respectively disposed on different surfaces.

When the display unit 351 and the sensor for sensing a touch operation (hereinafter, referred to as a 'touch sensor') form a layered structure (hereinafter referred to as a 'touch screen'), the display unit 351 is an input device other than an output device. It can also be used as a device. The touch sensor may have the form of, for example, a touch film, a touch sheet, and a touch pad.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 351 or a change in capacitance occurring in a specific portion of the display unit 351 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of the touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 380 . Accordingly, the control unit 380 can know which area of the display unit 351 has been touched, and the like.

The proximity sensor 341 may be disposed in an inner region of the mobile device covered by the touch screen or in the vicinity of the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. Proximity sensors have a longer lifespan than contact sensors and their utility is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is of a capacitive type, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of bringing the pointer closer to the touch screen without making contact so that the pointer is recognized as being positioned on the touch screen is referred to as a “proximity touch”, and the touch The act of actually touching the pointer on the screen is called "contact touch". The position at which a proximity touch is performed by the pointer on the touch screen means a position at which the pointer vertically corresponds to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 352 may output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 352 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile device 300 . The sound output module 352 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event in the mobile device 300 . Examples of events generated in the mobile device include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 353 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal may also be output through the display unit 351 or the audio output module 352 , so that they 351 and 352 may be classified as a part of the alarm unit 353 .

The haptic module 354 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 354 is vibration. The intensity and pattern of vibration generated by the haptic module 354 are controllable. For example, different vibrations may be synthesized and output or may be output sequentially. In addition to vibration, the haptic module 354 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, an electrostatic force, etc. Various tactile effects can be generated, such as an effect caused by heat absorption and an effect by reproducing a feeling of cold/warm using an element capable of absorbing heat or generating heat. The haptic module 354 may not only transmit the tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sensation such as a finger or arm. Two or more haptic modules 354 may be provided according to a configuration aspect of the mobile device 300 .

The memory 360 may store a program for the operation of the controller 380 and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving image, etc.). The memory 360 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

Memory 360 is a flash memory type (flash memory type), hard disk type (hard disk type), multimedia card micro type (multimedia card micro type), card type memory (for example, SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, It may include at least one type of storage medium among a magnetic disk and an optical disk. The mobile device 300 may operate in relation to a web storage that performs a storage function of the memory 360 on the Internet.

The interface unit 370 serves as a passage with all external devices connected to the mobile device 300 . The interface unit 370 receives data from an external device, receives power and transmits it to each component inside the mobile device 300 , or allows data inside the mobile device 300 to be transmitted to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video I/O port, an earphone port, etc. may be included in the interface unit 370 .

The identification module is a chip storing various information for authenticating the usage right of the mobile device 300 , and includes a User Identify Module (UIM), a Subscriber Identify Module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 200 through the port.

The interface unit 370, when the mobile device 300 is connected to an external cradle, is a passage through which power from the cradle is supplied to the mobile device 300, or various types of input from the cradle by the user. It may be a path through which a command signal is transmitted to the mobile device. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.

The controller 380 generally controls the overall operation of the mobile device 300 . The controller 380 performs related control and processing for, for example, a voice call, data communication, video call, and the like. The controller 380 may include a multimedia module 381 for playing multimedia. The multimedia module 381 may be implemented within the control unit 380 or may be implemented separately from the control unit 380 . The controller 380 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch-screen as characters and images, respectively.

The power supply unit 390 receives external power and internal power under the control of the control unit 380 to supply power required for operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and other electrical units for performing functions. These may be implemented by the controller 380 itself.

According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented as a software application written in a suitable programming language. Here, the software code may be stored in the memory 360 and executed by the controller 380 .

4 is a block diagram illustrating a digital device according to another embodiment of the present invention.

Another example of the digital device 400 is a broadcast receiving unit 405 , an external device interface unit 435 , a storage unit 440 , a user input interface unit 450 , a control unit 470 , a display unit 480 , and audio It may include an output unit 485, a power supply unit 490, and a photographing unit (not shown). Here, the broadcast receiving unit 405 may include at least one tuner 410 , a demodulator 420 , and a network interface unit 430 . However, in some cases, the broadcast receiving unit 405 may include the tuner 410 and the demodulator 420 but not the network interface unit 430 , and vice versa. In addition, although not shown, the broadcast receiving unit 405 includes a multiplexer and a signal demodulated by the demodulator 420 through the tuner 410 and a signal received through the network interface unit 430 . can also be multiplexed. In addition, although not shown, the broadcast receiving unit 425 includes a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal that has passed through the network interface unit 430. can

The tuner 410 receives an RF broadcast signal by tuning a channel selected by a user or all channels previously stored among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 410 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner 410 may process both a digital broadcast signal and an analog broadcast signal. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 410 may be directly input to the controller 470 .

Also, the tuner 410 may receive an RF broadcast signal of a single carrier or a multiple carrier. Meanwhile, the tuner 410 sequentially tunes and receives the RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna, and receives them as an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). frequency or baseband signal).

The demodulator 420 may receive and demodulate the digital IF signal DIF converted by the tuner 410 , and may perform channel decoding and the like. To this end, the demodulator 420 includes a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. - A Solomon decoder, etc. may be provided.

The demodulator 420 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal in which an image signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like are multiplexed.

The stream signal output from the demodulator 420 may be input to the controller 470 . The controller 470 may control demultiplexing, image/audio signal processing, and the like, and may control output of an image through the display unit 480 and audio through the audio output unit 485 .

The external device interface unit 435 provides an interface environment between the digital device 300 and various external devices. To this end, the external device interface unit 335 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

External device interface unit 435, DVD (Digital Versatile Disk), Blu-ray (Blu-ray), game device, camera, camcorder (Camcorder), computer (laptop), tablet PC, smart phone, Bluetooth device (Bluetooth) device) and an external device such as a cloud, and the like, may be connected by wire/wireless. The external device interface unit 435 transmits a signal including data such as an image, video, and voice input through a connected external device to the controller 470 of the digital device. The controller 470 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 435 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), It may include a Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit may perform short-range wireless communication with another digital device. The digital device 400 includes, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance (DLNA). It may be network-connected to other digital devices according to a communication protocol such as .

Also, the external device interface unit 435 may be connected to the set-top-box STB through at least one of the above-described various terminals to perform input/output operations with the set-top-box STB.

Meanwhile, the external device interface unit 435 may receive an application or an application list in an adjacent external device and transmit it to the controller 470 or the storage unit 440 .

The network interface unit 430 provides an interface for connecting the digital device 400 to a wired/wireless network including an Internet network. The network interface unit 430 may include, for example, an Ethernet (Ethernet) terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi- Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. may be used.

The network interface unit 430 may transmit or receive data with another user or another digital device through the connected network or another network linked to the connected network. In particular, some content data stored in the digital device 400 may be transmitted to a selected user or a selected digital device among other users or other digital devices previously registered in the digital device 400 .

Meanwhile, the network interface unit 430 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server. In addition, content or data provided by a content provider or network operator may be received. That is, content such as movies, advertisements, games, VODs, broadcast signals, etc. and information related thereto may be received from a content provider or a network provider through a network. In addition, it is possible to receive firmware update information and an update file provided by a network operator. It may also transmit data to the Internet or to a content provider or network operator.

Also, the network interface unit 430 may select and receive a desired application from among applications opened through a network.

The storage unit 440 may store a program for each signal processing and control in the control unit 470 , or may store a signal-processed image, audio, or data signal.

Also, the storage unit 440 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 435 or the network interface unit 430 . The storage unit 440 may store information about a predetermined broadcast channel through a channel storage function.

The storage unit 440 may store an application or an application list input from the external device interface unit 435 or the network interface unit 330 .

Also, the storage unit 440 may store various platforms to be described later.

The storage unit 440 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg, SD or XD). memory, etc.), a RAM (RAM), and a ROM (EEPROM, etc.) may include at least one type of storage medium. The digital device 400 may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the storage unit 440 and provide them to the user.

4 shows an embodiment in which the storage unit 440 is provided separately from the control unit 470, the present invention is not limited thereto. In other words, the storage unit 440 may be included in the control unit 470 .

The user input interface unit 450 transmits a signal input by the user to the control unit 470 or transmits a signal of the control unit 470 to the user.

For example, the user input interface unit 450 controls power on/off, channel selection, screen setting, etc. from the remote control device 500 according to various communication methods such as an RF communication method and an infrared (IR) communication method. The signal may be received and processed, or a control signal of the control unit 470 may be transmitted to the remote control device 500 .

Also, the user input interface unit 450 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 470 .

The user input interface unit 450 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 470 or transmits a signal of the control unit 470 to the sensing unit (not shown) can be transmitted. Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The controller 470 demultiplexes a stream input through the tuner 410, the demodulator 420, or the external device interface unit 435 or processes the demultiplexed signals to generate a signal for video or audio output. and output.

The image signal processed by the controller 470 may be input to the display unit 480 and displayed as an image corresponding to the image signal. Also, the image signal processed by the controller 470 may be input to an external output device through the external device interface unit 435 .

The audio signal processed by the control unit 470 may be audio output to the audio output unit 485 . Also, the audio signal processed by the controller 470 may be input to an external output device through the external device interface unit 435 .

Although not shown in FIG. 4 , the controller 470 may include a demultiplexer, an image processor, and the like.

The controller 470 may control the overall operation of the digital device 400 . For example, the controller 470 may control the tuner 410 to tune an RF broadcast corresponding to a channel selected by the user or a pre-stored channel.

The control unit 470 may control the digital device 400 according to a user command input through the user input interface unit 450 or an internal program. In particular, by accessing the network, a user may download a desired application or an application list into the digital device 400 .

For example, the controller 470 controls the tuner 410 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface 450 . And it processes the video, audio or data signal of the selected channel. The control unit 470 allows the channel information selected by the user to be output through the display unit 480 or the audio output unit 485 together with the processed image or audio signal.

As another example, the control unit 470 may be configured to receive an external device image playback command received through the user input interface unit 450 from an external device input through the external device interface unit 435, for example, a camera or a camcorder. , an image signal or an audio signal may be output through the display unit 480 or the audio output unit 485 .

Meanwhile, the controller 470 may control the display 480 to display an image. For example, a broadcast image input through the tuner 410, an external input image input through the external device interface unit 435, an image input through the network interface unit, or an image stored in the storage unit 440 , can be controlled to be displayed on the display unit 480 . In this case, the image displayed on the display unit 480 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the controller 470 may control to reproduce the content. In this case, the content may be content stored in the digital device 400 , received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, when entering the application view item, the controller 470 may control to display an application or an application list downloadable from an internal or external network of the digital device 300 .

The controller 470 may control to install and drive an application downloaded from an external network together with various user interfaces. In addition, by the user's selection, an image related to an executed application may be controlled to be displayed on the display unit 480 .

Meanwhile, although not shown in the drawings, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided.

The channel browsing processing unit receives the stream signal TS output from the demodulator 320 or the stream signal output from the external device interface 335, and extracts an image from the input stream signal to generate a thumbnail image. can The generated thumbnail image may be input to the controller 470 as it is or after being encoded. Also, the generated thumbnail image may be encoded in a stream form and input to the controller 470 . The controller 470 may display a thumbnail list including a plurality of thumbnail images on the display 480 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 480 converts the image signal, the data signal, the OSD signal processed by the control unit 470, or the image signal and the data signal received from the external device interface unit 435 into R, G, and B signals, respectively. generate a drive signal.

The display unit 480 may be a PDP, LCD, OLED, flexible display, or 3D display.

Meanwhile, the display unit 480 may be configured as a touch screen and used as an input device in addition to an output device.

The audio output unit 485 receives a signal processed by the control unit 470, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 485 may be implemented with various types of speakers.

Meanwhile, in order to detect a user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the digital device 400 . . The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 3470 through the user input interface unit 450 .

Meanwhile, a photographing unit (not shown) for photographing the user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 470 .

The controller 470 may detect a user's gesture by individually or in combination with an image captured by a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

The power supply unit 490 supplies the corresponding power to the digital device 400 as a whole.

In particular, to supply power to the control unit 470 that can be implemented in the form of a system on chip (SoC), the display unit 480 for displaying an image, and the audio output unit 485 for outputting audio. can

To this end, the power supply unit 490 may include a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit 480 is implemented as a liquid crystal panel including a plurality of backlight lamps, an inverter capable of Pulse Width Modulation (PWM) operation for luminance variable or dimming driving (inverter) (not shown) may be further provided.

The remote control device 500 transmits a user input to the user input interface unit 450 . To this end, the remote control device 500 may use Bluetooth (Bluetooth), Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the remote control device 500 may receive an image, audio, or data signal output from the user input interface unit 450 , and display it on the remote control device 500 or output voice or vibration.

The above-described digital device 400 may be a digital broadcast receiver capable of processing a digital broadcast signal of a fixed or mobile ATSC method or a DVB method.

In addition, the digital device according to the present invention may omit some of the illustrated components as needed, or may further include non-illustrated components. On the other hand, unlike the above, the digital device does not include a tuner and a demodulator, and may receive and reproduce content through a network interface unit or an external device interface unit.

5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention.

An example of the controller includes a demultiplexer 510 , an image processor 5520 , an OSD generator 540 , a mixer 550 , a frame rate converter (FRC) 555 , and A formatter 560 may be included. In addition, although not shown, the control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 510 demultiplexes an input stream. For example, the demultiplexer 510 may demultiplex the input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 510 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit 420 performs image processing on the demultiplexed image signal. To this end, the image processing unit 420 may include an image decoder 425 and a scaler 435 .

The image decoder 425 decodes the demultiplexed image signal, and the scaler 435 scales the resolution of the decoded image signal to be output on the display unit.

The video decoder 525 may support various standards. For example, the video decoder 525 performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and when the video signal is encoded in the DMB (Digital Multimedia Broadcasting) method or the H.264 standard. In this case, the function of the H.264 decoder may be performed.

Meanwhile, the image signal decoded by the image processing unit 520 is input to the mixer 450 .

The OSD generator 540 generates OSD data according to a user input or by itself. For example, the OSD generating unit 440 generates data for displaying various data in the form of graphics or text on the screen of the display unit 380 based on the control signal of the user input interface unit. The generated OSD data includes various data such as a user interface screen of a digital device, various menu screens, widgets, icons, and viewing rate information. The OSD generator 540 may generate data for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 550 mixes the OSD data generated by the OSD generator 540 and the image signal processed by the image processor and provides them to the formatter 560 . Since the decoded image signal and the OSD data are mixed, the OSD is overlaid and displayed on the broadcast image or the external input image.

The frame rate converter (FRC) 555 converts a frame rate of an input image. For example, the frame rate converter 555 may convert a frame rate of an input 60Hz image to have a frame rate of, for example, 120Hz or 240Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when the frame rate converter 555 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or the first frame predicted from the first frame and the second frame It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate converter 555 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when a separate frame conversion is not performed, the frame rate conversion unit 555 may be bypassed.

The formatter 560 changes the output of the input frame rate converter 555 to match the output format of the display unit. For example, the formatter 560 may output R, G, and B data signals, and these R, G, and B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. can be In addition, when the output of the input frame rate converter 555 is a 3D video signal, the formatter 560 may support the 3D service through the display unit by configuring the output in 3D form to match the output format of the display unit.

Meanwhile, the voice processing unit (not shown) in the control unit may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing of various audio formats. As an example, even when the audio signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, it can be processed with a corresponding decoder.

In addition, the voice processing unit (not shown) in the control unit may process a base (Base), a treble (Treble), volume control, and the like.

A data processing unit (not shown) in the control unit may perform data processing of the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program aired on each channel.

Meanwhile, the above-described digital device is an example according to the present invention, and each component may be integrated, added, or omitted according to specifications of a digital device that is actually implemented. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, the function performed in each block is for explaining an embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention.

Meanwhile, the digital device may be an image signal processing device that performs signal processing of an image stored in the device or an input image. As another example of the image signal processing device, the set-top box (STB) in which the display unit 480 and the audio output unit 485 shown in FIG. 4 are excluded, the above-described DVD player, Blu-ray player, game device, computer and the like can be further exemplified.

6 is a diagram illustrating an input means connected to the digital device of FIGS. 2 to 4 according to an embodiment of the present invention.

A front panel (not shown) or a control means (input means) provided on the digital device 600 is used to control the digital device 600 .

On the other hand, the control means is a user interface device (UID; User Interface Device) capable of wired and wireless communication, mainly implemented for the purpose of controlling the digital device 600, the remote control 610, the keyboard 630, the pointing device 620, A touch-pad or the like is included, but a control means exclusively for external input connected to the digital device 600 may also be included. In addition, the control means includes a mobile device such as a smart phone or a tablet PC that controls the digital device 600 through mode switching, etc., not for the purpose of controlling the digital device 600 . However, in the present specification, a pointing device is described as an example for convenience, but is not limited thereto.

The input means are communication protocols such as Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA), UWB (Ultra Wideband), ZigBee, DLNA (Digital Living Network Alliance), RS, etc. can communicate with a digital device by employing at least one or more as necessary.

The remote control 610 refers to a general input means provided with various key buttons necessary for controlling the digital device 600 .

The pointing device 620 is equipped with a gyro sensor to implement a pointer corresponding to the screen of the digital device 600 based on the user's movement, pressure, rotation, etc. ) to transmit a predetermined control command. The pointing device 620 may be named by various names, such as a magic remote control and a magic controller.

The keyboard 630, as the digital device 600 provides various services such as a web browser, an application, and a social network service (SNS) as an intelligent integrated digital device beyond the conventional broadcasting only, the control is possible only with the conventional remote control 610. It was not easy, so it was implemented to improve the convenience of inputting text, etc. by implementing it similar to the keyboard of a PC.

On the other hand, the control means such as the remote control 610, the pointing device 620, the keyboard 630 is provided with a touchpad if necessary, so that text input, pointer movement, enlargement/reduction of pictures or videos, etc. for more convenient and various control purposes is available for

The digital device described in this specification uses a webOS as an OS and/or a platform. Hereinafter, the webOS-based configuration or processing process such as an algorithm may be performed in the control unit of the digital device, etc. described above. Here, the control unit is used in a broad sense including the control unit in FIGS. 2 to 5 described above. Therefore, hereinafter, for the processing of webOS-based or related services, applications, and contents in a digital device, hardware or components including related software and firmware are referred to as a controller. Name and explain.

Such a webOS-based platform is, for example, to improve development independence and function scalability by integrating services and applications based on the Luna-service bus, and application development based on the web application framework. It can also increase productivity. In addition, it is possible to support multi-tasking by efficiently utilizing system resources and the like through webOS processes and resource management.

On the other hand, the webOS platform described in this specification can be used not only in fixed devices such as PCs, TVs, and set-top boxes (STBs), but also in mobile devices such as mobile phones, smart phones, tablet PCs, notebooks, and wearable devices. .

The software structure for digital devices is a monolithic structure that is dependent on conventional problem solving and the market. A single process and a closed product based on multi-threading technology. There were difficulties in external applications, and after that, we pursued new platform-based development, and pursued cost innovation through chip-set replacement and efficiency in UI application and external application development, leading to layering & componentization. ) was formed to have a three-layered structure, add-on, single source product, and add-on structure for open application. In recent years, the software structure has been further developed to provide a modular architecture of functional units, a Web Open API (Application Programming Interface) for the eco-system, and a game engine for the game engine. A modular design for a native open API, etc. is being made, and accordingly, a multi-process structure based on a service structure is created.

7 is a diagram illustrating a webOS architecture according to an embodiment of the present invention.

Referring to FIG. 7 , the architecture of the webOS platform will be described as follows.

The platform can be largely divided into a kernel, a system library-based WebOS core platform, an application, a service, and the like.

The architecture of the webOS platform is a layered structure, with the OS at the lowest layer, system library(s) at the next layer, and applications at the top.

First, the lowest layer may include Linux as an OS of the digital device by including a Linux kernel as an OS layer.

Above the OS layer, BSP (Board Support Package) / HAL (Hardware Abstraction Layer) layer, WebOS core module layer (Web OS core modules layer), service layer (service layer), Luna-service bus layer (Luna-Service) Bus layer), Anyo framework/NDK (Native Developer's Kit)/QT layer (Enyo framework/NDK/QT layer), and an application layer at the top layer sequentially exist.

On the other hand, some layers of the above-described webOS layer structure may be omitted, and a plurality of layers may be formed into one layer or, conversely, one layer may become a plurality of layer structures.

The webOS core module layer is based on LSM (Luna Surface Manager) that manages the surface window, etc., SAM (System & Application Manage) that manages the execution and execution status of applications, and WebKit (WebKit) Thus, it may include a Web Application Manager (WAM) that manages web applications and the like.

The LSM manages an application window displayed on the screen. The LSM manages the display hardware (Display HW), provides a buffer capable of rendering necessary content to applications, and synthesizes the results rendered by a plurality of applications on the screen. can be printed out.

The SAM manages execution policies for various conditions of systems and applications.

On the other hand, WAM, webOS can view a web application (Web App) as a basic application, it is based on the Enyo Framework (Enyo Framework).

The service use of the application is made through the Luna-service bus, a new service can be registered on the bus, and the application can find and use the service it needs.

The service layer may include services of various service levels, such as a TV service and a WebOS service. Meanwhile, the webOS service may include a media server, Node.JS, and the like. In particular, the Node.JS service supports, for example, JavaScript.

A webOS service can communicate through a bus to a Linux process that implements function logic. This can be largely divided into four parts, the TV process and services that are migrated from the TV process and the existing TV to the webOS or are manufacturer-differentiated services, webOS common services and JavaScript developed and used through Node.js It consists of Node.js services.

The application layer may include all applications supported by a digital device, such as a TV application, a showcase application, a native application, and a web application.

An application on the webOS may be classified into a web application, a Palm Development Kit (PDK) application, a Qt Meta Language or Qt Modeling Language (QML) application, and the like according to an implementation method.

The web application is based on a WebKit engine, and is executed on a WAM runtime. Such a web application may be developed and executed based on the Anyo framework, or based on general HTML5, Cascading Style Sheets (CSS), or JavaScript.

The PDK application includes, for example, a native application developed in C/C++ based on a PDK provided for a third-party or external developer. The PDK refers to a set of development libraries and tools provided so that a third party such as a game can develop a native application (C/C++). For example, a PDK application may be used to develop an application whose performance is important.

The QML application is a Qt-based native application, and includes a basic application provided with the webOS platform, such as a card view, a home dashboard, and a virtual keyboard. Here, QML is a mark-up language in the form of a script instead of C++.

Meanwhile, in the above, the native application refers to an application developed in C/C++, compiled, and executed in a binary form, and such a native application has an advantage in that the execution speed is fast.

8 is a diagram illustrating an architecture of a webOS device according to an embodiment of the present invention.

8 is a block diagram based on a runtime of a webOS device, which may be understood with reference to the layered structure of FIG. 7 .

Hereinafter, it will be described with reference to FIGS. 7 and 8 .

Referring to FIG. 8 , services, applications, and webOS core modules are included on the system OS (Linux) and system libraries, and communication between them may be made through a Luna-service bus.

Node.js services based on HTML5, CSS, java script, such as e-mail, contact, calendar, Logging, backup, file notify), database (DB), activity manager (activity manager), system policy (system policy), audio daemon (AudioD: Audio Daemon), update (update), webOS services such as media server (media server), EPG TV services such as (Electronic Program Guide), PVR (Personal Video Recorder), data broadcasting, voice recognition, Now on, Notification, search CP services such as , ACR (Auto Content Recognition), CBOX (Contents List Broswer), wfdd, DMR, Remote Application, download, SDPIF (Sony Philips Digital Interface Format), PDK applications, browser Native applications such as , QML applications, and UI-related TV applications and web applications based on the Anyo framework are processed through webOS core modules such as SAM, WAM, and LSM as described above through the Luna-service bus. Meanwhile, in the above, TV applications and web applications may not necessarily be Anyo framework-based or UI related.

The CBOX can manage a list and metadata of contents of external devices such as USB, DLNA, and cloud connected to the TV. On the other hand, the CBOX may output a content listing of various content containers such as USB, DMS, DVR, cloud, etc. as an integrated view. In addition, the CBOX may display various types of content listings, such as pictures, music, and videos, and manage the metadata. In addition, the CBOX may output the content of the attached storage device in real-time. For example, the CBOX should be able to immediately output a content list of the storage device when a storage device such as USB is plugged in. In this case, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate various connection protocols.

SAM is intended to improve module complexity and enhance scalability. For example, the existing system manager handles various functions such as system UI, window management, web application runtime, and UX constraint processing in one process, and the implementation complexity is high, so to solve the problem, the main functions are separated and functions It lowers the implementation complexity by clarifying the interface between them.

LSM supports independent development and integration of system UX implementations such as card view and launcher, and supports easy response to changes in product requirements. On the other hand, LSM enables multi-tasking by maximizing hardware resources when synthesizing a plurality of application screens such as App-on-App. It is possible to provide a window management mechanism for

LSM supports the implementation of the system UI based on QML and improves the development productivity. Based on MVC, QML UX can easily compose views of screen layouts and UI components, and can easily develop codes for handling user input. On the other hand, the interface between QML and the webOS component is made through the QML extension plug-in, and the graphic operation of the application can be based on wayland protocol, luna-service call, etc. have.

As described above, LSM is an abbreviation of Luna Surface Manager, and functions as an application window compositor.

LSM composes and outputs independently developed applications and UI components on the screen. In relation to this, when components such as a Recents application, a showcase application, and a launcher application each render their own content, the LSM defines an output area, an interworking method, etc. as a compositor. In other words, the LSM, which is a compositor, processes graphic composition, focus management, input events, and the like. In this case, the LSM receives an event, focus, etc. from an input manager, and the input manager may include a remote controller, HID such as a mouse & keyboard, a joystick, a game pad, an application remote, a pen touch, and the like.

As such, the LSM supports a multiple window model, which can be executed simultaneously in all applications due to the nature of the system UI. In this regard, launcher, request, setting, notification, system keyboard, volume UI, search, finger gesture, voice recognition (STT (Sound to Text), TTS (Text to) Sound), NLP (Natural Language Processing), etc.), pattern gestures (camera, MRCU (Mobile Radio Control Unit)), Live menu, ACR (Auto Content Recognition), etc. can be supported by LSM .

9 is a diagram illustrating a graphic composition flow in a webOS device according to an embodiment of the present invention.

Referring to FIG. 9 , the graphic composition processing includes a web application manager 910 in charge of a UI process, a webkit 920 in charge of a web process, an LSM 930 and a graphic manager (GM: Graphic Manager) This can be done through 940 .

When web application-based graphic data (or application) is generated as a UI process in the web application manager 910 , if the generated graphic data is not a full-screen application, it is transmitted to the LSM 930 . On the other hand, the web application manager 910 receives the application generated by the web kit 920 for sharing a GPU (Graphic Processing Unit) memory for graphic management between the UI process and the web process, and uses the full-screen If it is not an application, it is transferred to the LSM 930 . In the case of a full-screen application, the LSM 930 may be bypassed, and in this case, it may be directly transferred to the graphic manager 940 .

The LSM 930 transmits the received UI application to the Wayland Compositor via the Wayland surface, and the Wayland Compositor processes it appropriately and delivers it to the graphic manager. In this way, the graphic data transmitted from the LSM 930 is transmitted to the graphic manager compositor through the LSM GM surface of the graphic manager 940, for example.

On the other hand, as described above, the full-screen application is directly transferred to the graphic manager 940 without going through the LSM 930, and this application is processed in the graphic manager compositor through the WAM GM surface.

The graphic manager processes all graphic data in the webOS device. In addition to the data passed through the LSM GM surface and the data passed through the WAM GM surface, GM surface such as data broadcasting application, caption application, etc. It receives all the graphic data that have passed through the , and processes it so that it is properly output on the screen. Here, the function of the GM compositor is the same as or similar to that of the above-described compositor.

FIG. 10 is a diagram illustrating a media server according to an embodiment of the present invention, FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.

The media server supports the execution of various multimedia in the digital device and manages necessary resources. The media server may efficiently use hardware resources required for media play. For example, the media server requires audio/video hardware resources to execute multimedia, and can efficiently utilize the resource by managing the resource usage status. In general, a fixed device having a larger screen than a mobile device requires more hardware resources when performing multimedia, and the encoding/decoding and graphic data transfer speed must be fast due to a large amount of data. On the other hand, in addition to streaming and file-based playback, the media server performs broadcasting, recording, and tuning tasks, recording simultaneously with viewing, or simultaneously showing the sender and receiver screens during a video call. You should be able to handle it. However, in the media server, hardware resources such as encoders, decoders, tuners, and display engines are limited in chip-set units, and it is difficult to execute multiple tasks at the same time. input and process it.

The media server can strengthen system stability. This is, for example, when an error occurs as described above by removing and restarting a playback pipeline in which an error occurs during media playback for each pipeline. may not affect other media playback. Such a pipeline is a chain that connects unit functions such as decoding, analysis, and output when a media playback request is made, and required unit functions may vary according to a media type or the like.

The media server may have extensibility. For example, a new type of pipeline may be added without affecting an existing implementation method. For example, the media server may accommodate a camera pipeline, a video conferencing (Skype) pipeline, a third-party pipeline, and the like.

The media server may process general media playback and TV task execution as separate services, because the interface of the TV service is different from the media playback case. In the above, the media server supports operations such as 'setchannel', 'channelup', 'channeldown', 'channeltuning', and 'recordstart' in relation to TV service, and 'play' and 'pause' in relation to general media playback. By supporting operations such as ' and 'stop', different operations are supported for both, and can be processed as separate services.

The media server may control or integrate the resource management function. Allocating and recovering hardware resources within the device is integrated in the media server, and in particular, the TV service process transmits the currently running task and resource allocation status to the media server. The media server secures resources and executes pipelines whenever each media is executed. Based on the resource status occupied by each pipeline, the media server allows execution by priority (eg, policy) when requesting media execution and Reclaim resources from other pipelines, etc. Here, predefined execution priorities and resource information required for a specific request are managed by a policy manager, and the resource manager may communicate with the policy manager to process resource allocation, retrieval, and the like.

The media server may hold an identifier (ID) for all operations related to playback. For example, the media server may issue a command by instructing a specific pipeline based on the identifier. The media server may separately issue a command to the pipelines to play two or more media.

The media server may be in charge of playing HTML 5 standard media.

In addition, the media server may follow the TV restructuring scope for separate service processing of the TV pipeline. The media server may be designed and implemented irrespective of the scope of TV restructuring. If the TV is not separately serviced, it may be necessary to re-execute the entire TV when a problem occurs in a specific task.

The media server is also called uMS, that is, a micro media server. Here, a media player is a media client, which is, for example, an HTML5 video tag, a camera, a TV, Skype, a web for a second screen, and the like. It may mean a kit (Webkit).

In the media server, the management of micro resources such as a resource manager and a policy manager is a core function. In this regard, the media server also controls the playback control role for the web standard media content. In this regard, the media server may also manage a pipeline controller resource.

Such a media server supports, for example, extensibility, reliability, efficient resource usage, and the like.

In other words, the uMS, that is, the media server, is a webOS device such as a cloud game, MVPD (pay service, etc.), a camera preview, a second screen, a resource such as Skype, and a TV resource. It functions to manage and control the use of resources for proper processing within the overall management and control so that efficient use is possible. Meanwhile, when each resource is used, for example, a pipeline is used, and the media server may overall manage and control creation, deletion, use, etc. of the pipeline for resource management.

Here, the pipeline means, for example, when the media related to the task starts a series of tasks such as parsing of a request, a decoding stream, a video output, etc. can be For example, in relation to a TV service or application, watching, recording, channel tuning, etc. are each individually controlled and processed on resource use through a pipeline created according to the request. .

Referring to FIG. 10 , the processing structure of the media server will be described in more detail as follows.

In FIG. 10 , an application or service is connected to the media server 1020 through the Luna-service bus 1010 , and the media server 1020 includes pipelines re-created through the Luna-service bus 1010 and Connected and managed

An application or service may have various clients according to its characteristics, and may exchange data with the media server 1020 or a pipeline through it.

The client includes, for example, a uMedia client (Webkit) and a resource manager (RM) client (C/C++) for connection with the media server 1020 .

The application including the uMedia client is connected to the media server 1020 as described above. More specifically, the uMedia client corresponds to, for example, a video object to be described later, and such a client uses the media server 1020 for video operation by request or the like.

Here, the video operation relates to a video state, and loading, unloading, play, playback, or reproduce, pause, stop, etc. are all states related to the video operation. It may contain data. Each operation or state of such a video can be processed through individual pipeline creation. Accordingly, the uMedia client transmits the state data related to the video operation to the pipeline manager 1022 in the media server.

The pipeline manager 1022 obtains information on a current device resource through data communication with the resource manager 1024 and requests allocation of a resource corresponding to the state data of the uMedia client. In this case, the pipeline manager 1022 or the resource manager 1024 controls resource allocation through data communication with the policy manager 1026 if necessary in relation to the resource allocation. For example, when there is no or insufficient resources to be allocated according to the request of the pipeline manager 1022 in the resource manager 1024, appropriate resource allocation is performed according to the request according to the priority comparison of the policy manager 1026, etc. can

Meanwhile, the pipeline manager 1022 requests the media pipeline controller 1028 to create a pipeline for an operation according to the request of the uMedia client with respect to the resource allocated according to the resource allocation of the resource manager 1024 . .

The media pipeline controller 1028 creates a necessary pipeline under the control of the pipeline manager 1022 . As shown in the figure, in the generated pipeline, not only a media pipeline and a camera pipeline, but also pipelines related to playback, pause, pause, and the like may be generated. Meanwhile, the pipeline may include pipelines for HTML5, web CP, smartshare playback, thumbnail extraction, NDK, cinema, Multimedia and Hypermedia Information Coding Experts Group (MHEG), and the like.

In addition, the pipeline may include, for example, a service-based pipeline (own pipeline) and a URI-based pipeline (media pipeline).

Referring to FIG. 10 , an application or service including an RM client may not be directly connected to the media server 1020 . This is because an application or service may directly process the media. In other words, when an application or service directly processes media, it may not go through a media server. However, at this time, resource management is required for pipeline creation and use, and for this, the uMS connector functions. Meanwhile, when a resource management request for direct media processing of the application or service is received, the uMS connector communicates with the media server 1020 including the resource manager 1024 . For this, the media server 1020 must also be equipped with a uMS connector.

Accordingly, the application or service may respond to the request of the RM client by receiving the resource management of the resource manager 1024 through the uMS connector. These RM clients can handle services such as native CP, TV service, second screen, flash player, YouTube MSE (Media Source Extensions), cloud game, and skype. In this case, as described above, when necessary for resource management, the resource manager 1024 may appropriately manage the resource through data communication with the policy manager 1026 .

On the other hand, the URI-based pipeline is performed through the media server 1020 instead of directly processing media like the aforementioned RM client. Such a URI-based pipeline may include a player factory, a Gstreamer, a streaming plug-in, a Digital Rights Management (DRM) plug-in pipeline, and the like.

Meanwhile, an interface method between an application and media services may be as follows.

It is a method to interface using a service in a web application. This is a method of making a Luna call using PSB (Palm Service Bridge) and a method using Cordova, which extends the display to a video tag. In addition, there may be a method using the HTML5 standard for video tags or media elements.

And, it is a method of interfacing using a service in the PDK.

Alternatively, it is a method of using a service in an existing CP. This can be used by extending the plug-in of the existing platform based on Luna for backward compatibility.

Finally, it is an interface method in case of non-webOS. In this case, you can interface by calling the Luna bus directly.

Seamless change is processed by a separate module (for example, TVWIN), which is a process for seamlessly processing the TV before or during booting of webOS without webOS. . This is used for the purpose of providing the basic functions of the TV service first in order to quickly respond to the user's power on request because the booting time of the webOS is slow. In addition, as part of the TV service process, the module supports seamless change, factory mode, etc. that provide fast booting and basic TV functions. In addition, the module may be responsible for switching from the Non-WebOS mode to the WebOS mode.

11, the processing structure of the media server is shown.

At this time, in FIG. 11 , a solid line box may indicate a process processing configuration, and a dotted line box may indicate an internal processing module during a process. Also, a solid arrow may indicate an inter-process call, that is, a Luna service call, and a dotted arrow may indicate a notification such as register/notify or a data flow.

A service or web application or PDK application (hereinafter, 'application') is connected to various service processing components through a Luna-service bus, and through which the application operates or operation is controlled.

Depending on the type of application, the data processing path is different. For example, if the application is image data related to the camera sensor, it is transmitted to the camera processing unit 1130 and processed. In this case, the camera processing unit 1130 processes image data of the received application, including a gesture, a face detection module, and the like. Here, the camera processing unit 1130 may generate a pipeline through the media server processing unit 1110 and process the corresponding data, for example, if a user's selection or automatically using a pipeline is required.

Alternatively, when the application includes audio data, the audio may be processed through the audio processing unit (AudioD) 1140 and the audio module (PulseAudio) 1150 . For example, the audio processing unit 1140 processes audio data received from the application and transmits it to the audio module 1150 . In this case, the audio processing unit 1140 may include an audio policy manager to determine processing of audio data. The processed audio data is processed in the audio module 1160 . Meanwhile, the application may notify data related to audio data processing to the audio module 1160 , which may also be notified to the audio module 1160 in a related pipeline. The audio module 1150 includes an Advanced Linux Sound Architecture (ALSA).

Alternatively, when the application includes or processes (hereinafter included) DRM-applied content, the corresponding content data is transmitted to the DRM service processing unit 1160, and the DRM service processing unit 1170 generates a DRM instance (instance). to process the DRM-applied content data. Meanwhile, the DRM service processing unit 1160 may be connected to the DRM pipeline in the media pipeline through the Luna-service bus to process the content data on which the DRM is applied.

Hereinafter, processing in the case where the application is media data or TV service data (eg, broadcast data) will be described.

FIG. 12 is a diagram to explain in more detail only the media server processing unit and the TV service processing unit in FIG. 11 described above.

Therefore, hereinafter, it will be described with reference to FIGS. 11 and 12 together.

First, when the application includes TV service data, it is processed by the TV service processing unit 1120/1220.

Here, the TV service processing unit 1120 includes, for example, at least one of a DVR/channel manager, a broadcasting module, a TV pipeline manager, a TV resource manager, a data broadcasting module, an audio setting module, and a path manager. Alternatively, in FIG. 12, the TV service processing unit 1220 includes a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV MW (middleware)), a path manager, and a BSP ( For example, NetCast). Here, the service processing unit may refer to, for example, a module including a TV pipeline manager, a TV resource manager, a TV policy manager, and a USM connector.

In the present specification, the TV service processing unit may have the configuration shown in FIG. 11 or 12 or may be implemented as a combination of both, and some components may be omitted or some components not shown may be added.

The TV service processing unit 1120/1220 transmits the data to a DVR/channel manager in the case of a digital video recorder (DVR) or channel-related data, based on the attribute or type of the TV service data received from the application, and then back to the TV pipeline manager. to create a TV pipeline and process it. On the other hand, if the attribute or type of the TV service data is broadcast content data, the TV service processing unit 1120 generates and processes a TV pipeline through the TV pipeline manager in order to process the corresponding data through the broadcast module.

Alternatively, a json (Javascript standard object notation) file or a file written in c is processed in the TV broadcast handler, transmitted through the TV broadcast interface unit to the TV pipeline manager, and processed by creating a TV pipeline. In this case, the TV broadcast interface unit may transmit data or files that have passed through the TV broadcast handler to the TV pipeline manager based on the TV service policy, and refer to the data or file when creating a pipeline.

Meanwhile, the TV pipeline manager may be controlled by the TV resource manager when one or more pipelines are created according to a TV pipeline creation request from a processing module or manager within the TV service. Meanwhile, the TV resource manager may be controlled by the TV policy manager to request the status and allocation of resources allocated for a TV service according to the TV pipeline creation request of the TV pipeline manager, and the media server processing unit 1110 . /1210) and data communication through the uMS connector. The resource manager in the media server processing unit 1110/1210 transmits the status of a resource for the current TV service and whether or not to allocate it according to the request of the TV resource manager. For example, as a result of checking the resource manager in the media server processing unit 1110/1210, if all the resources for the TV service have already been allocated, the TV resource manager may notify that all the resources are currently allocated. In this case, the resource manager in the media server processing unit removes a predetermined TV pipeline according to a priority or a predetermined criterion among TV pipelines previously allocated for the TV service together with the notify, and removes the predetermined TV pipeline for the requested TV service. You can also request or assign a creation. Alternatively, the TV resource manager may appropriately control removal, addition, establishment, etc. of TV pipelines in the TV resource manager according to the status report of the resource manager in the media server processing unit 1110/1210.

Meanwhile, the BSP supports, for example, backward compatibility with an existing digital device.

The TV pipelines generated in this way may be appropriately operated under the control of the path manager during the processing process. The path manager may determine or control processing paths or processes of pipelines in consideration of not only the TV pipeline but also the operation of the pipeline generated by the media server processing unit 1110/1210 in the processing process.

Next, when the application includes media data rather than TV service data, it is processed by the media server processing unit 1110/1210. Here, the media server processing unit 1110/1210 includes a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, and the like. On the other hand, pipelines generated under the control of the media pipeline manager and the media pipeline controller can be created in various ways, such as a camera preview pipeline, a cloud game pipeline, and a media pipeline. Meanwhile, the media pipeline may include a streaming protocol, auto/static gstreamer, DRM, and the like, whose processing flow may be determined according to the control of the path manager. The detailed processing process in the media server processing unit 1110/1210 uses the description of FIG. 10 described above, and will not be repeated herein.

In the present specification, the resource manager in the media server processing unit 1110/1210 may perform resource management on a counter basis, for example.

13 is a diagram illustrating a detailed configuration module of a digital device related to music file use according to an embodiment of the present invention. It is also possible for those skilled in the art to supplementally interpret the digital device shown in FIG. 13 by using the smart TV equipped with the webOS described in the previous drawings.

The digital device 1300 according to an embodiment of the present invention includes a tuner 1310 , an interface module 1320 , an IR signal receiving module 1330 , a controller 1340 , a display module 1350 , a speaker 1360 , etc. Including, the digital device 1300 is controlled through a remote control 1301, a mobile device in which a remote control application is installed, and the like. However, hereinafter, for convenience, the remote control will be described as an example. Furthermore, the remote control 1301 includes an IR infrared processing unit, an RF signal processing unit, and the like, and for example, it is also possible to transmit information according to an input of the remote control 1301 to the digital device 1300 .

The tuner 1310 receives a broadcast signal from a broadcast station. In this case, the broadcast signal is multiplexed with video data and audio data. The broadcast signal may further include signaling data related to the audio and video data.

The interface module 1320 receives a music file. The interface module 1320 includes, for example, at least one of an Internet network, an interface accessible to an external memory, or an interface accessible to an internal memory. In particular, the music file may be independent of a broadcast signal received through a tuner, or may be included in the broadcast signal and transmitted. Meanwhile, the music file may be received by downloading or streaming.

The IR signal receiving module 1330 receives at least one command from the remote controller 1301 . The IR signal receiving module 1330 is also within the scope of the present invention to receive other types of signals instead of the IR signals.

The display module 1350 outputs video data included in the received broadcast signal, and the controller 1340 includes the tuner 1310 , the interface module 1320 , the IR signal reception module 1330 , and the display module. (1350) is coupled.

Furthermore, in response to a first command received through the IR signal receiving module 1330 , the controller 1340 displays the video data in a first area of the display module 1350 and controls the music file. It is possible to display an indicator used to perform a video on the second area, stop output of audio data included in the broadcast signal, and control so that only the music file is output. The indicator will be described in more detail below with reference to the drawings.

According to another embodiment of the present invention, the controller 1340 may change the indicator or change the size of the second area in response to the second command received through the IR signal receiving module 1330 . have.

In addition, according to another embodiment of the present invention, the controller 1340 controls a play list including audio data currently being output in response to a third command received through the IR signal receiving module 1330 . Outputs possible indicators.

And according to another embodiment of the present invention, in response to the third command, the controller 1340 outputs an indicator capable of controlling a play list that does not include the currently output audio data. That is, the digital device may be designed such that the level of the indicator is optimized for the needs or convenience of the user. A more detailed description will be given below.

14 and 15 are diagrams for explaining a method of reproducing audio data in a digital device according to an embodiment of the present invention.

Audio data, such as a music file, can be directly reproduced by the digital device in the state shown in FIG. 14 or 15 .

In the digital device, audio data such as a music file may be used through, for example, a music application according to a web OS platform. Meanwhile, when accessing the music application, a music application page may be provided or a music player may be provided. Also, when the digital device is turned on, the music player may be provided by being overlaid on a predetermined area within the screen on any screen.

In relation to this, in order to control a music file in a digital device, the music player may be provided in various states as follows. For example, when a menu launcher is provided in the digital device and a menu item for a music application in the menu launcher is selected, a music application included in a recent area in the menu launcher When accessing a menu item for , when executing a music application through a device connector You can use and control music files by running a music application when selecting a device in the input picker, selecting a music link when selecting a device in an input hub, etc. .

Referring to FIG. 14 , the digital device provides an application execution screen in an entire screen. Here, the digital device may provide a menu on the application execution screen according to a user's request. The menu may largely include a recent area or recent part and an application area. The receive area includes one or more menu items (one or more menu items) corresponding to the immediately or previously executed application screen (s). The application area includes menu items corresponding to a plurality of applications executable in the digital device. Meanwhile, in relation to the TV service application, the menu may further include a channel area and an information area for providing other information such as shopping for convenience of use.

In addition, the digital device may provide one or more menu icons to one area of the screen according to a movement of a pointer within the screen according to a menu request or without a separate user input. have. In relation to the present invention, a music menu icon for providing a music file may be provided to the one or more menu icons. Meanwhile, the music menu icon is not always included in the one or more menu icons, but may be provided according to an application being provided on the screen. For example, if the application currently being provided on the screen contains music files such as OST (original sound track) or BGM (background music), or there is a music file stored in relation to the application, or music related to an external memory or server, etc. It can only be provided if the file exists. When a user selects the music menu icon through a pointer in FIG. 14 , a music file may be played. A more detailed description thereof will be provided later. Meanwhile, in the present specification, selection includes, for example, a case of selecting by pressing an OK or OK button, as well as a case of pointing or hovering for a predetermined time. In addition, even if the selection is not necessarily through a pointer or a key button provided in an input device such as a remote control, a user's gesture, voice, eye-tracking, etc. or It can also be achieved through a combination of them.

Referring to FIG. 15A , when a user accesses a storage space 1512 of a digital device and selects a music icon 1514 provided in an upper area of the screen, music files in the accessed storage space are categorized and provided to be accessible. .

Referring to FIG. 15B , when a digital device provides one application execution screen in full screen, when a music file is included in the executed application, a music file is displayed in a predetermined area of the screen so that the music file can be used. An indicator 1520 is provided.

Referring to FIG. 15C , the digital device may provide an external input or an application for a moving image or a still image. In FIG. 15C , as an example, when a music function icon 1534 is selected from among function icons while a photo album application 1532 is provided by a digital device, a music file is executed. Here, the executed music file is any music file preset in the photo album application 1532 or related to the currently accessed photo image data, or included in a playlist among music files stored in the storage space of FIG. 15A . etc.

Meanwhile, if there is a user's selection in FIGS. 14 to 15 , the digital device may provide a music application list or a music player on the entire screen or a partial area, as will be described later.

Hereinafter, it is assumed that a music application is selected in FIGS. 14 to 15 .

16 to 20 are diagrams illustrating a list of music applications provided by a digital device according to an embodiment of the present invention.

As described above, when a music application is selected according to a user's request, a music application page may be provided as shown in FIG. 16A, except when the music player is directly executed.

Referring to FIG. 16A , the music application page may largely include a first music menu item 1610 , a second music menu item 1620 , and a third music menu item 1630 .

Here, the first music menu item 1610 is for directly accessing, for example, a music file play list set in advance by a digital device user. Accordingly, when the user selects the playlist menu item 1610, the digital device provides a preset music file list to be checked regardless of the storage space. In this case, a music file included in the playlist but not currently accessible is displayed so as to be identifiable in the playlist. On the other hand, the play list provides a music file that has been played or is being played immediately before can be identified from the play list.

The second music menu item 1620 is for accessing an internal storage folder of the digital device, and includes music file(s) (hereinafter referred to as a basic music file) included in manufacturing the digital device. Meanwhile, the internal storage folder may store music files downloaded from an external server in the digital device or moved from an external device in addition to the basic music files.

The third music menu item 1630 is for accessing a connected external device, etc. to search for, access, and the like a music file of the accessed external device.

When any one of the first to third music menu items 1610, 1620, and 1630 is selected in FIG. 16A or a music application is requested according to FIGS. 14 to 15, it is included in the music application page There is a problem how to configure and provide the music files, which are described in FIG. 16B .

Referring to FIG. 16B , basically, music files may have a folder type, an album type, an artist type, and the like. The folder type means that music files classified according to the same category or attribute or user's selection are provided in the form of a folder. In this case, the folder is a parent folder and includes one or more subfolders within the folder, which are provided in the same way for the subfolders. Meanwhile, music files not included in the folder may be appropriately classified according to a predetermined method and provided together with the folders. 16B and 17A illustrate a folder type classification scheme 1650 as an example.

16B and 17B, album types are shown. In the album type, music files for one or more songs included in one album are provided in the same way as the above-mentioned folder in units of an artist's album, and access, use, etc. are possible accordingly. For example, when one album is accessed, music files for one or more songs included in the corresponding album may be provided in the form of a sub-menu. Meanwhile, in each album, the number of linked music files included in the corresponding album may be provided in the form of numbers to help the user's convenience.

16B and 17C, artist types are shown. The artist type classifies music files as if an artist, ie, a singer, was a single parent folder. When an artist releases a plurality of albums and is available in a digital device, when the artist is selected, a list of albums released by the artist may be provided as a first sub-menu. When one album is selected from the first sub-menu, music files for one or more songs included in the re-selected album may be provided in the form of a second sub-menu. Similarly to the album type, the artist type may also be provided in the form of a number so that the number of available albums or the number of music files can be identified according to the selection of the corresponding artist.

Meanwhile, the classification of the music files can be arbitrarily changed through the table of contents icon 1640 .

Fig. 18A shows, for example, a play list according to a user's setting or the like. The playlist may be classified and sorted according to various criteria. This can be arbitrarily changed by accessing the sort icon 1820 . Meanwhile, in the playlist provided in FIG. 18A , the music file that was played immediately before is processed so as to be identifiable from the playlist. Meanwhile, each play file on the play list may provide, for example, at least one of an artist name, an album name, and a song title. The play music file selected from the play list may be selected according to the play time, current play remaining time, etc. Additional detailed information may be provided. Meanwhile, in the playlist, the number of songs included in the current playlist, the total playing time of the songs, etc. may be provided in the form of numbers.

18B is a screen provided according to selection of an edit icon 1830 for editing a playlist in the playlist of FIG. 18A, for example. In this case, FIG. 18B may be, for example, an edit screen for the entire playlist or an edit screen for a music file selected from the playlist.

When the edit icon 1830 is selected after selecting a specific music file, a specific artist, or a specific album in FIG. 18A, as shown in FIG. 18B, one or more related music files are listed-up and selected can be edited. Although only menus such as all selection, addition, and cancellation are provided in FIG. 18B , various menus related to playlist editing may be implemented and provided.

19 , a case in which a music file is moved as a type of editing in the music application page will be described as an example. In FIG. 19A , a user may select one music file 1910 using a pointer and drag and drop it to a desired location 1920 as shown in FIG. 19B . When the screen is, for example, a play list, the play order may be changed according to the movement. Although FIG. 19 illustrates a case in which only the corresponding file is moved when one file is moved, the present invention is not limited thereto. For example, the file may be a folder or an album, or related music files may be moved to the corresponding location depending on the artist. For example, if the selected file is an album of a specific artist and the album includes 10 songs, 10 songs included in the album may also be moved according to the movement of the file.

20A illustrates an embodiment of simultaneously deleting one or more music files on a music application page, and FIG. 20B illustrates an embodiment of simultaneously adding one or more music files.

The file selected in FIG. 20A is displayed (v) so that it can be identified that it is selected differently from other music files in the list, and can be deleted according to the user's selection. In this case, the user may set in advance such that deletion is impossible by music file unit, album unit, artist unit, folder unit, etc., but if preset as described above, the corresponding music files may not be provided in the deletion list from the beginning. . Alternatively, a GUI or the like may be provided to identify whether selection is inactivated even if it is provided in the deletion list or non-deletion is possible even if selection is possible.

In FIG. 20B, one or more music files may be added in a form similar to that of FIG. 20A. Meanwhile, in the case of adding a specific music file in FIG. 20B , the location may be preset by the user or if the user presses the add button in FIG. 20B , a GUI for selecting a storage location may be provided and may be followed. Alternatively, attributes of the music file additionally selected in FIG. 20B may be directly stored in a related folder or location in consideration of at least one factor among genre, album, artist, and the like.

21 is a diagram for explaining a method of searching for and using a music file provided by a digital device according to another embodiment of the present invention.

When a search request is received in a certain state, the digital device provides a search screen as shown in FIG. 21 .

On the search screen, a search term may be input through voice or keyboard. When a search word is input and a search request is received, the digital device provides a search result according to the search word on the screen. In this case, the search results may be sorted and provided in various ways, for example, by attribute, by device, and the like.

For example, as shown in FIG. 21 , a search result corresponding to the search word 'sugar' is provided, and when the user selects any one of the search results, the selected content playback screen is provided. Here, if the selected content includes audio data or a music file, a music player may be provided. Alternatively, even when the selected content does not include audio data or is not a music file, if there is a music file related to the corresponding content when playing according to a play command, the music file may be played and provided through a music player. have. Such music file reproduction may be performed according to a preset bar for the selected content or related application, for example.

22 to 23 are diagrams for explaining the use of a music application list and a music player according to an embodiment of the present invention.

22 to 23 are exemplary embodiments of a feature in which a music player is provided and a music file is played according to a user's action on the music application page after the music application is executed.

When one music file 2210 is selected from the folder-type music application page in FIG. 22A and a playback request is input, the digital device provides a music player 2220 as shown in FIG. 22B to play the corresponding music file.

When one music file 2310 is selected from the playlist music application page in FIG. 23A and a play request is input, the digital device provides a music player 2320 as shown in FIG. 23B to play the corresponding music file.

22B and 23B , the music player is provided on or within a music application page as an example. Meanwhile, the music player provided in FIGS. 22B and 23B may be continuously provided in the corresponding area despite a request to end the provision of a music application page later or a request to execute another application. In this case, the music player may be provided in another form or is always provided at the top layer to promote user convenience. However, in the case in which the music application itself is terminated and another application is executed, the music file reproduction may be stopped or stopped even though the music player is continuously provided. For example, when a music file or other audio file is included in the other running application in which an application other than the music application is executed, whether the music player is continuously provided or not according to a preset bar or according to the user's selection Whether to continue playing the file may be automatically determined or manually determined and followed. For example, when there is no audio data or an insignificant application is played, it is preferable that the music player is continuously provided and the music file is also continuously played. However, if there is audio data and the priority for importance is higher than that of the music application, the music file may be stopped and whether to continue providing the music player may be determined according to the difference in priorities. Even if the priority of the music application is lower than that of the newly executed application, the user can change the newly executed application within a predetermined time, so that the user's input for stopping or changing the execution of the application within the predetermined time is considered. it is preferable Alternatively, as described above, when an application having a high priority is executed, the music player may continuously or continuously provide the music file for a predetermined period of time, but playback of the music file may be paused. In this case, if an application having a higher priority is continuously used after a predetermined time, playback of the music file may be paused, or the music player may be minimized or removed from the screen as shown in FIG. 24B .

24 to 27 are diagrams for explaining a music player according to an embodiment of the present invention.

Hereinafter, a more detailed description of the use of the music player will be described with reference to the accompanying drawings.

In the present specification, when a music file is executed in any state of the digital device, a music player may always be provided.

Referring to FIG. 24A , if the digital device uses the first application according to the user's request, the digital device may use the second application according to the present invention together. Here, the first application means an application other than a music application, and the second application means a music application.

24A , when a second application execution request is received while using the first application, the digital device provides a music player 2410 for executing the second application. In this case, a speaker built into the digital device or a speaker connected to the digital device by wire/wireless may output the music file being executed in the music player 2410 in response to the second application execution request.

On the other hand, the music player is a music player 2410 of a first version as shown in FIG. 24A and a music player 2420 of a second version as shown in FIG. 24B based on the state, depth, and user's selection of the digital device. can be provided. Here, the music player divided into the first version and the second version is, for example, for the user's convenience in using the digital device. The first version of the music player 2410 can perform various functions or select the music player itself. On the other hand, in the second version of the music player 2420, although the music player continues to be used, in the case of the first version, the screen is often blocked, which may interfere with viewing of other applications, so the size of the music player is minimized. can see. In particular, in the case of the second version, when a predetermined action is not taken and, for example, a playback order or a playback file is continuously used under the same conditions, the second version can be used while minimizing interference with viewing of other applications. In the case of the second version, this is to enable the user to identify that the music application is running.

In addition, the first version music player 2410 illustrated in FIG. 24A and the second version music player 2420 illustrated in 24B may be arbitrarily changed to an area other than the illustrated area. Meanwhile, when pointing, hovering, or selecting the second version music player 2420 of FIG. 24B , it may be automatically switched to and provided to the first version music player 2410 as shown in FIG. 24A .

The first version music player 2410 in FIG. 24A is configured to include an image area 2412 , an information area 2414 , and a reproduction control area 2416 .

In the image area 2412, image data representing a corresponding music file, such as an album jacket or a thumbnail image, is provided.

The information area 2414 provides various information related to the music file, such as the title, artist name, and album name of the currently played or selected music file.

The reproduction control area 2416 may be provided in the form of a reproduction bar, and various functions for controlling reproduction of a music file are provided. Meanwhile, the basic reproduction control function may also be performed through the image area.

In FIG. 24A , the image area 2412 may include image data of the music file currently being played back, as well as image data of the music file that is played immediately before and next as shown in FIG. 25 . Alternatively, it may be image data of a music file corresponding to the previous and next playlists on the playlist based on the currently played music file. Such a plurality of image data may be provided so as to be accessible in the left and right directions regardless of the current reproduction. Accordingly, the user can search for the next play song or music file on the play list while continuously listening to the currently played music file.

Meanwhile, referring to FIG. 25 , when the user points to or hovers over a specific music file including the played music file in the image area 2412 , an icon 2510 is provided like an arrow. When the icon 2510 is selected, function icons 2610 as shown in FIG. 26 may be provided. For example, the first function icon performs a function of entering a music-related application. At least one of a music file list stored in the memory of the digital device or a music file list stored in a connected external device is output. The second function icon provides repeat and shuffle functions. That is, when the second function icon is selected, the music file is played in no repeat mode, and when the second function icon is selected again, the music file is played back in repeat 1, and again the second function icon is selected. 2 When the function icon is selected, the music file is played in the repeat all mode, and when the second function icon is selected again, the music file is played in the shuffle mode. The third function icon performs a function of wirelessly or wiredly forwarding the currently playing music file to an external device rather than a digital device. The fourth function icon provides a function of searching for information on a music file currently being played or other music files. The fifth function icon performs a function of temporarily making the indicator for a music file disappear, and the sixth function icon performs a function of completely stopping the playback of the currently output music file.

27 is a diagram for explaining various levels of an indicator for a music file of a digital device according to an embodiment of the present invention.

As described above, a feature of the present invention is that, instead of audio data included in a broadcast signal received from a tuner, a music file received through a different path is replaced and output. Furthermore, the indicator for the music file is designed to be more easily accessed by the user and optimized for user convenience.

In FIG. 27 , the indicator 2710 for a music file may be provided through the entire screen, unlike the aforementioned FIGS. 24A or 24B . Alternatively, according to the selection of the image data 2412 or 2420 in FIG. 24A or 24B, the indicator 2710 for the music file may be provided as shown.

28 and 29 are flowcharts illustrating a method of using or reproducing a music file in a digital device according to the present invention.

As shown in FIG. 28 , the digital device according to an embodiment of the present invention receives a broadcast signal from a broadcasting station (S2810). The broadcast signal is multiplexed with video data and audio data.

Further, the music file is received (S2820), and at least one command is received from the remote controller (S2830). In addition, the video data included in the received broadcast signal is output (S2840), and in response to the received first command, the video data is displayed on a first area within the screen of the digital device and the music file is controlled. An indicator used to perform the display is displayed on the second area of the screen (S2850).

Then, the output of the audio data included in the broadcast signal is stopped, and only the music file is controlled to be output (S2860).

Although not shown in FIG. 28, according to another embodiment of the present invention, the indicator is changed or the size of the second area is changed in response to the received second command.

Although not shown in FIG. 28 , according to another embodiment of the present invention, in response to the received third command, an indicator capable of controlling the play list including the currently output audio data is output.

Although not shown in FIG. 28, according to another embodiment of the present invention, in response to the received third command, an indicator capable of controlling a play list that does not include the currently output audio data is output.

Referring to FIG. 29 , the digital device displays the first application execution screen on the screen (S2910).

The digital device receives the menu display request (S2920), and displays the menu on the first application execution screen (S2930).

The digital device receives a menu item for a music application from the displayed menu (S2940), and displays a first version of the music player on the first application execution screen according to the selection of the music application menu item (S2950) .

Thereafter, the digital device switches the music player of the first version to the music player of the second version according to a preset condition and continuously displays the music player on the first application execution screen (S2960).

In the above, while the first version and the second version music players are provided, a music file is played and audio data of the music file is output.

The preset condition includes: when a user input for the first version of the music player is not received for a preset period of time, when a second application is executed on behalf of the first application, and when the second version of the music player When a user's request for display is received, when no input to the digital device is received for a preset time, when an application having an audio-related priority higher than the music application is executed, the output music file It may include at least one of a case in which the audio volume of ' is set to be lower than a preset reference volume.

In the above, displaying a second application execution screen on the screen together with or on behalf of the first application, and switching the music player of the previously output version to another version of the music player and displaying It may be made to further include.

In the above, when a second application execution screen is displayed on the screen together with or on behalf of the first application, the music player of the corresponding version may be displayed in the uppermost layer.

In the above, the method may further include receiving a signal for selecting a music player of the second version to be displayed, and switching to and displaying the music player of the first version according to the second version music player selection signal. have.

In the above, at least one of the first or second version of the music players may be movable to an arbitrary area within the screen.

In the above, the music player of the first version may include an image area, an information area and a reproduction control area.

In the above, the method may further include displaying a music application page according to a selection of a music application menu item.

The music application page is composed of a play list, internal memory, and items that can access external input, and music files according to the selected item can be sorted and provided by folder, artist, genre and album unit. have.

The first application and the second application may include a TV service application.

The configuration and method of the above-described embodiments may not be limitedly applied to the digital device equipped with the webOS disclosed in this specification and the method for processing a service or application in the digital device, but various modifications may be made to the embodiments. All or part of each embodiment may be selectively combined and configured.

Meanwhile, the method of operating a digital device disclosed in the present specification can be implemented as processor-readable codes on a processor-readable recording medium provided in the digital device. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. It includes those implemented in the form of a wave (carrier-wave). In addition, the processor-readable recording medium is distributed in a computer system connected to a network, so that the processor-readable code can be stored and executed in a distributed manner.

On the other hand, although the present specification has been described with reference to the accompanying drawings, this is only an embodiment and is not limited to a specific embodiment, and various contents that can be modified by those of ordinary skill in the art to which the present invention belongs are also claimed. It belongs to the scope of rights according to In addition, such modifications should not be individually understood from the spirit of the present invention.

201: network interface unit 202: TCP/IP manager
203: service delivery manager 204: SI decoder
205: demultiplexer 206: audio decoder
207: video decoder 208: display unit
209: service control manager 210: service discovery manager
211: SI & Metadata Database 212: Metadata Manager
213: service manager 214: UI manager

Claims (20)

In a digital device,
Memory;
an input interface unit for receiving a first application execution request, a menu display request, and menu item selection signals for a music application in the menu;
control to display the first application execution screen on the screen of the output unit, control to display a menu on the first application execution screen according to the menu display request, and control to display a menu on the first application execution screen according to a menu item selection signal for the music application control to display the first version of the music player on the first application execution screen, and switch the first version of the music player to the second version of the music player according to a preset condition to continue on the first application execution screen a control unit controlling the display; and
including the output unit,
The control unit is
control so that a music file is played and audio data of the music file is output while the first version and the second version music player are provided;
the music player of the first version is displayed to occupy a first proportion with respect to the screen of the output unit, and the music player of the second version is displayed to occupy a second proportion to the screen of the output unit which is less than the first proportion. do,
The first version of the music player includes an icon for performing a first function and a second function related to the control of the music application, and the second version of the music player performs a first function related to the control of the music application including icons that do,
digital device. According to claim 1,
The control unit is
When a user input for the first version of the music player is not received for a preset time, when a second application is executed on behalf of the first application, the user's request for displaying the second version of the music player is received, when no input to the digital device is received for a preset period of time, when an application having a higher audio related priority than the music application is executed, the audio volume of the output music file is set in advance The digital device of claim 1, wherein the first version and the second version of the music player are switched and controlled by using at least one of the case where the volume is set to be lower than the reference volume as the preset condition. According to claim 1,
The control unit is
Control to display a second application execution screen on the screen together with or on behalf of the first application,
The digital device of claim 1, wherein the previously output version of the music player is switched to another version of the music player and controlled to be displayed. According to claim 1,
The control unit is
When a second application execution screen is displayed on the screen together with or on behalf of the first application, the music player of the corresponding version is controlled to be displayed in the uppermost layer. According to claim 1,
The control unit is
and controlling to switch to the music player of the first version and display the music player according to the displayed second version of the music player selection signal. According to claim 1,
The control unit is
A digital device, characterized in that at least one of the first or second version of the music player is controlled to be moved to an arbitrary area within the screen. According to claim 1,
The first version of the music player,
A digital device comprising an image area, an information area and a reproduction control area. According to claim 1,
The control unit is
and controlling to display a music application page according to the selection of the music application menu item. 9. The method of claim 8,
The control unit is
The music application page is configured to include items that can access a play list, internal memory, and external input, and music files according to the selected item are sorted and provided in units of folders, artists, genres and albums. Digital device, characterized in that. 5. The method of claim 3 or 4,
The first application and the second application, the digital device, characterized in that it includes a TV service application. A method for controlling a digital device, comprising:
displaying a first application execution screen on the screen;
receiving a menu display request;
displaying a menu on the first application execution screen;
receiving a selection of a menu item for a music application from the displayed menu;
displaying a first version of the music player occupying a first ratio with respect to the first application execution screen on the first application execution screen according to the selection of the music application menu item; and
Switching the music player of the first version to the music player of the second version with respect to the first application execution screen according to a preset condition and continuously displaying it on the first application execution screen - The second ratio is the less than the first ratio-;
is made, including
While the first version and the second version music player are provided, a music file is played and audio data of the music file is output,
The first version of the music player includes an icon for performing a first function and a second function related to the control of the music application, and the second version of the music player performs a first function related to the control of the music application including icons that do,
Digital device control method. 12. The method of claim 11,
The preset condition is
When a user input for the first version of the music player is not received for a preset time, when a second application is executed on behalf of the first application, the user's request for displaying the second version of the music player is received, when no input to the digital device is received for a preset period of time, when an application having a higher audio related priority than the music application is executed, the audio volume of the output music file is set in advance Digital device control method comprising at least one of the case of setting lower than the reference volume. 12. The method of claim 11,
displaying a second application execution screen on the screen together with or on behalf of the first application;
The method for controlling a digital device, characterized in that it further comprises the step of switching the music player of the previously output version to the music player of another version and displaying the displayed music player. 12. The method of claim 11,
When a second application execution screen is displayed on the screen together with or in place of the first application, the music player of the corresponding version is displayed in the uppermost layer. 12. The method of claim 11,
receiving a signal for selecting the displayed second version of the music player;
and switching to the music player of the first version and displaying the music player according to the second version music player selection signal. 12. The method of claim 11,
A method for controlling a digital device, characterized in that at least one of the first or second version of the music player is movable to an arbitrary area within the screen. 12. The method of claim 11,
The first version of the music player,
A digital device control method comprising an image area, an information area and a reproduction control area. 12. The method of claim 11,
and displaying a music application page according to the selection of the music application menu item. 19. The method of claim 18,
The music application page,
Digital device control, characterized in that it is composed of a play list, an internal memory, and items that can access an external input, and the music file according to the selected item is sorted and provided by folder, artist, genre, and album unit Way. 15. The method of claim 13 or 14,
The first application and the second application, the digital device control method, characterized in that it includes a TV service application.

Images