KR101728726B1 - Method for processing multiple contents having different types in network tv and the network tv - Google Patents

Abstract

A method of controlling a network TV according to an embodiment of the present invention includes the steps of entering an initial screen execution step when a power on signal for the network TV is applied, Extracting second image data for identifying each of a plurality of contents of a second type stored in the memory, and extracting second image data for identifying each of the plurality of contents of the first type Converting at least one of the first image data into a size smaller than the original size when the number of first image data to be identified exceeds a displayable range in the first area of the initial screen, When the number of second image data items identifying each of the two kinds of contents exceeds a displayable range in the second area of the initial screen Converting at least one of the second image data into a size smaller than the original size, and converting the first image data and the first image data, which are smaller than the original size, And controlling an initial screen including the second area including specific second image data converted into a size to be displayed.

Description

METHOD FOR PROCESSING MULTIPLE CONTENTS HAVING DIFFERENT TYPES IN NETWORK TV AND THE NETWORK TV,

The present invention relates to a network television (TV) technology, and more particularly, to a network TV control method for processing a plurality of different types of content and to the network TV.

Recently, various types of network TVs have been discussed. In an embodiment of the network TV, a function of receiving and processing a larger amount of information in real time via a wired / wireless Internet network is expected, unlike a conventional television receiving limited data only through a broadcasting network. More specific embodiments of the network TV may include Internet protocol television (IPTV), smart television, and hybrid broadcast broadband television (HBBTV).

Network TV is expected to be able to perform various contents and applications at the same time. Particularly, considering the memory of the network TV and the performance of the CPU (Central Processing Unit), the number of processable contents and applications is highly likely to increase exponentially. However, the development of a solution that provides more intuitive guidance of the many functions provided on the network TV is not yet developed.

An embodiment of the present invention is to provide a solution that provides a more predictable initial screen to a user using a network TV considering the gradually increasing number of contents.

In addition, another embodiment of the present invention is to provide a method for enabling each of different types of content to be searched for at a faster rate in a specific gesture unit of a user.

A method of controlling a network TV for processing a plurality of different types of content according to an embodiment of the present invention includes the steps of entering an initial screen execution step when a power on signal for the network TV is applied, Extracting first image data identifying each of a plurality of types of contents, extracting second image data identifying each of a plurality of contents of a second type stored in the memory, When at least one of the first image data is smaller than the original size, the size of the first image data is smaller than the original size of the first image data, The number of second image data for identifying each of the plurality of contents of the second type is greater than the number of second image data for the second Converting at least one of the second image data into a size smaller than the original size when the range exceeds a displayable range of the first image data; And controlling to display an initial screen including the first area and the second area including the specific second image data converted to a size smaller than the original size.

11. The network TV for processing a plurality of different types of contents according to an embodiment of the present invention includes an interface designed to enter an initial screen execution step when a power on signal for the network TV is applied, A first extracting unit that extracts first image data that identifies each of a plurality of contents of a first type stored in the memory, a second extractor that extracts second image data that identifies each of the plurality of contents of the second type stored in the memory, A second extracting unit for extracting at least one of the first image data and the second image data from the first image data when the number of the first image data identifying each of the plurality of contents of the first type exceeds a displayable range in the first area of the initial screen, A first conversion unit for converting one or more images into a size smaller than the original size; A second conversion unit that converts at least one of the second image data into a size smaller than the original size when the number of the first image data exceeds a displayable range in the second area of the initial screen, And an initial screen including the first area including the converted specific first image data and the second area including the specific second image data converted to a size smaller than the original size is displayed.

According to an embodiment of the present invention, a solution for providing a more predictable initial screen to a user using a network TV considering the gradually increasing number of contents is presented.

According to another embodiment of the present invention, there is provided a method of enabling a search for each of different types of content in a specific gesture unit of a user at a faster speed.

The effects of the more specific invention will be described later in detail in the following table.

FIG. 1 is a diagram schematically showing an example of an entire broadcasting system including a network TV according to an embodiment of the present invention.
2 is a diagram schematically showing another example of an entire broadcasting system including a network TV according to another embodiment of the present invention.
FIG. 3 is a diagram illustrating a step in which the network TV shown in FIG. 1 or FIG. 2 connects to a service provider and receives channel information or the like.
4 is a diagram showing an example of data used in the steps shown in FIG.
FIG. 5 is a diagram showing an example of the network TV shown in FIG. 1 or FIG. 2 in more detail.
FIG. 6 is a view showing in further detail another example of the network TV shown in FIG. 1 or FIG.
FIG. 7 and FIG. 8 are views showing any one of the network TVs according to the embodiments of the present invention as a set-top box and a display device.
9 is a diagram for explaining a process in which any one of the network TVs according to the embodiments of the present invention communicates with third devices.
10 is an internal block diagram of the control unit shown in FIG.
11 is a diagram showing an example of any one of platform structures of network TVs according to the embodiments of the present invention.
12 is a diagram showing another example of the structure of any one of the network TVs according to the embodiments of the present invention.
13 is a diagram illustrating a control method of a remote control device for controlling any one of network TVs according to embodiments of the present invention.
14 is an internal block diagram of a remote control device for controlling any one of the network TVs according to the embodiments of the present invention.
15 is a diagram illustrating a first embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.
16 is a diagram illustrating a second embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.
17 is a diagram illustrating a third embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.
18 is a diagram illustrating a fourth embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.
19 is a diagram illustrating a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention.
20 is a diagram illustrating a process of generating first image data in which a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention is image-processed.
21 is a diagram illustrating a process of generating second image data in which a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention is image-processed.
22 is a diagram showing an initial screen provided by a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention.
FIG. 23 is a view illustrating a screen in which a network TV for processing a plurality of different types of content according to an embodiment of the present invention cuts the top of some data in the first image data.
FIG. 24 is a diagram illustrating a screen in which a lower end of some data in the first image data is cut by a network TV that processes a plurality of different types of content according to an exemplary embodiment of the present invention.
FIG. 25 is a diagram illustrating a screen in which a network TV for processing a plurality of different types of content according to an embodiment of the present invention cuts the top of some data in the second image data.
26 is a view showing a screen in which a lower end of some data in the second image data is cut by a network TV processing a plurality of different types of contents according to an embodiment of the present invention.
FIG. 27 is a flowchart illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a motion remote controller.
28 is a detailed view of a multiple camera added to a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention.
29 is a diagram illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a first gesture.
30 is a diagram illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a second gesture.
31 is a diagram illustrating a first menu screen for setting an initial screen of a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention.
32 is a diagram illustrating a second menu screen for setting an initial screen of a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention.
33 is a flowchart illustrating a method of controlling a network TV that processes a plurality of different types of content according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

Meanwhile, the network TV described in the present specification is an intelligent network TV, for example, that adds a computer support function to a broadcast reception function, and is added to a broadcast reception function while an Internet function is added. A remote controller and the like can be provided. With the support of wired or wireless internet function, it can be connected to internet and computer and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Therefore, the network TV described in the present invention can be freely added or deleted from various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the network TV may be, for example, IPTV, HBBTV, smart TV, or the like, and may be applied to a smartphone according to circumstances.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

 FIG. 1 is a diagram schematically showing an example of an entire broadcasting system including a network TV according to an embodiment of the present invention.

1, an overall broadcasting system including a network TV according to an embodiment of the present invention includes a content provider (CP) 10, a service provider (SP) 20, A network provider (NP) 30 and an HNED 40. The HNED 40 corresponds to, for example, a client 100 that is a network TV according to an embodiment of the present invention. The client 100 corresponds to a network TV according to an embodiment of the present invention, and the network TV is, for example, a network TV, a smart TV, an IPTV, or the like.

The content provider 10 produces and provides various contents. 1, a terrestrial broadcaster, a cable SO (System Operator), a MSO (Multiple System Operator), a satellite broadcaster, Internet broadcaster and the like can be exemplified.

In addition, the content provider 10 may provide various applications in addition to the broadcast content. In this regard, it will be described in detail later.

The service provider 20 can provide the contents provided by the contents provider 10 in a service package. For example, the service provider 20 of FIG. 1 can package and provide the first terrestrial broadcast, second terrestrial broadcast, cable MSO, satellite broadcast, various Internet broadcasts, applications, etc. to the user.

Meanwhile, the service provider 20 can provide a service to the client 100 using a unicast or multicast method. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in a unicast method, when a receiver requests data from a server, the server can transmit data to the receiver upon request. The multicast method is a method of transmitting data to a plurality of receivers of a specific group. For example, the server can transmit data to a plurality of pre-registered receivers at once. An Internet Group Management Protocol (IGMP) protocol may be used for multicast registration.

The network provider 30 may provide a network for providing services to the client 100. The client 100 may be provided with a service by building a home network end user (HNED).

As a means for protecting contents transmitted in the network TV system as described above, conditional access or content protection may be used. As an example of such restriction reception or content protection, a scheme such as a cable card (CableCARD) and a DCAS (Downloadable Conditional Access System) may be used.

On the other hand, the client 100 can also provide the content through the network. In this case, conversely, conversely, conversely, the client 100 may be a content provider, and the content provider 10 may receive content from the client 100. [ In this case, there is an advantage that an interactive content service or a data service is possible.

2 is a diagram schematically showing another example of an entire broadcasting system including a network TV according to another embodiment of the present invention.

As shown in FIG. 2, the network TV 100 according to another embodiment of the present invention is connected to a broadcast network and an Internet network. The network TV 100 is, for example, a network TV, a smart TV, an HBBTV, or the like.

The network TV 100 includes a broadcast interface 101, a section filter 102, an AIT filter 103, an application data processing section 104, a broadcast data processing section 111, a media player 106, An Internet protocol processing unit 107, an Internet interface 108, and a runtime module 109. [

Application information table (AIT) data, real-time broadcast content, application data, and stream events are received through the broadcast interface 101. Meanwhile, the real-time broadcast content may be referred to as Linear A / V content.

The section filter 102 performs section filtering on four pieces of data received through the broadcast interface 101 to transmit the AIT data to the AIT filter 103. The linear AV contents are transmitted to the broadcast data processing unit 111, And transmits the stream event and application data to the application data processing unit 104. [

Non-Linear A / V content and application data are received through the Internet interface 108. [ The non-linear AVE content may be, for example, a COD (Content On Demand) application.

The non-Linear Above content is transmitted to the media player 106, and the application data is transmitted to the runtime module 109.

Further, the runtime module 109 includes, for example, an application manager and a browser as shown in FIG. The application manager controls the life cycle for the interactive application using, for example, AIT data. The browser performs, for example, the function of displaying and processing the interactive application.

FIG. 3 is a diagram illustrating a step in which the network TV shown in FIG. 1 or FIG. 2 connects to a service provider and receives channel information or the like. Of course, FIG. 3 is an embodiment, and the scope of the present invention is not limited by the method of FIG.

The service provider performs a service provider discovery operation (S301). The network TV transmits an SP connection request (Service Provider Attachment Request) signal (S302). When the SP connection is completed, the network TV receives the provisioning information (S303). Further, the network TV receives the master SI table from the service provider (S304), receives the Virtual Chnnanel Map table (S305), receives the Virtual Channel Description table (S306), and receives the source table (S307 ).

More specifically, the following will be described.

The service provider discovery may refer to a process in which service providers providing services related to IPTV find a server providing information on their services.

There are three methods for finding an address list that can receive information (for example, SP discovery information) about an SD (service discovery) server, for example, as follows. First, an address preset to the network TV or an address set by the user's manual operation can be used. Second, you can use the DHCP-based SP discovery method. Third, DNS SRV-based SP discovery method can be used. Also, the network TV accesses a server of an address obtained by any one of the above three methods, and receives a service provider discovery record containing information necessary for service discovery by SP. Then, the service searching step is carried out using this. These processes are available in either push mode or pull mode.

Access the SP attachment server specified as the SP attachment locator of the SP discovery record and perform the registration procedure (or service attachment procedure).

Further, a separate authentication procedure may be performed by accessing the authentication service server of the SP designated as the SP authentication locator, and then the service authentication procedure may be performed.

On the other hand, the data transmitted from the server to the network TV after the success of the service attachment procedure may be in the form of a provisioning information table.

In the service attachment process, the network TV provides its own ID and location information to the data transmitted to the server, and the service attachment server can specify the service to which the network TV subscribes based on the ID and the location information. Further, the address information for obtaining the service information to be received by the network TV is provided in the form of a provisioning information table. The address information corresponds to the connection information of the master SI table. When such a method is used, it is easy to provide customized services for each subscriber.

The service information includes a master SI table record for managing connection information and version for a virtual channel map, a virtual channel map table for providing a service list of a package type, and a virtual channel description table , And a source table containing access information to access the actual service.

4 is a diagram showing an example of data used in the steps shown in FIG.

Figure 4 is a more detailed illustration of Figure 3. Hereinafter, the relationship of the data in the SI will be described with reference to FIG.

The master SI table contains location information for each virtual channel map and version information of each virtual channel map.

Each virtual channel map is uniquely identified by a virtual channel map identifier, and the virtual channel map version represents version information of the virtual channel map. When any one of all tables connected in the arrow direction starting from the master SI table shown in FIG. 4 is changed, the version of all the upper tables (up to the master SI table) increases with the version increase of the corresponding table. Therefore, by monitoring the master SI table, it is possible to immediately check the change in the entire SI table.

For example, if a change occurs in the source table, the version of the source table is incremented, and the version of the virtual channel description table that references the source table is also changed. Therefore, a change of the lower table causes a change of the upper table, and ultimately the version of the master SI table is changed.

There may be one Master SI table per service provider. However, when the configuration of the service is different according to the region or the subscriber (or subscriber group), the service provider designes a plurality of master SI tables to provide a customized service for each unit. In such a case, it is possible to efficiently provide a customized service according to the subscriber's region and subscription information through the master SI table.

The virtual channel map table may have one or more virtual channels, and may include location information that can acquire the detailed information, rather than including detailed channel information in the virtual channel map. The virtual channel description location of the virtual channel map table indicates the location of the virtual channel description table including the channel detail information.

The virtual channel description table includes detailed information of the virtual channel, and can access the virtual channel desctiprion table using the virtual channel description location of the virtual channel map table.

The source table provides connection information (for example, IP address, port, AV codec, transmission protocol, etc.) necessary for accessing the actual service on a service-by-service basis.

The master SI table, the virtual channel map table, the virtual channel description table, and the source table described above are logically transmitted through four separate flows, and both the push mode and the pull mode are available. On the other hand, the master SI table can be transmitted in multicast for version management, and receives the multicast stream to monitor the version change.

FIG. 5 is a diagram showing an example of the network TV shown in FIG. 1 or FIG. 2 in more detail. However, the drawing shown in FIG. 5 is only an embodiment, and the scope of rights of the present invention should be determined in principle by the claims rather than FIG.

The network TV 700 includes a network interface 701, a TCP / IP manager 702, a service delivery manager 703, a demultiplexer 705 A PSI & PSIP and / or SI decoder 704, an audio decoder 706, a video decoder 707, a display A / V and OSD module 708, A service control manager 709, a service discovery manager 710, a metadata manager 712, an SI & metadata database 711, a UI manager 714, (713), and the like.

The network interface unit 701 receives packets received from the network and transmits the packets to the network. That is, the network interface unit 701 receives services, contents, and the like from the service provider through the network.

The TCP / IP manager 702 is involved in delivering a packet to the network TV 700 and the packet transmitted from the network TV 700, that is, from the source to the destination. The TCP / IP manager 702 classifies the received packets so as to correspond to the appropriate protocols and classifies them into the service delivery manager 705, the service discovery manager 710, the service control manager 709, and the metadata manager 712 Lt; / RTI >

The service delivery manager 703 is responsible for controlling the received service data. For example, RTP / RTCP can be used to control real-time streaming data. When the real-time streaming data is transmitted using the RTP, the service delivery manager 703 parses the received data packet according to the RTP and transmits it to the demultiplexer 705 or to the control of the service manager 713 And stores it in the SI & Metadata DB 711. And feedbacks the network reception information to the server providing the service using the RTCP.

The demultiplexer 705 demultiplexes the received packets into audio, video, program specific information (PSI) data, and transmits them to the audio / video decoders 706 and 707 and the PSI & PSIP and / do.

The PSI & PSIP and / or SI decoder 704 decodes service information such as PSI (Program Specific Information), for example. That is, the PSI & PSIP and / or SI decoder 704 receives and decodes the demultiplexed PSI section, the Program and Service Information Protocol (PSIP) section, or the SI (Service Information) section in the demultiplexer 705.

In addition, the PSI & PSIP and / or SI decoder 704 decodes the received sections to create a database of service information, and stores the database of the service information in the SI & Metadata DB 711.

The audio / video decoder 706/707 decodes the video data and audio data received from the demultiplexer 705. The audio data decoded by the audio decoder 706 and the video data decoded by the video decoder 707 are provided to the user through the display unit 708. [

The UI manager 714 and the service manager 713 manage the overall state of the network TV 700, provide a user interface, and manage other managers.

The UI manager 714 provides a GUI (Graphic User Interface) for a user using an OSD (On Screen Display) or the like, and receives a key input from a user to perform a receiver operation according to the input. For example, upon receipt of a key input from the user regarding channel selection, the key input signal is transmitted to the service manager 713.

The service manager 713 controls the manager associated with the service, such as the service delivery manager 703, the service discovery manager 710, the service control manager 709, and the metadata manager 712.

In addition, the service manager 713 creates a channel map and selects a channel using the channel map according to a key input received from the user interface manager 714. The service manager 713 receives the service information of the channel from the PSI & PSIP and / or SI Decoder 704 and sets an audio / video PID (Packet Identifier) of the selected channel in the demultiplexer 705.

The service discovery manager 710 provides information necessary for selecting a service provider that provides the service. Upon receiving a signal regarding channel selection from the service manager 713, the service discovery manager 710 searches for the service using the information.

The service control manager 709 is responsible for selection and control of services. For example, when a user selects a service such as IGMP or RTSP when selecting a Live Broadcasting service such as an existing broadcasting method and selects a service such as VOD (Video On Demand), RTSP is used to select a service, control . The RTSP protocol may provide a trick mode for real-time streaming. Also, the service control manager 709 can initialize and manage a session through the IMC gateway using an IP Multimedia Subsystem (IMS) and a Session Initiation Protocol (SIP). The protocols are one embodiment, and other protocols may be used, depending on the implementation.

The metadata manager 712 manages the metadata associated with the service and stores the metadata in the SI & Metadata DB 711.

The SI & Metadata DN 711 selects the service information decoded by the PSI & PSIP and / or SI Decoder 704, the metadata managed by the metadata manager 712, and the service provider provided by the service discovery manager 710 Store the necessary information. In addition, the SI & Metadata DB 711 may store set-up data and the like for the system.

The SI & Metadata DB 711 may be implemented using a Nonvolatile RAM (NVRAM) or a flash memory.

Meanwhile, the IG 750 is a gateway that collects functions necessary for accessing an IMS-based IPTV service.

FIG. 6 is a view showing in further detail another example of the network TV shown in FIG. 1 or FIG.

6, a network TV 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user input interface unit 150, A display unit 180, an audio output unit 185, a power supply unit 190, and a photographing unit (not shown). The broadcast receiving unit 105 may include a tuner 110, a demodulator 120, and a network interface unit 130. Of course, the tuner 110 and the demodulator 120 may be provided, but the network interface 130 may not be included. Alternatively, the tuner 110 and the demodulator 120 may be included, It is also possible to design the demodulation unit 120 not to include it.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 can process both a digital broadcast signal and an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 110 can be directly input to the controller 170.

Also, the tuner 110 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner 110 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs 8-VSB (8-Vestigal Side Band) demodulation, for example. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs CODDMA (Coded Orthogonal Frequency Division Modulation) demodulation, for example. Also, the demodulation unit 120 may perform channel decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulating unit 120 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs the video to the display unit 180 and audio to the audio output unit 185.

The external device interface unit 135 can connect the network TV 100 with an external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface unit 135 transmits external video, audio or data signals to the control unit 170 of the network TV 100 through the connected external device. Also, the control unit 170 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V I / O unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The network TV 100 may be a wireless LAN device such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (UDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) And the like.

Also, the external device interface unit 135 may be connected to the various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

Meanwhile, the external device interface unit 135 may receive the application or application list in the adjacent external device, and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The network interface unit 130 provides an interface for connecting the network TV 100 to a wired / wireless network including the Internet network. The network interface unit 130 may include an Ethernet terminal or the like for connection to a wired network and may be a WLAN (Wireless LAN) (Wi- Fi wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 130 can transmit or receive data with other users or other electronic devices via a network connected thereto or another network linked to the connected network. Particularly, it is possible to transmit some content data stored in the network TV 100 to another user registered in advance in the network TV 100 or a selected user or selected electronic device among other electronic devices.

On the other hand, the network interface unit 130 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 130 can select and receive a desired application among applications open to the public via a network.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

The storage unit 140 may also function to temporarily store video, audio, or data signals input from the external device interface unit 135 or the network interface unit 130. In addition, the storage unit 140 may store information on a predetermined broadcast channel through the channel memory function.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 130. [

In addition, the storage unit 140 may store various platforms to be described later.

The storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD Memory, etc.), RAM, ROM (EEPROM, etc.), and the like. The network TV 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

FIG. 6 shows an embodiment in which the storage unit 140 is provided separately from the control unit 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be configured to turn on / off the power, select the channel, and display the screen from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared Or a control signal from the control section 170 to the remote control apparatus 200. The remote control apparatus 200 may be configured to receive the control signal from the control section 170,

Also, for example, the user input interface unit 150 can transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

For example, the user input interface unit 150 may transmit a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 170, or may sense a signal from the control unit 170 (Not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 135 to generate a signal for video or audio output Can be generated and output.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 6, the control unit 170 may include a demultiplexing unit, an image processing unit, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control overall operation in the network TV 100. [ For example, the control unit 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 may control the network TV 100 by a user command or an internal program input through the user input interface unit 150. In particular, it is possible to connect to the network and download a list of applications or applications desired by the user to the network TV 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. And processes video, audio or data signals of the selected channel. The control unit 170 allows the display unit 180 or the audio output unit 185 to output the video or audio signal processed by the user through the channel information or the like selected by the user.

For example, the control unit 170 may control the operation of the external device through the external device interface unit 135, for example, a camera or a camcorder, according to an external device video playback command received through the user input interface unit 150 So that the video signal or the audio signal of the audio signal output through the display unit 180 or the audio output unit 185 can be outputted.

Meanwhile, the control unit 170 may control the display unit 180 to display an image. For example, a broadcast image input through the tuner 110, an external input image input through the external device interface unit 135, an image input through the network interface unit, or an image stored in the storage unit 140 , And display on the display unit 180 can be controlled. At this time, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the control unit 170 can control to reproduce the content. The content at this time may be content stored in the network TV 100, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, in connection with the embodiment of the present invention, the control unit 170 can control the display unit 180 to display a home screen according to movement input to the home screen.

The home screen may include a plurality of card objects classified by content sources. The card object includes a card object representing a thumbnail list of broadcast channels, a card object representing a broadcast guide list, a card object representing a broadcast reservation list or a recording list, and a media list in a device connected to the network TV or the network TV A card object, and a card object. In addition, it may further include at least one of a card object indicating a list of connected external devices and a card object indicating a list related to a call.

Further, the home screen may further comprise an application menu having at least one executable application item.

On the other hand, when there is a card object movement input, the control unit 170 can control to move and display the card object or move and display the card object that is not displayed on the display unit 180 on the display unit 180 .

On the other hand, when a predetermined card object among a plurality of card objects in the home screen is selected, the control unit 170 can control the display unit 180 to display an image corresponding to the card object.

On the other hand, the control unit 170 can control to display a received broadcast image and an object representing the broadcast-related information in the card object for displaying the broadcast image. The broadcast image can be controlled so that its size is fixed by the lock setting.

On the other hand, the control unit 170 controls to display a set-up object for setting at least one of video setting, audio setting, screen setting, reservation setting, pointer setting of the remote control device, and network setting in the network TV in the home screen can do.

On the other hand, the control unit 170 may control to display objects for login, help, or exit items in one area of the home screen.

On the other hand, the control unit 170 can control to display the total number of card objects in one area of the home screen or an object representing the number of card objects displayed on the display unit 180 among all the card objects.

On the other hand, when the card object name in the predetermined card object among the card objects displayed on the display unit 180 is selected, the control unit 170 can control the display unit 180 to display the corresponding card object as a full screen.

On the other hand, when an incoming call is received in the connected external device or network TV, the control unit 170 may focus and display the call related card object among the plurality of card objects, move the call related card object into the display unit 180 So that the display can be controlled.

On the other hand, when entering the application view item, the control unit 170 can control to display a list of applications or applications that can be downloaded from the network TV 100 or from an external network.

The control unit 170 can control, in addition to various user interfaces, to install and operate an application downloaded from the external network. Further, it is possible to control so that an image related to the executed application is displayed on the display unit 180 by the user's selection.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided.

The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 135 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be directly or encoded and input to the controller 170. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display unit 180 using the input thumbnail images. On the other hand, the thumbnail images in this thumbnail list can be updated in sequence or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the control unit 170 or a video signal and a data signal received from the external device interface unit 135 into R, G, and B signals, respectively Thereby generating a driving signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

Meanwhile, the display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the control unit 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

In order to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, an audio sensor, a position sensor, and an operation sensor may be further included in the network TV 100 . A signal sensed by a sensing unit (not shown) may be transmitted to the controller 170 through the user input interface unit 150.

On the other hand, a photographing unit (not shown) for photographing a user may be further provided. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The control unit 170 may sense the gesture of the user by combining the images photographed by the photographing unit (not shown) or the signals sensed by the sensing unit (not shown).

The power supply unit 190 supplies corresponding power to the network TV 100.

Particularly, it is possible to supply power to a control unit 170 that can be implemented in the form of a system on chip (SOC), a display unit 180 for displaying an image, and an audio output unit 185 for audio output .

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. Meanwhile, for example, when the display unit 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) that can perform a PWM operation for variable luminance or dimming driving is further provided It is possible.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote control apparatus 200 can receive the video, audio or data signal output from the user input interface unit 150 and display it on the remote control apparatus 200 or output sound or vibration.

The network TV 100 described above can be used as a fixed-type digital broadcasting, an ATSC (8-VSB) digital broadcasting, a DVB-T (COFDM) digital broadcasting and an ISDB-T (BST- And may be a digital broadcast receiver capable of receiving at least one.

Meanwhile, a block diagram of the network TV 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the network TV 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

6, the network TV 100 does not include the tuner 110 and the demodulation unit 120 shown in FIG. 6, and the network interface unit 130 or the external device interface unit 135, It is possible to receive and reproduce the image content.

The network TV 100 is an example of a video signal processing apparatus that performs signal processing of an image stored in a device or an input image. Another example of the video signal processing apparatus includes a display unit 180 shown in FIG. 6, A set-top box excluding the audio output unit 185, a DVD player, a Blu-ray player, a game machine, a computer, and the like may be further exemplified. The set-top box will be described with reference to Figs. 7 and 8 below.

FIG. 7 and FIG. 8 are diagrams showing one of the network TVs according to the embodiments of the present invention as a set-top box and a display device.

First, referring to Fig. 7, the set-top box 250 and the display device 300 can transmit or receive data by wire or wirelessly.

The set top box 250 may include a network interface unit 255, a storage unit 258, a signal processing unit 260, a user input interface unit 263, and an external device interface unit 265.

The network interface unit 255 provides an interface for connection to a wired / wireless network including the Internet network. It can also transmit or receive data to other users or other electronic devices via the connected network or other network linked to the connected network.

The storage unit 258 may store a program for each signal processing and control in the signal processing unit 260 or may store a video, It may perform a function for temporary storage of a signal. In addition, the storage unit 258 may store the platform shown in Figs. 11 and 12, which will be described later.

The signal processing unit 260 performs signal processing of an input signal. For example, it is possible to demultiplex or decode an input video signal, and perform demultiplexing or decoding of an input audio signal. To this end, a video decoder or a voice decoder may be provided. The processed video signal or audio signal can be transmitted to the display device 300 through the external device interface unit 265. [

The user input interface unit 263 transfers a signal input by the user to the signal processing unit 260 or a signal from the signal processing unit 260 to the user. For example, various control signals, such as power on / off, operation input, and setting input, input through a local key (not shown) or the remote control device 200, may be received and transmitted to the signal processing unit 260.

The external device interface unit 265 provides an interface for transmitting or receiving data with an external device connected by wire or wirelessly. In particular, it provides an interface for transmitting or receiving data with the display device 300. It is also possible to provide an interface for data transmission or reception with an external device such as a game device, a camera, a camcorder, a computer (notebook computer) or the like.

The set-top box 250 may further include a media input unit (not shown) for playing a separate media. An example of such a media input unit is a Blu-ray input unit (not shown) or the like. That is, the set-top box 250 can include a Blu-ray player. The input media such as a Blu-ray disc can be transmitted to the display device 300 via the external device interface 265 for display after signal processing such as demultiplexing or decoding in the signal processor 260 .

The display device 300 includes a tuner 270, an external device interface unit 273, a demodulator 275, a storage unit 278, a control unit 280, a user input interface unit 283, a display unit 290, And an audio output unit 295, as shown in FIG.

The tuner 270, the demodulation unit 275, the storage unit 278, the control unit 280, the user input interface unit 283, the display unit 290, and the audio output unit 295, The user interface unit 150, the display unit 180, and the audio output unit 185 of the tuner 110, the demodulator 120, the storage unit 140, the controller 170, .

On the other hand, the external device interface unit 273 provides an interface for data transmission or reception with an external device connected by wire or wirelessly. In particular, it provides an interface for transmitting or receiving data with the set-top box 250.

Accordingly, a video signal or a voice signal input through the set-top box 250 is output through the display unit 180 or the audio output unit 185 via the control unit 170.

8, the set-top box 250 and the display apparatus 300 are the same as the set-top box 250 and the display apparatus 300 shown in FIG. 7, except that the set- There is a difference in that the position of the projection 275 is located within the set-top box 250 rather than the display device 300. [ Hereinafter, the difference will be mainly described.

The signal processing unit 260 may perform signal processing of a broadcast signal received through the tuner 270 and the demodulation unit 275. Also, the user input interface unit 263 can receive inputs such as channel selection, channel storage, and the like.

9 is a diagram for explaining a process in which any one of the network TVs according to the embodiments of the present invention communicates with third devices. The network TV shown in Fig. 9 can correspond to any one of the network TVs according to the embodiments of the present invention described above.

9, the network TV 100 according to an embodiment of the present invention may communicate with the broadcasting station 210, the network server 220, or the external device 230. [

The network TV set 100 may receive a broadcasting signal including a video signal transmitted from the broadcasting station 210. The network TV 100 may process a video signal, a voice signal, or a data signal included in the broadcast signal so as to be suitable for output from the network TV 100. [ The network TV 100 can output video or audio based on the processed video signal.

Meanwhile, the network TV 100 can communicate with the network server 220. The network server 220 is a device capable of transmitting and receiving signals to / from the network TV 100 through an arbitrary network. For example, the network server 220 may be a mobile phone terminal that can be connected to the network TV 100 through a wired or wireless base station. Also, the network server 220 may be a device capable of providing contents to the network TV 100 through the Internet network. The content provider can provide the content to the network TV 100 using the network server.

On the other hand, the network TV 100 can communicate with the external device 230. The external device 230 is a device capable of directly transmitting / receiving signals to / from the network TV 100 by wire or wirelessly. For example, the external device 230 may be a media storage device or a playback device used by a user. That is, the external device 230 corresponds to, for example, a camera, a DVD or a Blu-ray player, or a personal computer.

The broadcast station 210, the network server 220, or the external device 230 may transmit a signal including a video signal to the network TV 100. The network TV 100 can display an image based on a video signal included in an input signal. The network TV 100 may transmit a signal transmitted from the broadcasting station 210 or the network server 220 to the network TV 100 to the external device 230. In addition, a signal transmitted from the external device 230 to the network TV 100 may be transmitted to the broadcasting station 210 or the network server 220. That is, the network TV 100 has a function of directly reproducing contents included in signals transmitted from the broadcasting station 210, the network server 220, and the external device 230 on the network TV 100, .

10 is an internal block diagram of the control unit shown in FIG. Referring to FIGS. 10 and 6, the following will be described.

The controller 170 according to an exemplary embodiment of the present invention includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355, 360). A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 135.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display unit 180.

The video decoder 325 can include a decoder of various standards.

For example, if the demultiplexed video signal is an MPEG-2 standard encoded video signal

And can be decoded by an MPEG-2 decoder.

Also, for example, if the demultiplexed video signal is an encoded video signal of the H.264 standard according to the DMB (Digital Multimedia Broadcasting) scheme or DVB-H, it can be decoded by the H.264 decoder.

Meanwhile, the video signal decoded by the video processor 320 is input to the mixer 350.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a control signal from the user input interface unit 150, a signal for displaying various kinds of information in a graphic or text format can be generated on the screen of the display unit 180. The generated OSD signal may include various data such as a user interface screen of the network TV 100, various menu screens, a widget, and an icon.

For example, the OSD generating unit 340 may generate a signal for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 220. The mixed signal is provided to formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

A frame rate converter (FRC) 355 can convert a frame rate of an input image. For example, a frame rate of 60 Hz is converted to 120 Hz or 240 Hz. When converting the frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame between the first frame and the second frame, or insert the third frame predicted from the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or insert three predicted frames. On the other hand, it is also possible to maintain the input frame rate without performing another conversion.

The formatter 360 receives the output signal of the frame rate conversion unit 355 and changes the format of the signal to be suitable for the display unit 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

When a demultiplexed speech signal is a coded speech signal, the speech processing unit (not shown) in the control unit 170 can decode the demultiplexed speech signal. For example, the demultiplexed speech signal may be decoded by an MPEG-2 decoder, an MPEG 4 decoder, an AAC decoder, or an AC-3 decoder.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme and may include DVB-SI information in the DVB scheme .

The ATSC-PSIP information or the DVB-SI information may be information included in the above-described stream, that is, the header (4 bytes) of the MPEG-2 TS.

Meanwhile, since the block diagram of the controller 170 shown in FIG. 10 is a block diagram for an embodiment of the present invention, it is also possible to add other modules according to needs of those skilled in the art, or to omit some of the modules shown.

11 is a diagram showing an example of any one of platform structures of network TVs according to the embodiments of the present invention.

12 is a diagram showing another example of the structure of any one of the network TVs according to the embodiments of the present invention.

Any one of the network TVs according to the embodiments of the present invention may include OS-based software to perform the various operations described above.

11, any one of the visual indicators according to embodiments of the present invention is a separate platform, including a legacy system platform 400 and a smart system platform 405 Can be designed separately. The OS kernel 410 can be commonly used in the legacy system platform 400 and the smart system platform 405.

The legacy system platform 400 may include a driver 420 on the OS kernel 410, a middleware 430, and an application layer 450.

On the other hand, the smart system platform 405 may include a library 435, a framework 440, and an application layer 455 on the OS kernel 410.

The OS kernel 410 is a core of an operating system. It is a core of an operating system. It is used to drive hardware drivers, hardware and processor security in a network TV, efficient management of system resources, memory management, hardware by hardware abstraction Provision of an interface for a multi-process, and management of a schedule according to a multi-process. Meanwhile, the OS kernel 410 may further provide power management and the like.

The hardware driver in the OS kernel 410 may include at least one of a display driver, a Wi-Fi driver, a Bluetooth driver, a USB driver, an audio driver, a Power management, a Binder driver, .

The hardware driver in the OS kernel 410 is a driver for a hardware device in the OS kernel 410 and includes a character device driver, a block device driver, and a network device driver dirver. Since a block device driver transfers data in units of specific blocks, a buffer for storing a unit size may be required. The character device driver may transmit a basic data unit, i.e., a character unit, so that a buffer may not be needed.

The OS kernel 410 may be implemented in various operating system (OS) based kernels such as UNIX based (Linux) and Windows based. The OS kernel 410 is an open OS kernel, and can be general-purpose which can be used in other electronic devices.

The driver 420 is located between the OS kernel 410 and the middleware 430 and drives the device along with the middleware 430 for operation of the application layer 450. For example, the driver 420 may include a microcomputer, a display module, a graphics processing unit (GPU), a frame rate converter (FRC), a general purpose input / output pin (GPIO) , A driver such as an SDEC (System Decoder or Demultiplexer), a VDEC (Video Decoder), an ADEC (Audio Decoder), a PVR (Personal Video Recorder), or an I2C (Inter-Integrated Circuit). These drivers operate in conjunction with hardware drivers in the OS kernel 410. [

Further, the driver 420 may further include a remote control device 200, in particular, a driver for a space remote controller, which will be described later. In addition, the driver of the space remote controller may be variously provided in the OS kernel 410 or the middleware 430, in addition to the driver 420.

The middleware 430 is located between the OS kernel 410 and the application layer 450 and can serve as intermediary between other hardware or software to exchange data. Thus, it is possible to provide a standardized interface, various environment support, and system can interoperate with other tasks.

Examples of the middleware 430 in the legacy system platform 400 may be middleware of MHEG (Multimedia and Hypermedia information Coding Experts Group) and ACAP (Advanced Common Application Platform) which are data broadcasting related middleware. Or SI middleware, and peripheral communication related middleware DLNA middleware.

The application layer 450 on the middleware 430 or the application 450 layer in the legacy system platform 400 includes a User Interface Application for various menus and the like in the network TV 100, can do. The application layer 450 on this middleware 430 may be editable by the user's choice and may be updated over the network. By using the application layer 450, it is possible to enter a desired menu among various user interfaces according to the input of the remote control device while watching the broadcast video.

The application layer 450 within the legacy system platform 400 may also include at least one of a TV guide application, a Bluetooth application, a reservation application, a Digital Video Recorder (DVR) application, .

Meanwhile, the library 435 in the smart system platform 405 is located between the OS kernel 410 and the framework 440, and can form the basis of the framework 440. For example, the library 435 may include a security related library such as Secure Socket Layer (SSL), WebKit (WebKit) related to Web engine, libc (c library), video format and audio format A media framework such as a media-related library, and the like. Such a library 435 may be written on a C or C ++ basis. It can also be exposed to the developer through the framework 440.

The library 435 may include a runtime 437 having a core Java library and a virtual machine (VM). This runtime 437 forms the basis of the framework 440 along with the library 435.

The virtual machine (VM) can be a plurality of instances, that is, a virtual machine that can perform multitasking. On the other hand, each virtual machine (VM) may be allocated and executed in accordance with each application in the application layer 455, at which time a binder (not shown) in the OS kernel 410, for scheduling or inter- Binder) driver (not shown) may be operated.

Meanwhile, the binder driver and the runtime 437 can connect a Java-based application and a C-based library.

On the other hand, the library 435 and the runtime 437 can correspond to the middleware of the legacy system.

On the other hand, the framework 440 in the smart system platform 405 includes a program that is the basis of the application in the application layer 455. [ The framework 440 is compatible with any application and may be capable of reusing, moving or exchanging components. The framework 440 may include a support program, a program for weaving other software components, and the like. For example, a resource manager, an activity manager associated with an activity of an application, a notification manager, a content provider that summarizes shared information between applications, and the like . Such a framework 440 can be created based on Java (JAVA).

The application layer 455 on the framework 440 includes various programs that are driven and displayed within the network TV 100. For example, a Core Application having at least one of an email, a short message service (SMS), a calendar, a map, a browser, etc. . This application layer 450 may be created on a Java (JAVA) basis.

The application layer 455 also includes an application 465 that is stored in the network TV 100 and can not be deleted by the user, an application 465 that is downloaded and stored via an external device or network, ).

(VOD) service, a web album service, a social networking service (SNS), a location-based service (LBS), a map service, a web search Service, an application search service, and the like may be performed. In addition, various functions such as game and schedule management can be performed.

12, any one of the network TVs according to one embodiment of the present invention is an integrated platform, and includes an OS kernel 510, a driver 520, a middleware A middleware 530, a framework 540, and an application layer 550.

The platform of FIG. 12 differs from FIG. 11 in that the library 435 shown in FIG. 11 is omitted and the application layer 550 is provided as an integrated layer. In addition, the driver 520 and the framework 540 correspond to Fig.

On the other hand, it is possible to design the library 435 shown in FIG. 11 to be merged with the middleware 530 shown in FIG. That is, the middleware 530 is middleware under the legacy system, middleware of MHEG or ACAP, middleware of PSIP or SI, middleware of broadcasting information, DLNA middleware which is middleware related to peripheral communication,

Middleware under the device system can include SSL (Secure Socket Layer) which is a security related library, WebKit (WebKit) which is a web engine related library, libc, and a media framework which is a media related library. On the other hand, it may further include the above-described runtime.

The application layer 550 may be an application under the legacy system, including menu related applications, TV guide applications, reservation applications, etc., and may include email, SMS, calendars, maps, browsers, etc. as applications under the network TV system .

On the other hand, the application layer 550 includes an application 565 that is stored in the network TV 100 and can not be deleted by the user, an application 575 that is downloaded and stored via an external device or network, ).

On the other hand, various application programming interfaces (APIs) and software development kits (SDKs) necessary for application development can be opened based on the platforms of FIGS. 11 and 12 described above. APIs, on the other hand, can be implemented by calling a function that provides a connection to a particular subroutine for execution within the program.

For example, a source related to a hardware driver in the OS kernel 410 such as a display driver, a Wi-Fi driver, a Bluetooth driver, a USB driver, or an audio driver may be opened, A related source in a driver 420 such as a graphics processing unit (GPU), a frame rate converter (FRC), an SDEC, a VDEC, an ADEC or a space remote controller is opened or a PSIP or SI middleware related to broadcasting information, The source associated with the middleware can be opened.

The developers and the like are able to operate in the network TV 100 or to develop applications for controlling the operation of the network TV 100 based on the platforms of Figs. 11 and 12 described above do.

The above-described platforms of Figs. 11 and 12 can be used for general purpose in various electronic apparatuses as well as network TVs. 11 and 12 may be stored or loaded in the storage unit 140 or the control unit 170 or the separate processor (not shown) shown in FIG. 6, The SI & meta data DB 711, the UI manager 714, and the service manager 713, as shown in FIG. In addition, a separate application processor (not shown) for executing an application may be further provided.

13 is a diagram illustrating a control method of a remote control device for controlling any one of network TVs according to embodiments of the present invention.

13A illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. As shown in FIG.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 13 (b)), and back and forth (Fig. 13 (c)). The pointer 205 displayed on the display unit 180 of the network TV corresponds to the movement of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

13B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display unit 180 of the network TV also shifts to the left corresponding thereto.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the network TV. The network TV can calculate the coordinates of the pointer 205 from information on the motion of the remote control device 200. [ The network TV can display the pointer 205 so as to correspond to the calculated coordinates.

13C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is pressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed. On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control apparatus 200 moves away from or approaches the display unit 180, it is possible to recognize only the forward and backward movement without recognizing the upward and downward movement. Only the pointer 205 is moved in accordance with the upward / downward and leftward / rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to one of the horizontal axis and the vertical axis on the display unit 180 as well as corresponding to a plurality of points such as a line and a surface .

14 is an internal block diagram of a remote control device for controlling any one of the network TVs according to the embodiments of the present invention.

The remote control device 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, And may include a control unit 280.

The wireless communication unit 225 transmits / receives a signal to / from any one of the network TVs according to the embodiments of the present invention described above. Among the network TVs according to the embodiments of the present invention, one network TV 100 will be described as an example.

In this embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving signals to / from the network TV 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving signals with the network TV 100 according to the IR communication standard.

In this embodiment, the remote control device 200 transmits a signal containing information on the motion of the remote control device 200 to the network TV 100 through the RF module 221.

In addition, the remote control device 200 can receive the signal transmitted by the network TV 100 through the RF module 221. [ Also, the remote control device 200 can transmit a command regarding power on / off, channel change, volume change, and the like to the network TV 100 through the IR module 223 as needed.

The user input unit 235 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the network TV 100 to the remote control device 200 by operating the user input unit 235. [ When the user input unit 235 has a hard key button, the user can input a command related to the network TV 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 235 has a touch screen, the user may touch a soft key of the touch screen to input a command related to the network TV 100 to the remote control device 200. [ In addition, the user input unit 235 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243.

The gyro sensor 241 can sense information on the motion of the remote control device 200. [

For example, the gyro sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 243 can sense information on the moving speed of the remote control device 200 and the like. Meanwhile, a distance measuring sensor may be additionally provided, so that the distance to the display unit 180 can be sensed.

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the network TV 100. [ The user can recognize whether the user input unit 235 is operated or whether the network TV 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when a user input unit 235 is operated or a signal is transmitted / received to / from the network TV 100 through the wireless communication unit 225, a vibration module 253 An audio output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce the power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control apparatus 200 wirelessly transmits and receives a signal through the network TV 100 and the RF module 221, the remote control station 200 and the network TV 100 transmit and receive signals through a predetermined frequency band . The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving a signal with the network TV 100 paired with the remote control station 200 in the storage unit 270, can do.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240 to the network TV 100).

15 is a diagram illustrating a first embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.

16 is a diagram illustrating a second embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.

17 is a diagram illustrating a third embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.

18 is a diagram illustrating a fourth embodiment of a user interface provided by any one of the network TVs according to the embodiments of the present invention.

Fig. 15 illustrates that a list of applications on the network is displayed on the display unit 180. Fig. That is, it is possible for the user to directly access the content server or the network server to search for and download various applications.

FIG. 15A illustrates that various application lists 610 in a connected server are displayed on the display unit 180. FIG. The application list 610 may include an icon representing each application and a brief description information for each application. Meanwhile, since the network TV according to the embodiments of the present invention is capable of full browsing, it is possible to enlarge and display the size of icon or explanation information received from the connected server. Thus, the user can easily grasp the application item. This will be described later.

Next, FIG. 15 exemplifies selection of any one of the application items 620 of the application list 610 by using the pointer 205 of the remote control device 200. FIG. As a result, the application can be easily downloaded.

On the other hand, Fig. 16 illustrates that an application list in the network TV is displayed on the display unit 180. Fig. 16A shows an application list 660 stored in the network TV according to the embodiments of the present invention when the user enters the application list view item by the operation of the remote control device 200 of the user. And a part displayed on the display unit 180 are exemplified. In the drawing, only the icon representing each application is illustrated, but the present invention is not limited thereto, and may include brief explanatory information for each application, as shown in FIG. Thus, the user can easily grasp the application item.

Next, FIG. 16B exemplifies selection of any one of the application items 660 of the application list 660 by using the pointer 205 of the remote control device 200. FIG. As a result, the application can be easily executed.

Meanwhile, it is illustrated that the pointer 205 moving according to the user's movement is moved to the remote control device 200 shown in Figs. 15 and 16 to select a predetermined item. In the embodiment of the present invention, Various other examples are possible without limitation. For example, a predetermined item can be selected by using the cursor displayed on the screen by the combination of the direction key and the confirmation key disposed in the remote control device 200 or the local key (not shown).

As another example, when the remote control apparatus includes a touch pad, the pointer 205 moves on the display unit 180 by the touch operation of the touch pad, and a predetermined item can be selected by using the pointer.

On the other hand, Fig. 17 illustrates that the web screen is displayed on the display unit of the network TV.

17A illustrates that a searchable predetermined web screen 710 having a search window 720 is displayed on the display unit 180. In this case, The user can use a character key (not shown) provided on a keypad (not shown) or a local key (not shown) displayed on the screen or a character key (not shown) 720, it is possible to input a predetermined character.

Next, FIG. 17B illustrates that a search result screen 730 according to a search word entered in the search window is displayed on the display unit 180. FIG. Since the network TV according to the embodiment of the present invention can perform full browsing when displaying a web screen, the user can easily grasp the web screen.

On the other hand, Fig. 18 illustrates that the web screen is displayed on the display unit of the network TV.

18A illustrates that a mail service screen 810 having an ID input window 820 and a password input window 825 is displayed on the display unit 180. [ The user can input an ID input window (not shown) using a character key (not shown) provided on a keypad (not shown) or a local key (not shown) displayed on the screen or a character key It is possible to input a predetermined character into the password input window 820 and the password input window 825. As a result, the user can log in to the corresponding mail service.

Next, FIG. 18B illustrates that a screen 830 after login to the mail service is displayed on the display unit 180. FIG. For example, items such as 'Read a letter', 'Write a letter', 'Sent', 'Inbox', and 'Trash' items can be illustrated. In addition, the 'Inbox' item is classified into 'From' item and 'Title' item, and the mail can be sorted and displayed.

The network TV according to the embodiment of the present invention can perform full browsing when displaying the mail service screen, so that the user can easily use the mail service.

19 is a diagram illustrating a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention. Hereinafter, referring to FIG. 19, detailed modules of a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described. The modules shown in Fig. 19 can be designed by software / hardware, or by combining software and hardware. Further, the modules shown in FIG. 19 are for illustrating an embodiment of the present invention, and the scope of the present invention should be determined by the claims in principle.

19, the network TV 1900 according to an exemplary embodiment of the present invention includes an interface 1920, a gesture recognition sensor 1930, an initial screen execution unit 1940, a display unit 1950, and the like. . Further, the initial screen execution unit 1940 includes a memory 1941, a first extraction unit 1942, a second extraction unit 1943, a control unit 1944, a first conversion unit 1945, (1947), and image processors (1946, 1948).

The interface 1920 is designed to enter an initial screen execution step when a power-on signal is applied to the network TV 1900. The module associated with the initial screen execution step corresponds to, for example, 1940 in Fig.

The first extractor 1942 extracts first image data that identifies each of a plurality of contents of a first type stored in the memory 1941. Further, the second extracting unit 1943 extracts second image data identifying each of the plurality of contents of the second type stored in the memory 1941. However, the memory 1941 may be, for example, an HDD, a flash memory, a USB memory, or the like.

If the number of the first image data that identifies each of the plurality of contents of the first type exceeds the displayable range in the first area of the initial screen, the first conversion unit 1945 converts the first image data, And is designed to convert at least one of the image data to a size smaller than the original size.

If the number of the second image data for identifying each of the plurality of contents of the second type exceeds the displayable range in the second area of the initial screen, the second conversion unit 1947 converts the second image data, And is designed to convert at least one of the image data to a size smaller than the original size.

The control unit 1944 controls the first area including specific first image data converted to a size smaller than the original size and the second area including specific second image data converted to a size smaller than the original size, To be displayed.

The above-described embodiment will be described later in detail with reference to FIG. 20 to FIG.

According to another embodiment of the present invention, when the first image data exceeding the displayable range in the first area is positioned at the right end of the first area, When cutting the right part of the specific first image data and positioning the specific first image data exceeding the displayable range in the first area at the left end of the first area, And an image processor 1946 for cutting a left portion of the image. In addition, the image processor 1946 may be configured to, when positioning specific first image data exceeding a displayable range in the first area at the top of the first area, And to cut a lower end portion of the specific first image data when specific first image data exceeding a displayable range in the first region is positioned at a lower end of the first region. The above-described embodiment will be described later in detail with reference to FIG. 23 to FIG.

In addition, for example, the first image data may be designed to move in the left or right direction or the up-and-down direction within the first area, and the second image data may be shifted in the left- Respectively.

When the interface 1920 receives a command signal for moving the first image data from right to left, the control unit 1944 controls the display unit 1940 to display, on the right side of the first area, The control unit controls the first image data to be displayed in a restored state to the original size and converts the next first image data previously stored in the memory to a size smaller than the original size so as to be displayed on the right end of the first area . The above-described embodiment will be described later in detail with reference to FIG.

In addition, according to another embodiment of the present invention, the network TV 1900 further includes a gesture recognition sensor 1930 for detecting a gesture of a user located in the front direction of the network TV, and the controller 1944 ) Moves the position of the first image data displayed in the first area in the horizontal direction or the vertical direction based on the direction corresponding to the motion of the first gesture and moves the position of the first image data based on the direction corresponding to the motion of the second gesture And moves the position of the second image data displayed in the second area left or right or up and down. The above-described embodiments will be described later in detail with reference to FIG. 28 to FIG.

The first image data described above corresponds to, for example, an icon for displaying an arbitrary application. The second image data described above corresponds to the graphic information of the application executed when the icon is selected, for example.

If the interface 1920 selects an icon corresponding to the first image data, the control unit 1944 stops displaying the icon in the first area, To display the graphic information of the executed application.

The range that can be displayed in the first area of the initial screen and the range that can be displayed in the second area of the initial screen are determined by a fixed value previously stored in the memory or a variation value set by the user of the network TV Lt; / RTI > The above-described embodiment will be described later in detail with reference to FIG. 31 and FIG.

20 is a diagram illustrating a process of generating first image data in which a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention is image-processed. Hereinafter, a process of generating first image data processed by a network TV processing a plurality of different types of content according to an embodiment of the present invention will be described with reference to FIG.

As described above, the network TV 2000 according to an embodiment of the present invention extracts first image data that identifies each of a plurality of contents of a first type stored in a memory. If the number of first image data items identifying each of the plurality of contents of the first type exceeds a displayable range in the first area of the initial screen, at least one of the first image data items 2020) to a size smaller than the original size. However, a separate size conversion process is not performed on the first image data 2010 belonging to the displayable range.

The network TV 2000 primarily generates an initial screen including a first area 2030 including specific first image data 2020 converted to a size smaller than the original size.

Meanwhile, the first image data 2010 and 2020 described above corresponds to an icon for displaying an arbitrary application, for example, and may be expressed in units of snacks. In addition, the first image data 2010 and 2020 correspond to an object in an icon state, for example, and are configured with a graphic that makes it possible to predict the name or operation of a specific application.

21 is a diagram illustrating a process of generating second image data in which a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention is image-processed. Hereinafter, with reference to FIG. 21, a process of generating second image data processed by a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention will be described. 20 and 21 may be performed at the same time, or FIGS. 20 and 21 may be sequentially / reversely implemented.

21 will be described assuming the first area 2130 generated in FIG.

As described above, the network TV 2100 according to an embodiment of the present invention extracts second image data that identifies each of a plurality of contents of a second type stored in a memory. If the number of second image data for identifying each of the plurality of contents of the second type exceeds a displayable range in the second area of the initial screen, at least one of the second image data 2160) to a size smaller than the original size. However, no separate size conversion process is performed for the second image data 2150 in the displayable range.

The network TV 2100 secondarily generates an initial screen including a second area 2140 including specific second image data 2160 converted to a size smaller than the original size.

Meanwhile, the second image data 2150 and 2160 described above correspond to the graphic information of the executed application when a specific icon among the icons displayed in the first area 2130 is selected, for example, It can also be expressed. In addition, the second image data 2150 and 2160 correspond to a widget type and display only a minimum amount of information.

22 is a diagram showing an initial screen provided by a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention. Hereinafter, an initial screen provided by a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described with reference to FIG. For example, it is assumed that it includes both the first area for the first image data generated by Figs. 20 and 21 and the second area for the second image data.

22, the network TV 2200 according to an embodiment of the present invention is designed to display only a part of specific first image data in the first area 2230, By designing to display only a part of specific second image data, the user can intuitively know that the next image data exists, and by designing to display some image data processed image rather than a simple indicator, corresponding to the next image data There is an advantage that the content or the application to be predicted can be specifically predicted.

Further, according to another embodiment of the present invention, when specific image data among the image data displayed in the first area 2230 of FIG. 22 is selected, the second area 2240 of FIG. 22 is enlarged and displayed. Therefore, there is a unique advantage that the user can arbitrarily adjust the amount of information and the degree of display of the content or application desired by the user.

The initial screen according to an embodiment of the present invention may display an application or a card related to the content available in the network TV in the second area described above and may display an icon corresponding to the application or the content in the first area Area in the form of Launcher Bar.

The image data displayed in the second area may be referred to as a card. The card may be, for example, a card associated with a calendar application capable of schedule management, a card associated with an application capable of playing music, a card displaying terrestrial broadcast content And the like.

Further, according to the present invention, it is advantageous to improve the selectivity for the next card more than before by designing to display only a part of the cards related to some applications, up or down or left and right, even before the user applies a special scroll input have.

FIG. 23 is a view illustrating a screen in which a network TV for processing a plurality of different types of content according to an embodiment of the present invention cuts the top of some data in the first image data. Hereinafter, with reference to FIG. 23, a screen in which a top portion of some data in the first image data is cut by a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention will be described.

The network TV 2300 according to another embodiment of the present invention performs image processing for cutting the top of specific image data in the first area 2301 as shown in FIG. The image processing for the specific image data is performed when the image data for the application currently provided in the network TV can not be displayed all in the first area.

FIG. 24 is a diagram illustrating a screen in which a lower end of some data in the first image data is cut by a network TV that processes a plurality of different types of content according to an exemplary embodiment of the present invention. Hereinafter, with reference to FIG. 24, a screen of a network TV processing a plurality of different types of content according to an exemplary embodiment of the present invention, in which the lower end of some data in the first image data is cut, will be described.

The network TV 2400 according to another embodiment of the present invention performs image processing for cutting the lower end of specific image data in the first area 2401 as shown in Fig. The image processing for the specific image data is performed when the image data for the application currently provided in the network TV can not be displayed all in the first area.

FIG. 25 is a diagram illustrating a screen in which a network TV for processing a plurality of different types of content according to an embodiment of the present invention cuts the top of some data in the second image data. Hereinafter, with reference to FIG. 25, a screen in which a top portion of some data in the second image data is cut by a network TV that processes a plurality of different types of content according to an embodiment of the present invention will be described.

The network TV 2500 according to another embodiment of the present invention performs image processing for cutting the top of specific image data in the second area 2501 as shown in Fig. The image processing for the specific image data is performed when the image data for the card currently provided in the network TV can not be displayed all in the second area.

26 is a view showing a screen in which a lower end of some data in the second image data is cut by a network TV processing a plurality of different types of contents according to an embodiment of the present invention. Hereinafter, with reference to FIG. 26, a screen in which a lower portion of a part of data of the second image data is cut by a network TV that processes a plurality of different kinds of contents according to an embodiment of the present invention will be described.

The network TV 2600 according to another embodiment of the present invention performs image processing for cutting the lower end of specific image data in the second area 2601 as shown in Fig. The image processing for the specific image data is performed when the image data for the card currently provided in the network TV can not be displayed all in the second area.

FIG. 27 is a flowchart illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a motion remote controller. Hereinafter, a process of controlling a network TV for processing a plurality of different types of content according to an embodiment of the present invention with a motion remote controller will be described with reference to FIG.

As shown in FIG. 27 (a), in the first area 2730, specific image data 2720, which is partially cut with normal image data, is displayed. At this time, the user can confirm the partially cut specific image data 2720 using the motion remote control 2770. [ More specifically, for example, when the motion remote control 2770 is moved from right to left as shown in FIG. 27 (b), the entire image of the specific image data 2720 displayed in the first area 2730 The data is shifted to the left and displayed. Of course, the first area 2730 is illustrated in FIG. 27, but it is also possible to control the image data shown in the second area 2740. Furthermore, it is possible to design the above-described motion remote controller 2770 by using the controller 200 shown in Figs. 13 and 14. Fig.

28 is a detailed view of a multiple camera added to a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention. Hereinafter, a multiple camera added to a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described in detail with reference to FIG.

As another embodiment for controlling the image data displayed on the initial screen described above, the gesture recognition sensor is used. The gesture recognition sensor may use a known depth camera or an RGB color camera. In particular, it is also possible to detect gestures or motions of a user by adding the multiple cameras shown in FIG. 28 to the network TV.

28, a heterogeneous multiple camera according to an exemplary embodiment of the present invention includes a first camera group 2810 and a second camera 2820, a controller 2830, a memory 2840, an interface 2850 And the like, and is designed to receive audio data from the microphone 2870 and the external audio source 2860 under the control of the controller 2830.

The memory 2840 may be, for example, a flash memory or the like, and the interface 2850 may be designed, for example, as a USB interface and connected to an external network TV. Meanwhile, the first camera group 2810 includes an emitter 2880 and a depth camera 2890, and the emitter can be designed, for example, as an IR (Infra-Red) emitter.

Further, under the control of the controller 2830, the light projector 2882 of the emitter 2880 projects the lens 2881 to emit light to at least one or more users located in front of the network TV.

Also, under the control of the controller 2830, the depth camera 2890 captures a first image using the light received through the lens 2891, extracts depth data from the captured first image And transmits it to the controller 2830.

The controller 2830 recognizes the face and hand shapes of the at least one user using the transmitted depth data, and then controls the color camera 2820.

The color camera 2820 captures a second image of the recognized user's face and hand shape applied through the lens 2821 under the control of the controller 2830. [ Further, the color camera 2820 transmits the feature information extracted from the photographed second image to the controller 2820.

The controller 2830 is designed to transmit the extracted feature information to the network TV using the interface 2850. [ Therefore, the network TV receiving the network TV has the effect of identifying the hand shape and the gesture of the user.

29 is a diagram illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a first gesture. Hereinafter, a process of controlling a network TV that processes a plurality of different types of content according to an exemplary embodiment of the present invention will be described with reference to FIG. 29 as follows.

The gesture recognition sensor 2990 shown in Figs. 29 (a) and 29 (b) is designed, for example, as the multiple camera shown in Fig. 28 described above. Therefore, the network TV according to the embodiment of the present invention recognizes one finger 2970 of the user by using the gesture recognition sensor 2990, as shown in Fig. 29 (a). When the user wants to control specific image data 2920 among the image data shown in the first area 2930, the user moves one finger 2970 from right to left as shown in FIG. 29 (b) . At this time, as shown in FIG. 29 (b), the specific image data 2920 moves from right to left to show the entire image data.

29, a method of controlling image data of the first area 2930 other than the second area 2940 has been described, and one of the fingers is designed to control the movement of the image data displayed in the first area.

30 is a diagram illustrating a process in which a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention is controlled by a second gesture. Hereinafter, a process of controlling a network TV for processing a plurality of different types of content according to an exemplary embodiment of the present invention will be described with reference to FIG. 30 as follows.

The gesture recognition sensor 3090 shown in Figs. 30 (a) and 30 (b) is designed, for example, as the multiple camera shown in Fig. 28 described above. Accordingly, the network TV according to the embodiment of the present invention recognizes five fingers 3070 of the user using the gesture recognition sensor 3090, as shown in FIG. 30 (a). When the user wishes to control specific image data 3060 among the image data shown in the second area 3040, the five fingers 3070 are moved from right to left as shown in FIG. 30 (b) . At this time, as shown in FIG. 30 (b), the specific image data 3020 moves from right to left to show the entire image data.

However, in FIG. 30, a method of controlling image data of a second area 3040 other than the first area 3030 is described, and five fingers are designed to control the movement of image data displayed in the second area.

Therefore, according to the embodiments shown in FIGS. 28 to 30, the image data displayed in each area in the unit of the gesture can be controlled on a single screen from the viewpoint of the user.

31 is a diagram illustrating a first menu screen for setting an initial screen of a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention. Hereinafter, a first menu screen for setting an initial screen of a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described with reference to FIG.

As described above, according to the embodiments of the present invention, the image data displayed in the first area of the initial screen is divided into two groups and designed. There are cases where full image data is displayed full and only some image data is displayed. This is caused by the limited range of the first area. However, as shown in FIG. 31, the number of data to which full image data is fully displayed may be a fixed value already set in the network TV manufacturing step, ) Is directly set by the user, thereby enhancing the user's convenience. In addition, as shown in FIG. 31, the user may directly set the area of the first image data (snack unit) displayed on the initial screen to one of the top, bottom, left, and right sides.

32 is a diagram illustrating a second menu screen for setting an initial screen of a network TV for processing a plurality of different kinds of contents according to an embodiment of the present invention. Hereinafter, a second menu screen for setting an initial screen of a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described with reference to FIG.

As described above, according to the embodiments of the present invention, the image data displayed in the second area of the initial screen is also divided into two groups. There are cases where full image data is displayed full and only some image data is displayed. This is due to the limited range of the second area. However, the number of data in which full image data is fully displayed may be a fixed value that has been set up in the network TV manufacturing step. However, as shown in FIG. 32, ) Is directly set by the user, thereby enhancing the user's convenience. In addition, as shown in FIG. 32, the user may directly set the area of the second image data (in units of bite) displayed on the initial screen to one of the upper, lower, left, and right sides.

33 is a flowchart illustrating a method of controlling a network TV that processes a plurality of different types of content according to an embodiment of the present invention. Hereinafter, a method of controlling a network TV for processing a plurality of different types of content according to an embodiment of the present invention will be described with reference to FIG.

If a power-on signal for the network TV is applied (S3301), an initial screen execution step is entered (S3302).

The first image data for identifying each of the plurality of contents of the first type stored in the memory is extracted (S3303), and the second image data for identifying each of the plurality of contents of the second type stored in the memory is extracted S3304).

In operation S3305, it is determined whether the number of the first image data that identifies each of the plurality of contents of the first type exceeds a displayable range in the first area of the initial screen.

If it exceeds the range, at least one of the first image data is converted into a size smaller than the original size (S3306).

It is determined whether the number of second image data that identifies each of the plurality of contents of the second type exceeds a displayable range in the second area of the initial screen at step S3307.

If it exceeds the range, at least one of the second image data is converted into a size smaller than the original size (S3308).

Then, an initial screen including the first area including specific first image data converted into a size smaller than the original size and the second area including specific second image data converted to a size smaller than the original size is displayed on the display (S3309).

According to another embodiment of the present invention, in step S3306, when the specific first image data exceeding the displayable range in the first area is positioned at the right end of the first area, Executing image processing to cut a right portion of the data; and, when the first image data exceeding the displayable range in the first area is located at the left end of the first area, Executing image processing to cut a portion of the left side of the image data.

According to another embodiment of the present invention, in step S3306, when the specific first image data exceeding the displayable range in the first area is positioned at the top of the first area, And when the specific first image data exceeding the displayable range in the first area is positioned at the lower end of the first area, the image processing for cutting the upper part of the specific first image data And performing image processing to cut a lower portion of the image.

As described above, the first image data is designed to be moved in the left-right direction or the up-down direction within the first area, and the second image data is positioned in the left-right direction or the up-down direction in the second area .

According to another embodiment of the present invention, there is provided a method for controlling a gesture recognition method comprising the steps of: detecting a gesture of a user located in a front direction of a network TV using a gesture recognition sensor; Moving the position of the first image data displayed in the first area in the horizontal direction or in the vertical direction; and moving the second image data displayed in the second area based on the direction corresponding to the motion of the second gesture In the left and right direction or in the up and down direction.

The range that can be displayed in the first area of the initial screen and the range that can be displayed in the second area of the initial screen are set up by a fixed value previously stored in the memory or a variation value set by the user of the network TV .

Therefore, according to one embodiment of the present invention designed as described above, a solution for providing a predictable initial screen to a user using a network TV considering the gradually increasing number of contents is presented.

According to another embodiment of the present invention, there is provided a method of enabling a search for each of different types of content in a specific gesture unit of a user at a faster speed.

In particular, the image data displayed in the other area of the initial screen is designed to be controlled by a gesture unit, so that the application corresponding to the next image data can be accessed more quickly.

In this specification, both the invention and the invention of the method are explained, and the description of the two inventions can be supplementarily applied as necessary.

The method inventions according to the present invention can all be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

1900: Network TV
1920: Interface
1930: Gesture recognition sensor
1940: Initial screen execution unit
1950:

Claims (20)

A control method of a network TV for processing a plurality of different types of contents,
Entering an initial screen execution step when a power on signal for the network TV is applied;
Identifying each of a plurality of contents of a first type stored in a memory and extracting first image data corresponding to an icon representing an arbitrary application;
Identifying each of the plurality of contents of the second type stored in the memory and extracting second image data corresponding to the graphic information of the application executed when the icon is selected;
When at least one of the first image data is divided into at least one of an original size of the first image data and a second size of the first image data, Into a smaller size;
If at least one of the second image data sets is the original size of the second image data, if the number of the second image data for identifying each of the plurality of contents of the second type exceeds a displayable range in the second area of the initial screen, Into a smaller size; And
An initial screen including the first area including specific first image data converted to a size smaller than the original size and the second area including specific second image data converted to a size smaller than the original size is displayed Step
And a control unit configured to control the plurality of contents. The method according to claim 1,
Wherein the step of converting at least one of the first image data to a size smaller than the original size comprises:
Executing image processing to cut a right portion of the specific first image data when specific first image data exceeding a displayable range in the first area is positioned at the right end of the first area; And
Executing image processing to cut a left part of the specific first image data when specific first image data exceeding the displayable range in the first area is positioned at the left end of the first area
And a control unit configured to control the plurality of contents. The method according to claim 1,
Wherein the step of converting at least one of the first image data to a size smaller than the original size comprises:
Executing image processing to cut a top portion of the specific first image data when specific first image data exceeding a displayable range in the first area is positioned at the top of the first area; And
Executing image processing for cutting a lower end portion of the specific first image data when specific first image data exceeding a displayable range in the first region is positioned at a lower end of the first region
And a control unit configured to control the plurality of contents. The method according to claim 1,
The first image data is designed to be moved in the left / right or up / down direction within the first area, and
And the second image data is designed to be moved in the left / right or up / down direction in the second area. 5. The method of claim 4,
When a command signal for moving the first image data from right to left is transmitted to the network TV,
Restoring and displaying specific first image data that has been converted to a size smaller than the original size at the right end of the first area to an original size; And
Converting the next first image data previously stored in the memory into a size smaller than the original size and displaying the same on the right side of the first area
The method of claim 1, further comprising the steps of: 5. The method of claim 4,
Detecting a gesture of a user located in the network TV front direction using a gesture recognition sensor;
Moving the position of the first image data displayed in the first area in the horizontal direction or the vertical direction based on the direction corresponding to the motion of the first gesture; And
Moving the position of the second image data displayed in the second area in the horizontal direction or in the vertical direction based on the direction corresponding to the motion of the second gesture
The method of claim 1, further comprising the steps of: delete The method according to claim 1,
When an icon corresponding to the first image data is selected,
Stopping the display of the icon in the first area,
Displaying graphic information of an application executed in accordance with the selection of the icon in the second area
The method of claim 1, further comprising the steps of: The method according to claim 1,
Wherein a range that can be displayed in the first area of the initial screen and a range that can be displayed in the second area of the initial screen
A plurality of different types of content set up by a fixed value pre-stored in the memory or a variation value set by a user of the network TV. A computer-readable recording medium having recorded therein a program for executing the method according to any one of claims 1 to 9. A network TV for processing a plurality of different kinds of contents,
An interface designed to enter an initial screen execution step when a power on signal for the network TV is applied;
A first extracting unit for extracting first image data identifying each of a plurality of contents of a first type stored in a memory;
A second extracting unit for extracting second image data identifying each of a plurality of contents of a second type stored in the memory;
When at least one of the first image data is divided into at least one of an original size of the first image data and a second size of the first image data, A first conversion unit for converting the image into a smaller size;
If at least one of the second image data sets is the original size of the second image data, if the number of the second image data for identifying each of the plurality of contents of the second type exceeds a displayable range in the second area of the initial screen, A second conversion unit for converting the image data into a smaller size; And
An initial screen including the first area including specific first image data converted to a size smaller than the original size and the second area including specific second image data converted to a size smaller than the original size is displayed a controller for
Lt; / RTI >
Wherein,
A first setting value for the number of first image data displayed in the first area and the number of second image data displayed in the second area on a predetermined menu screen, And a second setting value for the moving direction of the data and displays the initial screen based on the received first setting value and the second setting value. . 12. The method of claim 11,
Wherein the first conversion unit comprises:
Cutting a right part of the specific first image data when specific first image data exceeding a displayable range in the first area is positioned at the right end of the first area,
An image processor for cutting a left part of the specific first image data when specific first image data exceeding a displayable range in the first area is positioned at a left end of the first area,
A network TV that processes a plurality of different types of content, 12. The method of claim 11,
Wherein the first conversion unit comprises:
Cutting a top part of the specific first image data when specific first image data exceeding a displayable range in the first area is positioned at the top of the first area,
An image processor for cutting a lower end portion of the specific first image data when specific first image data exceeding a displayable range in the first region is positioned at a lower end of the first region,
A network TV that processes a plurality of different types of content, 12. The method of claim 11,
The first image data is designed to be moved in the left / right or up / down direction within the first area, and
And the second image data is designed to be moved in the left / right or up / down direction within the second area. 15. The method of claim 14,
When the interface receives a command signal for moving the first image data from right to left,
Wherein,
Controls to display the specific first image data that has been converted to a size smaller than the original size at the right end of the first area in a restored state to the original size,
The next first image data previously stored in the memory is converted into a size smaller than the original size and is controlled to be displayed on the right end of the first area
A network TV that processes heterogeneous content. 15. The method of claim 14,
The network TV includes:
Further comprising a gesture recognition sensor for detecting a gesture of a user located in the network TV front direction,
Wherein,
Moving the position of the first image data displayed in the first area in the horizontal direction or the vertical direction based on the direction corresponding to the motion of the first gesture,
Based on the direction corresponding to the motion of the second gesture, the position of the second image data displayed in the second region is moved in the horizontal direction or the vertical direction
A network TV that processes heterogeneous content. 12. The method of claim 11,
Wherein the first image data corresponds to an icon indicating an arbitrary application,
Wherein the second image data processes a plurality of different types of content corresponding to graphic information of an application executed when the icon is selected. 18. The method of claim 17,
When the interface selects an icon corresponding to the first image data,
Wherein,
Stopping the display of the icon in the first area,
And controls to display, in the second area, the graphic information of the application executed according to the selection of the icon
A network TV that processes heterogeneous content. 12. The method of claim 11,
Wherein a range that can be displayed in the first area of the initial screen and a range that can be displayed in the second area of the initial screen
And a plurality of different kinds of contents set up by fixed values previously stored in the memory. 12. The method of claim 11,
The network TV includes:
A network TV that processes heterogeneous content corresponding to at least one of IPTV, HBBTV, or smart TV.

Images