KR102369588B1 - Digital device and method of processing data the same - Google Patents

Abstract

Disclosed herein are a digital device and a data processing method in the digital device. Here, the digital device according to an embodiment of the present invention controls a user interface unit that receives a region of interest (ROI) selection signal from an image frame of content reproduced on a screen, controls the content reproduction, and A control unit for controlling region data to be zoomed and provided at a preset zoom factor, and a display unit, wherein the user interface unit further receives a first zoom magnification change command for the provided region of interest data, the control unit comprising: control to provide an indicator indicating at least one of an object within the region of interest and one or more sub-objects belonging to the object according to the first zoom magnification change command, and one or more according to the indicator access signal Control to display a zoom menu including menu items, control execution of a function corresponding to a menu item selected from the zoom menu, or control to display information.

Description

DIGITAL DEVICE AND METHOD OF PROCESSING DATA THE SAME

The present invention relates to a digital device, and more particularly, according to an Enlarge/Reduce command for a region of interest (ROI) of content being reproduced in a digital device. It is about data processing.

Following the development of a standing device such as a personal computer (PC) and a TV (Television), a mobile device such as a smart phone, a tablet PC, a wearable device, etc. this is dazzling The fixed device and the mobile device have been developed separately by constructing their own domains, but the boundary between the mutually established domains is becoming blurred according to the recent boom in digital convergence.

When an enlarge/reduce command for the content being reproduced is received, the conventional digital device enlarges/reduces only the image frame unit of the content. In other words, in the conventional digital device, it is impossible to individually enlarge/reduce only a specific area or object within the image frame. In addition, as described above, digital devices can be enlarged/reduced only in units of image frames, so it is not possible to search for only a desired specific area or object. There is a problem that it doesn't.

In the present specification, a digital device and a data processing method in the digital device are disclosed in order to solve the above problems.

The present invention enlarges/reduces or zooms only a desired region within an image frame of content, that is, a region of interest (ROI) in a digital device, and the enlarged/reduced interest One task is to process a region (ROI) so that it can be identified from the entire region of a corresponding image frame.

Another object of the present invention is to provide various zoom functions, such as searching, as well as expanding or reducing a region of interest in a digital device.

Another object of the present invention is to provide various zoom functions as described above to improve user satisfaction and inspire a desire to purchase a product.

The technical problems to be achieved in the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. .

Various embodiment(s) of a digital device and a processing method in the digital device are disclosed herein.

A data processing method in a digital device according to an embodiment of the present invention includes the steps of: reproducing content on a screen; receiving a region of interest (ROI) selection signal from an image frame of the content; Zooming data to a preset zoom magnification and providing it on a screen, receiving a first zoom magnification change command for the provided region of interest data, and an object in the region of interest according to the first zoom magnification change command providing an indicator indicating at least one of one or more sub-objects belonging to the object; and providing a zoom menu including one or more menu items according to the indicator access signal, the zoom menu being selected from the zoom menu. and displaying information or executing a function corresponding to the menu item.

A digital device according to an embodiment of the present invention includes a user interface unit that receives a region of interest (ROI) selection signal from an image frame of content reproduced on a screen, controls content reproduction, and the region of interest data a control unit for controlling the zoom to be provided at a preset zoom factor, and a display unit, wherein the user interface unit further receives a first zoom factor change command for the provided region of interest data, and the control unit comprises: 1 Control to provide an indicator indicating at least one of an object in the region of interest and one or more sub-objects belonging to the object according to a zoom magnification change command, and one or more menu items according to the indicator access signal control to display a zoom menu including

The technical solutions obtainable in the present invention are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the art to which the present invention belongs from the description below. can be understood

The effects of the present invention are as follows.

According to one of the various embodiments of the present invention, in a digital device, only a desired region within an image frame of content, that is, a region of interest (ROI), is enlarged/reduced or reduced. zoom), and the enlarged/reduced region of interest (ROI) can be processed so that it can be identified from the entire region of the corresponding image frame.

According to another of various embodiments of the present invention, there is an effect that a digital device can provide various zoom functions such as search, as well as enlarge or reduce a region of interest (ROI) in a digital device.

According to another embodiment of the present invention, various zoom functions are provided to improve user satisfaction and inspire a desire to purchase a product.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

1 is a diagram schematically illustrating a service system according to an embodiment of the present invention;
2 is a block diagram illustrating a digital device according to an embodiment of the present invention;
3 is a block diagram of another configuration or detailed configuration of FIG. 2;
4 is a block diagram illustrating an external device according to an embodiment of the present invention;
5 is a block diagram illustrating a digital device or an external device according to another embodiment of the present invention;
6 is a diagram illustrating a control means for controlling a digital device according to an embodiment of the present invention;
7 is a view for explaining selection of a region of interest (ROI) in a digital device according to an embodiment of the present invention;
8 is a view for explaining the selection of a region of interest (ROI) in a digital device according to another embodiment of the present invention;
FIG. 9 is a diagram illustrating a method of processing a region of interest (ROI) in a digital device when a region of interest (ROI) is selected with reference to FIGS. 7 and 8 according to an embodiment of the present invention;
10 to 12 are diagrams illustrating a zoom function processing method for a region of interest (ROI) in a digital device according to an embodiment of the present invention;
13 to 17 are diagrams for a method of performing an additional function after providing zoomed region of interest (ROI) data according to an embodiment of the present invention;
18 to 22 are diagrams for a method of processing region of interest (ROI) data according to a zoom magnification level according to an embodiment of the present invention;
23 is a diagram illustrating a zoom function processing method for a region of interest (ROI) in a digital device according to another embodiment of the present invention; And
24 and 25 are flowcharts of a method of processing region of interest (ROI) data in a digital device according to an embodiment of the present invention.

Hereinafter, various embodiment(s) of a digital device and a data processing method in the digital device according to the present invention will be described with reference to the drawings.

The suffixes "module", "part", etc. for components used in this specification are given only in consideration of the ease of writing the specification, and both may be used interchangeably as needed. In addition, even when described as an ordinal number such as "first-", "second-", etc., it is only for convenience of explanation of the term rather than an order, and is not limited to such terms or ordinal numbers. In addition, the terms used in the present specification are also selected as widely used general terms as possible in consideration of the function according to the technical idea of the present invention, but this is according to the intention or customs of those of ordinary skill in the art or the emergence of new technologies, etc. may vary. However, in certain cases, there are terms arbitrarily selected by the applicant, but the meaning will be described in the related description. Therefore, it is clear that the term should be interpreted based on the actual meaning it has and the content described throughout this specification, not just the name. On the other hand, the content described in this specification or / and drawings, as a preferred embodiment according to the present invention is not limited thereto, and the scope of the rights should be determined through the claims.

As used herein, “digital device” includes, for example, all devices that receive, process, output, and the like, at least one of content. The digital device may receive streaming or download of the content or information about the content through a server, such as a broadcasting station, or an external input. The digital device may transmit/receive data including the content to the server and the like through a wired/wireless network. The digital device may be either a standing device or a mobile device or handheld device. The fixed device may include a network TV (Network TV), a Hybrid Broadcast Broadband TV (HBBTV), a Smart TV, an Internet Protocol TV (IPTV), a Personal Computer (PC), and the like. And, as the mobile device, PDA (Personal Digital Assistant), smart phone (Smart Phone), tablet PC (Tablet PC), notebook (Notebook), digital broadcasting terminal, PMP (Portable Multimedia Player), navigation (navigation), slate A PC (Slate PC), an Ultrabook (Ultrabook), a wearable device (eg, a watch-type terminal (smart watch), a glass-type terminal (smart glass), HMD (head mounted display)), etc. may be included. . Here, FIGS. 2 and 3 show a digital TV as one of the fixed devices, and FIGS. 4 and 5 show a mobile terminal and a wearable device (eg, a smart watch) as one of the mobile devices as examples of digital devices. and will be described in detail in that section. On the other hand, when the digital device is a fixed device, it may be in the form of a signage having only a display panel, and other configurations, for example, a set with a set-top box (STB), etc. (SET) may be implemented in the form.

Meanwhile, the wired/wireless network includes all hardware and/or software for connecting or pairing, data communication, and the like between the server and the digital device described above, and is standard. Also includes networks currently supported by or will be supported in the future. Meanwhile, the wired/wireless network may support one or more communication protocols for data communication. Such wired/wireless networks include, for example, Universal Serial Bus (USB), Composite Video Banking Sync (CVBS), Component, S-Video (analog), Digital Visual Interface (DVI), High Definition Multimedia Interface (HDMI), A network for wire connection such as RGB, D-SUB, and a communication standard or protocol for the same, Bluetooth, WLAN (Wireless LAN) (Wi-Fi), Wi-Fi direct, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), It may be formed by a network for wireless connection such as High Speed Downlink Packet Access (HSDPA), Long Term Evolution/LTE-Advanced (LTE/LTE-A), and the like, and a communication standard or protocol therefor.

On the other hand, as the digital device, a general-purpose operating system (OS), a web OS (Web OS), etc. may be used, and various services or applications are added to the general-purpose OS kernel, Linux kernel, and the like. , deletion, amending, updating, etc. can be processed, thereby providing a more user-friendly environment.

1 is a diagram schematically illustrating a service system according to an embodiment of the present invention.

Referring to FIG. 1 , a service system may be basically implemented including a server 105 and a digital TV 110 . Here, the digital TV 110 may be replaced with a mobile terminal 120 or a wearable device 130 . Alternatively, the service system may be implemented by further including the mobile terminal 120 or the wearable device 130 in addition to the server 105 and the digital TV 110 . Meanwhile, the operation of the digital TV 110 may be controlled by a control means such as the dedicated remote control 115 .

The digital device according to an embodiment of the present invention receives a region of interest (ROI) selection signal from an image frame of content reproduced on a screen. A receiving user interface unit, a control unit for controlling content reproduction, and controlling the ROI data to be zoomed to a preset zoom magnification and provided, and a display unit, wherein the user interface unit comprises: 1 Further receiving a zoom magnification change command, the control unit is configured to select an object in the region of interest and one or more sub-objects belonging to the object according to the first zoom magnification change command. control to provide an indicator indicating at least one, and control to display a zoom menu including one or more menu items according to the indicator access signal, and from the zoom menu Controls the execution of a function corresponding to the selected menu item or controls to display information.

The controller displays the entire image frame data including the region of interest (ROI) and an indicator indicating the region of interest (ROI) in the entire image frame on the screen through a first window (PIP) ) in the form of, and at least one of the object and sub-objects indicated by the indicator according to the first zoom magnification change control command can be controlled to be displayed through a second window . In addition, when a second zoom magnification change command is further received from the user interface unit, the controller determines whether there are a plurality of objects in the ROI according to the second zoom magnification change command, and as a result of the determination, the object in the ROI is plural, and when the first indicator indicates only an object within the region of interest, control to provide a second indicator indicating another object within the region of interest according to the second zoom magnification change command, the determination result When there are a plurality of objects in the region of interest and the first indicator indicates only the object in the region of interest, among one or more sub-objects belonging to the object in the region of interest according to the second zoom magnification change command control to provide a third indicator indicating one -If only an object is indicated, control to provide a fourth indicator indicating another sub-object belonging to the corresponding object in the region of interest according to the second zoom magnification change command. As a result of the determination, a plurality of objects in the region of interest are provided If not, the first indicator indicates only the object within the region of interest, indicating any one of one or more sub-objects belonging to the object in the region of interest according to the second zoom magnification change command Control to provide a fifth indicator and as a result of the determination, there are not a plurality of objects in the region of interest, and the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest In this case, it is possible to control to provide a sixth indicator indicating another sub-object belonging to the corresponding object in the ROI according to the second zoom magnification change command. In addition, the control unit may display a search word corresponding to at least one of an object and sub-objects indicated by an indicator according to the first zoom magnification change control command and a search result according to the search word in a third window It can be controlled to be displayed through

2 is a block diagram illustrating a digital TV according to an embodiment of the present invention.

The digital TV 200 includes a network interface 201 , a TCP/IP manager 202 , a service delivery manager 203 , an SI decoder 204 , Demultiplexer (demuxer or demultiplexer) 205, audio decoder (audio decoder) 206, video decoder (video decoder) 207, display unit (display A/V and OSD module) 208, service control manager (service control manager) 209, service discovery manager (210), SI & metadata database (SI&metadata DB) (211), metadata manager (metadata manager) (212), service manager (213), It may be configured to include a UI manager 214 and the like.

The network interface unit 201 is configured to provide IP packet(s) (Internet Protocol (IP) packet(s)) or IP datagram(s) (IP datagram(s)) (hereinafter 'IP packet(s)) through a network network. ') is received from the server 105 or transmitted to the server 105 . For example, the network interface unit 201 may receive a service, application, content, etc. from a service provider through a network.

The TCP/IP manager 202 performs packet transfer ( involved in packet delivery). The TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205 , the service discovery manager 210 , the service control manager 209 , and the metadata manager 212 . ), etc., and output the classified packet(s).

The service delivery manager 203 is responsible for controlling the received service data. For example, the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data. When the real-time streaming data is transmitted using RTP, the service delivery manager 203 parses the received data packet according to the RTP and transmits it to the demultiplexer 205 or the control of the service manager 213 according to the SI&metadata database 211. Then, the service delivery manager 203 feeds back the network reception information to the server that provides the service using RTCP.

The demultiplexer 205 demultiplexes the received packet into audio, video, SI (System Information) data, and the like, and transmits it to the audio/video decoders 206/207 and the SI decoder 204, respectively.

The SI decoder 204 includes demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting-Service Information (DVB-SI), and Digital Television Terrestrial Multimedia (DTMB/CMMB). It decodes service information such as Broadcasting/Coding Mobile Multimedia Broadcasting). Also, the SI decoder 204 may store the decoded service information in the SI&metadata database 211 . The stored service information may be read and used according to a corresponding configuration according to a user's request, for example.

The audio/video decoder 206/207 decodes each demultiplexed audio data and video data. The decoded audio and video data are provided to the user through the display unit 208 .

The application manager includes, for example, a UI manager 214 and a service manager 213 , and may perform a control function of the digital TV 200 . In other words, the application manager may manage the overall state of the digital TV 200 , provide a user interface (UI), and manage other managers.

The UI manager 214 provides a graphical user interface (GUI)/UI for a user using an on screen display (OSD), etc., receives a key input from the user, and performs a device operation according to the input. For example, when receiving a key input for channel selection from the user, the UI manager 214 transmits the key input signal to the service manager 213 .

The service manager 213 controls a manager associated with a service, such as the service delivery manager 203 , the service discovery manager 210 , the service control manager 209 , and the metadata manager 212 . In addition, the service manager 213 generates a channel map and controls selection of a channel using the generated channel map according to a key input received from the UI manager 214 . The service manager 213 receives service information from the SI decoder 204 and sets an audio/video PID (Packet Identifier) of the selected channel in the demultiplexer 205 . The PID set in this way can be used in the above-described demultiplexing process. Accordingly, the demultiplexer 205 filters audio data, video data, and SI data (PID or section filtering) using the PID.

The service discovery manager 210 provides information necessary for selecting a service provider that provides a service. When receiving a channel selection signal from the service manager 213, the service discovery manager 210 uses the information to find a service.

The service control manager 209 is in charge of service selection and control. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as the existing broadcasting method, and selects a service such as VOD (Video on Demand). RTSP is used to select and control services. The RTSP protocol may provide a trick mode for real-time streaming. Also, the service control manager 209 may initialize and manage a session through the IMS gateway 250 using an IP Multimedia Subsystem (IMS) or a Session Initiation Protocol (SIP). The above protocols are only an example, and other protocols may be used according to implementation examples.

The metadata manager 212 manages metadata associated with a service and stores the metadata in the SI&metadata database 211 .

The SI & metadata database 211 selects service information decoded by the SI decoder 204 , metadata managed by the metadata manager 212 , and a service provider provided by the service discovery manager 210 . Store the information you need to In addition, the SI&metadata database 211 may store set-up data for the system, and the like. The SI&metadata database 211 may be implemented using a non-volatile memory (NVRAM), a flash memory, or the like.

On the other hand, the IMS gateway 250 is a gateway that collects functions necessary to access an IMS-based IPTV service.

FIG. 3 is a block diagram of another configuration or detailed configuration of FIG. 2 .

Referring to FIG. 3A , the digital TV includes a broadcast receiving unit 305 , an external device interface unit 316 , a storage unit 318 , a user input interface unit 320 , a control unit 325 , a display unit 330 , and audio It may include an output unit 335 , a power supply unit 340 , and a photographing unit (not shown). Here, the broadcast receiving unit 305 may include at least one tuner 310 , a demodulator 312 , and a network interface unit 314 . However, in some cases, the broadcast receiving unit 305 may include the tuner 310 and the demodulator 312 but not the network interface unit 314 , and vice versa. In addition, although not shown, the broadcast receiving unit 305 includes a multiplexer and a signal demodulated by the demodulator 312 through the tuner 310 and a signal received through the network interface unit 314 . can also be multiplexed. In addition, although not shown, the broadcast receiving unit 305 may include a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal passed through the network interface unit 314 .

The tuner 310 receives an RF broadcast signal by tuning a channel selected by a user or all channels previously stored among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 310 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal. For example, if the received RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband image or audio signal (CVBS/SIF). That is, the tuner 310 may process both a digital broadcast signal and an analog broadcast signal. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 310 may be directly input to the controller 325 . Also, the tuner 310 may receive an RF broadcast signal of a single carrier or multiple carriers. Meanwhile, the tuner 310 sequentially tunes and receives the RF broadcast signals of all broadcast channels stored through the channel storage function among the RF broadcast signals received through the antenna, and receives them as an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). frequency or baseband signal).

The demodulator 312 may receive and demodulate the digital IF signal DIF converted by the tuner 310 , and may perform channel decoding and the like. To this end, the demodulator 312 includes a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. - A Solomon decoder, etc. may be provided. The demodulator 312 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal obtained by multiplexing an image signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, etc. are multiplexed. The stream signal output from the demodulator 312 may be input to the controller 325 . The controller 325 may control demultiplexing, image/audio signal processing, and the like, and may control output of an image through the display unit 330 and audio through the audio output unit 335 .

The external device interface unit 316 provides an interface environment between the digital TV and various external devices. To this end, the external device interface unit 316 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown). External device interface unit 316, DVD (Digital Versatile Disk), Blu-ray (Blu-ray), game device, camera, camcorder (Camcorder), computer (laptop), tablet PC, smart phone, Bluetooth device (Bluetooth) device) or an external device such as a cloud, and the like, may be connected via wired/wireless. The external device interface unit 316 transmits a signal including data such as an image, video, and audio input through a connected external device to the controller 325 of the digital TV. The controller 325 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 316 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI (Digital It may include a Visual Interface) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit may perform short-range wireless communication with another digital device. Digital TV includes, for example, communications such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance (DLNA). It can be network-connected with other digital devices according to the protocol.

In addition, the external device interface unit 316 may be connected to the set-top-box (STB) through at least one of the aforementioned various terminals to perform input/output operations with the set-top-box (STB). Meanwhile, the external device interface unit 316 may receive an application or an application list in an adjacent external device and transmit it to the control unit 325 or the storage unit 318 .

The network interface unit 314 provides an interface for connecting the digital TV to a wired/wireless network including an Internet network. The network interface unit 314 may include, for example, an Ethernet (Ethernet) terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi- Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. can be used. The network interface unit 314 may transmit or receive data with another user or another digital device through the connected network or another network linked to the connected network. In particular, some content data stored in the digital TV may be transmitted to a selected user or a selected digital device among other users or other digital devices previously registered in the digital TV. Meanwhile, the network interface unit 314 may access a predetermined web page through the connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with a corresponding server. In addition, content or data provided by a content provider or a network provider may be received. That is, content such as a movie, commercials, game, VOD, and broadcast signal and information related thereto may be received from a content provider or a network provider through a network. In addition, it is possible to receive firmware update information and an update file provided by a network operator. It may also transmit data to the Internet or to a content provider or network provider.

Also, the network interface unit 314 may select and receive a desired application from among applications opened through a network.

The storage unit 318 may store a program for processing and controlling each signal in the control unit 325 , or may store a signal-processed image, audio, or data signal. Also, the storage unit 318 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 316 or the network interface unit 314 . The storage unit 318 may store information about a predetermined broadcast channel through a channel storage function. The storage unit 318 may store an application or an application list input from the external device interface unit 316 or the network interface unit 314 . Also, the storage unit 318 may store various platforms to be described later. The storage unit 318 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg, SD or XD). memory, etc.), a RAM (RAM), and a ROM (EEPROM, etc.) may include at least one type of storage medium. The digital TV may reproduce content files (movie files, still image files, music files, document files, application files, etc.) stored in the storage unit 318 and provide them to the user. 3A shows an embodiment in which the storage unit 318 is provided separately from the control unit 325, but the present invention is not limited thereto. In other words, the storage unit 318 may be included in the control unit 325 .

The user input interface unit 320 transmits a signal input by the user to the control unit 325 or transmits a signal from the control unit 325 to the user. For example, the user input interface unit 320 controls power on/off, channel selection, screen setting, etc. from the remote control device 345 according to various communication methods such as an RF communication method and an infrared (IR) communication method. The signal may be received and processed, or a control signal of the control unit 325 may be processed to be transmitted to the remote control device 345 . Also, the user input interface unit 320 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 325 . The user input interface unit 320 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 325 or transmits a signal of the control unit 325 to the sensing unit. can send Here, the sensing unit may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The controller 325 demultiplexes a stream input through the tuner 310 , the demodulator 312 , or the external device interface unit 316 or processes the demultiplexed signals to generate a signal for video or audio output. and output. The image signal processed by the controller 325 may be input to the display 330 and displayed as an image corresponding to the image signal. Also, the image signal processed by the controller 325 may be input to an external output device through the external device interface 316 . The audio signal processed by the control unit 325 may be audio output to the audio output unit 335 . Also, the audio signal processed by the controller 325 may be input to an external output device through the external device interface 316 . Although not shown in FIG. 3A , the controller 325 may include a demultiplexer, an image processor, and the like. The controller 325 may control the overall operation of the digital TV. For example, the controller 325 may control the tuner 310 to tune an RF broadcast corresponding to a channel selected by the user or a pre-stored channel. The control unit 325 may control the digital TV according to a user command input through the user input interface unit 320 or an internal program. In particular, it is possible to allow a user to download a desired application or an application list into the digital TV by accessing the network. For example, the controller 325 controls the tuner 310 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface 320 . And it processes the video, audio, or data signal of the selected channel. The control unit 325 allows the channel information selected by the user to be output through the display unit 330 or the audio output unit 335 together with the processed image or audio signal. As another example, the control unit 325 may be configured to receive an external device image playback command received through the user input interface unit 320 from an external device input through the external device interface unit 316, for example, a camera or a camcorder. of, an image signal or an audio signal to be output through the display unit 330 or the audio output unit 335 . Meanwhile, the controller 325 may control the display 330 to display an image. For example, a broadcast image input through the tuner 310, an external input image input through the external device interface unit 316, an image input through the network interface unit, or an image stored in the storage unit 318 , can be controlled to be displayed on the display unit 330 . In this case, the image displayed on the display unit 330 may be a still image or a moving image, and may be a 2D image or a 3D image. Also, the controller 325 may control to reproduce the content. In this case, the content may be content stored in the digital TV, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file. Meanwhile, when entering the application view item, the controller 325 may control to display an application or an application list downloadable from an internal or external network of the digital TV. The controller 325 may control to install and drive an application downloaded from an external network together with various user interfaces. In addition, an image related to an executed application may be controlled to be displayed on the display unit 330 by a user's selection.

Meanwhile, although not shown in the drawings, the digital TV may further include a channel browsing processing unit that generates a thumbnail image corresponding to a channel signal or an external input signal. The channel browsing processing unit receives the stream signal TS output from the demodulator 312 or the stream signal output from the external device interface 316, and extracts an image from the input stream signal to generate a thumbnail image. can The generated thumbnail image may be input to the controller 325 as it is or encoded. Also, the generated thumbnail image may be encoded in a stream form and input to the controller 325 . The controller 325 may display a thumbnail list including a plurality of thumbnail images on the display 330 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 330 converts the image signal, the data signal, the OSD signal processed by the controller 325, or the image signal and the data signal received from the external device interface unit 316 into R, G, and B signals, respectively. generate a drive signal. The display unit 330 may be a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED), a flexible display, a three-dimensional display, or the like. Meanwhile, the display unit 330 may be configured as a touch screen and used as an input device in addition to an output device. The audio output unit 335 receives a signal processed by the control unit 325, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 335 may be implemented with various types of speakers.

Meanwhile, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the digital TV to detect the user's gesture. The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 325 through the user input interface unit 320 . Meanwhile, a photographing unit (not shown) for photographing the user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 325 . The controller 325 may detect a user's gesture by individually or in combination with an image captured by a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

The power supply unit 340 supplies the corresponding power throughout the digital TV. In particular, to supply power to the control unit 325 that can be implemented in the form of a system on chip (SoC), the display unit 380 for displaying an image, and the audio output unit 335 for outputting audio. can To this end, the power supply unit 340 may include a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit 380 is implemented as a liquid crystal panel including a plurality of backlight lamps, an inverter capable of Pulse Width Modulation (PWM) operation for luminance variable or dimming driving (inverter) (not shown) may be further provided.

The remote control device 345 transmits a user input to the user input interface unit 320 . To this end, the remote control device 345 may use Bluetooth (Bluetooth), radio frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like. In addition, the remote control device 345 may receive an image, audio, or data signal output from the user input interface 320 , and display it on the remote control device 345 or output voice or vibration.

In addition, the digital TV according to the present invention may omit some of the illustrated components, or may further include a non-illustrated component if necessary. On the other hand, unlike the above, the digital TV does not include a tuner and a demodulator, and may receive and reproduce content through a network interface unit or an external device interface unit.

Referring to FIG. 3B , an example of the controller includes a demultiplexer 350 , an image processor, an OSD generator 366 , a mixer 370 , and a frame rate converter (FRC) 380 . ), and a formatter 390 . In addition, although not shown, the control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 350 demultiplexes the input stream. For example, the demultiplexer 350 may demultiplex the input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 350 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit performs image processing of the demultiplexed image signal. To this end, the image processing unit may include an image decoder 362 and a scaler 364 . The image decoder 362 decodes the demultiplexed image signal, and the scaler 364 scales the resolution of the decoded image signal to be output on the display unit. The video decoder 362 may support various standards. For example, the video decoder 362 performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and when the video signal is encoded in the DMB (Digital Multimedia Broadcasting) method or the H.264 standard. In this case, the function of the H.264 decoder may be performed. Meanwhile, the image signal decoded by the image processing unit is input to the mixer 370 .

The OSD generator 366 generates OSD data according to a user input or by itself. For example, the OSD generating unit 366 generates data for displaying various data in the form of graphics or text on the screen of the display unit based on the control signal of the user input interface unit. The generated OSD data includes various data such as a user interface screen of a digital TV, various menu screens, widgets, icons, and viewing rate information. The OSD generator 366 may generate data for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 370 mixes the OSD data generated by the OSD generator 366 and the image signal processed by the image processor, and provides them to the formatter 390 . Because the decoded image signal and the OSD data are mixed, the OSD is overlaid and displayed on the broadcast image or the external input image.

The frame rate converter (FRC) 380 converts a frame rate of an input image. For example, the frame rate converter 380 may convert a frame rate of an input 60Hz image to have a frame rate of, for example, 120Hz or 240Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when the frame rate converter 380 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or the first frame predicted from the first frame and the second frame It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate converter 380 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when a separate frame conversion is not performed, the frame rate conversion unit 380 may be bypassed.

The formatter 390 changes the output of the input frame rate converter 380 to match the output format of the display unit. For example, the formatter 390 may output R, G, and B data signals, and these R, G, and B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. can be In addition, when the output of the input frame rate converter 380 is a 3D video signal, the formatter 390 may support the 3D service through the display unit by composing and outputting it in a 3D form to match the output format of the display unit.

Meanwhile, the voice processing unit (not shown) in the control unit may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing of various audio formats. For example, even when the audio signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, it can be processed with a corresponding decoder. In addition, the voice processing unit in the control unit may process a bass (Base), a treble (Treble), volume control, and the like. A data processing unit (not shown) in the control unit may perform data processing of the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as start time and end time of a broadcast program aired on each channel.

Meanwhile, the digital TV described above is an example according to the present invention, and each component may be integrated, added, or omitted according to the specifications of the actually implemented digital TV. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, the function performed in each block is for explaining the embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention. Meanwhile, the digital TV may be an image signal processing device that performs signal processing of an image stored in the device or an input image. As another example of the image signal processing device, the set-top box (STB) in which the display unit 330 and the audio output unit 335 shown in FIG. 3A are excluded, the above-described DVD player, Blu-ray player, game device, computer and the like can be further exemplified.

4 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 4 , the mobile terminal 400 includes a wireless communication unit 410 , an audio/video (A/V) input unit 420 , a user input unit 430 , a sensing unit 440 , an output unit 450 , It may include a memory 460 , an interface unit 470 , a control unit 480 , a power supply unit 490 , and the like.

The wireless communication unit 410 may include one or more modules that enable wireless communication between the mobile terminal 400 and the wireless communication system or between the mobile terminal and a network in which the mobile terminal is located. For example, the wireless communication unit 410 may include a broadcast reception module 411 , a mobile communication module 412 , a wireless Internet module 413 , a short-range communication module 414 , a location information module 415 , and the like. .

The broadcast reception module 411 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives a previously generated broadcast signal and/or broadcast-related information and transmits the received broadcast signal and/or broadcast-related information to the terminal. The broadcast signal includes a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal. The broadcast related information may include information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 412 . The broadcast-related information may include, for example, data for generating and outputting an Electronic Program Guide (EPG) or Electronic Service Guide (ESG) in the mobile terminal 400 . The broadcast receiving module 411 is, for example, ATSC, Digital Video Broadcasting-Terrestrial (DVB-T), DVB-S (Satellite), Media Forward Link Only (MediaFLO), DVB-H (Handheld), ISDB-T ( A digital broadcast signal can be received using a digital broadcast system such as Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 411 may be configured to be suitable for other digital broadcast systems as well as the aforementioned digital broadcast system. A broadcast signal and broadcast-related information received through the broadcast reception module 411 may be stored in the memory 460 .

The mobile communication module 412 transmits/receives a wireless signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of a voice signal, a video call signal, or a text/multimedia message.

The wireless Internet module 413 may be built-in or external to the mobile terminal 400 , including a module for wireless Internet access. As wireless Internet technologies, wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used.

The short-distance communication module 414 refers to a module for short-distance communication. Bluetooth, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, RS-232, RS-385, etc. will be used as short range communication technologies. can

The location information module 415 is a module for acquiring location information of the mobile terminal 400 , and may be a global positioning system (GPS) module as an example.

The A/V input unit 420 is for inputting audio and/or video signals, and may include a camera 421 and a microphone 422 , and the like. The camera 421 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 451 .

The image frame processed by the camera 421 may be stored in the memory 460 or transmitted to the outside through the wireless communication unit 410 . Two or more cameras 421 may be provided according to the use environment.

The microphone 422 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 412 in the call mode and output. Various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 422 .

The user input unit 430 generates input data for the user to control the operation of the terminal. The user input unit 430 may include a key pad, a dome switch, a touch pad (static pressure/electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 440 detects the current state of the mobile terminal 400, such as the opening/closing state of the mobile terminal 400, the location of the mobile terminal 400, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration/deceleration of the mobile terminal. It detects and generates a sensing signal for controlling the operation of the mobile terminal 400 . For example, when the mobile terminal 400 is moved or tilted, the position or inclination of the mobile terminal may be sensed. In addition, whether the power supply unit 490 is supplied with power, whether the interface unit 470 is coupled to an external device may be sensed. Meanwhile, the sensing unit 440 may include a proximity sensor 341 including near field communication (NFC) or the like.

The output unit 450 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 451 , a sound output module 452 , an alarm unit 453 , and a haptic module 454 , etc. there is.

The display unit 451 displays (outputs) information processed by the mobile terminal 400 . For example, when the mobile terminal is in a call mode, a UI or GUI related to a call is displayed. When the mobile terminal 400 is in the video call mode or the photographing mode, the photographed and/or received image, UI, and GUI are displayed.

The display unit 451 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( flexible display) and at least one of a three-dimensional display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be viewed through them. This may be referred to as a transparent display, and a representative example of the transparent display is a TOLED (Transparant OLED). The rear structure of the display unit 451 may also be configured as a light transmission type structure. With this structure, the user can see an object located at the rear of the terminal body through the area occupied by the display unit 451 of the terminal body.

Two or more display units 451 may exist according to an implementation form of the mobile terminal 400 . For example, in the mobile terminal 400 , a plurality of display units may be spaced apart or disposed integrally on one surface, or may be respectively disposed on different surfaces.

When the display unit 451 and the sensor for sensing a touch operation (hereinafter, referred to as a 'touch sensor') form a layered structure (hereinafter referred to as a 'touch screen'), the display unit 451 may input input other than the output device. It can also be used as a device. The touch sensor may have the form of, for example, a touch film, a touch sheet, and a touch pad.

The touch sensor may be configured to convert a change in pressure applied to a specific part of the display unit 451 or a change in capacitance occurring in a specific part of the display unit 451 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of the touch.

When there is a touch input to the touch sensor, a corresponding signal(s) is sent to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 480 . Accordingly, the control unit 480 can know which area of the display unit 451 has been touched, and the like.

The proximity sensor 441 may be disposed in an inner region of the mobile terminal covered by the touch screen or in the vicinity of the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. Proximity sensors have a longer lifespan than contact sensors and their utility is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is of a capacitive type, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of bringing the pointer closer to the touch screen without making contact so that the pointer is recognized as being positioned on the touch screen is referred to as a “proximity touch”, and the touch The act of actually touching the pointer on the screen is called "contact touch". The position at which a proximity touch is performed with the pointer on the touch screen means a position at which the pointer vertically corresponds to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 452 may output audio data received from the wireless communication unit 410 or stored in the memory 460 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 452 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 400 . The sound output module 452 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 453 outputs a signal for notifying the occurrence of an event in the mobile terminal 400 . Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 453 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal may also be output through the display unit 451 or the audio output module 452 , so that they 451 and 452 may be classified as a part of the alarm unit 453 .

The haptic module 454 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 454 is vibration. The intensity and pattern of vibration generated by the haptic module 454 are controllable. For example, different vibrations may be synthesized and outputted or output sequentially. In addition to vibration, the haptic module 454 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of cold/warm using an element capable of absorbing heat or generating heat. The haptic module 454 may not only transmit the tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sense of a finger or arm. Two or more haptic modules 454 may be provided according to the configuration of the mobile terminal 400 .

The memory 460 may store a program for the operation of the controller 480 , and may temporarily store input/output data (eg, phone book, message, still image, video, etc.). The memory 460 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 460 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, It may include at least one type of storage medium among a magnetic disk and an optical disk. The mobile terminal 400 may operate in relation to a web storage that performs a storage function of the memory 460 on the Internet.

The interface unit 470 serves as a passage with all external devices connected to the mobile terminal 400 . The interface unit 470 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 400 , or transmits data inside the mobile terminal 400 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video I/O port, an earphone port, etc. may be included in the interface unit 470 .

The identification module is a chip storing various information for authenticating the usage right of the mobile terminal 400 , and includes a User Identify Module (UIM), a Subscriber Identify Module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the mobile terminal 400 through the port.

When the mobile terminal 400 is connected to an external cradle (cradle), the interface unit 470 is a passage through which power from the cradle is supplied to the mobile terminal 400, or various types of input from the cradle by the user. It may be a path through which a command signal is transmitted to the mobile terminal. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 480 generally controls the overall operation of the mobile terminal 400 . The control unit 480 performs related control and processing for, for example, a voice call, data communication, video call, and the like. The controller 480 may include a multimedia module 481 for playing multimedia. The multimedia module 481 may be implemented within the control unit 480 or may be implemented separately from the control unit 480 . The controller 480 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input made on the touch screen as characters and images, respectively.

The power supply unit 490 receives external power and internal power under the control of the control unit 480 to supply power necessary for the operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and other electrical units for performing functions. These may be implemented by the control unit 480 itself.

According to the software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented as a software application written in an appropriate programming language. Here, the software code may be stored in the memory 460 and executed by the controller 480 .

On the other hand, a wearable device that can be worn on the body beyond the dimension that the user mainly holds in the hand and uses may operate or function as a digital device or an external device in the present specification. Such wearable devices include smart watches, smart glasses, and head mounted displays (HMDs).

As shown in FIG. 1 , the wearable device may exchange (or interwork) data with another device. The short-range communication module 414 may detect (or recognize) a wearable device capable of communicating around the mobile terminal 400 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 400 , the controller 480 transmits at least a portion of data processed in the mobile terminal 400 through the short-range communication module 414 . can be sent to Accordingly, the user may use data processed by the mobile terminal 400 through the wearable device. For example, when a call is received by the mobile terminal 400 , a phone call can be made through the wearable device, or when a message is received by the mobile terminal 400 , the received message can be checked through the wearable device.

5 is a block diagram illustrating a digital device or an external device according to another embodiment of the present invention.

Referring to FIG. 5 , a watch-type mobile terminal, that is, a smart watch 500 , includes a main body 501 having a display unit 551 and a band 502 connected to the main body 501 to be worn on the wrist. includes In general, the smart watch 500 may include features of the mobile terminal 400 of FIG. 4 or features similar thereto.

The body 501 includes a case that forms an exterior. As illustrated, the case may include a first case 501a and a second case 501b that provide an internal space for accommodating various electronic components. However, the present invention is not limited thereto, and one case is configured to provide the inner space, so that the unibody mobile terminal 500 may be implemented.

The smart watch 500 is configured to enable wireless communication, and an antenna for the wireless communication may be installed in the main body 501 . On the other hand, the antenna can expand its performance by using a case. For example, a case including a conductive material may be electrically connected to the antenna to expand the ground area or the radiation area.

A display unit 551 may be disposed on the front surface of the main body 501 to output information, and a touch sensor may be provided on the display unit 551 to be implemented as a touch screen. As illustrated, the window 551a of the display unit 551 may be mounted on the first case 501a to form a front surface of the terminal body together with the first case 501a.

The main body 501 may include a sound output unit 552 , a camera 521 , a microphone 522 , a user input unit 523 , and the like. When the display unit 551 is implemented as a touch screen, it may function as the user input unit 523 , and accordingly, a separate key may not be provided in the main body 501 .

The band 502 is worn on the wrist to surround the wrist, and may be formed of a flexible material for easy wearing. As such, the band 502 may be formed of leather, rubber, silicone, synthetic resin, or the like. In addition, the band 502 is configured to be detachable from the main body 501, and may be configured to be replaceable with a band of various types according to the user's taste.

On the other hand, the band 502 may be used to extend the performance of the antenna. For example, the band may have a built-in ground extension unit (not shown) electrically connected to the antenna to expand the ground area.

The band 502 may be provided with a fastener 502a. The fastener 502a may be implemented by a buckle, a snap-fit hook structure, or velcro (trade name), etc., and may include an elastic section or material. . In this figure, an example in which the fastener 502a is implemented in the form of a buckle is presented.

6 is a diagram illustrating a control means for controlling a digital device according to an embodiment of the present invention.

In order to control the digital device 600 , a front panel (not shown) or a control unit (input unit) provided on the digital device 600 is used.

On the other hand, the control means is a user interface device (UID) capable of wired and wireless communication, mainly implemented for the purpose of controlling the digital device 600, the remote control 610, the keyboard 630, the pointing device 620, A touch-pad or the like is included, but a control means exclusively for external input connected to the digital device 600 may also be included. In addition, the control means includes a mobile terminal, such as a smart phone, a tablet PC, etc. that controls the digital device 600 through mode switching, etc., not for the purpose of controlling the digital device 600 . However, in the present specification, a pointing device is described as an example for convenience, but is not limited thereto.

The input means are communication protocols such as Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA), UWB (Ultra Wideband), ZigBee, DLNA (Digital Living Network Alliance), RS, etc. can communicate with the digital device by employing at least one or more as necessary.

The remote control 610 refers to a general input means provided with various key buttons necessary for controlling the digital device 600 .

The pointing device 620 is equipped with a gyro sensor to implement a pointer corresponding to the screen of the digital device 600 based on the user's movement, pressure, rotation, etc. ) to transmit a predetermined control command. The pointing device 620 may be named by various names, such as a magic remote control and a magic controller.

As the digital device 600 provides various services such as a web browser, an application, and a social network service (SNS) as an intelligent integrated digital device beyond the conventional broadcasting only, the keyboard 630 can be controlled only with the conventional remote control 610. It was not easy, so it was implemented to improve the convenience of inputting text, etc. by implementing it similar to a PC keyboard.

On the other hand, the control means such as the remote control 610, the pointing device 620, the keyboard 630 is provided with a touch pad if necessary, so that text input, pointer movement, enlargement/reduction of pictures or videos, etc. for more convenient and various control purposes is available for

Hereinafter, according to the present invention, enlarge/reduce, that is, zoom (hereinafter referred to as zoom) for a desired region, that is, a region of interest (ROI) from content in a digital device according to the present invention. When a request is received, an embodiment of processing the region of interest (ROI) according to the zoom request so that it can be identified from the entire region of the image frame, the attribute of the zoomed region of interest (ROI) is automatically adjusted according to the attribute of the content Alternatively, manually (automatically or manually) by processing differently from the properties of the content to increase the convenience of identification, and to provide various zoom functions such as search as well as enlargement/reduction of the region of interest. It will be described in detail with reference to the drawings. Through this, the present invention can provide various zoom functions as described above to improve user satisfaction and inspire a desire to purchase a product. In the above, when a zoom request is received, the content may or may not be continuously played. In addition, the zoom-requested region of interest (ROI) may be continuously provided in a still image or moving image format. If the zoom requested region of interest (ROI) is provided in the video format, the data is processed by tracing continuously from the point of view of the region regardless of the object in the region of interest (ROI) at the time of the zoom request. Data may be processed by continuously tracking a specific object in the region of interest (ROI) as an object of interest at the time of the zoom request, not from the viewpoint of the region, but from the viewpoint of the object. Meanwhile, in describing the present invention, content is composed of one or more image frames, and each image frame may include at least one or more of a background, an object, and a text. there is.

7 is a diagram for explaining the selection of a region of interest (ROI) in a digital device according to an embodiment of the present invention, and FIG. 8 is a diagram illustrating selection of a region of interest (ROI) in the digital device according to another embodiment of the present invention. It is a drawing shown for explanation.

7 and 8 show a method of selecting a region of interest (ROI) in a digital device, respectively. Here, FIG. 7 is an embodiment of selecting a region of interest (ROI) in units of a preset region, and FIG. 8 is an embodiment of selecting a region of interest (ROI) in units of objects in an image frame. Meanwhile, although not shown, it is obvious that the entire image frame may be selected as a region of interest (ROI) in FIGS. 7 and 8 .

First, with reference to FIG. 7 , a method of selecting a region of interest (ROI) in units of regions will be described as follows.

The digital device divides the screen into 4 divisions as shown in FIG. 7a, 9 divisions as shown in FIG. 7b, or 9 divisions as shown in FIG. It is divided into 16 divisions together, and the selection can be induced by providing each division area so that it can be identified. At this time, the digital device stores the preset values and set values related to the selection of the region of interest (ROI) in advance in a memory, a storage unit or medium, etc. You can configure the screen like this.

On the other hand, in the digital device, after the division region (eg, 4 divisions as shown in FIG. 7A ) for selecting the region of interest (ROI) is initially provided through the hot-key of the remote control, the direction key, the channel, or the volume up/down key It is also possible to arbitrarily control the division ratio through . In addition, various methods such as voice, gesture, eye-tracking, etc. may be used in relation to screen configuration such as calling a division for the region of interest (ROI) or controlling the aspect ratio. .

7 illustrates a method of selecting a region of interest (ROI) in an image frame in units of regions, as described above. On the other hand, FIG. 8 is a method of selecting a region of interest (ROI) in units of objects.

Referring to FIG. 8A , one or more objects 810 , 820 , 830 , and 840 exist in an image frame and can be accessed individually. Such object unit processing may be performed, for example, based on content information. For example, if the content is encoded in MPEG-4 or the like and includes service information on objects, the digital device may support processing in units of objects based on the service information and the like.

When the user selects any one of the objects 810 , 820 , 830 , and 840 , the digital device differentiates the selected object 830 from other objects so that the user can identify the selection. For example, in the case of FIG. 8B , an edge or an outline 850 of the selected object 830 is processed as a dotted line to differentiate it from other objects. However, this is only an example, and the present invention is not limited thereto.

Meanwhile, when the user selects the object 830 , the digital device may provide a menu 860 as shown in FIG. 8B to provide additional functions or additional information on the selected object 830 . Referring to FIG. 8B , the menu 860 includes menu items related to the execution of functions such as Zoom (enlargement/reduction), Search, detailed information, and execution of a web browser or output of detailed information. However, the present invention is not limited to the content shown in FIG. 8B. In addition, the digital device may not provide the menu 860 as shown in FIG. 8B , but may immediately execute mapping or related functions or applications in advance.

9 is a diagram illustrating a method of processing a region of interest (ROI) in a digital device when a region of interest (ROI) is selected with reference to FIGS. 7 or 8 according to an embodiment of the present invention.

FIG. 9A is a case of selecting a region of interest (ROI) in units of regions as shown in FIG. 7 , and FIG. 9B is a case of selecting a region of interest (ROI) in units of objects as shown in FIG. 8 .

As shown in FIG. 9A or 9B by a control means such as a remote control, the digital device zooms the selected ROIs 910 and 920 when the ROIs 910 and 920 are selected. A region of interest (ROI) 930 is output on the screen. In this case, the digital device provides the zoom window 940 to a predetermined area on the screen, and provides the entire image frame on the provided zoom window 940 .

10 to 12 are diagrams illustrating a zoom function processing method for a region of interest (ROI) in a digital device according to an embodiment of the present invention.

10 to 12 are for describing a function execution according to an additional action of a user after a zoom function is executed by selecting a region of interest (ROI) according to FIG. 9 .

Referring to FIG. 10 , the digital device provides a region of interest (ROI) 1010 on a screen and provides a zoom window 1020 in one region of the screen. Here, the digital device provides a zoom sub-window 1025 to identify a region of interest (ROI) 1010 that is currently zoomed in the zoom window 1020 and is output on a screen. On the other hand, one end of the zoom window 1020 is provided with a zoom progress bar for adjusting the zoom magnification, one end of the zoom progress bar has an icon 1032 for reducing the magnification, and the other end of the zoom progress bar. may be provided with an icon 1034 for magnification. Meanwhile, on the zoom progress bar, graphic processing and/or a numerical display (eg, X2) for the magnification may be provided to identify the current zoom magnification. In addition, the digital device may also output the guide data 1050 to identify that the device is currently executing the zoom function.

In FIG. 10 , the digital device provides at least one of a general pointer 1042 or a zoom pointer 1044 according to the execution of a zoom function. In the above, when the general pointer 1042 is provided, it performs the same function as that of the original pointer. On the other hand, when the zoom pointer 1044 is provided, the zoom magnification may be enlarged/reduced according to a key button press of the control means, a voice, a gesture, or the like. Meanwhile, although not shown, the zoom pointer 1044 may additionally control a zoom of a specific sub-ROI or a specific object within the region of interest (ROI) 1010 . In this case, the digital device does not change the screen itself that is initially zoomed and is provided on the screen, and displays the zoomed screen additionally to the corresponding position or one area within the screen only for the area or object additionally zoomed in through a separate window. can provide The zoom pointer 1044 can be provided, for example, by pressing the zoom function key once more or by long-clicking on the control means.

In addition, if the digital device moves the pointer into the zoom window 1020 and adjusts the zoom magnification through the zoom progress bar, the size of the zoom window 1020 or the image frame itself in the zoom window 1020 is adjusted to the adjustment magnification. You can also control it accordingly. In this case, if the pointer exists in the zoom sub-window 1025 , the size of the zoom sub-window 1025 or the zoom magnification of the screen provided in the sub-frame 1025 may be adjusted.

In addition, the digital device may move the zoom sub-window 1025 within the zoom window 1020 according to the position of the pointer, and the region of interest (ROI) provided on the screen according to the movement of the zoom sub-window 1025 ROI) is changed, and data corresponding to the changed ROI may be provided on the screen.

In FIG. 11A , a zoomed region of interest (ROI) 1110 is provided as the main screen as in FIG. 10 described above, and the entire screen of the image frame is provided through the zoom window 1120 as a PIP. In this case, the digital device may switch between the main screen and the PIP as shown in FIG. 11B according to the user's control command through the control means and provide the main screen. As described above, the control command may include a specific key of the remote control, a voice, a gesture, and the like.

In the case of adding a region of interest (ROI) without canceling the first region of interest (ROI) after the user selects the first region of interest (ROI) during content reproduction, the digital device may process as shown in FIG. 12 . .

Referring to FIG. 12 , when a user selects three regions of interest (ROIs), the digital device provides the three regions of interest (ROIs) through individual zoom windows 1220 , 1230 , and 1240 , respectively. In this case, the digital device may display the order as a number or the like according to the order selected as the region of interest (ROI) to help the user's identification convenience. Meanwhile, in this case, as shown in FIG. 12 , the digital device provides the entire image frame on the main screen 1210 and provides the region of interest (ROI) in the form of a PIP. However, although not shown, conversely, a plurality of regions of interest may be simultaneously provided on the main screen through screen division, and data for the entire image frame on one region of the screen may be provided through a PIP window, that is, a zoom window. . In this case, a plurality of zoom sub-windows corresponding to a plurality of regions of interest (ROIs) may be provided in the zoom window.

Meanwhile, in the digital device, after providing zoom windows 1220 , 1230 , 1240 or a plurality of zoom sub-windows, after providing one zoom window, one zoom window or zoom sub-window is combined with another zoom window or zoom sub-window. If overlapped, either the overlapped zoom windows or zoom sub-windows may be removed. Alternatively, when a specific zoom window or a specific zoom sub-window is selected, an icon (not shown) for deleting the corresponding window may be provided, and whether to remove the window may be determined according to the selection.

In addition, although FIG. 12 shows that a zoom window is provided on the right side of the screen, each window is movable and is not necessarily limited to the above arrangement or arrangement.

13 to 17 are diagrams illustrating a method of performing an additional function after providing zoomed region of interest (ROI) data according to an embodiment of the present invention.

Referring to FIG. 13 , the digital device provides the selected region of interest (ROI) data through the main screen 1310 and the entire image frame data to a predetermined region within the screen through the zoom window 1320 . At this time, in the entire image frame being provided through the zoom window 1320 , a separate indicator 1325 is used to identify the location or region of the region of interest (ROI) data currently provided through the main screen 1310 . is provided Also, a zoom progress bar for identifying and controlling a zoom magnification of the region of interest (ROI) data being provided on the main screen 1310 may be provided around the zoom window 1320 .

Here, if the user selects some of the region of interest (ROI) data being provided on the main screen 1310 through the pointers 1330 and 1340 or selects the indicator 1325 in the zoom window 1320, Function icons 1335 and 1345 for selecting additional functions may be provided. In the above, a selected portion of the region of interest (ROI) data being provided on the main screen 1310 may be, for example, an area unit as shown in FIG. 7 or an object unit as shown in FIG. 8 . Meanwhile, in this specification, the term “selection” means access through a pointer, a control means such as a remote control, or pressing a key button provided on a front panel, or a corresponding area or object. It means a case of staying on the screen for a predetermined time or more or at least one of drag & drop, hovering, and the like. In addition, the selection is made by data sensed from sensors related to voice, gesture, eye-tracking, etc. or combined with the above-mentioned selection method. may be done

As described above, when the function icons 1335 and 1345 are provided and the provided function icons 1335 and 1345 are selected, guide data 1410 including a function list as shown in FIG. 14 may be provided. In this case, in the case of FIG. 14 , a case in which the guide data 1410 is provided when there is a pointer on an indicator within the zoom window is exemplified. In this case, the guide data 1410 is provided within the zoom window, for example, as shown in FIG. 14 , but is not limited thereto, and may be provided on another area within the screen other than within the zoom window. Meanwhile, when the pointer points to a predetermined area or object on the main screen instead of as an indicator in the zoom window, the guide data 1410 may be provided to a predetermined area within the screen.

When any one item is selected from the guide data 1410 of FIG. 14 , the digital device executes a web browser and provides a web service through the executed web browser, as shown in at least one of FIGS. 15A to 15C .

For example, the digital device may provide the web service as shown in FIG. 15B or 15C according to a user's control command while providing the web service as shown in FIG. 15A . In other words, the size of the web browser or the output area thereof can be arbitrarily changed and controlled.

16 is an embodiment of providing a content list 1610 related to an item according to an item selected from the guide data 1410 of FIG. 14 . The content list 1610 may be provided in the form of an Electronic Program Guide (EPG) or an Electronic Service Guide (ESG). On the other hand, the output area or size of the screen of the content list 1610 can also be arbitrarily changed and controlled, and may be provided so that it can be scrolled.

17A or 17B, when any one item is selected from the guide data 1410 of FIG. 14, one or more application icons ( 1710 to 1760) are provided in a predetermined area within the screen. When any one of the application icons 1710 to 1760 is selected, an application corresponding to the selected application icon is automatically executed. The thus-executed application screen is provided in a predetermined area within the screen. Meanwhile, when the specific application icon is selected, other application icons may or may not be continuously provided. As in the former case, when another application icon is continuously provided, when the user selects another application, another application screen may be provided instead of or provided together with the existing screen. As in the latter case, when provided together, it may be provided in the form of providing a multi-tap service for a web service on a web browser.

Meanwhile, the application icons 1710 to 1760 shown in FIGS. 17A and 17B are not limited thereto, and are configured and provided in various ways according to items selected from the guide data 1410 of FIG. 14 . can be Also, as will be described later, the application icons 1710 to 1760 may be provided differently according to the zoom magnification level.

18 to 22 are diagrams for a method of processing region of interest (ROI) data according to a zoom magnification level according to an embodiment of the present invention.

18 is an embodiment in which an object is changed and pointed in region of interest (ROI) data according to a zoom magnification level, and FIG. 19 is an embodiment in which a sub-object of a specific object in ROI data is changed and pointed according to a zoom magnification level example, and FIG. 20 shows a combined embodiment of FIGS. 18 and 19 .

Here, the change of the zoom magnification level is performed by, for example, pressing up/down or left/right key buttons, channel/volume up/down key buttons, or pressing the zoom key button several times or voice, gesture, eye- This may be accomplished by sensing data through tracking sensors. Alternatively, the zoom magnification level may be changed by directly handling the zoom magnification adjustment progress bar provided on the zoom window of FIGS. 18 to 20 using a control means such as a remote control.

Meanwhile, for the sake of convenience, the description is given as an example in which region of interest (ROI) data is provided on the main screen and entire image frame data is provided on a zoom window, but the present invention is not limited thereto.

First, FIG. 18 illustrates, for example, a processing method according to a change of a zoom magnification level when a plurality of objects exist in ROI data.

When a region of interest (ROI) is selected, the digital device provides the selected region of interest (ROI) data on the main screen according to a predefined zoom factor.

Thereafter, when the digital device receives a zoom magnification change control command for the region of interest (ROI) data provided with the predefined zoom magnification, an indicator indicating a specific object within the region of interest (ROI) as shown in FIG. 18A ( 1810) is provided. When the digital device accesses the provided object or indicator 1810 after the indicator 1810 is provided, as shown in FIG. 18A , as shown in FIGS. 13 to 17 above, additional function items or additions for the object information can be provided.

In FIG. 18A , if the zoom magnification change control command is received again, the digital device provides indicators 1820 and 1830 for objects other than the randomly or automatically selected object in FIG. 18A , as shown in FIG. 18B or 18C . Thereafter, as described above, additional functions or additional information are provided according to the corresponding object according to the access to the indicators 1820 and 1830 .

18D is a diagram for processing according to another embodiment of FIG. 18B or indicator 1820 access. For example, as shown in FIG. 18B, when a specific object is selected according to the zoom magnification change control command, an indicator 1820 related thereto is provided, and a separate window 1850 for only the corresponding object is shown together with the indicator 1820. 18d is provided. The window 1850 may be provided with an enlarged screen of only the corresponding object according to the zoom ratio according to the zoom ratio change control command, or additional function execution screens such as recommended content or related data or additional information may be provided. . In FIG. 18D , according to an embodiment, the digital device may identify one or more selectable sub-objects within the enlarged object together with a screen enlarged by a zoom factor corresponding to the zoom factor change control command of the corresponding object. provided by sub-indicators.

As described above, referring to FIG. 18 , when a plurality of objects exist in the zoomed region of interest (ROI), different objects are selected according to the zoom magnification change control command, and an additional function related thereto or may provide additional information. Meanwhile, when changing the zoom magnification such as enlarging/reducing the entire region of interest (ROI) according to the zoom magnification change control, a zoom magnification icon provided on the zoom window may be used.

In addition, in place of the zoom magnification change control command, even when a specific object is selected according to the movement of the pointer of the control means, as shown in FIG. 18D , at least one of a window 1850, sub-objects, additional functions or additional information, etc. You can also provide one.

On the other hand, in FIG. 18 , when the currently selected object is excluded from the previously provided region of interest (ROI) as the region of interest (ROI) itself is moved through the indicator within the entire image frame on the zoom window, in FIG. The above-described settings or application contents may be reset.

In addition, if the zoom magnification change control command is continuously received, it may be provided as shown in FIGS. 18A to 18C so that objects can be selected while continuously being cycled within the region of interest (ROI) in a wrap around manner. . Alternatively, in the above case, the digital device may enlarge and provide the region of interest (ROI) itself to include a selectable object in its vicinity rather than the region of interest (ROI) in the entire image frame, or vice versa. there is. For example, referring to the entire image frame being provided on the zoom window as shown in FIG. 18 , there are a total of 6 people (objects), but 3 people are fully zoomed in the region of interest (ROI) and some human bodies are included. it can be seen that In this case, when the 4th zoom magnification change control command is received, for example, the ROI itself is enlarged so that either a person half on the left side of the screen or a person half on the right side of the screen can be included in the ROI. You can extend it a bit more and provide an indicator for that.

Contrary to the above, the digital device may provide an indicator to be able to identify selectable sub-object(s) of a specific object when a zoom factor change control command is received.

Referring to FIG. 19A , according to a first zoom factor control command, the digital device provides an indicator (or sub-indicator) 1910 to identify a first sub-object of the object. Then, the digital device provides an indicator 1920 such that a second sub-object of the object is identified as shown in FIG. 19B according to the second zoom factor control command, and according to the third zoom factor control command, as shown in FIG. 19C, An indicator 1930 may be provided to identify a third sub-object of the object.

Meanwhile, in FIGS. 19A to 19C , a separate window 1940 may be provided with respect to a sub-object identified according to the zoom magnification control command, and only the sub-object corresponding to the zoom magnification may be separately provided.

The digital device provides an indicator to be selectable while continuously changing sub-object(s) within the corresponding object according to the zoom scale control command, wherein when the zoom scale control command is more than the number of sub-objects, automatically another object The same operation may be performed for . Alternatively, as described above, only sub-objects of the corresponding object are provided to be selectable while continuously circulating, but when another object is selected through a pointer, sub-object information about the other object may be provided at that time.

Also, when the indicators 1910 , 1920 , 1930 or the window 1940 for the sub-object are accessed, the digital device may provide an additional function or additional information corresponding to the accessed indicator or window.

FIG. 20 is a combination of FIGS. 18 and 19 described above. When an object 2010 is first selected according to a pointer or a first zoom magnification control command, and an additional zoom magnification control command is received, sub-objects for the selected object Identification indicators 2020 to 2040 or a window 2050 may be provided.

Also, referring to FIG. 20 , when one object 2010 is selected, indicators for one or more sub-objects 2020 to 2040 in the selected object 2010 may be provided at once.

Meanwhile, referring to FIG. 20 , an image of a specific object or sub-object is zoomed and provided through a separate window 2050. Referring to FIG. 21, instead of the window 2050, a search window 2110 is provided, a search word A corresponding to a specific object or sub-object provided in the search window may be provided, and a search result 2120 corresponding to the provided search word A may be provided. On the other hand, as shown in FIGS. 20 to 21 , when there are a plurality of objects or a plurality of sub-objects within one object, a search term corresponding to each object or sub-object is provided in the search window 2210 as shown in FIG. 22 , , a search result or image corresponding to the search words may be provided in the form of a tab on a web browser for each search word.

18 to 22, selection of each step or object or sub-object, provision of a search word, provision of a search result, etc. may be performed according to a zoom magnification level control command for every operation. For example, referring to FIG. 22 , there are three sub-objects in one object, and whenever a zoom magnification level command is received, a search term is provided, such as A, A+B, A+B+C, The search results for each are presented in a tab or the like manner. Meanwhile, according to the zoom magnification level control command in the above, a search term such as A, B, and C may be provided, or it may be combined with the above method.

In addition, although not shown, detailed information on a selected object or sub-object may be provided according to a change in the zoom magnification level, separately or in combination with any one of the embodiments of FIGS. 18 to 22 .

23 is a diagram illustrating a zoom function processing method for a region of interest (ROI) in a digital device according to another embodiment of the present invention.

23 is an embodiment of another processing method of region-of-interest (ROI) data.

Referring to FIG. 23A , when a region of interest (ROI) 2315 is selected from the image frame 2310 provided through the main screen, the digital device displays the region of interest (ROI) data and Additional information corresponding to the region of interest (ROI) data may be provided.

23B to 23E show the same content, but only provide additional information of region of interest (ROI) data, but with different levels of transparency. Such transparency level control may be achieved through, for example, a zoom magnification level control command.

Referring to FIG. 23B , the region of interest (ROI) data selected in FIG. 23A is provided on the main screen at a predetermined zoom magnification, and the entire image frame data is displayed in the first region. An indicator for identifying the region of interest (ROI); It is provided through the first window 2320 together. When the indicator or first window 2320 is accessed, as described above, a zoom menu 2325 including one or more menu items is provided, and according to the zoom menu 2325 access, the zoom menu 2325 is displayed. Additional information corresponding to a specific menu item selected from is provided through the second window 2330 . In this case, the second window 2330 has, for example, a transparency level of 25%. 23C to 23E have the same screen configuration as that of FIG. 23B described above, except that only the transparency of the windows 2340 , 2350 , and 2360 corresponding to the second window 2330 is different. For example, the transparency level of the window 2340 shown in FIG. 23C is 50%, the transparency level of the window 2350 shown in FIG. 23D is 75%, and finally the transparency level of the window 2360 shown in FIG. 23E is 50%. The level is 0%. The transparency level may be changed as illustrated in accordance with a control command such as a zoom magnification level and the like, and a screen may be provided with a transparency level of any one of FIGS. 23B to 23E according to an initial preset setting.

24 and 25 are flowcharts of a method of processing region of interest (ROI) data in a digital device according to an embodiment of the present invention.

The digital device reproduces the content on the screen (S2402), and receives a region of interest (ROI) selection signal from the image frame of the content being reproduced (S2404).

The digital device zooms the ROI data by a preset zoom factor and provides it on the screen (S2406).

Thereafter, when the digital device receives a first zoom magnification change command for the provided region of interest data ( S2408 ), the object in the region of interest and one or more objects belonging to the object according to the first zoom magnification change command are received ( S2408 ). An indicator indicating at least one of the sub-objects is provided (S2410).

The digital device provides a zoom menu including one or more menu items according to the indicator access signal (S2412), and displays function execution or information corresponding to the menu item selected from the zoom menu (S2414).

The digital device may display the entire image frame data including the region of interest (ROI) and an indicator indicating the region of interest (ROI) in the entire image frame in a PIP form on the screen through the first window, At least one of the object and sub-objects indicated by the indicator may be displayed through the second window according to the first zoom magnification change control command.

Referring to FIG. 25 , when a second zoom magnification change command is received ( S2502 ), the digital device determines whether there are a plurality of objects in the ROI according to the second zoom magnification change command ( S2504 ).

If, as a result of the determination in step S2504, there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest (A), the digital device determines the region of interest according to the second zoom magnification change command. A second indicator indicating my other object is provided (S2506).

If, as a result of the determination in step S2504, there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest (B), the digital device determines the region of interest according to the second zoom magnification change command. A third indicator indicating any one of one or more sub-objects belonging to my corresponding object is provided (S2508).

If, as a result of the determination in step S2504, the digital device has a plurality of objects in the region of interest, the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest In (C), a fourth indicator indicating another sub-object belonging to the corresponding object in the ROI is provided according to the second zoom magnification change command (S2510).

If, as a result of the determination in step S2504, there are not a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest (D), the digital device determines the interest according to the second zoom magnification change command. A fifth indicator indicating any one of one or more sub-objects belonging to the corresponding object in the region is provided (S2512).

If, as a result of the determination in step S2504, the digital device does not have a plurality of objects in the region of interest, the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest In (E), a sixth indicator indicating another sub-object belonging to the corresponding object in the ROI is provided according to the second zoom magnification change command (S2514).

Meanwhile, the digital device may display a search word corresponding to at least one of an object and sub-objects indicated by an indicator according to the zoom magnification change control command and a search result according to the search word through a third window.

Therefore, according to various embodiments of the present invention described above, in the digital device, only a desired region within an image frame of content, that is, a region of interest (ROI) is enlarged/reduced, and the enlarged/reduced region of interest (ROI) is displayed in the image frame. It can be processed so that it can be identified from the entire area, and the property of the region of interest (ROI) that is enlarged/reduced according to the property of the content can be automatically or manually processed differently from the property of the content to increase the convenience of identification and enlarge / Implementing the reduced region of interest (ROI) as a three-dimensional image (3D), and providing rotatable data of the region of interest (ROI) implemented in the three-dimensional image to provide data from other viewpoints of the region of interest (ROI) can be obtained.

In the digital device and data processing method in the digital device disclosed in this specification, the configuration and method of the above-described embodiments are not limitedly applicable, but the embodiments are all or all of the embodiments so that various modifications can be made. Some of them may be selectively combined and configured.

Meanwhile, the method of operating a digital device disclosed in the present specification can be implemented as processor-readable codes on a processor-readable recording medium provided in the digital device. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of the processor-readable recording medium include ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. It includes those implemented in the form of a wave (carrier-wave). In addition, the processor-readable recording medium is distributed in a computer system connected through a network, so that the processor-readable code can be stored and executed in a distributed manner.

On the other hand, although the present specification has been described with reference to the accompanying drawings, this is only an embodiment and is not limited to a specific embodiment, and various contents that can be modified by those of ordinary skill in the art to which the present invention belongs are also claimed. It belongs to the scope of rights according to In addition, such modifications should not be separately understood from the spirit of the present invention.

201: network interface unit 202: TCP/IP manager
203: service delivery manager 204: SI decoder
205: demultiplexer 206: audio decoder
207: video decoder 208: display unit
209: service control manager 210: service discovery manager
211: SI&Metadata Database 212: Metadata Manager
213: service manager 214: UI manager

Claims (20)

A data processing method in a digital device, comprising:
playing content on the screen;
receiving a region of interest (ROI) selection signal from the image frame of the content;
zooming the region of interest data by a preset zoom factor and providing the data on a screen;
receiving a first zoom magnification change command for the provided region of interest data;
providing an indicator indicating at least one of an object in the region of interest and one or more sub-objects belonging to the object according to the first zoom magnification change command; and
and providing a zoom menu including one or more menu items according to the indicator access signal, and displaying information or executing a function corresponding to a menu item selected from the zoom menu. According to claim 1,
Displaying the entire image frame data including the region of interest (ROI) and an indicator indicating the region of interest (ROI) within the entire image frame in a PIP form on a screen through a first window A method of data processing in a digital device. 3. The method of claim 2,
and displaying at least one of the object and sub-objects indicated by the indicator through the second window according to the first zoom magnification change control command. According to claim 1,
receiving a second zoom magnification change command; and
and determining whether there are a plurality of objects in the region of interest according to the second zoom magnification change command. 5. The method of claim 4,
As a result of the determination, when there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, a second indicator is provided for indicating other objects in the region of interest according to the second zoom magnification change command Data processing method in a digital device, characterized in that it further comprises the step of. 5. The method of claim 4,
As a result of the determination, if there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, one or more sub- The method of processing data in a digital device, characterized in that it further comprises the step of providing a third indicator indicating any one of the objects. 5. The method of claim 4,
As a result of the determination, if there are a plurality of objects in the region of interest and the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest, the second zoom magnification is changed and providing a fourth indicator indicating another sub-object belonging to the object in the region of interest according to a command. 5. The method of claim 4,
As a result of the determination, if there are not a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, one or more sub-subordinates belonging to the corresponding object in the region of interest according to the second zoom magnification change command - Data processing method in a digital device, characterized in that it further comprises the step of providing a fifth indicator indicating any one of the objects. 5. The method of claim 4,
When it is determined as a result of the determination that there are not a plurality of objects in the region of interest and the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest, the second zoom magnification is changed and providing a sixth indicator indicating another sub-object belonging to the corresponding object in the ROI according to a command. According to claim 1,
Displaying a search term corresponding to at least one of an object and sub-objects indicated by an indicator according to the first zoom magnification change control command and a search result according to the search term through a third window A data processing method in a digital device, characterized in that it is In a digital device,
a user interface unit for receiving a region of interest (ROI) selection signal from an image frame of content reproduced on the screen;
a control unit controlling content reproduction and controlling the ROI data to be provided by being zoomed at a preset zoom factor; and
including a display unit,
The user interface unit further receives a first zoom magnification change command for the provided region of interest data,
The control unit controls to provide an indicator indicating at least one of an object within the region of interest and one or more sub-objects belonging to the object according to the first zoom magnification change command, and according to the indicator access signal A digital device that controls to display a zoom menu including one or more menu items, and controls execution of a function corresponding to a menu item selected from the zoom menu or displays information. 12. The method of claim 11,
The control unit is
Digital device, characterized in that it controls to display the entire image frame data including the region of interest (ROI) and an indicator indicating the region of interest (ROI) in the entire image frame in a PIP form on a screen through a first window . 13. The method of claim 12,
The control unit is
and controlling to display at least one of an object and sub-objects indicated by an indicator through a second window according to the first zoom magnification change control command. 12. The method of claim 11,
The control unit is
When a second zoom magnification change command is further received from the user interface, it is determined whether there are a plurality of objects in the ROI according to the second zoom magnification change command. 15. The method of claim 14,
The control unit is
As a result of the determination, when there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, a second indicator is provided for indicating other objects in the region of interest according to the second zoom magnification change command A digital device, characterized in that it is controlled to do so. 15. The method of claim 14,
The control unit is
As a result of the determination, if there are a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, one or more sub- Digital device, characterized in that the control to provide a third indicator indicating any one of the objects. 15. The method of claim 14,
The control unit is
As a result of the determination, if there are a plurality of objects in the region of interest and the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest, the second zoom magnification is changed and controlling to provide a fourth indicator indicating another sub-object belonging to the object in the region of interest according to a command. 15. The method of claim 14,
The control unit is
As a result of the determination, if there are not a plurality of objects in the region of interest and the first indicator indicates only the objects in the region of interest, one or more sub-subordinates belonging to the corresponding object in the region of interest according to the second zoom magnification change command - Digital device, characterized in that the control to provide a fifth indicator indicating any one of the objects. 15. The method of claim 14,
The control unit is
When it is determined as a result of the determination that there are not a plurality of objects in the region of interest and the first indicator indicates only one sub-object among one or more sub-objects belonging to the object in the region of interest, the second zoom magnification is changed and controlling to provide a sixth indicator indicating another sub-object belonging to the corresponding object in the ROI according to a command. 12. The method of claim 11,
The control unit is
Controlling a search word corresponding to at least one of an object and sub-objects indicated by an indicator and a search result according to the search word to be displayed through a third window according to the first zoom magnification change control command device.

Images