KR20140029810A - Multimedia device for communicating with at least one device and method for controlling the same - Google Patents

Abstract

Disclosed are a remote controller and a control method for a multimedia device. The multimedia device communicating with one or more devices, in accordance with an embodiment of the present invention, includes a first interface module receiving a video image from an outer electronic device; a controller determining a currently focused first sub area and information on a location of a sub area; a second interface module receiving a command signal from a remote controller; and a display module focusing a second sub area instead of the first sub area and displaying the same based on the command signal and a determination result of the controller. [Reference numerals] (3040) Real-time broadcasting; (3831,3850) TV recommendation; (AA,BB) Specific code values : ↓

Description

TECHNICAL FIELD [0001] The present invention relates to a multimedia device and a control method thereof, and more particularly to a multimedia device that communicates with at least one device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia device communicating with at least one device and a control method thereof, and more particularly to a technology for controlling external electronic devices having different communication protocols using a single remote controller.

With the development of electronic technology, more and more kinds of electronic devices are being developed and popularized. Recently, electronic devices have a function of receiving a remote control signal for the convenience of the user. Accordingly, a user can control various electronic devices such as a TV, an audio player, a DVD player, an air conditioner, a fan, and the like using a remote controller.

Meanwhile, a recently developed multimedia device (for example, a TV, etc.) has a function of receiving various information by being connected to the Internet network. Accordingly, there is a problem in that a remote controller is required for controlling the multimedia device and the electronic device (e.g., STB, BD player, PC, etc.) connected to the multimedia device.

An object of the present invention is to provide a hybrid remote controller capable of controlling heterogeneous devices under two different communication protocols.

Another object of the present invention is to provide a solution for controlling heterogeneous devices while minimizing the memory usage of the remote controller.

In addition, another object of the present invention is to analyze a state in which some external electronic devices connected to a multimedia device can not be controlled by the hybrid remote controller, and solve the related problems.

A method of controlling a system for controlling an external electronic device according to an embodiment of the present invention includes the steps of outputting a video image received from an external electronic device connected via an interface to a predetermined area of a screen of the multimedia device And the multimedia device is configured to detect the location information of the sub-area and the currently focused first sub-area, and to display the first sub- Extracting from the memory of the multimedia device a code value necessary for focusing the second sub-area instead of the first sub-area, based on the result of the detection and calculation And the extracted nose To the remote controller from the multimedia device.

Further, a multimedia device communicating with at least one device according to another embodiment of the present invention may include a first interface module (e.g., the video image may include at least one or more selectable sub- A second interface module for receiving a command signal from a remote controller, and a second interface module for receiving the judgment result of the controller and the second interface module, And a display module for focusing and displaying the second sub-area instead of the first sub-area based on the command signal.

And, a method of controlling a multimedia device communicating with at least one device in accordance with another embodiment of the present invention includes receiving a video image from an external electronic device (e.g., the video image includes at least one Determining a position of the sub-area and a currently focused first sub-area; receiving a command signal from a remote controller; and comparing the determination result and the command signal based on the command signal , And focusing and displaying the second sub-area instead of the first sub-area.

According to an embodiment of the present invention, it is possible to provide a solution for controlling different kinds of electronic devices while minimizing the memory usage of the remote controller.

Furthermore, according to another embodiment of the present invention, there is an advantage of improving the GUI (Graphical User Interface) of the multimedia device communicating with the remote controller. This can greatly speed up the control of multiple devices.

According to another embodiment of the present invention, even when a specific video image is received from an external electronic device, a user can quickly perform a desired function without using an additional remote controller.

FIG. 1 is a schematic view of a system including a multimedia device, a remote controller, a server, and at least one electronic device according to an embodiment of the present invention.
FIG. 2 is a detailed block diagram illustrating the components of a multimedia device according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 3 is a block diagram showing the control unit shown in FIG. 2 in more detail.
4 is a view schematically showing an appearance of a remote controller according to an embodiment of the present invention.
5 is a detailed block diagram of the components of the remote controller shown in FIG.
6 is a diagram illustrating an example of a database of IR code values stored in a multimedia device according to an exemplary embodiment of the present invention.
7 is a diagram illustrating another example of a database of IR code values stored in the multimedia device according to an embodiment of the present invention.
FIG. 8 and FIG. 9 are views illustrating middleware storing the DB shown in FIG. 6 or FIG.
10 is a diagram illustrating a first OSD provided by a multimedia device according to an embodiment of the present invention.
11 is a diagram illustrating a second OSD provided by a multimedia device according to an embodiment of the present invention.
12 is a diagram illustrating a process of controlling an external electronic device using a local key button of a remote controller according to an embodiment of the present invention.
13 and 14 illustrate a first embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention.
15 and 16 illustrate a second embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention.
17 and 18 illustrate a third embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention.
FIG. 19 is a flow chart showing in detail data flows transmitted and received among the respective entities of the system shown in FIG. 1;
20 is a flowchart illustrating a method of controlling a multimedia device according to an embodiment of the present invention.
21 is a flowchart showing a control method of a remote controller according to an embodiment of the present invention.
22 is a diagram for explaining a process of controlling at least one external electronic device using a remote controller of a multimedia device according to an embodiment of the present invention.
23 is a diagram for explaining a process of controlling an external electronic device controlled by a universal remote controller according to an embodiment of the present invention.
FIG. 24 shows an example of an indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to an embodiment of the present invention.
25 shows another example of an indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to an embodiment of the present invention.
Figure 26 illustrates an example of a graphical image option received from an external electronic device.
27 is a diagram for explaining a process of selecting a graphic image option received from an external electronic device.
28A and 28B are diagrams for explaining the process of changing the OSD position controlled by the integrated remote controller.
29A, 29B and 29C are diagrams for explaining the process of changing the OSD content controlled by the integrated remote controller.
30A and 30B are diagrams for explaining a process of changing an external electronic device that is an object controlled by the integrated remote controller.
31 is a flowchart illustrating a process of controlling an external electronic device controlled by a universal remote controller and selecting an external electronic device according to an embodiment of the present invention.
32 is a flowchart illustrating a process of selecting an external electronic device to be controlled and controlled by a universal remote controller according to another embodiment of the present invention.
33 is a flowchart showing an overall process of a system for controlling an external electronic device using a remote controller of a multimedia device, according to an embodiment of the present invention.
34 is a view schematically showing a system including a multimedia device, a remote controller, a server, and at least one electronic device according to another embodiment of the present invention.
35 is a detailed block diagram of internal configuration modules of a multimedia device according to another embodiment of the present invention.
Figure 36 is a block diagram illustrating the capture and analysis module 3530 shown in Figure 35 in greater detail.
37 is a diagram for explaining a process in which a multimedia device according to another embodiment of the present invention calls a specific function of an external electronic device.
38 is a diagram for explaining a communication process between a multimedia device, a remote controller, and an external electronic device according to another embodiment of the present invention.
39 is a diagram illustrating an embodiment of analyzing a particular video image received from an external electronic device.
40 is a diagram illustrating another embodiment of analyzing a particular video image received from an external electronic device.
41 is a diagram for explaining a process of extracting a corresponding code value based on the analysis result shown in Fig. 39 or Fig.
FIG. 42 is a view for explaining another embodiment for extracting a code value in comparison with FIG.
43 to 45 are diagrams for explaining the operation process of the multimedia device according to another embodiment of the present invention.
46 is a flowchart for explaining a data communication process between respective components of the overall system including a multimedia device according to another embodiment of the present invention.
47 is a flowchart illustrating a method of controlling a multimedia device according to another embodiment of the present invention.
FIG. 48 shows two embodiments for implementing step S4720 shown in FIG.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module "and" part "

Meanwhile, the multimedia device described in this specification is an intelligent electronic device that adds a computer support function to a broadcast reception function, for example, and is equipped with an Internet function while being faithful to a broadcast reception function, A pad or a space remote controller. With the support of wired or wireless internet function, it can be connected to internet and computer and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Accordingly, the multimedia device described in the present invention can perform various user-friendly functions because various applications can be freely added or deleted on a general-purpose OS kernel, for example. More specifically, the multimedia device may be, for example, an Internet TV, an IPTV, a network TV, an HBBTV, a smart TV, and an open hybrid TV (OHTV), and may be applied to a smart phone, a PC, Do.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. However, the scope of the patent is also the case where each embodiment may have an independent right scope or at least one of the four embodiments may be combined to implement the present invention.

First, the first embodiment of the present invention provides a solution for controlling devices connected to a STB, a BD (blue-ray disk) player, a PC, a notebook, and a tablet by using only one universal remote controller to provide. For example, a network capable TV receives and stores an IR code table corresponding to each device from an external server. In addition, the TV transmits an IR code value for controlling a specific function of a specific device through RF (Radio Frequency) communication with a remote controller. The remote controller receiving the IR code value is designed to forward the IR code value to the specific device via IR communication.

Second, the second embodiment of the present invention provides a solution for setting devices to be controlled in order to apply the universal remote controller of the present invention. In this connection, according to the patented technology, a total of three technical methods are possible as follows.

a) Automatic detecting technology

For example, when a device controlled by a TV and a universal remote control is connected to a high definition multimedia interface (HDMI), information such as the type, name, and model name of the devices is transmitted from the device to the TV. As another embodiment, it is also possible to acquire information (e.g., type, name model name, etc.) for identifying the device by photographing the device with a camera, and then transmit the obtained identification information to the TV. Therefore, the TV that has received the device-related information described above can connect to an external server and automatically receive IR information corresponding to the device. In the case of such a design, there is an advantage that the user does not have to register the device separately. Of course, it is also possible to consider the case where the above-mentioned information is not transmitted or an error occurs in a device connected by HDMI, cable or the like in some cases. A method for solving this problem will be described in the following b) and c).

b) Hybrid technology

First, when a set top box (STB) and a TV are connected, the TV displays at least one maker of the STB or identification information of the cable broadcasting station that the user can select. For example, if there are a total of three companies providing related services in Korea (ex: QOOK TV, BTV, UPLUS), there is an option to select one of the three companies. At this time, if the user selects a specific company, the TV automatically receives the IR table corresponding to the remote controller of the company from the external server.

c) User input method

On the other hand, there may be cases where the case b) described above can not be applied due to a change in the networking environment or a technical error. Accordingly, a solution for directly inputting the type and model name of an external device controlled and controlled by the universal remote controller of the present invention by the user is also possible.

Third, the third embodiment of the present invention provides a solution for controlling an OSD provided by an external device, for example, an STB, by a remote controller rather than an OSD provided by a TV (in particular, according to an embodiment of the present invention The remote controller is designed to change the position of the pointer on the TV screen according to the motion of the remote controller).

The TV displays the TV OSD which can control the STB connected by HDMI or the like. At this time, by controlling the motion of the remote controller and positioning the pointer in the corresponding area, the user can easily perform the desired STB function. On the other hand, there may be cases where additional functions are not provided by the TV OSD. For example, features that were not provided in the first STB, menu options, etc. are not provided by the TV OSD. Of course, the STB OSD is also displayed at this time.

However, the STB OSD is image data that can not be selected by positioning the pointer of the motion remote control. Therefore, we need a solution to control the STB OSD by clicking the arrow button of the motion remote control.

For example, when the down arrow button of the motion remote control is clicked, the RF signal is transmitted to the TV side and the TV is designed to transmit the corresponding IR signal back to the remote controller through the RF network.

Fourth, the fourth embodiment of the present invention provides a channel browsing function that flexibly varies according to connected STBs, not an EPG provided by an existing broadcasting station.

Further, as a solution for implementing the invention proposed in the fourth embodiment, two methods will be mainly described as follows.

a) It is assumed that there is an external server that already knows all channel information (ex: thumbnail image, broadcast time, additional information, character information, etc.) provided by the STB. Therefore, the TV according to the embodiment of the present invention can receive the information of each channel by notifying the external server of the type of STB currently connected to the external server. Also, unlike the prior art, there is an advantage that at least two or more channel information can be located on one side of the screen, and a user can easily generate a motion of a remote controller to easily identify a desired channel group.

b) On the other hand, if there is no server such as the above case a), a TV may be operated in the background to scan each channel. For example, it is possible to scan each channel to capture video information or audio information, and to extract basic information or thumbnail image data about the content currently provided in each channel.

1 is a schematic diagram illustrating a system including a multimedia device 100, a remote controller 110, a server 120, and at least one electronic device 130 according to an embodiment of the present invention.

According to the related art, there is a problem in that a plurality of remote controllers 110 are required as many as the number of electronic devices 130 to be controlled. In addition, the so-called integrated remote controller according to the prior art also needs to load all the IR code values of the respective electronic devices 130, so that there is a limit in the memory capacity.

In order to solve the problems of the related art described above, the multimedia device 100 periodically updates IR code values for controlling an electronic device from a server 120 connected through an Internet network or the like. Of course, embodiments where the IR code values are updated when the user requests are also within the scope of the present invention.

Meanwhile, it is assumed that the remote controller 110 and the multimedia device 100 transmit and receive data to and from a first communication means (for example, Bluetooth). If the remote controller 110 requests an IR code value for a specific function of a specific electronic device to the multimedia device 100, the multimedia device 100 checks the pre-stored DB and stores the corresponding IR code value To the remote controller (110).

The remote controller 110 forwards the IR code value received from the multimedia device 100 to the corresponding electronic device 130 through the second communication means (for example, IR infrared communication). That is, the remote controller 110 according to the embodiment of the present invention is designed to serve as a repeater, so that there is a technical effect that there is no need to use a large-capacity memory.

The multimedia device 100 according to an embodiment of the present invention will be described later in detail with reference to FIG. 2 to FIG.

FIG. 2 is a detailed block diagram illustrating the components of a multimedia device according to an exemplary embodiment of the present invention. Referring to FIG. With reference to the description of the multimedia device 100 shown in FIG. 1, it is also possible to supplementarily analyze the multimedia device 200 shown in FIG.

2, the multimedia device 200 according to an exemplary embodiment of the present invention includes a broadcast receiving module 201, a demodulator 202, a network interface 203, an external device interface 204, A control unit 206, a video output unit 207, an audio output unit 208, a power supply unit 209, a user interface 211, and the like. Meanwhile, the multimedia device 200 is designed to perform data communication with the remote controller 210, and the remote controller 210 will be described later in detail with reference to FIGS. 4 and 5. FIG.

The broadcast receiving module 201 can be designed, for example, as an RF tuner or as an interface for receiving broadcast data from an external device such as an STB.

The broadcast receiving module 201 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

The demodulation unit 202 receives the digital IF signal DIF converted by the broadcast receiving module 201 and performs a demodulation operation.

For example, when the digital IF signal output from the broadcast receiving module 201 is the ATSC scheme, the demodulator 202 performs 8-VSB (8-Vestigal Side Band) demodulation, for example. Also, the demodulator 202 may perform channel decoding.

The external device interface 204 is an interface that enables data communication between the external device and the multimedia device 200. The external device interface 204 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface 204 transfers external video, audio, or data signals to the control unit 206 through the connected external device. Also, the control unit 206 can output the video, audio, or data signal processed by the control unit 206 to an external device.

The external device interface 204 may include, for example, a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, Terminal, an RGB terminal, a D-SUB terminal, and the like.

The network interface 203 provides an interface for connecting the multimedia device 200 to a wired / wireless network including the Internet network. The network interface 203 may include an Ethernet terminal or the like for connection to a wired network and may be a WLAN (Wireless LAN) (Wi-Fi ), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface 203 can transmit or receive data to another user or other electronic device via the network to which it is connected or another network linked to the network to which it is connected.

The memory 205 may store a program for each signal processing and control in the control unit 206, and may store signal processed video, audio, or data signals. The memory 205 may also function for temporary storage of video, audio, or data signals input from the external device interface 204 or the network interface 203. [ The memory 205 also stores various OSs, middleware, and platforms, for example.

The user interface 211 transmits a signal input by the user to the control unit 206 or transmits a signal from the control unit 206 to an external device (for example, the remote controller 210). For example, the user interface 211 may be provided with various functions such as power on / off, channel selection, screen setting, and the like from the remote controller 210 in accordance with various communication methods such as a radio frequency (RF) communication method and an infrared The control signal is received and processed, or the control signal from the control unit 206 is transmitted to the remote controller 210).

The control unit 206 demultiplexes the input stream or processes the demultiplexed signals through the broadcast reception module 201, the demodulation unit 202, the network interface 203, or the external device interface 204 And generate and output signals for video or audio output. The control unit 206 will be described later in detail with reference to FIG.

The video output unit 207 converts an image signal, a data signal, an OSD signal processed by the control unit 206 or a video signal and a data signal received from the external device interface 2045 into R, G, and B signals, respectively Thereby generating a driving signal. The video output unit 207 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The audio output unit 208 receives a signal processed by the control unit 206, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 208 may be implemented by various types of speakers.

The power supply unit 209 supplies corresponding power to the multimedia device 200. In particular, a control unit 206 that can be implemented in the form of a system on chip (SOC), a video output unit 207 for video display, and an audio output unit 208 for audio output .

Particularly, the following description will be given in connection with the embodiment of the present invention.

Under the control of the control unit 206, the network interface 203 connects to a specific server. Further, the IR code values received from the specific server are designed to be stored in the memory 205. On the other hand, the IR code values are values necessary for controlling the electronic device connected to the external device interface 204.

Finally, in response to a request from the remote controller 210, an IR code value corresponding to a specific function of the specific electronic device is transmitted to the remote controller 210 through the user interface 211. As described above, the Bluetooth communication method can be employed at this time.

FIG. 3 is a block diagram showing the control unit shown in FIG. 2 in more detail.

3, the control unit 306 of the multimedia device includes a demultiplexing unit 310, an image processing unit 320, an OSD generating unit 340, a mixer 350, a frame rate converting unit 355, A formatter 360, and the like. It is also within the scope of the present invention to further design a voice processing unit (not shown) and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively.

The image processing unit 320 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 320 may include a video decoder 325 and a scaler 335. The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the video output unit. The video signal decoded by the video processing unit 320 is input to the mixer 350.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. Accordingly, the mixer 350 can mix the OSD signal generated by the OSD generating unit 340 and the decoded video signal processed by the image processing unit 320.

The mixed signal is provided to formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

A frame rate converter (FRC) 355 can convert a frame rate of an input image. For example, a frame rate of 60 Hz is converted to 120 Hz or 240 Hz.

The formatter 360 receives the output signal of the frame rate conversion unit 355, changes the format of the signal to be suitable for the video output unit, and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

Particularly, the following description will be given in connection with the embodiment of the present invention.

An OSD for selecting an electronic device and a function to be controlled by the remote controller according to an embodiment of the present invention is generated by the OSD generation unit 340 described above. The mixer 350 described above is additionally designed to make the general broadcast screen and the OSD overlaid. The form in which the general broadcast screen and the OSD are overlaid can be understood with reference to FIG. 10 to FIG.

4 is a view schematically showing an appearance of a remote controller according to an embodiment of the present invention.

A pointer 401 corresponding to the movement of the remote controller 410 is displayed on the screen of the multimedia device 400 as shown in Fig. The user can move or rotate the remote controller 410 left and right (FIG. 4 (b)) or up and down (FIG. 4 (c)). In such a remote controller 410, since the pointer 401 is moved and displayed according to the movement in the 3D space, it may be called a space remote controller.

4 (b), when the user moves the remote controller 410 to the left, the pointer 401 displayed on the screen of the multimedia device 400 also moves to the left. Information on the motion of the remote controller 410 detected through the sensor of the remote controller 410 is transmitted to the multimedia device 400. The multimedia device 400 can calculate the coordinates of the pointer 401 from the information about the motion of the remote controller 410. [ The multimedia device 400 may display the pointer 401 so as to correspond to the calculated coordinates.

4 (c), when the user moves the remote controller 410 downward, the pointer 401 displayed on the screen of the multimedia device 400 also moves downward.

Therefore, it is possible to quickly select a specific area in the screen of the multimedia device 400 using the remote controller 410 according to an embodiment of the present invention.

5 is a detailed block diagram of the components of the remote controller shown in FIG.

5, the remote controller 510 includes a wireless communication unit 514, a user input unit 515, a sensor unit 517, an output unit 516, a power supply unit 511, a storage unit 512, And a control unit 513, and the like.

The wireless communication unit 514 is designed to be capable of communicating with any external device. In particular, according to one embodiment of the present invention, the RF module 514a is designed to communicate data with the multimedia device 500, and the IR module 514b is configured to communicate with the external electronic device 530 (e.g., STB) So that communication can be performed.

Accordingly, it is possible to implement the remote controller 510 to perform the role of a repeater for forwarding the IR infrared code value received from the multimedia device 500 to the STB 530. [

In addition, according to an embodiment of the present invention, the remote controller 510 transmits a signal containing information on the movement and the like of the remote controller 510 to the multimedia device 500 through the RF module 514a.

Also, the remote controller 510 can receive the signal transmitted by the multimedia device 500 through the RF module 514a. Also, the remote controller 510 can transmit a command regarding power on / off, channel change, volume change, and the like to the multimedia device 500 through the IR module 514b as needed.

The user input unit 515 may include a keypad, a button, a touch pad, or a touch screen.

The sensor unit 517 may include a gyro sensor 517a or an acceleration sensor 517b. The gyro sensor 517a can sense information on the motion of the remote controller 510. [ For example, the gyro sensor 517a can sense information about the operation of the remote controller 510 on the basis of the x, y, and z axes. The acceleration sensor 517b can sense information on the moving speed of the remote controller 510 and the like. In addition, a distance measuring sensor may be further provided, so that the distance to the multimedia device 500 can be sensed.

The output unit 516 may output an image or voice signal corresponding to the operation of the user input unit 515 or corresponding to the signal transmitted from the multimedia device 500. For example, the output unit 516 may include an LED module 516a1 that is lit when a user input unit 5155 is operated or a signal is transmitted to or received from the multimedia device 500 through the wireless communication unit 514, a vibration module 516b An audio output module 516c for outputting sound, or a display module 516d for outputting an image.

The power supply unit 511 supplies power to each component of the remote controller 510. The power supply unit 511 can reduce power waste by interrupting the power supply when the remote controller 510 has not moved for a predetermined time.

The storage unit 512 may store various types of programs, application data, and the like required for the control or operation of the remote controller 510. The control unit 513 controls various matters related to the control of the remote controller 510. [ For example, the control unit 513 transmits a signal corresponding to a predetermined key operation of the user input unit 515 or a signal corresponding to the motion of the remote controller 510 sensed by the sensor unit 517 to the radio communication unit 514, To the multimedia device 500 or to the STB 530 via the network.

6 is a diagram illustrating an example of a database of IR code values stored in a multimedia device according to an exemplary embodiment of the present invention.

The memory 205 of the multimedia device shown in Fig. 2 is designed so that the database (DataBase) shown in Fig. 6 is constructed. As shown in FIG. 6, IR code values for respective functions of a TV, which is an example of an external electronic device, are mapped. Further, the database shown in Fig. 6 is updated periodically or upon user request through communication with an external server.

Therefore, since the multimedia device according to the embodiment of the present invention is constructed in the database shown in FIG. 6, the IR code value for the specific function of the specific electronic device can be transmitted at any time according to the request of the remote controller.

7 is a diagram illustrating another example of a database of IR code values stored in the multimedia device according to an embodiment of the present invention.

Unlike the above-described FIG. 6, FIG. 7 is designed to store information on a plurality of devices in different memory addresses. That is, the first memory address stores the IR code value for the functions of the STB, and the second memory address stores the IR code value for the functions of the BD (Blueray-Disk) player.

Therefore, when designing as shown in FIG. 7, it is possible to implement an OSD for a specific electronic device, and it is possible to speed up access to a specific function of a specific electronic device.

In addition, although only two devices are illustrated in FIG. 7, since the multimedia device according to the embodiment of the present invention can update the database shown in FIG. 7 through communication with the server from time to time, The number of external electronic devices that can be used is increasing continuously. It is not necessary to separately improve the memory of the remote controller.

FIG. 8 and FIG. 9 are views illustrating middleware storing the DB shown in FIG. 6 or FIG.

8 and 9 are diagrams illustrating a design structure of a middleware required to construct the above-described database (FIG. 6 or FIG. 7). For example, it is also within the scope of the present invention to design the middleware so that the database shown in FIG. 6 or 7 is located in the native application as shown in FIG. It is also within the scope of the present invention to design the middleware so that the database shown in FIG. 6 or 7 is located in the flash engine or the browser as shown in FIG. On the other hand, in the case of designing as shown in FIG. 8, it is not necessary to change the structure of the existing platform.

Further, when a remote controller according to an exemplary embodiment of the present invention is used to control and reduce an external electronic device other than a multimedia device, two solutions are proposed to specify the external electronic device. The first solution will be described later with reference to FIG. 10, and the second solution will be described later with reference to FIG.

10 is a diagram illustrating a first OSD provided by a multimedia device according to an embodiment of the present invention. The OSD shown in Fig. 10 is displayed when a user presses a key button for selecting an external input list.

For example, when a user watching a broadcast through the multimedia device 1000 controls and stores another external electronic device, a key button attached to the remote controller or a local key attached to the multimedia device 1000 Button.

At this time, as shown in FIG. 10, the multimedia device 1000 displays an external input list 1001 that the user can select. The external input list 1001 may be limited to a device having IR code values stored in a multimedia device.

It is also within the scope of the present invention that the external input list 1001 includes an area 1002 for displaying not only the names of the initial terminals but also the names of the devices connected through the corresponding terminals.

Therefore, from the viewpoint of the user, there is a technical effect that the device to be controlled and selected by the user can be selected more easily and quickly.

11 is a diagram illustrating a second OSD provided by a multimedia device according to an embodiment of the present invention. Unlike FIG. 10, FIG. 11 displays a list of devices that can be controlled by a remote controller in a tab format.

For example, when a user watching a broadcast through the multimedia device 1100 controls and stores another external electronic device, a key button attached to the remote controller or a local key attached to the multimedia device 1100 Button.

At this time, as shown in FIG. 11, the multimedia device 1100 displays external input devices that can be controlled by the user in the form of tabs 1102 and 1103. The taps 1102 and 1103 may be limited to devices having IR code values stored in the multimedia device. It is also within the scope of the present invention that a tab 1101 showing a list of stored applications is additionally displayed.

Further, in Fig. 11, an external electronic device controlled in a tab format It is also within the scope of the present invention to provide a more intuitive interface to the user by displaying a graphic image similar to the appearance of the remote controller of the external electronic device as an alternative embodiment.

For example, it is designed to display an OSD including a graphic image as a main function necessary for controlling an STB of an external electronic device, or to display an OSD including a graphical image of all functions necessary for controlling the STB.

Therefore, unlike FIG. 10, in the case of designing as shown in FIG. 11, there is an advantage that a device to be controlled and reduced can be easily selected while maintaining a broadcast screen viewable by a user as much as possible.

Meanwhile, a solution for controlling an external electronic device using a remote controller according to an embodiment of the present invention can also be divided into two types. In the first embodiment, the basic functions of the external electronic device can be controlled directly without using the screen of the multimedia device. This will be described later with reference to FIG.

In a second embodiment, the additional functions of the external electronic device need to be controlled using the screen of the multimedia device. This will be described later with reference to FIG. 13 to FIG.

12 is a diagram illustrating a process of controlling an external electronic device using a local key button of a remote controller according to an embodiment of the present invention. Hereinafter, a process for quickly controlling an external electronic device while securing a screen of a multimedia device as much as possible will be described with reference to FIG.

First, it is assumed that the user selects to control a specific external device (e.g., STB) through the method shown in Fig. 10 or Fig. As shown in FIG. 12, the remote controller 1210 according to an embodiment of the present invention also has a local key button for the volume or channel of the STB.

Accordingly, when the user presses the volume up button of the remote controller 1210, the multimedia device 1200 transmits a signal requesting the IR code value corresponding to the volume up of the STB to the multimedia device 1200.

The multimedia device 1200 transmits an IR code value corresponding to the volume up of the STB to the remote controller 1210 and the remote controller 1210 forwards the received IR code value to the corresponding STB 1230.

Therefore, the STB 130 can perform the volume up function 1231 based on the IR code value received from the remote controller 1210. [

13 and 14 illustrate a first embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention. Hereinafter, with reference to Figs. 13 and 14, a process for controlling the function (for example, the menu function of the STB) of the external electronic device which is not attached to the outside of the remote controller with the local key button will be described. same.

First, it is assumed that the tab 1301 for displaying the STB is selected as the device to be controlled and controlled through the method shown in FIG. 13, the multimedia device 1300 according to an exemplary embodiment of the present invention displays an OSD for the functions of the selected STB.

The OSD is stored in the memory of the multimedia device for each device, and each function of the OSD shown in FIG. 13 is designed in a format selectable by the remote controller 1310.

When the user moves the remote controller 1310 and the indicator 1302 is located in the menu area of the STB, the multimedia device 1300 transmits the IR code value corresponding to the menu of the STB to the remote controller 1310 do.

The remote controller 1310 transmits the IR code value received from the multimedia device 1300 to the STB 1330 corresponding to the electronic device.

14, when the menu function of the STB 1430 is executed, the multimedia device 1400 connected to the STB 1430 displays the screen 1401 on which the STB menu has been executed.

It is also within the scope of the present invention that the remote controller 1410 is used to additionally select a specific option on the screen 1401 on which the STB menu is executed.

15 and 16 illustrate a second embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention. Hereinafter, with reference to FIG. 15 and FIG. 16, a process for controlling the function of the external electronic device (for example, the channel No. 9 function of the STB) not attached to the outside of the remote controller with the local key button will be described As follows.

First, it is assumed that the tab 1501 for displaying the STB is selected as the device to be controlled and controlled through the method shown in FIG. At this time, as shown in FIG. 15, the multimedia device 1500 according to an embodiment of the present invention displays the OSD for the functions of the selected STB.

The OSD is stored in the memory of the multimedia device for each device, and each function of the OSD shown in FIG. 15 is designed in a format that can be selected by the remote controller 1510.

When the user moves the remote controller 1510 and the indicator 1502 is located in the channel 9 area of the STB, the multimedia device 1500 transmits the IR code value corresponding to the channel No. 9 function of the STB to the remote controller Lt; / RTI >

The remote controller 1510 transmits the IR code value received from the multimedia device 1500 to the STB 1530 corresponding to the electronic device.

16, when the channel # 9 of the STB 1630 is executed, the multimedia device 1600 connected to the STB 1630 displays the changed screen # 9 of the channel # 9. It is also possible to further control other functions of the STB 1630 by using the remote controller 1610. [

17 and 18 illustrate a third embodiment of controlling an external electronic device using a screen provided by a multimedia device according to an embodiment of the present invention. 17 and 18, a process for controlling the function of the external electronic device (for example, the play function of the BD player) which is not attached to the outside of the remote controller with the local key button is referred to as " The following is an explanation.

First, it is assumed that a tab 1701 for displaying a BD player is selected as a device to be controlled and played through the method shown in FIG. At this time, as shown in FIG. 17, the multimedia device 1700 according to an embodiment of the present invention displays the OSD for the functions of the selected BD player.

The OSD is stored in the memory of the multimedia device for each device, and each function of the OSD shown in FIG. 17 is designed in a format selectable by the remote controller 1710.

When the user moves the remote controller 1710 so that the indicator 1702 is located in the play area of the BD player, the multimedia device 1700 transmits the IR code value corresponding to the playback function of the BD player to the remote To the controller 1710.

The remote controller 1710 transmits the IR code value received from the multimedia device 1700 to the BD player 1730 as a corresponding electronic device.

18, when the playback function of the BD player 1830 is executed, the multimedia device 1800 connected to the BD player 8630 displays a screen 1801 for playing back the title . It is also possible to further control other functions (e.g., Stop, reverse, etc.) of the BD player 1830 by using the remote controller 1810. [

FIG. 19 is a flow chart showing in detail data flows transmitted and received among the respective entities of the system shown in FIG. 1; Hereinafter, with reference to FIG. 19, a description will be given of a relationship in which data is transmitted and received between the multimedia device 1900, the remote controller 1910, the server 1920, and at least one electronic device 1930 according to an embodiment of the present invention. Then,

The multimedia device 1900 according to an embodiment of the present invention accesses any server 1920 that holds the IR code value (S1901). In response to the request of the multimedia device 1900, the server 1920 transmits an IR code value capable of controlling the functions of the specific electronic device (S 1902).

The multimedia device 1900 constructs a database for storing IR code values received from the server 1920 (S 1903). As shown in Fig. 7, storing in different memory addresses for each device is also within the scope of the present invention.

The remote controller 1910 and the multimedia device 1900 are connected to each other by a short distance communication such as Bluetooth (S1904). The remote controller 1910 requests an IR code value for a specific function of the specific electronic device to be controlled and stored (S1905).

The multimedia device 1900 transmits the corresponding IR code value at the request of the remote controller 1910 (S 1906). The remote controller 1910 forwards the received IR code value to the corresponding electronic device 1930 (S1907).

Then, the electronic device 1930 performs a function corresponding to the IR code value (S1908). The function performed in step S1908 may be related to the function of controlling the multimedia device 1900, for example.

20 is a flowchart illustrating a method of controlling a multimedia device according to an embodiment of the present invention. On the other hand, supplementary analysis of Fig. 20 is also within the scope of the present invention with reference to Figs. 1 to 19 described above.

The multimedia device performing data communication with the remote controller through the first communication path connects to the server through the network interface (S2001). The code value received from the connected server is stored in the memory (S2002). The code value is designed to correspond, for example, to a particular function of a particular electronic device, and to be transmitted over a second communication path.

And displays a first list that lists the types of at least one electronic device (S2003). Through the first communication path, a signal for selecting a specific electronic device is received (S2004).

And displays a second list listing the functions of the selected specific electronic device (S2005). Through the first communication path, a signal for selecting a specific function is received (S2006).

A code value corresponding to the selected function is extracted from the memory (S2007). Then, the extracted code value is transmitted to the remote controller through the first communication path (S2008).

The step S2001 is designed to update the code value according to a predetermined period or a user's request, for example.

The step S2002 may include, for example, storing at least one or more code values associated with the function of the first electronic device at a first address of the memory, and storing at least one or more code values associated with the function of the second electronic device To a second address of the memory.

The steps S2003 and S2005 may further include generating an OSD (On Screen Display) generating unit based on the data stored in the memory, the first list and the second list.

Furthermore, the OSD corresponding to the first list and the OSD corresponding to the second list may be simultaneously or selectively displayed in different areas of the screen of the multimedia device.

For example, the OSD necessary for controlling the STB (Set Top Bos) is located at the leftmost side of the screen, and the OSD necessary for controlling the BDP (Blueray Disk Player) is located at the rightmost side of the screen. Therefore, the heterogeneous devices can be controlled almost simultaneously on one screen, which improves data processing speed.

The steps S2004 and S2006 are designed to select the specific electronic device or the specific function based on, for example, the position sensor of the remote controller. The position detection sensor includes at least one of a gyro sensor or an acceleration sensor, for example.

21 is a flowchart showing a control method of a remote controller according to an embodiment of the present invention. On the other hand, supplementary analysis of Fig. 20 is also within the scope of the present invention with reference to Figs. 1 to 19 described above.

The remote controller performing data communication with the multimedia device and the specific electronic device transmits a signal requesting a code value corresponding to a specific function of the specific electronic device to be controlled by the remote controller to the multimedia device (S2101). The step S2101 is designed to be performed by the RF module 514a shown in FIG. 5, for example.

A code value corresponding to a specific function of the specific electronic device is received from the multimedia device (S2102). The step S2102 is designed to be performed by, for example, the RF module 514a shown in FIG.

The received code value is transmitted to the specific electronic device (S2103). The step S2103 is designed to be performed by, for example, the IR module 514b shown in FIG. Further, the first communication and the second communication are designed with different communication protocols.

The RF module 514a primarily transmits a signal for selecting the specific electronic device among a plurality of electronic devices, for example, from among a plurality of functions provided by the selected specific electronic device, And is designed to transmit a signal requesting a corresponding code value.

5, the above-described remote controller further includes a position detection sensor for changing the position of the pointer in the screen of the multimedia device according to the movement of the remote controller. The position detection sensor includes at least one of, for example, a gyro sensor or an acceleration sensor.

Further, the above-described multimedia device includes a memory storing code values for controlling at least one electronic device, as shown in Figs. 2, 3, 6 and 7, and a memory for communicating with the server And a network interface module for performing the network interface module.

Finally, more specifically, for example, the first communication is set to a Bluetooth communication protocol, and the second communication is set to an infrared (IR) communication protocol.

22 is a diagram for explaining a process of controlling at least one external electronic device using a remote controller of a multimedia device according to an embodiment of the present invention.

As shown in FIG. 22, the multimedia device 800 according to an embodiment of the present invention is connected to at least one or more external electronic devices. (STB) 831, a Home Theater System (HTS) 832, and a BDP (Blueray Disk Player) 833, for example. The external devices can be controlled only by the remote controller 810 of the multimedia device 800 without using the remote controller dedicated to the STB 831, the HTS 832 or the BDP 833 as described above.

First, the multimedia device 800 can receive an IR code value to be constructed in the database from the server using identification information on the connected electronic device. A more specific solution will be described later with reference to FIG. 23, FIG. 31, or FIG.

When the multimedia device 800 outputs the live broadcast screen 801 and receives a signal requesting the OSD for the universal remote controller from the remote controller 810 according to an embodiment of the present invention, Is displayed.

The remote controller 810 of the multimedia device 800 can control the external STB 831, the HTS 832, and the BDP 833 using the OSD 811 shown in FIG.

The OSD 811 shown in FIG. 8 is a graphic image generated by the multimedia device 800 using IR code values received from an external server and information on mapped functions of the electronic device. For example, the OSD 811 includes tabs for a basic channel browser (CHB) 805 and a TV function 806, and an IR code value associated with the multimedia device is stored in an electronic device (807, 808, 809) in a selectable tab format. In FIG. 22, it is assumed that the STB 831 is selected as an external electronic device controlled and controlled by the universal remote controller 810. That is, the corresponding tab 807 is highlighted, and the user is informed of the device that can be controlled by the remote controller 810 at present.

In addition, the OSD 811 shown in FIG. 22 includes a graphical option 802 in the form of a four-direction arrow. As described above, the remote controller 810 according to the embodiment of the present invention can be designed to change the position of the corresponding indicator according to the movement of the remote controller 810, for example. It is difficult to select a graphic image option received from an external electronic device other than the graphic OSD 811 generated by the graphic OSD 810. In this case, In this regard, it will be described in more detail below with reference to FIG. 26 and FIG.

Furthermore, the OSD 811 shown in FIG. 22 further includes directional taps 803 and 804 that can change the position and content contents, and will be described later with reference to FIGS. 28 to 30 in this regard.

Finally, the OSD 811 shown in FIG. 22 includes graphic image options for controlling the function of the STB 831, which is a specific electronic device among the connected electronic devices, and each option is mapped with the corresponding IR code value .

Accordingly, when the remote controller 810 selects a graphic image option corresponding to a specific function (e.g., number 1 or number 7, etc.), the multimedia device 800 transmits the corresponding IR code value via RF communication The remote controller 810 transmits the corresponding IR code value to the STB 831 to execute the corresponding function (for example, tuning to channel 1 or tuning to channel 7) .

Further, according to another embodiment of the present invention, a first control area for selecting a graphic option received from an arbitrary electronic device and a second control area for selecting a graphic option generated in the multimedia device itself are simultaneously Is displayed. The second control area corresponds to, for example, the OSD 811 shown in FIG.

Meanwhile, the first control area means image data that is not generated by the multimedia device itself. For example, options in the menu area 1202 transmitted in the STB shown in FIG. 26 or the channel browser area 1301 shown in FIG. 27 can not be selected only by the motion of the remote controller. If the remote controller can not select only a specific area, there is a possibility that the user may misunderstand that an error has occurred. Accordingly, in order to solve such a problem, a graphical image 802 in the form of a four-direction arrow shown in FIG. 22 is added.

23 is a diagram for explaining a process of controlling an external electronic device controlled by a universal remote controller according to an embodiment of the present invention.

As described above, it is possible to control arbitrary electronic devices connected to the multimedia device by using the remote controller according to an embodiment of the present invention. However, the multimedia device must receive information on connected electronic devices to receive a corresponding IR code value list.

As shown in FIG. 23, the multimedia device 900 according to an embodiment of the present invention displays an OSD for inputting information on an electronic device controlled by a remote controller.

For example, it is designed to output an option 902 for selecting the manufacturer of the connected STB and an option 903 for selecting the model name of the connected STB. This OSD is designed to be displayed in consideration of the possibility of using different IR code value systems by manufacturer or product model name.

Further, by designing to display the video data 901 currently output from the connected external electronic device as shown in FIG. 23, there is also an advantage that the user can avoid false confusion. The specific process by which the user directly inputs information on the external electronic device using the OSD designed in Fig. 23 will be described in more detail below with reference to Fig.

In FIG. 23, it is assumed that the user selects information on the external electronic device. A solution for automatically detecting the external electronic device will be described later with reference to FIG.

24 shows an example of an indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to an embodiment of the present invention. Hereinafter, an indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to an embodiment of the present invention will be described with reference to FIG. Further, a person skilled in the art may supplement the analysis of FIG. 24 with reference to FIG. 22 and the like as necessary.

As shown in FIG. 24, it is assumed that multimedia device 1000 is connected to external electronic devices such as STB 1031, HTS 1032, and BDP 1033, for example.

As described above, the remote controller 1010 according to an embodiment of the present invention includes a position sensing sensor, so that the user can sense the position, direction, speed, and the like that the user controls the remote controller 1010.

Also, an indicator 1001, which changes in accordance with the movement of the remote controller 1010, is displayed on the screen of the multimedia device 1000. Thus, the user can use the remote controller 1010 to select an image option that controls a particular function of the external electronic device.

25 shows another example of an indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to an embodiment of the present invention. Hereinafter, another example of the indicator displayed on the screen of the multimedia device according to the position of the integrated remote controller according to the embodiment of the present invention will be described with reference to FIG. Further, a person skilled in the art may supplement the interpretation of Fig. 25 with reference to Figs. 22 and 24, etc., if necessary.

As shown in FIG. 25, it is assumed that multimedia device 1100 is connected to external electronic devices such as STB 1131, HTS 1132, and BDP 1133, for example.

In contrast to the indicator 1001 shown in Fig. 24, the indicator 1101 shown in Fig. 25 is designed to have different transparency, shape, or hue. That is, when the indicator 1101 leaves the graphic image area for controlling the functions of the external electronic device, it is designed to be changed to the indicator 1001 different from that of FIG. 24, so that the universal remote controller 1110 can control the external electronic device To the area for control.

Figure 26 illustrates an example of a graphical image option received from an external electronic device.

26, a multimedia device 1200 according to an exemplary embodiment of the present invention is connected to an STB 1231, an HTS 1232, and a BDP 1233, and particularly controls the STB 1231 Mode is selected. For example, it is assumed that a tab 807 for controlling the STB shown in FIG. 22 is selected.

Further, when the menu option is selected on the OSD for the universal remote controller shown in Fig. 26, the graphic image 1202 provided by the STB 1231 is displayed.

As described above, the OSD graphic image for the universal remote controller generated by the multimedia device can select the desired specific option by moving the location of the remote controller 1210 and the corresponding indicator.

On the other hand, each selectable item (e.g., real time broadcast, TV view, movie / series, fun & life, etc.) provided by the graphic image option 1202 provided by the STB 1231 The corresponding indicator 1201 can not be directly located and selected. This is because the multimedia device 1200 can not know in advance the graphic image 1202 provided by the STB 1231, unlike the OSD for the universal remote controller.

Therefore, if the remote controller dedicated to the STB 1231 is separately used in such a situation, the data processing speed is also delayed, which is very inconvenient for the user. To solve this problem, as the first solution, the shape of the indicator 1201 is changed in the area 1202 where the indicator 1201 can not directly select. For example, as shown in Fig. 26, a straight line graphic that covers the center of the arrow appears.

Further, as a second solution, by placing the indicator 1201 in the four-way arrow button portion 802 described above in FIG. 22, the options in the menu image 1202 provided by the STB 1231 can be easily selected. A more specific process will be described later with reference to Fig.

27 is a diagram for explaining a process of selecting a graphic image option received from an external electronic device.

The multimedia device 1300 displaying the general broadcast screen displays a graphic image 1301 related to the channel browser provided by the STB 1331. [ Of course, if the graphic image 1301 related to the channel browser is processed and outputted by the multimedia device 1300, the user may select the desired specific channel by moving the remote controller 1310. [ The channel browser shown in FIG. 27 includes at least one of a thumbnail image, channel information, and program information for each channel.

However, as described above with reference to FIG. 26, when the graphic image 1301 related to the channel browser is directly received from the external electronic device, for example, the STB 1331 and output, The change indicator 1304 can not be directly selected by positioning it in the corresponding area. At this time, the shape, shape, color, transparency, and the like of the indicator 1304 are designed to change to inform the user that it is not an error.

Therefore, if a specific channel 1302 is selected and shaken in the channel browser image 1301 by using the remote controller 1310 corresponding to the multimedia device 1300 instead of the dedicated remote controller for the STB 1331, the indicator 1303 ) In the four-way arrow image.

For example, when a specific direction is selected using the remote controller 1310, the corresponding IR code value (for example, a command for moving one step in a specific direction) is transmitted from the multimedia device 1300 to the remote controller 1310 And the remote controller 1310 is designed to transmit the corresponding IR code value back to the STB 1331. [

28A and 28B are diagrams for explaining the process of changing the OSD position controlled by the integrated remote controller. If necessary, a person of ordinary skill in the art may supplement the interpretation of Figures 28A and 28B with reference to the preceding figures.

For example, when the position of the OSD for executing the universal remote controller is changed and reduced, the tab 1401 in the specific direction shown in Fig. 28A is selected. When the tab 1401 shown in Fig. 28A is selected, the position of the OSD is changed to the top of the screen as shown in Fig. 28B.

29A, 29B and 29C are diagrams for explaining the process of changing the OSD content controlled by the integrated remote controller. If necessary, a person of ordinary skill in the art may supplement the interpretation of Figures 29A-29C with reference to the previous figures.

For example, when changing and decreasing the OSD content for the execution of the universal remote controller, the tab 1501 in the specific direction shown in Fig. 29B is selected. At this time, each of the two embodiments is again included in the scope of the present invention.

In one embodiment, when the tab 1501 shown in Fig. 29A is selected, additional items on the OSD are replaced as shown in Fig. 29B. For example, in FIG. 29A, the menu items MENU, GUIDE, INFO, and EXIT degrees are included, but in FIG. 29B, functions 1 (Func.1) to 4 (Func.4 ).

As another embodiment, when the tab 1501 shown in Fig. 29A is selected, the entire page of the OSD is changed completely differently as shown in Fig. 29C. For example, all of the options such as the channel number disappear and only the changed additional items (function 1 to function 4) are displayed.

In the case of FIG. 29B, there is an advantage that only the additional items are changed, and there is an advantage that more additional items can be added than in the case of designing as shown in FIG. 29C.

30A and 30B are diagrams for explaining a process of changing an external electronic device that is an object controlled by the integrated remote controller. If necessary, those skilled in the art will be able to supplement the interpretation of Figures 30A and 30B with reference to the previous figures.

For example, when the external electronic device controlled and controlled by the universal remote controller is changed and saved, the specific tab 1601 shown in FIG. 30A is selected. When the tab 1601 shown in FIG. 30A is selected, the OSD is changed to list at least one function provided by the HTS as shown in FIG. 30B.

31 is a flowchart illustrating a process of controlling an external electronic device controlled by a universal remote controller and selecting an external electronic device according to an embodiment of the present invention.

In order to implement an embodiment of the present invention, the multimedia device needs to know the IR code values controlling the external electronic device to be controlled and controlled or access the server to update the DB or the like.

First, it is assumed that the system enters the universal remote controller setting mode (S1701). For example, it may be implemented using the OSD shown in FIG.

For example, an input terminal (ex: HDMI, etc.) to which an external electronic device STB is connected is selected (S1702), and a service name and a manufacturer are selected (S1703 and S1704). The service name corresponds to a service company name (e.g., Cook, LG Plus) that provides cable broadcasting, Internet broadcasting, etc., and the name of the manufacturer corresponds to, for example, , Motorola, Samsung, etc.).

If the multimedia device does not have an IR code value for controlling the external electronic device obtained through steps S1703 to S1704, the server accesses the related IR code value and updates the associated IR code value.

Finally, when the update is completed, for example, a channel up image for testing is displayed, and the user can confirm whether the channel of the connected STB is changed when the displayed image is selected by using the remote controller of the multimedia device. More specifically, for example, when the setting is normally made, the screen of the channel whose screen 901 of the current channel shown in FIG. 9 is changed to +1 is outputted.

However, since there is a problem that the user needs to separately select the process described in Fig. 31, a solution for simplifying the process will be described later with reference to Fig. 32 below.

FIG. 32 is a flowchart for explaining a process of controlling an external electronic device controlled by a universal remote controller according to another embodiment of the present invention.

In operation S1801, the multimedia device transmits a signal for requesting product information of a connected external electronic device to the connected electronic device in operation S1802, when the multimedia device and the external electronic device according to an exemplary embodiment of the present invention are connected.

Further, the electronic device transmits its product information to the multimedia device (S1803). The product information may be enough information (ID) for collecting the IR code values necessary for controlling the functions of the electronic device, for example.

In addition, the multimedia device requests and receives IR code values necessary for controlling the function of the identified electronic device in the external server (S1804, S1805). Finally, the multimedia device updates the database using the received IR code values (S1806). Therefore, it becomes possible to control any external electronic device with only the remote controller of the multimedia device.

33 is a flowchart showing an overall process of a system for controlling an external electronic device using a remote controller of a multimedia device, according to an embodiment of the present invention. A method of controlling at least one external electronic device by controlling only a remote controller of a multimedia device without using each remote controller in controlling a plurality of external electronic devices will be described.

The remote controller according to an embodiment of the present invention transmits a signal requesting execution of the universal remote controller to the multimedia device (S1901). For example, it can be implemented by pressing a shortcut key attached to a remote controller, or it can be implemented to be executed without any special action of the remote controller.

Further, the multimedia device according to an embodiment of the present invention displays the OSD associated with the universal remote controller (S1902). This has been described above in detail in Fig. 22 and the like.

If the location of the remote controller is moved and a specific function is selected from among the graphic image options displayed in step S1902 (S1903), the multimedia device accesses the memory (S1904). And extracting a corresponding IR code value which is held or updated by accessing the server.

In addition, the multimedia device transmits an IR code value corresponding to a specific function among the functions of the external electronic device selected by the remote controller to the remote controller (S1905).

The remote controller transmits the received IR code value to the electronic device connected to the multimedia device (S1906). Accordingly, the external electronic device executes the specific function (S1907), and transmits the corresponding command to the multimedia device connected to the external electronic device by wired or wireless connection (S1908).

22, the user must select one of the external electronic devices (STB 807, HTS 808, and BDP 809) that he wants to control. However, in the case of such a design, there is a possibility that the data processing speed is delayed and the user interface is somewhat inconvenient to the user.

Accordingly, there is a need for a solution that automatically provides appropriate OSD graphic data according to the current state of the multimedia device, even if the user does not take any special action. In this regard, it will be described later in detail with reference to FIG. 34 to FIG. Of course, it is also possible for those skilled in the art to interpret the embodiments of Figs. 34 to 46 in view of the embodiments described in Figs. 1 to 33 above.

In addition, in FIG. 5, the case where the remote controller according to the embodiment of the present invention includes both the RF module and the IR module has been described, but the scope of the present invention is not limited thereto. That is, the present invention can be applied to a remote controller having a touch sensor, a remote controller including a QWERTY keyboard, or a general remote controller.

34 is a view schematically showing a system including a multimedia device, a remote controller, a server, and at least one electronic device according to another embodiment of the present invention.

1, the remote controller including both the RF module and the IR module has been described in detail. On the other hand, in FIG. 34, a separate repeater 3440 is designed to perform RF communication with the multimedia device 3400 and IR communication with the external electronic device STB 3430. As an example of the RF communication, bluetooth may be adopted.

The multimedia device 3400 stores code values for controlling at least one external electronic device from the server 3420 in a memory. Of course, the code value may be directly received from the external electronic device in the HDMI format, or may be designed to be stored in advance, regardless of communication with other devices.

For example, when controlling and reducing the STB 3430, which is an external electronic device, the user can use the remote controller 3410 of the multimedia device 3400 to control a specific area (e.g., channel up) in the OSD graphic data, . At this time, the multimedia device 3400 transmits a code value corresponding to a specific area to the repeater 3440 as an RF signal, and the repeater 3440 transmits the code value to the STB 3430 as an IR signal.

The present invention is equally applicable to the system shown in Fig. 34 as well as the system shown in Fig.

On the other hand, the OSD graphic data for controlling an external electronic device as described in Figs. 1 to 34, for example, is designed to be generated and displayed on, for example, a multimedia device side. Thus, it is possible that the multimedia device already knows the location of the selectable options (e.g., channel, number, etc.) in the OSD graphic data.

However, it may be assumed that, in some cases, the OSD graphic data is not generated by the multimedia device, but only the image is received from the external electronic device and output as it is. For example, the multimedia device displays a menu screen provided by an arbitrary external electronic device (e.g., STB), but can not directly recognize various selectable submenus in the menu screen.

In such a case, a problem that a remote controller of the external electronic device is used in place of the remote controller according to an embodiment of the present invention, or only a directional key button of the remote controller according to an embodiment of the present invention is limitedly used have.

Therefore, a solution for solving these problems will be described in detail with reference to FIG. 35 to FIG. Of course, those skilled in the art may combine the embodiments described in FIGS. 1 through 34 with the embodiments described in FIGS. 35 through 48 to implement other embodiments, and such other embodiments are also within the scope of the present invention. Belongs.

Prior to the description of FIGS. 35 to 48, a communication process between the multimedia device and the external electronic device according to another embodiment of the present invention will be described.

35 to 48, which will be described later, assume that the multimedia device does not know in advance the selectable options in the video image, because the external electronic device transmits only the video image format to the multimedia device. However, when the external electronic device is connected to a multimedia device through a bidirectional data communication interface (e.g., HDMI (High Definition Multimedia Interface)), various control data stored in the external electronic device are automatically received It is possible.

More specifically, for example, the multimedia device 1200 shown in FIG. 26 and the STB 1231, which is an example of an external electronic device, are connected to the HDMI as described above, and the video image 1202 are stored in the memory of the STB 1231. In the STB 1231, It is also within the scope of the present invention that the multimedia device 1200 stores the location information in advance.

At this time, the multimedia device 1200 receives position information of each sub-region of the video image 1202 stored in the memory of the STB 1231 through a bidirectional data communication interface.

Accordingly, it is possible for the multimedia device to determine whether the indicator 1201 moving according to the motion of the remote controller 1210 is included in a specific sub-area in the video image 1202. [

Also, the multimedia device 1200 receives a command corresponding to a specific sub region determined by the STB 1231 (for example, "TV (TV) " shown in FIG. 26 Quot; again ") to the STB 1231 directly.

When designing in this manner, there is an advantage that the multimedia device 1200 can omit the process of transmitting the code value corresponding to the command to the remote controller 1210.

Particularly, when the position between the remote controller 1210 and the STB 1231 is out of the range capable of receiving the IR signal, the effect of the embodiment can be maximized.

Furthermore, although the HDMI has been described as an example in the above embodiments, the present invention can be sufficiently applied to DiiVA (Digital Interactive Interface for Video & Audio) capable of bidirectional communication with control data. That is, if the multimedia device 1200 and the external electronic device are connected to a bi-directional data communication line, they are covered by the scope of the present invention.

35 is a detailed block diagram of internal configuration modules of a multimedia device according to another embodiment of the present invention. Hereinafter, with reference to FIG. 35, a process of processing a specific video image received from an external electronic device (for example, STB) by a multimedia device according to another embodiment of the present invention will be schematically described.

35, the multimedia device includes an external interface 3510, a display module 3520, a capture and analysis module 3530, a motion position calculation module 3540, a controller 3550, a transmission module 3560), a memory 3570, and the like. Of course, it is also within the scope of the present invention to delete, modify and add some modules according to the needs of those skilled in the art.

The external interface 3510 receives a video image from an external electronic device. The external interface 3510 may be referred to as a first interface module. Further, the video image is divided into at least one or more selectable sub-areas, and more specifically, it may correspond to the menu screen 3761 shown in FIG. 37, for example.

The controller 3550 determines the position information of the sub area and the first sub area currently focused. In this regard, the capture and analysis module 3530 needs to determine the sub-regions in the video image and the currently focused specific sub-region, and will be described in more detail with reference to FIG. 39 and FIG.

The motion position calculation module 3540 receives a command signal from the remote controller and may designate it as a second interface module.

The display module 3520 is designed to focus and display the second sub-area instead of the first sub-area based on the determination result of the controller and the command signal.

In such a design, even when the multimedia device receives only the image signal from the external electronic device, there is an advantage that the external electronic device can be controlled using only the remote controller according to the present invention.

The controller 3550 further includes a character recognition module for recognizing a character string located in each of the sub areas of the video image, and will be described in detail with reference to FIG. 36 below.

Further, the controller 3550 is designed to estimate the position value and the size of the sub-area based on the character recognition result.

Meanwhile, according to another embodiment of the present invention, the memory 3570 stores a code value for controlling the external electronic device, as described above. Thus, the controller 3550 can access the memory and extract the code values needed to focus the second sub-area instead of the first sub-area, I will explain in detail.

Finally, the transmission module 3560 is designed to transmit the extracted code value to an external unit. In the case of a system designed as shown in FIG. 34, the external unit corresponds to a separate repeater 3440, whereas in the case of a system designed as shown in FIG. 1 or 22, the external unit corresponds to a remote controller.

Figure 36 is a block diagram illustrating the capture and analysis module 3530 shown in Figure 35 in greater detail. Hereinafter, the process of analyzing the video image received from the external electronic device will be described in detail with reference to FIGS. 36 and 35. FIG. For a more specific embodiment, supplemental analysis is possible with reference to FIG. 39 and FIG.

When a multimedia device receives a specific video image (e.g., menu screen-including at least one sub-area that can be selected) from an external electronic device (e.g., STB), it can not recognize each sub-area.

In order to solve such a problem, the capture and analysis module 3630 is designed to include a character recognition module 3631, a specific sub region determination module 3632, and a sub region size position determination module 3633.

First, the character recognition module 3631 is designed to recognize characters in the specific video image 3761 shown in FIG. 37 (b). Of course, it is not necessary to have a recognition performance enough to change the image of each character to text, and it is sufficient that the ability to determine the size / position of a particular sub area and sub area is sufficient.

The specific subarea determination module 3632 is designed to detect a specific subarea currently focused in a video image composed of at least one subarea. For example, it is possible to detect a specific sub region based on the difference value of color or lightness of the image.

The sub region size / position determination module 3633 can totally recognize the size and position of the sub region based on the result of the specific sub region determination module 3632, or independently The size and position of the area can be grasped as a whole. The former embodiment will be described later with reference to FIG. 39, and the latter embodiment will be described later with reference to FIG.

37 is a diagram for explaining a process in which a multimedia device according to another embodiment of the present invention calls a specific function of an external electronic device. Hereinafter, with reference to FIG. 37, a process in the case where the multimedia device according to another embodiment of the present invention first calls a specific function (e.g., menu execution) of the external electronic device will be described.

As shown in FIG. 37A, the multimedia device 3700 according to another embodiment of the present invention simultaneously displays a broadcast screen 3720 and OSD graphic data 3750. As described above, the OSD graphic data 3750 is used to control functions of the STB 3740, which is an example of an external electronic device.

Therefore, it is possible to select the menu 3760, which is a specific function in the OSD graphic data 3750, by using, for example, an indicator 3730 moving in accordance with the motion of the remote controller 3710. [

37 (b), the multimedia device 3701 outputs the menu screen 3761, which is a specific video image received from the STB 3741, when the menu 3760 is selected as described above. However, each option (e.g., channel, volume, number, etc.) in the OSD graphic data 3750 is mapped to a code value for controlling the STB, Therefore, there is a problem that the multimedia device can not currently recognize the respective options (real-time broadcasting, TV recommendation, My Menu, Fun & Life).

38 is a diagram for explaining a communication process between a multimedia device, a remote controller, and an external electronic device according to another embodiment of the present invention. 38, the process of selecting one of the options in the video image received from the STB, which is an example of an external electronic device, will be described.

35 and 36, a multimedia device according to another embodiment of the present invention can analyze a video image to determine a sub-area to be currently focused and a sub-area to be located and a remote controller.

First, according to the motion of the remote controller 3810 shown in FIG. 38A, the initial indicator 3830 was located in the menu 3760 portion of the OSD graphic data 3750. Accordingly, the menu related video image 3040 provided by the STB 3820 is being output. At this time, when the motion or position of the remote controller is changed (3811), the position of the indicator is also changed (3831).

(The "TV recommendation" shown in FIG. 38 (a)) located one level below the current focused sub region (" The recognized multimedia device 3701 displays a code value (e.g., a command corresponding to the down direction arrow button) for focusing the corresponding sub area 3850 as shown in FIG. 38 (b) And transmits it to the remote controller 3812.

Then, the remote controller 3812 transmits the received code value to the STB 3821 again, so that the STB 3821 can execute the function corresponding to "TV recommendation ".

39 is a diagram illustrating an embodiment of analyzing a particular video image received from an external electronic device.

39A, a specific sub area 3900 (for example, a function previously selected by the user or a function set as a default) is automatically displayed on the menu screen received from the external electronic device STB As shown in FIG. Accordingly, the multimedia device may detect that the size of the highlighted sub-area 3900 corresponds to "A ".

On the basis of this, as shown in FIG. 39 (b), the rest of the sub areas 3901, 3902, and 3903 are also designed to be estimated to correspond to the same size "A". However, in some cases, it may be difficult to confirm that the above-mentioned specific sub-area is not displayed in a highlighted state or that a specific sub-area and other sub-areas are in a distinguished state. A solution for solving this will be described later with reference to FIG.

40 is a diagram illustrating another embodiment of analyzing a particular video image received from an external electronic device.

First, as shown in FIG. 40 (a), when the currently focused specific sub-area is not displayed in a highlighted state, the process of analyzing the characters in the video image and calculating the position value of each sub- need.

For example, it is possible to estimate the lowest end of each character of the "real-time broadcast " by the hypothetical first line 4000, estimate the uppermost end of each character of & can do. Similarly, in the similar manner, the bottom of each character of "TV recommendation" is estimated to be imaginary third line 4002, and the top of each character of "My Menu" .

Therefore, based on the information on each of the estimated lines 4000, 4001, 4002, and 4003, each of the sub regions 4010, 4020, 4030, 4040 ) Corresponds to "B + b ".

41 is a diagram for explaining a process of extracting a corresponding code value based on the analysis result shown in Fig. 39 or Fig. In the previous drawings, it is assumed that the sub-regions in the video image are arranged only in the vertical direction. However, the present invention can also be applied to the case where the sub-regions are arranged in the horizontal direction and the vertical direction as shown in FIG.

41A, when the sub-areas in the video image 4100 are divided into actual lines, the multimedia device displays position information (size and x, y coordinates Information) can be determined.

On the other hand, when the actual line shown in FIG. 41A does not exist, the position information of the remaining eight sub-areas is recognized using the position information of the specific highlighted sub-area 4101 You may.

At this time, when the indicator moves to the menu 9 (4102) which is another sub-area as shown in (b) of FIG. 41 according to the control (for example, motion) of the remote controller, And calculates a difference value from the menu 1 4101 to the position information between menu 9 4102 where the current indicator is located.

That is, a command that moves twice in the right direction and twice in the downward direction is required based on the sub-area unit. 41C, a specific command sequence for controlling the STB from the memory (for example, two arrow buttons in the right direction and two arrow buttons in the down direction - can be changed) And the code value for displaying the specific command string is designed to be transmitted to the remote controller again.

Furthermore, two methods of extracting a code value according to the movement of the indicator are proposed in the present specification.

As a first embodiment, the movement of the indicator is continuously monitored, and the sub-area is distinguished from other sub-areas whenever the position of the indicator is changed for each sub-area. This design has the advantage of providing a more intuitive user interface to the user.

As a second embodiment, it is designed to calculate the position movement only when a specific button (e.g., "OK" or "OK") of the remote controller is selected without continuously monitoring the movement of the indicator. In the case of such a design, there is a technical effect that the load of unnecessary data processing can be reduced.

FIG. 42 is a view for explaining another embodiment for extracting a code value in comparison with FIG.

In the previous drawings, a method of extracting a code value based on the difference of positional information between sub-regions has been adopted. Accordingly, the code value may be composed of two or more series (for example, 1 in the right direction and 1 in the lower direction) in some cases. However, FIG. 42, which will be described below, proposes a method of controlling an external electronic device with only one code value.

First, as shown in FIG. 42A, the multimedia device 4200 outputs a menu screen 4210, which is a specific video image received from the STB 4240. Unlike the previous figures, the sub-areas within the menu screen 4210 now include numbers 4211, 4212, 4213, and 4214 that identify each of them. Therefore, it is possible to extract the numbers indicative of each sub-area by using, for example, an OCR (Optical Character Recognition) tool. Of course, it is also within the scope of the present invention to employ other character recognition methods instead of OCR.

Suppose, for example, that the remote controller 4230 is controlled to place the indicator 4220 in a specific sub-area (4. Fun & Life) as shown in Fig. 42 (a).

42 (b), the multimedia device 4201 transmits only the code value corresponding to the number 4 indicative of the specific sub-area 4250 to the remote controller 4231, The remote controller 4231 transmits the code value to the STB 4241 again.

As described above, there is an advantage in that it is not necessary to transmit a plurality of code values when designing as described above, and there is also a technical effect of greatly reducing the data loss rate.

43 to 45 are diagrams for explaining the operation process of the multimedia device according to another embodiment of the present invention. In the previous drawings, a case has been described in which a specific video image (a menu of an external STB) is composed of only one depth. However, hereinafter, a solution in the case where the menu of the external STB has two depths (two steps) will be described in FIG. 43 to FIG.

43, the multimedia device 4300 outputs a specific video image (menu screen) 4301 received from the STB 4320, which is an example of an external electronic device, on the screen. At this time, when a specific sub-area (my menu) is selected using the remote controller 3710, the sub-menu screen 4302 which can be selected again can be displayed. Since the provision of the submenu screen is determined by the CP (Content Provider) or SP (Service Provider) related to the STB 4320, the multimedia device 4300 still displays only the image.

Therefore, the process of analyzing the submenu screen 4302 is again necessary, and will be described with reference to FIG. 44 in this regard.

It is possible to estimate the size A of the sub areas of the main menu screen 4400 shown in Fig. 44 according to the embodiments described with reference to Figs. 39 and 40 described earlier and further to estimate the size A of the sub menu areas 4410 shown in Fig. The size (a) is also estimated for the sub areas. This process is required in consideration of the possibility that the main menu screen 4400 and the submenu screen 4410 are not the same size.

Accordingly, when the indicator 4430 is positioned in a specific sub-area (VOD search) in the submenu screen 4410 according to the control (e.g., motion) of the remote controller 4420, It is possible to estimate the specific sub-region.

On the other hand, as shown in FIG. 44, although it is possible to select a specific sub-area within the submenu screen 4410, the user may return to the main menu screen again and thereafter. An embodiment for meeting such needs will be described later with reference to FIG.

As shown in FIG. 45, it is assumed that the remote controller 4420 is controlled so that the indicator 4530 returns to the main menu screen 4500 instead of the sub menu screen 4510. As described above, the multimedia device according to another embodiment of the present invention knows the position information of each sub-area of the main menu screen and the sub-menu screen based on the character recognition method or the like.

Accordingly, when a sub-menu screen is displayed and any sub-area in the main menu screen is selected again, a code value corresponding to the left-direction arrow must be extracted from the memory. The code value is transmitted to the STB through the remote controller, so that the STB is designed to display only the main menu screen again.

46 is a flowchart for explaining a data communication process between respective components of the overall system including a multimedia device according to another embodiment of the present invention.

The external electronic device (e.g., STB) transmits the video image to the multimedia device (S4610). And outputs the video image received from the external electronic device connected to the interface to a predetermined area of the screen of the multimedia device (S4620). The video image is virtually or substantially divided into at least one or more selectable sub-areas, for example.

The multimedia device detects location information of the sub-area and the currently focused first sub-area (S4630).

Further, the multimedia device receives a control signal (e.g., a motion signal) from the remote controller (S4640), and the multimedia device displays the current position of the indicator whose position changes on the screen according to the control of the remote controller (S4650).

In step S4660, the multimedia device extracts code values necessary for focusing the second sub-area instead of the first sub-area, based on the result of the detection and calculation.

Then, the multimedia device transmits the extracted code value to the remote controller (S4670). If the code value is transmitted from the remote controller to the external electronic device (S4680), the external electronic device can execute the specific function (S4690).

According to another embodiment, the step S4630 is designed to estimate the position value and the size of the sub-area in the video image based on the character recognition result.

According to yet another embodiment, the step S4630 is designed to estimate the size and the number of sub-regions in the video image based on the positional information of the currently focused first sub-region.

In step S4650, based on the detection result, it is determined that the position of the indicator is shifted to the second sub-area of at least one sub-area in the video image.

In step S4660, a corresponding code value is extracted from the memory according to the number of sub-areas included between the first sub-area and the second sub-area.

The code value corresponds to, for example, a command for controlling the external electronic device. In addition, the step S4670 receives the code value through the first communication method, and the step S4680 is designed to transmit the code value to the external electronic device through the second communication method. The first communication method corresponds to a radio frequency (RF) communication protocol, and the second communication method corresponds to, for example, an infrared (IR) communication protocol.

47 is a flowchart illustrating a method of controlling a multimedia device according to another embodiment of the present invention.

A multimedia device communicating with at least one device according to another embodiment of the present invention is designed to receive a video image from an external electronic device (S4710). The video image is virtually or substantially divided into at least one or more selectable sub regions, for example.

In operation S4720, the multimedia device determines location information of the sub area and the currently focused first sub area, and calculates the current position of the indicator according to the command signal received from the remote controller in operation S4730.

And, based on the determination result and the command signal, it is designed to focus and display the second sub-area instead of the first sub-area. In order to implement this, the code value necessary for selecting the second sub-area in which the indicator is currently located is extracted from the memory (S4740), and the extracted code value is transmitted to the external unit (S4750).

The step S4720 includes recognizing a character string located in each sub-area in the video image, and estimating a position value and a size of the sub-area based on the character recognition result.

FIG. 48 shows two embodiments for implementing step S4720 shown in FIG. 48, two embodiments for detecting information on a sub area in a specific video image will be described.

First, the multimedia device according to an embodiment of the present invention determines whether at least one horizontal and vertical line component is included in the video image (S4721).

If the determination result (S4721) is included, at least one of the size, position, or number of sub-regions in the video image is calculated based on the horizontal and vertical lines (S4722). More specifically, it is suitable, for example, when a video image is configured as shown in Fig.

On the other hand, if the determination result (S4721) is not included, at least one of the size, position, or number of sub-regions in the video image is calculated based on the position information of characters in the video image (S4723). More specifically, for example, it is suitable when a video image is configured as shown in FIG. 39 or FIG.

According to embodiments of the present invention, as described fully above in Figures 1-48 (in particular, Figures 35-48), a sub-area (e.g., Is automatically detected and extracted, and a specific function can be performed in the menu provided by the STB.

Therefore, the user can continue to use the remote controller proposed by the present invention instead of the STB remote controller even under specific conditions. By using the motion function provided by the remote controller of the present invention, the user can quickly perform a specific function in the menu screen provided by the STB You can choose.

The apparatus and the control method according to an embodiment of the present invention may implement other embodiments by combining the above-described drawings and the drawings or by combining matters obvious to those skilled in the art, which also falls within the scope of the present invention.

Meanwhile, the method of operating the electronic device of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by the processor included in the electronic device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

3510: External interface
3520: Display Module
3530: Capture and Analysis Module
3540: Motion position calculation module
3550: Controller
3560: Transmission module
3570: Memory

Claims (19)

A control method of a system for controlling an external electronic device,
Outputting a video image received from an external electronic device connected via an interface to a predetermined area of a screen of a multimedia device, the video image being partitioned into at least one selectable sub-area;
The multimedia device detecting location information of the sub-area and the currently focused first sub-area;
Calculating a current position of an indicator whose position changes on the screen according to control of the remote controller;
Extracting from the memory of the multimedia device a code value necessary for focusing the second sub-area instead of the first sub-area, based on the detection and the calculation result; And
Transmitting the extracted code value from the multimedia device to the remote controller
≪ / RTI > The method according to claim 1,
Wherein the detecting comprises:
And estimating a position value and a size of the sub-area in the video image based on the character recognition result. The method according to claim 1,
Wherein the detecting comprises:
And to estimate the size and number of sub-regions in the video image based on position information of the currently focused first sub-region. The method according to claim 1,
Wherein the calculating step comprises:
And determining, based on the detection result, that the position of the indicator is shifted to a second sub-area of at least one sub-area in the video image. The method according to claim 1,
Wherein the extracting comprises:
And extracting a corresponding code value from the memory according to the number of sub-regions included between the first sub-region and the second sub-region. 6. The method of claim 5,
Wherein the code value corresponds to a command for controlling the external electronic device. The method according to claim 6,
The remote controller
And receiving the code value via a first communication scheme and transmitting the code value to the external electronic device via a second communication scheme. 8. The method of claim 7,
The first communication method corresponds to a radio frequency (RF) communication protocol,
Wherein the second communication method corresponds to an infrared (IR) communication protocol. The method according to claim 1,
The system comprises:
The multimedia device, and the remote controller. A multimedia device communicating with at least one device,
A first interface module for receiving a video image from an external electronic device, the video image being partitioned into at least one or more selectable sub-areas;
A controller for determining position information of the sub-area and the currently focused first sub-area;
A second interface module for receiving a command signal from a remote controller; And
A display module for focusing and displaying the second sub-area instead of the first sub-area based on the determination result of the controller and the command signal;
Lt; / RTI > 11. The method of claim 10,
The controller comprising:
A character recognition module for recognizing a character string located in each sub-
Lt; / RTI > 12. The method of claim 11,
And the controller is designed to estimate the position value and the size of the sub-area based on the character recognition result. 11. The method of claim 10,
A memory for storing a code value for controlling the external electronic device,
Lt; / RTI > 14. The method of claim 13,
The controller comprising:
And access the memory to extract code values needed to focus the second sub-area instead of the first sub-area. 15. The method of claim 14,
A transmission module for transmitting the extracted code value to the remote controller
Lt; / RTI > A method of controlling a multimedia device communicating with at least one device,
Receiving a video image from an external electronic device, the video image being partitioned into at least one selectable sub-region;
Determining location information of the sub-area and the currently focused first sub-area;
Receiving a command signal from a remote controller; And
Focusing and displaying the second sub-area instead of the first sub-area based on the determination result and the command signal
Gt; a < / RTI > 17. The method of claim 16,
Wherein the determining step comprises:
Recognizing a string located in each of the sub regions in the video image; And
Estimating a position value and a size of the sub region based on the character recognition result
Gt; a < / RTI > 17. The method of claim 16,
Between the receiving step and the displaying step,
Extracting from the memory a code value needed to focus the second sub-area instead of the first sub-area; And
Transmitting the extracted code value to the remote controller
Further comprising the steps of: A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 16 to 18.

Images