KR102108064B1 - Multimedia device and method for controlling the same - Google Patents

Abstract

Disclosed is a multimedia device and a method of controlling the same.
A control method of a multimedia device according to an embodiment of the present invention includes receiving a command to enter an external input mode of a specific external device through a user interface unit, and at least one communicating with a network interface unit through a network roll with the multimedia device. Searching for an external device, detecting the specific external device among the searched external devices, pairing with the detected specific external device, and video from the specific external device through an external device interface unit Receiving data and GUI data, outputting the received video data and GUI data through a display unit, and receiving signals corresponding to the movement of the remote controller from the remote controller and key buttons provided on the remote controller. Receiving a corresponding signal, calculating coordinate value information on a screen of the display unit based on a signal corresponding to the received movement of the remote controller, and corresponding to the calculated coordinate value information through a network interface unit And transmitting a signal corresponding to the key button and the signal to the specific external device.

Description

Multimedia device and its control method {MULTIMEDIA DEVICE AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a multimedia device and a control method thereof, and more particularly, to a technology for controlling a multimedia device and an external device connected thereto using one remote controller.

With the development of electronic technology, more and more types of electronic devices have been developed and spread. Recently popular electronic devices have a function of receiving a signal from a remote controller for user convenience. Accordingly, a user can control various electronic devices such as a TV, audio, DVD player, set-top box (STB), BD (Blu-ray Disc) player, and home theater system (HTS) using a remote controller.

Meanwhile, recently developed multimedia devices (for example, TVs) are equipped with a function of receiving various information in connection with an Internet network. In order to control such a multimedia device and an electronic device (for example, STB, DB player, HTS, etc.) connected thereto, there is a problem that a remote controller is required as many as the number of devices.

In order to solve this problem, a technique for controlling a plurality of devices using one remote controller is being discussed. However, the conventional method still has problems such as having to change the control right of the remote controller every time the various electronic devices are controlled, or to set the control right of the remote controller through various depths.

The technical problem to be achieved by an embodiment of the present invention is to provide a solution that allows the remote controller to be automatically set to the control mode of the corresponding external device by simply entering the external input mode of the external device to be controlled.

In addition, a technical problem to be achieved by an embodiment of the present invention is to provide a protocol for setting the remote controller to the control mode of the external device.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description. Will be able to.

A control method of a multimedia device according to an embodiment of the present invention includes receiving a command to enter an external input mode of a specific external device through a user interface unit, and at least one communicating with a network interface unit through a network roll with the multimedia device. Searching for an external device, detecting the specific external device among the searched external devices, pairing with the detected specific external device, and video from the specific external device through an external device interface unit Receiving data and GUI data, outputting the received video data and GUI data through a display unit, and receiving signals corresponding to the movement of the remote controller from the remote controller and key buttons provided on the remote controller. Receiving a corresponding signal, calculating coordinate value information on a screen of the display unit based on a signal corresponding to the received movement of the remote controller, and corresponding to the calculated coordinate value information through a network interface unit And transmitting a signal corresponding to the key button and the signal to the specific external device.

The multimedia device according to an embodiment of the present invention includes: an external device interface unit connected to at least one external device, a network interface unit communicating with the at least one external device via a network, and a specific one of the at least one external device A user interface unit that receives a command to enter an external input mode of an external device, and when a command to enter an external input mode of the specific external device is received, searches external devices that communicate with the network interface unit through the network. And a control unit for detecting the specific external device among the searched external devices and pairing with the detected external device, and a display unit, and the external device interface unit is not Receives erroneous data and GUI data, the display unit outputs the received video data and GUI data, and the user interface unit corresponds to a signal corresponding to the movement of the remote controller from the remote controller and a key button provided on the remote controller. A signal is received, and the control unit calculates coordinate value information on a screen of the display unit based on a signal corresponding to the received movement of the remote controller, and the network interface unit includes a signal corresponding to the calculated coordinate value information and The signal corresponding to the key button is transmitted to the specific external device.

According to an embodiment of the present invention, a solution is provided for automatically setting a remote controller to a control mode of a corresponding external device by simply entering an external input mode of an external device to be controlled.

In addition, according to an embodiment of the present invention, a protocol for setting a remote controller to a control mode of a corresponding external device is provided.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art from the following description. will be.

1 is a diagram schematically showing a system including a multimedia device controlled by a remote controller and an external device connected thereto according to an embodiment of the present invention.
2 is a block diagram illustrating configuration modules of a multimedia device according to an embodiment of the present invention.
FIG. 3 is a block diagram showing the controller of the multimedia device illustrated in FIG. 2 in more detail.
4 is a view briefly showing the appearance of a remote controller according to an embodiment of the present invention.
FIG. 5 is a block diagram showing the configuration modules of the remote controller illustrated in FIG. 4 in detail.
6 is a flowchart illustrating an example of a method for controlling a multimedia device according to an embodiment of the present invention.
7 is a diagram for explaining an example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.
8 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.
9 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.
FIG. 10 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.
11 is a diagram illustrating an example of a GUI displayed on a display unit of a multimedia device according to an embodiment of the present invention.
12 is a flowchart illustrating an example of a method of controlling a specific external device through a multimedia device using a remote controller according to an embodiment of the present invention.
13 is a diagram illustrating an example of GUI data displayed on a display unit of a multimedia device according to an embodiment of the present invention.
14 is a view for explaining a change in an indicator displayed on a display unit of a multimedia device before and after pairing of a specific external device is completed.
15 is a view for explaining an example of a method for controlling a specific external device on the multimedia device side through the HDMI-CEC function.
16 is a flowchart illustrating an example of a process in which a multimedia device performs pairing with an external device.
17 is a diagram illustrating an example of a message format exchanged between a multimedia device and an external device in the process of FIG. 16.
18 is a diagram illustrating an example of a data packet transmitted from a multimedia device to external devices when the multimedia device searches for external devices in the same network.
19 is a diagram illustrating an example of a message format exchanged between a multimedia device and a specific external device after pairing of the multimedia device and a specific external device is completed.
20 is a diagram illustrating an example of a data packet transmitted from a multimedia device to a specific external device after pairing of the multimedia device and a specific external device is completed.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are simply given in consideration of the ease of writing this specification, and the "modules" and "parts" may be used interchangeably.

On the other hand, the multimedia device described in the present specification is, for example, an intelligent network TV that adds a computer support function to a broadcast reception function, while being faithful to the broadcast reception function and having Internet functions added thereto, a handwritten input device, a touch screen or space It is possible to have a more convenient interface than a remote control. In addition, with the support of wired or wireless Internet functions, it is possible to perform functions such as e-mail, web browsing, banking or games by accessing the Internet and computers. A standardized general-purpose OS can be used for these various functions.

Furthermore, in the multimedia device described in the present invention, various applications can be freely added or deleted, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed.

Moreover, embodiments of the present invention will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present invention is not limited or limited by the embodiments.

The terminology used in the present specification is a general terminology that is currently widely used while considering functions in the present invention, but this may vary according to the intention or custom of a person skilled in the art or the appearance of a new technology. In addition, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, their meaning will be described in the description of the applicable invention. Therefore, it is intended to clarify that the terms used in the present specification are to be interpreted based on the actual meaning of the terms and the contents of the present specification, not simply the names of the terms.

1 is a diagram schematically showing a system including a multimedia device controlled by a remote controller and an external device connected thereto according to an embodiment of the present invention.

As shown in FIG. 1, the remote controller 300 according to an embodiment of the present invention may control the multimedia device 100 and the external device 200 connected thereto. A plurality of external devices 200 may be present.

The multimedia device 100 is, for example, an intelligent network TV in which a computer support function is added to a broadcast reception function, and is a device that is faithful to the broadcast reception function and has Internet functions added. For example, the multimedia device 100 corresponds to a network TV, a smart TV, a hybrid brodacast broadband television (HBBTV), an Internet TV, a web TV, and an Internet Protocol Television (IPTV).

The external device 200 may be connected to the multimedia device 100 through a wired cable and / or a wired / wireless network. The external device 200 may be connected to the multimedia device 100 through a wired cable, and may also be connected to the multimedia device 100 through a wired / wireless network.

As an external device 200 controlled by the remote controller 300, a set-top box (STB), a Blu-ray Disc (BD) player, and a home theater system (HTS) are illustrated, but are not limited thereto.

The indicator I corresponding to the movement of the remote controller 300 is displayed on the screen of the multimedia device 100.

The user may control the multimedia device 100 and the external device 200 using the remote controller 300. For example, when the multimedia device 100 enters the external input mode of the STB, the user can control the STB using the remote controller 300, and the multimedia device 100 enters the external input mode of the BD player. When entering, the user can control the BD player using the remote controller 300, and when the multimedia device 100 enters the external input mode of the HTS, the user controls the HTS using the remote controller 300 can do.

A method for a user to control the multimedia device 100 and the external device 200 using the remote controller 300 will be described later in detail with reference to each drawing.

2 is a block diagram illustrating configuration modules of a multimedia device according to an embodiment of the present invention. However, FIG. 2 is an embodiment for convenience of description, and includes a configuration module other than the configuration modules illustrated in FIG. 2, or a form in which some configuration modules are omitted also belong to the scope of the present invention.

2, the multimedia device 100 according to an embodiment of the present invention, the receiving unit 110, the external device interface unit 120, the memory 130, the control unit 140, the display unit 150 ), An audio output unit 160, a power supply unit 170, a user interface unit 180, and the like.

The reception unit 110 may include a tuner 111, a demodulation unit 112, and a network interface unit 113. In some cases, a plurality of tuners 111 may be provided.

The tuner 111 may receive, for example, a single carrier RF broadcast signal according to an Advanced Television System Committee (ATSC) method or a multiple carrier RF broadcast signal according to a Digital Video Broadcasting (DVB) method.

The demodulator 112 receives the digital IF signal DIF converted by the tuner 111 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 111 is an ATSC method, the demodulator 112 performs 8-Vestigal Side Band (8-VSB) demodulation, for example. Further, the demodulator 112 may perform channel decoding.

The network interface unit 113 provides an interface for connecting the multimedia device 100 to a wired / wireless network including an Internet network. The network interface unit 113 may include, for example, an Ethernet terminal or the like for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi- Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards and the like can be used.

The network interface unit 113 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

The external device interface unit 120 is an interface that enables data communication between the external device and the multimedia device 100. The external device interface unit 120 may be wired / wirelessly connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), or STB. The external device 200 may be connected to the multimedia device 300 by wire / wireless through the external device interface 120. The external device interface unit 120 transmits a video, audio, or data signal input from the outside through the connected external device to the control unit 140. Also, an image, audio, or data signal processed by the control unit 140 may be output to an external device.

The external device interface unit 120 includes, for example, a USB terminal, a Composite Video Banking Sync (CVBS) terminal, a component terminal, an S-video terminal (analog), a Digital Visual Interface (DVI) terminal, and a High Definition Multimedia Interface (HDMI). ) Terminal, RGB terminal, D-SUB terminal, and the like. HDMI is an interface that simultaneously transmits digital video and audio signals with a single cable. If both the playback device and the output device are equipped with an HDMI terminal, simply connect one HDMI cable between the playback device and the output device, and the video signal is easy. And a voice signal.

The memory 130 may store a program for processing and controlling each signal in the control unit 140, and may store a signal-processed image, audio, or data signal. Also, the memory 130 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 120 or the network interface unit 113. Also, the memory 130 stores various OS, middleware, and platforms, for example.

The user interface unit 180 transmits a signal input by the user to the control unit 140 or transmits a signal from the control unit 140 to an external device (eg, the remote controller 300). For example, the user interface unit 180 may turn on / off the power from the remote controller 300, select a channel, set a screen, etc. according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method. It may be designed to receive and process the control signal of, or to transmit a control signal from the control unit 140 to the remote controller 300.

The control unit 140 controls each component module in the multimedia device 100.

The control unit 140 demultiplexes the input stream or processes demultiplexed signals through the tuner 111, the demodulator 112, the network interface unit 113, or the external device interface unit 120. Signals for video or audio output can be generated and output. The control unit 140 will be described later in more detail with reference to FIG. 3.

The display unit 150 converts the image signal, data signal, OSD signal, or image signal received from the external device interface unit 120 processed by the control unit 140 into R, G, and B signals, respectively. Generate a drive signal. The display unit 150 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

The audio output unit 160 receives a signal processed by the control unit 140, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as voice. The audio output unit 160 may be implemented as various types of speakers.

Then, the power supply unit 170 supplies the corresponding power throughout the multimedia device 100. In particular, it is possible to supply power to a control unit 140 that can be implemented in the form of a system on chip (SOC), a display unit 150 for image display, and an audio output unit 160 for audio output. have.

FIG. 3 is a block diagram showing the controller of the multimedia device illustrated in FIG. 2 in more detail.

As shown in FIG. 3, the control unit 140 of the multimedia device 100 includes a demultiplexing unit 141, an image processing unit 142, a GUI generating unit 143, a mixer 144, and a frame rate conversion unit ( 145) and a formatter 146. In addition, designing to further include a voice processing unit (not shown) and a data processing unit (not shown) also falls within the scope of the present invention.

The demultiplexing unit 141 demultiplexes the input stream. For example, when MPEG-2 TS is input, it can be demultiplexed to separate video, audio, and data signals.

The image processing unit 142 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 142 may include an image decoder 142a and a scaler 142b. The video decoder 142a decodes a demultiplexed video signal, and the scaler 142b performs scaling so that the resolution of the decoded video signal can be output from a video output unit. Then, the video signal decoded by the video processing unit 142 is input to the mixer 144.

The GUI generating unit 143 generates a GUI signal according to a user input or by itself. Accordingly, the mixer 144 may mix the GUI signal generated by the GUI generating unit 143 and the decoded image signal processed by the image processing unit 142. The GUI generation unit 143 includes an OSD generation unit that generates an On Screen Display (OSD) signal including environment setting information of the multimedia device 100.

The mixed signal is provided to the formatter 146. Since the decoded broadcast video signal or the external input signal and the GUI signal or OSD signal are mixed, the GUI or OSD can be displayed overlaid on the broadcast video or external input video.

The frame rate converter (FRC) 145 may convert the frame rate of the input image. For example, convert a frame rate of 60 Hz to 120 Hz or 240 Hz. When converting a frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame or a third frame predicted from the first frame and the second frame between the first frame and the second frame. When converting the frame rate of 60Hz to 240Hz, it is possible to insert three more identical frames or insert three predicted frames. On the other hand, it is also possible to maintain the input frame rate without additional conversion.

Then, the formatter 146 receives the output signal of the frame rate conversion unit 145, changes the format of the signal to fit the video output unit, and outputs the signal. For example, R, G, and B data signals may be output, and the R, G, and B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

The configuration modules of the multimedia device 100 will be described below with reference to embodiments of the present invention.

The external device interface unit 120 is wired / wirelessly connected to the external device 200 to be controlled through the multimedia device 100 using the remote controller 300.

The network interface unit 113 may transmit or receive data with an external server (not shown) or an external device 200 through a wired / wireless network.

The network interface unit 113 may receive a control application related to the external device 200 from an external server, and the memory 130 may store the received control application. The control application may mean an application required when controlling a heterogeneous external device through the multimedia device 100. The control unit 140 may control the network interface unit 113 to receive an update file for updating a control application previously stored in the memory 130 from an external server, periodically or according to a user's command.

The user interface unit 180 receives the user input signal and transmits it to the control unit 140. The user interface unit 180 may include a communication module for receiving an RF signal or an infrared (IR) signal from the remote controller 300, a sensor module for sensing a user's voice or gesture, and the like.

When a user inputs a user command using the remote controller 300, the user interface unit 180 receives a user input signal from the remote controller 300 according to an RF communication method or an infrared (IR) communication method.

Alternatively, when a user inputs a user command through a graphical user interface (GUI) displayed on the display unit 150, the display unit 150 serves as the user interface unit 180, A user input signal is received through the GUI.

Alternatively, when a user utters a specific voice or inputs a user command by taking a specific gesture, a user input signal may be received through a sensor module in the user interface unit 180.

When a command for entering an external input mode of a specific external device (for example, STB) 200 is received through the user interface unit 180, the control unit 140 is connected to the multimedia device 100 in the same network. The external devices 200 are searched, the STB is detected among the searched external devices 200, and paired with the detected STB. When a command for entering the external input mode of the STB is received, the control unit 140 may access the control application previously stored in the memory 130 and execute the accessed control application for pairing with the STB.

When pairing with the specific external device 200 is completed, the user may control the specific external device 200 through the multimedia device 100 using the remote controller 300.

When pairing with the specific external device 200 is completed, a method of controlling the specific external device 200 on the multimedia device 100 side using the remote controller 300 will be described as follows.

The external device interface unit 120 receives video data and / or GUI data from a specific external device 200, and the control unit 140 outputs the received video data and / or GUI data through the display unit 150 do. The video data corresponds to content provided by a specific external device 200, and the GUI data corresponds to functions that can be implemented in the specific external device 200. Since the GUI data is generated by a specific external device 200, the multimedia device 100 cannot know what functions of the specific external device 200 corresponding to the GUI data are.

The user interface unit 180 receives a signal corresponding to the movement of the remote controller 300 and a signal corresponding to a key button provided in the remote controller 300 from the remote controller 300. The user interface unit 180 will receive only a signal corresponding to the movement from the remote controller 300 when the user is moving only the remote controller 300, and the user may move the remote controller 300 without moving the remote controller ( If only the key button provided in 300) is pressed, only key button related information will be received from the remote controller 300. If the user presses a specific key button after moving the remote controller 300, from the remote controller 300. The signal corresponding to the movement will be received first, followed by the signal corresponding to the specific key button.

The controller 140 calculates coordinate value information based on the signal corresponding to the received motion. The coordinate value information means coordinate value information on the screen of the display unit 150.

The network interface unit 113 transmits a signal corresponding to the calculated coordinate value information to a specific external device 200.

When a signal corresponding to a key button is received from the remote controller 300, the network interface unit 113 also transmits a signal corresponding to the received key button to the specific external device 200. In some cases, when the signal corresponding to the received key button is in the form of data that cannot be processed by the specific external device 200, the control unit 140 specifies the signal corresponding to the received key button as a specific external device. The process of processing in the form of data that the 200 can process may be preceded. The network interface unit 113 may transmit a signal corresponding to the movement and / or a signal corresponding to a key button to the specific external device 200 through an IP network.

For example, a signal corresponding to the movement of the remote controller 300 is received according to the RF communication method, and a signal corresponding to a key button provided in the remote controller 300 can be received according to the IR communication method, but is not limited thereto. Does not.

The specific external device 200 is designed to process a signal corresponding to coordinate value information transmitted from the multimedia device 100. The specific external device 200 processes a signal corresponding to the coordinate value information transmitted from the multimedia device 100 to determine which part of the video data and / or GUI data corresponds to the coordinate value information. Then, the specific external device 200 executes a function corresponding to the coordinate value information, and transmits the result to the multimedia device 100. For example, when only a signal corresponding to the coordinate value information is transmitted from the multimedia device 100, the specific external device 200 executes a function for highlighting a menu option on GUI data corresponding to the coordinate value information, and displays the result. It will transmit to the multimedia device 100. Alternatively, when a signal corresponding to coordinate value information and a signal corresponding to a key button are transmitted from the multimedia device 100, the specific external device 200 corresponds to a signal corresponding to coordinate value information and a signal corresponding to a key button The specific function corresponding to the menu option on the GUI data is executed, and the result is transmitted to the multimedia device 100.

However, in some cases, even when pairing with the specific external device 200 is completed, the specific external device 200 connected to the multimedia device 100 may be directly controlled through the HDMI-CEC function.

For example, the specific external device 200 is connected to the multimedia device 100 through the HDMI terminal included in the external device interface unit 120, and the external device interface unit 120 is an HDMI-CEC (High Definition Multimedia Interface) When the Consumer Electronics Control) function is supported, the basic functions of the specific external device 200 may be directly controlled using the remote controller 300. The HDMI-CEC function means a function that can control interconnected devices using the 13-pin of an HDMI cable as a control line. For example, when the specific external device 200 is an STB, the multimedia device 100 uses the key button provided on the remote controller 300 to play, pause, stop playing, and quickly stop the STB 200. Basic functions such as winding and rewinding can be directly controlled.

Or, for example, when a signal for requesting a GUI for a screen remote controller is received from the remote controller 300, the specific external device 200 is controlled by using the GUI output through the display unit 150 You may. In this case, the memory 130 of the multimedia device 100 stores IR code values mapped to respective functions of the specific external device 200 in advance. The GUI includes options corresponding to each function of the specific external device 200. When a selection command for selecting a specific option included in the GUI is received from the remote controller 300, the controller 140 detects an IR code value mapped to a specific function corresponding to the selected option, and the network interface unit ( 113) transmits the detected IR code value to the remote controller 300. The remote controller 300 transmits an IR signal corresponding to the transmitted IR code value to the specific external device 200. Thus, the specific external device 200 can be controlled.

The GUI for the screen remote controller differs from GUI data transmitted from the specific external device 200. The GUI for the screen remote controller is a control unit 140 of the multimedia device 100 (for example, GUI generation). The multimedia device 100 can know what each function of the specific external device 200 corresponding to the GUI for the screen remote controller is because it is generated in the unit), but the GUI data transmitted from the specific external device 200 Is generated by the specific external device 200, the multimedia device 100 cannot know what each function of the specific external device 200 corresponding to the GUI data is.

4 is a view briefly showing the appearance of a remote controller according to an embodiment of the present invention.

First, referring to (a) of FIG. 4, it is illustrated that the indicator I corresponding to the remote controller 300 is displayed on the screen of the multimedia device 100.

The user may move or rotate the remote controller 300 up, down, left and right (FIG. 4 (b)), and back and forth (FIG. 4 (c)). The indicator I displayed on the screen of the multimedia device 100 corresponds to the movement of the remote controller 300. The remote controller 300 may be referred to as a spatial remote controller, as the corresponding indicator I is moved and displayed according to movement in 3D space, as illustrated.

FIG. 4B illustrates that when the user moves the remote controller 300 to the left, the indicator I displayed on the screen of the multimedia device 100 also moves to the left correspondingly.

The signal corresponding to the movement of the remote controller 300 detected through the sensor of the remote controller 300 is transmitted to the multimedia device 100. The multimedia device 100 may calculate the coordinates of the indicator I from a signal corresponding to the movement of the remote controller 300. The multimedia device 100 may display the indicator I to correspond to the calculated coordinates.

4C illustrates an example in which the user moves the remote controller 300 away from the multimedia device 100 while pressing a specific button in the remote controller 300. Thereby, the selected area in the screen corresponding to the indicator I can be zoomed in and enlarged. Conversely, when the user moves the remote controller 300 closer to the multimedia device 100, the selected area in the screen corresponding to the indicator I may be zoomed out and reduced. On the other hand, when the remote controller 300 moves away from the multimedia device 100, the selection area is zoomed out, and when the remote controller 300 approaches the multimedia device 100, the selection area may be zoomed in.

FIG. 5 is a block diagram showing the configuration modules of the remote controller illustrated in FIG. 4 in detail.

5, the remote controller 300 includes a wireless communication unit 314, a user input unit 315, a sensor unit 317, an output unit 316, a power supply unit 311, a storage unit 312 And a control unit 313.

The wireless communication unit 314 is designed to communicate with any external device.

The remote controller 300 may include an RF module 314a capable of transmitting and receiving signals to and from the multimedia device 100 according to the RF communication standard. In addition, the remote controller 300 may include an IR module 314b capable of transmitting and receiving signals to and from the multimedia device 100 or the external device 200 (eg, STB) according to the IR communication standard.

The remote controller 300 transmits a signal including information on the movement of the remote controller 300 to the multimedia device 100 through the RF module 314a.

In addition, the remote controller 300 may receive a signal transmitted from the multimedia device 100 through the RF module 314b. In addition, the remote controller 300 may transmit a control signal related to power on / off, channel change, volume change, etc. to the multimedia device 100 through the IR module 314b as necessary. In addition, when the remote controller 300 controls the external device 200 through a GUI for a screen remote controller, the IR signal is received based on the IR code value received from the multimedia device 100 through the RF module 314b. Generated, the generated IR signal may be transmitted to the external device 200 through the IR module 314b.

The user input unit 315 may include a keypad, a button, a touch pad, or a touch screen.

The sensor unit 317 may include a gyro sensor 317a or an acceleration sensor 317b. The gyro sensor 317a may sense information regarding the movement of the remote controller 300. For example, the gyro sensor 317a may sense information regarding the operation of the remote controller 300 based on the x, y, and z axes. The acceleration sensor 317b may sense information on the movement speed of the remote controller 300, and the like. Meanwhile, a distance measurement sensor may be further provided, thereby sensing a distance from the multimedia device 100.

The output unit 316 may output an image or audio signal corresponding to manipulation of the user input unit 315 or a signal transmitted from the multimedia device 100. In one example, the output unit 316 is an LED module 316a that lights up when the user input unit 315 is operated or a signal is transmitted and received through the wireless communication unit 314 to the multimedia device 100, a vibration module 316b that generates vibration. ), An audio output module 316c for outputting sound, or a display module 316d for outputting an image.

The power supply unit 311 supplies power to each component of the remote controller 300. The power supply unit 311 may reduce power waste by stopping power supply when the remote controller 300 has not moved for a predetermined time.

The storage unit 312 may store various types of programs and application data required for control or operation of the remote controller 300. Then, the control unit 313 controls all matters related to the control of the remote controller 300. For example, the control unit 313 may transmit a signal corresponding to a predetermined key operation of the user input unit 315 or a signal corresponding to the movement of the remote controller 300 sensed by the sensor unit 317, to the wireless communication unit 314. It can be transmitted to the multimedia device 100 through.

Hereinafter, embodiments of the present invention will be described in detail with reference to each drawing.

According to the present invention, only by entering the external input mode of the external device 200 to be controlled, the control right of the remote controller 100 can be converted from the multimedia device 100 to the external device 200. This will be described with reference to FIGS. 6 to 11.

6 is a flowchart illustrating an example of a method for controlling a multimedia device according to an embodiment of the present invention.

Referring to FIG. 6, the external input mode of the specific external device 200 is entered (S401). The user interface unit 180 receives a command to enter the external input mode of the specific external device 200, and accordingly, the control unit 140 enters the external input mode of the specific external device 200. The controller 140 may output a screen indicating the external input mode of the specific external device 200 to the display unit 150. For example, the screen may be a home screen transmitted from a specific external device 200.

The control unit 140 searches for the external devices 200 connected to the multimedia device 100 through the same network (S402). For example, the control unit 140 searches for external devices 200 connected to the same access point as the network interface unit 113. In this case, the control unit 140 may be designed to access the memory 130 as a preliminary task and execute a pre-stored control application.

The controller 140 detects the specific external device 200 among the searched external devices 200 (S403). In some cases, when there are two or more external devices 200 of the same type as the specific external device 200 among the searched external devices 200, the controller 140 may select the external device 200 selected by a user command. It can be recognized as the specific external device 200 to be controlled.

The controller 140 performs pairing with the detected specific external device 200 (S404). In some cases, when there are two or more external devices 200 of the same type as the specific external device 200 among the searched external devices 200, the control unit 140 and the external device 200 selected by the user command You can pair.

When pairing with a specific external device 200 is completed, the remote controller 300 changes from a control mode of the multimedia device 100 to a control mode with the specific external device 200. Therefore, thereafter, the use of the remote controller 300 is for controlling the specific external device 200 rather than controlling the multimedia device 100. However, in some cases, information related to a specific key button provided in the remote controller 300 may not be transmitted to the specific external device 200 and may be used to control the function of the multimedia device 100 itself. For example, when a user presses a key button for displaying a power on / off key button or a GUI related to the multimedia device 100 among key buttons provided in the remote controller 300, the key button related information is specified externally. It may not be transmitted to the device 200 and may be used to control the corresponding function of the multimedia device 100.

According to the present embodiment, since the control right of the remote controller 300 is automatically set as the control mode of the external device 200 only by entering the external input mode of the external device 200 to be controlled, user convenience increases. do.

7 is a diagram for explaining an example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.

Referring to FIG. 7, the first GUI 510 is displayed on the display unit 150 of the multimedia device 100. The first GUI 510 is displayed when a user presses a key button to select an external input list.

For example, when a user who is watching a broadcast through the multimedia device 100 wants to control the external device 200, a key button provided in the remote controller 300 or a local key provided in the multimedia device 100 When the button is pressed, the first GUI 510 may be displayed on the display unit 150.

The first GUI 510 includes a list of external devices 200 connected through the external device interface unit 120. When the region 512 corresponding to a specific external device (eg, STB) in the first GUI 510 is selected using the remote controller 300, the external input mode of the STB may be entered.

Meanwhile, according to the present invention, an external input mode of a specific external device may be entered through a screen remote controller displayed on a screen of the display unit 150. This will be described with reference to FIG. 8.

8 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.

Referring to FIG. 8, the second GUI 520 is displayed on the display unit 150 of the multimedia device 100.

For example, when a user who is watching a broadcast through the multimedia device 100 wants to control the external device 200, a key button provided in the remote controller 300 or a local key provided in the multimedia device 100 When a button is pressed or an application menu provided on a screen of the display unit 150 is selected, the second GUI 520 may be displayed on the display unit 150.

The second GUI 520 corresponding to the screen remote controller enters an external input mode of the external device 200 connected through a key button for controlling functions of the multimedia device 100 and an external device interface unit 120. Key buttons and more are included. When the button 522 for a specific external device (eg, STB) in the second GUI 520 is selected using the remote controller 300, the external input mode of the STB may be entered.

Meanwhile, according to the present invention, it is also possible to enter an external input mode of a specific external device through gesture recognition. This will be described with reference to FIG. 9.

9 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.

Referring to FIG. 9, a third GUI 530 is displayed on the display unit 150 of the multimedia device 100.

For example, when a user who is watching a broadcast through the multimedia device 100 wants to control the external device 200, a key button provided in the remote controller 300 or a local key provided in the multimedia device 100 When a button is pressed or a user makes a specific gesture, the third GUI 530 may be displayed on the display unit 150.

The third GUI 530 includes a key button for controlling functions of the multimedia device 100 and a key button for entering an external input mode of the external device 200 connected through the external device interface unit 120. have. Among the key buttons provided in the third GUI 530, a key button corresponding to the currently selected function or menu is highlighted (H). When the user moves the hand with the palm open, the key button that is highlighted in response to the hand movement changes, and when the user holds the hand while the specific key button is highlighted, a function or menu corresponding to the specific key button is executed. . In this way, the user may enter a external input mode of a specific external device (eg, STB) by making a gesture.

FIG. 10 is a view for explaining another example of a method for entering an external input mode of a specific external device according to an embodiment of the present invention.

Referring to FIG. 10, a fourth GUI 540 is displayed on the display unit 150 of the multimedia device 100.

For example, when a user who is watching a broadcast through the multimedia device 100 wants to control the external device 200, a key button provided in the remote controller 300 or a local key provided in the multimedia device 100 When a button is pressed or an application menu provided on the screen of the display unit 150 is selected, the fourth GUI 540 may be displayed.

The fourth GUI 540 includes a list of external devices 200 that support the HDMI-CEC function. When the button 542 related to a specific external device (eg, STB) in the fourth GUI 540 is selected using the remote controller 300, the external input mode of the STB may be entered.

Meanwhile, according to the present invention, after entering an external input mode to a specific external device 200, as a result of searching for external devices 200 connected to the same network as the multimedia device 100, the specific external device 200 In some cases, two or more external devices 200 of the same type may be detected. This will be described with reference to FIG. 11.

11 is a diagram illustrating an example of a GUI displayed on a display unit of a multimedia device according to an embodiment of the present invention.

Referring to FIG. 11, a fifth GUI 550 is displayed on the display unit 150 of the multimedia device 100.

When entering the external input mode of a specific external device 200, for example, STB, the controller 140 searches for external devices 200 connected to the multimedia device 100 through the same network. As a result of the search, when there are two or more external devices 200 of the same type as the specific external device 200, that is, the STB, the control unit 140 determines which of the two STBs the external device 200 that the user wants to control is controlled by. In order to confirm, the display unit 150 is controlled to display the fifth GUI 550.

Here, the external device 200 of the same type means an external device belonging to the same family type as the specific external device 200. For example, STBs, digital cameras, mobile terminals, DVD players, and game consoles fall under different product categories. In some cases, the external device 200 of the same type may mean an external device manufactured by the same manufacturing company while belonging to the same product type. For example, when two STBs corresponding to the same product family type exist, if the manufacturing companies are different, it is also possible to design the control unit 140 to determine that the two STBs are not the same type of external device 200. .

In the fifth GUI 550, a list 552 of external devices 200 of the same type as the specific external device 200 is listed. When the user selects STB 2 using the remote controller 300 and selects the confirm button 554, the control unit 140 controls the STB 2 selected by the user command as a control target, that is, a specific external device 200 as a pairing target 200 ), And pair with the STB 2.

Hereinafter, referring to FIGS. 12 to 14, when pairing with a specific external device 200 is completed, a method of controlling the specific external device 200 through the multimedia device 100 using the remote controller 300 To explain.

12 is a flowchart illustrating an example of a method of controlling a specific external device through a multimedia device using a remote controller according to an embodiment of the present invention.

It will be described on the assumption that the multimedia device 100 has entered the external input mode of the specific external device 200 and that the pairing of the multimedia device 100 and the specific external device 200 is completed.

The specific external device 200 transmits GUI data corresponding to functions that can be implemented in the specific external device 200 to the multimedia device 100 (S601).

The multimedia device 100 receives and displays the GUI data from a specific external device 200 (S602). The GUI data is received from the external device interface unit 120 of the multimedia device 100, and the received GUI data is displayed through the display unit 150 under the control of the control unit 140. The control unit 140 of the multimedia device 100 cannot know what the contents of the GUI data are and what functions of the specific external device 200 correspond to the GUI data.

For example, when the user moves the remote controller 300 toward the first menu option included in the GUI data, and then moves toward the second menu option included in the GUI data, and then presses a selection key button. Explain.

First, the user interface unit 180 of the multimedia device 100 receives a signal corresponding to a motion as a user input signal from the remote controller 300 (S603).

The controller 140 of the multimedia device calculates first coordinate value information based on the signal corresponding to the received motion (S604). It is assumed that the first coordinate value information corresponds to the first menu option.

The network interface unit 113 of the multimedia device transmits a signal corresponding to the calculated first coordinate value information to the specific external device 200 (S605).

The specific external device 200 processes a signal corresponding to the transmitted first coordinate value information to execute a function corresponding to the first coordinate value information (S606). Since the user has not yet pressed the selection key button provided on the remote controller 300, the specific external device 200 is a function corresponding to the first coordinate value information, and a function of highlighting a first menu option on the GUI data Run

Then, the specific external device 200 transmits a result of highlighting the first menu option on the GUI data to the multimedia device 100 (S607).

The external device interface unit 120 of the multimedia device 100 receives the result, and the control unit 140 controls the GUI data on which the first menu option is highlighted to be displayed through the display unit 150 (S608). .

In addition, the user interface unit 180 of the multimedia device 100 receives a signal corresponding to the movement as a user input signal from the remote controller 300 (S603).

The control unit 140 of the multimedia device 100 calculates second coordinate value information based on the received motion information (S604). It is assumed that the second coordinate value information corresponds to the second menu option. Between the first coordinate value information and the second coordinate value information, coordinate value information corresponding to the movement of the remote controller 300 may be further present, but for convenience of description, the controller 140 controls the first coordinate value information and the second coordinate value. It is assumed that only value information is calculated.

The network interface unit 113 of the multimedia device 100 transmits a signal corresponding to the calculated second coordinate value information to the specific external device 200 (S605).

The specific external device 200 processes a signal corresponding to the transmitted second coordinate value information to execute a function corresponding to the second coordinate value information (S606). Since the user has not yet pressed the selection key button provided on the remote controller 300, the specific external device 200 is a function corresponding to the second coordinate value information, and a function of highlighting a second menu option on the GUI data Run

Then, the specific external device 200 transmits the result of highlighting the second menu option rather than the first menu option on the GUI data to the multimedia device 100 (S607).

The external device interface unit 120 of the multimedia device 100 receives the result, and the control unit 140 controls to display GUI data on which the second menu option is highlighted through the display unit 150 (S608). .

In addition, the user interface unit 180 of the multimedia device 100 receives a selection key button related information as a user input signal from the remote controller 300 (S603).

When the control unit 140 of the multimedia device 100, the received selection key button related information is in the form of data that cannot be processed by the specific external device 200, the data of the specific external device 200 can be processed. Form. Of course, when the received selection key button related information is in the form of data that can be processed by a specific external device 200, the data processing process of the controller 140 as described above may be omitted.

The network interface unit 113 of the multimedia device 100 transmits the selection key button related information to the specific external device 200 (S605).

The specific external device 200 processes the transmitted selection key button related information to execute a function corresponding to the key button related information (S606). That is, the specific external device 200 executes a specific function corresponding to the second menu option on the GUI data.

Then, the specific external device 200 transmits a result of executing a specific function corresponding to the second menu option to the multimedia device 100 (S607).

The external device interface unit 120 of the multimedia device 100 receives the result, and the control unit 140 controls to output a result of executing a specific function corresponding to the second menu option. For example, when the second menu option corresponds to an option for playing specific VOD content, the external device interface unit 120 receives audio / video data of the specific VOD content from a specific external device 200, The control unit 140 controls the audio data to be output through the audio output unit 160 and controls the video data to be output through the display unit 150.

Depending on the embodiment, each of the steps S603 to S608 may be performed multiple times, or some of the steps may be performed overlapping each other in time. In addition, while the video data is being output through the display unit 150 in step S608, each of the steps S603 to S608 may be performed multiple times, or some of the steps may be performed overlapping each other in time. have.

On the other hand, the specific external device 200, based on the signal corresponding to the coordinate value information transmitted from the multimedia device 100, the information related to the indicator (P) corresponding to the movement of the remote controller 300, the multimedia device (100) ) Can be transmitted (S607).

The external device interface unit 120 of the multimedia device 100 receives the indicator P-related information, and the control unit 140 displays the indicator P to display based on the received indicator-P-related information. The unit 150 is controlled (S608).

13 is a diagram illustrating an example of GUI data of a specific external device displayed on a display unit of a multimedia device according to an embodiment of the present invention. In FIG. 13, it is assumed on the assumption that the specific external device 200 to be controlled by the multimedia device 100 is the STB 201. For example, the STB 201 is connected to the external device interface unit 120 through an HDMI cable C, and is connected to the same access point as the network interface unit 113, but is not limited thereto.

Referring to FIG. 13, GUI data 700 of the STB is displayed on the display unit 150 of the multimedia device 100. The GUI data 700 of the STB is received from the STB 201 by the external device interface 120 of the multimedia device 100.

The GUI data 700 of the STB may be transmitted from the STB 201 after pairing of the multimedia device 100 and the STB 201 is completed, or after entering the external input mode of the STB 201, the multimedia device ( 100) may be transmitted from the STB 201 before pairing of the STB 201 is completed. However, hereinafter, when using the remote controller 300 to control each function of the STB 201 corresponding to the GUI data 700 of the STB through the multimedia device 100, the multimedia device 100 It is assumed that pairing of) and STB 201 is completed.

The GUI data 700 of the STB includes menu options corresponding to each function that can be executed in the STB 201. For example, the GUI data 700 of the STB includes real-time broadcasts 710 and includes thumbnail images 711 to 712 for each channel, and menus 721 to 725 indicating the type of VOD content as the VOD service 720. ), And may include today's weather menu 731 and game menu 732 as Fun & Life 730. However, the control unit 140 of the multimedia device 100 does not know what the contents of the GUI data 700 of the STB and what functions of the STB 201 correspond to the GUI data 700 of the STB.

When the user moves the remote controller 300 toward the GUI data 700 of the STB, a signal corresponding to the coordinate value information is transmitted from the multimedia device 100 to the STB 201 as described above with reference to FIG. 12, Information related to the indicator P corresponding to the movement of the remote controller 300 is transmitted from the STB 201 to the multimedia device 100. Accordingly, an indicator P corresponding to the movement of the remote controller 300 is displayed on the display unit 150 of the multimedia device 100.

As an example, when the user moves the indicator P corresponding to the movement of the remote controller 300 onto the new movie menu 723 on the thumbnail image 711 of the KBS1 channel, the coordinate values as described above with reference to FIG. 12 A signal corresponding to the information is transmitted from the multimedia device 100 to the STB 201, and a function execution result corresponding to the coordinate value information is transmitted from the STB 201 to the multimedia device 100. Accordingly, on the display unit 150 of the multimedia device 100, the thumbnail image 711 of the KBS1 channel is highlighted, and then the highlight state of the thumbnail image 711 of the KBS1 channel is released and the new movie menu 723 is highlighted. Results are output sequentially.

As another example, when the user positions the indicator P corresponding to the movement of the remote controller 300 on the thumbnail image 711 of the KBS1 channel and presses the select key button, as described above with reference to FIG. 12. , After the thumbnail image 711 of the KBS1 channel is highlighted, the broadcast view menu of the KBS1 channel is entered and live broadcast data of the KBS1 channel is output through the display unit 150 and the audio output unit 160.

Meanwhile, according to the present invention, before the pairing of the multimedia device 100 and the specific external device 200 is completed and after pairing is completed, an indicator corresponding to the movement of the remote controller 300 is displayed differently on the display unit 150. It may be. This will be described with reference to FIG. 14.

14 is a diagram for explaining a change in an indicator displayed on a display unit of a multimedia device before and after pairing with a specific external device is completed.

Referring to FIG. 14A, video data 800 of a live broadcast signal is output to the display unit 150 of the multimedia device 100. An indicator I corresponding to the movement of the remote controller 300 is displayed on the screen of the display unit 150. The indicator I will be referred to as a first indicator I. The controller 140 calculates coordinate value information based on a signal corresponding to the motion received from the remote controller 300, and displays the display unit 150 to output the first indicator I according to the calculated coordinate value information. ) Control. The first indicator (I) is for controlling the GUI associated with the multimedia device (100).

If a user receives a command to enter the external input mode of the STB 201 while watching a live broadcast, the control unit 140 of the multimedia device 100 receives the STB 201 as described above with reference to FIG. 6. Perform pairing with.

When pairing of the multimedia device 100 and the STB 201 is completed, the control unit 140 controls the network interface unit 113 to transmit a signal corresponding to the movement received from the remote controller 300 to the STB 201. do.

The STB 201 transmits the indicator P information corresponding to the movement of the remote controller 300 to the multimedia device 100 based on the signal corresponding to the coordinate value information transmitted from the multimedia device 100. . The external device interface unit 120 receives the indicator (P) -related information, and the control unit 140, based on the received indicator (P) -related information, an indicator as shown in (b) of FIG. 14 ( The display unit 150 is controlled to display P). The indicator P will be referred to as a second indicator P. That is, the second indicator P is for controlling the STB 201 according to a signal corresponding to the movement of the remote controller 300.

14A and 14B, the first indicator I and the second indicator P may have at least one of shape, size, color, or transparency different from each other. The user may recognize whether the current remote controller 300 is the control mode of the multimedia device 100 or the control mode of the specific external device 200 based on the change of the indicator output to the display unit 150. Meanwhile, in some cases, even when pairing with the specific external device 200 is completed, the specific external device 200 connected to the multimedia device 100 may be directly controlled through the HDMI-CEC function. This will be described with reference to FIG. 15.

15 is a view for explaining an example of a method for controlling a specific external device on the multimedia device side through the HDMI-CEC function. In FIG. 15, it is assumed on the assumption that the specific external device 200 to be controlled by the multimedia device 100 is the STB 201. For example, the STB 201 is connected to the external device interface unit 120 through an HDMI cable C, but is not limited thereto.

15, video data 900 of VOD content is output to the display unit 150 of the multimedia device 100. The video data 900 is transmitted from the STB 201 to the multimedia device 100 through an HDMI cable C.

When the multimedia device 100 and the STB 201 support the HDMI-CEC function, the basic functions of the STB 201 can be directly controlled using the remote controller 300. For example, the user can directly control basic functions such as playback and pause of VOD content of the STB 201 by pressing key buttons such as playback and pause provided in the remote controller 300.

Hereinafter, referring to FIGS. 16 to 18, the multimedia device 100 searches for external devices 200 in the same network and pairs with the specific external device 200 to be controlled among the searched external devices 200. Describes the process of doing it.

16 is a flowchart illustrating an example of a process in which a multimedia device performs pairing with an external device. However, the process in which the multimedia device performs pairing with the external device is not limited to FIG. 16.

First, the multimedia device 100 transmits a PairingRequest message informing the initialization of the pairing process to the external device 200 (S1001). Then, the external device 200 responds to the multimedia device 100 with PairingRequestAck (S1002).

The multimedia device 100 transmits an option capable of processing the random number value to the external device 200 (S1003). Here, the multimedia device 100 may transmit a type of a random number value that can be processed to the external device 200.

Then, the external device 200 transmits an option to process the random number value to the multimedia device 100 (S1004). Here, the external device 200 may transmit a generated random number value and a receiveable response message to the multimedia device 100.

The multimedia device 100 transmits the configuration details of the random number value to the external device 200 in the Config message (S1005). Then, the external device 200 responds to the multimedia device 100 with ConfigAck (S1006).

Thereafter, the multimedia device 100 and the external device 200 exchange secret keys (S1007). Specifically, the external device 200 generates an appropriate random number value and transmits it to the user, and the encryption key can be exchanged in such a way that the user responds to the random number value.

When the user responds to the random number value, the multimedia device 100 confirms the response, and when the verification result is correct, sends a secret message to the external device 200 (S1008).

Thereafter, when the external device 200 confirms the response and the verification result is correct, the secret device is transmitted to the multimedia device 100 (S1009).

As an example, the above pairing process may use a Secure Socket Layer (SSL) protocol with a short activation time to prevent message spinning.

According to the present invention, only by entering the external input mode of the external device 200 to be controlled, the pairing process described above with reference to FIG. 16 may be automatically performed. If the pairing process as shown in FIG. 16 is performed between the multimedia device 100 and the external device 200, and then enters the external input mode of the external device 200 again, without the encryption key input procedure Pairing with the external device 200 may be completed immediately.

17 is a diagram illustrating an example of a message format exchanged between a multimedia device and an external device in the process of FIG. 16. However, the message format exchanged between the multimedia device 100 and the external device 200 is not limited to FIG. 17.

Referring to FIG. 17, the message 1100 exchanged between the multimedia device 100 and the external device 200 is an outer message that encrypts all exchanged messages and has a common header field 1110 and a lower level. The message includes an inner payload 1120.

The common header field 1110 includes two required fields, protocol_version (1111) and status (1112). protocol_version (1111) is an integer value indicating the version of the current protocol, and is used for backward compatibility in protocol extension. status 1112 is an integer value indicating the status of the protocol. For example, if the status code is OK, status (1112) is '200', which means that the previous message (if any) was received and the next message in the protocol can be sent. When the status 1112 is a value other than '200', it means that an error has occurred in the transmission and the session ends. The common header field 1110 may further include a type 1113 as an optional field. The type 1113 should include an integer number indicating the payload 1120 when the status code is OK.

The inner payload 1120 includes a PairingRequest message 1121, a PairingRequestAck message 1122, an Oprions message 1123, a Configuration message 1124, a ConfigurationAck message 1125, a Secret message 1126, or a SecretAck message 1127, respectively. Can be included.

18 is a diagram illustrating an example of a data packet transmitted from a multimedia device to external devices when the multimedia device searches for external devices in the same network. However, the structure of a data packet transmitted from a multimedia device to external devices when the multimedia device searches for external devices in the same network is not limited to FIG. 18. The data packet 1200 of FIG. 18 will be referred to as a first data packet 1200 for convenience.

The first data packet 1200 includes a payload 1210 containing data to be transmitted and a header 1220 containing information about the payload 1210.

The header 1220 may include information 1221 for error detection, protocol version information 1222, length information 1223 of the payload 1210, and the like.

In the payload 1210 containing the actual data to be transmitted, MAC address information 1211 of the device transmitting the message, name information 1212 of the protocol, length information 1213 of the protocol name, and a message are transmitted. Model name information 1214 of the device, length information 1215 of the model name of the device, and the like may be included.

Hereinafter, a method in which the multimedia device 100 transmits coordinate value information or key button related information to the specific external device 200 will be described with reference to FIGS. 19 and 20.

19 is a diagram illustrating an example of a message format exchanged between a multimedia device and a specific external device after pairing of the multimedia device and a specific external device is completed. However, the message format exchanged between the multimedia device 100 and the specific external device 200 is not limited to FIG. 19.

For example, when the multimedia device 100 and a specific external device 200 transmit a message to each other, the message may follow the RemoteMessage protocol buffer format.

If the Request Message 1310 is included in the RemoteMessage 1300, the sequence_number 1330 responds with the same Response Message 1320 in the specific external device 200. That is, the multimedia device 100 may provide a sequence_number (1330) field value in order to track a response to a request transmitted to a specific external device 200.

The message transmitted from the multimedia device 100 to the specific external device 200 must be encrypted in the Request Message 1310. The request message 1310 includes a key event message 1311, a mouse movement message 1312, a mouse wheel event message 1313, a message 1314 including data, a transmission message 1315 when connected, and a fling message 1316. This can be included. The multimedia device 100 may encrypt the coordinate value information and / or key button related information, etc. in the Request Message 1310 and transmit it to the specific external device 200.

The response message 1320 transmitted from the specific external device 200 to the multimedia device 100 may include a message 1321 including data, a transmission message 1322 when connected, and a fling result message 1323.

20 is a diagram illustrating an example of a data packet transmitted from a multimedia device to a specific external device after pairing of the multimedia device and a specific external device is completed. However, the structure of a data packet transmitted from a multimedia device to a specific external device after pairing of the multimedia device with a specific external device is completed is not limited to FIG. 20. The data packet 1400 of FIG. 20 will be referred to as a second data packet 1400 for convenience.

The second data packet 1400 includes a payload 1410 containing data to be transmitted and a header 1420 containing information about the payload 1410.

The header 1420 may include protocol version information / input method designation information 1421, message full length information 1422, time stamp value information 1423 of a video frame to which the packet content is applied, and the like.

The payload 1410 containing actual data to be transmitted may include information 1411 for input types such as zoom and scroll, coordinate value information 1412, and length information 1413 of the coordinate values. .

For convenience of explanation, each drawing is divided and described, but it is also possible to design to implement a new embodiment by merging the embodiments described in each drawing. It is also within the scope of the present invention to design a computer-readable recording medium in which a program for executing the previously described embodiments is recorded according to the needs of those skilled in the art.

The multimedia device and the operation method according to the present invention are not limited to the configuration and method of the above-described embodiments, and the above embodiments are all or part of each embodiment so that various modifications can be made. It may be configured in an optional combination.

On the other hand, the operation method of the multimedia device of the present invention can be implemented as a code that can be read by the processor on a recording medium readable by the processor provided in the display apparatus. The processor-readable recording medium includes all kinds of recording devices in which data that can be read by the processor are stored. Examples of the recording medium readable by the processor include a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also implemented in the form of a carrier wave such as transmission through the Internet. . In addition, the processor-readable recording medium may be distributed over a networked computer system so that the processor-readable code is stored and executed in a distributed manner.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by a person having ordinary knowledge in the course, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

In addition, in the specification, both the invention of the object and the invention of the method are described, and the description of both inventions may be applied supplementally as necessary.

100: multimedia device
200: external device
300: remote controller

Claims (13)

Receiving a command for entering an external input mode of a specific external device through a user interface;
Searching for at least one external device in communication with the network interface unit via the multimedia device and the network;
Detecting the specific external device among the searched external devices;
Pairing with the detected specific external device;
Receiving video data and GUI data from the specific external device through an external device interface;
Outputting the received video data and GUI data through a display unit;
Receiving a signal corresponding to the movement of the remote controller and a signal corresponding to a key button provided in the remote controller from the remote controller;
Calculating coordinate value information of a screen of the display unit based on a signal corresponding to the received movement of the remote controller;
Transmitting a signal corresponding to the calculated coordinate value information and a signal corresponding to the key button to the specific external device through a network interface unit;
Displaying a first indicator for controlling GUI data of the multimedia device on a display unit according to a signal corresponding to the movement of the remote controller before completion of the pairing step; And
Displaying a second indicator for controlling GUI data of the specific external device on a display unit according to a signal corresponding to the movement of the remote controller after completion of the pairing step
Control method of a multimedia device comprising a. According to claim 1,
Receiving a control application related to the specific external device from an external server; And
And storing the received control application in a memory. According to claim 1, The search step,
Accessing a control application related to the specific external device pre-stored in a memory; And
And executing the accessed control application. delete According to claim 1,
The first indicator and the second indicator is different, at least one of shape, size, color or transparency, the control method of the multimedia device. The method of claim 1, wherein the detecting step,
And displaying a GUI for receiving a command for selecting the specific external device when there are two or more external devices belonging to the same family type as the specific external device among the searched external devices. . An external device interface unit connected to at least one external device and receiving video data and GUI data from the at least one device;
A network interface unit communicating with the at least one external device through a network;
A command for entering an external input mode of a specific external device among the at least one external device is received, and a signal corresponding to the movement of the remote controller and a signal corresponding to a key button provided in the remote controller are received from a remote controller. A user interface unit;
A display unit to display the received video data and GUI data; And
When a command for entering the external input mode of the specific external device is received, external devices communicating with a network interface unit through the network are searched for,
And a control unit detecting the specific external device among the searched external devices and pairing with the detected external device,
The control unit,
Coordinate value information of the screen of the display unit is calculated based on a signal corresponding to the movement of the received remote controller,
The display unit controls to display a first indicator for controlling the GUI of the multimedia device according to a signal corresponding to the movement of the remote controller before pairing with the specific external device is completed,
After the display completes pairing with the specific external device, control to display a second indicator for controlling the GUI of the specific external device according to a signal corresponding to the movement of the remote controller,
The network interface unit controls to transmit a signal corresponding to the calculated coordinate value information and a signal corresponding to the key button to the specific external device,
Multimedia device. The method of claim 7,
The network interface unit receives a control application related to the specific external device from an external server,
The multimedia device further comprises a memory for storing the received control application. The method of claim 7,
Further comprising; a memory for storing a control application for the specific external device;
The controller, when a command for entering the external input mode of the specific external device is received, accesses the control application stored in the memory and executes the accessed control application. delete The method of claim 7,
The first indicator and the second indicator are different, at least one of shape, size, color or transparency, multimedia device. The method of claim 7,
The control unit generates a GUI for receiving a command for selecting the specific external device when there are two or more external devices belonging to the same family type as the specific external device among the searched external devices. The method of claim 7,
The network interface unit transmits a signal corresponding to the coordinate value information and a signal corresponding to the key button to the specific external device through an IP network.

Images