KR101190759B1 - Access system of terminal and display apparatus using connection apparatus - Google Patents

Abstract

The present invention relates to a terminal and a display device connection system using a connection device, wherein the connection between the terminal and the display device is connected to a network through the connection device, and a control signal or a status signal is controlled under the control of the connection device through the connected network. It relates to a connection system that can provide for sharing between display devices.
With such a connection system, there is an advantage that the display device can be easily connected to the mobile terminal, an effect that can provide various applications, and a variety of information can be shared with the various mobile terminals.

Description

ACCESS SYSTEM OF TERMINAL AND DISPLAY APPARATUS USING CONNECTION APPARATUS}

The present invention relates to a system for connecting a terminal and a display device using a connection device, and a terminal and a connection device associated therewith.

Recently, display devices such as TVs have evolved into smart TVs that can use the Internet and applications in various ways beyond simply playing contents provided to broadcasting stations.

Smart TV refers to a TV that can freely watch video without breaking the three screens such as TV, mobile phone, and PC. It can also be called an Internet TV or a connected TV. Such smart TVs can download and view contents from the Internet in real time, and can act as a communication center that can directly check news, weather, email, etc. through the smart TV.

In order to use such a smart TV, a user input device is required. Conventionally, an external display device such as a TV can be controlled through a dedicated controller such as a remote controller and a joystick. However, in the case of a device having a complex and diverse function such as a smart TV in recent years, there is a limit to fully exhibit its function with a conventional dedicated controller.

In addition, although a method of controlling a smart TV using a mobile terminal such as a recent smart phone has been developed, there is a problem that its functions and services are limited because it is provided in a limited form in service selection and channel change.

The present invention provides a mobile terminal and a display device connection system capable of connecting a mobile terminal and a display device to control the display device through the mobile terminal.

In addition, the present invention provides a connection system capable of simultaneously managing a plurality of connected mobile terminals and display apparatuses using a connection apparatus in connecting and controlling the mobile apparatus and the display apparatus.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

Terminal and display device connection system using a connection device according to an embodiment of the present invention for realizing the above object, the first display device for outputting a controlled video signal or audio signal according to the received control command and the first A first mobile terminal for sending a control command to a first display device, the identification information identifying the first display device and the first information for establishing a first pairing connection in connection with the first display device. Identify the first mobile terminal and the first display device in response to the first mobile terminal transmitting the connection request signal to the connection device and the connection request signal, the identification information identifying the mobile terminal; 1 configure a first pairing connection by connecting a mobile terminal and the first display device; Includes a connection device, and when the first mobile terminal and the first display device are connected, the connection device downloads a first program capable of generating a control command for a specific application to the first mobile terminal. And downloading a second program controlled based on the generated control command to the first display device.

A connection device related to another example of the present invention for realizing the above object includes a connection request signal including identification information of a first mobile terminal and a first display device, in order to connect with a first display device from a first mobile terminal. A storage unit for storing identification information included in the communication request signal and the connection request signal received, and storing programs for a specific application that can be used in at least one mobile terminal and at least one display device. The first mobile terminal and the first display device are identified using the identification information according to the reception of a signal, and the first program and the first program corresponding to a specific application are identified by the identified first mobile terminal and the first display device. It includes control unit which each downloads 2 programs.

A mobile terminal according to another example of the present invention for realizing the above object comprises an identification unit for identifying a wireless communication unit and a display device and generating identification information of the display device, and a connection command and a control command for the display device. Generates a connection request signal for the display device according to an input of a user input unit and an input of the connection command, and transmits the generated connection request signal to a connection device capable of connecting the display device and the mobile terminal through the wireless communication unit. And a control unit controlling to connect to the display device, wherein the connection request signal includes identification information of the mobile terminal and the display device, and the control unit, when connected to the display device, inputs the control command. Depending on the control signal It generates and controls the display device.

The connection system according to at least one embodiment of the present invention configured as described above has an effect of easily connecting a display device to a mobile terminal through an image code or a Bluetooth communication technology.

In addition, the connection system according to at least one embodiment of the present invention configured as described above can control the display device in the use of various applications through the mobile terminal as well as utilize various storage media of the connection device. Is present.

In addition, the access system according to at least one embodiment of the present invention configured as described above has the effect of allowing various applications to be shared with one or more mobile terminals.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a conceptual diagram of a connection system according to the present invention.
2 is a block diagram of a mobile terminal and a connection device according to the present invention.
3 is a view illustrating an operation in which a mobile terminal and a display device are connected in accordance with the present invention.
4 and 5 illustrate an operation of controlling a display device for a specific application through a mobile terminal in accordance with the present invention.

The above objects, features, and advantages will become more apparent from the following detailed description with reference to the accompanying drawings, and as such, those skilled in the art to which the present invention pertains may share the spirit of the present invention. It will be easy to implement. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram of a connection system according to an embodiment of the present invention.

1 (a) is a conceptual diagram of a basic connection system of a mobile terminal 100-a connection device 200-a display device 300 in connection with the present invention.

In the present invention, when the mobile terminal 100 and the display apparatus 300 are connected, the mobile terminal 100 can control the display apparatus 300. Here, although the mobile terminal 100 may directly control the display apparatus 300, the mobile terminal 100 may preferably control the display apparatus 300 using the connection apparatus 200.

The mobile terminal 100 generates control information for controlling the display apparatus 300, and transmits the generated control information to the connection apparatus 200. The connection device 200 analyzes the content of the received control information. For example, a process related to the case where the content of the control information is the reproduction stop of the moving image may be performed. In addition, the connection apparatus 200 transmits control information to the display apparatus 300, and the display apparatus 300 may be controlled by contents included in the control information by the transmitted control information.

Here, the control information received from the connection device 200 and the control information transmitted to the display device 300 are not necessarily the same, and the control reprocessed to the display device 300 through the reprocessing process in the connection device 200. Information can be sent. For example, the control information received from the mobile terminal 100 may be a selection command of a specific menu for a user input menu displayed on the mobile terminal 100, and at this time, the connection device 200 analyzes the selection command. The connection apparatus 200 may directly perform the processing for the selection command, and may transmit reprocessed control information for displaying the performed processing result on the display apparatus 300. Here, the reprocessed control information may be, for example, a command for displaying a specific image that may be easily processed by the display apparatus 300, or may further transmit an image together with the command.

In addition, when the mobile terminal 100 and the display apparatus 300 are connected, the connection device 200 may continuously manage the connection state. That is, the mobile terminal 100 and the display apparatus 300 may manage to transmit and receive information with each other. In addition, when the mobile terminal 100 and the display apparatus 300 require the same application, the mobile terminal 100 and the display apparatus 300 may store the corresponding application and provide the corresponding application.

Here, when the mobile terminal 100 and the display apparatus 300 are connected, it may be expressed that the mobile terminal 100 and the display apparatus 300 are paired with each other. In the present specification, the 'pairing connection' state refers to a state in which the mobile terminal 100 and the display apparatus 300 are connected in pairs to share respective connection information. In addition, the mobile terminal 100 may transmit control information such as various control signals to the display apparatus 300, and the mobile terminal 100 may receive state information of the display apparatus 300. For example, in the case of the mobile terminal 100 and the display apparatus 300 that are in a pairing connection state, when the mobile terminal 100 is inclined in a specific direction, the display apparatus 300 receives information on the degree of inclination. It can also be reflected in the display angle of the reproduced image.

In addition, when the mobile terminal 100 and the display device 300 are paired with each other, the connection device 200 moves a program stored in the connection device 200 to execute an application that can be selected according to a user's selection. It can be downloaded to the terminal 100 and the display device 300. The programs downloaded to the mobile terminal 100 and the display device may be the same programs or different programs. In the case of another program, for example, the program downloaded to the mobile terminal 100 may be a user interface program for controlling a program to be displayed on the display apparatus 300. In addition, the connection device 200 may directly drive a program capable of interworking with the downloaded application to implement an interface between the program between the mobile terminal 100 and the display device 300, in which case the connection device 200 The driven program reprocesses the control information (control signal) or state information received from the mobile terminal 100 or the display apparatus 300 into a format that can be processed by each application program, thereby reproducing the mobile terminal 100 or the display apparatus. 300 can be sent.

The control information (control signal) may be a processing command for processing a specific operation or action for a specific application generated in the mobile terminal 100. Such a processing command may be received through the user input unit 130 of the mobile terminal 100, for example, a gyro sensor or an acceleration sensor for detecting a position change or a speed change of the mobile terminal 100 through a button or the like. Can be received via

1 (b) shows a plurality of connection systems in connection with the present invention.

The connection system related to the present invention may be one connection system composed of a mobile terminal 100-a connection device 200-a display device 300. However, the present invention may be a plurality of connection systems. That is, the connection device 200 may configure a plurality of connected mobile terminals and display devices and a plurality of connection systems.

Referring to FIG. 1B, the first mobile terminal 100a and the first display apparatus 300a are first connected 10, and the second mobile terminal 100b and the second display apparatus 300b are connected to each other. The second connection 20 is established, and the third mobile terminal 100c and the third display device 300c may be the third connection 30. In this example, each mobile terminal and each display device have been described as being paired. However, the present invention is not limited thereto, and certain mobile terminals may be configured not to be paired.

Here, each of the connected units 10, 20, 30 share the same connecting device 200. That is, a plurality of mobile terminals can be connected to a plurality of display devices through one connection device 200. Through this, each connected mobile terminal and display device may transmit and receive various information through the same connection device.

Here, a program to be used in the mobile terminals 100a, 100b and 100c in the respective connected units 10, 20, and 30 may download the same program from the connection device 200, and may display the respective display devices. Programs to be used for the 300a, 300b, and 300c may be downloaded from the connection device 200 as the same program.

2 is a block diagram of a mobile terminal and a connection device according to the present invention.

A mobile terminal and a connection device according to the present invention will be described in more detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

2 (a) is a block diagram of a mobile terminal which is one side of the present invention connection system.

The mobile terminal described herein includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, a tablet, and the like. This may include. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

The mobile terminal 100 may include a wireless communication unit 110, an identification unit 120, a user input unit 130, a power supply unit 140, a display unit 150, a memory 160, a controller 170, and the like. Can be. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the connection device 200 or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module, a mobile communication module, and a wireless internet module.

The wireless communication unit 110 may transmit and receive various signals such as control signals and connection signals for communication with one or more display devices 300 or other mobile terminals using the mobile communication module, the wireless internet module, the broadcast communication module, and the like. have. In addition, the wireless communication unit 110 may transmit a connection request signal or a control signal to the connection device 200, and may receive various signals such as a status signal or a connection configuration signal from the connection device 200.

The identification unit 120 may function to identify the display apparatus 300 that is present in the vicinity or a long distance of the mobile terminal 100. That is, the identification unit 120 may obtain identification information about the display apparatus 300 to which the mobile terminal 100 is connected. The identification unit 120 may include one or more modules capable of identifying the display device 300. For example, it may include an image code recognition module such as a short range communication module, a location information module, a QR code, and the like.

The short range communication module refers to a module for short range communication. Short range communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Wi-Fi, Binary-CDMA, etc. Can be. For example, the mobile terminal 100 may obtain identification information of the display apparatus 300 using Bluetooth communication.

The location information module is a module for obtaining the location of the mobile terminal 100 or the display apparatus 300. Representative examples of the location information module for identifying the location of the mobile terminal 100 include a GPS (Global Position System) module, a WPS (WiFi Position System) module, an XPS (Hybrid Position System), and the like. In addition, the location information module may identify the location of the display apparatus 300. For example, when the current position of the mobile terminal 100 is confirmed from the GPS module, information of the display apparatus located in the vicinity may be confirmed from the connection apparatus 200. Accordingly, the location information module may obtain identification information of the display apparatus 300.

The image code recognition module can display information from the information contained in the image code through a technology capable of writing information on displayed images such as QR (Quick Response) codes, two-dimensional and three-dimensional barcodes, MS-tags, or Wi-Mo. This module can identify. When the display device 300 to be recognized generates a QR code, for example, the image code recognition module recognizes the QR code of the display device 300 and extracts identification information of the display device 300 within the QR code. Can be. The image code recognition module for recognizing the image code may be configured to recognize the image code by using a camera or the like mounted on the mobile terminal.

The identification information is configured to identify the display apparatus 300. For example, the identification information may include a wireless or wired network address to which the connecting device 200 may connect to the display device 300, model information of the display device 300, software version information (for example, OS version information) or a display. Serial number, etc., stored in the device 300.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, a joy stick, a joy disk, or the like. It may include a voice input module. For example, a user may input a specific command for the display device 300 through the user input unit 130, and the input command may be transmitted through the connection device 200 or to the display device 300. .

The power supply unit 140 receives an external power source and an internal power source under the control of the controller 170 to supply power for operation of each component.

The display unit 150 displays (outputs) information processed by the mobile terminal 100. The display unit 150 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display, a 3D display, and a light emitting diode (LED) for emitting light.

The memory unit 160 may store a program for processing and controlling the controller 170, and temporarily stores input / output data (for example, a phone book, a message, an audio, a still image, a video, etc.). It can also perform a function for. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen. In addition, the memory unit 160 may store a program downloaded from the connection device 200 (for example, a control program for controlling the display device 300).

The controller 170 typically controls the overall operation of the mobile terminal. For example, control and processing related to operations of the wireless communication unit 110, the identification unit 120, the user input unit 130, the display unit 150, and the memory 160 are performed. In addition, when identifying the display apparatus 300, the controller 170 may generate a connection request signal for the display apparatus. In addition, the controller 170 may generate various control signals for controlling the display apparatus 300 through the stored program.

Here, the connection request signal may include identification information of the display device 300 as well as identification information of the mobile terminal 100 and transmit the identification information to the connection device 200. The identification information of the mobile terminal 100 includes, for example, a network address, a mobile phone address, or a mobile terminal, which allows the user ID of the user who uses the mobile terminal 100 and the mobile terminal 100 to be connected to the connection device 200. OS version information driven at 100 may be included.

In addition, the controller 170 may download a program to be used for controlling the display apparatus through the connection apparatus 200 through the wireless communication unit 110, and the controller 170 may use the downloaded program to display the display apparatus 300. The control signal may be transmitted directly to or through the connection device 200, and the processing result of the control signal or the status information of the display device 300 may be received from the connection device 200. The user may be notified by outputting through the vibration module or the voice output module mounted in the display unit 150 or the mobile terminal 100.

In addition, the controller 170 may be connected to the connection device 200 to select various applications that can be used from the connection device 200 through the user input unit 130, and select a program corresponding to the selected application from the mobile terminal 100. ) To the display device 300 and the display device 300. The program downloaded to the mobile terminal 100 and the program downloaded to the display apparatus 300 may be the same program or different programs.

If another program is downloaded, the program downloaded to the mobile terminal 100 may be a user interface program for guiding a user's input used for control of the display apparatus 300, and downloaded to the display apparatus 300. The program may be a special-purpose program such as a video reproducing program that responds according to a control signal received through a user interface, or a program that can receive a continuous packet stream from the connection device 200. In this case, the program downloaded to the display device 300 may be configured as a program of some of the entire programs capable of executing a specific application (for example, a rendering program capable of drawing an image) to reduce the load on the display device 300. You can do that.

2B is a configuration diagram of a connection device 200 which is the other side of the present invention connection system.

In connection with the present invention, a connection system consists of a mobile terminal, a display device and a connection device. The mobile terminal 100 is connected to the display apparatus 300, and when connected, operates by the management or control of the connection apparatus 200.

As used herein, the term “connecting device” refers to a connecting device for connecting a mobile terminal and a display device by expanding a unit connection connected in a one-to-one or one-to-one connection to N-N, and the connection device 200 The control unit may transmit and receive a control signal required for control between the connected terminal 100 and the display apparatus 300. An example of the connection device 200 may be a server that can be accessed through the Internet and may be configured to include one or more servers. Alternatively, the connection device 200 may be included in the display device 300 and a single device, for example, in a television such as a smart TV or an IP TV. The connection device 200 may connect the mobile terminal 100 and the display device 300 and provide various applications.

The mobile terminal 100 or the display device 300 that is connected to the connection device 200 does not need to store all programs, and has enough storage space and performance to download, store, and execute a program stored in the connection device 200. All you need is

In addition, the connection device 200 of the present invention may be provided with various applications stored in the connection device 200 to provide a variety of services. For example, when the mobile terminal 100 tries to execute a game, home shopping, or word application, the connection device 200 may provide the application.

Hereinafter, the structure of the connection device 200 will be described.

The connection device 200 may include a communication unit 210, a storage unit 220, a control unit 230, and the like. However, the components shown in FIG. 2 (b) are not essential, so that a connection device having more or fewer components may be implemented.

The communication unit 210 may receive a connection request signal and a control signal from the mobile terminal 100, and receive various state information from the display device 300. In addition, the communication unit 210 may retransmit the received control signal to the display apparatus 300 connected to the mobile terminal 100. Alternatively, the state information received from the display apparatus 300 may be retransmitted to the connected mobile terminal 100. Alternatively, the communicator 210 may retransmit the result of the control signal and / or state information processed by the controller 230 to the mobile terminal 100 and / or the display apparatus 300.

Here, the communication unit 210 is responsible for connecting a network between the mobile terminal 100 and the connection device 200 and a network between the display device 300 and the connection device 200, and the two networks do not necessarily need to be identical. . For example, the network between the mobile terminal 100 and the connection device 200 may be an internet network using a wireless network, and the network between the display device 300 may be a wired LAN or a wired bus type wired network.

The storage unit 220 may store identification information about the mobile terminal and the display device. That is, when the access request signal for the display apparatus is received from the mobile terminal 100, the mobile terminal 100 and the display apparatus 300 may be identified using the identification information stored in the storage 220. The stored identification information may be updated periodically.

In the identification information included in the connection request signal from the mobile terminal 100, the mobile terminal 100 and the display apparatus 300 are identified, and the connection apparatus 200 identifies the mobile terminal 100 and the display apparatus 300, respectively. Contains address information for connecting to the network. The address information may include a wireless or wired IP address or a mobile phone address of the mobile terminal 100, and the wireless or wired IP address of the display device 300 or a similar connection device 200 may be used as the display device. It may further include user information indicating the user of the mobile terminal 100, including address information for connecting to the 300 to form a network.

The storage unit 220 includes programs for executing various applications and user information including, for example, a user ID and a password for authenticating a user connected through the mobile terminal 100. Such various applications may include, for example, games, home shopping, word applications, and the like. Each program corresponding to the application may be configured to separately configure a program to be used in the connection device 200 by the mobile terminal 100 and the display apparatus 300, and the mobile terminal 100 requests a specific application. In addition, the mobile terminal program stored in the corresponding application may be transmitted to the mobile terminal 100, the display device program may be transmitted to the display device 300, and the connection device 200 may be loaded with a program to be used by the connection device. The program can interface with the downloaded program, process the received control signals or status information, and retransmit or bypass the processed results. In addition, the programs stored in the storage unit 200 may be separately stored for each OS and OS version, and accordingly, when the OS information is included in the identification information, the mobile terminal 100 and / or the program corresponding to the OS version are included. Alternatively, it may be transmitted to the display device. The storage unit 220 may be configured as a database, and may be configured using a hard disk and a nonvolatile memory.

The controller 230 connects the display apparatus 300 connected to the mobile terminal 100 to the display apparatus 300 using the identification information included in the connection request signal received from the mobile terminal 100. Configure a pairing connection and download a program corresponding to the application to be implemented through the pairing to the mobile terminal 100 and the display apparatus 300.

The program downloaded to the mobile terminal 100 receives and generates a control signal for controlling the program downloaded to the display apparatus 300 through the user input unit 130 and the like, and generates the generated control signal through the connection apparatus 200. It may transmit to the display device 300. In addition, the program downloaded to the display apparatus 300 may generate an audio signal or a video signal output through the display apparatus 300 in response to the control signal received through the connection apparatus 200. Of course, the specific control signal may be configured to transmit the mobile terminal 100 directly to the display device 300 without passing through the connection device 200, or the control signal or state information processed through the processing in the connection device 200. Can be resent.

Here, the control signals received from the mobile terminal 100 are retransmitted to the display apparatus 300, and the state information received from the display apparatus 300 is retransmitted to the mobile terminal 100. The connection device 200 is not limited thereto, and the connection device 200 processes an operation to be performed in a specific application according to the received control signal and also transmits the processed result to the mobile terminal 100 that has transmitted the control signal. The mobile terminal 100 may be configured to be displayed to the user or notified using a vibration module or the like according to the processed result. In addition, the mobile terminal 100 may display the received state information (for example, a processing result of the control signal in the display apparatus 300, etc.) to the user or inform the user using a vibration module. By feeding back the result of the processing to the mobile terminal 100 or transmitting the status information, the user can select various interfaces (for example, a vibration module or audio) of the mobile terminal 100 in which the user possesses the processing result of the control signal. Output), so that the user can react in real time.

In addition, the controller 230 may further configure a pairing connection (herein referred to as a second pairing connection) between the display device and the other mobile terminal 100b, which is separate from the aforementioned pairing connection (herein referred to as a first pairing connection). have. To this end, it is possible to receive a connection request signal from the other mobile terminal (100b). The second pairing connection may be configured according to the connection request signal.

In this case, the application to be implemented through the first pairing connection and the second pairing connection may be an application that can be shared by accessing multiple parties. For example, the application may be a game application capable of playing a multi-party game, an image communication application capable of video communication, or an Internet course program capable of watching a lecture on the Internet.

In order to implement an application that can be shared by accessing a multiparty, the controller 230 requests a multi-party connection from the mobile terminal 100a included in the first pairing connection or the mobile terminal 100b included in the second pairing connection. Can be received. When receiving the multi-party access request, the control unit 230 may transmit such information to the mobile terminal belonging to the requested pairing connection, and receive the permission message accordingly to connect the pairing between the two.

When the pairing connection between them is connected, the controller 230 may transmit the control signal and / or state information received from the first pairing connection to the second pairing connection, and conversely, the control signal received from the second pairing connection and / or Alternatively, the status information may be transferred to the first pairing connection. Therefore, the control signal and the state information received from the second pairing connection or the first pairing connection may be transmitted to the mobile terminal 100 or the display apparatus 300 of the opposite pairing connection, and the received mobile terminal 100 or the display apparatus is received. According to the program of 300, control according to this can be executed. Meanwhile, a specific signal (information) of the control signal or the state information received from the connection device 200 may be configured to omit the transmission.

The display device 300 included in the first pairing connection and the second pairing connection may be the same one display device, for example, one television may play a role. To this end, the screen of one television may be configured to distinguish display areas for distinguishing each pairing, or may be configured to share a display area for each pairing.

The display device 300 in charge of another side of the access system related to the present invention may be a device capable of displaying or playing specific content. The display apparatus 300 does not have a 1: 1 match with a specific mobile terminal 100. That is, even if the display device 300 is arbitrary, when the mobile terminal 100 obtains identification information about the display device 300, the mobile terminal 100 may be connected to the mobile terminal 100.

A display device that stores various applications such as a smart TV or an IP TV may also be a display device applicable to the present invention.

The display apparatus 300 is a device that can be connected to the mobile terminal 100 and is a device that can be controlled by the mobile terminal 100. The display apparatus 300 may include various components, and may include a display module and a sound module capable of playing various contents. In addition, the display apparatus 300 may include a wireless communication module capable of receiving a control signal or a connection configuration signal by an external mobile terminal 100 or the connection device 200.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments can be implemented.

In addition, the connection device 200 and the display device 300 may be implemented in one device, for example, may be implemented in a television such as a smart TV.

3 is a view illustrating a process of interconnecting a mobile terminal and a display device in accordance with the present invention.

3A is a diagram illustrating an example in which a mobile terminal and a display device are connected.

The mobile terminal 100 may be connected to the display apparatus 300 in various ways. For example, the mobile terminal 100 may be connected to the mobile terminal 100 in a Quick Response (QR) code recognition scheme.

The QR (Quick Response) code is a grid patterned two-dimensional code that can hold more information than a conventional barcode. Although it was difficult for general users to obtain the corresponding information by identifying the existing barcode through the dedicated terminal, the QR code can easily obtain the information in the case of a mobile terminal in which a program such as a QR code application is installed.

In addition, the QR code may be easily generated through a QR code generation application included in the QR code generation site or the display device 300.

In this regard, referring to the present invention, the display apparatus 300 may generate a QR code through a predetermined method. The QR code herein may include identification information for identifying the corresponding display device 300.

When the display apparatus 300 generates the QR code, the mobile terminal 100 may recognize the QR code. The identification unit 120 of the mobile terminal 100 may recognize a QR code through a camera module or the like, and may acquire identification information about the display apparatus 300 by recognizing the QR code. The mobile terminal 100 obtains the identification information of the display apparatus 300 and includes the identification information of the mobile terminal 100 so that the mobile terminal 100 is connected to the display apparatus 300 with respect to the display apparatus 300. The connection request signal can be transmitted.

The display device 300 may be configured not to display the generated QR code at all times. For example, when the QR code is displayed periodically, or if one mobile terminal 100 is already connected and an application that cannot share the display device 300 with another mobile terminal 100 is running, You can configure the QR code to be generated and not displayed. Alternatively, the external device managing the display device 300 may determine the timing of generation of the QR code.

The identification information about the mobile terminal 100 and the display device 300 is information used by the connection device 200 to connect the terminal 100 and the display device 300, and includes a network address of each device. In addition, it may further include authentication information (for example, user ID and password) for user authentication.

The connection device 200 may identify each of the mobile terminal 100 and the display device 300 according to the connection request signal. In order to connect the mobile terminal 100 and the display apparatus 300, the connection apparatus 200 needs to confirm identification information on which device each apparatus is. In addition, the connection request signal received by the connection device 200 may include information about the mobile terminal 100 and information about the display device 300 to be connected. Such information may be used by the connection device 200 to identify the mobile terminal 100 and the display device 300.

Meanwhile, the storage unit 220 of the connection device 200 may store a user ID, a user password, and the like as identification information for each, and identify whether the received authentication information is valid through the stored user authentication information.

When the connecting device 200 identifies the mobile terminal 100 and the display device 300, respectively, the connecting device 200 may identify the other party's identification information or the connecting device 200 to the mobile terminal 100 and the display device 300. The mobile terminal 100 and the display apparatus 300 that transmit the connection configuration signal including the network channel information respectively set and receive the connection configuration signal may be in a connection state between the connection apparatus 200.

The connection device 200 sets up a connection line between the mobile terminal 100 and the display device 300 that are paired and connected, and through this, the mobile terminal 100 and the display device 300 mutually control signals or status information. Can transmit and receive.

3B is a diagram illustrating another example in which a mobile terminal and a display device are connected.

In the present embodiment, the mobile terminal 100 receives identification information of the display apparatus 300 through the Bluetooth communication technology. In addition to Bluetooth communication technology, there are infrared communication technology, RFID technology, and the like, and the present invention may be connected to a mobile terminal and a display device through the various short-range communication technologies in addition to the Bluetooth communication technology.

Bluetooth communication technology refers to the development code name of the wireless data communication standard developed by Ericsson of Sweden, IBM and Intel of USA, Nokia of Finland, Toshiba of Japan, etc. Communication can be enabled.

The mobile terminal 100 and the display apparatus 300 related to the present invention are basically devices capable of Bluetooth communication.

The display apparatus 300 may first establish a Bluetooth connection. When the Bluetooth connection is established, the mobile terminal 100 can check the display device 300 located near the device through Bluetooth search. The mobile terminal 100 may obtain identification information about the display apparatus with respect to the identified display apparatus 300.

When the mobile terminal 100 obtains identification information about the display apparatus 300 through Bluetooth communication, the mobile terminal 100 may transmit a connection request signal to the connection apparatus 200.

In this case, the connection device 200 identifies the mobile terminal 100 and the display device 300, respectively, similarly to the description of FIG. 3 (a), and connects to the mobile terminal 100 and the display device 300. Send a configuration signal. The mobile terminal 100 and the display apparatus 300 which have received the connection configuration signal are connected to each other.

Meanwhile, in the above description, the manner in which the mobile terminal 100 is connected to the display apparatus 300 using QR code recognition and Bluetooth communication technology has been described, but the present invention is not limited thereto.

For example, when the mobile terminal 100 has previously stored identification information about the display apparatus 300 to which the mobile terminal 100 is to be connected, or the user of the mobile terminal 100 knows the mobile terminal 100, the mobile terminal 100 may display the display apparatus 300. It is also possible to transmit a connection request signal to the connection device 200 without having to obtain identification information.

4 and 5 illustrate an operation of controlling a display apparatus through a mobile terminal according to the present invention.

When the mobile terminal 100 and the display device 300 are connected through the connection device 200, the present invention may control the display device 300 in connection with operations of various applications. In addition, here, the mobile terminal 100 and the display device 300 are connected through the connection device 200, and various functions of the connection device 200 may be used in the connection state.

4A illustrates an operation of executing a game application as an example of an operation of controlling a display device.

The mobile terminal 100 and the display device 300 may store the same game application, but may not. In this case, the connecting device 200 may transmit the same game application executable to each device.

On the other hand, a program such as a game application is actually stored by the connecting device 200, the mobile terminal 100 simply has a program related to the operation function, and the display device 300 to play only the display result, not the game application itself. You may. That is, the operation and storage subject of the actual game application may be the connection apparatus 200, the input subject may be the mobile terminal 100, and the display subject may be divided into the display apparatus 300. Here, the connection device 200 may process a control signal received from the mobile terminal 100 and transmit the processed result to the mobile terminal 100, and the mobile terminal 100 may know the received processed result. Can be output to the display or notified to the user via vibration or audio output.

When the mobile terminal 100 is used as a remote controller in connection with a game application, various control signals such as a touch method or a moving method or a voice input may be generated. The generated control signal may be transmitted to the connection device 200.

The control signal received by the connection device 200 determines an action to be processed in the game application based on the state information of the game application, and transmits the processed control signal corresponding to the determined action to the display device 300 and the processing result. May transmit a control signal for the user to the mobile terminal 100 to control the operation of the game application. The processed control signals transmitted to the mobile terminal 100 or the display apparatus 300 are not necessarily the same. For example, the processed control signals transmitted to the mobile terminal 100 may be controlled by the user of the mobile terminal 100. It may be a control signal to generate an output of a form that can inform the result of the control signal, the processed control signal transmitted to the display device 300 is displayed such as to display a specific image according to the processing result of the action in the connection device It may be a control command that can be executed in the device 300 without any processing. To this end, the connection device 200 may load and execute a program capable of receiving a control signal of a game application and generate a processing result thereof, and may be configured to transmit a result processed by the corresponding program.

Meanwhile, the mobile terminal 100 may include a position sensing sensor such as an acceleration sensor and a gyro sensor. The mobile terminal 100 may generate various manipulation signals through the acceleration sensor and the gyro sensor, and may affect the operation of the game application through the generated manipulation signals.

In driving the game application, a plurality of people may participate in the game application instead of one. In this case, the connection system of the present invention may include a plurality of connected mobile terminals and display devices. Accordingly, a plurality of users corresponding to the connected mobile terminal and the display device may simultaneously participate in the game application. In this case, the connection device 200 may be a subject that operates the game application.

In addition, the connection device 200 may retransmit or process the received state information back to the mobile terminal 100 again to inform the result of the game or the current state information. In addition, the connection device 200 may configure the result information (for example, the end of the game) of the corresponding state information to be written in the user account of the mobile terminal 100 of the storage unit 220.

4B illustrates an operation of executing a word writing application as another example of the operation of controlling the display apparatus.

The mobile terminal 100 may have various user input functions. According to the present embodiment, when a word is written using the user input unit 130 of the mobile terminal 100, the result may be displayed on the connected display apparatus 300.

When the present invention is applied in connection with a word writing application, the mobile terminal 100 may serve as a keyboard for word writing. In addition, the display apparatus 300 may provide a function such as a monitor showing a result of word writing.

The mobile terminal 100 may have a display unit having a touch screen function, and may display a key input format such as a QWERTY key or a heavenly man. When a specific character is input through the QWERTY key displayed on the mobile terminal 100, a control signal including the input character is transmitted to the connection device 200. The control signal transmitted to the connection device 200 may be stored in the connection device 200. At the same time, the connection device 200 may process the control signal and transmit the control signal to the display device 300. The input characters included in the transmitted control signal are displayed on the display device 300. Through this, the input character may be displayed on the display apparatus 300. The connection device 200 drives a word writing application, receives a control signal indicating a user input, processes the word writing application, and transmits the result so that the user of the mobile terminal 100 can recognize the processed result. Can be. By building the system in this manner, the display device 300 can be simply and quickly performed without having to directly implement a specific application.

5A illustrates an operation of executing a video call application as another example of the operation of controlling the display apparatus.

As described above, in the present invention, the connected mobile terminal and the display apparatus may exist in a plurality of units, and video calls may be possible through the connection apparatus 200 for each connected connection unit.

The mobile terminal 100 may function as an input device for audio and video capable of capturing a user's own appearance and receiving a user's voice. Such a function is possible through the camera module and the sound module of the mobile terminal 100.

The mobile terminal 100 may generate a video signal related to its own video in connection with a video call, and transmit the video signal to the counterpart.

In detail, the connected first mobile terminal 100a receives a voice and a video and transmits the corresponding video signal a to the connection device 200. The video signal a transmitted to the connection device 200 is transmitted to the second display device 300b of the other second group which is connected. In addition, on the contrary, the connected second mobile terminal 100b receives audio and video and transmits the corresponding video signal b to the connection device 200, and the video signal b transmitted to the connection device 200 is Is transmitted to the connected first display device 300a.

Through this, the connected first and second groups may implement a video call function with each other. Here, the connection device 200 may provide a function for connecting through the first and second groups of video calls connected.

5 (b) illustrates an operation of executing a home shopping application as another example of an operation of controlling the display apparatus.

As another embodiment of the present invention, a home shopping application may be applied to the system. That is, the mobile terminal 100 may receive an order for a specific item from a user as an ordering subject, the display apparatus 300 may display an article related to home shopping, and the connection apparatus 200 may be home shopping. Control operations related to the operation can be performed.

Referring to FIG. 5B, the mobile terminal 100 serves as an input unit for receiving an order from a user in relation to a home shopping application. The display apparatus 300 may display various contents related to a home shopping application. Various contents related to the home shopping application may be transmitted from the mobile terminal 100 or the connection device 200. The connection device 200 may serve as a subject of various control operations related to home shopping. In addition, although the connection device 200 may perform all control operations related to the corresponding home shopping application, the connection device 200 may provide a related service using an external service. For example, the connection device 200 may be provided with information related to home shopping through a home shopping service, and may provide order related information. That is, the connection device 200 may serve to connect to an external server through an intermediary function related to home shopping, and the connection device 200 orders the product ordered by the mobile terminal 100 to the mobile terminal 100. It can provide a result of related information. Here, the result value of the order-related information may include identification information for identifying the order, shipping information, scheduled delivery information, and status information of the order.

In addition, although not shown in the figure, the connection device 200 may directly provide a payment service related to home shopping, or may provide a corresponding service by accessing an external payment server through the connection device 200.

In addition, when the article displayed on the display apparatus 300 has a QR code, the mobile terminal 100 may make an article cast through recognizing the QR code.

In the above description, the application operation of the connection system has been described in relation to the operation of some applications. However, the inventors' access system is not limited to the operation of the specific application described above. For example, in relation to a video playback application, a video or an application may be controlled to play the video on the display apparatus 300 through the control of the mobile terminal 100 while being stored in the connection device 200.

In addition, the connection device 100 may use the user information included in the connection request signal, such as usage information such as the frequency of use or the number of times of use of the application executed or used by the user on the connection device, and the result after using the specific application (for example, in the case of a game). The final stage of the finished game, such as the acquired item, the final word generation file for a word, etc.), so that when the user selects a specific application, the user can decide whether to start after the saved results for that particular application. In addition, the usage information may be used as an objective criterion such as an advertisement fee.

According to one embodiment of the present invention, the above-described connection system can be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

100 Mobile terminal 110 Wireless communication unit
120 Identification unit 130 User input unit
170 controls
200 connection unit 210 communication unit
220 Storage 230 Control
300 display device

Claims (12)

A terminal and display device connection system using a connection device,
A first display device for outputting a controlled video signal or audio signal in accordance with a received control command;
A first mobile terminal for sending a control command to said first display device, said identification information identifying said first display device for establishing a first pairing connection in connection with said first display device; A first mobile terminal for transmitting a connection request signal to the connection device, the first mobile terminal comprising identification information identifying a first mobile terminal; And
A connection device identifying the first mobile terminal and the first display device in response to the connection request signal, and connecting the first mobile terminal and the first display device to form the first pairing connection;
When the first mobile terminal and the first display device are connected,
The connection device downloads a first program capable of generating a control command for a specific application to the first mobile terminal, and downloads a second program controlled based on the generated control command to the first display device. Characterized by
Terminal and display device connection system using a connection device. The method of claim 1,
The first mobile terminal,
Recognizing the image code generated by the first display device to extract the identification information of the first display device,
Terminal and display device connection system using a connection device. The method of claim 1,
The connecting device and the first display device are implemented on one television, characterized in that the first program is a user interface program capable of receiving a user's control command,
Terminal and display device connection system using a connection device. The method of claim 1,
A second display device for outputting a video signal or an audio signal controlled according to the received control command; And
A second mobile terminal for transmitting a control command to the second display device and the first display device, wherein the second display device is configured to establish a second pairing connection by connecting to the second display device. And a second mobile terminal for transmitting a connection request signal to the connection device, the identification information identifying the identification information and the identification information identifying the second mobile terminal.
The connection device identifies the second mobile terminal and the second display device in response to the connection request signal, further configures the second pairing connection by connecting the second mobile terminal and the second display device; The control command processed by processing the control command received from the first mobile terminal is transmitted to at least the first display device and the second display device, and the control processed by processing the control command received from the second mobile terminal. Send a command to at least the first display device and the second display device.
Terminal and display device connection system using a connection device. The method of claim 4, wherein
Characterized in that the first display device and the second display device is implemented on one television,
Terminal and display device connection system using a connection device. A connecting device for connecting a mobile terminal and a display device,
A communication unit for receiving a connection request signal including identification information of the first mobile terminal and the first display device from the first mobile terminal, so that the first mobile terminal accesses the first display device;
The storage unit stores identification information of the first mobile terminal and the first display device included in the received connection request signal, and stores programs for a specific application that can be used in the at least one mobile terminal and the at least one display device. ; And
The first mobile terminal and the first display device are identified using the identification information of the first mobile terminal and the first display device included in the connection request signal according to the reception of the connection request signal, and the identified first And a control unit for respectively downloading a first program and a second program corresponding to a specific application to the mobile terminal and the first display device.
Connecting device. The method according to claim 6,
The communication unit further receives from the second mobile terminal a connection request signal including identification information of the second mobile terminal and the second display device, in order for the second mobile terminal to access the second display device.
The controller may be further configured to use the second mobile terminal and identification information of the second mobile terminal and the second display device included in the connection request signal from the second mobile terminal in response to the reception of the connection request signal from the second mobile terminal. Identifying a second mobile terminal and the second display device and downloading the first program and the second program corresponding to the specific application to the identified second mobile terminal and the second display device, respectively;
Connecting device. 8. The method of claim 7,
The controller is configured to process the control command received from the first mobile terminal and retransmit the processed control command to at least one of the first display device, the second mobile terminal, and the second display device. And retransmitting the processed control command to at least one of the second display device, the first mobile terminal, and the first display device.
Connecting device. As a mobile terminal,
A wireless communication unit;
An identification unit for identifying a display device and generating identification information of the display device;
A user input unit for receiving a connection command and a control command for the display device;
Generating a connection request signal for the display device according to the reception of the connection command, and transmitting the generated connection request signal to a connection device capable of connecting the display device and the mobile terminal through the wireless communication unit; A control unit for controlling access;
The access request signal includes identification information of the mobile terminal and the display device.
The control unit,
When connected to the display device, generating a control signal to control the display device in accordance with the reception of the control command,
Mobile terminal. The method of claim 9,
The controller receives a control program for generating a control signal for controlling the display device from the connection device to drive the control program,
The control program transmits a control signal to the connection device according to the received control command,
Mobile terminal. The method of claim 9,
The control unit further receives a control command from an external mobile terminal connected by the connection device, and controls to notify the user of the mobile terminal of the further received control command from the external mobile terminal.
Mobile terminal. The method of claim 9,
The identification information of the mobile terminal and the identification information of the display device include a network address to which the connection device can access.
Mobile terminal.

Images