KR20150012495A - Mobile terminal - Google Patents

Abstract

The present invention relates to a mobile terminal capable of being connected to an external display device. A mobile terminal according to an embodiment of the present invention includes a display module which displays a user input image and recognizes the touch input inputted through the displayed user display module; an interface module for transmitting/receiving data to/from an external display device; and a control module which outputs a touch execution command corresponding to the touch input through the interface module to execute the touch input inputted through the display module in the external display device.

Description

[0001] MOBILE TERMINAL [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal connectable with a display device.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

Due to the development of the technology, the mobile terminal has been able to install various application programs corresponding to the needs of the users, and to use the data related thereto, beyond simply transmitting only the voice. The data range also includes personal information stored in the mobile terminal, such as schedule management and SMS (Short Message Service) transmission / reception history, self-generated data such as a photograph or a moving image that can be generated using a camera mounted on the terminal, And content such as e-books, picture buddies, ring tones, and MP3s downloaded from the server. Here, the mobile terminal may be a wireless terminal, a PDA (personal digital assistant), a portable multimedia player (PMP), or the like.

However, since a user needs to input a key several times in order to access a desired function or information through a mobile terminal, it is cumbersome to use, and it is also not easy for an infrequent user to access necessary information.

In order to support and enhance the functionality of such a mobile terminal, it may be considered to improve the structural and / or software aspects of the mobile terminal.

It is an object of the present invention to provide a mobile terminal that can be connected to a display device.

A mobile terminal according to the present invention is intended to control a display device with a mobile terminal by being connected to a display device.

It is another object of the present invention to output a signal output from a mobile terminal to a connected display device.

According to an aspect of the present invention, there is provided a mobile terminal including a display module for displaying a user input screen and recognizing a touch input inputted through the displayed user input screen; An interface module for transmitting and receiving data to and from an external display device; And a control module for outputting a touch execution command corresponding to the touch input through the interface module so that the touch input inputted through the display module is executed in the external display device.

The user input screen may include at least one of a key signal receiving unit for receiving a character key signal and a mouse signal receiving unit for receiving an operation signal of the mouse pointer.

Further, the mobile terminal according to the present invention may further include a wireless communication unit for transmitting and receiving a wireless communication signal, and when the predetermined communication signal is received through the wireless communication unit, You can control the module. When the predetermined communication signal is received through the wireless communication unit, the control module transmits a notification command signal to the external display device through the interface module so that a notification signal indicating that the predetermined communication signal has been received is displayed on the external display device Can be output. The predetermined communication signal includes a character / multimedia signal.

Wherein the control module controls the display module to display the user input screen when the display signal of the user input screen is received through the display module and the interface module includes at least one communication method of Wi- To communicate with the external display device.

According to another aspect of the present invention, there is provided a mobile terminal including: an interface module for transmitting and receiving data to and from an external display device; And a control module for controlling the interface module to output the audio signal to the external display device so that an audio signal is output through the external display device when the external display device is connected, . The information processing apparatus according to claim 1, further comprising a display module capable of displaying predetermined user information, wherein the control module displays the user information displayed on the display module on the external display device, It can be delivered to the device. The display module includes a user input screen including at least one of a key signal receiving unit for receiving a character key signal and a mouse signal receiving unit for receiving an operation signal of a mouse pointer, When the user information modification command is received through the interface module, the user information modification command can be transmitted to the external display device through the interface module.

According to at least one of the embodiments of the present invention, the mobile terminal can be used as a user input unit of the display device, thereby increasing the utilization of the display device and the mobile terminal.

The mobile terminal according to the present invention may include a user input screen including a keyboard receiving unit and a mouse pointer receiving unit in a user input module, thereby enhancing user convenience.

The present invention can provide convenience to the user by outputting image and / or audio signals outputable to the mobile terminal from the mobile terminal as well as the connected display device.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a block diagram of a display device according to an embodiment of the present invention.
3 is a diagram illustrating a display device and a mobile terminal connected thereto according to an embodiment of the present invention.
4 is a flowchart illustrating a process of connecting a mobile terminal to a display device according to an exemplary embodiment of the present invention.
5 is a flowchart illustrating a control procedure between a mobile terminal and a display device according to an exemplary embodiment of the present invention.
6 is a flowchart illustrating a control procedure between a mobile terminal and a display device according to another embodiment of the present invention.
7 and 8 are views showing a state where a display device and a mobile terminal are connected according to an embodiment of the present invention.
9 and 10 are control flowcharts of the mobile terminal and the display device according to the embodiment of the present invention in the connection state shown in FIG. 7 and FIG.
11 is a view showing an embodiment in which a plurality of mobile terminals are connected to a display device.

2. Description of the Related Art [0002] In recent years, a display unit of a mobile terminal has been provided with an indicator having an information display function such as an alarm mode, whether a user has received a character or voice message, battery capacity, (graphic user interface).

Accordingly, the user can know the state of the mobile terminal without performing key input several times in order to access desired functions or information through the mobile terminal. In addition, the user can easily operate the mobile terminal by touching a specific graphical user interface among various graphical user interfaces displayed on the idle screen and directly executing the application contents corresponding to the touch point.

Here, the indicator generally shows fixed information such as the setting and reception status of the mobile terminal. When the user uses the specific function of the mobile terminal, it indicates that the corresponding function is in operation. The indicator is displayed in a fixed area of the display unit screen automatically and is distinguished from a graphical user interface for executing a program in that a separate menu search and setting function must be used to perform a specified specific function or to change the set operation state .

A graphical user interface that supports interaction between a user and an application program executed on the mobile terminal includes an 'Icon' that displays a corresponding program or a shortcut to the program or a shortcut thereof on the display unit in order to execute various programs, And a 'widget' that displays programs in real time using a separate window on the display unit by executing a program independent of the operating state of the computer.

The graphical user interface such as 'icon' should be set to be displayed on the display unit screen in order to easily execute the function of the mobile terminal frequently used by the user, and the displayed position may be arbitrarily designated. As the functions set on these icons are performed, the display or operating state of the application currently running on the display unit is usually changed.

On the other hand, a graphical user interface such as a 'widget' is one of graphical interfaces for smoothly supporting interaction with a user, an application program / operating system, and the like. Even if a user does not visit a portal service or a content providing site, So that the desired service can be used immediately. Examples of the information or service provided through the widget include information such as the memory space of the mobile terminal, the state of the mobile terminal such as the remaining amount of battery, weather information, traffic information, MSN messenger, Receiving service and the like.

In case of a widget, after a widget providing a service to be used by a user is connected to the site and installed in the terminal for the first time, the service can be easily used on the idle screen of the terminal through the widget without visiting the web site. A widget is sometimes called a gadget.

Hereinafter, the 'graphical user interface' in the embodiments of the present invention provides visual information on the display unit, and includes a concept including an application for performing each function provided by the mobile terminal and all applications downloaded from the outside do. Also, it should be noted that the graphical user interface is a concept different from the 'indicator' as described above.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. However, the following embodiments of the present invention may be modified into various other forms, and the scope of the present invention is not limited to the embodiments described below.

The suffix 'module' and the 'suffix' for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

Hereinafter, components of a mobile terminal in which the present invention can be implemented will be described with reference to FIG. A mobile terminal in which the present invention may be implemented includes at least one of the components shown in Figure 1, but may include more components than the components shown in Figure 1 as needed, and fewer components .

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input module 120, a user input module 130, a sensing unit 140, an output unit 150, a memory 160, An interface module 170, a control module 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input module 120 is for inputting audio signals or video signals, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display module 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input module 130 generates input data for a user to control operation of the terminal. The user input module 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface module 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output related to visual, auditory or tactile sense and includes a display module 151, an acoustic output module 152, an alarm module 153, a haptic module 154, 155, and the like.

The display module 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display module 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

There may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

(Hereinafter, referred to as a 'touch screen') in which the display module 151 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure, It can also be used as an input device. That is, the display module 151 may be used as the user input module 130. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display module 151 or a capacitance generated in a specific portion of the display module 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits corresponding data to the control module 180. Thus, the control module 180 can know which area of the display module 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm module 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm module 153 may output a signal for informing occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may be output through the display module 151 or the audio output module 152 so that they may be classified as a part of the alarm module 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and includes an image displayed on the display module 151 in accordance with a control signal of the control module 180, Images that are the same or at least partially different can be displayed on an external screen or on a wall.

The memory unit 160 may store a program for processing and controlling the control module 180 and may temporarily store temporary data of input / output data (e.g., telephone directory, message, audio, And may perform functions for storage. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface module 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface module 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface module 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface module 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, May be a path through which the mobile terminal 100 is transmitted. Various command signals input from the cradle or the power source may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control module 180 may include a multimedia module 181 for multimedia playback. In addition, the user may have a graphic module 182 for controlling a graphic tool displayed on the idle screen of the display module 151 or a graphic effect that can be displayed on the idle screen as the user sets the graphic user interface. In addition, a graphical user interface module 183 may be provided for controlling other graphical user interfaces to be interlocked or changed in accordance with the interaction between the graphic user interfaces.

The multimedia module 181, the graphic module 182 and the graphic user interface module 183 may be implemented in the control module 180 or separately from the control module 180.

The control module 180 can perform pattern recognition processing capable of recognizing the handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control module 180 and supplies power required for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control module 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the control module 180.

The control module 180 of the mobile terminal 100 according to the present invention transmits a touch display command corresponding to the touch input to the external display device 200 so that the touch input input through the display module 151 is output to the external display device 200. [ Module 170. In this way, When the external display device 200 is connected and the external speaker output mode is selected, the control module 180 transmits an audio signal to the interface module 200 of the mobile terminal 200 so that the audio signal is output through the external display device 200. [ The interface module 170 can be controlled to output the image data to the external display device 200 through the interface 170. A detailed description thereof will be described later.

2 is a block diagram of a display device 200 according to an embodiment of the present invention.

2, a display device 200 according to an embodiment of the present invention includes a video / audio processing unit 201, an interface unit 250, a storage unit 260, a display unit 270, a voice input / output unit 290 And a control unit 280. [0033]

The video / audio processing unit 201 processes the input video signal or audio signal to output the video or audio to the display unit 270 and the audio input / output unit 290 of the display device 200. To this end, the video / audio processing unit 201 may include a signal input unit 210, a demodulation unit 220, and a signal processing unit 230. The signal input unit 210 may include at least one of a tuner unit 211, an A / V input unit 212, a USB input unit 213, and a wireless signal input unit 214.

The tuner unit 211 selects an RF broadcast signal corresponding to a channel selected by a user from among RF (Radio Frequency) broadcast signals received through an antenna, converts the selected RF broadcast signal into an intermediate frequency signal, a baseband image, or an acoustic signal Conversion. The analog base band image or the sound signal CVBS SIF output from the tuner unit 211 may be directly input to the signal processing unit 230. [

The demodulation unit 220 receives the digital IF signal DIF converted by the tuner unit 211 and performs a demodulation operation. The demodulator 220 performs demodulation and outputs a stream signal TS. The stream signal output from the demodulation unit 220 may be input to the signal processing unit 230.

The signal processing unit 230 performs demultiplexing, signal processing, and the like, and then outputs an image to the display unit 270 and outputs the voice to the voice input / output unit 290. The voice input / output unit 290 may include a voice input unit 293 such as a microphone and a voice output unit 291 such as a speaker.

Also, the signal input unit 210 can connect an external device and the display device 200. [ The signal input unit 210 is connected to an external device such as a DVD (Digital Versatile Disk), a Blu-ray, a game device, a camcorder, And transmits the data signal to the signal processing unit 230 in the display device 200. In addition, the video signal, audio signal, and data signal processed in the display device 200 can be output to another external device.

The A / V input unit 212 of the signal input unit 210 includes a CVBS (Composite Video Banking Sync) terminal, a component terminal, and an S-video terminal (not shown) so that the video and audio signals of the external apparatus can be input to the display device 200. [ (DVI) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, an IEEE 1394 terminal, a SPDIF terminal, and a Liquid HD terminal. The CVBS terminal, and the S-video terminal may be converted into a digital signal and input to the signal processing unit 230. [ The digital signal input through the other input terminal may be input to the signal processing unit 230 without the analog / digital conversion process.

The USB input unit 213 can input video and audio signals through the USB terminal.

The wireless signal input unit 214 may connect the display device 200 to a wireless network. The display device 200 may be connected to the wireless Internet through the wireless signal input unit 214. [ The wireless signal input unit 214 can perform short-range wireless communication with other electronic devices.

Also, the signal input unit 210 can connect the display device 200 and the set-top box. For example, if the set-top box is a set-top box for an IP (Internet Protocol) TV, the video, audio or data signals of the IP TV set-top box can be transmitted to the signal processor, To the IP TV set-top box. Meanwhile, the above-mentioned IPTV may mean an Internet TV capable of accessing the Internet, and a full browsing TV.

The signal processing unit 230 demultiplexes the received stream signal, for example, an MPEG-2 TS, into a video signal, an audio signal, and a data signal, respectively. Also, the signal processing unit 230 can perform image processing of the demultiplexed video signal. For example, if the demultiplexed video signal is a coded video signal, it can be decoded. Specifically, when the demultiplexed video signal is an MPEG-2 standard-coded video signal, it can be decoded by an MPEG-2 decoder.

The video signal processed by the signal processing unit 230 is displayed through the display unit 270. In addition, the signal processing unit 230 can perform the voice processing of the demultiplexed voice signal.

In addition, the signal processing unit 230 may perform an OSD (On Screen Display) process. Specifically, the signal processing unit 230 displays various types of data on the screen of the display unit 270 based on at least one of the image-processed video signal and the data-processed data signal and the input signal input through the mobile terminal 100 Information can be output as graphic or text.

The storage unit 260 may store an application for each signal processing and control in the control unit 280 or may store a video signal, a voice signal, or a data signal subjected to signal processing. In addition, the storage unit 260 may perform a function for temporarily storing video, audio, or data signals input to the signal input unit 210.

The storage unit 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The display device 200 can reproduce files (moving picture files, still picture files, music files, document files, etc.) stored in the storage unit 260 and provide them to the user and stored in the storage unit 260 The application can be executed and presented to the user.

The control unit 280 controls the above-described overall operation in the display device 200. [ The control unit 280 can receive the signal transmitted from the mobile terminal 100 through the interface unit 250. [ The control unit 280 determines the command inputted by the user to the mobile terminal 100 through the received signal and controls the display device 200 to correspond to the command.

For example, when the user requests screen information or audio information of the display device 200 through the mobile terminal 100, the control unit 280 controls the display unit 200 to display the image processed by the signal processing unit 230 Signal or voice signal to the mobile terminal 100.

When the user requests the application information being executed in the display device 200 through the mobile terminal 100, the control unit 280 controls the display unit 200 to display the application Or environmental information of the mobile terminal 100 to the mobile terminal 100.

When the user inputs data such as text input through the mobile terminal 100 through the interface unit 250, the control unit 280 controls the signal processing unit 230 to process the input data, And output the signal-processed video or audio to the display unit 270.

3 is a diagram illustrating a display device 200 and a mobile terminal 100 according to an embodiment of the present invention.

The mobile terminal 100 according to the present invention can operate in conjunction with an external device, for example, the display device 200. [ That is, all or a part of the display module 151 of the mobile terminal 100 may be displayed on the display unit 270 of the display device 200 or the touch input inputted to the display module 151 may be displayed on the interface of the display device 200 The control unit 280 may input an instruction corresponding to the touch input.

According to an embodiment of the present invention, the display module 151 of the mobile terminal 100 may be used as the user input unit 240 of the display device 200. [ At this time, a predetermined user input screen may be displayed on the display module 151. The control module 180 may display a predetermined user input screen on the display module 151 by executing a predetermined user input, for example, executing an application, a widget, or inputting a key button. At this time, the user input screen may include at least one of a key signal receiving unit 243 for receiving a character key signal and a mouse signal receiving unit 241 for receiving an operation signal of the mouse pointer. The mouse signal receiving unit 241 receives an operation signal corresponding to a user's touch input, such as a mouse pointer, and receives a pointer of the display unit 270 or a pointer unit for moving the screen displayed on the display unit 270 horizontally A wheel button portion 241b for scrolling the screen displayed on the display portion 270 in correspondence with the wheel function of the mouse or a pointer displayed on the display portion 270 to perform a click operation And a click button portion 241c for clicking the button. Here, the wheel button unit 241b operates like a mouse wheel, so that a pointer or a screen displayed on the display unit 270 scrolls up and down, thereby enhancing the convenience of the user in the case of web page search and document operation. In addition, the click button unit 241c operates as a left button or click button of a mouse, and can activate a corresponding region by clicking a specific region displayed on the display unit 270. [

3, when a user input screen is displayed on the display module 151 and a user inputs a predetermined key signal through the key signal receiving unit 243 of the user input screen, The key signal input through the key signal receiving unit 243 may be displayed on the display unit 270. Accordingly, the characters input by the user through the user input screen can be displayed on the display device 200, so that the user can perform a search operation such as a document operation, a movie, a channel, a document, Or you can create your own documents.

4 is a control flowchart illustrating a process of connecting the mobile terminal 100 to the display device 200 according to an embodiment of the present invention.

That is, a connection command signal for connecting the display device 200 to the mobile terminal 100 may be input (S310). At this time, the connection command signal may be a command signal according to the touch input by the user. However, if the mobile terminal 100 and the display device 200 are within a predetermined distance, even if there is no command signal corresponding to a separate touch input, they may be automatically connected. When the connection command signal is input to the mobile terminal 100 at step S310, the control module 180 of the mobile terminal 100 may transmit the connection command to the display device 200 through the interface module 170 (S330). If a connection command is received through the interface unit 250, the control unit 280 of the display device 200 determines whether connection is allowed (S350). 4, the control unit 280 of the display device 200 may additionally perform a step for authentication of the mobile terminal 200 selectively. That is, it is possible to determine whether the connection is permitted by identifying the product number, the product ID, etc. of the corresponding mobile terminal 100, or to determine whether the connection is permitted by inputting an authentication number. At this time, the mobile terminal 100 and the display device 200 can be connected and communicated using at least one communication protocol such as Wi-Fi and Bluetooth.

 If the connection is permitted, notification information indicating that connection is allowed to at least one of the display module 151 of the mobile terminal 100 and the display unit 270 of the display device 200 may be displayed (S370). If the connection is not allowed, notification information indicating that the connection is not allowed is displayed on at least one of the display module 151 of the mobile terminal 100 and the display unit 270 of the display device 200 (S380). Here, whether to display the notification information is optional, and the notification information may not be displayed by the user or the designer.

4 illustrates that the connection command signal for connection to the display device 200 is input to the mobile terminal 100. Alternatively, a connection command signal may be input to the display device 200. [ Also, the main body for determining whether the connection is allowed may be performed in the mobile terminal 100 as well as the display device 200. [

5 is a control flowchart between the mobile terminal 100 and the display device 200 according to an embodiment of the present invention.

After the mobile terminal 100 and the display device 200 are connected, the control module 180 of the mobile terminal 100 may receive a user input screen display command (S410). At this time, the user input screen display command may be a command according to the execution of a predetermined application or widget by touch input through the display module 151.

When a user input screen display command is received, the control module 180 controls the display module 151 to display a user input screen (S430). The user can input the user input information through the user input screen. At this time, the user input information is information input through the user input screen, that is, information inputted through at least one of the key signal receiving unit 243 and the mouse signal receiving unit 241 described in the description of FIG.

When the user input information is received through the user input screen (S450), the control module 180 analyzes the user input information and transmits a display command to the interface module 170 so that the inputted user input information is displayed on the display device 200 To the display device 200 (S470). When a display command is received through the interface unit 250 of the display device 200, the control unit 280 of the display device 200 controls the display unit 270 to display information corresponding to the display command S490). 3, an input window for displaying a key signal is generated on the display unit 270 (S480). When an input window is displayed on the display unit 270, The character "a" corresponding to the key signal is displayed on the input window of the display unit 270 (S490).

6, after the mobile terminal 100 and the display device 200 are connected to each other, the control module 180 of the mobile terminal 100 displays a user input screen Command (S610). When a user input screen display command is received, the control module 180 controls the display module 151 to display a user input screen (S530). The user can input the user input information through the user input screen. At this time, the user input information is information input through the user input screen, that is, information inputted through at least one of the key signal receiving unit 243 and the mouse signal receiving unit 241 described in the description of FIG.

When the user input information is received through the user input screen (S550), the control module 180 analyzes the user input information and transmits an operation command to the interface module 170 so that the input user input information is operated in the display device 200 The control unit 280 of the display device 200 performs an operation command to the display device 200 when the operation command is received through the interface unit 250 of the display device 200 (S590). That is, when the touch input corresponding to the mouse signal is inputted as the user input information through the mouse signal receiving unit 241, the control module 180 analyzes the user input information and outputs the inputted user input information to the interface module 170 The control unit 280 of the display device 200 can execute a command corresponding to the touch input in step S590. For example, in a state where a predetermined game is played on the display device 200, the motion of the game object can be controlled based on a signal input through the user input screen. Alternatively, when performing a movie search on the display device 200 through an input signal on a user input screen, a movie title is input to a predetermined input window by a key signal input through the key signal receiving unit 243, The movie search operation can be executed by inputting the enter signal of the receiving section 243 or inputting the click signal by the mouse signal receiving section 241. [

In the meantime, according to one embodiment of the present invention, when a predetermined communication signal such as SMS or MMS is received through the wireless communication unit 110, the control module 180 controls the display module 151 to display a user input screen. Also, the control module 180 may transmit a notification signal to the display unit 200 indicating that the communication signal has been received. Then, the control unit 280 may display a notification signal in one area of the display unit 270 to inform the user of the notification signal. At this time, the notification signal may include a communication signal, and the control unit 280 may control the display unit 270 to display a communication signal display window for displaying the received communication signal.

7 and 8 are views showing a state in which the display device 200 and the mobile terminal 100 are connected according to an embodiment of the present invention.

As described above, the mobile terminal 100 according to the present invention can operate in conjunction with an external device, for example, the display device 200. [ That is, all or a part of the display module 151 of the mobile terminal 100 may be displayed on the display unit 270 of the display device 200 or the touch input inputted to the display module 151 may be displayed on the interface of the display device 200 The control unit 280 may input an instruction corresponding to the touch input. In addition, the sound output module 152 of the mobile terminal 100 according to the present invention can be interlocked with the sound output unit 291 of the display device 200. Here, the sound output module 152 and the sound output unit 291 each include a speaker.

After the mobile terminal 100 and the display device 200 are connected to each other, an audio signal output through the audio output module 152 of the mobile terminal 100 at the user's selection is output to the audio output unit 291 ). ≪ / RTI > Here, an audio signal is a concept distinguished from a video signal, and refers to a signal that can be audibly identified during reproduction, and includes both a speech signal and a music signal.

7, when the user selects the speakerphone mode, that is, the external audio output mode, while the mobile terminal 100 is in communication with the display device 200 using the mobile terminal 100, the display device 200 The audio output unit 291 outputs the audio.

8, when the mobile terminal 100 and the display device 200 are connected, all or part of the image and / or document displayed on the display unit of the mobile terminal 100 may be displayed on the display device 200 On the display unit 270 of FIG. At this time, the image and / or the document displayed on the display unit 270 can be modified through the user input screen. Here, the user input screen may include at least one of a predetermined key signal receiving unit 249 and a mouse signal receiving unit (not shown).

9 and 10 are control flow diagrams of the mobile terminal 100 and the display device 200 according to an embodiment of the present invention in the connection state shown in FIGS. 7 and 8. FIG.

9, when the mobile terminal 100 and the display device 200 are connected, the control module 180 determines whether the image / audio output mode in which image and / or audio can be output from the mobile terminal 100 (S610). Here, the audio output mode includes a communication mode, a music listening mode, a moving picture playback mode, and the like. The image output mode includes all states in which an image can be displayed on the display module 151 such as a video communication mode, a moving image playback mode, a document display mode, and the like. Here, the image is used to mean not only moving images and images but also documents including words, PDPs, PDFs, and texts.

The control module 180 may determine whether the image / audio external output mode for outputting image / audio from the display device 100 is selected (S630). The image / audio external output mode can be set by a user's selection and the image / audio can be displayed on the display unit 270 and / or the audio output unit 291 of the display device 200 connected to the mobile terminal 100 Output mode. For example, when a user selects a speaker mode during a voice call through the mobile terminal 100 while the mobile terminal 100 and the display device 200 are connected, the speaker 291 of the display device 200 selects the speaker mode Can be output. As a result of the determination, when the image / audio external output mode is selected, the control module 180 transmits the image / audio signal to the external device, that is, the display device 200 via the interface module 170, To the display device 200 (S650). When the image / audio signal is received through the interface unit 250 in operation S670, the control unit 280 of the display device 200 displays the image / audio signal on the display unit 270 and the audio output unit 291 (S690).

FIG. 10 is a control flow chart embodying an embodiment for video conference using the display device 200 of the embodiment according to FIG.

If the mobile terminal 100 and the display device 200 are connected, the control module 180 determines whether the mobile terminal 100 is capable of outputting audio (S610, S710). At this time, the audio output mode includes at least one of a voice communication mode and a video communication mode. At this time, when the user selects the external output (S630), the voice signal is outputted to the display device 200 (S650, 670) in the voice communication mode and the voice signal is outputted through the speaker of the display device 200 S690). In the video communication mode, not only a voice signal but also an image signal is outputted to the display device 200 (S650 and S670), and an image signal is displayed on the display unit 270 of the display device 200 (S690).

The control module 180 may control the display module 151 to display the image or document information stored in the memory 160 of the mobile terminal 100 as user information at step S720, The display command can be transmitted to the display device 200 so that the displayed user information can be displayed on the display unit 270 (S730). At this time, the user information displayed on the display module 151 may be displayed on the display unit 270, but the information not selectively displayed on the display module 151 may be displayed on the memory 160 and the display device If the information stored in the storage unit 260 of the display unit 200 is displayed on the display unit 270. Here, the memory 160 and the storage unit 260 may further include a buffer for temporarily storing data input through the wireless communication unit 110, the A / V input module 120, and the signal input unit 210 .

The control unit 280 of the display device 100 controls the display unit 270 to display the received user information (S780) when a user information display command is received (S770). Referring to FIG. 8, the user information 248 may be displayed in one area of the user input screen of the display module 151, and the key signal receiving unit 249 may be displayed in another area. At this time, the user information 248 may be displayed on the display unit 270 in the same manner.

Meanwhile, the user can correct the user information 248 through the user input screen of the display module 151. For example, when the user information is a word document, the document content of the user information 248 can be changed through key input of the key signal receiving unit 249. [ That is, when the change command input information for changing the user information 248 is received through the user input screen (S750), the control module 180 transmits the change command input information to the display device 200 (S760). Then, the display device 200 changes the user information 248 based on the received change instruction input information (S790). Accordingly, the user can change the user information using the mobile terminal 100 even during the call. With this function, when the mobile terminal 100 and the display device 200 are connected, the present invention can perform a call through the speaker of the display device 200, and can perform a document operation during a call. In addition, when the conference is proceeded, the conversation is performed through the speaker of the display device 200 so that the conference can be performed at a larger volume, the conference data can be displayed on the display unit 270, There is an effect that can be.

11 is a view showing an embodiment in which a plurality of mobile terminals 100 are connected to the display device 200. [

When a plurality of mobile terminals 300, 400, and 500 are connected to the display device 200, the control unit 280 of the display device 200 can determine a priority order among the plurality of mobile terminals 300, 400, have. Accordingly, when a selection signal indicating that the external image / audio output mode is selected from the plurality of mobile terminals 300, 400, and 500 is received, the controller 280 activates only the first selection signal input to the display device 200 . Then, the remaining selection signals are deactivated. In addition, the control unit 280 can activate the received selection signal when the selection signal is received again after the control according to the selection signal inputted before the assumption is completed. At this time, the control unit 280 may activate a selection signal from another mobile terminal after a predetermined time, for example, 3 seconds, has elapsed since the control according to the selection signal inputted before the assumption was completed.

Specifically, when a predetermined control signal is simultaneously received on the display device 200 through the user input screens of the plurality of mobile terminals 300, 400, and 500, the control unit 280 transmits the first control signal And gives control of the display device 200 to the mobile terminal. Accordingly, the control unit 280 activates the control signal received from the corresponding mobile terminal. If the control signal is not received from the mobile terminal for a predetermined time, the control right of the mobile terminal can be released.

Here, the control signal may be used to control the display device 200 using a mobile terminal such as channel change, volume selection, key signal input for searching, mouse pointer control signal, external image / speaker output mode selection, And a control signal.

At this time, a notification signal indicating that the control right is not given may be displayed on the display module of the mobile terminal which has not been given the control right.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (10)

A display module for displaying a user input screen and recognizing a touch input inputted through the displayed user input screen;
An interface module for transmitting and receiving data to and from an external display device;
And a control module for outputting a touch execution command corresponding to the touch input through the interface module so that the touch input inputted through the display module is executed in the external display device. The method according to claim 1,
Wherein the user input screen comprises at least one of a key signal receiving unit for receiving a character key signal and a mouse signal receiving unit for receiving an operation signal of a mouse pointer. 3. The method according to claim 1 or 2,
Further comprising a wireless communication unit for transmitting and receiving a wireless communication signal,
Wherein the control module controls the display module to display the user input screen when a predetermined communication signal is received through the wireless communication unit. The method of claim 3,
The control module outputs a notification command signal to the external display device through the interface module so that a notification signal indicating that the predetermined communication signal has been received is displayed on the external display device when the predetermined communication signal is received through the wireless communication unit Wherein the mobile terminal is a mobile terminal. 5. The method of claim 4,
Wherein the predetermined communication signal is a character / multimedia signal. 3. The method according to claim 1 or 2,
Wherein when the display signal of the user input screen is received through the display module, the control module controls the display module to display the user input screen. 3. The method according to claim 1 or 2,
Wherein the interface module communicates with the external display device using at least one of a Wi-Fi and a Bluetooth communication method. An interface module for transmitting and receiving data to and from an external display device;
And a control module for controlling the interface module to output the audio signal to the external display device so that an audio signal is output through the external display device when the external display device is connected, . 9. The method of claim 8,
Further comprising a display module capable of displaying predetermined user information,
Wherein the control module transmits the user information to the external display device through the interface module so that the user information displayed on the display module is displayed on the external display device. 10. The method of claim 9,
Wherein the display module displays a user input screen including at least one of a key signal receiving unit for receiving a character key signal and a mouse signal receiving unit for receiving an operation signal of a mouse pointer,
Wherein the control module transmits the user information modification command to the external display device through the interface module when the user information modification command is received through the user input screen.

Images