KR20150038883A - Terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a portable terminal and a control method thereof. The portable terminal connects communication with at least one external device, and figures out applications linkable between applications of the portable terminal and applications of the external device to provide an application linking function between the portable terminal and the external device to a user.

Description

TECHNICAL FIELD [0001] The present invention relates to a portable terminal,

The present invention relates to a portable terminal and a control method thereof, in which the use of the terminal can be realized by further considering the convenience of the user.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

Recently, a communication is established between a portable terminal and a plurality of external devices in a home using a DLNA (Digital Living Network Alliance) network, and data can be exchanged between the portable terminal and the external devices.

However, in order to link the operation of a specific application between the portable terminal and the external devices, the portable terminal executes an application that wants to be linked with the external devices, and then operates the external devices again, There is an inconvenient problem that must be executed.

An object of the present invention is to provide a portable terminal which communicates with at least one external device and grasps an application that can be interlocked with the external device in the portable terminal and provides the user with an application interlocking function between the portable terminal and the external device And a control method thereof.

According to an aspect of the present invention, there is provided a portable terminal including: a touch screen; A wireless communication unit for communicating with at least one external device installed with applications and performing communication with the external device; A memory in which applications are installed; Wherein when the specific application installed in the memory is executed, the control unit receives the related information of the applications installed in the external device from the external device through the wireless communication unit, And a control unit for receiving at least one application capable of interlocking with the external device and transmitting a signal for controlling execution of the identified application to the external device through the wireless communication unit.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method including: communicating with at least one external device installed with applications; Receiving related information of applications installed in the external device from the external device; Executing a specific application installed in the portable terminal; Identifying at least one application among the applications of the external device that can be interlocked with the executed specific application based on the related information; And transmitting a signal for controlling execution of the identified application to the external device.

A portable terminal and its control method according to the present invention is a portable terminal and a control method thereof that enable a portable terminal to communicate with at least one external device and grasp an application capable of interlocking between applications of the portable terminal and applications of the external device, And an application interlocking function between the external device and the external device.

1 is a block diagram of a portable terminal according to an embodiment of the present invention.
2 is a front perspective view of a portable terminal according to an embodiment of the present invention.
3 is a rear perspective view of a portable terminal according to an embodiment of the present invention.
4 is a flowchart illustrating a process of controlling the mobile terminal according to the present invention.
5 to 13 are explanatory views illustrating a control procedure of the portable terminal according to the present invention.

Hereinafter, a portable terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The portable terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to the portable terminal.

The external device described in this specification can be connected to a DLNA (Digital Living Network Alliance) network such as the portable terminal, the refrigerator, the digital TV, the notebook, the computer, the rice cooker, the washing machine, the webcam, And all devices capable of transmitting and receiving data with the portable terminal and capable of installing and executing an application providing a specific function.

1 is a block diagram of a portable terminal according to an embodiment of the present invention. The portable terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the wireless terminal 100 and the wireless communication system or between the wireless terminal 100 and a network in which the wireless terminal 100 is located.

For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

In addition, the wireless communication unit 110 communicates with at least one external device through a DLNA network or a wireless communication network, and transmits / receives data to / from the external device.

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

Also, the mobile communication module 112 communicates with at least one external device through the DLNA network or mobile communication network, and transmits / receives data to / from the external device.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

In addition, the wireless Internet module 113 communicates with at least one external device through a DLNA network or a wireless Internet network, and transmits / receives data to / from the external device.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

In addition, the short-range communication module 114 communicates with at least one external device through a DLNA network or a local area network, and transmits / receives data to / from the external device.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 located on the front, rear, or side of the portable terminal 100, and may include a key pad ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, the presence of the user, the orientation of the portable terminal, And generates a sensing signal for controlling the operation of the portable terminal 100. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) the information processed in the portable terminal 100. For example, when the portable terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received image, UI, or GUI is displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the portable terminal 100. [ For example, in the portable terminal 100, a plurality of display units may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor 137 may be stacked on the display unit 151 to form a layer structure when the touch sensor 137 has a form of a touch film, a touch sheet, a touch pad, or the like. And may be integrally formed.

The touch sensor 137 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 137 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 137, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner area of the portable terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception tones, message reception tones, etc.) performed in the portable terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal include receiving a call signal, receiving a message, inputting a key signal, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, still image, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory 160 may store data on vibrations and sounds of various patterns to be output upon touch input on the touch screen, and may store map data including a plurality of regions according to the present invention.

Also, a plurality of applications may be installed and stored in the memory 160.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory A static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) Magnetic disk, magnetic disk, magnetic disk, or optical disk. The portable terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the portable terminal 100. The interface unit 170 receives data from an external device or receives power from the external device and transmits the data to each component in the portable terminal 100 or allows data in the portable terminal 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the portable terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the portable terminal 100, or various command signals input from the cradle by the user It can be a passage to be transmitted to the terminal. The various command signals input from the cradle or the power source may be operated as a signal for recognizing that the portable terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the portable terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2 is a perspective view of a portable terminal according to an embodiment of the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the portable terminal 100 includes cases 101, 102, and 103 which form an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

A component such as a USIM card and a memory card, such as an auxiliary storage medium 165, which may be detached, may include an opening in the case so as to be inserted into the case from the outside. Slots may be formed on the side of the case so that the auxiliary storage medium 165 may be inserted from the side of the portable terminal 100 and card slots 166 and 167 may be formed on the surface of the rear case 102 It is possible.

The cases 101, 102, and 103 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100, and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive commands such as activation / deactivation of the touch recognition mode of the display unit 151 and the like.

The operation units 131, 132 and 133 may have a button system recognized when a user applies pressure and a touch sensor 137 may be provided to the operation units 131, 132 and 133 in addition to the display unit 151 So that the user's command can be received only by the user's touch.

3 is a rear perspective view of the portable terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or pop-up.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output 152 'on the rear side of the body may implement the stereo function together with the sound output 152 (see FIG. 2) of the front side of the body, and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

Hereinafter, one embodiment of a control method that can be implemented in the mobile terminal 100 configured as above will be described with reference to FIG.

For convenience of explanation, it is assumed that the portable terminal mentioned below includes at least a part of the components shown in Fig. Specifically, the portable terminal according to the present invention includes a display unit 151, a memory 160, and a controller 180 among the components shown in FIG. The portable terminal according to the present invention can be implemented more easily when the display unit 151 is the touch screen 151. Therefore, it is assumed that the display unit 151 is a 'touch screen'.

Meanwhile, in the embodiment of the present invention, the touch action of the user means a touch gesture implemented by touching or touching closely on the touch-screen type display unit 151, and the touch input indicates an input received by the touch gesture do.

The touch gesture can be classified into various types depending on the operation such as tapping, touch & drag, flicking, long touch, multi touch, pinch in, pinch out.

Tapping refers to a touch gesture such as a click of a mouse in a general personal computer, by lightly pressing and releasing the display unit 151 once.

In addition, the touch drag may be an operation of moving to a specific position while holding the touch of the display unit 151 and releasing the object. When the object is dragged, the object may be continuously displayed in accordance with the drag direction.

In addition, flicking refers to an operation of touching the display unit 151 and then stroking in a specific direction (up, down, left, right or diagonal) and a specific speed (or intensity) When the touch input is received by flicking, the controller 100 performs a specific operation based on the flicking direction, speed, and the like.

Also, the long touch means an operation of continuously holding the touch for a predetermined time or longer after touching the display unit 151. [

Also, the multi-touch means an operation of touching a plurality of points of the display unit 151 at the same time.

In addition, the pinch-in refers to an operation of dragging a plurality of pointers in multi-touch on the display unit 151 in a direction toward each other. That is, dragging starts from at least one point among a plurality of points that are multi-touched on the display unit 151 and occurs in a direction in which a plurality of points that are multi-touched approach each other.

In addition, the pinch-out refers to an operation of dragging a plurality of pointers in a multitouch direction on the display unit 151 in directions away from each other. That is, dragging starts from at least one point among a plurality of points that are multi-touched on the display unit 151 and occurs in a direction in which a plurality of points that are multi-touched move away from each other.

4 to 13, the portable terminal 100 is connected to at least one external device, and the applications of the portable terminal 100 and the applications of the external device are connected to each other A process of providing an application interlocking function between the portable terminal and the external device by grasping an interlocking application is explained in detail.

4 is a flowchart illustrating a process of controlling the mobile terminal according to the present invention.

5 to 13 are explanatory views illustrating a control procedure of the portable terminal according to the present invention.

4 to 13, the controller 180 of the portable terminal 100 searches for at least one external device capable of communicating with the portable terminal 100 through the wireless communication unit 110, And a communication is established (S110).

In this case, the external device may be a device connected to the DLNA network. In this case, the control unit 180 accesses the DLNA network through the wireless communication unit 110, and transmits at least one external device previously registered in the DLNA network You can search and connect the communication.

When the communication with the external device is established, the control unit 180 transmits a signal requesting the external device to request the related information of the applications installed in the external device through the wireless communication unit 110, And stores the received data (S120).

The related information may include at least one of a list of applications installed in the external device, a name of the applications, a web address of a corresponding sales web page of the application store that sells the applications, category information to which the application belongs, And a function to perform the function of the function.

In addition, the related information includes information of contents executable through each of the applications installed in the external apparatus among the contents provided in the external apparatus.

The control unit 180 determines whether a specific application among the applications installed in the memory 160 is being executed in a state in which the communication with the external device is connected (S130).

If it is determined that the specific application is being executed (S140), the controller 180 determines whether the application is currently being executed in the portable terminal 100 among the applications installed in the external device based on the related information received from the external device And recognizes at least one application capable of interworking with a specific application [S150].

At this time, among the applications installed in the external device, at least one application that can be interlocked with the specific application currently running in the mobile terminal 100 is a specific application currently running in the mobile terminal 100, Or an application having the same name as the specific application currently running in the mobile terminal 100 or an application providing the same function as the specific application currently running in the mobile terminal 100, Or an application belonging to the same category as the specific application currently running in the mobile terminal 100. [

The control unit 180 transmits a signal for instructing execution of the identified application to the external device through the wireless communication unit 110 so that the identified application can be executed in the external device and interlocked (S180).

Meanwhile, in steps S150 and S180, the controller 180 displays an item indicating a specific application currently being executed in the first display area of the screen of the touch screen 151, and displays the related information in the second display area of the screen And displays an item indicating an application identified in step S150 in a third display area of the screen.

At this time, the controller 180 distinguishably displays at least one item corresponding to at least one application that can be interlocked with the specific application currently running in the portable terminal 100 among the items displayed in the second display area. That is, the user can report the item marked separately and know what can be interlocked with the specific application currently running in the portable terminal 100 among the applications of the external device.

If the item displayed in the third display area is selected in step S180, the controller 180 may transmit a signal for controlling the application corresponding to the selected item to the external device through the wireless communication unit 110 .

On the other hand, if it is determined in operation S130 that the specific application is not being executed, the controller 180 determines whether the applications of the external device and the applications installed in the memory At least one application capable of interlocking with each other can be identified and an item indicating the identified application can be displayed on the screen [S160].

At this time, the controller 180 displays a list of items of applications installed in the portable terminal 100 in the first display area of the screen, and displays the list of applications installed in the external device on the second display area of the screen, And display items of at least one application that can be interlocked with each other among the applications of the external device and the applications installed in the memory in the third display area of the screen.

When the item of the interlocking application is selected, the control unit 180 executes an application corresponding to the selected item among the applications installed in the memory 160 (S170). If the external device is an application installed in the external device A signal for instructing execution of the application corresponding to the selected item is transmitted to the external device through the wireless communication unit 110 so as to execute the application corresponding to the selected item among the items selected in step S180.

Hereinafter, the control process of the portable terminal 100 according to the present invention will be described in detail with reference to FIG. 5 to FIG.

5 shows a list screen 210 of external devices registered in the DLNA network when the portable terminal 100 is connected to the DLNA network.

That is, the portable terminal 180 receives related information of external devices (TV, Webcam, electromagnetic cooker) previously registered as a group of the portable terminal 100 from the DLNA network, The names of the external devices (211, 212, 213) and the list of items of the applications installed in the external devices are displayed on the list screen 210, respectively.

If at least one external device is selected in the list screen 210, the control unit 180 connects the selected external device through the wireless communication unit 110. [

6, when the TV is connected to the portable terminal 100 as the external device, the control unit 180 controls the operation of the portable terminal 100 and the user interface (UI) 220) on the screen.

6, the application interworking UI 220 includes a first area 221 for displaying an item of applications installed in the TV, a second area 221 for displaying an item of an application currently running in the portable terminal 100, A second area 222 in which an item of applications installed in the terminal 100 is displayed, and a third area 223 in which an item of an application that can be interlocked with the portable terminal 100 and applications of the TV is displayed.

 Here, as shown in FIGS. 7A and 7B, the first to third regions 221, 222, and 223 can be enlarged or reduced in size according to a user's touch gesture. For example, the area 221, 222, 223 can be enlarged or reduced according to a double-click or a pinch-out / pinch-in touch gesture.

In this case, as shown in FIG. 7B, when the specific area 223 is enlarged, the remaining two areas 221 and 222 are inversely reduced inversely. Conversely, when the specific area 223 is reduced, The remaining two areas 221 and 222 may be enlarged in inverse proportion thereto.

8, the control unit 180 determines whether or not an application that can be interlocked with the portable terminal 100 and applications installed in the TV, or an application that can be interlocked with the TV, based on the related information received from the TV, An item 231 of an application that can be interlocked with an application currently running in the portable terminal 100 among the installed applications can be displayed in the third area 223.

If an application that is not yet installed in the portable terminal 100 is searched from the application store or the web based on the related information, the control unit 180 displays the item 232 of the searched application Is displayed in the third area.

9, when the item 232 of the searched application is dragged and dropped into the second area 222 by the touch gesture of the user, the control unit 180 determines whether the item 232 corresponding to the item 232 The application is downloaded from the application store or the web and installed in the memory 160.

10, if the item 231 of the interlocking application is touched and an application corresponding to the item 231 is currently being executed in the portable terminal 100, And transmits a signal instructing execution of an application corresponding to the item 231 to an external device.

If the item 231 of the interlocking application is touched and the application corresponding to the item 231 is not currently being executed in the portable terminal 100, Executes an application, and transmits a signal instructing execution of an application corresponding to the item (231) to the external device.

11, when the interlocking application is executed in the portable terminal 100 and the TV, the control unit 180 determines whether the content currently stored in the portable terminal 100 100 and displays the contents executable by the application executed in the TV among the contents stored in the memory 160 in the second area 222 ).

In this case, when the content displayed in the first area 221 is dragged and dropped into the second area 222, the control unit 180 downloads the content from the TV through the wireless communication unit 110, (Or plays) the downloaded contents through an application currently running on the portable terminal 100. [

When the content displayed in the second area 222 is dragged and dropped into the first area 221, the controller 180 executes the content displayed in the second area 222 on the TV And transmits the content to the TV through the wireless communication unit 110 to execute the application through the application.

12 (a) and 12 (b), when the specific content among the contents displayed in the first area 221 is selected by the process of FIG. 11, The editing UI 240 for the user is displayed.

For example, the editing UI 240 may include at least one of a copy function 241, a delete function 242, and a sharing function 243. That is, when the copy function 241 is selected, the control unit 180 copies the specific content and pastes the specific content into the memory 160 or pastes the copied content to another external device communicable with the portable terminal 100 . Also, when the delete function 242 is selected, the control unit 180 transmits a signal to the TV instructing the TV to delete the specific content. When the sharing function 243 is selected, the control unit 180 displays a contact list for transmitting the specific content, and transmits a signal for instructing the external device to transmit the specific content to the contact selected in the contact list To the TV.

In addition, the controller 180 displays the edit UI 240 for editing the selected content when a specific content among the contents displayed in the second area 221 is selected in the process of FIG.

That is, when the copy function 241 is selected, the controller 180 copies the specific content and pastes the copied content to another external device connected to the portable terminal 100 in a communication manner. If the deletion function 242 is selected, the control unit 180 deletes the specific content from the portable terminal 100. If the sharing function 243 is selected, the control unit 180 displays a contact list to which the specific content is to be transmitted, and transmits the specific content to the contact selected in the contact list.

Next, referring to FIGS. 13A and 13B, when the specific content among the contents displayed in the first area 221 is selected by the process of FIG. 11, And displays an operation control UI 250 for control.

In one example, the operation control UI 250 may include at least one of a playback function 251, a stop function 252, a streaming function 253, and a capture function 254. That is, when the playback function 251 is selected, the control unit 180 transmits to the TV a signal instructing the TV to play the specific content through an application running on the TV. If the stop function 252 is selected while the TV is playing the specific content through the application running on the TV, the control unit 180 controls the TV to play the specific content To the TV. When the streaming function 253 is selected, the controller 180 reproduces the specific content through an application running on the TV and transmits the specific content to the portable terminal 100 in real time And outputs a playback image and sound of the specific content streamed in real time from the TV. In addition, when the capture function 254 is selected, the control unit 180 transmits a signal instructing the TV to capture a playback image of the specific content being played back through the application running on the TV.

In addition, the controller 180 displays the operation control UI 250 for controlling the operation of the selected content when the specific content is selected from among the contents displayed in the second area 221 according to the procedure of FIG.

That is, when the playback function 251 is selected, the controller 180 plays the specific content through the application currently running on the portable terminal 100. [ The control unit 180 stops playback of the specific content when the stop function 252 is selected during the playback of the specific content. When the streaming function 253 is selected, And real-time streaming video and sound of specific contents to the TV. Further, when the capture function 254 is selected, the control unit 180 captures a reproduced image of the specific content being reproduced.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
111: broadcast receiver 112: mobile communication module
113 wireless Internet module 114 short-range communication module
115: Position information module 120: A / V input section
121: camera 122: microphone
130: user input unit 140: sensing unit
141: proximity sensor 150: output section
151: Display unit 152: Acoustic output module
153: Alarm module 154: Haptic module
155: projector module 160: memory
170: interface unit 180: control unit
181: Multimedia module 190: Power supply

Claims (8)

touch screen;
A wireless communication unit for communicating with at least one external device installed with applications and performing communication with the external device;
Memory where applications are installed; And
Wherein when the specific application installed in the memory is executed, the control unit receives the related information of the applications installed in the external device from the external device through the wireless communication unit, And a control unit for receiving at least one application capable of interlocking with the external device and transmitting a signal for controlling execution of the identified application to the external device through the wireless communication unit. The method according to claim 1,
Wherein the identified application includes an application previously mapped with the specific application executed in the external device, an application having the same name as the executed specific application, an application providing the same function as the executed specific application, And at least one of applications that belong to the same category as the specific application executed. The method according to claim 1,
Wherein the control unit displays an item indicating the executed specific application in a first display area of the touch screen and displays an item indicating an application installed in the external device on the basis of the related information in a second display area of the touch screen And displays an item indicating the identified application in a third display area of the touch screen. The method of claim 3,
Wherein the control unit distinguishably displays at least one item corresponding to at least one application that can be interlocked with the executed specific application among the items displayed in the second display area. The method of claim 3,
Wherein the control unit transmits a signal for controlling execution of an application corresponding to the selected item to the external device through the wireless communication unit when the item displayed in the third display area is selected. The method according to claim 1,
Wherein the control unit recognizes at least one application that can be interlinked with each other among the applications of the external device and the memory based on the related information when the specific application is not executed, And displays an item representing the application on the touch screen. The method according to claim 6,
Wherein the control unit executes a corresponding application to the item when the item is selected and transmits a signal for controlling execution of the application corresponding to the item to the external device through the wireless communication unit . Connecting a communication with at least one external device in which applications are installed;
Receiving related information of applications installed in the external device from the external device;
Executing a specific application installed in the portable terminal;
Identifying at least one application among the applications of the external device that can be interlocked with the executed specific application based on the related information; And
And transmitting a signal for controlling execution of the identified application to the external device.

Images