KR20140128197A - Mobile terminal and method for controlling thereof - Google Patents

Abstract

The present invention relates to a mobile terminal and a controlling method thereof and, more specifically, to a mobile terminal capable of continuously performing the same function seamlessly by being synchronized with an external device and a controlling method thereof. The mobile terminal according to an embodiment of the present invention comprises: a wireless communication unit for establishing a data path to an external device and receiving application running information of the external device from the external device; a touch screen for displaying a lock screen corresponding to the application running information; and a control unit for running a first application, when the lock screen is unlocked to correspond to the first application among the application running information.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile terminal and a control method thereof, and more particularly, to a mobile terminal and its control method which can be synchronized with external devices and seamlessly perform the same functions.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

2. Description of the Related Art [0002] With the recent spread of smart mobile terminals, the same functions, that is, applications, can be driven through different mobile terminals. Accordingly, there is a need to satisfy a desire to continuously use the same application through other terminals while a user using a plurality of terminals drives a specific application on one terminal.

The present invention provides a mobile terminal capable of continuously executing an application executed in an external device and a control method thereof.

The present invention also provides a mobile terminal capable of executing an application that has been executed in an external device or an application in which the execution state remains unchanged when the application itself is not terminated, and a control method thereof.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A mobile terminal according to an embodiment of the present invention for realizing the above-mentioned object includes a wireless communication unit for establishing a data path with an external device and receiving application execution information of the external device from the external device; A touch screen for displaying a lock screen corresponding to the application execution information; And a control unit for executing the first application when the lock screen is released to correspond to the first application among the application execution information.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: establishing a data path with an external device; Receiving application execution information of the external device from the external device; Displaying a lock screen corresponding to the application execution information on a touch screen; And executing the first application when the lock screen is released to correspond to the first application among the application execution information.

According to the present invention, even when a device operated by a user is changed, a specific application executed in a previous device can be used in a continuously changed device.

In particular, the user can conveniently determine from the lock screen whether to execute an application that has been executed in an external device, or whether to execute the application while maintaining the execution state when the application itself is not terminated.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a flowchart showing an example of a process of continuously executing an application executed in an external device in a mobile terminal according to an embodiment of the present invention.
4A and 4B show an example of a mode in which a moving picture application in a state in which playback is stopped in an external device is driven through a mobile terminal.
5 shows an example of a method for successively executing an application that has been executed on an external device in a mobile terminal according to an embodiment of the present invention.
6 illustrates an example of a mobile terminal operation when there is an insufficient element for providing continuity in the mobile terminal according to an embodiment of the present invention.
7 shows an example of a method for receiving content from an external device in a mobile terminal according to an embodiment of the present invention.
FIG. 8 shows an example of a method of switching content that is streamed from an external device to download in a mobile terminal according to an embodiment of the present invention.
9 shows an example of a form in which a web browser application executed in an external device is driven through a mobile terminal.
FIG. 10 shows another example of a method for selecting an application to be continuously executed in a mobile terminal according to an embodiment of the present invention.
11 shows an example of a continuity of browsing order and a method of downloading content for offline page browsing in a mobile terminal according to an embodiment of the present invention.
FIG. 12 shows an example of a state in which a position displayed on an external device is maintained with respect to the entire web page in the mobile terminal according to an exemplary embodiment of the present invention.
13 shows an example of a method for continuously executing an application according to a command input from an external device in a mobile terminal according to another aspect of the embodiment of the present invention.
14 shows an example of a form in which a gallery application executed in an external device is driven through a mobile terminal.
15 illustrates an example of an image acquisition method for providing continuity in a mobile terminal according to an embodiment of the present invention.
16 shows an example of a method of providing continuity of an image viewing sequence in a mobile terminal according to an embodiment of the present invention.
17 shows an example of a method for transferring a control right from a mobile terminal to an external device according to another embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 located on the front, rear, or side of the mobile terminal 100, and a touch sensor (static / static) 137. Although not shown, ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor may be stacked on the display unit 151 to form a layer structure when the touch sensor has a form of a touch film, a touch sheet, a touch pad, or the like. ≪ / RTI >

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

A component such as a USIM card and a memory card, such as an auxiliary storage medium 165, which may be detached, may include an opening in the case so as to be inserted into the case from the outside. Slots may be formed on the side of the case so that the auxiliary storage medium 165 may be inserted from the side of the mobile terminal 100 and card slots 166 and 167 may be formed on the surface of the rear case 102 It is possible.

The cases 101, 102, and 103 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive commands such as activation / deactivation of the touch recognition mode of the display unit 151 and the like.

In addition to the display unit 151, the operation units 131, 132, and 133 may be provided with touch sensors, It is also possible to receive a command of the user by touch alone.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least one of the components shown in FIG. Also, an arrow or a finger-shaped graphic for pointing a specific object on the display unit 151 or selecting a menu on the display unit 151 is called a pointer or a cursor. However, in the case of a pointer, it often means a finger or a stylus pen for a touch operation or the like. Therefore, in this specification, a graphic displayed on the display unit is referred to as a cursor, and a physical means for performing a touch, a proximity touch, and a gesture, such as a finger or a stylus pen, is referred to as a pointer.

Provides continuity of applications on different devices

In an embodiment of the present invention, in a state where a mobile terminal and an external device are connected through a predetermined data path, operations performed in the application using the execution information of the application executed in the external device can be continuously performed in the mobile terminal We propose a method. Here, the execution of seamless work means that the progress of the work performed in one apparatus is directly transmitted to another apparatus. For example, when the user changes the operation device from the external device to the mobile terminal while the specific video is being reproduced for 1 minute and 10 seconds, the mobile terminal continuously reproduces the video from 1 minute and 11 seconds.

For convenience of explanation, it is assumed that the external device is a smart phone type and the mobile terminal is a tablet type. Of course, this is an exemplary case, in which the form of the external device and the mobile terminal may be opposite, or both may be in the form of a smartphone, or both in the form of a tablet.

3 is a flowchart showing an example of a process of continuously executing an application executed in an external device in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 3, a data path with an external device may be established (S310). The establishment of the data path can be implemented through various short-range communication methods such as Wi-Fi Direcrt, Digital Living Network Alliance (DLNA), and Bluetooth. Of course, this is an example and is not limited in any way as long as data can be exchanged according to a predetermined protocol between the external device and the mobile terminal 100. Establishment of the data path may be performed as the data path setup command is entered from the user via the mobile terminal or external device and may be performed under certain conditions (e.g., at a certain time or location, When the other one is detected in the device, etc.) may be satisfied.

When the data path is set, the mobile terminal can acquire application execution information from an external device through the set data path (S320). Here, the application execution information is information that is required to continuously execute, in the mobile terminal, applications that are being driven or driven by an external device such as application identification information indicating the type of application that has been recently executed or being executed in the external device, It can mean information. In addition, the use history may include a list of playback / browsing contents, a progress of the playback, a screen shot of the current execution video, and the like. Such application execution information is moved to an event based (for example, execution / termination of an application, change of a work status such as start / stop of content browsing in a running application, activation / deactivation of a touch screen of an external device and / May be acquired at the terminal, or may be acquired at regular intervals.

When the mobile terminal 100 is operated by the user, for example, when the user lifts the mobile terminal through the sensing unit 140 or operates the home key button, Can display a lock screen corresponding to the application execution information (S330). Here, the lock screen may mean a screen displayed in a state of restricting at least some functions (for example, entering a home screen) of the mobile terminal except a specific function provided by the lock screen until a specific type of command input have. The correspondence to the execution information may mean that information corresponding to the application execution information is displayed in a specific area on the lock screen. In addition, the information corresponding to the execution information of the application may include a screen shot of the last execution screen, a text describing the last execution state, a text / symbol / image representing the type of the recently executed application, and the like.

When the lock screen is displayed (S340), the controller 180 can execute the application (S350A) so that the application providing continuity can be specified, that is, the lock screen is released to correspond to the specific application (S340). At this time, the application may be displayed as it was last executed in the external device so as to provide continuity of work to the user. If the lock screen is released in a general manner without being corresponded to a specific application, the mobile terminal may display the home screen or the displayed image until the touch screen 151 is turned off (S350B).

Hereinafter, referring to the drawings, a specific form in which various applications executed in an external device are continuously executed in the mobile terminal will be described.

Provides continuity of video applications

First, the case of a moving image application will be described with reference to FIGS. 4A to 8. FIG. In the following drawings, it is assumed that the data path setting between the mobile terminal and the external device is completed.

4A and 4B show an example of a mode in which a moving picture application in a state in which playback is stopped in an external device is driven through a mobile terminal.

Referring to (a) of FIG. 4A, the external device 200 is temporarily stopped while moving picture contents are being played through a moving picture application.

At this time, when the user calls the lock screen by operating the mobile terminal 100 (for example, lifting the mobile terminal or operating a specific key button), a lock screen may be displayed as shown in FIG. 4A. An indicator 410 for releasing the lock screen state and application information 420 according to the application execution information are displayed on the lock screen. The method of releasing the lock screen state in the present invention assumes that the indicator 410 is dragged by a predetermined distance or more. More specifically, the application information 420 includes an icon 421 corresponding to the source device (external device) of the application, a screen shot of the final execution screen of the application last executed by the external device, An indicator 425 indicating the ratio of the reproduction time relative to the entire contents, and time information 427 indicating the reproduction stopped can be displayed. Through the application information 420, the user can acquire information on the type and execution state of the application that can be continuously executed.

In this state, when the user touches the indicator 410 to release the lock screen state, the user can drag the pointer to the area where the application information 420 is displayed and release the touch input have. Alternatively, as shown in FIG. 4B (b), the pointer can be dragged to the application indicator 430, which can be continuously displayed as the indicator 410 is touched, and then the touch input can be released. Accordingly, a moving picture application can be executed on the touch screen of the mobile terminal 100 as shown in (c) of FIG. At this time, in the mobile terminal, the moving picture application may be executed in the playback stop state as in the final state of the moving picture application in the external device, and the playback button 450 for resuming playback may be displayed at the center. At the top of the execution screen, content information 440 indicating the source device, the content name, the download availability, and the like may be displayed, and another selectable play time list 460 may be displayed at the bottom. In addition, when the touch input is detected on the indicator 410 for releasing the lock screen state, the controller 180 can change the shape of the touch input to display it (410 ').

If the touch-drag input started from the indicator for releasing the lock screen state is dragged and released on the area where the application information 420 is displayed or the area where the application indicator 430 is not displayed, The execution image displayed until entering the screen can be displayed.

4A and 4B, it is assumed that the moving picture application is suspended in the external device. If the lock screen of the mobile terminal is called when the corresponding content is being played back through the moving picture application in the external device and the lock screen is released through the method as shown in (b) of FIG. 4b, The playback of the content can be resumed. In this case, the play button 450 and the other selectable play time list 460 may not be displayed because the moving picture is already being played back.

Next, a description will be given of a case where the lock screen of the mobile terminal is called in a state where the moving picture application is terminated in the external device, with reference to FIG.

5 shows an example of a method for successively executing an application that has been executed on an external device in a mobile terminal according to an embodiment of the present invention.

When the execution of the moving image application is terminated on the external device, the application execution information acquired by the mobile terminal may include information on the application terminated after execution instead of the information on the application currently executed on the external device. Accordingly, when the lock screen of the mobile terminal is called, the application information 420 is not displayed in FIG. 5A, unlike FIG. 4A. Instead, when the indicator 410 for releasing the lock screen is touched, an icon 510 corresponding to the external device in which the data path is established as shown in FIG. 5B may be displayed on the lock screen.

5 (c), when the pointer is dragged to the icon 510, the controller 180 displays icons 521 to 527 corresponding to the recently executed applications in the external device, Can be displayed. Here, if the pointer is dragged to the icon 525 corresponding to the moving image application and the touch input is released, the control unit 180 can execute the moving image application.

However, the same application as the application executed in the external device may not be installed in the mobile terminal, or the content reproduced in the external device may not be stored in the memory 160 of the mobile terminal in advance. In this case, the operation of the mobile terminal will be described with reference to FIGS. 6 to 8. FIG.

6 illustrates an example of a mobile terminal operation when there is an insufficient element for providing continuity in the mobile terminal according to an embodiment of the present invention.

First, if the same application as the application executed in the external device is not installed in the mobile terminal, the control unit 180 may display a pop-up window 610 for confirming whether or not to install the application. For this, the control unit 180 can determine the type of application executed in the external device from the application execution information and search for a link capable of installing / downloading the same application.

In addition, the control unit 180 can acquire information about the content that has been reproduced through the application running on the external device through the application execution information. However, after the application is terminated by the external device, When executed, the list of contents stored in the external device may not be obtained. In this case, a pop-up window 620 for confirming whether or not to receive a content list from an external device for content synchronization may be displayed. It goes without saying that this procedure may be omitted if the application execution information includes a list of contents held in an external device that can be reproduced through the application.

Next, referring to FIG. 7, a method for acquiring the content itself after acquiring the content list from the external device will be described.

7 shows an example of a method for receiving content from an external device in a mobile terminal according to an embodiment of the present invention.

FIG. 7 assumes a situation where a moving image application is executed through the method shown in FIG. As the video application is executed, a list of videos that can be played back can be displayed as shown in Fig. 7 (a). Here, the thumbnails 710 of the moving images stored in the memory 160 of the mobile terminal can be displayed in a general thumbnail form. However, an indicator and a download button corresponding to the source device may be given to the thumbnails 720 corresponding to the contents that are not currently present in the memory 160 but are obtained through content synchronization from an external device. Here, if the download button of the second thumbnail among the thumbnails 720 corresponding to the content stored in the external device is selected, the controller 180 can request the external device to transfer the content. If the information on the details of the contents reproduced on the external device is received from the external device in response to the request, the control unit 180 determines whether to download the entire contents as shown in FIG. 7 (b) A pop-up window 730 for confirming whether the user wants to download only a portion after being reproduced in the pop-up window 730 can be displayed. Then, according to the user's selection, the corresponding content can be transmitted from the external device, and the controller 180 can display the download progress 740 on the thumbnail corresponding to the content, as shown in (c) of FIG. Of course, since the content is stored in the memory 160 of the mobile terminal when the transmission of the content is completed, the source device indicator and the download button may disappear from the corresponding thumbnail.

Meanwhile, as described with reference to FIG. 7, the content may be downloaded from the external device to the mobile terminal in a file format or transmitted in a streaming format. However, when the content is transmitted in a streaming format, the streaming may not be smooth according to the protocol constituting the data path. In this case, it is possible to switch to the download method. This will be described with reference to FIG.

FIG. 8 shows an example of a method of switching content that is streamed from an external device to download in a mobile terminal according to an embodiment of the present invention.

In the case of selecting one of the thumbnails 720 corresponding to the content obtained through content synchronization from the external device in the situation as shown in FIG. 7A, the control unit 180 determines whether the thumbnail 720 corresponding to the thumbnail selected from the external device The content can be played back through the streaming method. In this case, as shown in FIG. 8A, the content information 440 indicating the source device, the content name, the download availability, and the like may be displayed on the top of the execution image of the moving image application. Here, if the user wants to change from the streaming method to the downloading method, the download button 441 can be selected. Accordingly, the reproduction of the moving picture is suspended, and the download button 441 can be replaced with a progress bar 442 indicating the progress of the download as shown in (b) of FIG. When the download is completed, the control unit 180 can resume the playback using the content stored in the memory 160. In this case, the download button 441 may disappear from the top content information 440 as shown in FIG. 8 (c).

Meanwhile, although not shown, environment setting values (e.g., brightness, reproduction speed, subtitle language / position, etc.) of a moving image application set in an external device for providing a higher level of continuity are also displayed in a mobile terminal It can be applied as it is.

Provides continuity of web browser applications

Hereinafter, the case of a web browser application will be described with reference to Figs. 9 to 13. Fig.

9 shows an example of a form in which a web browser application executed in an external device is driven through a mobile terminal.

First, referring to FIG. 9 (a), a state in which a web page is displayed through a web browser application in the external device 200 is shown.

At this time, if the user calls the lock screen by operating the mobile terminal 100 (for example, lifting the mobile terminal or operating a specific key button), the lock screen may be displayed as shown in FIG. 9 (b). An indicator 410 for releasing the lock screen state is displayed on the lock screen in the background of a web page displayed on the external device. If the user drags the indicator 410 over a certain distance as shown in FIG. 9C, the lock screen is released and the web browser application can be executed. Finally, the web browser application is finally displayed on the external device through the executed web browser application The web page that was in can be displayed.

On the other hand, the application information is configured in a different form from that of FIG. 4A, and may replace the function of the indicator for releasing the lock screen state. This will be described with reference to FIG.

FIG. 10 shows another example of a method for selecting an application to be continuously executed in a mobile terminal according to an embodiment of the present invention. In FIG. 10, it is assumed that a data path for exchanging application execution information with an external device is set in the mobile terminal, and a lock screen of the mobile terminal is called while the web browser is being executed in the external device.

Referring to FIG. 10A, a portion 1010 of a web browser application execution screen image, which is executed in an external device, is displayed on the left edge of a general lock screen including an indicator for releasing the lock screen state. At this time, if the user drags a portion 1010 of the execution screen image over a certain distance in the center direction of the touch screen as shown in FIG. 10B, the control unit 180 determines that the lock screen is released to correspond to the web browser application And execute the web browser application so that the continuity is maintained according to the application execution information.

If the lock screen of the mobile terminal is called after the web browser application is executed in the external device, the lock screen as shown in FIG. 5 may be displayed. If the touch-drag input is an icon corresponding to the web browser application 527, the web browser application can be executed in the mobile terminal.

According to the present embodiment, in the case of the web browser application, the web page browsing order and the history information for offline browsing can be obtained through the application execution information or the user's selection according to the user's selection. This will be described with reference to FIG. 11

11 shows an example of a continuity of browsing order and a method of downloading content for offline page browsing in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 11 (a), since the web browser application is finally executed in the external device and information on the order of browsing the web page until the user performs the device conversion to the mobile terminal is provided as application execution information The "previous page" button 1111 of the web browser can be activated. If, for example, a web page -> b web page -> c web page is displayed, and then the web page is displayed again, immediately before the conversion from the external device to the mobile terminal, Quot; next page "button 1113) can also be activated. In addition, when the history button 1115 is selected, content included in the web page viewed by the external device may be selectively downloaded according to the elapsed time as shown in FIG. 11 (b). Specifically, the time range area 1130 is displayed at the bottom of the screen, and the contents included in the web page viewed by the user during the period selected in the time range area can be displayed in the contents list area 1120 on the left side. The user can individually download the content through the content list area or download all the contents corresponding to the selected period through the slider 1132 by selecting the download button 1133. [ The source device indicator 1131 may also be provided in the time range area 1130. In the case of FIG. 11, the source device may be represented by a smartphone icon so that the indicator corresponds to an external device. Using the downloaded contents as described above, the user can browse the previously viewed web page through the web browser application even when the user is offline without connecting to the Internet.

In order to provide a higher level of continuity, environment setting values of a web browser application set / input by an external device (for example, the position, magnification, brightness, login information, , Cookie information, etc.) can be directly applied when the web browser application is executed in the mobile terminal. A mode in which the external device displays the location of the external device in relation to the entire web page in the mobile terminal will be described with reference to FIG.

FIG. 12 shows an example of a state in which a position displayed on an external device is maintained with respect to the entire web page in the mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 12 (a), the scroll bar 1210 is moved downward as the external device 200 scrolls downward when browsing a specific web page through a web browser application. If the lock screen of the mobile terminal is released to correspond to the web browser application in this situation, a web browser application is executed on the touch screen as shown in (b) of FIG. 12, and a portion where a specific web page is displayed The same portion may be displayed, so that the scroll bar 1210 'may also be moved downward to correspond to the currently displayed portion.

In another aspect of the present embodiment, the application may be continuously executed in the mobile terminal immediately without a lock screen release process in response to a command input from the external device. This will be described with reference to FIG.

13 shows an example of a method for continuously executing an application according to a command input from an external device in a mobile terminal according to another aspect of the embodiment of the present invention.

Referring to FIG. 13 (a), while a web browser application is being executed in an external device, a user can touch two or more fingers simultaneously on the touch screen and then drag in one direction. Accordingly, as shown in FIG. 13 (b), the screen of the web browser application is reduced, and the animation in which the web page is transferred to the device to which the application continuity is to be provided, that is, the icon corresponding to the mobile terminal, can be displayed. In the mobile terminal, the web browser application is executed while the touch screen is turned on as shown in (c) of FIG. 13, so that the web page displayed on the external device can be automatically displayed.

Provides continuity of gallery applications

Hereinafter, the case of the gallery application will be described with reference to FIG. 14 to FIG.

14 shows an example of a form in which a gallery application executed in an external device is driven through a mobile terminal.

First, referring to FIG. 14 (a), a state in which a specific image is displayed through the gallery application in the external device 200 is shown.

At this time, when the user calls the lock screen by operating the mobile terminal 100 (for example, lifting the mobile terminal or operating a specific key button), a lock screen may be displayed as shown in FIG. 14 (b). An indicator 410 for releasing the lock screen state is displayed on the lock screen in the background of a specific image displayed on the external device. Here, when the user drags the indicator 410 over a certain distance, the lock screen is released and a text 1410 indicating that the gallery application is executed may be displayed at the top. When the Gallery application is launched, it can display the image that was last displayed on the external device.

Next, an image acquisition method will be described with reference to FIG. 15 illustrates an example of an image acquisition method for providing continuity in a mobile terminal according to an embodiment of the present invention.

When the gallery application is running on the external device, the process shown in FIG. 14 can be performed. In the case where the lock screen of the mobile terminal is called after the gallery application is being executed in the external device, The gallery application can be executed on the terminal.

At this time, when there is an image or album (for example, a plurality of images in a folder unit) identical to the image displayed last in the external device in the memory 160 of the mobile terminal, Can be displayed through the gallery application. However, if the image or the album including the image is not stored in the memory 160, a menu for fetching an image from an external device may be displayed as shown in FIG. 15 (b). Here, a menu 1510 for downloading only the album including a specific image and a menu 1520 for downloading the entire album stored in the external device may be included. However, since the downloaded image may not be used after the one-time drive to provide the continuity of the gallery application, if the download method is selected as shown in FIG. 15C, a period in which the album is stored in the memory 160 is selected The menus 1511 to 1515 may be displayed. Accordingly, when the thumbnail list is displayed through the gallery application as shown in (d) of FIG. 15, different indicators 1521 and 1523 may be assigned to the album / image thumbnail for each image storage period.

According to the present invention, information on the order in which images are browsed through the gallery application can also be acquired in the mobile terminal through the application execution information. This will be described with reference to FIG.

16 shows an example of a method of providing continuity of an image viewing sequence in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 16 (a), a gallery application is executed in an external device, and a plurality of images can be browsed sequentially in the left direction. Thereafter, when the gallery application is executed in the mobile terminal to provide continuity, the user can input the multi-touch-drag in one direction as shown in FIG. 16 (b). Accordingly, a thumbnail 1610 corresponding to each of the images viewed by the external device can be displayed at the bottom of the screen in browsing order as shown in FIG. 16 (c).

According to another aspect of this embodiment, the external device can transmit control to operate as a remote controller for the mobile terminal. This will be described with reference to FIG.

17 shows an example of a method for transferring a control right from a mobile terminal to an external device according to another embodiment of the present invention.

When the continuity of the gallery application executed in the external device through the mobile terminal is provided, the user can input the multi-touch-drag in one direction as shown in (a) of FIG. Accordingly, a menu 1710 for passing the control right to the external device is displayed as shown in FIG. 17 (b). When control transfer is selected through the menu 1710, the gallery application may be started while a message 1720 indicating that the control of the mobile terminal is acquired is displayed on the external device as shown in FIG. 17C. Then, the command inputted from the external application through the gallery application is performed on the mobile terminal as it is.

Meanwhile, it is apparent to those skilled in the art that the type of the lock screen for each application is exemplary and the type of the lock screen is not dependent on the application.

According to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described mobile terminal and its control method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified such that all or some of the embodiments are selectively And may be configured in combination.

Claims (15)

Establishing a data path with an external device;
Receiving application execution information of the external device from the external device;
Displaying a lock screen corresponding to the application execution information on a touch screen; And
And executing the first application when the lock screen is released to correspond to the first application among the application execution information. The method according to claim 1,
Wherein the step of displaying the lock screen comprises:
And displaying information corresponding to the first application on a first area of the lock screen.
A method of controlling a mobile terminal. 3. The method of claim 2,
Wherein the lock screen includes release means for releasing the lock screen,
When the lock screen is released to correspond to the first application among the application execution information,
And a touch-drag input started from the releasing means on the touch screen is released in the first area. 3. The method of claim 2,
The information corresponding to the first application may include:
Wherein the first application includes at least one of an execution image last executed in the external device, a name of the first application, and an indicator corresponding to an execution state of the first application. 3. The method of claim 2,
Wherein the step of displaying information corresponding to the first application in the first area of the lock screen is performed when the first application is not terminated in the external device. The method according to claim 1,
In a case where the first application is terminated in the external device
Wherein the step of displaying the lock screen comprises:
Displaying a first indicator corresponding to the external device in a first area of the lock screen; And
And displaying a second indicator corresponding to each of at least one application recently used in the external device, including the first application, in a second area of the lock screen when the first indicator is selected. A method of controlling a mobile terminal. The method according to claim 6,
Wherein the lock screen includes release means for releasing the lock screen,
When the lock screen is released to correspond to the first application among the application execution information,
Wherein the touch-drag input started from the releasing means on the touch screen is released on the second indicator corresponding to the first application via the first indicator. The method according to claim 1,
Searching the first application if the first application is not installed in the mobile terminal; And
And installing the first application. The method according to claim 1,
If the first application is a moving image application,
Further comprising the step of acquiring, from the external device, the moving picture content that has been played back by the external device in a streaming or downloading manner. The method according to claim 1,
If the first application is a web browser application,
And acquiring web page browsing history information stored in the external device. 11. The method of claim 10,
And activating at least one of a previous page movement function and a next page movement function according to the history information. The method according to claim 1,
If the first application is a gallery application,
And performing image content synchronization with the external device. 13. The method of claim 12,
Wherein the performing the content synchronization comprises:
Selecting an image content unit to be stored in the memory of the mobile terminal; And
Further comprising selecting a storage period of the selected image content unit. The method according to claim 1,
The application execution information includes:
Based on an event, or on a predetermined cycle. A wireless communication unit for establishing a data path with an external device and receiving application execution information of the external device from the external device;
A touch screen for displaying a lock screen corresponding to the application execution information; And
And a control unit for executing the first application when the lock screen is released to correspond to the first application among the application execution information.

Images