KR20150032068A - Method and device for executing a plurality of applications - Google Patents

Abstract

The present invention relates to a method for a device to execute multiple applications. Disclosed is a method to execute multiple applications, which includes a step of displaying an execution window of a first application on a screen; a step of receiving a request for the execution of a second application, which is different from the first application; a step of displaying an execution window of the second application, which is made smaller than the execution window of the first application, on the execution window of the first application based on the request for the execution; and a step of executing a predetermined function of the second application by using information provided from the first application.

Description

[0001] METHOD AND DEVICE FOR EXECUTING A PLURALITY OF APPLICATIONS [0002]

The present invention relates to a method for executing a plurality of applications and to a device therefor.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function.

Some mobile terminals include additional functions to execute games, and some other terminals are also implemented as multimedia devices. Moreover, as the development of smartphones accelerates, the development and use of various applications is increasing.

However, in order to provide a multi-window function in a mobile terminal, since the multi-window is provided by dividing the screen, only one or a small number of windows can be executed. That is, the practicality of the multi-window is hampered by the restriction of the screen size of the mobile terminal.

Therefore, there is a need to develop a system that can maximize the use of multi-windows in a mobile terminal.

An object of the present invention is to provide a plurality of application execution methods for connecting and executing a plurality of applications and a device therefor.

An object of the present invention is to provide a plurality of application execution methods and a device therefor, which improve the multi-window function by providing an execution window of a second application of a predetermined size movable on the execution window of the first application.

A plurality of application execution methods according to an embodiment of the present invention includes: displaying an execution window of a first application on a screen; Receiving an execution request for a second application different from the first application; Displaying an execution window of the second application on the execution window of the first application at a predetermined size smaller than the execution window of the first application based on the execution request; And executing the predetermined function of the second application using the information provided in the first application.

The step of receiving an execution request according to an embodiment of the present invention may include receiving a request to execute the second application at the predetermined size smaller than the execution window of the first application.

The step of receiving an execution request for a second application according to an embodiment of the present invention may include detecting a predetermined event occurrence corresponding to an execution request for the second application.

The predetermined event according to an exemplary embodiment of the present invention may include at least one of connection of an external device, reception of a notification message, connection request of an external device, and reception of a predetermined button selection input.

The information provided in the first application according to an embodiment of the present invention may include at least one of information displayed in the execution window of the first application and information transferred from the first application to the second application.

The plurality of application execution methods according to an embodiment of the present invention may further include the step of displaying the result information obtained by executing the predetermined function on the execution window of the second application.

Executing the predetermined function of the second application according to an embodiment of the present invention includes selecting at least one content displayed in the execution window of the first application based on the user input; And executing the predetermined function of the second application using the selected at least one content.

The step of executing a predetermined function of the second application according to an embodiment of the present invention includes: selecting at least one image displayed in an execution window of the first application based on a user input; And capturing the selected at least one image using the second application.

The step of executing a predetermined function of the second application according to an embodiment of the present invention includes: selecting a text displayed in an execution window of the first application based on a user input; And providing additional information for the selected text through a second application.

The step of selecting at least one content according to an embodiment of the present invention may include moving an execution window of the second application to a region in which at least one content is displayed based on a drag input of the user.

According to an embodiment of the present invention, there is provided a method for executing a plurality of applications, the method comprising: receiving a move request for an execution window of a second application; And moving the execution window of the second application on the execution window of the first application based on the move request.

According to an embodiment of the present invention, there is provided a method of executing a plurality of applications, including: sensing a user's touch on a screen; And moving the execution window of the second application to the position where the touch is detected on the screen.

According to an embodiment of the present invention, there is provided a method for executing a plurality of applications, the method comprising: receiving a voice of a user; And moving the execution window of the second application in the direction in which the voice was received.

A plurality of application execution methods according to an embodiment of the present invention includes receiving a size change request for an execution window of a second application displayed in a predetermined size; And resizing the execution window of the second application based on the resize request.

The plurality of application execution methods according to an embodiment of the present invention may further include adjusting the size of the execution window of the second application according to the size of the subject when the second application is a camera application.

The method of executing a plurality of applications according to an embodiment of the present invention may further include executing a predetermined function of the first application using information provided in the second application.

A device according to an embodiment of the present invention displays an execution window of a first application on a screen and displays an execution window of a second application on the basis of an execution request for a second application different from the first application, A display unit for displaying on the execution window of the first application a predetermined size smaller than the execution window; And

And a control unit for executing a predetermined function of the second application using the information provided in the first application.

The control unit of the device according to an embodiment of the present invention may receive a request to execute the second application at the predetermined size smaller than the execution window of the first application.

The controller of the device according to an embodiment of the present invention may detect occurrence of a predetermined event corresponding to an execution request for the second application.

The control unit of the device according to an embodiment of the present invention may control the display unit to display the result information obtained by executing the predetermined function on the execution window of the second application.

The control unit of the device according to an embodiment of the present invention may select at least one content displayed in the execution window of the first application based on the user input and use at least one selected content to display a predetermined function .

The control unit of the device according to an embodiment of the present invention can select at least one image displayed in the execution window of the first application based on the user input and capture the selected at least one image using the second application have.

The control unit of the device according to the embodiment of the present invention can select the text displayed in the execution window of the first application based on the user input and provide the additional information about the selected text through the second application.

The controller of the device according to an embodiment of the present invention may move the execution window of the second application to the area where at least one content is displayed based on the drag input of the user.

The control unit of the device according to the embodiment of the present invention can receive the move request for the execution window of the second application and move the execution window of the second application on the execution window of the first application based on the move request have.

The controller of the device according to an embodiment of the present invention can detect the user's touch on the screen and move the execution window of the second application to the position where the touch is detected on the screen.

The control unit of the device according to an embodiment of the present invention may further include a step of receiving the user's voice and moving the execution window of the second application in the direction in which the voice was received.

The controller of the device according to an embodiment of the present invention may receive a size change request for the execution window of the second application displayed in the predetermined size and change the size of the execution window of the second application based on the size change request .

The controller of the device according to an embodiment of the present invention can adjust the size of the execution window of the second application according to the size of the subject when the second application is a camera application.

The control unit of the device according to the embodiment of the present invention can execute a predetermined function of the first application using the information provided in the second application.

1 is a diagram for explaining a multi-window function according to an embodiment of the present invention.
2 is a flowchart illustrating a method of executing a plurality of applications according to an embodiment of the present invention.
3 is a diagram illustrating an example of displaying an execution window of a second application on the execution window of the first application in the form of a floating window according to an embodiment of the present invention.
4 is a diagram illustrating an example in which a device according to an embodiment of the present invention displays a floating window corresponding to an external device connection.
5 is a diagram for explaining an example in which a device according to an embodiment of the present invention displays a floating window corresponding to a connection request of an external device.
6 is a diagram for explaining the movement of an execution window of a second application according to an embodiment of the present invention.
7 is a diagram illustrating an example in which an execution window of a second application is moved according to a touch position according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating an example in which an execution window of a second application is moved according to a voice receiving direction according to an embodiment of the present invention.
9 is a view for explaining an example of displaying a plurality of floating windows according to an embodiment of the present invention.
10 is a diagram showing an example in which the execution window of the second application is enlarged according to an embodiment of the present invention.
11 is a diagram illustrating an example in which the size of an execution window of a second application is adjusted according to the size of a subject according to an embodiment of the present invention.
12 is a flowchart illustrating a method of executing a predetermined function of a second application using content displayed in an execution window of a first application according to an embodiment of the present invention.
13 is a diagram illustrating an example of capturing an image displayed on a device using a second application according to an embodiment of the present invention.
FIG. 14 is a flowchart illustrating a method of displaying result information of a second application executing a predetermined function on an execution window of a second application according to an embodiment of the present invention. Referring to FIG.
15 is a diagram showing an example in which an execution window of a dictionary application according to an embodiment of the present invention is displayed as a floating window of a predetermined size.
FIG. 16 is a diagram illustrating an example in which an execution window of a translation application according to an embodiment of the present invention is displayed as a floating window of a predetermined size.
FIG. 17 is a diagram illustrating an example in which an execution window of a data transfer application is displayed as a floating window of a predetermined size according to an embodiment of the present invention. FIG.
18 is a flowchart illustrating a method of linking a first application and a second application according to an embodiment of the present invention.
19 is a diagram illustrating an example in which a messenger application and a map application are linked with each other according to an embodiment of the present invention.
20 is a flowchart illustrating a method of executing a predetermined function of a first application using information provided in a second application according to an embodiment of the present invention.
21 and 22 are views for explaining an example in which two-dimensional barcode information obtained through a camera application is displayed through a web browser.
23 is a flowchart illustrating a method for changing an application displayed as a floating window according to an embodiment of the present invention.
24 is a diagram showing an example of providing an application list according to an embodiment of the present invention.
25 and 26 are block diagrams for explaining the configuration of a device according to an embodiment of the present invention.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Throughout the specification, " application " refers to a set of computer programs designed to perform a particular task. The applications described herein may vary. For example, an application may include a web browser, a camera application, a dictionary application, a translation application, a data transfer application, a music playback application, a video playback application, a message application, a social communicator application, a social media application, , A game application, a motion support application, a payment application, a memo application, a calendar application, a phone book application, and the like.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

1 is a diagram for explaining a multi-window function according to an embodiment of the present invention.

According to one embodiment of the present invention, the device 100 may provide a multi-window function. Here, the multi-window function may mean a function of a user interface that displays a plurality of task windows (e.g., an application execution window) on one screen.

For example, the device 100 may execute a first application and a second application. Then, the device 100 can display the execution window 10 of the first application and the execution window 20 of the second application together on the screen.

According to an embodiment of the present invention, the device 100 may display the sizes of the execution window 10 of the first application and the execution window 20 of the second application differently. For example, the device 100 displays the execution window 10 of the first application on the entire screen, and the execution window 20 of the second application is displayed in a smaller size than the execution window 10 of the first application can do.

Also, the device 100 may display the execution window 20 of the second application, which is smaller than the execution window 10 of the first application, in the form of a floating window. A floating window can refer to a floating user interface (UI) object that can be moved according to user input. For example, the device 100 may move and display the execution window 20 of the second application on the execution window 10 of the first application, based on the user input. Hereinafter, for convenience of explanation, a movable window that is displayed in a smaller size than the full screen and is movable is referred to as a floating window.

According to one embodiment of the present invention, the device 100 may receive a touch input. Throughout the specification, "touch input" means a gesture or the like that the user makes on the touch screen to control the device 100. [ For example, the touch input described herein may include a tap, a touch & hold, a double tap, a drag, a panning, a flick, a drag and drop,

The "tap" indicates an operation in which the user immediately touches the screen using a finger or a touch tool (e.g., an electronic pen) and immediately lifts it from the screen without moving.

"Touch & hold" represents an operation for the user to touch the screen using a finger or a touch tool (e.g., an electronic pen) and then maintain the touch input for a critical time (e.g., 2 seconds) or more. For example, the time difference between the touch-in and touch-out times is equal to or greater than a threshold time (e.g., 2 seconds). In order to allow the user to recognize whether the touch input is a tap or a touch & hold, the feedback signal may be provided visually, audibly or tactually when the touch input is maintained for a predetermined time or more. The threshold time may vary depending on the implementation.

"Double tap" indicates an operation in which the user touches the screen twice with a finger or a stylus.

"Drag" means an operation of moving a finger or a touch tool to another position in the screen while the user holds the touch after touching the finger or the touch tool on the screen. The object is moved due to the drag operation or a panning operation to be described later is performed.

"Panning" indicates a case where a user performs a drag operation without selecting an object. Since panning does not select a specific object, the object is not moved within the page, but the page itself moves within the screen, or the group of objects moves within the page.

A "flick" represents an operation in which a user drags a finger or touch tool to a critical velocity (e.g., 100 pixel / s) or more. It is possible to distinguish the drag (or panning) from the flick based on whether the moving speed of the finger or the touch tool is equal to or greater than a critical speed (for example, 100 pixel / s).

"Drag & drop" means an operation in which a user drags an object to a predetermined position on the screen using a finger or a touch tool, and then releases the object.

A " pinch " represents an operation in which a user moves two fingers in different directions while touching the screen. It is a gesture for pinch opening or pinch closing of an object or a page, and a magnification value or a reduction value is determined according to the distance between two fingers.

A "swipe" is an operation of moving a certain distance in the horizontal or vertical direction while touching an object on the screen with a finger or a touch tool. Motion in the diagonal direction may not be recognized as a swipe event.

According to an embodiment of the present invention, the first application and the second application can be controlled by the same input method. For example, both the first application and the second application may be controlled by a touch input.

According to another embodiment of the present invention, the first application and the second application may be controlled by different input methods. For example, the first application may be controlled by a touch input, and the second application may be controlled by a voice input. Further, the first application may be controlled by a touch input, and the second application may be controlled by an eye input. The eyeball input is an input for controlling the device 100 by the user to control the blinking of the eye, the gazing position, the moving speed of the eyeball, and the like.

Meanwhile, according to an embodiment of the present invention, the device 100 may be implemented in various forms. For example, the device 100 described herein may be a mobile phone, a smart phone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcast terminal, a personal digital assistant (PDA) Portable multimedia players), navigation, smart TVs, CE (Consumer Electronics) devices (e.g., refrigerators with display panels, air conditioners, etc.), but are not limited thereto

Hereinafter, a method of executing a plurality of applications by the device 100 according to an embodiment of the present invention will be described in detail with reference to FIG.

2 is a flowchart illustrating a method of executing a plurality of applications according to an embodiment of the present invention.

In step S210, the device 100 can display an execution window of the first application on the screen.

For example, the device 100 may execute a first application based on a user request and display an execution window of the first application on the screen. At this time, according to an embodiment of the present invention, the device 100 may display the execution window of the first application on the full screen in full size.

According to an embodiment of the present invention, the type of the first application may be various. For example, the first application may include, but is not limited to, a web browser, a messenger application, a navigation application, a photo folder application, and the like.

In step S220, the device 100 may receive an execution request for a second application different from the first application. For example, the device 100 may detect occurrence of a predetermined event corresponding to an execution request for the second application. According to an embodiment of the present invention, the preset event may include at least one of receiving a button selection input, connecting an external device, receiving a notification message, and requesting connection of an external device, but the present invention is not limited thereto.

According to one embodiment of the present invention, the user may select a particular button included in the device 100 to request execution for the second application. At this time, the specific button may be a physical button or a virtual button in GUI (Graphical User Interface) form. For example, the user may request the device 100 to execute the second application by touching the icon corresponding to the second application.

In addition, the user may connect an external device to the device 100 to request execution for the second application. At this time, the external device may be wired to the device 100 or may be connected wirelessly. The external device according to an embodiment of the present invention may include an earphone, a charger, an electronic pen, a TV, and the like, but is not limited thereto.

According to an embodiment of the present invention, the device 100 may determine that an execution request for a second application has been received when a notification message is received or a communication connection request is received from an external device.

According to one embodiment of the present invention, the device 100 may receive a request to execute the second application at a predetermined size smaller than the execution window of the first application. For example, the user may enter into the device 100 a request to execute the execution window of the second application in the form of a floating window.

In step S230, the device 100 can display the execution window of the second application on the execution window of the first application at a predetermined size smaller than the execution window of the first application, based on the execution request for the second application .

According to one embodiment of the present invention, the size or shape of the execution window of the second application may be predetermined by the user of the device 100. The size or shape of the execution window of the second application may be determined in advance at the time of creating or distributing the second application according to the type of the second application. Meanwhile, according to one embodiment of the present invention, the device 100 may adjust the size or shape of the execution window of the second application according to user input.

According to one embodiment of the present invention, the device 100 may display the execution window of the second application in the form of a floating window. That is, the execution window of the second application can be moved on the execution window of the first application. For example, the device 100 can move the execution window of the second application according to the drag input of the user. In addition, the device 100 may move the execution window of the second application to a location where a user's touch is sensed or a location where a voice is received.

According to an embodiment of the present invention, when the second application is executed, the execution window of the second application is displayed at a predetermined size smaller than the execution window of the first application, so that the device 100 displays the execution window of the first application, The application's execution window can be displayed at the same time.

In addition, according to the embodiment of the present invention, since the execution window of the second application is displayed on the execution window of the first application with a predetermined size, the device 100 determines the size of the execution window of the first application .

According to an embodiment of the present invention, since the execution window of the first application is different from the execution window of the second application, the user can use the first application as the main application and the second application as the sub application .

In step S240, the device 100 can execute a predetermined function of the second application using the information provided in the first application.

According to an embodiment of the present invention, the information provided in the first application may include at least one of information displayed in the execution window of the first application and information transferred from the first application to the second application.

The information displayed on the execution window of the first application may include, but is not limited to, still images (e.g., photographs, pictures, etc.), moving pictures, texts, In addition, the information transmitted from the first application to the second application may include location information of the external device, execution result information of the first application, status information of the external device, communication connection information with the external device, It is not.

According to one embodiment of the present invention, the predetermined function of the second application may be various. For example, the predetermined function of the second application may include a data transfer function, a translation function, a dictionary function, a capture function, and the like, but is not limited thereto.

According to one embodiment of the present invention, the device 100 may execute the second application in cooperation with the first application, rather than separately from the first application. For example, the second application may capture a specific image displayed in an execution window of the first application. In addition, the second application may provide additional information (e.g., translation, dictionary meaning, etc.) for the specific text displayed in the execution window of the first application. This will be described later in more detail with reference to FIG.

The order of steps S210 to S240 may be changed according to the embodiment of the present invention, and some steps may be omitted. Hereinafter, an embodiment in which the device 100 controls the execution window of the second application will be described in detail.

3 is a diagram illustrating an example of displaying an execution window of a second application on the execution window of the first application in the form of a floating window according to an embodiment of the present invention. In FIG. 3, the case where the first application is a web browser and the second application is a music reproduction application will be described as an example.

3 (a), according to an embodiment of the present invention, the device 100 executes a first application (e.g., a web browser), and displays an execution window 310 of the first application as a full screen Can be displayed. In addition, the device 100 may execute a second application (e.g., a music playback application) and display an execution window 320 of a second application (e.g., a music playback application) on the full screen in response to a user request . In this case, since the execution window 320 of the second application is displayed on the execution window 310 of the first application, the execution window 310 of the first application that was executed earlier than the second application (e.g., the music reproduction application) ) May no longer be visible.

At this time, the device 100 may receive a user input to display the execution window 320 of the second application displayed as a full screen in the form of a floating window. For example, the device 100 may receive user input to drag and select a region on the execution window 320 of the second application.

As shown in FIG. 3 (b), the device 100 converts the execution window 320 of the second application, which has been displayed as a full screen, into a small-sized floating window form according to the user's drag input, can do. At this time, the device 100 can display the execution window 320 of the second application with a size corresponding to the selected area selected by the user. For example, if the user drags and draws a circle having a radius of 2 cm on the execution window 320 of the second application, the device 100 displays the execution window 320 of the second application in a circular shape having a radius of 2 cm can do.

On the other hand, since the size of the execution window 320 of the second application is smaller than the size of the execution window 310 of the first application, the execution window 310 of the first application previously displayed on the entire screen can be displayed. That is, according to one embodiment of the present invention, the device 100 can display the execution window 320 of the second application together with the small size on the execution window 310 of the first application of the full size.

In addition, according to an embodiment of the present invention, the execution window 320 of the second application is provided in a floating window form, and thus can be freely moved on the execution window 310 of the first application. This will be described later in detail with reference to FIG.

According to an embodiment of the present invention, the device 100 may display a GUI corresponding to the size of the execution window 320 of the second application on the execution window 320 of the second application. For example, when the execution window 320 of the second application is displayed on the full screen, the device 100 displays the album image, the artist information, the recycle time, the reproduction control button (for example, And the execution window 320 of the second application is displayed as a floating window of a small size, the execution window 320 of the second application 320 ), You can display only the album image and the pause button.

4 is a diagram illustrating an example in which a device according to an embodiment of the present invention displays a floating window corresponding to an external device connection. In FIG. 4, the case where the first application is a web browser and the second application is a music reproduction application will be described as an example.

As shown in FIG. 4 (a), according to an embodiment of the present invention, the device 100 may detect occurrence of a predetermined event corresponding to an execution request for a second application. For example, the device 100 can detect the connection of the earphone 400 while executing the first application and displaying the execution window 410 of the first application.

As shown in FIG. 4 (b), when the connection of the earphone 400 is detected, the device 100 may execute a second application corresponding to the connection detection of the earphone 400. For example, the device 100 may execute a music playback application. The device 100 may then display the execution window 420 of the music playback application as a floating window.

4, the earphone 400 is connected to the device 100. However, the present invention is not limited thereto. For example, when a charger is connected to the device 100, the device 100 may automatically execute a speech recognition application. Then, the device 100 can display the execution window of the voice recognition application as a floating window. At this time, the user can control the device 100 being charged through voice recognition application.

According to another embodiment, when a TV is connected to the device 100, the device 100 can execute a remote control application that can detect the TV connection and remotely control the TV. At this time, the device 100 can display the execution window of the remote control application as a floating window.

5 is a diagram for explaining an example in which a device according to an embodiment of the present invention displays a floating window corresponding to a connection request of an external device. 5, the first application is a web browser and the second application is a phone call application.

As shown in FIG. 5 (a), the device 100 may display an execution window (e.g., a web page) 510 of the first application on the full screen. At this time, the device 100 may receive a phone call connection request from a friend's device (e.g., sarah's phone).

As shown in FIG. 5 (b), the device 100 may execute a telephone call application based on a telephone call connection request. The device 100 may then display the execution window 520 of the phone call application as a floating window. At this time, information (for example, a partner image, a partner phone number, a partner name, and the like) of the partner requesting the phone call connection may be displayed in the execution window 520 of the phone call application. In addition, the user can move the execution window 520 of the telephone call application up and down to receive a call or block a telephone connection.

Thus, according to one embodiment of the present invention, even if the device 100 receives a telephone connection request from the outside while displaying the web page 510, the device 100 can display the telephone call application in the form of a small- The execution window 520 can be displayed on the web page 510, thereby minimizing interference with the user's use of the web page 510.

6 is a diagram for explaining the movement of an execution window of a second application according to an embodiment of the present invention.

As shown in FIG. 6 (a), the device 100 can display the execution window 620 of the second application on the upper left of the screen. At this time, the device 100 may receive a move request for the execution window 620 of the second application. For example, the user can input a user input that is dragged while touching the execution window 620 of the second application.

As shown in FIG. 6 (b), the device 100, based on the movement request for the execution window 620 of the second application, displays the execution window 620 of the second application as an execution window Lt; RTI ID = 0.0 > 610 < / RTI > For example, the device 100 may move the execution window 620 of the second application displayed on the upper left side to the lower left side based on the user's touch and drag input.

According to one embodiment of the present invention, the user may freely move the execution window 620 of the second application in the form of a floating window. 6 illustrates an example in which the execution window of the second application is moved based on the touch input of the user, but the present invention is not limited thereto. For example, the execution window 620 of the second application may be moved based on the user's voice input, motion input, bending input, or key input.

7 is a diagram illustrating an example in which an execution window of a second application is moved according to a touch position according to an embodiment of the present invention. In FIG. 7, the first application is a moving picture playback application and the second application is a phone call application.

As shown in Fig. 7 (a), the device 100 can display an execution window (e.g., moving image playback) 710 of the first application on the entire screen. In addition, the device 100 may receive a telephone call connection request from an external device while reproducing a predetermined moving picture through the first application. At this time, the device 100 may display the execution window 720 of the telephone call application in the form of floating window on the execution window 710 of the first application.

As shown in FIG. 7 (b), the device 100 can sense a user's touch on the screen. In this case, the device 100 can move the execution window 720 of the second application to the position where the touch is detected. For example, when the user touches the upper right corner of the screen with the thumb, the device 100 can display the execution window 720 of the second application displayed on the lower left side of the screen by moving it to the upper right corner of the screen .

According to an embodiment of the present invention, the device 100 can move the floating window to a position where the user's touch is sensed, so that the user can easily manipulate the floating window without changing the touch position.

FIG. 8 is a diagram illustrating an example in which an execution window of a second application is moved according to a voice receiving direction according to an embodiment of the present invention. In FIG. 8, the case where the first application is a navigation application and the second application is a voice recognition application will be described as an example.

8, the device 100 displays the execution window 810 of the navigation application on the full screen, and the execution window 820 of the voice recognition application is displayed in the execution window 810 of the navigation application in the form of a floating window, Above.

At this time, according to the embodiment of the present invention, the device 100 can receive the voice of the user through the microphone. Then, the device 100 can display the execution window 820 of the voice recognition application in the direction in which the voice was received.

For example, when a user inputs a voice in the upper direction of the device 100, the device 100 can move the execution window 820 of the voice recognition application to the top of the screen and display it. In this case, the user can intuitively grasp the position where the voice is input to the device 100 by confirming the position of the execution window 820 of the voice recognition application.

According to one embodiment of the present invention, the speech recognition application may analyze the speech input from the user and deliver the analyzed speech information to the navigation application.

9 is a view for explaining an example of displaying a plurality of floating windows according to an embodiment of the present invention.

9, the device 100 displays the execution window 910 of the web browser on the full screen and displays the execution window 920 of the music playback application in the form of a floating window on the execution window 910 of the web browser, Can be displayed.

Also, according to one embodiment of the present invention, the device 100 may receive a telephone call connection request from an external device. At this time, the device 100 can display the execution window 930 of the telephone call application on the execution window 910 of the web browser in the form of a floating window.

According to one embodiment of the present invention, the user can control each of the plurality of floating windows displayed on the screen of the device 100. [ For example, the user can change the playback content or adjust the playback speed through the left and right swipe input to the execution window 920 of the music playback application. Further, the user may stop music playback by touching the execution window 920 of the music playback application for a predetermined time (e.g., 2 seconds) or a predetermined number of times (e.g., twice).

In addition, according to an embodiment of the present invention, the user can allow or block the telephone call connection through the up / down swipe input to the execution window 930 of the telephone call application. For example, if the user swipes the launch window 930 of the phone call application upwards, the device 100 can make a phone call connection with the external device. In addition, when the user swipes the execution window 930 of the telephone call application downward, the device 100 can transmit a rejection message for the telephone call connection request of the external device to the external device.

10 is a diagram showing an example in which the execution window of the second application is enlarged according to an embodiment of the present invention.

As shown in Fig. 10, the device 100 may change the size of the execution window of the second application according to user input. In this case, the device 100 can display a GUI (Graphical User Interface) corresponding to the size of the execution window of the second application on the execution window of the second application.

For example, the device 100 may receive a user input (e.g., a double tap) that selects an execution window 1020 of a circular music application. In this case, the device 100 may enlarge the execution window 1020 of the circular music application and display the enlarged window 1021 on the execution window 1010 of the first application. According to an embodiment of the present invention, the device 100 may provide a control panel including more control buttons than the execution window 1020 of the circular music application through the enlarged window 1021. According to one embodiment of the present invention, the enlarged window 1021 may also be moved according to the user's input.

Meanwhile, according to an embodiment of the present invention, the device 100 may display the enlarged window 1021 again in the execution window 1020 of the circular music application based on the user input.

11 is a diagram illustrating an example in which the size of an execution window of a second application is adjusted according to the size of a subject according to an embodiment of the present invention.

As shown in Fig. 11 (a), the device 100 can execute a camera application and display an execution window 1100 of the camera application in the form of a floating window of a predetermined size. At this time, only a part of the image of the subject (for example, a two-dimensional bar code image) may be displayed through the execution window 1100 of the camera application of a predetermined size.

As shown in FIG. 11 (b), the device 100 can adjust the size of the execution window 1100 of the camera application according to the size of the subject image. For example, the device 100 may magnify the launch window 1100 of the camera application such that the entire image of the subject (e.g., a two-dimensional bar code image) is displayed through the launch window 1100 of the camera application.

12 is a flowchart illustrating a method of executing a predetermined function of a second application using content displayed in an execution window of a first application according to an embodiment of the present invention.

In step S1210, the device 100 can display the execution window of the second application on the execution window of the first application with a predetermined size. For example, the device 100 may display the execution window of the second application in the form of a movable window of small size. Since step S1210 corresponds to step S230 of FIG. 2, a detailed description will be omitted.

In step S1220, the device 100 can select at least one content displayed in the execution window of the first application, based on the user input.

Throughout the specification, 'content' may refer to digital information provided through a wired or wireless communication network. The content according to an exemplary embodiment of the present invention may include video content (e.g., a TV program video, a video on demand (VOD), a user-created content (UCC), a music video, a YouTube video, (E.g., pictures, pictures, etc.), text content (e.g., electronic books (poetry, novels), letters, work files), music content But is not limited thereto.

According to one embodiment of the present invention, the device 100 can move the execution window of the second application to the area where at least one content is displayed on the execution window of the first application, based on the drag input of the user. The device 100 may then select at least one content displayed in an area where the execution window of the second application is located.

In step S1230, the device 100 may execute a predetermined function of the second application using at least one content displayed in the execution window of the first application. According to an embodiment of the present invention, a predetermined function of the second application may include at least one of a data transfer function, a translation function, a dictionary function, and a capture function, but is not limited thereto. Referring to FIG. 13, a detailed description will be given.

13 is a diagram illustrating an example of capturing an image displayed on a device using a second application according to an embodiment of the present invention. In FIG. 13, the case where the first application is a web browser and the second application is a camera application will be described as an example.

As shown in Fig. 13 (a), the device 100 can execute a web browser and display an execution window 1310 of the web browser on the entire screen. At this time, the execution window 1310 of the web browser may include at least one image.

According to an embodiment of the present invention, the device 100 may execute a camera application and display an execution window 1320 of the camera application on the execution window 1310 of the web browser. At this time, the device 100 may display the execution window 1320 of the camera application in a movable mini-size floating window form.

According to an embodiment of the present invention, the user can move the execution window 1320 of the camera application and place it on the first image 1311 included in the execution window 1310 of the web browser. At this time, the device 100 can select the first image 1311 in which the execution window 1320 of the camera application is located.

According to one embodiment of the present invention, when the user selects the capture button in the execution window 1320 of the camera application, the device 100 can capture the first image 1311 using the capture function of the camera application have.

As shown in FIG. 13 (b), the user may move the execution window 1320 of the camera application over the second image 1311. In this case, when the user selects the capture button in the execution window 1320 of the camera application, the device 100 can capture the second image 1311 using the capture function of the camera application.

As shown in Figure 13 (c), according to one embodiment of the present invention, the device 100 may store the captured first image 1311 and the second image 1312 in an image folder. Thus, according to one embodiment of the present invention, the device 100 may capture some images displayed on the screen and provide some of the captured images to the user.

FIG. 14 is a flowchart illustrating a method of displaying result information of a second application executing a predetermined function on an execution window of a second application according to an embodiment of the present invention. Referring to FIG.

In step S1410, the device 100 can display the execution window of the second application on the execution window of the first application with a predetermined size.

In step S1420, the device 100 can select at least one content displayed in the execution window of the first application based on the user input.

In step S1430, the device 100 can execute a predetermined function of the second application using at least one content displayed in the execution window of the first application. Since steps S1410 to S1430 correspond to steps S1210 to S1230 in Fig. 12, detailed description thereof will be omitted.

In step S1440, the device 100 can display the result information obtained by executing the predetermined function of the second application on the execution window of the second application. According to an embodiment of the present invention, the result information obtained by executing the predetermined function of the second application may include captured image information, translated text information, retrieved word semantic information, information on the number of contents transmitted to the outside, But is not limited thereto. 15 and 16, a more detailed description will be given.

15 is a diagram showing an example in which an execution window of a dictionary application according to an embodiment of the present invention is displayed as a floating window of a predetermined size. In Fig. 15, the case where the first application is a newspaper application and the second application is a pre-application will be described as an example.

As shown in Fig. 15 (a), the device 100 can execute a newspaper application and display an execution window 1510 of the newspaper application on the entire screen. At this time, the device 100 can display the news content in the execution window 1510 of the newspaper application. In addition, the device 100 may display the execution window 1520 of the dictionary application on the execution window 1510 of the newspaper application in the form of a floating window of a predetermined size.

At this time, the user can move the execution window 1520 of the dictionary application and place it on a specific word (e.g., threaten) included in the news content. The user can touch the execution window 1520 of the dictionary application for more than a predetermined time (for example, three seconds) or a predetermined number of times (for example, twice). In this case, the device 100 may use the dictionary application to retrieve the meaning of a particular word (e.g., threaten) selected by the user.

15B, the device 100 enlarges the execution window 1520 of the dictionary application and displays the meaning of a specific word (e.g., threaten) on the execution window 1520 of the enlarged dictionary application (e.g., , [VERB] If a person threatens to do something unpleasant to you, or if they threaten you, they say or imply that they will do something unpleasant to you, especially if you do not do what they want.

In the example shown in FIG. 15, the user moves the floating window to select a specific word. However, the present invention is not limited thereto. For example, if the device 100 supports multiple input methods, the user may select a specific word (e.g., threaten) from the launch window 1510 of the newspaper application via a touch input (e.g., dragging a region in which a particular word is displayed) And may control the dictionary application to search for a specific word (e.g., threaten) through voice input.

FIG. 16 is a diagram illustrating an example in which an execution window of a translation application according to an embodiment of the present invention is displayed as a floating window of a predetermined size. In FIG. 16, the case where the first application is a newspaper application and the second application is a translation application will be described as an example.

As shown in Fig. 16 (a), the device 100 can execute a newspaper application and display an execution window 1610 of the newspaper application on the entire screen. At this time, the device 100 can display the news content in the execution window 1610 of the newspaper application. In addition, the device 100 may display the execution window 1620 of the translation application on the execution window 1610 of the newspaper application in the form of a floating window of a predetermined size.

At this time, the user may move the execution window 1620 of the translation application and place it on the desired news content to be translated. If the size of the news content desired to be translated is larger than the size of the execution window 1620 of the translation application, the user can enlarge the execution window 1620 of the translation application through touch input (e.g., pinch input).

As shown in FIG. 16 (b), the device 100 may display a translation of the news content located under the execution window 1520 of the translation application on the execution window 1620 of the translation application. For example, the device 100 can translate the English news script selected by the user into Korean by using the translation function of the translation application. The device 100 may then display the translation translated into Korean on the execution window 1620 of the translation application.

FIG. 17 is a diagram illustrating an example in which an execution window of a data transfer application is displayed as a floating window of a predetermined size according to an embodiment of the present invention. FIG. In FIG. 17, the case where the first application is a photo folder application and the second application is a data transfer application will be described as an example.

As shown in FIG. 17 (a), the device 100 may display an execution window 1710 of the photo folder application on the full screen in response to a user's request. At this time, a plurality of pictures can be displayed in the execution window 1710 of the photo folder application. In addition, the device 100 may display the execution window 1720 of the data transfer application on the execution window 1710 of the photo folder application in the form of a floating window.

According to one embodiment of the present invention, the user may move the execution window 1720 of the data transfer application onto the first picture included in the execution window 1710 of the photo folder application. The user can touch the execution window 1720 of the data transfer application for a predetermined time (for example, three seconds) or more or a predetermined number of times (for example, twice). In this case, the device 100 may use the data transfer application to transfer the first photo selected by the user to the external device.

According to one embodiment of the present invention, the device 100 may transmit the first picture to the external device through short-range communication. The local communication may include, but is not limited to, Bluetooth, Bluetooth low energy (BLE), Wi-Fi direct, ultra wideband (UWB), Zigbee, Near Field Communication unit (NFC)

Meanwhile, according to an embodiment of the present invention, the device 100 may display information on the number of pictures transmitted to the external device on the execution window 1720 of the data transfer application. For example, if the device 100 has transmitted 8 pictures to an external device via a data transfer application, the device 100 may display an '8' over the execution window 1720 of the data transfer application.

As shown in Fig. 17 (b), the device 100 may move the execution window 1720 of the data transfer application based on the touch input (e.g., drag) of the user. For example, the device 100 may move the execution window 1720 of the data transfer application over the second picture. At this time, when an input for touching the execution window 1720 of the data transfer application for a predetermined time (for example, three seconds) or more or a predetermined number of times (for example, twice) It is possible to transmit the second picture to the external device by using the transfer function of the second picture.

According to one embodiment of the invention, the device 100 may display '9' on the execution window 1720 of the data transfer application since it has transmitted nine pictures to the external device through the data transfer application.

18 is a flowchart illustrating a method of linking a first application and a second application according to an embodiment of the present invention.

In step S1810, the device 100 may execute the first application and the second application. For example, the device 100 may display the execution window of the first application on the full screen and the execution window of the second application on the execution window of the first application in the form of a floating window.

In step S1820, the external device 200 may also execute the first application. According to one embodiment of the present invention, the first application may be a native communication application, a social communicator application (e.g., KakaoTalk, band, MyPhone, etc.), and a social media application Twitter, etc.). In step S1830, the device 100 and the external device 200 can be connected through the first application.

In step S1840, the external device 200 can collect information of the external device 200. [ The information of the external device 200 may include at least one of the location information of the external device 200, the capability information of the external device 200, and the context information of the external device 200, It is not.

In step S1850, the external device 200 can transmit the information of the external device 200 to the device 100 through the first application. At this time, in step S1860, the device 100 can receive information of the external device 200 through the first application. In step S1870, the device 100 can control the first application to transfer information of the external device 200 to the second application.

In step S1880, the device 100 can execute the predetermined function of the second application using the information of the external device 200 transmitted from the first application to the second application. Referring to Fig. 19, a detailed description will be given.

19 is a diagram illustrating an example in which a messenger application and a map application are linked with each other according to an embodiment of the present invention.

As shown in FIG. 19, the device 100 may display an execution window 1910 of the instant messenger application on the full screen in response to a user request. At this time, the user of the device 100 can communicate with the user of the external device through the messenger application. In addition, the device 100 can display the execution window 1920 of the map application in the form of a floating window on the execution window 1910 of the messenger application.

According to one embodiment of the present invention, the device 100 may receive location information of an external device from an external device via a messenger application. The device 100 may then transmit the location information of the external device received by the messenger application to the map application.

At this time, the map application can compare the location information of the external device with the current location information of the device 100. [ The map application may display the relative location information of the external device on the execution window 1920 of the map application.

For example, if the user of device 100 is in conversation with a friend (e.g., Tom) via an instant messaging application, device 100 sends the relative location information of the device of friend (e.g., Tom) (1920) on the screen. If the device of the friend (e.g., Tom) is 20 meters away from the device 100 in the west direction, the device 100 moves the execution window 1920 of the map application to the west direction, '20 m' can be displayed on the window (1920).

Accordingly, the user of the device 100 can search for a buddy (for example, a friend who is talking) on the basis of the distance information (e.g., 20 m) displayed in the execution window 1920 of the map application and the location information of the execution window 1920 of the map application. Tom ') can be easily identified.

20 is a flowchart illustrating a method of executing a predetermined function of a first application using information provided in a second application according to an embodiment of the present invention.

In step S2010, the device 100 can execute the first application and display the execution window of the first application on the entire screen.

In step S2020, the device 100 may receive an execution request for the second application. At this time, according to an embodiment of the present invention, the device 100 may receive an execution request to execute the second application with a mini-size floating window.

In step S2030, the device 100 can display the execution window of the second application on the execution window of the first application with a predetermined size. Since steps S2010 to S2030 correspond to steps S210 to S230 in FIG. 2, detailed description thereof will be omitted.

In step S2040, the device 100 can execute a predetermined function of the first application using the information provided in the second application.

According to an embodiment of the present invention, the information provided in the second application may include at least one of information displayed in the execution window of the second application and information transferred from the second application to the first application.

According to one embodiment of the present invention, the predetermined function of the first application may be various. For example, the predetermined function of the first application may include a bar code analysis function, a search function, a data transfer function, a translation function, a dictionary function, a capture function, and the like, but is not limited thereto.

Hereinafter, an embodiment in which the device 100 executes a predetermined function of the first application using information provided in the second application will be described with reference to FIGS. 21 and 22. FIG.

21 and 22 are views for explaining an example in which two-dimensional barcode information obtained through a camera application is displayed through a web browser. In FIGS. 21 and 22, the case where the first application is a web browser and the second application is a camera application will be described as an example.

As shown in FIG. 21, the device 100 may display an execution window 2120 of a camera application in a floating window form on an execution window 2110 of a web browser. At this time, the user can freely move the execution window 2120 of the camera application to recognize the two-dimensional barcode 2101 included in the business card 2100. The camera application can analyze the two-dimensional barcode 2101 included in the card 2100 and deliver the analyzed information to the web browser.

According to an embodiment of the present invention, the web browser displays information (e.g., name, image, telephone number, fax, e-mail, address, etc.) obtained by analyzing the two-dimensional bar code 2101 transmitted from the camera application, (2110).

As shown in FIG. 22, the user can freely move the execution window 2220 of the camera application to recognize the two-dimensional bar code 2201 included in the lottery 2200. The camera application can analyze the two-dimensional bar code 2201 included in the lottery 2200 and deliver the analyzed information to the web browser.

According to one embodiment of the present invention, the web browser can display information (e.g., winning number, winning amount, etc.) obtained by analyzing the two-dimensional bar code 2201 transmitted from the camera application in the execution window 2210 of the web browser have.

According to one embodiment of the present invention, the device 100 continues to provide the execution windows 2120 and 2220 of the camera application in the form of a floating window even after recognizing the two-dimensional barcode, while the information obtained by analyzing the two- And can be displayed through the execution windows 2110 and 2210 of the application. Accordingly, the user can continuously check information obtained by analyzing various kinds of two-dimensional bar codes.

23 is a flowchart illustrating a method for changing an application displayed as a floating window according to an embodiment of the present invention.

In step S2310, the device 100 can execute the second application and display the execution window of the second application on the execution window of the first application with a predetermined size.

In step S2320, the device 100 may provide an application list based on the user input. For example, when an input that swips inward from one side of the screen is received, the device 100 may display an application list including applications providing a multi-window function in a partial area of the screen.

In step S2330, the device 100 can select the third application from the application list. According to one embodiment of the present invention, the third application may be an application different from the first application and the second application.

In step S2340, the device 100 may receive a user input to move the third application onto the execution window of the second application. For example, the user can drag the third application to the area where the execution window of the second application is displayed while touching the third application in the application list.

In step S2350, the device 100 can execute the third application and display the execution window of the third application on the execution window of the second application with a predetermined size. According to an embodiment of the present invention, the device 100 can change the execution window of the second application, which is provided in the form of a floating window of a small size, to the execution window of the third application.

According to an embodiment of the present invention, when the user selects the fourth application from the application list and drags the fourth application to the remaining area excluding the area where the execution window of the second application is displayed, The fourth application can be executed and the execution window of the fourth application can be displayed on the entire screen. At this time, a floating window may be displayed on the execution window of the fourth application.

24 is a diagram showing an example of providing an application list according to an embodiment of the present invention.

24A, the device 100 displays the execution window 2410 of the web browser on the full screen, and displays the execution window 2420 of the music playback application on the execution window 2410 of the web browser It can be displayed in floating window form.

In addition, the device 100 can display an indicator 2400 indicating that an application list is present on the screen. According to one embodiment of the present invention, the device 100 may display the indicator 2400 only at the request of the user, or may always display the indicator 2400. [

As shown in FIG. 24 (b), when the user drags the indicator 2400 in the right direction while touching it, the device 100 can display the application list 2430 on the screen. 24 (b), the drag input is described as an example, but the present invention is not limited thereto. For example, when the user tap (or double tap) the indicator 2400, the device 100 may display an application list.

The user selects the map application 2431 from the application list 2430 and drags the map application 2431 to display the execution window 2420 of the music playback application . ≪ / RTI > In this case, the device 100 can execute the map application 2431 and display the execution window 2432 of the map application in a floating window form instead of the execution window 2420 of the music reproduction application. At this time, the execution window 2432 of the map application can be freely moved on the execution window 2410 of the web browser.

According to an embodiment of the present invention, the device 100 may display distance information or direction information on a predetermined point of interest (POI) in the execution window 2432 of the map application.

25 and 26 are block diagrams for explaining the configuration of a device according to an embodiment of the present invention.

As shown in FIG. 25, a device 100 according to an embodiment of the present invention may include a display unit 111 and a control unit 120. However, not all illustrated components are required. The device 100 may be implemented by more components than the components shown, and the device 100 may be implemented by fewer components.

26, the device 100 according to an exemplary embodiment of the present invention may include a user input unit 130, a sensing unit 140, a communication unit 130, An input / output unit 150, an A / V input unit 160, and a memory 170.

Hereinafter, the components will be described in order.

The output unit 110 is for outputting an audio signal, a video signal, or a vibration signal. The output unit 110 may include a display unit 111, an acoustic output unit 112, a vibration motor 113, and the like.

The display unit 111 displays and outputs information processed by the device 100. [ For example, the display unit 111 can display the execution window of the first application on the entire screen. Also, the display unit 111 can display the execution window of the second application on the execution window of the first application with a predetermined size. The predetermined size may be smaller than the size of the entire screen. The display unit 111 may display the execution window of the second application in a movable floating window form. The display unit 111 may display an application list providing a multi-window function.

Meanwhile, when the display unit 111 and the touch pad have a layer structure and are configured as a touch screen, the display unit 111 can be used as an input device in addition to the output device. The display unit 111 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display A 3D display, and an electrophoretic display. In addition, the device 100 may include two or more display units 111 according to the implementation of the device 100.

The audio output unit 112 outputs audio data received from the communication unit 150 or stored in the memory 170. [ Also, the sound output unit 112 outputs a sound signal related to functions (e.g., call signal reception sound, message reception sound, notification sound) performed in the device 100. [ The sound output unit 112 may include a speaker, a buzzer, and the like.

The vibration motor 113 can output a vibration signal. For example, the vibration motor 113 may output a vibration signal corresponding to an output of audio data or video data (e.g., a call signal reception tone, a message reception tone, etc.). In addition, the vibration motor 113 may output a vibration signal when a touch is input to the touch screen.

The control unit 120 typically controls the overall operation of the device 100. For example, the control unit 120 may include an output unit 110, a user input unit 120, a sensing unit 140, a communication unit 150, an A / V input unit 160 ) Can be generally controlled.

The control unit 120 may receive an execution request for the second application different from the first application. For example, the control unit 120 may detect occurrence of a predetermined event corresponding to an execution request for the second application.

The control unit 120 can execute a predetermined function of the second application using the information provided in the first application. For example, the control unit 120 may select at least one content displayed in the execution window of the first application based on the user input, and execute the predetermined function of the second application using the selected at least one content have. The control unit 120 may control the display unit 111 to display the result information obtained by executing the predetermined function on the execution window of the second application.

The control unit 120 can select at least one image displayed in the execution window of the first application based on the user input, and capture the selected at least one image using the second application. The control unit 120 selects the text displayed on the execution window of the first application based on the user input and provides the additional information (e.g., dictionary meaning, translation, etc.) for the selected text through the second application It is possible.

The control unit 120 can move the execution window of the second application to the area where at least one content is displayed based on the drag input of the user. The control unit 120 can move the execution window of the second application on the execution window of the first application based on the movement request for the execution window of the second application.

The control unit 120 can detect the user's touch on the screen and move the execution window of the second application to the position where the touch is detected on the screen. Also, the control unit 120 may move the execution window of the second application in the direction in which the user's voice is received.

The control unit 120 can change the size of the execution window of the second application based on the size change request for the execution window of the second application displayed in the predetermined size. If the second application is a camera application, the control unit 120 can adjust the size of the execution window of the second application according to the size of the subject.

On the other hand, the control unit 120 may execute a predetermined function of the first application using the information provided by the second application.

The user input unit 130 means means for the user to input data for controlling the device 100. [ For example, the user input unit 130 may include a key pad, a dome switch, a touch pad (contact type capacitance type, pressure type resistive type, infrared ray detection type, surface ultrasonic wave conduction type, A tension measuring method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto.

The user input unit 130 may receive a request to execute the second application at a predetermined size smaller than the execution window of the first application. The user input unit 130 may receive a move request for the execution window of the second application. The user input unit 130 may receive a size change request for an execution window of a second application displayed in a predetermined size.

The sensing unit 140 may sense the state of the device 100 or the state around the device 100 and may transmit the sensed information to the control unit 120. [

The sensing unit 140 includes a magnetism sensor 141, an acceleration sensor 142, a temperature / humidity sensor 143, an infrared sensor 144, a gyroscope sensor 145, (GPS) 146, an air pressure sensor 147, a proximity sensor 148, and an RGB sensor (illuminance sensor) 149. However, the present invention is not limited thereto. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

The communication unit 150 may include one or more components that allow communication between the device 100 and an external device or between the device 100 and the server. For example, the communication unit 150 may include a short-range communication unit 151, a mobile communication unit 152, and a broadcast reception unit 153.

The short-range wireless communication unit 151 includes a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a Near Field Communication unit, a WLAN communication unit, a Zigbee communication unit, IrDA, an infrared data association) communication unit, a WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant + communication unit, and the like.

The mobile communication unit 152 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The broadcast receiving unit 153 receives broadcast signals and / or broadcast-related information from outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The device 100 may not include the broadcast receiving unit 153 according to the embodiment.

The A / V (Audio / Video) input unit 160 is for inputting an audio signal or a video signal, and may include a camera 161 and a microphone 162. The camera 161 can obtain an image frame such as a still image or a moving image through the image sensor in a video communication mode or a photographing mode. The image captured through the image sensor can be processed through the control unit 120 or a separate image processing unit (not shown).

The image frame processed by the camera 161 can be stored in the memory 170 or transmitted to the outside through the communication unit 150. [ The camera 161 may be provided in two or more according to the configuration of the device 100.

The microphone 162 receives an external acoustic signal and processes it as electrical voice data. For example, the microphone 162 may receive acoustic signals from an external device or speaker. The microphone 162 may use various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The memory 170 may store a program for processing and control of the controller 120 and may store data input / output (e.g., application, content, location information of an external device, address book, May be stored.

The memory 170 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , An optical disc, and the like. In addition, the device 100 may operate a web storage or a cloud server that performs a storage function of the memory 170 on the Internet.

The programs stored in the memory 170 may be classified into a plurality of modules according to their functions, for example, a UI module 171, a touch screen module 172, a notification module 173, .

The UI module 171 can provide a specialized UI, a GUI, and the like that are interlocked with the device 100 for each application. The touch screen module 172 senses a touch gesture on the user's touch screen and can transmit information on the touch gesture to the control unit 120. [ The touch screen module 172 according to an embodiment of the present invention can recognize and analyze the touch code. The touch screen module 172 may be configured as separate hardware including a controller.

Various sensors may be provided in or near the touch screen to sense the touch or near touch of the touch screen. An example of a sensor for sensing the touch of the touch screen is a tactile sensor. A tactile sensor is a sensor that detects the contact of a specific object with a degree or more that a person feels. The tactile sensor can detect various information such as the roughness of the contact surface, the rigidity of the contact object, and the temperature of the contact point.

In addition, a proximity sensor is an example of a sensor for sensing the touch of the touch screen.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. The user's touch gestures can include tap, touch & hold, double tap, drag, panning, flick, drag and drop, swipe, and the like.

The notification module 173 may generate a signal for notifying the occurrence of an event of the device 100. [ Examples of events generated in the device 100 include call signal reception, message reception, key signal input, schedule notification, and the like. The notification module 173 may output a notification signal in the form of a video signal through the display unit 111 or may output a notification signal in the form of an audio signal through the sound output unit 112, It is possible to output a notification signal in the form of a vibration signal.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

The device 100 according to an exemplary embodiment of the present invention provides an execution window of at least one application on the execution window of another application in the form of a floating window so that the user can efficiently utilize the multi- .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: Device 110: Output section
120: control unit 130: user input unit
140: sensing unit 150: communication unit
160: A / V input unit 170: Memory

Claims (31)

A method for a device to execute a plurality of applications,
Displaying an execution window of the first application on a screen;
Receiving an execution request for a second application different than the first application;
Displaying an execution window of the second application on the execution window of the first application at a predetermined size smaller than the execution window of the first application based on the execution request; And
And executing a predetermined function of the second application using information provided in the first application. 2. The method of claim 1, wherein receiving an execution request comprises:
And receiving a request to execute the second application at the predetermined size smaller than the execution window of the first application. 2. The method of claim 1, wherein receiving an execution request for the second application further comprises:
Detecting a predetermined event occurrence corresponding to an execution request for the second application. 4. The method of claim 3,
A connection of an external device, a reception of a notification message, a connection request of an external device, and a predetermined button selection input reception. The information processing apparatus according to claim 1, wherein the information provided in the first application includes:
And information displayed in an execution window of the first application and information transmitted to the second application from the first application. The method as claimed in claim 1,
And displaying the result information obtained by executing the predetermined function on the execution window of the second application. The method of claim 1, wherein the step of executing a predetermined function of the second application comprises:
Selecting at least one content displayed in an execution window of the first application based on user input; And
And executing a predetermined function of the second application using the selected at least one content. 8. The method of claim 7, wherein the step of performing a predetermined function of the second application further comprises:
Selecting at least one image displayed in an execution window of the first application based on the user input; And
And capturing the selected at least one image using the second application. 8. The method of claim 7, wherein the step of performing a predetermined function of the second application further comprises:
Selecting a text displayed in an execution window of the first application based on the user input; And
And providing additional information on the selected text through the second application. 8. The method of claim 7, wherein selecting the at least one content comprises:
And moving an execution window of the second application to a region in which the at least one content is displayed based on a drag input of the user. The method as claimed in claim 1,
Receiving a move request for an execution window of the second application; And
And moving the execution window of the second application on the execution window of the first application based on the move request. The method as claimed in claim 1,
Sensing a user's touch on the screen; And
Further comprising moving an execution window of the second application to a position where the touch is sensed on the screen. The method as claimed in claim 1,
Receiving a voice of the user; And
And moving an execution window of the second application in a direction in which the voice was received. The method as claimed in claim 1,
Receiving a size change request for an execution window of the second application displayed in the predetermined size; And
And changing the size of the execution window of the second application based on the size change request. 15. The method according to claim 14,
And adjusting the size of the execution window of the second application according to the size of the subject when the second application is a camera application. The method as claimed in claim 1,
Further comprising executing a predetermined function of the first application using information provided in the second application. Displaying an execution window of the first application on a screen and displaying an execution window of the second application in a predetermined size smaller than an execution window of the first application based on an execution request for a second application different from the first application A display unit for displaying on the execution window of the first application; And
And a control unit that executes a predetermined function of the second application using information provided in the first application. 18. The apparatus of claim 17,
And receive a request to execute the second application at the predetermined size smaller than the execution window of the first application. 18. The apparatus of claim 17,
And detects a predetermined event occurrence corresponding to an execution request for the second application. 18. The apparatus of claim 17,
And controls the display unit to display the result information obtained by executing the predetermined function on the execution window of the second application. 18. The apparatus of claim 17,
A device that selects at least one content displayed in an execution window of the first application based on user input and executes a predetermined function of the second application using the selected at least one content. 22. The apparatus of claim 21,
Selecting at least one image displayed in the execution window of the first application based on the user input and capturing the selected at least one image using the second application. 22. The apparatus of claim 21,
Selecting a text displayed in the execution window of the first application based on the user input, and providing additional information on the selected text through the second application. 22. The apparatus of claim 21,
And move an execution window of the second application to a region in which the at least one content is displayed based on a drag input of the user. 18. The apparatus of claim 17,
Receiving a move request for the execution window of the second application and moving the execution window of the second application on the execution window of the first application based on the move request. 18. The apparatus of claim 17,
A device for detecting a touch of a user on the screen and moving an execution window of the second application to a position where the touch is sensed on the screen. 18. The apparatus of claim 17,
Receiving a user's voice and moving an execution window of the second application in a direction in which the voice was received. 18. The apparatus of claim 17,
Receiving a size change request for the execution window of the second application displayed in the predetermined size, and changing a size of the execution window of the second application based on the size change request. 29. The apparatus of claim 28,
And adjusts the size of the execution window of the second application according to the size of the subject when the second application is a camera application. 18. The apparatus of claim 17,
And executes the predetermined function of the first application by using the information provided in the second application. 17. A computer-readable recording medium on which a program for implementing a plurality of application executing methods according to any one of claims 1 to 16 is recorded.

Images