KR20090012950A - Method and apparatus for sharing application being executed - Google Patents

Abstract

An application sharing method and an apparatus thereof for simultaneously outputting the application sharing screen of a terminal and outputting an image are provided to operate an application using an icon and a menu while outputting a driven image of the application and image data. A display unit(110) activates the operation by control of the controller and terminates the drive of the controller. A communications unit(120) operates a portable terminal(100) in a communications mode for performing communication. An input unit(130) generates all kinds of the signals corresponding to the manipulation of user and inputs the signal to the controller. A storage(140) is a memory of storing video data and/or data for controlling the general operation of the portable terminal inputted through the camera part(150) or the external input device. A camera part transmits the image signal processor(160).

Description

METHOD AND APPARATUS FOR SHARING APPLICATION BEING EXECUTED}

The present invention relates to a mobile terminal and a method that can be performed in the mobile terminal, and more particularly, to an application executed by one of the video callers with another caller.

 Recently, as portable electronic devices having various multimedia functions (for example, mobile phones, personal digital assistants (PDAs), notebooks, etc.) are widely used, various applications used in portable electronic devices (for example, The ability to output MP3 sound sources, TV reception functions, etc.) is also actively developed. Among these various application technologies, a function of generating image or video data using a camera attached to a portable terminal or outputting stored image or video data through a display unit is one of the most widely used technologies.

For example, a mobile communication terminal equipped with a camera enables a user to create a photo or video data anywhere as well as make a video call. That is, the mobile communication terminal can take a video call between a plurality of mobile communication terminals by taking a user's image in real time and transmits it to the opposite terminal through the mobile communication network.

However, the conventional portable electronic device has a limitation in that it is not possible to simultaneously display the operation screens of the corresponding services (that is, driving the video call and the application) when it is desired to drive an application during a video call.

In addition, the conventional portable electronic device is limited so that only one caller has a right to control or use an application driven by one caller during a video call, so that other callers share the corresponding application through control of the corresponding application. There was a limit that could not be.

In order to solve the above problems, the present invention is to provide a portable terminal and a method for simultaneously outputting the image data and the data driven by the application through the display unit.

Another object of the present invention is to provide a portable terminal and a method for displaying the same application operation status display screen among a plurality of callers.

It is another object of the present invention to provide a portable terminal and a method for allowing an application executed by one caller to be controlled by another caller.

Other objects of the present invention will be readily understood through the following description.

According to an aspect of the present invention, a portable terminal for sharing a driven application between callers, the portable terminal comprising: a storage unit in which data relating to at least one application is stored; An input unit configured to receive a driving command for an arbitrary application; A display unit configured to output an application driving image corresponding to the driven application; And a controller for controlling the application corresponding to the driving command to be started and controlling the application driving image to be transmitted to the counterpart terminal through a communication network.

The controller controls the video call to be performed with the counterpart terminal and divides the entire display screen of the display unit into two or more divided regions to display the video communication data corresponding to the video call and the application driving image on separate divided regions. Can be controlled.

The apparatus may further include a communication unit configured to transmit the application driving image to the counterpart terminal through a communication network.

When a data storage request corresponding to the application driving image is received from the counterpart terminal through the communication unit, the controller reads data corresponding to the data storage request from the storage unit and transmits the data corresponding to the application driving image to the counterpart terminal through a communication network. Can be controlled.

When a selection of an icon or a menu displayed on one region of the application driving region is input, the controller may control to perform a function corresponding to the icon or menu.

The controller may control to switch so that any one of the divided regions is displayed on the entire display screen.

According to another aspect of the present invention, a method for sharing an application running in a portable terminal between callers, the method comprising the steps of: (a) receiving a driving command for any application; (b) driving an application corresponding to the driving command, and transmitting the application driving image to a counterpart terminal through a communication network; (c) there is provided an application sharing method comprising the step of outputting an application driving image corresponding to the driven application.

The method may further include performing a video call with the counterpart terminal before the step (a).

Step (c) may include dividing the entire display screen into two or more divided regions; And displaying the video communication data corresponding to the video call and the application driving video in separate partitions.

The method may further include transmitting data corresponding to the data storage request to the counterpart terminal through a communication network when a data storage request corresponding to the application driving image is received from the counterpart terminal.

The method may further include performing a function corresponding to the icon or menu when a selection of an icon or a menu displayed on one area of the application driving region is input.

The method may further include switching control so that any one of the divided regions is displayed on the entire display screen.

According to yet another aspect of the present invention, a program of instructions executable by a portable terminal is tangibly embodied and a recording medium having recorded thereon a program which can be read by the portable terminal, comprising: (a) for any application; Receiving a driving command; (b) driving an application corresponding to the driving command, and transmitting the application driving image to a counterpart terminal through a communication network; (c) There is provided a recording medium on which a program is recorded which performs the step of outputting an application driving image corresponding to the driven application.

According to the present invention, it is possible to provide a terminal and a method for simultaneously outputting a video output and an application sharing screen of the terminal through a split screen.

In addition, according to the present invention there is an effect that can provide a terminal and a method for operating the application using the icon and the menu while simultaneously outputting the video data and the application driving video corresponding to the video call.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, a portable terminal capable of sharing an application during a video call according to an embodiment of the present invention will be described with reference to FIGS. 1 to 4.

1 is a block diagram of a portable terminal having an application sharing function during a video call according to an embodiment of the present invention, and FIG. 2 is a display screen when an application is executed during a video call according to an embodiment of the present invention. Exemplary screen display showing the split state, Figure 3 is an exemplary view of the screen display when the application is executed during a video call according to another embodiment of the present invention.

Referring to FIG. 1, a portable terminal 100 having an application sharing function during a video call according to an embodiment of the present invention may include a display unit 110, a communication unit 120, an input unit 130, and a storage unit 140. , A camera unit 150, an image signal processor 160, a sound input unit 170, a sound signal processor 180, a sound output unit 185, and a controller 190.

The display 110 may be activated or terminated by the control of the controller 190, and various messages and / or applications generated while various functions (or modes) are executed under the control of the controller 190. Display the execution screen. In addition, the display 110 outputs the processed image data to the outside as visual information. For example, the image data processed by the image signal processor 160 may be output as visual information so that a user can identify the image data. For example, the display 110 may include an LCD or a plasma display panel (PDP), and may further include components for functioning as a touch screen. However, since the configuration of the display unit 110 to perform the above-described function and the additional configuration for functioning as a touch screen are obvious to those skilled in the art, a separate description will be omitted.

When the portable terminal 100 operates in a communication mode (especially, a video communication mode) for performing communication, the communication unit 120 performs various data such as voice, video, and the like (e.g., text message, incoming call, etc.) and a wireless communication network. Communication signal). The communication unit 120 may include a transmitter for amplifying a frequency of a transmitted signal and a receiver for amplifying and adjusting a frequency of a received signal. In addition, the communication unit 120 may further include a modem for modulating and demodulating the transmitted and received signals.

The input unit 130 generates various signals corresponding to a user's manipulation and inputs them to the controller 190. In particular, when a user manipulates the input unit 130 to select an icon or a menu on the screen, the input unit 130 generates a corresponding signal and transmits it to the control unit 190. The input unit 130 may be a keypad, a touch pad, or various other signal input devices.

The storage unit 140 may include data for controlling a general operation of the portable terminal 100 and / or image data input through a camera unit 150 or an external input device (for example, a 24-pin data input / output terminal). It may be a memory for storing. Of course, the storage 140 may further store communication related data for enabling a user to use a communication service.

The camera unit 150 converts an input analog image signal (that is, an image signal corresponding to a subject) into a digital image signal and transmits the digital image signal to the image signal processor 160. For example, the camera unit 150 may include a Charge-Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor.

The image signal processor 160 may convert and / or process an image signal input from the camera unit 150 in a preset manner and transmit the image signal to the display 110. In particular, when the portable terminal 100 operates in a video communication mode (that is, a mode for conducting a video call), the video signal processor 160 may output video communication data (for example, image data, etc.) received from the other party. Processing may be performed in a preset manner and transmitted to the controller 190 or the display 110. In addition, the image signal processor 160 may process the image data stored in the storage 140 under a preset method and transmit the image data stored in the storage 140 to the display 110 under the control of the controller 190.

The sound input unit 170 may be activated or terminated by the control of the controller 190. The sound input unit 170 may convert a voice or sound input from the outside into an electric voice signal, which is an electrical signal, and transmit the same to the sound signal processor 180. . For example, when the portable terminal 100 operates in a communication mode (particularly, a video communication mode), the portable terminal 100 may convert the input voice into a voice signal that is an electrical signal and transmit the converted voice signal to the sound signal processor 180.

The sound signal processor 180 decodes the voice communication data input by the control of the controller 190 in a preset manner. The sound signal decoded by the sound signal processor 180 may be output to the outside through the sound output unit 185. Through this, the user can check the voice communication data transmitted from the opposite terminal. The audio communication data processed (decoded) by the sound signal processor 180 may be output in synchronization with the video communication data processed by the video signal processor 160.

The controller 190 controls the overall operation of the portable terminal 100. For example, the controller 190 controls the operation of necessary components of the portable terminal 100 in order to perform a corresponding function when various signals are input according to a user's manipulation of the input unit 130. For example, during a video call (i.e., while the video data received from the other terminal is being output), when the user runs an application, the display screen is divided into video data (video communication data) for the video call. Each component of the portable terminal 100 may be controlled to simultaneously output an output of the application and a driving state screen of the application (for convenience, referred to as an application driving image). For example, the controller 190 may display the entire output screen (for example, all parts or icons of a display screen that can be output through the display 110 (for example, a battery level indicator icon, a reception sensitivity indicator icon, etc.). ), The entire portion of the display screen excluding the display area, etc.) is divided according to a ratio determined by a preset method. In this case, the controller 190 divides the entire screen into divided screens corresponding to one or more applications. It is apparent that the number of the divided regions for dividing the entire output screen, the size of each divided region, the type of division, etc., by the controller 190 may be preset in advance or set by the user. Hereinafter, a process of dividing the screen by the controller 190 will be described with reference to FIGS. 2 and 3 for a clear understanding of the present invention.

Referring to FIG. 2, as shown in FIG. 2A, in general, the portable terminal 100 operating in the video communication mode outputs video communication data to the entire output screen 210. In this state, when the execution of another application is requested by the user's request, the controller 190 displays the entire output screen 210 in a predetermined format (that is, a divided area) as shown in FIG. To the size, position and shape, etc.).

That is, the portable terminal 100 according to the present invention includes a plurality of executed applications (that is, a first application for performing a video call in a video communication mode and a second application other than the second application (for example, an MP3 player and a phone book). , SMS transceiver, game, video player, etc.) may be displayed together on the display screen.

In FIG. 2, it is assumed that the entire output screen 210 is divided in the vertical direction. However, the entire output screen 210 may be divided in the left and right directions as shown in FIG. 3A, or in FIG. 3B. As such, it is apparent that data selected by a user or set as a default among the image communication data or the application driving image may be displayed on the entire output screen 210 as a whole.

Referring back to FIG. 1, when the original video communication signal is input from the connected mobile communication network, the controller 190 converts the original video communication signal into video communication data (ie, video data included in the original video communication signal) and audio communication data ( That is, after separating into the audio data included in the original video communication signal, the video communication data can be controlled to be input to the video signal processor 160, the voice communication data to the audio signal processor 180, respectively. That is, when the video communication signal is input from the connected mobile communication network, the controller 190 controls each component so that the mobile terminal 100 performs a video communication mode (that is, the mobile terminal 100 performs a video call with the opposite terminal). Operation mode). Of course, when a call for a video call is received and the corresponding user answers to initiate a call, it is obvious that the portable terminal 100 may start the video call mode.

In addition, the controller 190 controls an icon or a menu corresponding to a function of an application to be arranged in a display screen area for outputting an application driving image, and when a user selects an icon or a menu using the input unit 130, a corresponding processing operation is performed. Can be controlled to be performed. In addition, when a user manipulation using the input unit 130 instructs a change in the shape, color, or icon type of the icon or menu, a corresponding process may be performed.

Hereinafter, referring to FIG. 4, a process of initiating or ending sharing of the application screen 230 on which the application driving image is displayed between each caller will be briefly described.

4 is a diagram illustrating an icon arrangement form in an application screen according to an embodiment of the present invention. In the description of the arrangement of icons in the application screen with reference to FIG. 4, it is assumed that the driven application is an address book. In addition, it will be described on the assumption that the entire display screen is divided up and down when an application is driven during a video call. In addition, for convenience of description, a user who determines driving and sharing start / end of an application is referred to as a first user, and a counterpart sharing a shared application started by the first user is referred to as a second user. Each of the portable terminals provided will be referred to as a first user terminal and a second user terminal.

When the controller 190 recognizes that the driving command of the address book application is input during the video call, the controller 190 controls the entire display screen to be divided through the above-described process. Subsequently, the controller 190 causes the image communication data to be displayed on the image output screen 220 which is the first area among the divided screens, and the application driving image corresponding to the driven application is displayed on the application screen 230 which is the second area. Control to be displayed. The application screen 230 may display a show icon 410 for starting sharing of the executed address book application with a second user who is in a video call. In addition, a storage icon 420 may be further displayed so that the driven application may be a request for storing by inputting a new telephone number or the like as an address book application.

When the controller 190 recognizes that the display icon 410 is selected by a user manipulation using the input unit 130, the controller 190 transfers the application driving image displayed on the application screen 230 to the second user terminal through the communication unit 120. send. In this case, the controller 190 may start the transmission of the application driving image when detecting the selection of the display icon 410, or start the transmission of the application driving image only when the sharing acceptance signal is received from the second user terminal. It is possible to determine whether to transmit the application driving image. For example, when the selection of the display icon 410 is recognized, the controller 190 transmits a preset sharing request signal to the second user terminal through the communication unit 120, and then receives a sharing acceptance signal from the second user terminal. Only when the application driving image is transmitted to the second user terminal through the communication unit 120. In this case, a share acceptance icon and a share rejection icon may be displayed on the display unit of the second user terminal to determine whether to accept the share, and the corresponding icons may be displayed in a partial area where video communication data is displayed or after the screen is divided. It may be displayed in.

When the address book application is started to be shared, the entire display screen of the second user terminal may also be divided to display respective data, and the second user may display address book information displayed on the application screen (that is, the address book driven in the first user terminal). Necessary information among the address book information displayed by the operation of the application may be selected and stored in the storage unit of the second user terminal. To this end, when the second user selects a storage icon after selecting an address book item on the application screen, the control unit of the second user terminal transmits a request for transmitting the corresponding information to the first user terminal, and the first user terminal corresponds to the corresponding user. The address book information may be transmitted to the second user terminal so that the corresponding information may be stored in the second user terminal. Of course, the method of storing the information stored in the first user terminal in the second user terminal may vary.

In the above-described process, transmission and reception of data for application driving and storage between the first user terminal and the second user terminal may be performed through a communication path already established for a video call between the first user terminal and the second user terminal.

In addition, it is apparent that after the application sharing is started, the hide icon is displayed on the application screen of the second user terminal to allow the second user to terminate the application sharing.

When the application sharing is started, the controller 190 of the first user terminal may display the hide icon 430 illustrated in FIG. 4B instead of the show icon 410 illustrated in FIG. 4A. At this time, when the selection of the hide icon 430 is recognized by the user operation using the input unit 130, the controller 190 stops sharing the application.

1 to 4, a device for sharing an application of a portable terminal during image output according to an embodiment of the present invention has been described.

So far, the operation of the functional unit of the application sharing apparatus that performs the sharing function of the address book application during the video call according to the exemplary embodiment of the present invention has been described. Although the functions of the above-described application have been described as being shown, hidden, and stored, it will be apparent to those skilled in the art that various functions may be implemented according to the application. Hereinafter, referring to FIG. 5, an application sharing method of a terminal that provides sharing of an application during image output according to an embodiment of the present invention will be described.

5 is a flowchart illustrating an application sharing process of a portable terminal providing sharing of an application during a video call according to an embodiment of the present invention. Each step described below is performed by each internal component of the portable terminal 100, but will be collectively described as a portable terminal 100 for the convenience of understanding and explanation.

In operation 510, the mobile terminal 100 performing the video call function receives an arbitrary application driving command from the user.

In operation 520, the portable terminal 100 divides the entire output screen on which the video communication data is being output by a predetermined method according to the input application driving command. In addition, the portable terminal 100 controls to continuously output image communication data on any one of the divided screens, and outputs the application driving image for the application driven in response to the application driving command to the other of the divided screens. If there are two or more applications that can be simultaneously driven, the number of split screens may be three or more, and it is obvious that two or more applications that can be shared with a communication counterpart may be provided.

In operation 530, the portable terminal 100 displays icons (or menu items) corresponding to respective applications (eg, a video call application and an MP3 player application) for displaying data in each partition. Display in the partition area. Steps 520 and 530 described above may be performed at the same time or may be changed later.

In operation 540, the mobile terminal 100 receives an input for selecting an icon that is preset for screen sharing of an application. As illustrated above, the icon may be a display icon.

In operation 550, the portable terminal 100 transmits a preset sharing request signal to the counterpart terminal, and receives a share accept signal from the counterpart terminal. As described above, in the case where application sharing is started only by selecting a user's display icon, step 550 may be omitted.

In operation 560, the portable terminal 100 transmits data necessary for executing the application to the counterpart terminal and starts sharing the application with the counterpart terminal. Here, the data transmitted to the counterpart terminal may be limited to an image corresponding to an application driving image, and receive location information and selected icon (or menu) information corresponding to a specific cursor position (or mouse pointer location) from the counterpart terminal. Obviously, the portable terminal 100 may perform related data transmission or application operation control (for example, change of a song to be played, volume control, etc.).

In operation 570, the portable terminal 100 determines whether a sharing stop notification is received from the counterpart terminal.

If a sharing stop notification has been received, the sharing process stops. However, if the sharing stop notification has not been received, the portable terminal 100 determines whether a sharing end icon (or menu item) has been selected in step 580.

If the sharing end icon (or menu item) is not selected, the application sharing state in step 560 is maintained. However, if the sharing end icon is selected, the portable terminal 100 stops application data transmission to the opposite terminal in step 590 to terminate application sharing.

Hereinafter, referring to FIG. 6, an application sharing method of a counterpart terminal receiving sharing of an application during image output according to an embodiment of the present invention will be described. In this case, the other side terminal should also have an application sharing function, and since it has the same configuration as that of FIG. 1 described above, the other side terminal will be referred to as a portable terminal 100 and a portable terminal providing application sharing will be described as the other side terminal. do.

6 is a flowchart illustrating an application sharing process of a terminal provided with sharing of an application during a video call according to another embodiment of the present invention.

In operation 610, the mobile terminal 100 performing the video call function receives an application sharing request signal from the counterpart terminal.

In operation 620, the portable terminal 100 displays an icon (or menu) indicating sharing acceptance and rejection on the image output screen.

In operation 630, the portable terminal 100 determines which icon of a share accept or reject icon (or menu) is input.

If the share rejection icon (or menu) is selected, the application terminates without starting application sharing when the input is selected. That is, since the application sharing ends, only the processing for the video call will be performed.

If the sharing acceptance icon (or menu) is selected, in step 640, the portable terminal 100 divides the screen and outputs image communication data and an application driving image to each of the divided regions.

In operation 650, the portable terminal 100 displays an icon (or menu) corresponding to each divided area on the screen. If only icons (or menus) for application sharing need to be displayed, the corresponding icons (or menus) will be displayed on the application screen 230.

In operation 660, the portable terminal 100 determines whether a sharing stop notification has been received from the counterpart terminal.

If a sharing stop notification has been received, the sharing process stops. However, if the sharing stop notification has not been received, the portable terminal 100 determines whether a sharing end icon (or menu) is selected in step 670.

If the sharing end icon (or menu item) is not selected, the application sharing state in step 650 is maintained. However, if the end sharing icon is selected, the portable terminal 100 stops sharing the application with the other terminal in step 680.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the present invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

1 is a block diagram of a portable terminal having an application sharing function during a video call according to an embodiment of the present invention.

2 is an exemplary view of a screen display showing a display screen division state when an application is executed during a video call according to an embodiment of the present invention.

 3 is an exemplary view of a screen display when an application is executed during a video call according to another embodiment of the present invention.

4 is a diagram illustrating an icon arrangement in an application screen according to an embodiment of the present invention.

5 is a flowchart illustrating an application sharing process of a portable terminal providing sharing of an application during a video call according to an embodiment of the present invention.

6 is a flowchart illustrating an application sharing process of a terminal provided with sharing of an application during a video call according to another exemplary embodiment of the present invention.

Claims (13)

In the portable terminal to share the driven application between the caller, A storage unit for storing data regarding one or more applications; An input unit configured to receive a driving command for an arbitrary application; A display unit configured to output an application driving image corresponding to the driven application; And And a controller configured to control driving of an application corresponding to the driving command to be started and to transmit the application driving image to a counterpart terminal through a communication network. The method of claim 1, The controller controls the video call to be performed with the counterpart terminal and divides the entire display screen of the display unit into two or more divided regions to display the video communication data corresponding to the video call and the application driving image on separate divided regions. Portable terminal, characterized in that to control to. According to claim 1, And a communication unit for transmitting the application driving image to the counterpart terminal through a communication network. The method of claim 3, wherein When a data storage request corresponding to the application driving image is received from the counterpart terminal through the communication unit, the controller controls to read data corresponding to the data storage request from the storage unit and transmit the data corresponding to the application driving image to the counterpart terminal through a communication network. Portable terminal, characterized in that. The method of claim 2, When a selection of an icon or a menu displayed on one region of the application driving region is input, the controller controls to perform a function corresponding to the icon or menu. The method of claim 2, And the control unit controls switching so that any one of the divided regions is displayed on the entire display screen. In the method for sharing the application running in the portable terminal between the caller, (a) receiving a driving command for an arbitrary application; (b) driving an application corresponding to the driving command, and transmitting the application driving image to a counterpart terminal through a communication network; (c) outputting an application driving image corresponding to the driven application. The method of claim 7, wherein And performing a video call with the counterpart terminal. The method of claim 8, Step (c) is Dividing the entire display screen into two or more divided regions; And And displaying the video communication data corresponding to the video call and the application driving video in separate partitions. The method of claim 9, And when the data storage request corresponding to the application driving image is received from the counterpart terminal, transmitting data corresponding to the data storage request to the counterpart terminal through a communication network. The method of claim 9, And if a selection of an icon or a menu displayed on one area of the application driving area is input, performing a function corresponding to the icon or menu. The method of claim 9, And switching control so that any one of the divided regions is displayed on the entire display screen. In the recording medium in which a program of instructions that can be executed by a portable terminal is tangibly embodied to perform an application sharing method, and the program can be read by the portable terminal. (a) receiving a driving command for an arbitrary application; (b) driving an application corresponding to the driving command, and transmitting the application driving image to a counterpart terminal through a communication network; (c) a recording medium having a program recorded thereon which performs the step of outputting an application driving image corresponding to the driven application.

Images