JP2015201074A - Information processing device and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an "information processing device and a computer program" for assisting a user in an application switching operation for going to a foreground state so as not to invoke the user's unintended stoppage of continuous application operation.SOLUTION: The display area of an icon 701 on the menu screen (a) of an application is divided into a background continuous operation disabled icon list area 710 and a background continuous operation enabled icon list area 720. The icons 701 of mobile applications whose background operation attributes indicate that they cannot continue operating in a background state are arranged in the background continuous operation disabled icon list area 710, and the icons 701 of mobile applications whose background operation attributes indicate that they can continue operating in the background state are arranged in the background continuous operation enabled icon list area 720.

Description

  The present invention relates to a technique for supporting the use of an application of a mobile device connected to the information processing device in an information processing device.

  In the information processing apparatus, as a technique of using an application of the mobile device connected to the information processing apparatus, the output video of the mobile device transferred from the mobile device is displayed on the display device of the information processing apparatus. A technique is known in which a user operation received by an information processing device is transferred to a mobile device, and the mobile device performs an operation corresponding to the user operation transferred from the information processing device (for example, Patent Documents 1 and 2).

  Here, generally, in a mobile device, when a plurality of applications are activated, only one application is in the foreground state, and the other activated applications are in the background state. When the application to be in the foreground state is switched in accordance with a user operation or the like, the application that has been in the foreground state until then transitions to the background state.

  Here, the foreground state is a state in which the application is executed in a state where the window can be displayed and a user operation can be accepted, and the background state cannot be displayed in the window and a user operation. It is a state being executed in the state.

JP 2012-253736 A JP 2012-202706 A

  Now, there are two types of applications for mobile devices: applications that continue to perform processing that has been performed in the foreground state after the transition from the foreground state to the background state; There are applications that can no longer perform the processing that was done in the state.

  Therefore, when the application A that cannot perform the processing performed in the foreground state after the transition to the background state is in the foreground state, if the user sets another application B to the foreground state, the application A is in the foreground state. The processing that was being performed in the process will be stopped.

  At this time, assuming that the process that the user has performed in the foreground state is continued even when the application A is in the background state, the other application B is set in the foreground state and the application A is set in the background state. In this case, an operation contrary to the user's intention is performed.

  Therefore, an object of the present invention is to support a user's operation for switching an application to be in the foreground state so that an unintended operation does not occur.

  To achieve the above object, the present invention provides an information processing apparatus having a plurality of applications and selectively connecting a mobile device capable of executing one application in the foreground and executing another application in the background. An information acquisition unit that acquires information of each application included in the mobile device from the display device and a mobile device connected to the information processing device; and each application included in the mobile device connected to the information processing device A menu display unit that displays an application menu screen on which the icon is arranged on the display device, and a selection of a user icon on the application menu is received, and the mobile device executes an application that the mobile device executes in the foreground. Icon selected To switch to the application is provided with a the foreground application switching unit. However, the information of each application acquired by the information acquisition unit is a first type of application that is a type of application in which each application continues processing being executed in the foreground while executing in the background. Or the attribute information indicating whether the application is a second type of application that does not continue the processing that is being executed in the foreground while being executed in the background, and the menu display unit is The application menu that indicates whether each icon is an icon of the first type application or an icon of the second type application in a form that allows the user to determine based on the acquired attribute information Generate and display a screen.

  More specifically, in such an information processing apparatus, the application menu screen is divided into a first display area of a first display area and a second display area, and The first type of application icons may be arranged in the first display area, and the second type of application icons may be arranged in the second display area.

  Alternatively, in such an information processing apparatus, among the icons arranged on the application menu screen, the icon of the first type application may be displayed in a form with a predetermined mark.

  Alternatively, in such an information processing apparatus, among the icons arranged on the application menu screen, the icon of the first type application may be displayed in a form with a predetermined decoration.

  Here, in the information processing apparatus described above, the icon of the application being executed in the foreground in the mobile device among the icons arranged on the application menu screen in the menu display unit, and You may comprise so that the said application menu screen represented with the form which can be discriminated is displayed.

  Further, in the information processing apparatus described above, the user can discriminate the icon of the application being executed in the background on the mobile device from the icons arranged in the application menu screen in the menu display unit. The application menu screen expressed in a possible form may be displayed.

  Further, in the information processing apparatus described above, the mobile device that is output from the mobile device when the menu display unit does not display the application menu on the display device is executed in the foreground. You may make it provide the window display part which displays the window screen of the existing application on the said display apparatus.

  In this case, in the window display unit, the application that the mobile device is executing in the background is executed in the foreground together with the window screen of the application that the mobile device is executing in the foreground. Sometimes, the information processing apparatus may be configured to display a captured image obtained by capturing a window screen output from the mobile device on the display device.

  In this case, the foreground application switching unit accepts a user's selection operation for the captured image, and the mobile device executes an application executed by the mobile device in the foreground. The information processing apparatus may be configured to switch to the application that the mobile device was executing in the foreground when captured.

Note that the information processing apparatus as described above may be an in-vehicle information processing apparatus mounted on an automobile.
According to the information processing apparatus as described above, it is possible to determine whether or not the icon of each application of the mobile device is an icon of an application that continues the process that was being executed in the foreground while executing in the background. Since the application menu screen arranged in the form is displayed, the user can check whether each application can continue the processing performed in the foreground state after transitioning to the background state from the application menu screen. Recognize and perform the foreground / background operation of each mobile application.

  Therefore, it is assumed that the application that cannot be continued in the foreground state when the user transitions to the background state will continue the process that was performed in the foreground state even if the application transitions to the background state. The transition from the foreground state to the background state due to the foreground state of another mobile application can be suppressed.

  As described above, according to the present invention, it is possible to support a user's operation for switching an application to be in the foreground state so that an unintended operation does not occur.

It is a block diagram which shows the structure of the vehicle-mounted apparatus and smart phone which concern on embodiment of this invention. It is a figure which shows arrangement | positioning of the vehicle-mounted apparatus which concerns on embodiment of this invention. It is a figure which shows the mobile application management table which concerns on embodiment of this invention. It is a flowchart which shows the mobile application registration process which concerns on embodiment of this invention. It is a figure which shows the example of a display of the vehicle-mounted apparatus which concerns on embodiment of this invention. It is a flowchart which shows the menu process which concerns on embodiment of this invention. It is a figure which shows the example of the menu screen which concerns on embodiment of this invention.

Hereinafter, embodiments of the present invention will be described.
FIG. 1 shows the configuration of the in-vehicle device 1 and the smartphone 2.
As shown in the figure, the in-vehicle device 1 operates on an input device 101, a display device 102, a voice input / output device 103 having a microphone, a speaker, and the like, an external interface device 104, an operating system 105 of the in-vehicle device 1, and an operating system 105. An application, a storage device 106, and other peripheral devices 107 are provided.

The in-vehicle device 1 includes a terminal application 111 and other various applications 112 as the applications described above.
However, the in-vehicle apparatus 1 as described above is configured by using a computer having a CPU, a memory, and the like in hardware. The operating system 105 and each application are stored in a predetermined computer. It is realized by executing a computer program.

  Next, the smartphone 2 is a mobile device carried by the user. As illustrated, the smartphone 2 includes an operation unit 201, a display 202, a voice input / output unit 203 including a microphone and a speaker, an external interface unit 204, and the smartphone 2. A mobile operating system 205 that is an OS, a mobile application that is an application running on the mobile operating system 205, a storage unit 206, a mobile communication device 207 for accessing a mobile telephone network, and other peripheral devices 208 are provided. .

  Here, the smartphone 2 includes a mobile phone application 211 that provides a mobile phone function using the mobile communication device 207, the voice input / output unit 203, and the operation unit 201, and various other mobile applications 212 as mobile applications. .

  The smartphone 2 is configured using a portable computer that includes a CPU, a memory, and the like in terms of hardware. The mobile operating system 205, the mobile application, and the like are stored in a predetermined computer. It is realized by executing a program.

Here, as shown in FIG. 2, for example, the in-vehicle device 1 is arranged on the dashboard of the automobile with the display surface of the display device 102 facing the rear of the automobile.
Then, the smartphone 2 brought into the automobile by the user is connected to the in-vehicle device 1, the external interface device 104 of the in-vehicle device 1, and the external interface unit 204 of the smartphone 2 via wired communication such as USB, or Wi-fi, They are connected to each other by wireless communication such as Bluetooth (registered trademark).

Next, the mobile application management table stored in the storage device 106 of the in-vehicle device 1 will be described.
As shown in FIG. 3, the mobile application management table is a table for registering a mobile application included in the smartphone 2 connected to the in-vehicle device 1, and has an entry (each row in the figure) for each mobile application included in the smartphone 2.

  In each entry, a mobile application name that is the name of the mobile application, icon data of an icon of the mobile application, application attributes, an execution state, and window capture data are registered.

  In the application attribute of each entry of the mobile application management table, a background operation attribute indicating whether the mobile application continues to operate in the background state and other attributes are registered.

  In addition, the execution state of the mobile application is registered in the execution state of each entry in the mobile application management table. Here, as the execution state of the mobile application, the mobile application that has been started is stopped, the mobile application that has been started is running in the foreground that indicates that the started mobile application is operating in the foreground state, An execution state during non-foreground execution indicating that the operation is performed in a state other than the foreground state (background state or the like) is used.

  In addition, the window capture data of each entry in the mobile application management table captures the window that the mobile application displayed and output immediately before the mobile application execution state transitioned from foreground execution to non-foreground execution. The image data of the selected image is registered.

Hereinafter, the operation of the terminal application 111 of the in-vehicle device 1 will be described.
First, when the terminal application 111 detects that the smartphone 2 is connected via the operating system 105, the terminal application 111 executes mobile application registration processing.

  As shown in FIG. 4, in this mobile application registration process, first, a predetermined procedure is executed between the mobile operating system 205 of the smartphone 2 and a mobile application list is acquired from the mobile operating system 205 (step 402).

  The mobile application list is a list of information of each mobile application installed in the smartphone 2, and each mobile application information includes a mobile application name, mobile application icon data, and a mobile application background operation attribute. , Other attributes of the mobile application, and the execution state of the mobile application.

  Next, the terminal application 111 updates the mobile application management table based on the mobile application list acquired from the mobile operating system 205 (step 404).

  Specifically, the contents of the mobile application management table are initialized, an entry corresponding to each mobile application whose information is included in the mobile application list is created in the mobile application management table, and the mobile corresponding to each created entry is created. The mobile application name, icon data, background operation attribute, other attributes, and execution state indicated by the mobile application information in the application list are registered.

  Then, a menu that defines a menu screen that represents a list of icons indicated by icon data of each mobile application registered in the mobile application management table in a form that can identify the background operation attribute of the mobile application corresponding to the icon. Screen data is created and saved (step 406), and the process is terminated.

Details of the menu screen will be described later.
The mobile application registration process performed by the terminal application 111 of the in-vehicle device 1 has been described above.
Now, when the smartphone 2 is connected to the in-vehicle device 1 and the mobile application registration process is executed, the terminal application 111 of the in-vehicle device 1 performs the following terminal operation.

  That is, the terminal application 111 of the in-vehicle device 1 in the terminal operation, first, as shown in FIG. 5a1, in the foreground window area 510 and the background window area 520 provided by dividing the display screen of the display device 102, The image 511 transferred from the smartphone 2 is displayed in the foreground window area 510, and the window capture data in which execution status of non-foreground execution is set in the mobile application management table is displayed in the background window area 520. The operation of displaying the captured images 521 of the windows side by side is performed.

  Here, as shown in FIG. 5 a 2, the smartphone 2 transfers the image displayed on the display 202 to the in-vehicle device 1 while being connected to the in-vehicle device 1. Therefore, in the foreground window area 510 of the display device 102 of the in-vehicle device 1, a window of a mobile application that is being executed in the foreground state by the smartphone 2 is displayed.

  Further, the terminal application 111 of the in-vehicle device 1 also performs an operation of transferring a user operation or the like performed on the foreground window area 510 using the input device 101 to the smartphone 2 in the terminal operation.

  When the operating system 105 of the smartphone 2 receives a user operation performed on the foreground window area 510 from the terminal application 111 of the in-vehicle device 1, the operating system 105 notifies the mobile application running in the foreground state of the user operation. The mobile application executed in the ground state performs processing according to the notified user operation.

  As a result, the GUI using the display device 102 and the input device 101 of the in-vehicle device 1 for the mobile application executed in the foreground state on the smartphone 2 is realized.

  Next, the terminal application 111 of the in-vehicle device 1 executes menu processing when a user's menu calling operation using the input device 101 occurs during the terminal operation described above.

FIG. 6 shows the procedure of this menu processing.
As shown in the figure, in the menu process, first, an image 511 displayed in the foreground window area 510 is captured as shown in FIG. 5a1, and “foreground executing” is set in the execution state of the mobile application management table. The window capture data being updated is updated to the image data of the captured image (step 602).

  Then, the menu screen defined by the menu screen data created and stored in the mobile application registration process shown in FIG. 4 is displayed on the display device 102 in a form in which the execution state of each mobile application can be identified (step 604). ).

Here, details of the menu screen will be described.
FIG. 7a shows a first example of the menu screen.
As described above, according to the definition of the menu screen data, the menu screen is displayed by menu processing in a form in which the background operation attribute can be identified from the list of the mobile application icons 701.

  In the menu screen of FIG. 7A, the display area of the icon 701 is divided into a background continuous operation disabled icon list area 710 and a background continuous operation disabled icon list area 720. A mobile application icon 701 indicating that the background operation attribute indicates that the mobile application cannot be continuously operated in the background state is arranged, and the background operation attribute is set in the background continuous operation enable icon list area 720. The mobile application icons 701 indicating that continuous operation is possible are arranged. In addition, in order to avoid complication of the figure, in the figure, it is omitted to add a reference numeral 701 to all icons, but in each figure of FIG. 7a, a square figure in which the symbol figure in the figure is drawn is All are mobile application icons 701. Similarly, in the following FIGS. 7b, 7c, and 7d, all the square figures in which the symbol figures are drawn are the icons 701 of the mobile application.

Further, as described above, the menu screen is represented in a form in which the execution state of the mobile application can be identified by menu processing.
In the menu screen of FIG. 7a, an icon 710F of a mobile application whose execution state is foreground execution and an icon 710B of a mobile application whose execution state is non-foreground execution are displayed by being surrounded by different forms of frames. Thus, the execution state of the mobile application of each icon 701 can be identified.

Next, FIG. 7b shows a second example of the menu screen.
As shown in FIG. 7b, in this menu screen, the background operation attribute is displayed by adding a “BG” mark only to the mobile application icon 701 indicating that the mobile application can continue to operate in the background state. Accordingly, the user can identify the mobile application icon 701 that can be continuously operated in the background state and the mobile application icon 701 that cannot be continuously operated in the background state. In the example of FIG. 7B, the mobile application icon 710F whose execution state is foreground execution and the mobile application icon 710B whose execution state is non-foreground execution are displayed with higher brightness than the other icons 701. At the same time, the mobile application icon 710F whose execution state is being executed in the foreground is displayed in a frame so that the mobile application execution state of each icon 701 can be identified.

Next, FIG. 7c shows a third example of the menu screen.
As shown in FIG. 7c, in this menu screen, only the mobile application icon 701 indicating that the background operation attribute indicates that the mobile application can continue to operate in the background state is displayed in the background state. The user can identify the mobile application icon 701 that can be continuously operated and the mobile application icon 701 that cannot be continuously operated in the background state. In the example of FIG. 7c, a mark 740 indicating that the execution state is being executed is added to the icon 710F of the mobile application whose execution state is being executed in the foreground and the mobile application icon 710B whose execution state is being executed as a non-foreground execution. In addition to the display, the mobile application icon 710F whose execution state is being executed in the foreground is displayed with higher brightness than the other icons 701, so that the execution state of the mobile application of each icon 701 can be identified.

The “close” button 730 in each page menu is for accepting a user's cancel operation.
As described above, according to the display of the menu screen as shown in FIGS. 7A to 7C, the application menu displayed in the form in which the mobile application icon 701 is simply arranged on the smartphone 2 as shown in FIG. The background operation attribute is displayed on the display device 102 of the in-vehicle device 1 in a form that can be identified. Therefore, the user recognizes from the menu screen whether each mobile application can continue the processing that was being performed in the foreground state after transitioning to the background state, and sets each mobile application to the foreground state. / Can perform background state operation.

  Therefore, if the user unintentionally transitions to the background state, the application that cannot be continued in the foreground state continues processing that was performed in the foreground state even if the application transitions to the background state. It is possible to suppress the transition from the foreground state to the background state due to the foreground state of another mobile application.

  Returning to FIG. 6, if the menu screen as described above is displayed (step 604), a user cancel operation by the operation of the “close” button 720 (step 606), any icon on the menu screen is displayed. The occurrence of the selection operation 701 (step 608) is monitored.

If a cancel operation occurs, the menu process is terminated and the terminal operation is restored.
On the other hand, when the selection operation of any icon 701 on the menu screen as described above occurs (step 608), it is determined whether or not the execution state of the mobile application of the selected icon 701 is foreground execution. The mobile application management table is referred to and checked (step 610). If the foreground is being executed, the menu process is terminated and the terminal operation described above is resumed.

  On the other hand, if the execution state of the mobile application of the selected icon 701 is not in the foreground execution (step 610), a request for foreground state setting of the mobile application corresponding to the selected icon 701 is issued to the smartphone 2 ( Step 612).

  Here, the mobile operating system 205 of the smartphone 2 requested to change to the foreground state switches the mobile application executed in the foreground state to the mobile application requested to change to the foreground state. At this time, the execution state of the mobile application that has been executed in the foreground state is the background state. If the execution state of the mobile application to be in the foreground state is stopped, the mobile application is activated and the execution state is set to the foreground state.

  Next, the terminal application 111 of the in-vehicle device 1 updates the execution state of the entry whose execution state of the mobile application management table is in the foreground execution to the non-foreground execution, and the mobile application management table is selected. The execution state of the entry of the mobile application with the icon 701 is updated during the foreground execution (step 614), the menu processing is terminated, and the terminal operation is restored.

The menu process performed by the terminal application 111 of the in-vehicle device 1 has been described above.
Note that the above menu process may be automatically executed even after the mobile application registration process shown in FIG. 4 ends.
Next, the terminal application 111 of the in-vehicle device 1 also performs an operation of outputting the voice transferred from the smartphone 2 via the voice input / output device 103 during execution of the above terminal operation and menu treatment. Here, while connected to the in-vehicle device 1, the smartphone 2 transfers the sound output to the sound input / output unit 203 to the in-vehicle device 1 without outputting it to the sound input / output unit 203.

The embodiment of the present invention has been described above.
By the way, in the above embodiment, in the terminal operation, the display screen of the display device 102 is divided into two to provide a foreground window area 510 and a background window area 520, which are transferred from the smartphone 2 to the foreground window area 510. A window image 511 displayed and output by the mobile application executing the foreground is displayed, and a captured image 521 of the window executing the non-foreground is displayed in the background window area 520. This is shown in FIG. 5b. In this way, only the window image 511 displayed by the mobile application running in the foreground transferred from the smartphone 2 may be displayed on the entire display screen of the display device 102. In this case, the configuration and processing related to the window capture data in the above embodiment may be omitted.

  In the above embodiment, in the menu treatment, the menu screen is displayed on the display device 102 in such a form that the execution state of each mobile application can be identified, but the menu screen does not represent the execution state of each mobile application. It may be.

  In the above embodiment, the menu screen may not display the execution state of each mobile application, and may not display the captured image 521 in the background window area 520. The configuration and processing related to the execution state of the mobile application of the in-vehicle device 1 in the above embodiment may be omitted.

  In addition, when the background window area 520 is provided in the above embodiment, the user's selection operation of the captured image 521 of the non-foreground execution window displayed in the background window area 520 is received and selected by the smartphone 2. By requesting the mobile operating system 205 of the smartphone 2 to change the mobile application corresponding to the captured image 521 for which the operation has been accepted to the mobile operating system 205 of the smartphone 2, the captured image 521 for which the selection operation has been accepted for the mobile application to be executed in the foreground state. You may make it switch to the mobile application corresponding to.

In the above embodiment, the case where the device that executes the mobile application is the smartphone 2 has been described as an example. However, the device that executes the mobile application may be an arbitrary device such as a tablet device or other mobile device. .

  Moreover, although the above embodiment demonstrated taking the application to the vehicle-mounted apparatus 1 mounted in a motor vehicle as an example, this embodiment replaces the vehicle-mounted apparatus 1 and arbitrary information processing apparatuses, such as a fixed information processing apparatus. The same applies when used.

  DESCRIPTION OF SYMBOLS 1 ... In-vehicle device, 2 ... Smartphone, 101 ... Input device, 102 ... Display device, 103 ... Voice input / output device, 104 ... External interface device, 105 ... Operating system, 106 ... Storage device, 107 ... Peripheral device, 111 ... Terminal Application, 112 ... kind application, 201 ... operation unit, 202 ... display, 203 ... voice input / output unit, 204 ... external interface unit, 205 ... mobile operating system, 206 ... storage unit, 207 ... mobile communication device, 208 ... peripheral device 211 ... Mobile phone application, 510 ... Foreground window area, 520 ... Background window area, 701 ... Icon.

Claims (19)

An information processing apparatus to which a mobile device having a plurality of applications and executing one application in the foreground while executing another application in the background is selectively connected,
A display device;
An information acquisition unit that acquires information of each application included in the mobile device from a mobile device connected to the information processing device;
A menu display unit for displaying an application menu screen on which icons of each application included in the mobile device connected to the information processing device are arranged on the display device;
A foreground application switching unit that accepts selection of a user's icon on the application menu and causes the mobile device to switch an application that the mobile device executes in the foreground to an application with the icon selected;
The information of each application acquired by the information acquisition unit is a first type of application that is a type of application in which each application continues processing being executed in the foreground while executing in the background, Attribute information indicating whether it is a second type application that is a type of application that does not continue processing that was being executed in the foreground during execution in the background,
The menu display unit determines whether each icon is an icon of the first type application or an icon of the second type application based on the attribute information acquired from the mobile device. An information processing apparatus that generates and displays the application menu screen represented in a discriminable form. The information processing apparatus according to claim 1,
The application menu screen is divided into a first display area of a first display area and a second display area, and the first display area contains the first type of application. An information processing apparatus, wherein icons are arranged, and icons of the second type of application are arranged in the second display area. The information processing apparatus according to claim 1,
Of the icons arranged on the application menu screen, the icon of the first type application is displayed in a form with a predetermined mark. The information processing apparatus according to claim 1,
Of the icons arranged on the application menu screen, the icon of the first type application is displayed in a form with a predetermined decoration. The information processing apparatus according to claim 1, 2, 3 or 4,
The menu display unit displays the application menu screen in which an icon of an application being executed in the foreground in the mobile device is displayed in a form that allows a user to distinguish it from other icons. . The information processing apparatus according to claim 1, 2, 3, 4 or 5,
The menu display unit displays the application menu screen that displays an icon of an application running in the background on the mobile device in a form that allows the user to distinguish it from other icons. . The information processing apparatus according to claim 1, 2, 3, 4, 5 or 6,
When the menu display unit does not display the application menu screen on the display device, the window screen of the application executed by the mobile device in the foreground output from the mobile device is displayed on the display device. An information processing apparatus having a window display unit. The information processing apparatus according to claim 7,
The window display unit displays the mobile device when an application executed in the background by the mobile device is executed in the foreground together with a window screen of an application executed in the foreground by the mobile device. An information processing apparatus that displays a captured image obtained by capturing a window screen output from the display device on the display device. An information processing apparatus according to claim 8, wherein
The foreground application switching unit accepts a user's selection operation of the captured image, and when the mobile device captures the selected captured image, the mobile device executes the application executed in the foreground. An information processing apparatus that causes an apparatus to switch to an application that has been executed in the foreground. An information processing apparatus according to claim 1, 2, 3, 4, 5, 6, 7, 8, or 9,
The information processing apparatus is an in-vehicle information processing apparatus mounted on an automobile. A computer program that is read and executed by a computer having a display device, a plurality of applications, and a mobile device that can execute one application in the foreground and can execute another application in the background. There,
The computer,
An information acquisition unit that acquires information of each application included in the mobile device from a mobile device connected to the information processing device;
A menu display unit for displaying an application menu screen on which icons of each application included in the mobile device connected to the information processing device are arranged on the display device;
Accepting the selection of the user's icon on the application menu, causing the mobile device to function as a foreground application switching unit that switches the application that the mobile device executes in the foreground to the application for which the icon has been selected,
The information of each application acquired by the information acquisition unit is a first type of application that is a type of application in which each application continues processing being executed in the foreground while executing in the background, Attribute information indicating whether it is a second type application that is a type of application that does not continue processing that was being executed in the foreground during execution in the background,
The menu display unit determines whether each icon is an icon of the first type application or an icon of the second type application based on the attribute information acquired from the mobile device. A computer program for generating and displaying the application menu screen represented in a discriminable form. A computer program according to claim 11, comprising:
The application menu screen is divided into a first display area of a first display area and a second display area, and the first display area contains the first type of application. A computer program, wherein icons are arranged, and icons of the second type of application are arranged in the second display area. A computer program according to claim 11, comprising:
Among the icons arranged on the application menu screen, the icon of the first type application is displayed in a form with a predetermined mark. A computer program according to claim 11, comprising:
Of the icons arranged on the application menu screen, the icon of the first type application is displayed in a form with a predetermined decoration. A computer program according to claim 11, 12, 13 or 14,
The menu display unit displays the application menu screen in which an icon of an application being executed in the foreground on the mobile device is displayed in a form that allows a user to distinguish it from other icons. A computer program according to claim 11, 12, 13, 14 or 15,
The menu display unit displays the application menu that is executed in the background on the mobile device among the icons arranged on the application menu screen in a form that allows the user to distinguish from other icons. A computer program characterized by displaying a screen. A computer program according to claim 11, 12, 13, 14, 15 or 16,
When the menu display unit does not display the application menu on the display device, a window that displays on the display device a window screen of an application that is output from the mobile device and that the mobile device is executing in the foreground. A computer program comprising a display unit. A computer program according to claim 17,
The window display unit displays the mobile device when an application executed in the background by the mobile device is executed in the foreground together with a window screen of an application executed in the foreground by the mobile device. A computer program for displaying a captured image obtained by capturing a window screen output from the display device on the display device. A computer program according to claim 18, comprising:
The foreground application switching unit accepts a user's selection operation of the captured image, and when the mobile device captures the selected captured image, the mobile device executes the application executed in the foreground. A computer program that causes an apparatus to switch to an application that has been executed in the foreground.