JP2008310791A - Information processor, menu generating method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display in a menu starting with an application program which requires larger work and time in the activation process when a menu for displaying the candidates of applications to be activated is displayed. <P>SOLUTION: A mobile terminal device 100 has a plurality of applications 102. A mobile terminal application selection support 121 monitors kinds of keys pressed down by a user and the frequency thereof and records them as a log before the activation of the application. Furthermore, while the menu is displayed, in the log recorded, the application which shows the history of the key operation matching the current key operation by the user is extracted as the application to be displayed on the menu. For every extracted application, based on the number of key operations needed for the activation and the time of operation, the order of priority is determined, and the order of display of the applications on the menu is adjusted according to the order of priority. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a technique for displaying a menu for starting an application on a display unit of an information processing device, and particularly to a technique for displaying a menu for starting an application on a display unit of a mobile terminal device such as a mobile phone.

Mobile phones are not only simple voice calls, but can be e-mailed, network browsing, cameras can be used, TV can be viewed, FM radio can be listened to, and music can be recorded and played back.
In other words, it has many functions and its usage is becoming complicated.

On the other hand, the user does not master all the functions and often uses a certain fixed usage.
However, in some cases, it may be necessary to use functions that are rarely used.
For example, the software update function may or may not be used occasionally, but it will be a problem because the problem will not be corrected if it is not used, but few people remember how to use it.

Alternatively, the lock setting is only used in certain cases, and for those who do not always use it, they often go through the menu with ambiguous memory.
In order to solve such a problem, not only a portable terminal but also a plurality of techniques for using an operation history are disclosed.

Japanese Patent Laid-Open No. 2002-101179 discloses a technique of storing a function once executed as a history and selecting and executing the history from the history for the purpose of not repeating a complicated operation on the mobile terminal. .
A technique is disclosed in which not all operation histories are taken, but only those that satisfy certain conditions are acquired as histories, and whether to store in advance for each function as a recording condition or at the time of execution The condition of designating such a thing is only disclosed.

For this reason, it is not mentioned that the operation itself is troublesome, the number of operations, and the deep hierarchical structure, and there is no suggestion regarding the ease of error of the operation.
Also, the selection from the history is not disclosed regarding the natural display in the normal menu.

  Japanese Patent Application Laid-Open No. 2006-185351 is a method of supporting user operations by putting an operation history in a menu. However, since the user explicitly specifies and enters the menu, the user remembers that function later. No such information is disclosed.

Japanese Patent Application Laid-Open No. 2000-261544 also discloses a technique that allows an operation that has been operated in the past to be called into a menu and called it. The technique of displaying is not disclosed.
Japanese Patent Laid-Open No. 2002-101179 JP 2006-185351 A JP 2000-261544 A

If the history of past operations is simply used as a method for supporting user operations, problems such as too many patterns of past operations occur.
In addition, it becomes difficult to identify candidate operations that are really necessary.
In addition, it is necessary to consider the ease of error in operation.

  Furthermore, under a specific situation, there is a high possibility that a specific application corresponding to the situation is activated, and it is desirable to display a menu that presents an application with a high possibility of activation for each situation.

One of the main purposes of the present invention is to solve the above-mentioned problems, and after considering the labor of the operation, the candidate is selected as a candidate of the application to be displayed on the menu from the one with a large degree of labor, In addition, since an operation error is often repeated, the main object is to realize a technique for displaying a menu structure that is easier to use by considering it as an effort including an error operation.
Furthermore, the main object is to realize a technique for displaying a menu structure that is easier to use by presenting application candidates that are likely to be activated for each situation through grasping the situation by a sensor or the like.

An information processing apparatus according to the present invention includes:
Information having a plurality of application programs, a display unit for displaying a menu for selecting an application program to be activated from the plurality of application programs to the user, and an operation unit operated by the user A processing device comprising:
An application start operation that indicates a start application program that is started each time the application program is started and a series of operations performed on the operation unit by the user until the start application program is started An application activation operation process information storage unit for storing process information;
An operation analysis unit that analyzes an operation performed on the operation unit by the user each time an operation is performed on the operation unit by the user when a menu is displayed on the display unit;
Each time the operation of the user is analyzed by the operation analysis unit, application start operation process information indicating an operation process that matches the progress of the user operation analyzed by the operation analysis unit is displayed. A menu generation unit configured to generate a menu that is extracted from the storage unit and presents a startup application program indicated in at least one of the extracted application startup operation process information, and to display the generated menu on the display unit; It is characterized by.

According to the present invention, the information indicating the operation process of a series of operations performed by the user before the activation application program is activated is stored as the application activation operation process information, which matches the progress of the user's operation on the menu. In response to the progress of user operations, the application launch operation process information indicating the operation process is extracted, and the menu for presenting the start application program indicated in the extracted application launch operation process information is dynamically generated and displayed. Appropriate menu display.
In particular, it determines the difficulty level of the operation and generates a menu to be presented with higher priority for the startup application program that has a greater difficulty level of the operation. Therefore, it is possible to preferentially present application programs that often end up, improving user convenience.

Embodiment 1 FIG.
The mobile terminal device (information processing device) according to the present embodiment traces until the final application designation every time a user requests to start an application using a menu or to start an application by pressing a key. The track of the menu is monitored, the track of the menu is recorded as a log, the type and number of keys pressed until the final application designation is monitored, and the type and number of pressed keys are recorded as a log.
Furthermore, when displaying the menu, the mobile terminal apparatus according to the present embodiment determines the priority order based on the contents of the log, and adjusts the display contents of the menu (application display order) according to the priority order.
When the menu is displayed, it is selected as a candidate for an application to be displayed on the menu, in consideration of the time and effort of the operation.
In addition, since an operation error is often repeated, a menu that is easier to use is displayed by considering it as time-consuming including an error key operation.
That is, the mobile terminal apparatus according to the present embodiment includes a menu based on information on what route the user has searched for and used the target function (application) in the past, including erroneous operations. Create configurations dynamically. Also, the list of application candidates to be displayed as a menu is not necessarily in the order of frequently used functions, and is a complicated function, and priority is given to functions that are occasionally used.
Here, an operation error is an extra operation such as returning to the menu hierarchy, redoing the operation, or taking a detour route instead of the shortest route to starting the target application.

Hereinafter, the portable terminal device according to the present embodiment will be described in detail with reference to the drawings.
First, FIG. 1 shows a configuration example of mobile terminal apparatus 100 according to the present embodiment.
The mobile terminal device 100 is an example of an information processing device, such as a mobile phone or a car navigation system.
The mobile terminal device 100 generally has a communication module or the like. However, since functions related to communication are not directly related to the essence of the present embodiment, only the portions related to the operation of the application are described in this description. A block diagram is shown.

In FIG. 1, a user interface unit 101 is a function serving as an interface between the mobile terminal device 100 and a user.
In a mobile phone or a car navigation system, the user interface unit 101 changes depending on H / W (Hard Wear), such as a different display size or a different number of keys, even for the same manufacturer. There is a part.
The user interface unit 101 includes functions such as a window system and a GUI (Graphical User Interface).

In the mobile terminal device 100, there are a plurality of application programs 102.
Hereinafter, the application program is also simply referred to as an application or an application.
The application 102 uses the user interface unit 101 to know the user's intention.
The application 102 is stored in a storage device such as an HDD / flash memory 1053, which will be described later, and is loaded into the memory 1052 and executed by the CPU 1051 at the time of activation, like an ordinary computer or mobile phone.
In FIG. 1, in order to emphasize the relationship with the mobile terminal application selection support unit 121, the mobile terminal application selection support unit 121 is intentionally illustrated.
The mobile terminal device 100 is one of the applications similar to the application 102, but has an application called a menu application 111. The menu application 111 provides a function of allowing the user to select another application by following a menu display and tracing the menu hierarchy.
Hereinafter, the menu application is also simply referred to as a menu application.

The mobile terminal application selection support unit 121 monitors the type and number of keys pressed by the user until the final application is specified for the menu displayed by the display unit 1054, and determines the type of the pressed key. Record the number of times as a log, and when the menu is displayed, determine the priority of the application to be displayed in the menu based on the contents of the log, and adjust the display content of the menu (application display order) according to the priority To do.
Details of the mobile terminal application selection support unit 121 will be described later with reference to FIG.

The middleware 103 is an intermediate layer between the application 102 and the OS, and is a layer that can be commonly used by various applications 102. Various applications 102 operate using the functions of the middleware 103.
An OS (Operating System) 104 is software that performs overall control of the mobile terminal device 100.

The H / W (Hard Wall) 105 includes, for example, a CPU (Central Processing Unit) 1051, a memory 1052, a HDD (Hard Disc Drive) or a flash memory (referred to as HDD / flash memory) 1053, and a display unit such as a liquid crystal display 1054 includes a key operation unit 1055 (operation unit) composed of a plurality of keys.
The display unit 1054 displays a menu for selecting an application to be activated from the plurality of applications 102 to the user.
The key operation unit 1055 is operated by the user, and inputs a user instruction for a menu displayed by the display unit 1054, for example.

Next, the mobile terminal application selection support unit 121 will be described with reference to FIG.
FIG. 2 shows details of the mobile terminal application selection support unit 121.

  The user operation log acquisition unit 201 acquires a log of operations performed by the user using the key operation unit 1055. The user operation log acquisition unit 201 will be described in detail with reference to FIG.

The log storage unit 202 has a function of storing the log acquired by the user operation log acquisition unit 201, and is a storage function including, for example, a flash memory and a hard disk.
In other words, the log storage unit 202 is a startup application program that is started every time an application program is started, and a sequence of operations performed by the user on the key operation unit 1055 until the startup application program is started. Is stored as a user log (application activation operation process information). The log storage unit 202 is an example of an application activation operation process information storage unit.

The application activation determination unit 203 determines that the application has been activated.
Specifically, it is confirmed whether or not an application program started as a result of the user's operation of the key operation unit 1055 is still running after a predetermined time has elapsed since the start.
The application activation determination unit 203 is an example of an operation confirmation unit.

  The menu display unit 204 outputs a menu to the display unit 1054 and causes the display unit 1054 to display the menu.

The menu complement unit 205 generates the menu by dynamically changing the menu. The menu complementing unit 205 is an example of a menu generating unit.
Each time the user operation is analyzed by the user operation log acquisition unit 201, the menu complementing unit 205 displays a user log (application) indicating an operation process that matches the progress of the user operation analyzed by the user operation log acquisition unit 201. (Startup operation process information) is extracted from the log storage unit 202, a menu for presenting the startup application program indicated in at least one of the extracted user logs is generated, and the generated menu is displayed on the display unit 1054.
Further, when a plurality of user logs are extracted, the menu complementing unit 205 is difficult to operate until the startup application program is started based on the contents of the user log for each startup application program indicated in the extracted user log. A menu to be preferentially presented is generated for a startup application program having a greater degree of difficulty.
Here, as a criterion of the difficulty level, for example, an operation time (time required for activation) required until the activation application program is activated, a key operation number (activation) required for the activation of the activation application program The number of required operations), and the value of the calculation result using these.
A method for deriving the operation difficulty will be described later.

Next, a configuration example of the user operation log acquisition unit 201 illustrated in FIG. 2 will be described.
FIG. 3 shows a configuration example of the user operation log acquisition unit 201.

301 is an application. A menu application 401 exists as one of the applications. The application 301 and the menu application 401 are the same as the application 102 and the menu application 111 shown in FIG.
As described above, the application 301 and the menu application 401 are stored in a storage device such as the HDD / flash memory 1053 before activation, and loaded into the memory 1052 at the time of activation, as in the case of a normal computer or mobile phone. Although executed by the CPU 1051, since it is strongly related to the user operation log acquisition unit 201, it is shown in association with the user operation log acquisition unit 201.

The application management unit 302 performs application activation control and the like.
For example, it is assumed that a specific application is designated by the menu application 401 among the applications 301. When the application management unit 302 is notified that the application is to be activated, the application management unit 302 determines whether the application is already activated or activated, whether another application is activated and is not in an exclusive state, or the like. After checking the above, allow the application to start.
In addition, the application management unit 302 notifies the application activation information transmission unit 303 of a function related to the activation of the application.

When the menu is displayed on the display unit 1054, the key event acquisition unit 304 analyzes an operation performed on the key operation unit 1055 by the user every time the user operates the key operation unit 1055.
The application specifying unit 305 determines an application started as a result of a key operation by the user.
The key event acquisition unit 304 and the application identification unit 305 are examples of an operation analysis unit.

Each time a key is pressed or released, the application is notified as an event.
The menu application 401 sees this event and moves the focused part or knows that a specific application has been determined.
The user operation log acquisition unit 201 acquires information about the key event from the menu application 401, knows the information of the finally specified application from the menu application 401, and specifies the application.
The user operation log acquisition unit 201 can acquire information corresponding to all such key presses and the application.
In this way, the application is selected by the menu application, and the user operation log acquisition unit 201 acquires information that the user has started the application by acquiring the key operation and the information of the started application, and the log storage unit 202. As a user log.

Next, an example of a user log in the log storage unit 202 will be described.
Reference numeral 501 in FIG. 4 stores the information of the activated application and the menu position information as a pair. Specifically, the application information is information that can uniquely identify the application, and may be an ID or an application name.
The menu position information is information indicating the position on the hierarchy, and may be expressed as a character string, or may be expressed in a format using information on the order of the hierarchy that can be uniquely specified.
For example, in the case of (1, 2, 1), the first item in the second item in the first item of the menu may be used.
In this case, if the same application can be started from multiple locations with a function that shows a shortcut, and the application is started following a different hierarchy, it is recorded and saved separately. Also good.
Reference numeral 501 is information that should be referred to as an optimal solution for starting each application, and does not indicate the transition of operations performed by the user in the past, and includes errors in operations such as returning to the menu hierarchy and redoing operations. Absent.
For this reason, 501 is not directly related to the menu display that takes into account the trouble of operation described in the present embodiment, and the features according to the present embodiment are mainly realized by the contents of 502.

Reference numeral 502 in FIG. 4 stores an application ID that uniquely identifies the application, an application name, and key press information indicating which key is pressed and how many times this key is specified.
For example, the first line of 502 indicates that the application 1 is activated by pressing a key in the order of 1 → 2 → 5 → 1. Note that the numbers in the key press columns are the numbers corresponding to the pressed keys. The key press row may include special characters such as alphabets, Japanese syllabary and asterisk in addition to numbers.
In addition, it is thought that there is an operation of going back and forth when the key is pressed, but since it is different as the key press column, there are logs of multiple types of key press columns as the key press column when starting the same application It doesn't matter.
Also, a key event for performing an operation of returning one by one, such as a clear key of a mobile phone, may be recorded as just one of the key press columns.
As described above, reference numeral 502 denotes a series of key operation operations performed by the user on the key operation unit 1055 in order to start the application. The log storage unit 202 stores the same application. On the other hand, two or more user logs each indicating a different operation process may be stored. In addition, when there is a clear operation that clears the operation performed immediately before, the user log operation including the clear operation is stored, and a user log indicating the operation process of a series of operations including the clear operation is displayed. Remembered.

Next, FIG. 5 shows an example of menu display of mobile terminal apparatus 100 according to the present embodiment.
(1) to (5) in the figure are application activation candidates under this menu hierarchy, and are dynamically changing portions.
The parts (6) to (9) are fixed menus in this menu hierarchy.
In the menus (1) to (5), applications whose priorities are determined based on the user's operation history and based on the operation effort (operation difficulty level) are shown according to the priorities. In the example of FIG. An application that has been activated by the user in the past and that is determined to have a large operation effort (degree of operation difficulty) is preferentially (higher) displayed.

Next, an outline (menu generation method) of the operation of mobile terminal apparatus 100 according to the present embodiment will be described.
FIG. 6 is a flowchart for explaining an outline (menu generation method) of the operation of mobile terminal apparatus 100 according to the present embodiment.

First, the menu display unit 204 outputs a Top menu to the display unit 1054, and the display unit 1054 displays the Top menu (S101). The Top menu is prepared as a default.
Next, when the user operates the key operation unit 1055, the key event acquisition unit 304 detects the key operation by the user (S102), and the key event acquisition unit 304 and the application identification unit 305 analyze the contents of the key operation. (S103) (operation analysis step).

If the content of the user's key operation is not an application activation request (NO in S104), that is, if the user has not designated the application to be activated and is still working on the menu hierarchy, the menu complementing unit 205 However, the user log of the key press sequence that matches the progress of the key operation by the user is extracted from the log storage unit 202 to obtain application candidates (S105) (menu generation step).
For example, if the progress of the key press by the user is 1 → 2, the application 1 (1 → 2 → 5 → 1) and the application 2 (1 → 2 → 4) in which the key press sequences matching this are stored. → 2) is a candidate for menu display.
Next, the menu complementing unit 205 generates a menu indicating the application candidates acquired in S105 (S106) (menu generation step). When generating the menu, the menu complementing unit 205 determines a priority order among the application candidates based on the operation time (operation difficulty level), and generates a menu for displaying the application candidates according to the priority order.
Next, the menu display unit 204 outputs the menu dynamically generated by the menu complementing unit 205 to the display unit 1054, and the display unit 1054 displays the menu (S107).
In parallel with S105 to S107, the log storage unit 202 stores the user's key operation (S108) (application activation operation process information storage step).
In FIG. 6, S108 is performed after the processing of S105 to S107, but S108 may be performed before the processing of S105 to S107, or performed simultaneously with the processing of S105 to S107. It may be broken.

On the other hand, when the user's key operation is an application activation request (YES in S104), that is, when the user designates a specific application on the menu and requests activation of the application, the application management unit 302 The activation of the application is permitted, and the application is activated (S109).
Further, the log storage unit 202 stores the startup application name or the startup application ID in association with the key press column of the user log stored in S108, as indicated by 502 in FIG. 4 (S110) (application startup operation) Process information storage step).
In FIG. 6, S110 is performed after the process of S109, but S110 may be performed before the process of S109 or may be performed simultaneously with the process of S109.

  Next, the operation of each unit of the mobile terminal device 100 will be described in detail.

First, FIG. 10 shows a flowchart showing an operation example of the key event acquisition unit 304 and the application identification unit 305.
The key event acquisition unit 304 waits for a key event. Each time a key is pressed or released, the key event acquisition unit 304 is notified as an event. The key event acquisition unit 304 scans for a change in state such as a key press or release in step S1001.
If the state changes, the key event acquisition unit 304 determines whether the key is pressed or released in step S1002.
Next, in step S1003, the key event acquisition unit 304 acquires information on the pressed position or the released position. In step 1004, the key event acquisition unit 304 determines whether the pressing is a release, a release, or a release. In this case, it is determined whether it is a long press from the point of how many seconds it was pressed.
In step S1005, the key event acquisition unit 304 notifies the application specifying unit 305 together with information on the type of event as a key event and which key is pressed at which cursor position.
On the other hand, the key event acquisition unit 304 returns the process to step S1001. If there is a state change, the key event acquisition unit 304 repeats the processes after S1002.

The application identifying unit 305 is waiting for an event in step S1011. If there is an event notification from the key event acquisition unit 304, the application identifying unit 305 stores the received event in the log storage unit 202 in step S1012. At this time, the information stored in the log storage unit 202 is only the information of each key in the key press column indicated by 502 in FIG. 4, and the application name or application ID is not stored.
Next, the application specifying unit 305 determines whether or not to start the process in step S1013. For example, nothing is done in the event of only moving the cursor, and the application is notified only when the enter key is pressed. That is, the application specifying unit 305 determines whether or not the user has requested activation of a specific application based on the key operation information notified from the key event acquisition unit 304, and the user is requested to activate the application. If not (“unnecessary” in S1013), the process returns to step S1011. If activation of the application is requested by the user (“necessary” in S1013), the process proceeds to step S1014.
In step S <b> 1014, the application specifying unit 305 specifies an application that is requested to be activated and notifies the application that is requested to be activated to be activated.
Next, in step 1015, the application specifying unit 305 stores information on the application requested to be activated by the user in the log storage unit 202. Thereby, the relationship between the application and the key is saved. In other words, at this stage, the application name or application ID 502 in FIG. 4 is stored, the application is associated with the key press sequence, and a series of steps performed by the user on the key operation unit 1055 until the application is started. The operation process of the operation is stored in the log storage unit 202.

Next, a flowchart showing an example of the operation of the menu complementing unit 205 is shown in FIG.
First, in step S801, the menu complementing unit 205 acquires hierarchical information indicating where the menu is currently located. For example, when the key event acquisition unit 304 notifies the application specifying unit 305 of the key press position and the like in step S1005 of FIG. Get as.
In step S <b> 802, the menu complementing unit 205 acquires information on applications used in the past in a layer below this layer.
Specifically, the menu complementing unit 205 extracts a user log of a key press sequence that matches the progress of the key operation by the user from the log storage unit 202, and acquires application candidates.
Here, the menu complementing unit 205 may include not only a lower layer, but also an application found once entering the lower layer and returning to another layer.
For example, when the user's key operation is 1 → 2 → 3 → clear key → 5, the 3rd key is pressed after the 2nd key is pressed, but the 3rd key is changed by pressing the clear key later. The operation of pressing is cleared (cancelled) and indicates that the fifth key has been pressed again. The progress of the key operation in this case is not completely coincident with the first line 502 in FIG. 4, but the operation of 2 → 3 → clear key → 5 is substantially the same as 2 → 5. Therefore, the progress of the user operation and the series of operation processes shown in the first line 502 in FIG. 4 are common, and the first line 502 in FIG. 4 can be applied to acquire the application 1 as an application candidate. it can.
Conversely, when the user log 1 → 2 → 3 → clear key → 5 is stored in the log storage unit 202 as an operation process for starting the application 1, the user operates the key operation 1 → 2 → 5. In the case where both are performed, both are determined to be substantially the same operation, and the application 1 can be acquired as an application candidate for the user operation. The progress of the key operation in this case and the operation process shown in the user log do not completely match, but the operation of 2 → 3 → clear key → 5 is substantially the same as 2 → 5. Therefore, the progress of the user operation and the series of operation processes of the user log are common, and the application 1 can be acquired as an application candidate.

Next, when acquiring a plurality of applications, the menu complementing unit 205 determines the priority order between the applications in step S803.
Next, in step S804, the menu complementing unit 205 extracts higher-ranked application candidates according to the priority order obtained in step S803.
This extraction may be determined using an appropriate number, such as matching the size of the screen.
Thereafter, the menu complementing unit 205 adds the candidate extracted in step S804 to the menu list in step S805. In addition, the menu list includes, for example, fixed menus such as (6) to (9) in FIG.
In step S806, the menu complementing unit 205 passes the menu list to the menu display unit 204, and the menu display unit 204 displays the menu on the display unit 1054.

Next, an example of a detailed procedure in step S803 will be described.
In step S811, the menu complementing unit 205 acquires a parameter for determining the order.
This parameter may be from a recently used one, a parameter based on the number of operations expressed by the number of key events and the time taken for the operation, or a parameter such as the menu depth. Also good.

In the following, an example in which the effort of the user operation (operation difficulty level) is used as a criterion for determining the priority order will be described. The effort of the user operation (operation difficulty level) is determined by the number of key events and the time until the application is specified.
For this reason, the menu complementing unit 205 calculates the operation time (required activation time) required for starting the application and the number of key operations (required activation operation) required for the application program activation. It is a parameter.
Although not shown in FIG. 4, the log storage unit 202 activates the application together with the operation process (key press string) of a series of operations performed on the key operation unit 1055 by the user until the application is activated. The user log (application activation operation process information) indicating the operation time (starting time) required until the operation is stored, and the menu complementing unit 205 stores the operation time information from the log storage unit 202 in step S811. Can be obtained.
Further, as shown in FIG. 4, the log storage unit 202 stores information on key press columns for each application, and the key press columns indicate the number of key operations. For example, the first row of 502 in FIG. 4 shows a key press column of 1 → 2 → 5 → 1. From this key press column, the number of key operations required to start application 1 is 4. It is guided to be. As described above, the menu complementing unit 205 can acquire the information of the key press column as the information on the number of key operations from the log storage unit 202 in step S811.

  In step S812, the menu complementing unit 205 orders the applications according to the parameters determined in step S811, and here, S1101 to S1104 shown in FIG. 11 will be described as details of step S812.

In step S1101, the menu complementing unit 205 acquires information on the number of key operations for each application from the log storage unit 202, and calculates an average number of key operations for each application. As described above, when two or more different key operations are performed to start the same application, each key operation is stored as a user log. Here, two or more key operations for a common application are stored. The average number of key operations is obtained by integrating the number of key operations (key press string).
Next, in step S1102, the menu complementing unit 205 acquires the time (operation time) until the application is selected for each application from the log storage unit 202 in units of seconds, and also counts the average number of seconds for each application. To do.
Next, in step 1103, the menu complementing unit 205 sums up the number of operations and the number of seconds calculated in steps S1101 and S1102.
Next, in step S1104, the menu complementing unit 205 selects an application by determining the priority order from the one having the larger numerical value calculated in step S1103.

Here, when calculating the total of the average number of operations and the average number of seconds, each may be added with a weight.
In the above description, the priority order is determined based on the total value of the average number of operations and the average number of seconds, but only one of the number of operations and the operation time is used. The priority order may be determined only by the magnitude of the operation time.
Even when both the average number of operations and the average number of seconds are used, other types of calculation other than addition may be performed, and the priority order may be obtained based on the value of the calculation result.

  Further, in this flow, as the number of operation errors, the number of times of returning to the same hierarchy by a key event may be obtained from the log, and this average number may be added and used as information for determining the priority.

  In addition, the log storage unit 202 stores a user operation including a clear operation when the user performs a clear operation that clears the operation performed immediately before, and performs a series of operation operations including the clear operation. A user log indicating the process is stored, and the menu complementing unit 205 counts the number of clear operations indicated in the user log for each application, and performs a calculation using the number of key operations, the operation time, and the number of clear operations. It is also possible to generate a menu that preferentially presents for an application program having a larger calculation result value.

  Finally, in step S813, the menu complement unit 205 lists application candidates according to the priority order.

The user operation can be supported by the method as described above.
In particular, it is not a function that is frequently used, but it is possible to present application candidates for operations that are forgotten immediately or operations that are often mistaken, and this has the effect of improving convenience.

In the following, an example of a processing flow of the application management unit 302 and the activation target application illustrated in FIG. 9 will be described, and an example of a processing flow of the application activation determination unit 203 illustrated in FIG. 7 will be described.
The processing shown in FIGS. 9 and 7 is one of the features of the present embodiment, which monitors user operations up to application specification, stores the user operations up to application specification, and displays the user at the time of menu display. Although not directly related to the function of selecting candidate applications to be displayed on the menu in consideration of the operation, it will be described because it relates to the activation of the application.

Here, an example of the processing flow of the application management unit 302 and the activation target application will be described with reference to FIG.
Note that the application to be activated described in FIG. 9 is an application that has been requested to be activated by a user's key operation and has been notified by the application specifying unit 305 in step S1014 of FIG. is there.

First, in step S911, the application management unit 302 is inquired whether the application to be activated is in a state where it can be activated.
At this stage, the application to be activated is not activated as an active state (full-scale activation), but is activated in a preparation stage in which preparation processing is performed before full-scale operation.
Upon receiving the activation notification in step S901, the application management unit 302 looks at the activation management table and returns an OK / NG determination to the activation target application.
The activation management table has information indicating that it has already been activated and information indicating that it cannot be activated in another specific state, and determines whether the activation target application can be activated based on these information.
If the notification from the application management unit 302 is OK in step S912, the application is actually started (S913). When the startup is completed, the application notifies the application management unit 302 of the startup in step S914. To get the application up and running.
On the other hand, if it is determined in step S912 that the application cannot be activated, the application is terminated without being activated.
After confirming activation, the application management unit 302 determines in step S903 whether or not activation activation has been confirmed for the activation target application. If activation activation is confirmed, activation notification is issued. Wait for.
In step S904, the application management unit 302 waits for the activation notification. After receiving the activation notification, the application management unit 302 changes the management table to a state in which a certain application has been activated, and the application activation information transmission unit 303 is activated. Information that a certain application is activated is transmitted to the function related to the application.
For example, by broadcasting, each application can operate based on the information related to itself, but can be ignored if the information is not related to itself.
Specifically, for example, when there is a mail function and the mail filter function is activated, the mail function looks at the activation notification of the mail filter function and does not go directly to receive mail. You can use it like receiving from the filter function.
The application management unit 302 need not know these details and can be implemented.
In step S906, a log of the activated application is saved. Note that the log of this application is a log used for a purpose different from the menu generation of FIG. 8, and detailed description thereof is omitted.

Next, an example of a processing flow of the application activation determination unit 203 will be described with reference to FIG.
The application activation determination unit 203 operates after receiving the application activation notification in S601.
In step S602, the application activation determining unit 203 acquires information indicating which application has been activated correctly.
This acquisition is acquired from the application management unit 302 or log information.
The application activation determination unit 203 waits for a certain time, for example, 5 seconds, in S603, and then checks whether the application is activated in Step S604. If it is activated, the application activation determination unit 203 determines that the application has been activated correctly in Step S605. To do.
On the other hand, if it is not activated, it is determined in step S606 that this application has been activated by mistake and is not originally activated.
This result is reflected in the log storage unit 202, and if it is not activated, it does not remain as a log (that is, the key press string stored so far is deleted).
Further, the application activation determining unit 203 may take a method of waiting again after seeing the input state of the key after waiting for a certain time and when nothing is input. This designation may be performed for each application.

  As described above, in the present embodiment, the user operation log acquisition function, the log storage function, the application activation determination function, and the application selection are performed on a device that is carried around, such as a mobile phone or a car navigation device, or that is moved on a car. A mobile terminal device having a menu display function has been described.

  In addition, a mobile terminal device has been described in which the user operation log acquisition function has an application management function for managing application activation and an application activation information transmission function for transmitting information indicating which application has been activated.

  Further, the mobile terminal device has been described in which the user operation log acquisition function has a key event acquisition function for acquiring a user key operation log and an application specification function for specifying a correspondence between the key event and the application.

  Further, the mobile terminal apparatus in which the log storage function stores the application activation history and the hierarchical structure on the menu has been described.

  In addition, the mobile terminal device in which the log storage function stores a plurality of key events from the pressing of the menu key for specifying the application activation history and the application key has been described.

  Further, the mobile terminal device that determines that the application activation determination function has been activated when the application has been activated and has not been completed within a certain time has been described.

  In addition, a mobile terminal device has been described in which the menu display function includes a predetermined fixed menu display function and a menu display function that dynamically determines the configuration.

  In addition, the above-described menu display function that dynamically determines the configuration has a history terminal function that displays a menu by selecting an application that has been used in the past based on a user operation log from among applications below that hierarchy. Explained.

  In addition, the mobile terminal device has been described in which the history menu function is used in the past from applications under the specified menu hierarchy and displayed on the dynamic menu display unit in order from the most recent one.

  In addition, for the mobile terminal device in which the history menu function is used in the past from the applications under the specified menu hierarchy and displayed on the dynamic menu display unit in the order of the deepest hierarchy from that hierarchy. explained.

  In addition, the above-mentioned history menu function has been used in the past from applications under the specified menu hierarchy, and it is below that hierarchy, and the user operation log has a lot of trouble for user operations. The mobile terminal device displaying from the above has been described.

  In addition, the above-described history menu function is an application that has been used by viewing the user log from the hierarchy after having been used in the past from among the applications below the specified menu hierarchy, In addition, the mobile terminal device that displays the items that require a lot of user operation has been described.

  In addition, the mobile terminal device has been described in which the above-described user operation is determined by the number of key events and the time until application identification.

  In addition, a mobile terminal device has been described in which the above-described user operation is determined by the number of key events, the time until application identification, and the number of times that a specific key event has erroneously returned to the hierarchy.

Embodiment 2. FIG.
In the present embodiment, an example will be described in which a menu that presents an application having a high possibility of activation is displayed for each situation.
In the present embodiment, the state of the mobile terminal device is managed and analyzed, and a menu for presenting an application that is likely to be activated is generated according to the state of the mobile terminal device.
Specifically, in the present embodiment, the following states are managed and analyzed.
(1) State management in the case where an external event is received and the state is changed, and management when the state is not canceled until a specific operation is performed.
(2) Management in the case where a state changes in response to an event reception from the outside and the state is maintained for a certain period of time
(3) Management that grasps the external situation through a sensor or the like and maintains the state unless the situation changes.
(4) Management when the external situation is grasped through a sensor or the like, and the situation does not change unless a specific operation is performed even if the situation changes.

As an example of the above (1), it is assumed that, for example, an e-mail (message example) is received as an example of an external event, and a notification of a software update request is included in the content.
Determination can be made if there is a word (keyword) of software update notification in the subject part of the e-mail. Such a word (keyword) to be extracted may be one whose meaning is not recognized by the user (for example, a code meaning software update notification).
In such a case, the software update is necessary until the software update is executed, and the possibility of selecting the software update function is increased until the software update is executed. That is, a menu that preferentially presents an application called software update is generated.

As an example of (2), for example, as an example of an event from the outside, it is assumed that an e-mail (example of message) is received and the content (keyword) of a reply is included in the content.
The determination can be made when there is a word (keyword) of a reply required in the subject part.
However, replying to an e-mail may not be carried out on the same mobile phone, and it does not make sense after many days.
Therefore, the state is valid only for a fixed time.
In other words, a menu that preferentially presents an application called mail reply for a certain time is generated.

In addition, as an example of (3), the peripheral state of the mobile terminal device, for example, the out-of-service state (presence / absence of arrival of radio waves from the base station of the mobile phone network), radio waves such as a wireless LAN (Local Area Network), etc. It is a function that monitors whether or not it enters.
The situation changes if the situation changes.
That is, for example, if the mobile terminal device is in an area where radio waves of a wireless LAN enter, the probability that an application related to the wireless LAN is selected increases.
For this reason, when a communication wave for wireless LAN has arrived at the mobile terminal device, a menu that preferentially presents an application involving wireless LAN communication is generated.

An example of (4) is a sensor for physical condition management.
Various sensors such as a pulse sensor, a bad breath sensor, and a body temperature sensor are conceivable.
This is whether it can be assumed that if the situation changes once in a bad direction, by leaving the fact, the person's work will also change.
For example, if the pulse, bad breath, body temperature, etc. exceed normal values, it is highly likely that the application for physical condition management will be activated, so the application for physical condition management is presented with priority. Generate menus.
After a certain time, the state may be restored (application for physical condition management is not presented preferentially).

  Next, the details of the mobile terminal apparatus according to the present embodiment will be described. For convenience of description, the mobile terminal apparatus corresponding to the above (1) and (2) will be described first, and then the above (3) and ( A mobile terminal apparatus corresponding to 4) will be described.

FIG. 13 shows a configuration example of the mobile terminal apparatus 100 corresponding to the above (1) and (2).
FIG. 13 is the same diagram as FIG. 1 in the first embodiment, and a communication I / F (interface) 105 and a communication processing unit 106 (message receiving unit) are added as compared to FIG.
Other elements are the same as those shown in FIG.

The communication I / F 105 is hardware that serves as an interface when the mobile terminal device 100 performs an external communication device. Receive.
The communication processing unit 106 performs e-mail transmission / reception processing while managing the communication I / F 105, which is a physical interface, managing transmission control procedures, managing network connection procedures, and the like.

FIG. 14 is a diagram illustrating a configuration example of the mobile terminal application selection support unit 121 according to the present embodiment, and is the same diagram as FIG. 2 in the first embodiment.
In FIG. 14, the message analysis unit 206 analyzes whether or not a keyword related to any application is included in the electronic mail (example of message) received by the communication processing unit 106.
The keyword is stored in the extraction target keyword information storage unit 207, which will be described later, and the message analysis unit 206 analyzes whether or not the keyword stored in the extraction target keyword information storage unit 207 is included in the received e-mail. To do.
For example, if the word “software update” is stored as a keyword, the message analysis unit 206 analyzes whether the word “software update” is included in the subject of the e-mail, for example.

The extraction target keyword information storage unit 207 stores extraction target keyword information indicating keywords to be extracted by the message analysis unit 206, applications corresponding to the keywords, and the like.
An example of the extraction target keyword information is shown in FIG.
FIG. 15 shows a message type, an extraction target keyword, an application to be included in the menu when the extraction target keyword is extracted (extraction keyword-related application program), and an exclusion event for excluding the application from the menu. .
For example, as shown in the first line of FIG. 15, when the keyword “software update” is included in the email, “software update application” is preferentially presented in the menu, and the “software update” is displayed. After one week has passed since the execution of “ware update application” or a predetermined time (for example, keyword extraction time), “software update application” is excluded from the menu, or the priority of “software update application” (displayed) (Ranking) is lowered.

Further, the menu complementing unit 205 (menu generating unit) performs an operation similar to that shown in the first embodiment, but in this embodiment, the menu complementing unit 205 causes the message analysis unit 206 to execute any application. When a keyword related to is extracted from an e-mail, a menu that preferentially presents the application related to the extracted keyword (extracted keyword related application program) to other applications is generated, and the generated menu is displayed as a menu. Displayed on the unit 204.
Note that the menu complementing unit 205 gives priority to the application when it is necessary to display a menu until the application activation determining unit 203 determines that an application related to a keyword (extracted keyword-related application program) has been activated. After the application activation determination unit 203 determines that the application (extracted keyword-related application program) is activated, a menu that does not present the application is generated.
Further, the menu complementing unit 205 relates to the keyword when the menu needs to be displayed within a predetermined time (for example, one week) from the keyword extraction time or the display time of the e-mail containing the keyword on the display unit 105. A menu for presenting an application (extracted keyword-related application program) is generated, and the application is presented after a predetermined time (for example, one week) has elapsed from the keyword extraction time or the e-mail display time on the display unit 105. Generates a menu that is not (or has a low priority for gargle applications).

  The application activation determination unit 203 (activation determination unit) is also the same as in the first embodiment, and determines whether or not an application related to a keyword (extracted keyword-related application program) is activated.

The user operation log acquisition unit 201 is as shown in the first embodiment and has a lower hierarchy shown in FIG.
The log storage unit 202 and the menu display unit 204 are also as described in the first embodiment, and detailed description thereof is omitted.

Next, the operation of mobile terminal apparatus 100 according to the present embodiment will be described with reference to FIG. 16 and FIG.
FIG. 16 shows a process for extracting a keyword from an e-mail (message) and designating a priority presentation application to be preferentially presented on the menu, and FIG. 17 generates a menu for presenting the priority presentation application. The processing when displaying is shown.

First, in the mobile terminal device 100, the key event acquisition unit 304 shown in FIG. 3 determines whether browsing of an e-mail (message) is requested by a user's key operation or the like (S1601), and browsing is requested. If not (NO in S1601), the process waits until browsing is requested. If browsing is requested (YES in S1601), the message analysis unit 206 sends an e-mail (message) stored in the mobile terminal device 100. ) Is analyzed (S1602) (message analysis step).
Specifically, it is analyzed whether or not an extraction target keyword (keyword stored in the extraction target keyword information storage unit 207) is included in a subject (or an e-mail body) of an unread email. To do.

If the keyword to be extracted is not included in the e-mail (NO in S1603), the process ends.
On the other hand, if the analyzed e-mail contains a keyword to be extracted (YES in S1603), the message analysis unit 206 selects an application (extracted keyword-related application program) related to the extracted keyword as an application activation determination unit. In order to determine whether or not an application related to the extracted keyword is to be executed, the process waits for a predetermined time (S1604).
Next, the application activation determination unit 203 determines whether an application related to the extracted keyword (extracted keyword-related application program) has been executed (S1605).
If an application related to the extracted keyword is executed (YES in S1605), it is not necessary to display a menu including the application, and the process ends.
On the other hand, if an application related to the extracted keyword is not executed (NO in S1605), the message analysis unit 206 uses the application related to the extracted keyword (extracted keyword-related application program) as a priority presentation application. The complement unit 205 is notified (S1606). Further, when “execution of application” is indicated as an exclusion event in the extraction target keyword information (FIG. 15), the message analysis unit 206 requests the application activation determination unit 203 to monitor whether the priority presentation application is activated again. .

  For example, if the exclusion event column of the extraction target keyword information indicates that the priority presentation application is excluded from the menu after a certain period of time has elapsed from the keyword extraction time, the message analysis unit 206 is not explicitly shown in the flowchart. May be stored in a memory, a register, or the like and used to calculate the time when the priority presentation application is excluded from the menu.

Next, FIG. 17 will be described.
First, the key event acquisition unit 304 detects a user's key operation (S1701), and analyzes the contents of the key operation (S1702).
If the user's key operation does not require menu display (NO in S1703), the process requested by the user is executed (S1708).
On the other hand, if the user's key operation requests menu display (YES in step S1703), the menu complementing unit 205 determines whether there is a priority presentation application notified from the message analysis unit 206 ( S1704) If there is no priority presentation application (NO in S1704), the menu complementing unit 205 prepares a normal TOP menu, the menu display unit 204 outputs the normal TOP menu to the display unit 1054, and the display unit 1054 A normal TOP menu is displayed (S1707).
On the other hand, if there is a priority presentation application (YES in S1704), the menu complementing unit 205 generates a menu that presents the priority presentation application with priority over other applications (S1705) (menu generation step). For example, a menu showing the priority presentation application at the top is generated.
Next, the menu display unit 204 outputs the menu to the display unit 1054, and the display unit 1054 displays the menu (S1706).

  For example, when the exclusion event column of the extraction target keyword information indicates that the priority presentation application is excluded from the menu after a lapse of a certain time from the menu display time, the display unit 1054 is not explicitly shown in the flowchart. The time at which the menu including the priority presentation application is displayed may be stored in a memory, a register, or the like, and used to calculate the time when the priority presentation application is excluded from the menu.

Next, an operation example when the mobile terminal apparatus 100 according to the present embodiment excludes the priority presentation application from the menu will be described with reference to FIGS. 18 and 19.
FIG. 18 shows an operation example in which the priority presentation application is excluded from the menu by executing the priority presentation application, and FIG. 19 shows an operation example in which the priority presentation application is excluded from the menu as time elapses.

In FIG. 18, the application activation determination unit 203 monitors whether or not the priority presentation application requested to be monitored by the message analysis unit 206 is executed. If the priority presentation application is executed (YES in S1801), the application activation determination unit 203 notifies the menu complementing unit 205 that the priority presentation application has been executed, and the menu complementing unit 205 excludes the target priority presentation application from the menu presentation target (S1802).
As a result, the application is not included in the subsequent menus.

In FIG. 19, the menu complementing unit 205 determines whether or not a predetermined time has elapsed from the keyword extraction time by the message analysis unit 206 (S1901).
The predetermined time is the time described in the exclusion event column of the extraction target keyword information (FIG. 15).
In FIG. 19, the keyword extraction time is used as the starting point. However, for example, the first display time of the menu including the priority presentation application may be used as the starting point, or the e-mail (message) including the keyword may be used as the starting point. The reception time may be used as a starting point.
When the predetermined time has elapsed since the keyword extraction (YES in S1901), the menu complementing unit 205 excludes the target priority presentation application from the menu presentation target (S1902).
As a result, the application is not included in the subsequent menus.

  Next, the mobile terminal apparatus corresponding to the above (3) and (4) will be described.

FIG. 20 shows a configuration example of the mobile terminal apparatus 100 corresponding to the above (3) and (4).
FIG. 20 is a diagram similar to FIG. 1 in the first embodiment, and a sensor 1057 is added as compared to FIG.
Other elements are the same as those shown in FIG.
The sensor 105 detects the arrival of radio waves for short-range wireless communication such as wireless LAN and infrared communication.
The sensor 1057 includes a pulse meter, an odor meter, a thermometer, and the like, and detects an event relating to the state of the user's body using the mobile terminal device 100 such as a pulse, bad breath, and body temperature. When detecting a pulse or a body temperature, for example, the sensor 1057 may be attached to a user's body part (such as a wrist).

FIG. 14 is a diagram illustrating a configuration example of the mobile terminal application selection support unit 121 according to the present embodiment, and is the same diagram as FIG. 2 in the first embodiment.
The state monitoring unit 208 monitors the peripheral state of the mobile terminal device 100 through the sensor 1057.
Specifically, the state monitoring unit 208 monitors the presence or absence of short-range wireless communication radio waves such as a wireless LAN as the peripheral state, and also the state of the user using the mobile terminal device 100 (pulse, Monitor bad breath, body temperature, etc.)
If the state shown in the menu presentation application program definition information stored in the menu presentation application program definition information storage unit 209 (described later) has occurred, the state monitoring unit 208 notifies the menu complementing unit 205 of the state.

The menu presentation application program definition information storage unit 209 stores menu presentation application program definition information that defines an application to be presented on the menu according to the peripheral state of the mobile terminal device 100.
Specifically, the menu presentation application program definition information storage unit 209 stores menu presentation application program definition information that defines an application to be presented on the menu when the arrival of radio waves for near field communication such as a wireless LAN is detected. I remember it.
Further, the menu presentation application program definition information storage unit 209 stores menu presentation application program definition information that defines application programs to be presented on the menu according to the physical state of the user of the mobile terminal device 100.
FIG. 22 shows an example of menu presentation application program definition information stored in the menu presentation application program definition information storage unit 209.
In the example of FIG. 22, as a state, a state where a radio wave of wireless LAN or infrared communication is detected, a state where the user's pulse is out of the range of 50 to 100 beats / minute, a user's bad breath has an odor degree of 230 or more. State is defined.
In addition, as an application corresponding to each state, for example, a game application A that can communicate with a communication partner by performing wireless LAN communication, a game application B that can perform a battle with a communication partner by performing infrared communication, and a doctor A telephone application for making a phone call and a mail application for sending an email to the attending physician are defined. In addition, an Internet connection application for connecting to an Internet site that provides medical information may be defined.
In addition, an exclusion event for excluding each application from the menu is also defined.

Further, the menu complementing unit 205 (menu generating unit) performs an operation similar to that shown in the first embodiment, but in this embodiment, when a specific state is detected by the state monitoring unit 208, Based on the specific state detected by the state monitoring unit 208 and the application definition in the menu presentation application program definition information, a specific application is selected from a plurality of applications, and the selected specific application is selected more than other applications. A menu to be presented with priority is generated, and the generated menu is displayed on the menu display unit 204.
Specifically, the menu complementing unit 205 detects a specific application according to the application definition in the menu presentation application program definition information when the state monitoring unit 208 detects the arrival of radio waves for short-range wireless communication such as a wireless LAN. (Game application A, game application B, etc.) is selected, and a menu for preferentially presenting the selected application is generated.
In addition, when the state monitoring unit 208 detects a specific state of the user's body, the menu complementing unit 205 defines the specific state detected by the state monitoring unit 208 and the application definition in the menu presentation application program definition information. Based on, select a specific application (phone application for calling the attending physician, email application for sending email to the attending physician, etc.) from multiple applications, and generate a menu that preferentially presents the selected application .

  In addition, the menu complementing unit 205 generates a menu that presents an application related to the keyword (extracted keyword-related application program) within a predetermined time (for example, 30 minutes) from the detection time of the specific state or the generation time of the menu. After a predetermined time (for example, 30 minutes) has elapsed from the detection time or the menu generation time, a menu in which the application is not presented is generated.

  The application activation determination unit 203 (activation determination unit) is also the same as that in the first embodiment, and determines whether an application related to the state has been activated.

The user operation log acquisition unit 201 is as shown in the first embodiment and has a lower hierarchy shown in FIG.
The log storage unit 202 and the menu display unit 204 are also as described in the first embodiment, and detailed description thereof is omitted.

Next, the operation of mobile terminal apparatus 100 according to the present embodiment will be described with reference to FIG. 23 and FIG.
FIG. 23 shows processing when the user of the mobile terminal device 100 analyzes the peripheral state when requesting menu display and generates a menu according to the analysis result of the peripheral state. FIG. Shows a process for generating a menu according to the analysis result of the peripheral state by periodically analyzing the peripheral state irrespectively.

  First, referring to FIG. 23, a process when a user of the mobile terminal apparatus 100 requests a menu display to analyze a peripheral state and generate a menu according to the analysis result of the peripheral state will be described.

In the mobile terminal device 100, the key event acquisition unit 304 shown in FIG. 3 detects the user's key operation (S2301), and analyzes the contents of the key operation (S2302).
If the user's key operation does not require menu display (NO in S2303), the process requested by the user is executed (S2310).
On the other hand, if the user's key operation requests menu display (YES in S2303), the sensor 1057 is activated at this timing, the sensor 1057 digitizes the peripheral state, and the state monitoring unit 208 uses the sensor 1057. A sensor value that is a digitized peripheral state is input, and the input sensor value is analyzed (S2304).
Specifically, the state monitoring unit 208 refers to the menu presentation application program definition information in the menu presentation application program definition information storage unit 209 and determines whether or not radio waves for wireless LAN and infrared communication have arrived (reception power is low). Whether the user's pulse, bad breath, etc. are within the range of the reference value.
Next, the message complementing unit 205 confirms whether or not the state monitoring unit 208 determines that it is in a specific state (S2305) (application selection step), and is not in a specific state (the radio wave for wireless LAN or infrared communication is not received). If the user's pulse, bad breath, etc. are within the standard value range (NO in S2305), the menu complementing unit 205 prepares a normal TOP menu, and the menu display unit 204 displays a normal TOP menu. Is displayed on the display unit 1054, and the display unit 1054 displays a normal TOP menu (S2309).

On the other hand, when it is in a specific state (when a wireless LAN or infrared communication radio wave has arrived, or when the user's pulse, bad breath, etc. are outside the range of the reference value) (YES in S2305), the menu The complementing unit 205 designates the application indicated as the application corresponding to the state in the menu presentation application program definition information as the priority presentation application (S2306) (application selection step), and presents the priority presentation application with priority over other applications. A menu to be generated is generated (S2307) (menu generation step). For example, a menu showing the priority presentation application at the top is generated.
Next, the menu display unit 204 outputs the menu to the display unit 1054, and the display unit 1054 displays the menu (S2308).

  For example, the exclusion event column of the menu presentation application program definition information indicates that the priority presentation application is excluded from the menu after a certain period of time has elapsed since the time when a specific state was detected or the menu including the priority presentation application was displayed. If it is, the time when the specific state is detected or the time when the menu including the priority presentation application is displayed is stored in a memory, a register, etc. May be used to calculate the time to exclude from the menu.

  Next, referring to FIG. 24, a process for periodically analyzing the peripheral state regardless of the user's operation and generating a menu according to the analysis result of the peripheral state will be described.

The sensor 1057 is periodically activated, the sensor 1057 digitizes the peripheral state, the state monitoring unit 208 inputs the sensor value which is the peripheral state digitized by the sensor 1057, and analyzes the input sensor value (S2401). .
Specifically, the state monitoring unit 208 refers to the menu presentation application program definition information (FIG. 22) in the menu presentation application program definition information storage unit 209 to determine whether or not radio waves for wireless LAN and infrared communication have arrived. (Whether or not the received power is larger than a predetermined threshold value) or whether or not the user's pulse, bad breath, etc. are within the range of the reference value.
Next, the message complementing unit 205 confirms whether or not the state monitoring unit 208 determines that it is in a specific state (S2402), and is not in a specific state (the radio wave for wireless LAN or infrared communication has not arrived, If the user's pulse, bad breath, etc. are within the reference value range (NO in S2402), the process ends.

On the other hand, when it is in a specific state (when a wireless LAN or infrared communication radio wave has arrived, or when the user's pulse, bad breath, etc. are outside the range of the reference value) (YES in S2402), the menu The complementing unit 205 sets the application indicated as the application corresponding to the state in the menu presentation application program definition information as the priority presentation application (S2403), and generates a menu that presents the priority presentation application with priority over other applications. (S2404). For example, a menu showing the priority presentation application at the top is generated.
Next, the menu display unit 204 outputs the menu to the display unit 1054, and the display unit 1054 displays the menu (S2405).
Further, an alarm sound may be output in order to notify the user that a menu including the priority presentation application is displayed (S2406).

  For example, the exclusion event column of the menu presentation application program definition information indicates that the priority presentation application is excluded from the menu after a certain period of time has elapsed since the time when a specific state was detected or the menu including the priority presentation application was displayed. Is not explicitly shown in the flowchart, the time when the specific state is detected or the time when the menu including the priority presentation application is displayed is stored in a memory, a register, etc., and the priority presentation application is stored. May be used to calculate the time to exclude from the menu.

  Next, an operation example when the mobile terminal apparatus 100 according to the present embodiment excludes the priority presentation application from the menu will be described with reference to FIG.

In FIG. 25, the menu complementing unit 205 determines whether or not a predetermined time has elapsed from the detection time of the specific state (S2501).
The predetermined time is the time described in the exclusion event column of the menu presentation application program definition information (FIG. 22).
In addition, in FIG. 25, the example is based on the detection time of a specific state, but for example, the first display time of a menu including a priority presentation application may be used as the starting point.
When the predetermined time has elapsed since the detection of the specific state (YES in S2501), the menu complementing unit 205 excludes the target priority presentation application from the menu presentation target (S2502).
As a result, the application is not included in the subsequent menus.

  The operation of excluding the priority presentation application from the menu by executing the priority presentation application is the same as that shown in FIG.

Note that the menu generation method shown in the first embodiment may be added to the menu generation method shown in the present embodiment.
In other words, the priority presentation application may be presented at the top level, and a menu for presenting a highly difficult application may be generated based on the user's key operation process described in the first embodiment after the second level. .

  As described above, in this embodiment, the peripheral state of the mobile terminal device is analyzed, and a menu that preferentially presents an application that is likely to be activated is generated and displayed in correspondence with the peripheral state of the mobile terminal device. , User convenience is improved.

  As described above, the present embodiment has described the mobile terminal device in which the display of the candidate menu changes depending on the result of the situation determination unit that determines the situation immediately before.

  Further, in the present embodiment, the mobile terminal device has been described that displays an application that is highly likely to be analyzed by analyzing the subject portion when an e-mail is received as the determination of the situation immediately before.

  Further, in the present embodiment, the mobile terminal device that displays the software update function when the information indicating software update guidance is described in the e-mail has been described.

  In the present embodiment, a function that is meaningless if the application is activated and executed once after receiving the notification, such as software update, is possible until it is executed after the notification mail is received. A mobile terminal device has been described that displays a function by selecting a group that has a high probability and that belongs to a set that has a low probability even after activation.

  Further, in this embodiment, when it is within a predetermined period (for example, one day) after receiving an email requesting a reply immediately such as a reply required, the predetermined period is set as a highly likely set. A description has been given of a mobile terminal device that is placed in a set with a low possibility when it is more than (for example, one day).

  Moreover, in this Embodiment, the mobile terminal device which judges a condition according to the information acquisition result in a sensor was demonstrated.

  Moreover, this Embodiment demonstrated the mobile terminal device provided with the sensor which collects the conditions of human bodies, such as a pulse, a bad breath, and body temperature.

  Further, in the present embodiment, the mobile terminal device has been described in which an application that is likely to be started for contact or confirmation by a user when an abnormality has occurred due to a numerical value obtained by the sensor is a candidate on the menu. .

Finally, a hardware configuration example of the mobile terminal apparatus 100 according to Embodiments 1 and 2 will be described.
FIG. 12 is a diagram illustrating an example of hardware resources of the mobile terminal device 100 illustrated in the first and second embodiments.
The configuration in FIG. 12 is merely an example of the hardware configuration of the mobile terminal device 100, and the hardware configuration of the mobile terminal device 100 is not limited to the configuration shown in FIG. Also good.

In FIG. 12, the mobile terminal apparatus 100 includes a CPU 911 (also referred to as a central processing unit, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, and a processor) that executes a program.
The CPU 911 receives, for example, a ROM (Read Only Memory) 913, a RAM (Random Access Memory) 914, a communication board 915, a display device 901 such as a liquid crystal display, a numeric keypad 902, a microphone 904, a speaker 905, an HDD, or the like via the bus 912. It is connected to the flash memory 920 and controls these hardware devices.
The RAM 914 is an example of the memory 1052.
The display device 901 is an example of the display unit 1054, and the numeric keypad 902 is an example of the key operation unit 1055.

The mobile terminal device 100 may include a keyboard, a non-contact IC card, a camera, a vibrator, and the like in addition to these hardware devices.
The RAM 914 is an example of a volatile memory.
A storage medium such as the ROM 913, the HDD or flash memory 920, and the non-contact IC card is an example of a nonvolatile memory.
A communication board 915, a numeric keypad 902, a keyboard, and the like are examples of an input device.
Further, the communication board 915, the display device 901, the non-contact IC card, and the like are examples of the output device.

The communication board 915 can be connected to, for example, the Internet, a WAN (wide area network), a LAN (local area network), or the like via a wireless line.
The HDD or flash memory 920 can store an operating system 921 (OS), middleware 922, a program group 923, a file group 924, and the like. Programs in the program group 923 are executed by the CPU 911, operating system 921, and middleware 922.

The program group 923 includes the application program and menu application described in the first and second embodiments.
The program group 923 stores programs that execute the functions described in the first and second embodiments.
The functions described in the first and second embodiments are functions included in at least the mobile terminal application selection support unit 121, and include a user operation log acquisition unit 201, an application activation determination unit 203, a menu display unit 204, and menu complementation. A unit 205, an application management unit 302, an application activation information transmission unit 303, a key event acquisition unit 304, an application identification unit 305, and the like.
The program is read and executed by the CPU 911.

In the file group 924, in the above description, "analysis of", "acquisition of", "generation of", "determination of", "calculation of", "comparison of", " Information, data, signal values, variable values, and parameters indicating the results of the processing described as "extraction", "setting of", "registration of", etc. are items in "~ file" and "~ database". Is remembered as
“˜File” and “˜Database” are stored in a recording medium.
Information, data, signal values, variable values, and parameters stored in the storage medium are read out to the main memory and the cache memory by the CPU 911 via a read / write circuit, and extracted, searched, referenced, compared, calculated, calculated, processed, and processed. Used for CPU operations such as editing, output, and display. Information, data, signal values, variable values, and parameters are stored in the main memory, registers, cache memory, buffer memory, etc. during the CPU operation of extraction, search, reference, comparison, operation, calculation, processing, editing, output, and display. Temporarily stored.
In addition, the arrows in the flowchart described above mainly indicate input / output of data and signals, and the data and signal values are recorded on a recording medium. Data and signals are transmitted online via a bus 912, signal lines, cables, or other transmission media.

  In the above description, what is described as “to part” and “to function” may be “to circuit”, “to device”, “to device”, and “means”. -Step "," -procedure "," -process "may be used. That is, what is described as “˜unit” and “˜function” may be realized by firmware stored in the ROM 913. Alternatively, only software, hardware such as an element, a device, a substrate, and wiring, a combination of software and hardware, or a combination of firmware may be used. Firmware and software are stored in a recording medium as programs. The program is read by the CPU 911 and executed by the CPU 911.

  As described above, the mobile terminal device 100 shown in this embodiment includes a CPU as a processing device, a memory as a storage device, a flash memory, a numeric keypad as an input device, a keyboard, a communication board, etc., a display device as a output device, a communication board, A non-contact IC card or the like is provided, and the elements indicated as “to part” and “to function” are realized by using these processing devices, storage devices, input devices, and output devices.

FIG. 2 shows a configuration example of a mobile terminal apparatus according to Embodiment 1. The figure which shows the structural example of the mobile terminal application selection assistance part which concerns on Embodiment 1. FIG. FIG. 3 is a diagram illustrating a configuration example of a user operation log acquisition unit according to the first embodiment. FIG. 3 is a diagram illustrating a log storage example of a log storage unit according to the first embodiment. FIG. 4 shows a menu display example according to the first embodiment. FIG. 3 is a flowchart showing an operation example of the mobile terminal apparatus according to the first embodiment. FIG. 6 is a flowchart showing an operation example of an application activation determination unit according to the first embodiment. FIG. 4 is a flowchart showing an operation example of a menu complementing unit according to the first embodiment. FIG. 6 is a flowchart showing an operation example of an application management unit according to the first embodiment. FIG. 6 is a flowchart showing an operation example of a key event acquisition unit and an application identification unit according to the first embodiment. FIG. 3 is a flowchart showing an example of priority order determining operation according to the first embodiment. FIG. 3 is a diagram illustrating a hardware configuration example of the mobile terminal apparatus according to the first embodiment. The figure which shows the structural example of the mobile terminal apparatus which concerns on Embodiment 2. FIG. The figure which shows the structural example of the mobile terminal application selection assistance part which concerns on Embodiment 2. FIG. The figure which shows the example of the extraction object keyword information which concerns on Embodiment 2. FIG. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. The figure which shows the structural example of the mobile terminal apparatus which concerns on Embodiment 2. FIG. The figure which shows the structural example of the mobile terminal application selection assistance part which concerns on Embodiment 2. FIG. The figure which shows the example of the menu presentation application program definition information which concerns on Embodiment 2. FIG. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment. FIG. 6 is a flowchart showing an operation example of the mobile terminal apparatus according to the second embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Mobile terminal device, 101 User interface part, 102 Application program, 103 Middleware, 104 Operating system, 105 Hardware, 106 Communication processing part, 111 Menu application, 121 Mobile terminal application selection support part, 201 User operation log acquisition part, 202 log storage unit, 203 application activation determination unit, 204 menu display unit, 205 menu complementing unit, 206 message analysis unit, 207 extraction target keyword information storage unit, 208 status monitoring unit, 209 menu presentation application program definition information storage unit, 301 Application program, 302 Application management unit, 303 Application activation information transmission unit, 304 Key event acquisition unit, 305 Application specifying unit, 401 menu application, 1051 CPU, 1052 memory, 1053 HDD / flash memory, 1054 display unit, 1055 key operation unit, 1056 communication I / F, 1057 sensor.

Claims (35)

Information having a plurality of application programs, a display unit for displaying a menu for selecting an application program to be activated from the plurality of application programs to the user, and an operation unit operated by the user A processing device comprising:
An application start operation that indicates a start application program that is started each time the application program is started and a series of operations performed on the operation unit by the user until the start application program is started An application activation operation process information storage unit for storing process information;
An operation analysis unit that analyzes an operation performed on the operation unit by the user each time an operation is performed on the operation unit by the user when a menu is displayed on the display unit;
Each time the operation of the user is analyzed by the operation analysis unit, application start operation process information indicating an operation process that matches the progress of the user operation analyzed by the operation analysis unit is displayed. A menu generation unit that generates a menu that is extracted from the storage unit, presents a startup application program indicated in at least one of the extracted application startup operation process information, and displays the generated menu on the display unit; An information processing apparatus characterized by the above. The menu generation unit
When multiple pieces of application start operation process information are extracted, for each start application program indicated in the extracted application start operation process information, the operation until the start application program is started based on the contents of the application start operation process information. 2. The information processing apparatus according to claim 1, wherein a difficulty level is determined, and a menu to be preferentially presented is generated for a startup application program having a larger determined difficulty level. The application activation operation process information storage unit is
Application activation operation process information indicating the time required for activation until the activation application program is activated, together with the operation process of a series of operations performed on the operation unit by the user until the activation application program is activated Remember
The menu generation unit
When multiple application startup operation process information is extracted, it takes for each startup application program indicated in the extracted application startup operation process information to start the startup application program based on the operation process indicated in the application startup operation process information. The number of start required operations is determined, a calculation is performed using the determined number of start required operations and the required start time indicated in the application start operation process information, the value of the calculation result is set as the difficulty level, and the value of the calculation result is The information processing apparatus according to claim 2, wherein a menu to be presented with higher priority is generated for a larger startup application program. The application activation operation process information storage unit is
In some cases, two or more application activation operation process information indicating different operation processes are stored for the same activation application program,
The menu generation unit
A plurality of application activation operation process information is extracted, and the extracted plurality of application activation operation process information includes two or more application activation operation process information indicating different operation processes for the same activation application program. In this case, the average number of required startup operations for the startup application program is calculated based on the operation process indicated in each of the two or more application startup operation process information for the same startup application program, and the two or more application startup operation processes are calculated. Calculate the average startup time for the startup application program based on the startup duration indicated in each piece of information, perform the calculation using the calculated average startup required operation count and average startup duration, and perform the calculation The resulting value and The information processing apparatus according to claim 3, characterized by comparing the value of the operation result of the active application program. The application activation operation process information storage unit is
Each time the operation of the user is analyzed by the operation analysis unit, the user operation analyzed by the operation analysis unit is stored, and a clear operation that clears the operation performed immediately before is cleared by the operation analysis unit. When analyzed, store the user's operation including the clear operation, store application activation operation process information indicating the operation process of a series of operations including the clear operation,
The menu generation unit
When multiple pieces of application start operation process information are extracted, the number of required start operations is determined for each start application program indicated in the extracted application start operation process information, and the number of clear operations indicated in the application start operation process information Is calculated using the determined number of required startup operations, the counted number of clear operations and the required startup time indicated in the application startup operation process information, and the value of the calculation result is set as the difficulty level. 5. The information processing apparatus according to claim 3, wherein a menu to be presented with higher priority is generated for a startup application program having a larger value. The menu generation unit
When multiple application startup operation process information is extracted, it takes for each startup application program indicated in the extracted application startup operation process information to start the startup application program based on the operation process indicated in the application startup operation process information. The information processing apparatus according to claim 2, wherein the number of startup required operations is determined as the degree of difficulty, and a menu that is preferentially presented for a startup application program having a larger determined startup startup number is generated. The application activation operation process information storage unit is
In some cases, two or more application activation operation process information indicating different operation processes are stored for the same activation application program,
The menu generation unit
A plurality of application activation operation process information is extracted, and the extracted plurality of application activation operation process information includes two or more application activation operation process information indicating different operation processes for the same activation application program. The average number of required startup operations for the startup application program is calculated based on the operation process indicated in each of the two or more application startup operation process information for the same startup application program. The information processing apparatus according to claim 6, wherein the number of operations for activation places of other activation application programs is compared. The application activation operation process information storage unit is
Application activation operation process information indicating the time required for activation until the activation application program is activated, together with the operation process of a series of operations performed on the operation unit by the user until the activation application program is activated Remember
The menu generation unit
3. A menu to be presented with higher priority for a startup application program having a longer startup time when a plurality of application startup operation process information is extracted, with the difficulty level being set as the difficulty level. Information processing device. The application activation operation process information storage unit is
In some cases, two or more application activation operation process information indicating different operation processes are stored for the same activation application program,
The menu generation unit
A plurality of application activation operation process information is extracted, and the extracted plurality of application activation operation process information includes two or more application activation operation process information indicating different operation processes for the same activation application program. In this case, an average startup required time for the startup application program is calculated based on the startup required time indicated in each of two or more application startup operation process information for the same startup application program, and the calculated average startup required time and The information processing apparatus according to claim 8, wherein the time required for starting another application program is compared. The operation analysis unit
When the menu is displayed on the display unit, each time the user performs an operation on the operation unit, the operation performed on the operation unit by the user is analyzed, and the operation unit is operated by the user. Determine the application program that is started as a result of
The application activation operation process information storage unit is
Each time the user operation is analyzed by the operation analysis unit, the user operation analyzed by the operation analysis unit is stored, and the application program determined by the operation analysis unit is stored as a startup application program. And storing application activation operation process information indicating an activation application program and an operation process of a series of operations performed on the operation unit by the user before the activation application program is activated. Item 10. The information processing device according to any one of Items 1 to 9. The application activation operation process information storage unit is
When a clear operation that clears the operation performed immediately before is analyzed by the operation analysis unit, the user operation including the operation immediately before the clear operation, the clear operation, and the operation after the clear operation is performed. 11. An application activation operation process information indicating an operation process of a series of operations including an operation immediately before the clear operation, the clear operation, and an operation after the clear operation is stored. The information processing apparatus described. The menu generation unit
Any application activation operation process information indicates an operation process of a series of operations including an operation immediately before a clear operation, the clear operation, and an operation after the clear operation, and after the clear operation in the application activation operation process information The application activation operation process information is extracted from the application activation operation process information storage unit when an operation process after an operation is in common with the progress of the user operation analyzed by the operation analysis unit. Item 12. The information processing apparatus according to Item 11. The information processing apparatus further includes:
An operation confirmation unit for confirming whether or not an application program activated as a result of the operation of the operation unit by the user is still active after a predetermined time has elapsed since activation;
The application activation operation process information storage unit is
When it is confirmed by the operation confirmation unit that the application program activated as a result of the operation of the operation unit by the user is still active after a certain time has elapsed since activation, application activation operation process information on the application program is displayed. An application activation operation for the application program when it is confirmed by the operation confirmation unit that the application program activated as a result of the operation of the operation unit by the user has not been activated after a predetermined time has elapsed since activation. The information processing apparatus according to claim 10, wherein the process information is discarded. The information processing apparatus includes:
The operation unit has a key operation unit composed of a plurality of keys,
The application activation operation process information storage unit is
As the operation process of the operation by the user, storing application activation operation process information indicating the operation sequence of the keys operated by the user before the activation application program is activated,
The operation analysis unit
When the menu is displayed on the display unit, each time the user operates the key operation unit, the type of the key operated by the user is analyzed,
The menu generation unit
Each time the key type is analyzed by the operation analysis unit, the application activation operation process information indicating the key operation sequence that matches the user's key operation sequence analyzed by the operation analysis unit is displayed. The information according to any one of claims 1 to 13, wherein a menu is generated that is extracted from the process information storage unit and indicates a start application program indicated in at least one of the extracted application start operation process information. Processing equipment.   The information processing apparatus according to claim 1, wherein the information processing apparatus is a mobile terminal device. A plurality of application programs, a storage device, a display unit for displaying a menu for selecting a startup target application program from among the plurality of application programs, and an operation unit operated by the user A menu generation method in which a mobile terminal device having a menu generates a menu,
The mobile terminal device is activated every time an application program is activated, and an operation process of a series of operations performed on the operation unit by the user until the activated application program is activated. Application activation operation process information storage step for storing the application activation operation process information indicated in the storage device;
An operation analysis step for analyzing an operation performed on the operation unit by the user every time the user performs an operation on the operation unit when the menu is displayed on the display unit; ,
Each time the mobile terminal device analyzes the user operation in the operation analysis step, application start operation process information indicating an operation process that matches the progress of the user operation analyzed in the operation analysis step is displayed. A menu generation step of generating a menu that is extracted from the storage device, presenting a startup application program indicated in at least one of the extracted application startup operation process information, and displaying the generated menu on the display unit; A menu generation method characterized by the above. A plurality of application programs, a storage device, a display unit for displaying a menu for selecting a startup target application program from among the plurality of application programs, and an operation unit operated by the user In a mobile terminal device having
An application start operation that indicates a start application program that is started each time the application program is started and a series of operations performed on the operation unit by the user until the start application program is started Application activation operation process information storage process for storing process information in the storage device;
An operation analysis process for analyzing an operation performed on the operation unit by the user each time an operation is performed on the operation unit by the user when a menu is displayed on the display unit;
Each time the user operation is analyzed by the operation analysis process, application activation operation process information indicating an operation process that matches the progress of the user operation analyzed by the operation analysis process is extracted from the storage device. Generating a menu for presenting a startup application program indicated in at least one of the extracted application startup operation process information, and executing a menu generation process for displaying the generated menu on the display unit program. The information processing apparatus further includes:
A message receiver for receiving external messages;
A message analysis unit that analyzes whether or not a keyword related to any application program is included in the message received by the message reception unit;
The menu generation unit
When a keyword related to any application program is extracted from the message by the message analysis unit, an extracted keyword-related application program related to the extracted keyword and an application extracted from the application activation operation process information storage unit The information processing apparatus according to claim 1, wherein a menu for presenting a startup application program indicated in at least one of the startup operation process information is generated. The menu generation unit
The information processing apparatus according to claim 18, wherein the extracted keyword-related application program generates a menu presented in preference to the startup application program. The information processing apparatus further includes:
A state monitoring unit for monitoring the peripheral state of the information processing device;
A menu presenting application program definition information storage unit for storing menu presenting application program definition information that defines an application program to be presented on the menu according to the peripheral state;
The menu generation unit
When a specific state is detected by the state monitoring unit, based on the specific state detected by the state monitoring unit and the definition of the application program in the menu presentation application program definition information, the plurality of application programs A specific application program is selected from among them, and the selected specific application program and the activation application program indicated in at least one of the application activation operation process information extracted from the application activation operation process information storage unit are presented The information processing apparatus according to claim 1, wherein a menu to be generated is generated. The menu generation unit
21. The information processing apparatus according to claim 20, wherein the selected application program generates a menu presented in preference to the activated application program. A display unit that has a plurality of application programs, displays a menu for selecting a startup target application program from the plurality of application programs, and a message receiving unit that receives a message from the outside. An information processing apparatus having
A message analysis unit for analyzing whether or not a keyword related to any application program is included in the message received by the message reception unit;
When a keyword related to one of the application programs is extracted from the message by the message analysis unit, a menu for presenting the extracted keyword-related application program related to the extracted keyword is generated, and the generated menu is displayed. An information processing apparatus comprising: a menu generation unit to be displayed on the unit. The information processing apparatus further includes:
An activation determination unit that determines whether or not the extracted keyword-related application program is activated;
The menu generation unit
A menu for presenting the extracted keyword-related application program is generated until it is determined by the activation determining unit that the extracted keyword-related application program has been activated, and it is determined that the extracted keyword-related application program has been activated by the activation determining unit 23. The information processing apparatus according to claim 22, wherein a menu on which the extracted keyword-related application program is not presented is generated after being executed. The menu generation unit
A menu presenting the extracted keyword-related application program is generated within a predetermined time from the extraction time of the keyword or the display time of the message including the keyword on the display unit, and the extraction time of the keyword or the display of the message 24. The information processing apparatus according to claim 22 or 23, wherein a menu in which the extracted keyword-related application program is not presented is generated after a predetermined time has elapsed from a display time on the unit. The menu generation unit
A menu on which the extracted keyword-related application program and other application programs other than the extracted keyword-related application program are presented, wherein the extracted keyword-related application program is presented with priority over other application programs. The information processing apparatus according to any one of claims 22 to 24. A display unit that has a plurality of application programs and displays a menu for selecting a startup target application program from among the plurality of application programs, and a state monitoring unit that monitors a peripheral state of the information processing apparatus An information processing apparatus having
A menu presentation application program definition information storage unit for storing menu presentation application program definition information for defining an application program to be presented on the menu according to the peripheral state;
When a specific state is detected by the state monitoring unit, based on the specific state detected by the state monitoring unit and the definition of the application program in the menu presentation application program definition information, the plurality of application programs An information processing apparatus comprising: a menu generation unit that selects a specific application program from among them, generates a menu for presenting the selected specific application program, and displays the generated menu on the display unit. The state monitoring unit
As the peripheral state, the presence or absence of arrival of radio waves for short-range wireless communication is monitored,
The menu presentation application program definition information storage unit is
Stores menu presentation application program definition information that defines an application program to be presented on the menu when the arrival of radio waves for near field communication is detected,
The menu generation unit
27. The specific application program is selected according to the definition of the application program in the menu presentation application program definition information when the state monitoring unit detects the arrival of radio waves for short-range wireless communication. The information processing apparatus described. The state monitoring unit
As the peripheral state, monitor the state of the user's body using the information processing device,
The menu presentation application program definition information storage unit is
Storing menu presentation application program definition information that defines an application program to be presented on a menu according to the state of the user's body;
The menu generation unit
When a specific state of the user's body is detected by the state monitoring unit, based on the specific state detected by the state monitoring unit and the application program definition in the menu presentation application program definition information, the 28. The information processing apparatus according to claim 26, wherein a specific application program is selected from a plurality of application programs. The information processing apparatus further includes:
An activation determination unit for determining whether or not the specific application program has been activated;
The menu generation unit
A menu for presenting the specific application program is generated until the start determination unit determines that the specific application program has been started, and after the start determination unit determines that the specific application program has been started The information processing apparatus according to any one of claims 26 to 28, characterized in that generates a menu in which the specific application program is not presented. The menu generation unit
A menu for presenting the specific application program is generated within a predetermined time from the time when the specific state is detected by the state monitoring unit, and the predetermined time from the time when the specific state is detected by the state monitoring unit. 30. The information processing apparatus according to claim 26, wherein a menu on which the specific application program is not presented after the elapse of time is generated. The menu generation unit
A menu in which the specific application program and other application programs other than the specific application program are presented, wherein the specific application program is presented with priority over other application programs. The information processing apparatus according to any one of claims 26 to 30. A display unit that has a plurality of application programs, displays a menu for selecting a startup target application program from the plurality of application programs, and a message receiving unit that receives a message from the outside. A menu generation method in which a mobile terminal device has a menu,
A message analysis step for analyzing whether the mobile terminal device includes a keyword related to any application program in the message received by the message receiving unit;
The mobile terminal device generates a menu that presents an extracted keyword-related application program related to the extracted keyword when a keyword related to any application program is extracted from the message by the message analysis step, A menu generating step of displaying the generated menu on the display unit; A display unit that has a plurality of application programs, displays a menu for selecting a startup target application program from among the plurality of application programs, and a state monitoring unit that monitors the peripheral state of the mobile terminal device And a menu presentation application program definition information storage unit for storing menu presentation application program definition information for defining application programs to be presented on the menu according to the peripheral state. And
When a specific state is detected by the state monitoring unit, the mobile terminal device is based on the specific state detected by the state monitoring unit and the application program definition in the menu presentation application program definition information, An application selection step of selecting a specific application program from the plurality of application programs;
A menu generation method, comprising: generating a menu for presenting the specific application program selected in the application selection step, and displaying the generated menu on the display unit. A display unit that has a plurality of application programs, displays a menu for selecting a startup target application program from among the plurality of application programs, and a message receiving unit that receives a message from the outside In the mobile terminal device having
A message analysis process for analyzing whether or not a keyword related to any application program is included in the message received by the message receiving unit;
When a keyword related to any application program is extracted from the message by the message analysis process, a menu for presenting the extracted keyword-related application program related to the extracted keyword is generated, and the generated menu is displayed. A program for executing a menu generation process to be displayed on a section. A display unit that has a plurality of application programs, displays a menu for selecting a startup target application program from among the plurality of application programs, and a state monitoring unit that monitors the peripheral state of the mobile terminal device And a menu presentation application program definition information storage unit that stores menu presentation application program definition information that defines an application program to be presented on the menu according to the peripheral state.
When a specific state is detected by the state monitoring unit, based on the specific state detected by the state monitoring unit and the definition of the application program in the menu presentation application program definition information, the plurality of application programs An application selection process for selecting a specific application program from among them,
A program for generating a menu for presenting the specific application program selected by the application selection process, and causing the display unit to display the generated menu.

Images