JP6121724B2 - Terminal, application operation assistance method and program - Google Patents

Description

  The present invention relates to a terminal that assists a user in application operation, an application operation assistance method, and a program.

  Conventionally, a single client terminal includes an execution unit, a terminal management unit, a network interface unit, and an input / output unit in order to reduce the labor of user management when using different OS environments according to a plurality of usage purposes. The management unit includes at least a terminal management recording unit, an execution target management unit, a user management unit, and a user interface unit. The terminal management recording unit is used for at least use mode management information that associates execution targets, context identification information, and user interface information, context management information that associates context identification information with credentials, and authentication for a connection destination device or the like. Credentials are recorded. The user management unit includes a holder confirmation unit and a credential selection unit. As the execution target management unit, a client terminal having a context acquisition unit, a user interface information acquisition unit, and a credential setting unit is disclosed (for example, see Patent Document 1).

  In addition, the actual operation history of the user's software (system) is matched with the system usage example assumed by the system developer to determine the use case that best represents the actual operation history, In order to estimate the user's purpose of system use based on the user's purpose and to determine the next operation, a model element including operation history for satisfying the application function according to the user's purpose of use, state or transition information, and Based on multiple use case candidates from the use case database that is the combination and a request signal based on a service request that is a request for predicting the next operation from the application, an operation result path at the time of request from the user operation that is sequentially input The actual request path is obtained from the request actual path and multiple use case candidates. Calculating a goodness of fit between the paths, the output discloses a technique to best fit high degree of use case candidate prediction result (e.g., see Patent Document 2.).

  In addition, in order to display a home screen excellent in user operability, when displaying a storage means that stores an operation history every time it is operated and a home screen that is an operation starting point, operation history information is acquired to perform this operation. An information communication terminal including a generating unit that generates recommended information from history information and a display unit that displays a home screen including the generated recommended information is disclosed (for example, see Patent Document 3).

  Furthermore, in order to display the images side by side based on a certain unit, indicate the current position in the whole, and accurately grasp the overall image and the current progress position, the display input device has a plurality of functions. As a setting item, a storage unit for storing a program for displaying on the display unit a screen for setting the setting item selected and registered in advance by calling, and a program calling and display input device. An input unit for receiving setting input made, and the display unit is displayed when setting a position display image for indicating the current position and setting items included in the program when the program is called. Or a combination image combining screen number display images indicating the number of displayed setting screens is set in the program for each of the setting items included in the program. Technique of displaying side by side in the display order of the items have been disclosed (e.g., refer to Patent Document 4.).

  In addition, when an incoming call is detected while waiting for an incoming call, a message indicating that the incoming call is being received is displayed together with the telephone number, and the off-hook key flashes in green and the on-hook key lights in red to assist the operation. A technique for displaying information (auxiliary information) (see, for example, Patent Document 5) and a technique for holding a time history in which an application is used and highlighting an application menu at that time (see, for example, Patent Document 6). Is also disclosed.

JP 2010-198348 A JP 2011-170672 A JP 2011-0666850 A JP 2011-164726 A Republished 05/125159 JP 2006-127372 A

  By the way, in a terminal such as a smartphone that allows display and input acceptance on a touch panel display, there are no restrictions on the operation method until the purpose is achieved, depending on the current display state of the terminal, terminal settings, storage in the terminal, etc. And the input method is variously changed (the display position of the push button can be arbitrarily changed, etc.). In addition, recent terminals are highly customizable by users due to interactive UI operations (for example, it is easy to change the application shortcut position on the home screen, change the home application itself, and the like).

  For this reason, with conventional terminals using non-touch panel displays and hardware keys, input means and screen transitions are possible because there are at most only the absolute number of hardware keys or the number of branches determined by the absolute number. In addition, it is difficult to perform operation navigation (a method of presenting an operation method using a separate manual or the like) by sequentially pressing predetermined hardware keys from the terminal standard start position (home screen or the like). Especially for elderly people, there are many users who have memorized by the same operation method for a certain purpose. Therefore, the above problem increases the difficulty of smartphone operation.

  In the techniques described in Patent Documents 1 to 3, 5, and 6 described above, there are contrivances such as showing the next operation method, displaying a frequently executed application, and providing a UI suitable for the operation level. However, with the methods described above, it is possible to lead to an app for performing the intended operation, but the user's operation proficiency until the goal is achieved does not increase, and the satisfaction of using the terminal is not necessarily enhanced. I can't. Moreover, when the prediction is wrong, the user who relies on guidance falls into a situation where it cannot be operated thereafter.

  In the technique described in Patent Document 4 described above, the operation flow can be visually confirmed. However, in a smartphone, it is more difficult to operate each application than to grasp a series of application activations. And requires explanation on the application operation screen. Further, since there are many cases where the operation flow is deviated from the operation flow due to the difference in the operation of the application, it is necessary to instruct the operation flow after understanding the operation completion status in the application.

  On the other hand, in some smartphones, for security protection, one app may not be able to accept operations from other apps (acquiring data, performing button / touch operations, etc.) . Therefore, it is difficult to grasp the operation status in an application created by a third party.

  In addition, some electronic version manuals may have links to launch apps, but with this method, it is necessary to operate a smartphone while viewing the electronic version manual. Therefore, since the operation is complicated, there is a problem that it is generally not possible for the user to perform such an operation a plurality of times.

  Therefore, the present invention has been made in view of the above-described problems, and assists a user in operating an application, and through such an operation, a terminal capable of increasing the skill level of the operation, an application operation assisting method, and The purpose is to provide a program.

  The present invention proposes the following matters in order to solve the above problems. In addition, in order to make an understanding easy, although the code | symbol corresponding to embodiment of this invention is attached | subjected and demonstrated, it is not limited to this.

  (1) The present invention includes an application created by a third party and an operation monitoring application for monitoring an operation status of the application created by the third party, and the operation monitoring application includes an application created by the third party. Based on the acquired state transition information, the start state to be started, the state transition information acquisition unit for acquiring the state transition information from the third party created application, and the operation status of the third party created application are estimated And a display device for displaying operation assistance information on the operation screen of the application created by the third party according to the estimated operation status. ing.

  According to the present invention, the operation monitoring application activation means activates a third party-created application, and the state transition information acquisition means obtains state transition information from the third party-created application. The operation status estimation means estimates the operation status of the application created by the third party based on the acquired state transition information. And a display means displays operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. In other words, the user can confirm the operation assistance information on the external application only by starting the external application without performing any other intentional operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (2) The present invention provides an application created by a third party, an operation monitoring application for monitoring the operation status of the application created by the third party, and basic functions used for the application created by the third party. Management means for managing, the operation monitoring application obtains the state change from the startup means for starting the third party created application and the management means, and the third party created An operation status estimating means for estimating an operation status of the application, and a display means for displaying operation assistance information on the operation screen of the application created by the third party according to the estimated operation status. A terminal with features is proposed.

  According to the present invention, the management means provides and manages basic functions used for third-party-created applications. The operation monitoring application activation unit activates a third party-created application, and the operation state estimation unit obtains the state change from the management unit, and estimates the operation state of the third-party created application. And a display means displays operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. Therefore, even when explicit information indicating the operation status cannot be obtained from the external application, the user can estimate the operation status indirectly from the change of the state. The operation assistance information can be confirmed on the external application without performing any operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (3) The present invention includes a first display unit that includes an application created by a third party and an operation monitoring application that monitors an operation status of the application created by the third party, and displays the operation menu. Selection means for selecting a desired operation item from the operation menu, storage means for storing the operation item, an external application, and an operation monitoring application for monitoring the operation status of the third party created application, and the display When a target operation item is selected from the operation menu, the storage unit is searched, and a first operation monitoring application for monitoring an operation state of the third party-created application associated with the operation item is started. The external application in which an activation unit and the operation monitoring application are associated with the operation item A second activation means for activating the application, a state transition information obtaining means for obtaining state transition information from the application created by the third party, and an application of the third party created based on the obtained state transition information. An operation situation estimating means for estimating an operation situation, and a second display means for displaying operation assistance information on the operation screen of the third party created application according to the estimated operation situation. We have proposed a terminal that features

  According to this invention, the first display means displays the operation menu. The selection means selects a target operation item from the displayed operation menu. The storage unit stores the operation item, the external application, and the operation monitoring application for monitoring the operation status of the application created by the third party in association with each other. When the first activation means selects a target operation item from the displayed operation menu, the first activation means searches the storage means and monitors an operation monitoring application for monitoring an operation status of a third party created application associated with the operation item. to start. The second activation unit of the operation monitoring application activates an external application associated with the operation item. The state transition information acquisition unit acquires state transition information from an application created by a third party. The operation status estimation means estimates the operation status of the application created by the third party based on the acquired state transition information. The second display means displays the operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. That is, when an operation menu is presented to the user and the user selects a menu according to the operation purpose, the external application corresponding to the operation purpose is automatically started, the operation state is estimated from the state transition, and the external application In addition, since the operation assistance information is displayed, the user only has to select a menu corresponding to the operation purpose, and perform the operation according to the operation assistance information without performing any other intentional operation. You can do what you want. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (4) The present invention includes a first display that includes an application created by a third party, an operation monitoring application that monitors an operation status of the application created by the third party, and a flow management application, and displays an operation menu. Means, selection means for selecting a target operation item from the displayed operation menu, an external application corresponding to a series of flows for completing the operation purpose of the operation item, and the operation status of the application created by the third party Storage means for associating and storing an operation monitoring application that monitors the operation, and a flow management application that is activated when a target operation item is selected from the displayed operation menu, searches the storage means, and An operation monitoring application that monitors the operation status of the third-party created application corresponding to the flow A management unit that manages activation and termination of an application; a state in which the operation monitoring application obtains state transition information from the application created by the third party and an activation unit that activates the external application corresponding to the series of flows Transition information acquisition means, and operation status estimation means for estimating the operation status of the third party-created application based on the acquired state transition information, and according to the estimated operation status, the third Has proposed a terminal comprising second display means for displaying operation assistance information on an operation screen of a user-created application.

  According to this invention, the first display means displays the operation menu. The selection means selects a target operation item from the displayed operation menu. The storage means stores an external application corresponding to a series of flows for completing the operation purpose of the operation item and an operation monitoring application for monitoring the operation status of the third party created application. When the management means selects a desired operation item from the displayed operation menu, the flow management application that is activated searches the storage means and monitors the operation status of a third party created application corresponding to a series of flows. Manages startup and termination of operation monitoring applications. The operation monitoring application activation means activates an external application corresponding to a series of flows. The state transition information acquisition unit acquires state transition information from an application created by a third party. The operation status estimation means estimates the operation status of the application created by the third party based on the acquired state transition information. The second display means displays the operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. That is, when the operation menu is presented to the user and the user selects a menu corresponding to the operation purpose, the flow management application is activated. The flow management application manages the activation and termination of multiple operation monitoring applications with individual functions, and each operation monitoring application automatically creates an external application corresponding to a series of flows to complete each operation purpose. In order to display the operation assistance information on the external application by estimating the operation status from the state transition, the user only has to select a menu according to the operation purpose and perform other intentional operations. Even if it is not performed, if the operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (5) In the present invention, for the terminals of (1), (3), and (4), the operation status estimation means uses the return value acquired from the third party created application as the state transition information, Has proposed a terminal characterized by estimating the operation status of a user-created application.

  According to this invention, the operation status estimation means estimates the operation status of the third party created application using the return value acquired from the third party created application as the state transition information.

  (6) The present invention is a method for assisting operation of an application in a terminal including an activation unit, a state transition information acquisition unit, an operation state estimation unit, and a display unit, wherein the activation unit is created by a third party A first step of activating the application, a second step in which the state transition information acquisition unit acquires state transition information from the third party-created application, and a state in which the operation state estimation unit acquires the state Based on the transition information, a third step of estimating the operation status of the third party-created application, and the display means on the operation screen of the third party-created application according to the estimated operation status And a fourth step of displaying the operation assistance information. The application operation assistance method characterized by comprising:

  According to the present invention, the activation unit activates the third party-created application, and the state transition information acquisition unit obtains the state transition information from the third party-created application. Then, the operation status estimation means estimates the operation status of the application created by the third party based on the acquired state transition information, and the display means operates the operation of the application created by the third party according to the estimated operation status. Display operation assistance information on the screen. In other words, the user only activates the external application, and the operation assistance information is displayed on the external application without performing any other intentional operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (7) The present invention is an operation assistance method for an application in a terminal comprising a management means, an activation means, an operation status estimation means, and a display means, wherein the activation means creates an application created by a third party. The first step to be activated and the operation status estimating means provide a basic function used for the application created by the third party, acquire the state change from the management means to manage, and A second step of estimating an operation status of a three-party created application; and a second step of displaying operation assistance information on the operation screen of the third-party created application in accordance with the estimated operation status of the display means. And an operation assisting method for an application, characterized in that it comprises the three steps.

  According to the present invention, from the managing means for starting and starting the application created by the third party, the operation status estimating means providing and managing the basic function used for the application created by the third party, The state change is acquired, and the operation state of the application created by the third party is estimated. Then, the display means displays the operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. Therefore, even when explicit information indicating the operation status cannot be obtained from the external application, the user can estimate the operation status indirectly from the change of the state. Even if the operation is not performed, the operation assistance information is displayed on the external application. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (8) The present invention provides a first display unit, a selection unit, a storage unit, a first activation unit, a second activation unit, a state transition information acquisition unit, an operation status estimation unit, A method for assisting operation of an application in a terminal comprising two display means, wherein the first display means displays an operation menu, and the selection means performs a purpose from the displayed operation menu. A second step of selecting the operation item, and when the first activation means selects a target operation item from the displayed operation menu, the operation item, the external application, and the third party-created application The storage means for storing the operation monitoring application in association with the operation status is searched, and the operation status of the third party created application associated with the operation item is searched. A third step of activating an operation monitoring application to be monitored; a fourth step of activating the external application associated with the operation item by the second activating unit; and the state transition information acquiring unit comprising: A fifth step of acquiring state transition information from an application created by a third party, and an operation state estimating means for estimating an operation state of the application created by the third party based on the acquired state transition information; And a second step in which the second display means displays operation assistance information on the operation screen of the application created by the third party in accordance with the estimated operation situation. We have proposed a method for assisting the operation of applications.

  According to this invention, the first display means displays an operation menu, and the selection means selects a target operation item from the displayed operation menu. The first activation unit stores the operation item, the external application, and the operation monitoring application for monitoring the operation status of the application created by the third party in association with each other when the target operation item is selected from the displayed operation menu. A means is searched, and an operation monitoring application for monitoring the operation status of the third party created application associated with the operation item is started. The second activation unit activates an external application associated with the operation item, and the state transition information acquisition unit acquires state transition information from an application created by a third party. Then, the operation status estimation means estimates the operation status of the third party created application based on the acquired state transition information, and the second display means creates the third party created according to the estimated operation status. Display operation assistance information on the operation screen of the application. That is, when an operation menu is presented to the user and the user selects a menu according to the operation purpose, the external application corresponding to the operation purpose is automatically started, the operation state is estimated from the state transition, and the external application In addition, since the operation assistance information is displayed, the user only has to select a menu corresponding to the operation purpose, and perform the operation according to the operation assistance information without performing any other intentional operation. You can do what you want. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (9) The present invention includes a first display unit, a selection unit, a storage unit, a management unit, an activation unit, a state transition information acquisition unit, an operation status estimation unit, and a second display unit. A method for assisting operation of an application in a terminal provided, wherein the first display means displays an operation menu, and the selection means selects a desired operation item from the displayed operation menu. And when the management means selects a target operation item from the displayed operation menu, the flow management application that is activated corresponds to a series of flows for completing the operation purpose of the operation item. The storage means for storing the external application and the operation monitoring application for monitoring the operation status of the application created by the third party in association with each other is searched, and the series of A third step for managing activation and termination of an operation monitoring application for monitoring an operation status of the third party-created application corresponding to a row; and the activation unit activates the external application corresponding to the series of flows A fourth step in which the state transition information acquisition means acquires state transition information from the third party-created application, and the operation status estimation means is based on the acquired state transition information. The sixth step of estimating the operation status of the third party-created application and the second display means operate on the operation screen of the application created by the third party according to the estimated operation status And a seventh step of displaying auxiliary information. An application operation auxiliary method is provided.

  According to this invention, the first display means displays the operation menu, and the target operation item is selected from the operation menu displayed by the selection means. When the management means selects a target operation item from the displayed operation menu, the flow management application to be activated creates an external application corresponding to a series of flows for completing the operation purpose of the operation item and a third party Searching the storage means for associating and storing the operation monitoring application for monitoring the operation status of the application, and managing the start and end of the operation monitoring application for monitoring the operation status of the third party created application corresponding to a series of flows To do. The activation unit activates an external application corresponding to a series of flows, and the state transition information acquisition unit acquires state transition information from an application created by a third party. Then, the operation status estimation means estimates the operation status of the third party created application based on the acquired state transition information, and the second display means creates the third party created according to the estimated operation status. Display operation assistance information on the operation screen of the application. That is, when the operation menu is presented to the user and the user selects a menu corresponding to the operation purpose, the flow management application is activated. The flow management application manages the activation and termination of multiple operation monitoring applications with individual functions, and each operation monitoring application automatically creates an external application corresponding to a series of flows to complete each operation purpose. In order to display the operation assistance information on the external application by estimating the operation status from the state transition, the user only has to select a menu according to the operation purpose and perform other intentional operations. Even if it is not performed, if the operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (10) The present invention is a program for causing a computer to execute an application operation assisting method in a terminal including an activation unit, a state transition information acquisition unit, an operation state estimation unit, and a display unit, A first step of starting an application created by a third party; a second step of acquiring state transition information from the application created by the third party; and the operation status. A third step of estimating an operation state of the third party-created application based on the acquired state transition information; and a third step of determining whether the display unit is in accordance with the estimated operation state. A program for causing the computer to execute a fourth step of displaying the operation assistance information on the operation screen of the application created by the user. It is.

  According to the present invention, the activation unit activates the third party-created application, and the state transition information acquisition unit obtains the state transition information from the third party-created application. Then, the operation status estimation means estimates the operation status of the application created by the third party based on the acquired state transition information, and the display means operates the operation of the application created by the third party according to the estimated operation status. Display operation assistance information on the screen. In other words, the user only activates the external application, and the operation assistance information is displayed on the external application without performing any other intentional operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (11) The present invention is a program for causing a computer to execute an application operation assisting method in a terminal including management means, activation means, operation status estimation means, and display means, wherein the activation means A first step of starting an application created by a third party, and the operation state estimating means providing and managing a basic function used for the application created by the third party, A second step of acquiring a state change and estimating an operation state of the third-party-created application; and the display means on the operation screen of the third-party-created application according to the estimated operation state A program for causing the computer to execute the third step of displaying the operation assistance information is proposed.

  According to the present invention, from the managing means for starting and starting the application created by the third party, the operation status estimating means providing and managing the basic function used for the application created by the third party, The state change is acquired, and the operation state of the application created by the third party is estimated. Then, the display means displays the operation assistance information on the operation screen of the application created by the third party according to the estimated operation situation. Therefore, even when explicit information indicating the operation status cannot be obtained from the external application, the user can estimate the operation status indirectly from the change of the state. Even if the operation is not performed, the operation assistance information is displayed on the external application. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (12) The present invention provides a first display unit, a selection unit, a storage unit, a first activation unit, a second activation unit, a state transition information acquisition unit, an operation status estimation unit, A program for causing a computer to execute an application operation assisting method in a terminal including two display means, wherein the first display means displays an operation menu, and the selection means A second step of selecting a target operation item from the displayed operation menu; and when the first activation means selects a target operation item from the displayed operation menu, the operation item and the external application And the operation monitoring application for monitoring the operation status of the application created by the third party is searched for the storage means and stored in association with the operation item. A third step of activating an operation monitoring application for monitoring an operation status of the third-party-created application; and a fourth step of activating the external application associated with the operation item by the second activation unit. And a fifth step in which the state transition information acquisition means acquires state transition information from the application created by the third party, and the operation status estimation means uses the third state based on the acquired state transition information. A sixth step for estimating the operation status of the user-created application, and the second display means displays operation assistance information on the operation screen of the third-party-created application according to the estimated operation status A program for causing a computer to execute the seventh step is proposed.

  According to this invention, the first display means displays an operation menu, and the selection means selects a target operation item from the displayed operation menu. The first activation unit stores the operation item, the external application, and the operation monitoring application for monitoring the operation status of the application created by the third party in association with each other when the target operation item is selected from the displayed operation menu. A means is searched, and an operation monitoring application for monitoring the operation status of the third party created application associated with the operation item is started. The second activation unit activates an external application associated with the operation item, and the state transition information acquisition unit acquires state transition information from an application created by a third party. Then, the operation status estimation means estimates the operation status of the third party created application based on the acquired state transition information, and the second display means creates the third party created according to the estimated operation status. Display operation assistance information on the operation screen of the application. That is, when an operation menu is presented to the user and the user selects a menu according to the operation purpose, the external application corresponding to the operation purpose is automatically started, the operation state is estimated from the state transition, and the external application In addition, since the operation assistance information is displayed, the user only has to select a menu corresponding to the operation purpose, and perform the operation according to the operation assistance information without performing any other intentional operation. You can do what you want. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  (13) The present invention includes a first display unit, a selection unit, a storage unit, a management unit, an activation unit, a state transition information acquisition unit, an operation status estimation unit, and a second display unit. A program for causing a computer to execute a method for assisting operation of an application in a terminal provided, wherein the first display means displays an operation menu, and the selection means selects a purpose from the displayed operation menu. A second step of selecting the operation item, and a flow management application that is activated when the management unit selects the target operation item from the displayed operation menu, completes the operation purpose of the operation item. Between the external application corresponding to a series of flows for the operation and the operation monitoring application for monitoring the operation status of the third party created application. A third step of searching for storage means to store and managing the start and end of an operation monitoring application for monitoring the operation status of the third party created application corresponding to the series of flows; A fourth step of starting the external application corresponding to the series of flows, a fifth step of the state transition information acquisition means acquiring state transition information from the third party created application, and the operation status Based on the acquired state transition information, the estimation means estimates the operation status of the third party-created application, and the second display means determines the operation status according to the estimated operation status. For causing the computer to execute a seventh step of displaying operation assistance information on an operation screen of the application created by the third party. It has proposed a program.

  According to this invention, the first display means displays the operation menu, and the target operation item is selected from the operation menu displayed by the selection means. When the management means selects a target operation item from the displayed operation menu, the flow management application to be activated creates an external application corresponding to a series of flows for completing the operation purpose of the operation item and a third party Searching the storage means for associating and storing the operation monitoring application for monitoring the operation status of the application, and managing the start and end of the operation monitoring application for monitoring the operation status of the third party created application corresponding to a series of flows To do. The activation unit activates an external application corresponding to a series of flows, and the state transition information acquisition unit acquires state transition information from an application created by a third party. Then, the operation status estimation means estimates the operation status of the third party created application based on the acquired state transition information, and the second display means creates the third party created according to the estimated operation status. Display operation assistance information on the operation screen of the application. That is, when the operation menu is presented to the user and the user selects a menu corresponding to the operation purpose, the flow management application is activated. The flow management application manages the activation and termination of multiple operation monitoring applications with individual functions, and each operation monitoring application automatically creates an external application corresponding to a series of flows to complete each operation purpose. In order to display the operation assistance information on the external application by estimating the operation status from the state transition, the user only has to select a menu according to the operation purpose and perform other intentional operations. Even if it is not performed, if the operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  According to the present invention, there is an effect that it is possible to estimate an operation state without specially modifying an external application by a third party. This makes it possible to provide auxiliary operation information for operations that cannot be understood intuitively in applications such as smartphones, and the operation method up to the purpose varies depending on the current display status of the terminal. The terminal can also understand an appropriate operation method.

It is a figure which shows the structure of the terminal which concerns on the 1st Embodiment of this invention. It is a figure which shows the process of the terminal which concerns on the 1st Embodiment of this invention. It is a figure which shows the structure of the terminal which concerns on the 2nd Embodiment of this invention. It is a figure which shows the process of the terminal which concerns on the 2nd Embodiment of this invention. It is a figure which shows the structure of the terminal which concerns on the 3rd Embodiment of this invention. It is a figure which shows the process of the terminal which concerns on the 3rd Embodiment of this invention. It is the figure which illustrated the menu display which concerns on the 3rd Embodiment of this invention. It is a figure which shows the structure of the terminal which concerns on the 4th Embodiment of this invention. It is a figure which shows the process of the terminal which concerns on the 4th Embodiment of this invention. It is the figure which illustrated the menu display which concerns on the 4th Embodiment of this invention. It is the figure which illustrated the list display of the procedure which concerns on the 4th Embodiment of this invention. It is the figure which illustrated photography operation concerning a 4th embodiment of the present invention. It is the figure which illustrated the operation assistance display which concerns on the 4th Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
Note that the constituent elements in the present embodiment can be appropriately replaced with existing constituent elements and the like, and various variations including combinations with other existing constituent elements are possible. Therefore, the description of the present embodiment does not limit the contents of the invention described in the claims.

<First Embodiment>
A first embodiment of the present invention will be described with reference to FIGS. 1 and 2.

<Terminal configuration>
As shown in FIG. 1, the terminal according to the present embodiment includes an external application 100, an operation monitoring application 200, and a display unit 300. The operation monitoring application 200 further includes an activation unit 210, state transition information, and the like. The acquisition part 220 and the operation condition estimation part 230 are provided.

  The external application 100 is an application downloaded from the outside in order to execute processing that the user wants to perform using the terminal. In the present embodiment, it is assumed that the application can obtain state transition information that shows the state of the state transition.

  The operation monitoring application 200 is an application that monitors the operation status of an application created by a third party. The display unit 300 displays operation assistance information on an operation screen of an application created by a third party according to an operation situation estimated by an operation situation estimation unit 230 described later.

  The activation unit 210 activates the application 100 created by the third party. The state transition information acquisition unit 220 acquires state transition information from the third party created application 100. Here, examples of the state transition information include a return value obtained from the external application 100. The operation status estimation unit 230 estimates the operation status of the third party-created application 100 based on the acquired state transition information.

<Terminal processing>
Processing of the terminal according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 2, first, the activation unit 210 in the operation monitoring application 200 activates the third party-created application 100 (step S <b> 110), and the state transition information acquisition unit 220 starts the third party-created application 100. State transition information is acquired from (step S120).

  Next, the operation status estimation unit 230 estimates the operation status of the third-party-created application 100 based on the acquired state transition information (step S130), and the display unit 300 according to the estimated operation status, Operation assistance information is displayed on the operation screen of the application 100 created by the third party (step S140).

  As described above, according to the present embodiment, the user only activates the external application, and the operation assistance information is displayed on the external application without performing another intentional operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

<Second Embodiment>
A second embodiment of the present invention will be described with reference to FIGS. 3 and 4.

<Terminal configuration>
As shown in FIG. 3, the terminal according to the present embodiment includes an external application 110, an operation monitoring application 201, a display unit 300, and a management unit 400. The operation monitoring application 201 further includes an activation unit 210. And an operation state estimation unit 231. In addition, about the component which attaches | subjects the same code | symbol as 1st Embodiment, since it has the same function, the detailed description is abbreviate | omitted.

  The external application 110 is an application downloaded from the outside in order to execute a process that the user wants to perform using the terminal. For example, the external application 110 is a book application such as a photo application or a web search application for taking a photo. In the embodiment, an application is assumed in which state transition information indicating the state of the state transition cannot be obtained directly.

  The management unit 400 provides and manages basic functions used for the third party-created application 100. The management unit 400 is specifically an operation system (OS) in a PC or a mobile phone. The operation state estimation unit 231 acquires the state change from the management unit 400 and estimates the operation state of the application 100 created by the third party. Specifically, for example, in the case of a photo application, the operation status such as taking a photo or saving a photo is estimated from the increase in the capacity of the memory element in the card memory or the terminal. Estimates the operation status of whether or not a web search has been executed from the state of change in the web browsing history in the browser. In addition, the detection of transition from another application created by a third party to activation of another application or another screen is also included.

<Terminal processing>
The processing of the terminal according to the present embodiment will be described using FIG.

  As illustrated in FIG. 4, first, the activation unit 210 activates the third-party-created application 100 (step S <b> 210), and the operation situation estimation unit 231 is basically used for the third-party-created application 100. The state change is acquired from the management unit 400 that provides and manages the function, and the operation status of the application 100 created by the third party is estimated (step S220). Then, the display unit 300 displays operation assistance information on the operation screen of the application 100 created by the third party according to the estimated operation situation (step S230).

  As described above, according to the present embodiment, even when explicit information indicating the operation status is not obtained from the external application, the user can estimate the operation status indirectly from the change in the state. Operation assistance information is displayed on the external application simply by activating the external application and without performing any other intentional operation. Therefore, if an operation is performed according to the operation assistance information, it is possible to execute what is desired without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

<Third Embodiment>
A third embodiment of the present invention will be described with reference to FIGS.

<Terminal configuration>
As illustrated in FIG. 5, the terminal according to the present embodiment includes an external application 100, an operation monitoring application 202, a second display unit 310, a first display unit 510, a selection unit 520, and a storage unit 530. And the first activation unit 540, and the operation monitoring application 202 further includes a second activation unit 240, a state transition information acquisition unit 220, and an operation state estimation unit 230. In addition, about the component which attaches | subjects the same code | symbol as 1st, 2nd embodiment, since it has the same function, the detailed description is abbreviate | omitted.

  For example, the first display unit 510 displays an operation menu as shown in FIG. The selection unit 520 is a function for the user to select a target operation item from the operation menu displayed on the first display unit 510.

  The storage unit 530 stores operation items, the external application 100, and an operation monitoring application 202 that monitors the operation status of an application created by a third party in association with each other. When the first activation unit 540 selects a target operation item from the displayed operation menu, the first activation unit 540 searches the storage unit 530 and monitors the operation status of the third-party-created application 100 associated with the operation item. The monitoring application 202 is activated. The second activation unit 240 activates the external application 100 associated with the operation item.

<Terminal processing>
Processing of the terminal according to the present embodiment will be described using FIG.

  As shown in FIG. 6, first, the first display unit 510 displays an operation menu (step S310), and the selection unit 520 selects a target operation item from the displayed operation menu (step S320).

  When the first operation unit 540 selects a target operation item from the displayed operation menu, the first activation unit 540 associates the operation item, the external application 100, and the operation monitoring application 202 that monitors the operation status of the third party created application. In step S330, the storage monitoring unit 202 searches the storage unit 530 stored therein and monitors the operation status of the third party-created application 100 associated with the operation item.

  The second activation unit 240 activates the external application 100 associated with the operation item (step S340), and the state transition information acquisition unit 220 acquires state transition information from an application created by a third party (step S350). .

  Then, the operation status estimation unit 230 estimates the operation status of the third party-created application 100 based on the acquired state transition information (step S360), and the second display unit 310 responds to the estimated operation status. Then, the operation assistance information is displayed on the operation screen of the application 100 created by the third party (step S370).

  As described above, according to the present embodiment, when the operation menu is presented to the user and the user selects the menu corresponding to the operation purpose, the external application corresponding to the operation purpose is automatically started, In order to estimate the operation status from the transition and display the operation assistance information on the external application, the user only has to select a menu according to the operation purpose and perform other intentional actions. If you follow the operation assistance information, you can do what you want without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

<Fourth Embodiment>
A fourth embodiment of the present invention will be described with reference to FIGS.

<Terminal configuration>
As shown in FIG. 8, the terminal according to the present embodiment includes an external application 100, an operation monitoring application 203, a second display unit 310, a first display unit 510, a selection unit 520, and a storage unit 530. , A management unit 550, and a flow management application 560. The operation monitoring application 202 further includes a second activation unit 240, a state transition information acquisition unit 220, and an operation state estimation unit 230. . In addition, about the component which attaches | subjects the same code | symbol as 1st, 2nd, 3rd embodiment, since it has the same function, the detailed description is abbreviate | omitted.

  When the management unit 550 selects a target operation item from the displayed operation menu, the flow management application 560 that is activated searches the storage unit 530, and the third-party-created application 100 corresponding to a series of flows. The activation and termination of the operation monitoring application 203 that monitors the operation status is managed.

  That is, the present embodiment starts up the operation monitoring application 203 having different functions according to a series of work flows from the operation menu for each purpose displayed on the first display unit 510, and supports the storage unit 530. The attached external application 100 is activated, and operation assistance display is performed on the display screen of the external application 100.

<Terminal processing>
The processing of the terminal according to the present embodiment will be described using FIG.

  As shown in FIG. 9, first, the first display unit 510 displays an operation menu (step S410), and the selection unit 520 selects a target operation item from the displayed operation menu (step S420).

  When the management unit 550 selects a target operation item from the displayed operation menu, the flow management application 560 that is started up corresponds to the external application 100 corresponding to a series of flows for completing the operation purpose of the operation item, and the external application 100. Operation monitoring for monitoring the operation status of the third party-created application 100 corresponding to a series of flows by searching the storage unit 530 for storing the operation monitor application 203 for monitoring the operation status of the third-party created application. The activation and termination of the application 203 are managed (step S430).

  The second activation unit 240 activates the external application 100 corresponding to a series of flows (step S440), and the state transition information acquisition unit 220 acquires state transition information from the third party created application 100 (step S450). .

  The operation status estimation unit 230 estimates the operation status of the third-party-created application 100 based on the acquired state transition information (step S460), and the second display unit 310 determines the operation status estimated according to the estimated operation status. Operation assistance information is displayed on the operation screen of the application 100 created by the third party (step S470).

The above processing will be specifically described below with reference to FIGS.
First, the purpose-specific menu list shown in FIG. 10 is displayed on the terminal screen. In the case of FIG. 10, the menu includes “I want to exchange addresses!”, “I want to take a landscape!”, “I want to send photos to my grandchildren!”, “I want to check my location on a map!” I want to know the stock price! "Is displayed. Other menus are also prepared, and other menus can be browsed and selected by operating the → button at the bottom of the screen.

  For example, when “I want to send a photograph to a grandchild!” Is selected from the menu list for each purpose in FIG. 10, the screen display changes as shown in FIG. 11, and a procedure for achieving the purpose is displayed. Specifically, the procedures of “1. Take a photo!”, “2. Check the photo with a viewer!” And “3. Send a photo by e-mail!” Are displayed.

  Here, if the right arrow button is operated once, a screen corresponding to the procedure of “1. Take a photo!” Is displayed as shown in FIG. In detail, the terminal, the subject displayed on the screen in the terminal, and the operation assistance information of “you can take a picture by pressing the button” are displayed superimposed on this. Then, when the transition is made to FIG. 13, the shutter position is displayed in an overlapping manner.

  In addition, in the menu display by purpose of FIG. 10, the achievement level may be provided for each menu, and the user's performance by purpose may be determined and displayed from the operation implementation status. In FIG. 11, the entire flow may be displayed before an operation or between operations. In FIG. 12, in order to understand which application is activated, the application may be activated by pressing an icon of the application. Further, in FIG. 13, as the operation assistance information, in addition to superimposing and displaying on the upper layer of the application, notification by voice synthesis, use of sound or vibration, and the like may be used. Further, in order not to perform an unexpected operation, an operation other than a necessary operation may be ignored.

  As described above, according to the present embodiment, the operation menu is presented to the user, and when the user selects the menu corresponding to the operation purpose, the flow management application is started. Manages startup and termination of multiple operation monitoring applications, and each operation monitoring application automatically starts an external application corresponding to a series of flows for completing each operation purpose. Since the operation status is estimated and the operation assistance information is displayed on the external application, the user can select the menu according to the operation purpose and perform the operation assistance information without performing any other intentional operation. If you follow the procedure, you can do what you want without difficulty. In addition, by repeating this operation, it is possible to expect an improvement in proficiency so that the operation can be reproduced without operation assistance information.

  The terminal of the present invention can be realized by recording the processing of the terminal on a recording medium readable by the computer system, causing the terminal to read and execute the program recorded on the recording medium. The computer system here includes an OS and hardware such as peripheral devices.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW (World Wide Web) system is used. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  The embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the embodiments, and includes designs and the like that do not depart from the gist of the present invention.

DESCRIPTION OF SYMBOLS 100; External application 110; External application 200; Operation monitoring application 201; Operation monitoring application 202; Operation monitoring application 203; Operation monitoring application 210; Activation part 220; State transition information acquisition part 230; Operation situation estimation part 231; Unit 240; second activation unit 300; display unit 310; second display unit 400; management unit 510; first display unit 520; selection unit 530; storage unit 540; first activation unit 550; ; Flow management application

Claims (13)

An application created by a third party and an operation monitoring application for monitoring the operation status of the application created by the third party;
The operation monitoring application is
Starting means for starting the third party created application;
State transition information acquisition means for acquiring state transition information from the third party created application;
Based on the acquired state transition information, an operation status estimation means for estimating the operation status of the third party created application,
With
A terminal comprising display means for displaying operation assistance information on an operation screen of an application created by the third party according to the estimated operation situation. A third-party application,
An operation monitoring application for monitoring the operation status of the third party created application;
Management means for providing and managing basic functions used in the third party created application;
Have
The operation monitoring application is
Starting means for starting the third party created application;
Operation status estimation means for acquiring the state change from the management means and estimating the operation status of the third party created application;
With
A terminal comprising display means for displaying operation assistance information on an operation screen of an application created by the third party according to the estimated operation situation. An application created by a third party and an operation monitoring application for monitoring the operation status of the application created by the third party;
First display means for displaying an operation menu;
Selecting means for selecting a desired operation item from the displayed operation menu;
Storage means for storing the operation items, the external application, and an operation monitoring application for monitoring the operation status of the third party created application;
When a target operation item is selected from the displayed operation menu, the storage unit is searched, and an operation monitoring application for monitoring an operation status of the third party-created application associated with the operation item is started. 1 activation means,
The operation monitoring application is
Second activation means for activating the external application associated with the operation item;
State transition information acquisition means for acquiring state transition information from the third party created application;
Based on the acquired state transition information, an operation status estimation means for estimating the operation status of the third party created application,
With
A terminal comprising: second display means for displaying operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation. An application created by a third party, an operation monitoring application for monitoring the operation status of the application created by the third party, and a flow management application;
First display means for displaying an operation menu;
Selecting means for selecting a desired operation item from the displayed operation menu;
Storage means for storing an external application corresponding to a series of flows for completing the operation purpose of the operation item in association with an operation monitoring application for monitoring an operation status of the third party created application;
When a target operation item is selected from the displayed operation menu, the flow management application that is activated searches the storage unit and monitors the operation status of the third party created application corresponding to the series of flows. Management means for managing the start and end of the operation monitoring application to be
The operation monitoring application is
Starting means for starting the external application corresponding to the series of flows;
State transition information acquisition means for acquiring state transition information from the third party created application;
Based on the acquired state transition information, an operation status estimation means for estimating the operation status of the third party created application,
With
A terminal comprising: second display means for displaying operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation.   The operation state estimation unit estimates an operation state of the third party-created application using a return value acquired from the third party-created application as state transition information. The terminal according to claim 4. An operation assisting method for an application in a terminal provided with an activation unit, a state transition information acquisition unit, an operation state estimation unit, and a display unit,
A first step in which the activation means activates an application created by a third party;
A second step in which the state transition information acquisition means acquires state transition information from the third party created application;
A third step in which the operation status estimation means estimates an operation status of the third party-created application based on the acquired state transition information;
A fourth step in which the display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A method for assisting operation of an application, comprising: An application operation assisting method in a terminal comprising a management means, an activation means, an operation status estimation means, and a display means,
A first step in which the activation means activates an application created by a third party;
The operation status estimation means obtains a change in state from the management means that provides and manages a basic function used for the application created by the third party, and the operation status of the application created by the third party A second step of estimating
A third step in which the display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A method for assisting operation of an application, comprising: First display means, selection means, storage means, first activation means, second activation means, state transition information acquisition means, operation status estimation means, and second display means A method for assisting operation of an application on a terminal,
A first step in which the first display means displays an operation menu;
A second step in which the selection means selects a target operation item from the displayed operation menu;
When the first activation unit selects a target operation item from the displayed operation menu, the operation item, the external application, and an operation monitoring application for monitoring an operation status of a third party created application are associated with each other. A third step of searching the storage means for storing and starting an operation monitoring application for monitoring an operation status of the third party-created application associated with the operation item;
A fourth step in which the second activation means activates the external application associated with the operation item;
A fifth step in which the state transition information acquisition means acquires state transition information from the third party created application;
A sixth step in which the operation state estimating means estimates an operation state of the third party-created application based on the acquired state transition information;
A second step in which the second display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A method for assisting operation of an application, comprising: Application operation on a terminal including a first display unit, a selection unit, a storage unit, a management unit, an activation unit, a state transition information acquisition unit, an operation status estimation unit, and a second display unit An auxiliary method,
A first step in which the first display means displays an operation menu;
A second step in which the selection means selects a target operation item from the displayed operation menu;
When the management means selects a target operation item from the displayed operation menu, the flow management application that is activated is an external application corresponding to a series of flows for completing the operation purpose of the operation item. An operation monitoring application that searches the storage means for associating and storing the operation monitoring application that monitors the operation status of the three-party created application and monitors the operation status of the third-party created application corresponding to the series of flows. A third step for managing activation and termination;
A fourth step in which the activation means activates the external application corresponding to the series of flows;
A fifth step in which the state transition information acquisition means acquires state transition information from the third party created application;
A sixth step in which the operation state estimating means estimates an operation state of the third party-created application based on the acquired state transition information;
A second step in which the second display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A method for assisting operation of an application, comprising: A program for causing a computer to execute an operation assisting method for an application in a terminal including an activation unit, a state transition information acquisition unit, an operation state estimation unit, and a display unit,
A first step in which the activation means activates an application created by a third party;
A second step in which the state transition information acquisition means acquires state transition information from the third party created application;
A third step in which the operation status estimation means estimates an operation status of the third party-created application based on the acquired state transition information;
A fourth step in which the display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A program that causes a computer to execute. A program for causing a computer to execute an operation assisting method for an application in a terminal including a managing unit, a starting unit, an operation state estimating unit, and a display unit,
A first step in which the activation means activates an application created by a third party;
The operation status estimation means obtains a change in state from the management means that provides and manages a basic function used for the application created by the third party, and the operation status of the application created by the third party A second step of estimating
A third step in which the display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A program that causes a computer to execute. First display means, selection means, storage means, first activation means, second activation means, state transition information acquisition means, operation status estimation means, and second display means A program for causing a computer to execute an application operation assisting method in a terminal,
A first step in which the first display means displays an operation menu;
A second step in which the selection means selects a target operation item from the displayed operation menu;
When the first activation unit selects a target operation item from the displayed operation menu, the operation item, the external application, and an operation monitoring application for monitoring an operation status of a third party created application are associated with each other. A third step of searching the storage means for storing and starting an operation monitoring application for monitoring an operation status of the third party-created application associated with the operation item;
A fourth step in which the second activation means activates the external application associated with the operation item;
A fifth step in which the state transition information acquisition means acquires state transition information from the third party created application;
A sixth step in which the operation state estimating means estimates an operation state of the third party-created application based on the acquired state transition information;
A second step in which the second display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A program that causes a computer to execute. Application operation on a terminal including a first display unit, a selection unit, a storage unit, a management unit, an activation unit, a state transition information acquisition unit, an operation status estimation unit, and a second display unit A program for causing a computer to execute an auxiliary method,
A first step in which the first display means displays an operation menu;
A second step in which the selection means selects a target operation item from the displayed operation menu;
When the management means selects a target operation item from the displayed operation menu, the flow management application that is activated is an external application corresponding to a series of flows for completing the operation purpose of the operation item. An operation monitoring application that searches the storage means for associating and storing the operation monitoring application that monitors the operation status of the three-party created application and monitors the operation status of the third-party created application corresponding to the series of flows. A third step for managing activation and termination;
A fourth step in which the activation means activates the external application corresponding to the series of flows;
A fifth step in which the state transition information acquisition means acquires state transition information from the third party created application;
A sixth step in which the operation state estimating means estimates an operation state of the third party-created application based on the acquired state transition information;
A second step in which the second display means displays operation assistance information on an operation screen of the application created by the third party according to the estimated operation situation;
A program that causes a computer to execute.