JP4213008B2 - Information terminal device, operation support method, and operation support program - Google Patents

Description

  The present invention relates to an information terminal device, an operation support method, and an operation support program, and more specifically, learns a tendency of an operation performed by a user from information on an operation history performed by the user, and predicts an operation by the user. The present invention relates to an information terminal device to be supported, an operation support method performed by the device, and a program for executing the method.

  In recent years, information terminal devices such as mobile phones and PDAs have become multifunctional, and it is necessary to learn various operation procedures in order to use all functions. Of these many functions, only a part of functions are frequently used by the user, and the same operation is repeatedly performed in order to repeatedly execute some of the functions. Therefore, the information terminal device itself grasps the specific operation procedures and customary operation procedures that are often performed by the user, and predicts the operation suitable for the next operation and automatically executes it or teaches it. Is convenient. However, as far as the inventor knows, there is no conventional technique in which an information terminal device predicts an operation and automatically executes it or teaches it. In other words, there is no user-specific information terminal device that automatically sets personality and habits related to user operations.

As related arts that are not direct techniques, there are techniques disclosed in Patent Documents 1 and 2. In Patent Document 1, in order to realize an individualized information terminal device, only information required by a user is selected from information stored in a connected server system and stored in the information terminal device. The technology is described. Patent Document 2 discloses an information terminal device that learns a user's current time, current position, and preference from a message received from another information terminal device.
JP 2002-135461 A JP 2001-265809 A

  However, in the technique described in Patent Literature 1, it is necessary to select a setting desired by the user from the server system, and the information terminal device does not automatically perform the next operation.

  Moreover, in the technique described in Patent Document 2, the user's preference is learned from spot information such as a restaurant or a sightseeing spot composed of position information and explanation contents, and the user's operation is not learned. In addition, the purpose of using the technique described in Patent Document 2 is to collate with other users' preferences, and does not automatically operate or set the information terminal device.

  As described above, in the conventional information terminal device, it is necessary to repeatedly perform the same operation in order to repeatedly execute and set the same function. In particular, a portable information terminal device has a problem that the operation is complicated and complicated for the user because the operability is sacrificed with emphasis on portability.

  Therefore, an object of the present invention is to predict a suitable operation next to a specific operation input by the user based on a previous operation history performed by the user, and to support the operation input by the user according to this prediction. To provide an improved information terminal device, operation support method, and operation support program.

  The present invention is directed to an information terminal device that executes a function corresponding to an operation based on an operation input by a user. And in order to achieve the said objective, the information terminal device of this invention is provided with the input part, the operation history memory | storage part, the operation prediction part, and the prediction operation assistance part.

The input unit inputs an operation requested by the user. The operation history storage unit stores information related to an operation input to the input unit and a time when the operation is input as an operation history. Operation prediction unit, when an operation is input to the input unit, the operation history based on the operation history information stored in the storage unit, the time for the next operation that would user inputs following the input operation To predict from the operations that are determined to be chain operations . The prediction operation support unit supports execution of a function corresponding to the next operation predicted by the operation prediction unit.

  As the support content of the prediction operation support unit, a function corresponding to the next operation predicted by the operation prediction unit is automatically executed, and information on the next operation executed is stored in the operation history storage unit as an operation history. It is possible. Or, when a new operation is input to the input unit, the next operation predicted by the operation prediction unit based on the operation input before the new operation is compared with the new operation. It is also conceivable to notify the user when they are different.

  The operation history storage section preferably stores operation history information describing information related to operations in the order in which the user operated them. Further, the operation history storage unit may store operation history information that is statistically described by classifying information related to operations into contents continuously operated by the user.

  The typical operation predicting unit calculates the occurrence frequency related to the next operation performed continuously after the operation previously input to the input unit based on the operation history information, and is continuously executed obtained from the occurrence frequency. The next operation with the highest probability is predicted as the next operation that the user will input. Here, it is desirable that the operation prediction unit calculates the occurrence frequency in consideration of at least one operation continuously executed before the operation input to the input unit. The occurrence frequency is preferably calculated based on operation history information every time an operation is input to the input unit.

  In order to make the operation prediction more accurate suitable for the user, the operation prediction unit predicts the next operation based on the occurrence frequency calculated from the latest operation history information, or the occurrence calculated in the past Whether to predict the next operation based on the frequency may be selectable by the user. Further, when the operation history information in the operation history storage unit is statistically insufficient to predict the next operation, the operation prediction unit may not predict the next operation. Moreover, the function which a prediction operation assistance part performs automatically may be matched beforehand for every next operation which can be estimated by the operation prediction part.

Further, the operation predicting unit predicts the next operation that has been performed in succession to the operation input to the input unit and that is contradictory or contradictory to the operation input to the input unit. It is effective to make it excluded from. Also, the operation predicting unit compares the next operation automatically executed with a new operation input to the input unit thereafter, and if both operations are in conflict or contradictory, the next operation It is also an effective technique to reduce the possibility that the next operation will be automatically executed by lowering the statistic regarding the history of the chain operation that caused the automatic execution .

  In addition, the information terminal device of the present invention may further include an operation detection unit that determines whether or not the operation input to the input unit is a predetermined operation, in the above configuration. In this configuration, the operation prediction unit can predict the next operation that the user will input only for the operation that is determined to be the predetermined operation by the operation detection unit.

  In addition, the information terminal device of the present invention may further include an information management unit that manages special information related to an operation input to the input unit, in the above configuration. In this configuration, the operation history storage unit stores information related to the operation input to the input unit as operation history information together with special information provided from the information management unit, and the operation prediction unit is stored in the operation history storage unit. It is possible to predict the next operation that the user will input based on the operation history information including the special information. As this special information, information such as date, time, day of the week, user type, area, or movement state when an operation is input to the input unit can be considered.

  On the other hand, the information terminal device of the present invention can be configured such that the operation history storage processing and the operation prediction processing are functionally independent on an external server device. For example, an input unit for inputting an operation requested by a user, a transmission unit that transmits information about an operation input to the input unit as an operation history to the server device, and an input unit predicted by the server device A receiving unit that receives information about the next operation that the user will input following the operation from the server device, and a predictive operation support unit that supports execution of a function corresponding to the next operation received by the receiving unit; Is an information terminal device.

  Alternatively, the information terminal device of the present invention can be configured to write the operation history information on a recording medium. For example, an input unit for inputting an operation requested by a user, a recording unit that stores information related to an operation input to the input unit as an operation history in a recording medium, and a recording medium when an operation is input to the input unit An operation unit that acquires operation history information stored in the storage unit, and predicts a next operation that the user will input following the operation input to the input unit based on the operation history information acquired by the acquisition unit The information terminal device includes an operation prediction unit and a prediction operation support unit that supports execution of a function corresponding to the next operation predicted by the operation prediction unit.

  Each process performed by the input unit, the operation history storage unit, the operation prediction unit, and the operation support unit of the information terminal device described above can be regarded as an operation support method that provides a series of processing procedures. That is, in the information terminal device, an operation requested by the user is input, information regarding the input operation is stored as an operation history in a predetermined storage unit, and stored in the storage unit when an operation requested by the user is input. An operation support method that predicts a next operation that a user will input following an input operation based on the operation history information that is input, and supports execution of a function corresponding to the predicted next operation. is there.

  Preferably, this operation support method is provided in the form of a program for causing an information terminal device to execute a series of processing procedures. This program may be recorded on a computer-readable recording medium.

  According to the present invention described above, an operation suitable for the user who uses the device is predicted because an operation suitable for the next operation after the operation input based on the operation history performed by the user previously is predicted. Can be built. Also, since the predicted operation is automatically executed or notified to the user when it does not coincide with the next input operation, the operability of the operation input by the user can be improved. In addition, since operation prediction can be performed only for a specific operation, the present invention can be used even when the processing capability of the information terminal device is limited or the storage capacity of the operation history storage unit is limited. It becomes possible. Further, special information such as time is also stored as operation history information together with information related to user operations, and an operation prediction model considering special information can be created. Can be built.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
(First embodiment)
FIG. 1 is a block diagram showing a configuration of an information terminal device according to the first embodiment of the present invention. In FIG. 1, the information terminal device according to the first embodiment includes an input unit 11, an operation history storage unit 12, an operation prediction unit 13, and an operation support unit 14. The operation support unit 14 includes a prediction operation execution unit 15 and a user notification unit 16.

First, the outline | summary of each structure of the information terminal device which concerns on 1st Embodiment is demonstrated.
The input unit 11 inputs an operation requested by the user and notifies the operation history storage unit 12 of the operation. The operation history storage unit 12 stores information related to the input operation notified from the input unit 11 temporarily or in the long term as an operation history. Based on the operation history information stored in the operation history storage unit 12, the operation prediction unit 13 predicts an operation that is likely to be performed next by the user. The operation support unit 14 is configured to support execution of a function corresponding to the operation predicted by the operation prediction unit 13 and is typically realized by either the prediction operation execution unit 15 or the user notification unit 16. Is done. It is possible to include both configurations as shown in FIG. 1, but in this case, only one of the configurations operates by function selection or the like. The prediction operation execution unit 15 automatically executes the operation predicted by the operation prediction unit 13. Information related to the operation automatically executed by the prediction operation execution unit 15 is stored in the operation history information of the operation history storage unit 12 in a recording format that shows that the operation is automatically executed. The user notification unit 16 compares the operation predicted by the operation prediction unit 13 with the operation input to the input unit 11 next by the user, and when the predicted operation is not operated by the user, the user notification unit 16 matches the prediction. The user is notified that the operation has not been performed.

Next, detailed operation of the information terminal device according to the first embodiment having the above-described configuration will be described.
The input unit 11 is an interface for a user to input an operation requested to the information terminal device, and corresponds to a numeric keypad, a button, a jog dial, or the like attached to the device. In addition, the input unit 11 includes a touch panel for designating an operation by touching the screen of the information terminal device, a voice recognition device for recognizing sound or a user's voice, an image recognition device for capturing and recognizing an image or video, and the like. It is also possible to use it. Furthermore, it is possible to use a device that receives a predetermined operation signal from another device in a wired or wireless manner.

  An example of the operation input to the input unit 11 is shown in FIG. Each specific operation content (function) 202 is assigned in advance a unique identification ID (operation ID) 201 for uniquely specifying the operation. In FIG. 2, for example, “game01” is an operation ID for starting up the game A, and “mannerOn” is an operation ID for setting the manner mode. The method of assigning the operation ID 201 and the operation content 202 depends on the function of the information terminal device and is not limited to that shown in FIG. If the operation can be uniquely identified, it is not necessary to associate the operation ID 201 with each operation content 202 as shown in FIG. When an operation is input to the input unit 11, an operation ID corresponding to the operation is notified to the operation history storage unit 12.

  The operation history storage unit 12 receives information related to operations input to the input unit 11, that is, operation IDs, and sequentially stores them in a predetermined storage area. Thereby, the operation history storage unit 12 stores the history information of operations executed by the information terminal device in time series. An example of the operation history information is shown in FIG. In FIG. 3, an execution number 301 is a serial number for managing the order of executed operation IDs 302. However, if there is another mechanism that can manage the execution order of operations, the item of the execution number 301 is not particularly necessary. In this operation history information, information on operations automatically executed by the prediction operation execution unit 15 described later is also stored as a history (described as automatic operation in FIG. 3). In addition, it is preferable that the user can erase all the operation history information stored in the operation history storage unit 12. In this way, it is possible to delete all old operation history information and predict an operation based on new operation history information. The operation history storage unit 12 notifies the operation prediction unit 13 of the operation ID every time an operation ID related to the operation input to the input unit 11 is added to the operation history information.

  The operation prediction unit 13 creates a predetermined operation prediction model based on the operation history information stored in the operation history storage unit 12. The operation prediction model is obtained by determining the probability of an operation that will be performed next to the occurrence of a certain operation based on the number of occurrences (frequency) of operations performed continuously by the user in the past. . The operation prediction model may be created based on all the operation history information or may be created based on a part of the operation history information (for example, only the latest operation history information), and is preferably selectable by the user. In addition, the operation prediction model may be created every time an operation is input to the input unit 11 or may be periodically updated every certain period. There are various methods for creating the operation prediction model. A typical example will be described below. In the following description, an operation performed by the user for two consecutive times is expressed as “two-chain operation”, and an operation performed for three consecutive times is expressed as “three-chain operation”.

  In creating the operation prediction model, the operation prediction unit 13 first creates statistical information as shown in FIG. 4 from the operation history information stored in the operation history storage unit 12. The statistical information shown in FIG. 4 is statistically described by dividing information related to operations into contents that are continuously operated by the user. In FIG. 4, the operation content 401 includes an item 411 relating to the total number of occurrences of all single operations, an item 412 indicating whether previous operations and automatic operations are present, an item 413 relating to the single occurrence of each operation, and the occurrence of a chain operation. Item 414 is set. The number of occurrences 402 indicates the number of occurrences for each item of the operation content 401. The following contents can be read from this statistical information. The user has performed 2944 operations so far, and “game01” has been operated 32 times. Of the 32 times this “game01” was executed, “game02” was executed twice, followed by “volume00” was executed 28 times, and “mannerOn” was executed twice. It is. Further, out of 28 times “volume00” executed after “game01”, “mannerOn” was executed 10 times, and “dialLockOn” was executed 8 times. These pieces of statistical information can all be obtained from the operation history information shown in FIG. Note that the statistical information may be created by the operation prediction unit 13 as described above, or may be created in advance by the operation history storage unit 12.

  Then, the operation prediction unit 13 creates an operation prediction model as shown in FIG. 5 from the operation history information using the statistical information described above. In FIG. 5, the operation prediction model is a probability value 502 of occurrence for a model 501 that has been chain-operated by the user in the past. In FIG. 5, the probability that the operation x is performed after the operation a, the operation b... The operation n is continuously executed is expressed by P (x | a b... N). For example, P (game02 | game01) expresses the probability that “game02” will be executed after executing “game01”, and the probability value is 0.0625. This probability value is obtained from the statistical information occurrence frequency 402, and can be obtained by dividing the number of occurrences of a specific two-chain operation by the total number of occurrences of the chain operation for a certain operation. For example, if “game01” is first performed by the total number of times two chain operations are performed (= 32) and the number of times “game01” → “game02” is performed (= 2), the probability P (game02 | game01) = 0.0625 (= 2/32) is obtained. As the operation prediction model, it is not necessary to obtain probability values for all the chain operation models as shown in FIG. 5, and only the chain operation model having the highest probability value may be obtained for each operation.

  The number of chain operations to be generated as an operation prediction model can be set freely, but depends on the number of chains used for prediction in the operation prediction unit 13 in the subsequent stage. Since the operation prediction unit 13 fixedly sets the number of chains to be predicted for operation, basically, an operation prediction model having only the set number of chains is sufficient. Note that the larger the number of chain operations, the closer the prediction operation can be to the operation desired by the user, but the reliability of the probability value becomes lower when the number of operation history samples is small. there is a possibility. Also, if the number of chain operations is increased, the number of combinations of operations becomes enormous, and a large storage capacity is required.

  Note that if the operation history information sufficient to create the operation prediction model is not accumulated in the operation history storage unit 12, the operation prediction model to be created has low accuracy. It is preferable not to create a model or to predict operation even if it is created. Two examples of cases where the operation history information is insufficient are shown. One is a case where the total number of occurrences of all single operations (item 43) is less than a certain threshold value. This threshold value depends on the number of operation types and the number of chained operations for estimating the probability. For example, when there are 10 types of operations and there are 3 predicted operations and it is desired to secure an average of occurrence frequency of operation a → operation b 20 times or more, the threshold value is 2000 (= 10 × 10 × 20). Times. The other is a case where the number of occurrences of the operation chain immediately before the determination for predicting the operation is less than a certain threshold value. For example, in estimating the probability P (x | ab), if the occurrence frequency of the operation a → the operation b is less than the threshold value 20, it is determined that it is insufficient to obtain the chain probability. In this case, it is only necessary not to create the operation prediction model only for the operation chain determined to be insufficient.

  Next, operation prediction processing performed by the operation prediction unit 13 will be described with reference to FIG. FIG. 6 is a flowchart illustrating a processing procedure performed by the operation prediction unit 13. The operation prediction unit 13 receives a notification of the operation ID from the operation history storage unit 12 to confirm that a user operation is newly input to the input unit 11 (step S601). When a new operation x is input, the operation prediction unit 13 predicts the next operation that the user will perform following the operation x from the operation prediction model created as described above (step S602).

  This prediction is performed based on the number of chained operations set in advance by the user or the like. When the setting is made to predict an operation with the probability of a two-chain operation, the operation prediction unit 13 selects a probability from among a plurality of P (? | X) in the operation prediction model (? Is any operation). The operation y of P (y | x) having the highest value is predicted as the next operation that the user will perform. In FIG. 4, for example, if the operation x is “game01”, “volume00” is predicted as the next operation that the user will perform based on P (volume00 | game01) having the highest probability value. When the setting is made to predict an operation with the probability of a three-chain operation, the operation prediction unit 13 also considers the operation w performed immediately before the operation x, and a plurality of P (? | The operation z of P (z | w x) having the highest probability value is predicted as the next operation that the user will perform from w x). In FIG. 4, for example, if the operation w is “game01” and the operation x is “volume00”, “mannerOn” will be executed by the user on the basis of P (mannerOn | game01 volume00) having the highest probability value. It is predicted as an operation.

  The operation prediction unit 13 temporarily stores the predicted next operation (hereinafter referred to as a prediction operation) (steps S603 and S604). If the next operation cannot be predicted, the process returns to step S601 to wait for the next user operation. After saving the prediction operation, the operation prediction unit 13 next determines a support method set in advance by the user or the like (step S605). When the support method is automatic execution, the operation prediction unit 13 notifies the prediction operation execution unit 15 of the operation ID of the prediction operation (step S606). When the support method is a user notification, the operation prediction unit 13 performs an operation input by the user this time and a previous prediction operation that is temporarily stored by predicting from the operation input by the previous user. Compare (step S607). If the two operations match, the process returns to step S601 to wait for the next user operation. If the two operations do not match, the operation prediction unit 13 notifies the user notification unit 16 that the two operations do not match (step S608).

  The prediction operation execution unit 15 receives the notification of the operation ID of the prediction operation from the operation prediction unit 13 and automatically executes the operation content (function) corresponding to this operation ID. The operation content automatically executed by this prediction is not limited to the operation content defined in advance for each operation ID in normal time as shown in FIG. For example, as shown in FIG. 7, it is possible to freely define the prediction time. In the example of FIG. 7, for the operation ID “mailSend”, the originally defined operation content “launch mailer and send mail” is changed to the operation content “display mail transmission form” uniquely defined. . Further, the operation content “send” which is originally defined for the operation ID “call” is eliminated. Such a change in the operation content can prevent an email from being transmitted or transmitted without permission when the user does not intend to perform it automatically. In the latter case, the operation is predicted, but there is no actual state of execution. Note that the operation prediction unit 13 may have information on the operation content as shown in FIG. In this case, a unique operation content corresponding to the predicted operation is transmitted from the operation prediction unit 13 to the prediction operation execution unit 15.

  Upon receiving notification from the operation prediction unit 13 that the two operations do not match, the user notification unit 16 notifies the user that the operations do not match. As a notification method, music, voice, or sound effects are generated from the information terminal device through the speaker to appeal to the user's hearing, characters or images are displayed through the display screen attached to the information terminal device, or light is emitted. It is conceivable to appeal to the user's vision. As a result, when the user does not perform the prediction operation predicted by the operation prediction unit 13, it is possible to notify the user with a voice or play a warning sound with a melody. In addition, it is possible to display a statement that there is a possibility that a necessary operation has not been executed, or to warn a character set by the user. It is also possible to notify the user when the information terminal device itself vibrates or the like, or to send information to other devices via wired or wireless communication, since the information terminal device has a communication function.

  The user notification unit 16 can not only notify the user of the operation predicted by the operation prediction unit 13 but also provide an environment in which the user can easily execute the operation. For example, when the user is notified to the user notification unit 16 and executes the prediction operation, the information terminal device is ready to execute the prediction operation, and the user selects whether to execute the button input or other You can do this by entering

  As described above, according to the information terminal device and the operation support method according to the first embodiment of the present invention, an operation suitable for the next operation input by the user based on the operation history performed by the user previously is performed. Predict. Therefore, it is possible to construct an information terminal device whose function is specialized for a user who uses the device. Also, since the predicted operation is automatically executed or notified to the user when it does not coincide with the next input operation, the operability of the operation input by the user can be improved.

  In addition, when the operation prediction model is generated by the operation prediction unit 13, it can be generated so as not to allow a chain operation of conflicting operations. For example, it is meaningless if a key-valid operation is performed after a key-invalid operation has been performed. Therefore, even if operation history information in which such operations are continued exists in the operation history storage unit 12. Do not create an operation prediction model based on this information. Further, by clustering operations of the same system and using them in the operation history, a high-quality operation prediction model can be created with a small amount of operation history information.

  Further, as described above, the operation automatically executed by the prediction operation execution unit 15 is also stored as operation history information in the operation history storage unit 12. This storage process can cope with a case where an operation is automatically executed unlike the user's intention. For example, in order to cancel an unintended operation, the user is likely to immediately perform an operation that is the opposite of the automatically operated content. Therefore, when the operation prediction model is created by the operation prediction unit 13, the possibility of automatic operation is reduced by artificially lowering the statistic regarding the history of chain operations that caused automatic execution. A method can be considered.

(Second Embodiment)
FIG. 8 is a block diagram showing a configuration of an information terminal device according to the second embodiment of the present invention. In FIG. 8, the information terminal device according to the second embodiment includes an input unit 11, an operation detection unit 21, an operation history storage unit 12, an operation prediction unit 13, and an operation support unit 14. The operation support unit 14 includes a prediction operation execution unit 15 and a user notification unit 16. As shown in FIG. 8, the information terminal device according to the second embodiment is different in the configuration of the operation detection unit 21 from the information terminal device according to the first embodiment. Hereinafter, the information terminal device according to the second embodiment will be described focusing on this different configuration.

  The input unit 11 inputs an operation requested by the user and notifies the operation detection unit 21 of the operation. The operation detection unit 21 notifies the operation history storage unit 12 of a predetermined specific operation among the input operations notified from the input unit 11. The specific operation notified by the operation detection unit 21 to the operation history storage unit 12 is set in advance by selecting only a desired operation from among all the operations included in the information terminal device by a developer, a user, or the like. . With this setting, only the operations related to the settings and operations of the entire information terminal device, that is, operations that can be executed and confirmed from the standby state among the application activation and operation settings of the information terminal device and the operation content of the portable information terminal It becomes possible to perform operation prediction. The operation history storage unit 12 stores information about the operation notified from the operation detection unit 21 temporarily or for a long time as an operation history.

  As described above, according to the information terminal device and the operation support method according to the second embodiment of the present invention, operation prediction can be performed only for a specific operation. Therefore, even when the processing capability of the information terminal device is limited or when the storage capacity of the operation history storage unit 12 is limited, the operation prediction of the present invention can be performed.

(Third embodiment)
FIG. 9 is a block diagram showing a configuration of an information terminal apparatus according to the third embodiment of the present invention. In FIG. 9, the information terminal device according to the third embodiment includes an input unit 11, an information management unit 31, an operation history storage unit 32, an operation prediction unit 33, and an operation support unit 14. The operation support unit 14 includes a prediction operation execution unit 15 and a user notification unit 16. As illustrated in FIG. 9, the information terminal device according to the third embodiment includes the information management unit 31, the operation history storage unit 32, and the operation prediction unit 33 with respect to the information terminal device according to the first embodiment. Is different. Hereinafter, the information terminal device according to the third embodiment will be described focusing on this different configuration.

  The input unit 11 inputs an operation requested by the user and notifies the information management unit 31 and the operation history storage unit 32. The information management unit 31 manages special information related to the operation, and notifies the operation history storage unit 32 of the special information for the input operation notified from the input unit 11. The special information includes date, time, day of the week, user type, region, movement state, and the like, and is used in any one or combination thereof. Date, time, and time information of the day of the week are managed using a clock function (not shown) or the like inside the information terminal device. The user type information is managed by an identification number or the like when the user logs on to the information terminal device. The information on the area and the movement state is managed using a position search function (not shown) using GPS in the information terminal device. In addition, the information management unit 31 has various data conversion functions such as a function for converting the year to the year of a specific country and a function for calculating the date and day of the week from the elapsed time from the reference time. .

  The operation history storage unit 32 stores information related to the operation input to the input unit 11 together with special information notified from the information management unit 31 as an operation history temporarily or for a long term. FIG. 10 shows an example of operation history information using time information stored in the operation history storage unit 32. In FIG. 10, an operation date 1001 indicates information on the date on which the operation was performed. The day of the week 1002 indicates information on the day of the week on which the operation was executed. A time 1003 indicates the hour, minute, and second when the operation is executed. In addition, as long as each special information is matched with operation ID1004, it may be other than the data structure shown in FIG.

  Based on the operation history information stored in the operation history storage unit 32, the operation prediction unit 33 predicts an operation that is likely to be performed next by the user. In predicting the next operation, the operation prediction unit 33 creates a predetermined operation prediction model based on the operation history information stored in the operation history storage unit 32. The basic concept of the operation prediction model is as described above, but the operation prediction unit 33 of the third embodiment and the operation prediction unit 13 of the first embodiment differ in the following points.

  First, the operation history storage unit 12 of the first embodiment stores a continuous operation history without considering the time interval. For example, even when the next operation is performed 7 hours after a certain operation is performed, the operation history storage unit 12 records the operation as a continuous operation. For this reason, in the first embodiment, these two unrelated operations may be regarded as a two-chain operation, and an operation prediction model may be created. Therefore, in the third embodiment, the operation prediction with higher accuracy is realized by reflecting only the related chain operation in the creation of the operation prediction model using the time information. For example, in FIG. 10, in the third embodiment, “alarm02” performed at 22:25:30 on July 1 and “mannerOn” performed at 9: 1: 58 on July 2 Not considered as a two-chain operation. In addition, what time interval is not considered as a chain operation may be determined in view of the accuracy of operation prediction desired.

  In addition, the chain operation performed by the user may be an operation performed intensively only during a certain time zone or a certain day of the week. However, since the operation history information stored in the operation history storage unit 12 of the first embodiment does not have time information, such a determination is impossible. Thus, in the third embodiment, operation prediction with higher accuracy is realized by creating an operation prediction model in which chain operations are classified in consideration of time relevance using time information. An example of the operation prediction model created by this method is shown in FIG. In FIG. 11, the probability value of the operation performed after executing “game01” is highest in “volume00” in the time zone from 22:00 to 18:00, and “mannerOn” is highest in the time zone from 18:00 to 22:00. I understand that. Therefore, in this case, the operation predicting unit 33 predicts either “volume00” or “mannerOn” as the next operation that the user will perform according to the time zone in which the user inputs the operation “game01”.

  As described above, according to the information terminal device and operation support method according to the third embodiment of the present invention, special information such as time is stored together with information related to user operation as operation history information. Thereby, since the operation prediction model which considered special information can be created, the information terminal device more suitable for a user's action pattern than the said 1st Embodiment can be constructed | assembled. Needless to say, the information terminal device according to the third embodiment can also be configured to include the operation detection unit 21 described in the second embodiment.

(Fourth embodiment)
In the first to third embodiments, a case has been described in which operation history information is stored and operation prediction is all performed in the information terminal device. These storage and prediction processes can also be performed outside the information terminal device. Hereinafter, this embodiment will be described.

  FIG. 12 is a configuration diagram of a communication system including an information terminal device according to the fourth embodiment of the present invention. The communication system in FIG. 12 includes an information terminal device 121 and a server device 122. The information terminal device 121 and the server device 122 are connected by a wired or wireless transmission path. The information terminal device 121 includes the above-described input unit and operation support unit (if necessary, an information management unit and / or an operation detection unit) and a transmission / reception unit that transmits and receives data to and from the server device 122. (All not shown). The server device 122 includes the above-described operation history storage unit and operation prediction unit, and a transmission / reception unit that transmits / receives data to / from the information terminal device 121 (all not shown).

  Information regarding the operation input by the user is transmitted from the information terminal device 121 to the server device 122. The server device 122 can perform processing with a larger capacity and higher speed than the information terminal device 121. The server device 122 stores information related to the input operation received from the information terminal device 121 in a predetermined storage area. Then, the server device 122 predicts the next operation according to the stored contents, and transmits the prediction result to the information terminal device 121. Based on the prediction result received from the server device 122, the information terminal device 121 performs operation support related to the prediction operation.

(Fifth embodiment)
FIG. 13 is a configuration diagram of a communication system including an information terminal device according to the fifth embodiment of the present invention. The communication system of FIG. 13 includes an information terminal device 131 and a recording medium 132. The information terminal device 131 stores data in the input unit, the operation prediction unit, a part of the operation history storage unit, an operation support unit (an information management unit and / or an operation detection unit, if necessary), and a recording medium 132. And a drive device for writing (all not shown). The drive device may be externally connected without being built in the information terminal device 131. The recording medium 132 is a medium (SD card or the like) for recording the operation history information described above.

  Information regarding the operation input by the user to the information terminal device 131 is written to the recording medium 132 by the drive device. When predicting the next operation, the information terminal device 131 reads information about the operation from the recording medium 132 and predicts the next operation based on the read information. Then, the information terminal device 131 performs operation support based on the prediction operation.

  As described above, according to the information terminal device and the operation support method according to the fourth and fifth embodiments of the present invention, an external device that has a larger storage area than the information terminal device and can perform high-speed processing. It is possible to send data to the configuration for processing.

  Although the present invention has been described in detail above, the above description is merely illustrative of the present invention in all respects and is not intended to limit the scope thereof. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention.

  INDUSTRIAL APPLICABILITY The information terminal device and the operation support method of the present invention are useful for improving the operability by supporting the operation input by the user, and in particular, predicting the operation that will be performed next from the operation performed by the user It is suitable for automatic execution.

The block diagram which shows the structure of the information terminal device which concerns on the 1st Embodiment of this invention The figure which shows an example of operation input into the input part 11 The figure which shows an example of the operation history information memorize | stored in the operation history memory | storage part 12. The figure which shows an example of the statistical information created from the operation history information memorize | stored in the operation history memory | storage part 12 The figure which shows an example of the operation prediction model produced | generated by the operation prediction part 13 The flowchart which shows the treatment procedure performed in the operation prediction part 13 The figure which shows an example of the operation content defined with respect to prediction operation The block diagram which shows the structure of the information terminal device which concerns on the 2nd Embodiment of this invention. The block diagram which shows the structure of the information terminal device which concerns on the 3rd Embodiment of this invention. The figure which shows an example of the operation history information memorize | stored in the operation history memory | storage part 32 The figure which shows an example of the operation prediction model produced | generated by the operation prediction part 33 The block diagram of the communication system containing the information terminal device which concerns on the 4th Embodiment of this invention Configuration diagram of a communication system including an information terminal device according to a fifth embodiment of the present invention

Explanation of symbols

11 Input unit 12, 32 Operation history storage unit 13, 33 Operation prediction unit 14 Operation support unit 15 Prediction operation execution unit 16 User notification unit 21 Operation detection unit 31 Information management unit 121, 131 Information terminal device 122 Server device 132 Recording medium

Claims (20)

An information terminal device that executes a function corresponding to an operation based on an operation input by a user,
An input unit for inputting an operation requested by the user;
An operation history storage unit for storing information about an operation input to the input unit and a time when the operation is input as an operation history;
When an operation is input to the input unit, based on the operation history information stored in the operation history storage unit, the next operation that the user will input following the input operation is performed according to the time. An operation prediction unit for predicting from operations determined to be chain operations ;
A function corresponding to the next operation predicted by the operation prediction unit is automatically executed, and a prediction operation support unit that stores information related to the executed next operation in the operation history storage unit as an operation history is provided .
The operation predicting unit compares the automatically executed next operation with a new operation input to the input unit thereafter, and if both operations are in conflict or contradictory, operations that lowers the statistics regarding the history of the chain operation that caused to be automatically executed, characterized by lowering the possibility of the following actions is automatically performed, the information terminal device.   The prediction operation support unit, when a new operation is input to the input unit, the next operation predicted by the operation prediction unit based on the operation input before the new operation and the new operation The information terminal device according to claim 1, wherein a user is notified when both operations are different.   The information terminal device according to claim 1, wherein the operation history storage unit stores operation history information in which information related to an operation is described in an operation order by a user.   The information terminal device according to claim 1, wherein the operation history storage unit stores operation history information statistically described by dividing information related to operations into contents continuously operated by a user. The operation prediction unit calculates an occurrence frequency related to a next operation that has been performed continuously after the operation previously input to the input unit based on the operation history information, and is continuously executed obtained from the occurrence frequency. The information terminal device according to claim 3 , wherein the next operation with the highest probability of being predicted is predicted as the next operation that the user will input. The operation prediction unit calculates an occurrence frequency related to a next operation that has been performed continuously after the operation previously input to the input unit based on the operation history information, and is continuously executed obtained from the occurrence frequency. The information terminal device according to claim 4 , wherein the next operation with the highest probability of being predicted is predicted as the next operation that the user will input. The operation prediction unit, the taking into account at least one or more operations were performed in succession in front of the input operation to the input unit, and calculates the occurrence frequency, in claim 5 The information terminal device described. The operation prediction unit, the taking into account at least one or more operations were performed in succession in front of the input operation to the input unit, and calculates the occurrence frequency, in claim 6 The information terminal device described. The information terminal device according to claim 5 , wherein the operation prediction unit calculates the occurrence frequency based on the operation history information every time an operation is input to the input unit. The information terminal device according to claim 6 , wherein the operation prediction unit calculates the occurrence frequency based on the operation history information every time an operation is input to the input unit. The operation prediction unit, the operation when the operation history information in the history storage unit is statistically insufficient to predict the next operation, characterized in that it does not predict the next operation, in claim 5 The information terminal device described. The operation prediction unit, the operation when the operation history information in the history storage unit is statistically insufficient to predict the next operation, characterized in that it does not predict the next operation, in claim 6 The information terminal device described. The operation predicting unit predicts a next operation that is performed in succession to the operation input to the input unit and that is in conflict with or contradicting the operation input to the input unit. The information terminal device according to claim 5 , wherein the information terminal device is excluded from a target. The operation predicting unit predicts a next operation that is performed in succession to the operation input to the input unit and that is in conflict with or contradicting the operation input to the input unit. The information terminal device according to claim 6 , wherein the information terminal device is excluded from a target. An operation detection unit that determines whether the operation input to the input unit is a predetermined operation;
The information according to claim 1, wherein the operation prediction unit predicts a next operation that a user will input only for an operation that is determined to be a predetermined operation by the operation detection unit. Terminal device. An information management unit that manages special information related to the operation input to the input unit;
The operation history storage unit stores information on the operation input to the input unit as operation history information together with special information given from the information management unit,
The operation prediction unit predicts a next operation that a user will input based on operation history information including special information stored in the operation history storage unit. The information terminal device described. The information terminal device according to claim 16 , wherein the special information is at least one information of a date, a time, a day of the week, a user type, a region, or a movement state when an operation is input to the input unit. . An information terminal device that executes a function corresponding to an operation based on an operation input by a user,
An input unit for inputting an operation requested by the user;
A recording unit that stores information related to an operation input to the input unit and a time when the operation is input in a recording medium as an operation history;
An acquisition unit that acquires operation history information stored in the recording medium when an operation is input to the input unit;
Based on the operation history information acquired by the acquisition unit, the next operation that the user will input following the operation input to the input unit is determined as a chain operation according to the time. An operation prediction unit to predict;
A function corresponding to the next operation predicted by the operation prediction unit is automatically executed, and a prediction operation support unit that stores information related to the executed next operation in the operation history storage unit as an operation history is provided .
The operation predicting unit compares the automatically executed next operation with a new operation input to the input unit thereafter, and if both operations are in conflict or contradictory, operations that lowers the statistics regarding the history of the chain operation that caused to be automatically executed, characterized by lowering the possibility of the following actions is automatically performed, the information terminal device. An operation support method performed by an information terminal device that executes a function corresponding to an operation based on an operation input by a user,
Inputting an operation requested by the user;
Storing the operation input in the input step and information on the time when the operation was input in a predetermined storage unit as an operation history;
When an operation is input in the input step, based on the operation history information stored in the storage unit, the next operation that the user will input following the input operation is chained according to the time. Predicting from operations determined to be operations ,
Automatically executing a function corresponding to the next operation predicted in the step of predicting , and storing information related to the executed next operation in the predetermined storage unit as an operation history ;
The next operation automatically executed is compared with a new operation input to the input unit thereafter, and if both operations are in conflict or contradictory, the next operation is automatically executed. And a step of reducing the possibility that the next operation is automatically executed by lowering the statistic regarding the history of the chain operation that caused the operation . A program executed by an information terminal device that executes a function corresponding to an operation based on an operation input by a user,
In the information terminal device,
Inputting an operation requested by the user;
Storing the operation input in the input step and information on the time when the operation was input in a predetermined storage unit as an operation history;
When an operation is input in the input step, based on the operation history information stored in the storage unit, the next operation that the user will input following the input operation is chained according to the time. Predicting from operations determined to be operations ,
Automatically executing a function corresponding to the next operation predicted in the step of predicting , and storing information related to the executed next operation in the predetermined storage unit as an operation history ;
The next operation automatically executed is compared with a new operation input to the input unit thereafter, and if both operations are in conflict or contradictory, the next operation is automatically executed. A program for executing a step of lowering a possibility that the next operation is automatically executed by lowering a statistic regarding the history of chain operations that caused the operation .

Images