JP6496264B2 - Mobile terminal, information processing method, and program - Google Patents

Description

  The present invention relates to a mobile terminal, an information processing method, and a program, and more particularly to a technique for supporting a character input operation such as mail in a mobile terminal.

  2. Description of the Related Art Conventionally, devices that display information for guiding operation methods are known. Patent Document 1 discloses a technique for displaying an operation guide corresponding to a user's proficiency level on an operation screen of a digital multifunction peripheral.

JP 2009-259127 A

  In general, an operation display screen of a digital multifunction peripheral displays a screen for allowing a user to select a predetermined operation, and it is considered that display items are predetermined on the operation display screen. On the other hand, when performing character input, for example, on a mobile terminal such as a smartphone, it is not possible to determine in advance what character the user will input. Therefore, displaying the information for guiding the operation method on the operation display screen of the mobile terminal does not always improve the convenience for the user. This is because the display of such information occupies a limited display area of the mobile terminal, and there is a possibility that information desired by the user and at least a part thereof may be shielded.

  The present invention has been made in view of these points, and an object thereof is to provide a technique that balances convenience improvement by notifying operation information to a user of a mobile terminal and effective use of a display screen. To do.

  The first aspect of the present invention is a mobile terminal. The portable terminal includes a display unit that displays a key input area for inputting a key by a touch operation in a part of the display area, and a key input pattern input to the key input area includes any of a plurality of reference patterns. A determination unit that determines whether or not to match, and when a key input pattern input to the key input area matches any of the plurality of reference patterns, information according to the type of the matched reference pattern is notified A notification unit.

  The notification unit may change the display mode of the key input area at the position associated with the matched reference pattern and display the change on the display unit.

  The notification unit may display the information in a display region different from the key input region in the display region of the display unit.

  The notification unit may display the information in a display area of an input key in the display area of the display unit.

  The notification unit may change the transparency of the information display area based on the width of the overlapped part and display the information on the display unit when the information display area is superimposed on the input key display. .

  The notification unit may change a timing of notifying the information according to a speed of key input input to the key input area.

  The notification unit may change a notification mode of the information according to a type of keyboard displayed in the key input area.

  The information processing apparatus may further include a personal information acquisition unit that acquires the personal information from a storage unit that stores personal information of the user of the mobile terminal, and the notification unit changes a notification mode of the information based on the personal information. May be.

  The notification unit may change a font of the information displayed on the display unit based on the personal information.

  An audio output unit that outputs audio may be further provided, and the notification unit may notify the information by causing the audio output unit to output the information.

  The notification unit may change the notification mode based on the number of times the information has been notified in the past.

  The determination unit includes a status acquisition unit that acquires a key input status by comparing a key input pattern input to the key input area with a reference pattern, and a user key input determined based on the key input status. And a proficiency level management unit for managing the proficiency level.

  The second aspect of the present invention is an information processing method. The method includes a step of displaying a key input area for inputting a key by a touch operation in a part of the display area, and a key input pattern input to the key input area matches any of a plurality of reference patterns. A step of determining whether or not, and a step of notifying information according to a type of the matched reference pattern when a key input pattern input to the key input area matches any of the plurality of reference patterns; Is executed by the processor.

  The third aspect of the present invention is a program. The program has a function of causing a computer to display a key input area for inputting a key by a touch operation on a part of the display area of the display unit, and a plurality of key input patterns input to the key input area. A function for determining whether or not to match any of the reference patterns, and information corresponding to the type of the matched reference pattern when the key input pattern input to the key input area matches any of the plurality of reference patterns And a function to notify

  ADVANTAGE OF THE INVENTION According to this invention, the convenience improvement by notifying operation information to the user of a portable terminal and the effective utilization of a display screen can be balanced.

It is a figure which shows the function structure of a portable terminal typically. It is a figure which shows an example of the screen displayed on the display part of a portable terminal. It is a figure which shows an example of a reference | standard pattern table. It is a figure which shows an example of a failure table and a success table. It is a figure which shows the other example of a failure table and a success table. It is a figure which shows another example of the screen displayed on the display part of a portable terminal. It is a figure which shows an example of a transparency management table. It is a figure which shows an example of the notification grace time management table. It is a figure which shows an example of a personal information management table. It is a figure which shows an example of the control table of the notification aspect based on the frequency | count of notification. It is an operation | movement flowchart of a portable terminal.

<Functional configuration of mobile terminal 1>
FIG. 1 is a diagram schematically illustrating a functional configuration of the mobile terminal 1 according to the embodiment. The mobile terminal 1 is a smartphone, a tablet PC (Personal Computer), or the like. Therefore, the display unit 20 is a touch screen in which, for example, a liquid crystal panel or an organic EL (electroluminescence) panel and a touch panel are integrated. The display unit 20 displays a key input area for inputting a key by a touch operation in a part of the display area. In the mobile terminal 1, key input is an input operation of characters, numbers, symbols, and the like performed by a user using a software keyboard displayed on the display unit 20.

As illustrated in FIG. 1, the mobile terminal 1 includes a reception unit 10, a display unit 20, an audio output unit 21, a storage unit 30, and a control unit 40.
The display unit 20 is a display that displays information to be presented to the user, and is also an input interface that accepts key input from the user. The reception unit 10 is a virtual software keyboard displayed on the display unit 20 and receives input of characters, numbers, symbols, and the like based on a user key input operation. The voice output unit 21 is a speaker that outputs information to be presented to the user by voice.

  The storage unit 30 includes a nonvolatile memory (for example, a flash memory) and a volatile memory (for example, a RAM (Random Access Memory)). A program executed by the control unit 40 is stored in the nonvolatile memory. In addition, the nonvolatile memory includes a reference pattern table indicating a plurality of reference patterns used for determining a key input status by a user, a failure table indicating key input failure contents, and a success table indicating key input success contents. Information such as the date and time when the key input was successful, the date and time when the key input failed, and the determination result of whether or not the key input was successful are stored. The nonvolatile memory is used as a work memory when the control unit 40 executes a program.

  Fig.2 (a)-(b) is a figure which shows an example of the screen displayed on the display part 20 of the portable terminal 1 which concerns on embodiment. FIG. 2A shows an example of a screen when the user inputs a key on the mobile terminal 1, and this screen displays a character display area 201 where the input characters are displayed, and word candidates. A candidate display area 202 and a key input area 203 for displaying keys.

  FIG. 2B shows a screen in a state where information indicating advice is displayed in the advice display area 204. When it is determined that the user cannot appropriately perform the key input based on the key input situation by the user, the mobile terminal 1 displays an advice as illustrated in FIG.

The control unit 40 is, for example, a CPU (Central Processing Unit). The control unit 40 includes a determination unit 41, a notification unit 42, a measurement unit 43, and a personal information acquisition unit 44.
The determination unit 41 determines the key input status by comparing the key input pattern received by the reception unit 10 with the reference pattern stored in the storage unit 30. More specifically, the determination unit 41 determines whether or not the key input pattern input to the key input area 203 matches any of a plurality of reference patterns.

  FIG. 3 is an example of a reference pattern table stored in the storage unit 30. The reference pattern table stores a reference pattern ID (Identification) for specifying each reference pattern and the content of the reference pattern in association with each other. The reference pattern table is referred to by the status acquisition unit 411 of the determination unit 41 and includes, for example, the type of characters, numbers, or symbols to be input. The reference pattern is not limited to the pattern showing the rules as shown in FIG. 3, and can be in various forms. For example, an input pattern group having a high failure probability and an input pattern group having a high success probability obtained by machine learning based on operation log data may be used as the reference pattern.

  FIG. 4A is an example of a failure table and a success table stored in the storage unit 30. The failure table and the success table are referred to by the situation acquisition unit 411 and the proficiency level management unit 412 in the determination unit 41. In the failure table shown in FIG. 4A (a), the failure ID and the failure content are associated with each other. In the success table shown in FIG. 4A (b), the success ID and the success content are associated with each other.

  FIG. 4B is another example of the failure table and the success table stored in the storage unit 30. In the failure table shown in FIG. 4B (a), the corresponding reference pattern is associated with the failure ID and the failure content. In the success table shown in FIG. 4B (b), the corresponding failure ID is associated with the success ID and the content of the success. In this way, a plurality of failure IDs may be associated with one success ID. Conversely, one failure ID may be associated with a plurality of success IDs.

Returning to the description of FIG. When the key input pattern input to the key input area 203 matches any of a plurality of reference patterns, the notification unit 42 notifies information corresponding to the type of the matched reference pattern.
As described above, the “reference pattern” is a pattern used to determine the state of key input by the user. For example, the pattern whose reference pattern ID is 1P in the reference pattern table shown in FIG. 3 indicates a situation in which “the phrase can be input within 5 seconds at the position where the phrase is input?”. The notification unit 42 notifies the user of advice when the state of character input by the user is a situation where advice should be given for each reference pattern.

  In general, the situation where advice should be given to the user is a situation where the user has been stagnating, that is, a situation where the user is speaking to the character. Therefore, in this specification, “matches the reference pattern” means a case where the situation acquisition unit 411 determines that the key input by the user matches the situation shown in the failure table as shown in FIGS. 4A and 4B. .

<Notification by the notification unit 42>
Hereinafter, the information notified by the notification unit 42 to the user of the mobile terminal 1 will be described in more detail.
[Location of notification]
The notification unit 42 changes the display mode of the key input area 203 at the position associated with the matched reference pattern and causes the display unit 20 to display it. For example, FIG. 2B shows an example of information notified by the notification unit 42 when the status acquisition unit 411 matches the pattern indicated by the reference pattern ID 5P in the reference pattern table shown in FIG. That is, the example illustrated in FIG. 2B illustrates a display screen that the notification unit 42 displays on the display unit 20 when the situation acquisition unit 411 determines that the user has not confirmed the character input.

  In the example shown in FIG. 2B, the key for confirming the character input is located at the lower right of the key input area 203 in the figure. Therefore, the notification unit 42 surrounds the confirmation key of the key input area 203 with, for example, a rectangular frame, thereby changing the display mode from the other input keys and causing the display unit 20 to display the display mode. In this way, the notification unit 42 changes the display mode of the key at the position related to the reference pattern in the key input area 203, so that the user who is in a situation of character input selects the input key to be operated. It can be grasped at a glance. The manner of presenting such advice by the notification unit 42 is not the hardware keyboard but the key input area 203 that is a software keyboard displayed on a part of the display area of the display unit 20 instead of the hardware keyboard. Therefore, it can be easily realized.

  The notification unit 42 displays an advice display area 204 that displays information indicating advice in a display area of the display unit 20 that is different from the key input area 203. As described with reference to FIG. 2A, the screen when the user inputs a key on the mobile terminal 1 includes the character display area 201, the candidate display area 202, and the key input area 203. Therefore, the candidate for the position where the notification unit 42 displays the advice display area 204 in the display area of the display unit 20 is at least one of the character display area 201 and the candidate display area 202.

  Here, the candidate display area 202 is an area where word candidates are displayed, and is considered to be an area that the user frequently pays attention when inputting characters. On the other hand, the character display area 201 is an area where a character whose input has already been confirmed is displayed. Considering from the viewpoint of “whether or not attention is paid to the user when inputting characters”, the character display area 201 is more focused than the candidate display area 202 The degree is considered low. Therefore, the position where the notification unit 42 displays the advice display region 204 in the display region of the display unit 20 is preferably the character display region 201.

  Therefore, the notification unit 42 displays information indicating advice in the character display area 201 in the display area of the display unit 20. In the example shown in FIG. 2B, a character string “Sentence is confirmed by pressing the lower right confirmation key” is displayed in the advice display area 204 as information indicating advice. The advice display area 204 is displayed superimposed on the character display area 201. Accordingly, the user can browse the advice without being blocked by the advice display area 204 in the candidate display area 202 where the word candidates that are important when inputting characters are displayed.

  FIGS. 2A to 2B show an example in which only one character “A” is displayed in the character display area 201. Since most of the character display area 201 is an empty space, even if the advice display area 204 and the character display area 201 are superimposed, the characters displayed in the character display area 201 and the advice display area 204 are displayed. Substantially does not overlap with the character string. However, when the number of characters displayed in the character display area 201 is large, the character string displayed in the advice display area 204 may overlap the character string displayed in the character display area 201. . In such a case, the notification unit 42 sets the character string displayed in the character display area 201 among the character strings displayed in the advice display area 204 above the character string displayed in the character display area 201. The transparency of the display area of the advice display area 204 corresponding to the overlapping character string is changed. As a result, the characters displayed in the character display area 201 are displayed through the advice display area 204.

  Here, “transparency” refers to another object that the object placed on the user's viewpoint side shields from the user's view when the notification unit 42 displays two different objects superimposed on the display unit 20. It is an index indicating how much is transmitted and presented to the user. The transparency is expressed as a percentage from 0% to 100%, for example. When the transparency of an object is 0%, the object completely shields other objects from the user's viewpoint. Conversely, when the transparency of an object is 100%, the object is completely transparent to other objects.

  FIG. 5 is a diagram illustrating another example of a screen displayed on the display unit 20 of the mobile terminal 1 according to the embodiment. The example shown in FIG. 5 shows an example in which the character string displayed in the character display area 201 and the character string displayed in the advice display area 204 overlap. More specifically, in the example shown in FIG. 5, the character display area 201 displays a character string “Thank you for your support yesterday late”. In the advice display area 204, a character string “Sentence is confirmed by pressing the confirmation key at the lower right” is displayed. Among these, the character string “Thank you very much” in the character display area 201 has its display position superimposed on the advice display area 204. Therefore, the notification unit 42 changes the transparency of the advice display area 204 so that the character string “Thank you very much” in the character display area 201 is also displayed on the display unit 20.

  As a result, the user can simultaneously confirm the character string whose input has been confirmed and the information indicating the advice. Since the candidate display area 202 does not overlap the character display area 201 and the advice display area 204, the user can simultaneously confirm word candidates in addition to the character strings for which advice and input have been confirmed.

FIG. 5 shows an example when the transparency of the advice display area 204 is set to 50%. For this reason, the character string “Thank you very much” in the character display area 201 has a luminance of 50% of the remaining character string “We responded late until yesterday”.
Here, when the advice display area 204 overlaps with the character display area 201, the notification unit 42 may change the transparency of the advice display area 204 based on the width of the overlapped portion and display it on the display unit 20. More specifically, the notification unit 42 may increase the transparency when the area overlapping the character display area 201 in the advice display area 204 is wide than when it is narrow.

  FIG. 6 is a diagram schematically illustrating the data structure of the transparency management table referred to by the notification unit 42 according to the embodiment. In the example of the transparency management table shown in FIG. 6, the overlapping rate of two objects is classified into four categories, and the transparency of the object is stored in association with each category. In the transparency management table shown in FIG. 6, the duplication rate increases in the order of O1, O2, and O3. Further, the transparency Tr1, Tr2, Tr3, and Tr4 also increase in this order. In accordance with the transparency acquired by referring to the transparency management table, the notification unit 42 increases the transparency to be set in the advice display area 204 as the area that overlaps the character display area 201 in the advice display area 204 increases, and the transparency decreases as the area decreases. Make it smaller. Thereby, the presentation of advice and the visibility of the character string in the character display area 201 can be balanced.

  The notification unit 42 may set the display position of the advice display area 204 so that the area where the character string displayed in the character display area 201 overlaps with the character string displayed in the advice display area 204 becomes small. . In the character display area 201, the character strings whose input has been confirmed are displayed in order from the upper left in FIG. Therefore, the notification unit 42 displays the advice display area 204 on the lower side in FIG. Alternatively, the notification unit 42 specifies a blank area in the character display area 201 by image analysis, and displays the advice display area 204 so that a superimposed portion of the specified blank area and the advice display area 204 becomes wide. Also good. Thereby, the overlap part of the character string displayed on the character display area 201 and the character string displayed on the advice display area 204 decreases, and the visibility of each character string can be improved.

Notification timing
Next, the timing at which the notification unit 42 notifies the user of information indicating advice will be described.
The notification unit 42 responds to the type of the matched reference pattern when a predetermined time elapses after the situation acquisition unit 411 in the determination unit 41 determines that the user's input operation matches a certain reference pattern. The information indicating the advice is displayed on the display unit 20. Here, the “predetermined time” is a notification grace time that represents a timing at which the notification unit 42 notifies the user of information indicating advice. This time can also be said to be an allowable time until the user inputs a character in view of the possibility that the user overcomes the input stroke by himself / herself. Note that the measurement unit 43 starts time measurement when the situation acquisition unit 411 determines that the user's input operation matches a certain reference pattern. The notification unit 42 can acquire the elapsed time by referring to the time measured by the measurement unit 43.

The notification unit 42 changes the notification postponement time according to the speed of key input input to the key input area 203. More specifically, the notification unit 42 shortens the notification grace time as the key input speed input to the key input area 203 increases, and notifies information indicating advice earlier.
FIG. 7 is a diagram schematically illustrating a data structure of the notification postponement time management table referred to by the notification unit 42 according to the embodiment. In the example of the notification grace time management table shown in FIG. 7, the character input speed is classified into three categories, and the notification grace time is stored in association with each category. In the notification postponement time management table shown in FIG. 7, the character input speeds of S1 and S2 increase in this order. In addition, the notification postponement times T1, T2, and T3 are shortened in this order.

  In general, the speed of character input is considered to correlate with the user's proficiency in character input. That is, it is considered that the user who is more proficient in character input has a faster character input speed. On the other hand, a user who is not used to character input is considered to be slow in character input. Therefore, if the notification grace time is set uniformly regardless of the key input speed, for example, when a user who is not proficient in character input is inputting characters, the user is not speaking. However, it may happen that advice is displayed on the display unit 20. By following the notification advance time acquired by the notification unit 42 with reference to the notification advance time management table, the notification unit 42 notifies the information indicating the advice later as the key input speed of the user is slower. Thereby, notification of useless advice can be suppressed.

  Note that a user who is proficient in character input may be able to solve it by his / her own power even if he / she goes to character input. In such a case, it is considered that the user is more effective from the viewpoint of improving the proficiency of the user, rather than looking at the advice that the notification unit 42 displays on the display unit 20 and solving the whispering by his own power. . Therefore, the notification unit 42 may increase the notification grace time as the speed of key input to the key input area 203 increases, and notify information indicating advice later. Thereby, the opportunity of a user's character input proficiency improvement improvement can be provided.

[Change notification mode according to usage status]
The notification location and notification timing of information indicating advice by the notification unit 42 have been described above. The notification unit 42 variously changes the notification mode of advice in accordance with the usage status of the user's mobile terminal 1. Hereinafter, the change of the notification mode of advice according to the usage status of the mobile terminal 1 by the user will be described.

  As described above, the mobile terminal 1 according to the embodiment is a smartphone or a tablet PC, and the user performs character input using the software keyboard displayed on the display unit 20. Unlike the hardware keyboard, the user can easily change the software keyboard according to his / her preference. When the display area of the display unit 20 of the portable terminal 1 is narrow, for example, a dedicated software keyboard for Japanese language input, numeric input, or Roman character input is prepared, and the user can select the type of character string to be input. Character input is often performed while switching the keyboard accordingly.

  Of course, different types of software keyboards have different keyboard layouts and displayed keys on the display unit 20. For example, even if the situation acquisition unit 411 matches the pattern indicated by the reference pattern ID 5P in the reference pattern table shown in FIG. The key location is different. Therefore, the notification unit 42 changes the notification mode of information indicating advice in accordance with the type of keyboard displayed in the key input area 203. Thereby, the advice suitable for the kind of software keyboard currently used for a user's character input can be provided.

  In addition, smartphones and tablet PCs that are portable terminals 1 have been spreading explosively in recent years, and portable terminals 1 are being used by many people regardless of age or sex. For this reason, it is preferable that the information indicating the advice displayed by the notification unit 42 on the display unit 20 is also customized according to the user who uses the mobile terminal 1.

Therefore, the storage unit 30 stores personal information of the user of the mobile terminal 1. The notification unit 42 acquires personal information of the user of the mobile terminal 1 from the storage unit 30.
FIG. 8 is a diagram schematically illustrating a data structure of the personal information management table referred to by the notification unit 42 according to the embodiment. As shown in FIG. 8, the personal information management table stores user identification information for identifying the user of the mobile terminal 1, and personal information such as the user name and age. The user identification information may be the telephone number when the mobile terminal 1 has a telephone function. Further, when the user contracts with the provider of the communication service in order to use the communication line, the user identifier issued by the provider may be used.

When the mobile terminal 1 is a smartphone, the display area of the display unit 20 is generally narrow. For this reason, even if information indicating advice with a character size that can be visually recognized by a young user is displayed on the display unit 20, it may be difficult to visually recognize the user of the mobile terminal 1 when the user is elderly.
Therefore, the notification unit 42 changes the font size of information indicating advice displayed on the display unit 20 according to the age of the user of the mobile terminal 1. More specifically, the notification unit 42 increases the font size of characters displayed on the display unit 20 when the age of the user of the mobile terminal 1 is high than when the user is low. Thereby, information can be provided with the character size suitable for the visual characteristic of the user of the portable terminal 1.

  As shown in FIG. 8, the personal information management table also stores the color vision characteristics of the user of the portable terminal 1 when the user of the portable terminal 1 registers. Here, the “user's color vision characteristic” is information indicating the color appearance characteristic of the user. The notification unit 42 displays information indicating advice on the display unit 20, but it is difficult to achieve the purpose of providing advice if the displayed information is not noticed by the user. Therefore, the notification unit 42 changes the font color of information indicating advice displayed on the display unit 20 to make the information stand out. However, for example, a color that is conspicuous for many users may not be a color that is conspicuous for users with weak colors.

  Therefore, the notification unit 42 changes the font color of the character string of the information indicating the advice to be displayed on the display unit 20 according to the type of color vision characteristic of the user of the mobile terminal 1, or instead of changing the font color, In addition to flashing text. Thereby, the information suitable for the color vision characteristic of the user of the portable terminal 1 can be presented.

[Notification of advice by voice]
In the above, the aspect which the notification part 42 displays the information which shows advice on the display part 20 as an image was mainly demonstrated. The notification unit 42 may cause the audio output unit 21 to output information as audio in addition to an aspect in which information indicating advice is displayed as an image on the display unit 20. Thereby, even if the user overlooks the information indicating the advice displayed on the display unit 20, the user can receive the advice by hearing.

[Change notification mode according to the number of notifications]
As described above, the case where the notification unit 42 notifies the information according to the type of the matched reference pattern when the input operation of the user matches any of the plurality of reference patterns has been described. This is advantageous in that advice can be notified to a user who is stuck in character input. On the other hand, if the same advice is repeatedly presented, it may be felt complicated for some users.
Accordingly, the notification unit 42 changes the notification mode of the advice to be newly notified to the user according to the number of times the user has been notified of advice in the past.

  FIG. 9 is a diagram schematically illustrating a data structure of a control table of a notification mode based on the number of notifications referred to by the notification unit 42 according to the embodiment. As shown in FIG. 9, the control table of the notification mode based on the number of notifications stores the relationship between the number of notifications and the notification information for each reference pattern. More specifically, in the example shown in FIG. 9, the relationship between the number of patterns whose reference pattern ID is IP and the notification information is illustrated. As shown in FIG. 3, the pattern indicated by the reference pattern ID 1P is a pattern indicating a situation of “has the phrase input within 5 seconds at the position where the phrase is input?”. Therefore, in the case where the notification unit 42 notifies the user who is eager to input punctuation marks, if the number of times the same advice has been notified in the past is less than N1, the “notification key on the lower right” Press twice. The character information “select” is displayed on the display unit 20 and the punctuation key on the software keyboard is highlighted. In the case of N1 times or more and less than N2 times, the notification unit 42 displays “. A short advice "" is in the lower right "is displayed on the display unit 20, and the punctuation key is highlighted.

  When the number of advices presented further increases and the number of times similar advice has been notified in the past is N2 or more and less than N3 times, the notification unit 42 does not display the character information indicating the advice on the display unit 20, and punctuation marks on the software keyboard Perform input key emphasis only. When the number of advices presented is N3 or more, the notification unit 42 does not execute any notification process. Thereby, by notifying the user of the portable terminal 1 of the advice, it is possible to balance the convenience improvement and the increase in complexity due to the notification of the advice.

<Acquisition of key input status>
The notification of advice by the notification unit 42 has been described above. Next, the acquisition of the key input status that is the basis for whether or not the notification unit 42 notifies the advice will be described in more detail.
As described above, the status acquisition unit 411 in the determination unit 41 acquires the key input status by comparing the key input pattern input to the key input area 203 with the reference pattern. Here, the “key input status” corresponds to the quality of the key input by the user, and is, for example, a status relating to whether the key input has succeeded or failed. The determination unit 41 determines whether the key input operation corresponding to which reference pattern has succeeded or failed based on a plurality of reference patterns as shown in FIG.

  For example, the situation acquisition unit 411 analyzes a character string key-input by the user, and if the last input phrase ends with an expression indicating the end of the sentence, “input a punctuation point in the reference pattern table of FIG. A reference pattern with a reference pattern ID of 1P is selected, “Has a punctuation point been input within 5 seconds at the position?”. Based on the reference pattern 1P, the situation acquisition unit 411 measures the elapsed time from the last key input by the user, and a punctuation point is input within the time determined in the reference pattern (5 seconds in this example). It is determined whether or not.

  The situation acquisition unit 411 determines that the key input has failed when no punctuation is input within a predetermined time. For example, among the plurality of failure IDs included in the failure table illustrated in FIG. 4A (a), The corresponding failure ID 1F is specified. The situation acquisition unit 411 stores the identified failure ID in the storage unit 30 in association with the date and time. Further, the situation acquisition unit 411 determines that the key input has been successful when a phrase is input within a predetermined time, and among the plurality of success IDs included in the success table shown in FIG. 4A (b), The corresponding success ID 1S is specified. The situation acquisition unit 411 notifies the proficiency level management unit 412 of the identified success ID and stores it in the storage unit 30 in association with the date and time.

  When a failure corresponding to a plurality of reference patterns is detected, the situation acquisition unit 411 selects a failure ID to be notified to the proficiency level management unit 412 from a plurality of failure IDs based on a predetermined priority order. May be. For example, if the user does not input a key for a predetermined time at a position where both the possibility of inputting a punctuation point and the possibility of inputting a cloud point is detected, the situation acquisition unit 411 fails with an ID having a high priority of 1F. The ID is notified to the proficiency level management unit 412.

  The proficiency level management unit 412 manages the proficiency level of the user's key input determined based on the key input status. The proficiency level management unit 412 updates the proficiency level determined based on, for example, the key input history made by the user in the past based on whether the previous key input has succeeded or failed, and then becomes proficient with time. Change to reduce the degree. The proficiency level management unit 412 updates the proficiency level at a predetermined cycle, for example. The proficiency level management unit 412 may update the proficiency level in a predetermined time zone, or may update the proficiency level at a timing when a predetermined user operation is performed.

  The proficiency level management unit 412 determines the proficiency level for each type of reference pattern. The proficiency level management unit 412 determines the proficiency level for each operation item such as “input a phrase” or “input a muddy point”, for example. Also, the proficiency level management unit 412 increases the proficiency level as the number of successful key inputs within a predetermined period increases, and decreases the proficiency level as the number of failed key inputs increases. The proficiency level management unit 412 adds, for example, a predetermined value to the latest proficiency value every time the key input is successful, and subtracts the predetermined value from the latest proficiency value every time the key input fails. Update your proficiency level. The proficiency level management unit 412 notifies the notification unit 42 of the updated proficiency level.

[Operation Flowchart of Portable Terminal 1]
FIG. 10 is an operation flowchart of the mobile terminal 1. The processing in this flowchart starts when the mobile terminal 1 is activated, for example.

  The display unit 20 displays the character display area 201 and the key input area 203 in the display area (S2). The accepting unit 10 acquires a key input pattern input by the user in the key input area 203 (S4). The measurement unit 43 measures the speed of key input performed by the user in the key input area 203 (S6). The determination unit 41 compares the key input pattern acquired by the reception unit 10 with a predetermined reference pattern (S8). When the key input pattern acquired by the receiving unit 10 does not match the predetermined reference pattern (NO in S10), the process returns to step S4, and the receiving unit 10 continues to acquire the key input pattern.

  When the key input pattern acquired by the reception unit 10 matches a predetermined reference pattern (YES in S10), the notification unit 42 acquires the type of software keyboard displayed on the display unit 20 by the user ( S12). The notification unit 42 acquires the personal information of the user of the mobile terminal 1 with reference to the storage unit 30 (S14). When the character information included in the advice display area 204 displayed by the notification unit 42 superimposed on the character display area 201 of the display unit 20 overlaps with the input confirmed character string displayed in the character display area 201 (YES in S16). The notification unit 42 changes the transparency of the advice display area 204 (S18), and displays character information indicating advice on the display unit 20 (S20). When the character information included in the advice display area 204 displayed by the notification unit 42 superimposed on the character display area 201 of the display unit 20 does not overlap with the input confirmed character string displayed in the character display area 201 (NO in S16) The notification unit 42 causes the display unit 20 to display character information indicating advice without changing the transparency of the advice display area 204 (S20).

Until the key input by the user is completed (NO in S22), the process returns to step S4 and the processes from step S4 to step S20 are repeated. When the key input by the user ends (YES in S22), the processing in this flowchart ends.

[Effects of the embodiment of the present invention]
As described above, in the embodiment of the present invention, advice corresponding to a reference pattern is notified to the user only when the character input pattern by the user matches a predetermined reference pattern to be advised. Therefore, it is possible to balance convenience improvement by notification of operation information and effective use of the display screen.

  Further, since the location of the key input area 203 to be operated by the user is notified to the display unit 20 according to the matched reference pattern, the user can grasp the location to be operated at a glance. In addition, an advice display area 204 that displays character information indicating advice in accordance with the reference pattern is displayed in the character display area 201, which is an area different from the key input area 203. The advice can be confirmed without disturbing the operation in the input area 203. In addition, when the character information indicating the advice according to the reference pattern overlaps the character string displayed in the character display area 201, the transparency of the advice display area 204 is increased. Both strings can be confirmed.

Furthermore, since the timing of notification of advice is changed according to the speed of the user's character input, advice can be notified at a timing suitable for each user. Moreover, since the font of advice is changed according to the user's age and color vision characteristics, the advice can be notified with a character size and character color suitable for each user.
Since the amount of information to be notified is changed according to the number of times similar advice has been notified in the past, notification of advice can balance convenience improvement and increased complexity due to notification of advice.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above embodiment. In particular, the specific embodiments of the distribution / integration of the devices are not limited to those illustrated above, and all or a part thereof may be in arbitrary units according to various additions or according to functional loads. Can be configured to be functionally or physically distributed and integrated.

DESCRIPTION OF SYMBOLS 1 ... Portable terminal 10 ... Reception part 20 ... Display part 21 ... Audio | voice output part 30 ... Memory | storage part 40 ... Control part 41 ... Determination part 42 ... Notification part 43 ... Measurement unit 44 ... Personal information acquisition unit 201 ... Character display area 202 ... Candidate display area 203 ... Key input area 204 ... Advice display area 411 ... Situation acquisition unit 412 ..Proficiency level management department

Claims (12)

A mobile device,
A display unit for displaying a key input area for inputting a key by a touch operation in a part of the display area;
A determination unit that determines whether or not a key input pattern input to the key input area matches any of a plurality of reference patterns;
A notification unit for notifying information according to the type of the matched reference pattern when a key input pattern input to the key input area matches any of the plurality of reference patterns;
A personal information acquisition unit that acquires the personal information from a storage unit that stores personal information of the user of the mobile terminal;
The notification unit changes the font color of the information displayed on the display unit based on the color vision characteristics of the user included in the personal information, and the speed of key input input to the key input area is high. The mobile terminal is characterized in that the information is notified early . It further includes an audio output unit that outputs audio,
The notification unit notifies the information by causing the audio output unit to output the information.
The mobile terminal according to claim 1.   The mobile terminal according to claim 1 or 2, wherein the notification unit changes the display mode of the key input area at a position associated with a matched reference pattern and causes the display unit to display the display mode.   The mobile terminal according to any one of claims 1 to 3, wherein the notification unit displays the information in a display area different from the key input area in the display area of the display unit.   The mobile terminal according to claim 4, wherein the notification unit displays the information in a display area of an input key in a display area of the display unit.   When the information display area is superimposed on the input key display, the notification section changes the transparency of the information display area based on the width of the overlapped portion and displays the information on the display section. The mobile terminal according to claim 5.   The mobile terminal according to any one of claims 1 to 6, wherein the notification unit changes a timing of notifying the information according to a speed of key input input to the key input area. .   The mobile terminal according to claim 1, wherein the notification unit changes a notification mode of the information according to a type of a keyboard displayed in the key input area.   The mobile terminal according to any one of claims 1 to 8, wherein the notification unit changes a notification mode based on the number of times the information has been notified in the past. The determination unit
A status acquisition unit that acquires a key input status by comparing a key input pattern input to the key input area with a reference pattern;
A proficiency level management unit for managing the proficiency level of the user's key input determined based on the key input status;
The mobile terminal according to any one of claims 1 to 9, further comprising: An information processing method executed by a processor of a mobile terminal,
Displaying a key input area for inputting a key by a touch operation on a part of the display area of the display unit of the mobile terminal; and
Determining whether or not a key input pattern input to the key input area matches any of a plurality of reference patterns;
A step of notifying information according to the type of the matched reference pattern when a key input pattern input to the key input area matches any of the plurality of reference patterns;
Obtaining the personal information from a storage unit for storing personal information of the user of the mobile terminal,
In the notifying step, the font color of the information to be displayed on the display unit is changed based on the color vision characteristics of the user included in the personal information, and the speed of the key input input to the key input area is changed. An information processing method characterized by notifying the information earlier as the information is earlier . A program, on a computer,
A function for displaying a key input area for inputting a key by a touch operation on a part of the display area of the display unit;
A function of determining whether or not a key input pattern input to the key input area matches any of a plurality of reference patterns;
A function of notifying information according to the type of the matched reference pattern when the pattern of the key input entered in the key input area matches any of the plurality of reference patterns;
Obtaining the personal information from a storage unit for storing personal information of the user of the computer,
The notifying function changes the font color of the information displayed on the display unit based on the color vision characteristics of the user included in the personal information, and the speed of key input input to the key input area. The program is characterized in that the earlier the information is notified, the earlier it is.