JP2011197782A - Candidate display device and candidate display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience of a user in time of candidate selection by displaying a candidate in a state suitable for an operation situation of the user.SOLUTION: The candidate display device includes: an input operation reception part receiving input operation of the user to an input device; a touch selection control part making the candidate be displayed on a display selection device such that the user can perform touch selection, and receiving the touch selection from the user about the candidate made to be displayed on the display selection device; a candidate acquisition part acquiring at least one candidate determined based on the input operation from the user received in the input operation reception part; an input operation situation acquisition part acquiring an input operation situation including information related to a position of the input operation finally performed in the input device; and a display position determination part determining a display position of the candidate made to be displayed on the display selection device based on the input operation situation.

Description

  The present invention relates to a candidate display device and a candidate display method for displaying candidates.

  Along with the widespread use of touch panels, many computer devices, PDAs (Personal Digital Assistance), mobile phones, and the like that employ a touch panel as a display device have been commercialized. Adoption of the touch panel can improve operability such as input when using various applications. Further, operability can be further improved by changing the display position of the touch target button on the touch panel according to the user.

  For example, the operator's dominant hand is determined based on the touch distribution when the operator first touches an initial screen such as a menu screen displayed on a display device having a touch panel, and the determined dominant hand A technique for changing the operation screen after the next time is known (for example, see Patent Document 1). Further, a technique for detecting whether a keyboard key is pressed with the left hand or the right hand is known (see, for example, Patent Document 2). Furthermore, the usage mode of the keyboard is a first usage mode in which the user can input keys using both hands, or a second mode in which the user can use the mouse with one hand and input keys only with the other hand. A technique for detecting which mode is in use is known (for example, see Patent Document 3).

JP 2006-330992 A JP 2006-85687 A JP 2002-358151 A

  For example, by using a touch panel as a display device of a computer device, it is possible to perform input using a conventional keyboard and input using a touch panel. The input form in this case will be described by taking a kana-kanji conversion application as an example. FIG. 1 is a schematic diagram illustrating an example of a case where kana-kanji conversion processing is performed on a computer device 10 using a touch panel and a keyboard.

  First, the user inputs a desired character key on the keyboard 13 using the right hand 11 or the left hand 12. For example, when inputting “Fuji” by the so-called Roman character input method, the character keys “F”, “U”, “J”, and “I” are pressed. In this case, the kana character “Fuji” is displayed on the editor screen 16 in accordance with the user's key input. The computer apparatus 10 performs predictive conversion based on the character string “Fuji” input by the key, and displays one or more conversion candidates on the touch panel 14 in descending order of priority. In FIG. 1, conversion candidates “Fuji”, “Mt. Fuji”, and “Mt. Fuji” are displayed in descending order of priority as conversion candidates for the character string “Fuji”.

  When the user finds a target conversion candidate on the touch panel, the surface portion of the touch panel on which the conversion candidate (for example, conversion candidate 15) is displayed is touched (contacted) with the left hand 12 (or left hand). select. The computer apparatus 10 recognizes which conversion candidate is selected on the basis of the coordinate position on the touch panel 14 selected by the user, and selects the recognized conversion candidate as an input character (for example, “Fuji”). .)) As a conversion character string (for example, “Fuji”).

  As described above, in the computer device 10 that performs character input by linking two input devices such as the keyboard 13 and the touch panel 14, the input using the touch panel is a character input operation that has been conventionally performed only by the input using the keyboard 13 (for example, It can be said that it assists input, conversion, confirmation, etc.). In the computer device 10, the keyboard 13 is specialized for the character input function, and the touch panel 14 is specialized for the conversion candidate selection function. In other words, in the computer device 10 described above, by separating the functions into two devices, ie, a keyboard 13 that performs an input operation and a touch panel 14 that performs a selection operation, the operations on the individual devices are simplified and the operability of the user is improved. Can be improved.

  For example, the dominant hand of the operator (for example, 11 or 12 in FIG. 1) is determined for the computer device 10 that performs character input by linking the two input devices of the keyboard 13 and the touch panel 14 described above. For example, when a technique for changing and displaying the operation screen according to the application is applied, a dominant hand can be determined from the past usage state of the touch panel 14, and the conversion candidate 15 can be displayed at a position corresponding to the determined dominant hand.

  Also, it is detected whether the keyboard key is pressed with the left hand 12 or the right hand 11 with respect to the computer device 10 that performs character input by linking the two input devices, the keyboard 13 and the touch panel 14, as described above. When the technique is applied, for example, it is possible to determine which hand has pressed the keyboard, and display conversion candidates at positions corresponding to the determined hand.

  Furthermore, suppose that the first use mode in which key input can be performed using both hands with respect to the computer device 10 that performs character input by linking the two input devices such as the keyboard 13 and the touch panel 14 described above with one hand. When the technique for detecting whether the second use mode in which key input is possible using only the other hand using the mouse is applied, for example, the hands capable of key input are both hands (for example, 11 and 12 in FIG. 1). ) Or one hand (for example, 11 or 12 in FIG. 1), and a conversion candidate can be displayed at a position corresponding to a hand capable of key input.

  However, when character input is performed by linking two input devices such as the keyboard 13 and the touch panel 14, the conversion is based on which hand is the dominant hand, which hand is pressed, or one hand or both hands. It is not possible to sufficiently improve the operability for display selection of conversion candidates simply by determining the display positions of candidates.

  This is because the way in which the user assigns left and right hands to the touch panel (for example, heel etc.) depends on the user's ability (for example, user's hand movement performance, user's viewing angle or user's attention). This is because it varies depending on the user's preference and the like. In other words, the above-described apparatus cannot display candidates in a mode suitable for the operation situation such as the user's ability and preference, and therefore cannot improve the user's convenience when selecting candidates. There is. Such a problem can be particularly noticeable in the elderly and disabled.

  The present invention has been made in view of the above points, and a candidate display device capable of displaying a candidate in a mode suitable for the user's operation situation and improving the convenience of the user at the time of candidate selection. And it aims at providing a candidate display method.

  In order to achieve the above object, a candidate display device disclosed below displays an input operation reception unit that receives a user's input operation on the input device, and displays a candidate so that the user can select a touch on the display selection device And acquiring at least one candidate determined based on the input operation from the user received in the input operation receiving unit, and a touch selection control unit that receives touch selection from the user for the candidates displayed on the display selection device A candidate acquisition unit that performs an input operation status acquisition unit that acquires information regarding a position of the last input operation performed on the input device, and a display on the display selection device based on the input operation status. A display position determination unit that determines a display position of a candidate to be displayed.

  According to the disclosure of the present specification, it is possible to improve the convenience of the user when selecting candidates by displaying candidates in a mode suitable for the user's operation status.

It is a schematic diagram which shows an example in the case of performing a Kana-Kanji conversion process using a touch panel and a keyboard. It is a figure which shows an example of the relationship of each function part in the candidate display apparatus. It is a figure which shows the example of the hardware constitution which implement | achieved the candidate display apparatus 1 shown in FIG. 2 using CPU. It is a figure which shows an example of the operation chart of the candidate display process based on the candidate display program performed with CPU302 of the candidate display apparatus 1. FIG. It is a figure which shows an example of the screen displayed on the display with a touch panel 301. FIG. It is a figure which shows an example of the operation chart of the determination process of a key input direction. It is a figure which shows an example of the operation chart of a key input direction determination process. FIG. 6 is a schematic diagram showing a distance L from a position P1 of the last input key on the keyboard 305 to a candidate display position P2 on the display 301 with a touch panel in a three-dimensional coordinate space by the XYZ axes. It is a schematic diagram which defines candidate display position P2 (x, y) on the coordinate plane of the X0-Y0 axis | shaft of the display 301 with a touchscreen by making an upper left corner into an origin. It is a schematic diagram which defines candidate display position P2 (x, yy) with the lower right corner as the origin in the coordinate plane of the X0-Y1 axis of the display 301 with a touch panel. FIG. 10 is a schematic diagram that defines a candidate display position P1 (a, b) with the upper right corner as the origin on the A-B axis coordinate plane of the keyboard 305; Here, d is the length of the keyboard 305 in the B-axis direction. It is a schematic diagram which shows the relationship between the keyboard 305 and the display 301 with a touch panel. It is a figure which shows an example at the time of displaying a conversion candidate in the candidate display position of the display 301 with a touch panel. It is a figure which shows an example at the time of displaying a conversion candidate in the candidate display position of the display 301 with a touch panel. It is a figure which shows an example of the state of the display with a touch panel 301 after touch selection. It is a figure which shows an example of the candidate display in 2nd implementation. It is a schematic diagram showing the relationship from the position P1 of the last input key on the keyboard 305 to the candidate display position P3 on the display with a touch panel 301 in the three-dimensional coordinate space by the XYZ axes. It is a figure which shows an example of the candidate display in 3rd implementation. It is a figure which shows an example of the operation chart of the candidate display process based on the candidate display program performed with CPU302 of the candidate display apparatus 1. FIG. It is a figure which shows an example of directivity recording data. It is a figure which shows an example of the operation chart of the creation process of directivity recording data. It is a figure which shows an example of the operation chart of the candidate display process based on the candidate display program performed with CPU302 of the candidate display apparatus 1. FIG. It is a figure which shows an example of the display with a touchscreen which made the conversion candidate in 5th Embodiment. It is a figure which shows an example of the display with a touchscreen which made the conversion candidate in 5th Embodiment. It is a figure which shows an example of the display with a touchscreen which made the conversion candidate in 5th Embodiment. It is a figure which shows an example of the display with a touchscreen which made the conversion candidate in 5th Embodiment. It is a figure which shows an example of the relationship of each function part in the candidate display apparatus. It is a figure which shows an example of the operation chart of the candidate display process based on the candidate display program performed with CPU302 of the candidate display apparatus 1. FIG. It is a figure which shows an example of evaluation data.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

[1. First Embodiment]
Hereinafter, an example in which the candidate display device according to the present embodiment is configured using a so-called notebook computer device will be described. In addition, you may comprise the candidate display apparatus concerning this embodiment, for example using apparatuses, such as a mobile telephone or PDA (Personal Digital Assistance).

[1-1. System configuration]
FIG. 2 is a diagram illustrating an example of the relationship between the functional units in the candidate display device according to the present embodiment. As an example, the candidate display device 1 according to the present embodiment functions in cooperation with a Kana-Kanji conversion program that performs Kana-Kanji conversion processing. The candidate display device 1 shown in FIG. 2 includes an input operation reception unit 201, an input operation status acquisition unit 202, a display position determination unit 203, a touch selection control unit 204, a candidate determination unit 205, a candidate prediction unit 206, a candidate acquisition unit 207, An input operation direction determination unit 210, an input operation direction acquisition unit 211, a touch selection direction acquisition unit 212, and a touch selection direction determination unit 213 are provided.

  The input operation receiving unit 201 receives a user input operation on the keyboard 305 that is an input device. The touch selection control unit 204 displays candidates so that the user can select a touch on the display 301 with a touch panel, which is a display selection device, and the candidate displayed on the display 301 with a touch panel (the display selection device) from the user. The touch selection is accepted.

  The candidate prediction unit 206 predicts one or more candidates that can be converted based on the input operation from the user received by the input operation reception unit 201. The candidate acquisition unit 207 acquires at least one candidate determined based on the input operation from the user received by the input operation reception unit 201.

  The input operation status acquisition unit 202 acquires an input operation status including information on the position of the input operation last performed on the keyboard 305 as an input device. The input operation direction acquisition unit 211 acquires an input operation direction indicating from which direction the user performs an input operation on the keyboard 305 (input device). The touch selection direction acquisition unit 212 acquires a touch selection direction indicating from which direction the user performs touch selection on the display 301 with a touch panel (display selection device).

  The input operation direction determination unit 210 determines an input operation direction based on an input time interval for two or more input operations arranged on the keyboard 305 (input device). The touch selection direction determination unit 213 determines the touch selection direction based on the vertical approach direction with respect to the display 301 with a touch panel (display selection device) when the user performs touch selection.

  The display position determination unit 203 determines candidate display positions to be displayed on the display 301 with a touch panel (display selection device) based on the input operation status.

  As described above, the input operation receiving unit 201 receives an input operation from the user with respect to the input device, and the candidate acquisition unit 207 determines at least one determined based on the input operation from the user received by the input operation receiving unit 201. Candidates are acquired, the input operation status acquisition unit 202 acquires an input operation status including information on the position of the input operation last performed in the input operation reception unit 201, and the display position determination unit 203 determines the input operation status. Candidate display that can improve the convenience of the user at the time of candidate selection by displaying the candidate in a mode suitable for the user's operation situation by determining the display position of the candidate to be displayed on the display selection device based on A device can be provided.

  Note that each functional unit shown in the candidate display device 1 of FIG. 2 is a concept including a CPU function realized by a program. Here, the program is not only a program that can be directly executed by the CPU, but also a concept including a source format program, a compressed program, an encrypted program, and the like.

[1-2. Hardware configuration]
FIG. 3 is a diagram illustrating an example of a hardware configuration in which the candidate display device 1 illustrated in FIG. 2 is realized using a CPU. The candidate display device 1 includes at least a display 301 with a touch panel, a CPU 302, a memory 303, a hard disk 304, and a keyboard 305. The hard disk 304 stores an OS (operating system, not shown), a candidate display program 304a, a kana-kanji conversion processing program 304b, and the like. The CPU 302 executes processing based on the OS, the candidate display program 304a, the kana-kanji conversion processing program 304b, and the like.

  The input operation receiving unit 201, the touch selection control unit 204, the input operation status acquisition unit 202, the display position determination unit 203, the candidate determination unit 205, the candidate acquisition unit 207, and the input operation that configure the candidate display device 1 illustrated in FIG. For example, the direction determination unit 210, the input operation direction acquisition unit 211, the touch selection direction acquisition unit 212, and the touch selection direction determination unit 213 are realized by executing the candidate display program 304a on the CPU 302. In addition, the candidate prediction unit 206 is realized, for example, by executing the kana-kanji conversion processing program 304b on the CPU 302.

[1-3. Candidate display processing]
The processing contents of the candidate display program 304a in the candidate display device 1 will be described with reference to FIGS. 4 to 10C in addition to FIGS. 2 and 3 described above. It is assumed that the candidate display device 1 has a candidate display program 304a and a kana-kanji conversion processing program 304b installed.

  The outline of the above processing will be described. The CPU 302 executes a candidate display program 304a and a kana-kanji conversion processing program 304b to display a kana-kanji conversion candidate based on a character string key-input by the user using the keyboard 305. The Kana-Kanji conversion candidate displayed on the display 301 (hereinafter referred to as the display 301) and touch-selected by the user on the display 301 is determined as a conversion target for the character string input by the key input.

  FIG. 4 is a diagram illustrating an example of an operation chart of candidate display processing based on the candidate display program 304a executed by the CPU 302 of the candidate display device 1 and the kana-kanji conversion processing program 304b. FIG. 5 is a diagram illustrating an example of a screen displayed on the display 301.

[1-3-1. Candidate acquisition processing]
In the operation chart of FIG. 4, the CPU 302 determines whether or not a key input has been made (Op 401). For example, whether or not there is a key input in Op 401 is determined based on an output signal from the keyboard 305. In this case, as shown in FIG. 5, the user inputs “Fuji” into the input area 51 of the editor as a pre-conversion character string in the kana-kanji conversion process.

  When the CPU 302 determines that a key input has been made (Op 401, Yes), it records information about which input key was pressed to make the key input (Op 402). For example, key arrangement information (for example, JIS arrangement) is obtained based on keyboard driver information and the like, and information on input keys (for example, key position information, etc.) based on the arrangement information is recorded on the memory 303. To do.

  After recording the input key, the CPU 302 predicts a candidate based on the input character string (Op403). For example, the processing of Op403 is executed by the Kana-Kanji conversion processing program 304b. Specifically, processing for extracting predictable conversion candidates from the input character string is performed based on past conversion history and the like.

  When the CPU 302 determines that there is a candidate (Op404, Yes), the CPU 302 acquires predictable conversion candidate information (Op405). In this case, if there are a plurality of conversion candidates, information on the conversion candidates is acquired together with the priority of display of the conversion candidates. This priority order is determined based on the number of past conversions, for example.

  CPU302 acquires the information regarding the input key which the user performed the key input last (Op406). For example, the information regarding the input key that has performed the last key input can be acquired from the information of the input key recorded in the memory 303 immediately before in Op 402. For example, when the kana character “Fuji” is input by the so-called Roman character input method, key input is performed in the order of “F”, “U”, “J”, “I”. Is “I”. Therefore, in this case, “I” is acquired as the information related to the input key on which the key input was last performed.

  The CPU 302 acquires an input operation direction indicating from which direction the user performs an input operation on the keyboard 305 (Op407). Here, the input operation direction indicates whether the input is performed using the left hand, the right hand, or both hands when the input is performed using the keyboard.

  The input operation direction can be acquired through, for example, a key input direction determination process (Op 414). Note that the key input direction determination processing in Op 414 may be executed each time a key is input, or may be executed at an arbitrary timing.

[1-3-2. Key input direction determination process]
FIG. 6 is a diagram illustrating an example of an operation chart of the key input direction determination process of Op414. In this process, the CPU 302 first collects input speed data A for continuous key input across the left and right regions (Op 601). For example, in the case of a JIS keyboard, the left and right areas are defined as the boundaries between “T” and “Y”, “G” and “H”, and “B” and “N”. Determine by separating left and right. For example, with reference to the key input information recorded in the memory 303 in Op 402, at least one combination of two input keys continuously input beyond the left and right areas is extracted, and the relationship between the input time of each key and the distance Based on the above, one or a plurality of input speed data A is calculated. For example, the input speed data A is calculated by dividing the distance between two input keys on the keyboard 305 by the input time interval of the two input keys.

  Next, the CPU 302 collects input speed data B of continuous key input that does not cross the left and right regions (Op 602). For example, at least one combination of two input keys that are continuously input in only the right region or only the left region is extracted, and one or a plurality of input speeds are based on the relationship between the input time and distance of each key. Data B is calculated. For example, like the input speed data A, the input speed data B is calculated by dividing the distance between two input keys on the keyboard 305 by the input time interval of the two input keys.

  The CPU 302 determines whether or not the average value of the input speed data A is higher than the average value of the input speed data B (Op 603). When determining that the average value of the input speed data A is higher than the average value of the input speed data B (Op603, Yes), the CPU 302 determines that the operation is a two-handed operation (Op604).

  On the other hand, when the CPU 302 does not determine that the average value of the input speed data A is higher than the average value of the input speed data B (Op603, No), the CPU 302 further performs continuous key input in the right area and the left area. It is determined whether or not the average value of the velocity data group is significantly different (Op605). For example, for significant judgment, it is only necessary to test whether or not there is a significant difference in the average value of data using analysis of variance. If the average value of the input speed data A or B in the left region is significantly high, the CPU 302 determines that the left hand / one hand operation is performed (Op606). On the other hand, when the average value of the input speed data A or B in the right region is significantly high, it is determined that the operation is a right-handed one-handed operation (Op 608). Furthermore, when there is no difference between the average values of the input speed data A or B in the left region and the right region, it is determined that the operation is a two-handed operation (Op 607).

  The reason for determining as described above is that, for example, in order to perform two consecutive key inputs in the left region using the right hand, it takes time to extend a finger or an arm during movement between keys with the right hand. Because.

  In general, in the case where the forearm is placed on a plane and the elbow is bent at 90 ° as a reference, the rotation angle in the upper arm long axis becomes larger (for example, the right hand moves to the left side of the keyboard), It is known that it takes time to recognize the object, making it difficult to touch the object, and increasing the subjective difficulty of performing the work. From this, for example, as the right hand moves to the left side, the subjective difficulty level for the keyboard operation, the tactile difficulty or inaccuracy of the target increases, and it is considered that the operation takes time.

  For this reason, when two consecutive key inputs are performed in the right region, it is considered that the above operation does not take time and the input speed is significantly faster than that in the left region.

  Since the left and right hands may be used near the center of the keyboard, the average value may be calculated by reducing the weight of a predetermined key near the center of the keyboard. Thereby, the determination accuracy of the operator can be improved.

  In Op 414, appropriate determination processing can be performed only after some input operation is performed by the same user. Therefore, when the operation history of the input key is not sufficiently recorded in the memory 303, it may be determined as “two-hand operation” as a default value.

  Moreover, you may determine right hand operation, left hand operation, or both-hands operation based on the self-report from a user. For example, at the start of use of the computer device, the operator's setting registration screen may be displayed, and the user may perform the selection operation.

  Furthermore, a right hand operation, a left hand operation, or a two-hand operation may be determined based on another determination method. For example, it may be determined using a right hand operation, a left hand operation, or a two-hand operation using a camera device, a sensor, or the like.

[1-3-3. Touch selection direction determination process]
Returning to the processing of FIG. 4, the CPU 302 acquires a touch selection direction indicating from which direction the user performs touch selection on the display 301 (Op 408). Here, the touch selection direction indicates which of the left hand, the right hand, or both hands is used when performing a touch selection on the display 301.

  Acquisition of a touch selection direction can be acquired through a touch selection direction determination process, for example (Op415). The touch selection direction determination process may be executed every time touch is selected, or may be executed at an arbitrary timing. In Op 415, appropriate determination processing can be performed only after touch selection is performed to some extent by the same user. For this reason, when the operation history of touch selection is not sufficiently recorded in the memory 303, it may be determined as “two-hand operation” as a default value.

  FIG. 7 is a diagram illustrating an example of an operation chart of the touch selection direction determination process. In this process, the CPU 302 first collects a pair of hand entry data (three-dimensional data (XYZ) group) and final entry position (XY) (Op 701). For example, a capacitance touch panel capable of sensing in the normal direction of the screen may be used for acquiring hand approach data.

  Next, the CPU 302 calculates the approach vector of the hand, and always calculates an approach position (vertical entry position) having a strong vertical tendency (Op 702). For example, if the vertical tendency is strong, it is considered that the user touches with the hand located on the front side of the approach position.

  The CPU 302 determines whether or not there is only one vertical approach position (Op 703). For example, if there are two or more vertical approach positions, it is considered that touch selection is performed using both hands. Therefore, when the CPU 302 determines that the vertical approach position is not one (Op703, No), it determines that the operation is a two-handed operation (Op704).

  When the CPU 302 determines that the vertical approach position is one place (Op703, Yes), the data when the hand is translating horizontally within the threshold value with a constant depth (Z) is obtained from the three-dimensional data. The horizontal average moving speed is extracted and collected in association with the horizontal coordinate. Thereafter, the CPU 302 determines which of the left and right slopes of the average approach vector is stronger in the right area and the left area of the vertical approach position (Op 706).

  If the CPU 302 determines that the average approach vector is tilted almost to the right when viewed from the display 301, the CPU 302 determines that the operation is a left-handed one-handed operation (Op707). On the other hand, if the CPU 302 determines that the average approach vector is tilted almost to the left as viewed from the display 301, the CPU 302 determines that the operation is a right-handed one-handed operation (Op709). On the other hand, if the CPU 302 determines that the average approach vector has no difference between the left and right inclinations when viewed from the display 301, it determines that the operation is a two-handed operation (Op 708).

[1-3-4. Op410 Candidate Display Position Calculation Process]
Returning to the processing of FIG. 4, the CPU 302 determines whether or not the input operation direction and the touch selection direction are common (Op409). For example, if the hand indicating the input operation direction is “right hand” and the hand indicating the touch selection direction is “right hand”, the input operation direction and the touch selection direction are common to “right hand”. If the hand indicating the input operation direction is “left hand” and the hand indicating the touch selection direction is “left hand”, the input operation direction and the touch selection direction are common to “left hand”.

  When the input operation direction and the touch selection direction are common (Op409, Yes), the CPU 302 calculates a candidate display position on the touch panel from the position of the last input key (Op410). In this case, the conversion candidate with the highest priority (obtained at Op 405) is closer to the display 301 than the other conversion candidates from the last input key (obtained at Op 406) on the keyboard 305. Each candidate display position is calculated so as to be displayed at the position. Thereby, the movement distance of the hand which performs cooperation operation with the keyboard 305 and the display 301 can be made comparatively small. For this reason, fatigue of the user's hand can be made difficult to occur.

  Hereinafter, the process of calculating the candidate display position in Op 410 will be described in detail. FIG. 8 is a schematic diagram showing a distance L between the position P1 of the last input key on the keyboard 305 and the candidate display position P2 on the display 301 in the three-dimensional coordinate space by the XYZ axes. FIG. 9A is a schematic diagram when the candidate display position P2 (x, y) is defined with the upper left corner as the origin (0, 0) in the coordinate plane of the X0-Y0 axis of the display 301. FIG. 9B is a schematic diagram when the candidate display position P2 (x, yy) is defined with the lower right corner as the origin (0, 0) on the coordinate plane of the X0-Y1 axis of the display 301. Here, h is the length of the display 301 in the Y0 axis or Y1 axis direction.

  FIG. 9C is a schematic diagram when the candidate display position P1 (a, b) is defined with the upper right corner as the origin (0, 0) on the coordinate plane of the A-B axis of the keyboard 305. Here, d is the length of the keyboard 305 in the B-axis direction. P1 on the coordinate system shown in FIG. 9C (coordinate plane of AB axis) is expressed on the coordinate system shown in FIG. 8 (three-dimensional coordinate space with XYZ axes) as follows.

  FIG. 9D is a schematic diagram illustrating a relationship between the keyboard 305 and the display 301. Here, θ is an opening angle of the display 301 in the computer apparatus 10, and this angle is an angle determined by the relationship between the keyboard 305 corresponding to the XY plane and the display 301. P2 on the coordinate system shown in FIG. 9B (the coordinate plane of the X0-Y1 axis) is expressed on the coordinate system shown in FIG. 9D (a three-dimensional coordinate space based on the XYZ axes) as follows.

  As described above, on the coordinate system shown in FIG. 9D (three-dimensional coordinate space with the XYZ axes), the distance L between P1 and P2 is calculated by the following equation.

  Therefore, in Op410, the CPU 302 calculates the distance L for a representative coordinate position where the conversion candidate can be displayed (for example, the position of the center of gravity with respect to the display area), and the distance L decreases as the display wired rank increases. Thus, the display position of each conversion candidate is calculated.

  Although a notebook computer device is used in this embodiment, the distance L may be calculated by applying an appropriate correction during coordinate system conversion based on the positional relationship between the keyboard 305 and the display 301. Good.

  For example, when a desktop computer device in which the keyboard 305 and the display 301 are independent from each other is used, the distance L can be calculated by obtaining a positional relationship based on the distance or angle between the keyboard 305 and the display 301. That's fine. In addition, when acquiring the positional relationship, for example, the distance is calculated by photographing the keyboard using a camera built in the display or the like, and identifying the key input key by image recognition. May be. Further, for example, when the display 301 is rotatable in a notebook computer apparatus, the distance L may be calculated by obtaining a positional relationship based on the distance or rotation angle between the keyboard 305 and the display 301.

[1-3-5. Op 412 Candidate Display Position Calculation Process]
Returning to the processing of FIG. 4, when the input operation direction and the touch selection direction are not common (Op409, No), the CPU 302 determines whether or not the input operation direction and the touch selection direction are opposite (Op411). . For example, if the hand indicating the input operation direction is “right hand” and the hand indicating the touch selection direction is “left hand”, the input operation direction and the touch selection direction are opposite to each other. Further, if the hand indicating the input operation direction is “left hand” and the hand indicating the touch selection direction is “right hand”, the input operation direction and the touch selection direction are opposite to each other.

  When the input operation direction and the touch selection direction are opposite to each other (Op411, Yes), the CPU 302 calculates and determines a candidate display position on the touch panel from the end of the touch selection direction on the display 301 (Op412). In this case, each candidate display position is displayed so that the conversion candidate with the highest priority (obtained at Op 405) is displayed at a position where the distance from the left and right end portions on the display 301 is closer to the other conversion candidates. calculate. As a result, conversion candidates with high possibility of selection are preferentially displayed on the side (left and right) close to the operator performing touch selection on the display 301, and the moving distance of the hand performing the cooperative operation can be made relatively small. . For this reason, fatigue of the user's hand can be made difficult to occur.

[1-3-6. Op413 candidate display position calculation processing]
When the input operation direction and the touch selection direction are not opposite in Op411 (Op411, No), the CPU 302 calculates and determines the candidate display position on the touch panel from the default setting (Op413). In this case, for example, each candidate display position is calculated so that the conversion candidate with the highest priority (obtained in Op 405) is displayed in order from the left side of the display 301.

[1-3-7. Candidate display processing]
Returning to the processing of FIG. 4, the CPU 302 outputs a signal to the display 301 to display each conversion candidate acquired in Op 405 at the candidate display position determined above (Op 416). FIG. 10A and FIG. 10B are diagrams illustrating an example in which conversion candidates are displayed at the candidate display positions on the display 301.

  FIG. 10A shows that the conversion candidate “Fuji” having the highest priority is displayed at the position closest to the position 305i of the last input key “I” in Op 410, and the next position to the left of “Fuji” is the next. Shows an example in which a conversion candidate “Mt. Fuji” with a high priority is displayed, and a conversion candidate “Mt. Fuji” with the lowest priority is displayed at a position adjacent to the left of “Mt. Fuji”.

  FIG. 10B shows that in Op 412, the conversion candidate “Fuji” having the highest priority is displayed at the position closest to the touch selection direction end portion 102 on the display 301, and the next position to the right of “Fuji” is the next. Shows an example in which a conversion candidate “Mt. Fuji” having a high priority is displayed, and a conversion candidate “Mt. Fuji” having the lowest priority is displayed at a position to the right of “Mt. Fuji”.

  Note that the display positions of the conversion candidates with the second and subsequent priorities are arbitrary. For example, when there are many conversion candidates, they may be displayed in a plurality of columns. In this case, the conversion candidates may be assigned in order of priority based on the vertical and horizontal distances to the display position of the conversion candidate with the highest priority.

  When displaying each conversion candidate, the CPU 302 stands by until the user touches any one of the candidates (Op 417). If key input is restarted without touch selection, the process returns to step S401 and the process may be repeated (not shown).

  When there is a touch selection from the user, the display 301 notifies the CPU 302 of the coordinate position of the conversion candidate touch-selected. The CPU 302 recognizes which conversion candidate has been touch-selected based on the notified coordinate position. In this case, as described in Op415, the touch selection direction determination process is executed, and the touch selection direction is determined based on the operation history of the user's touch selection. Thereby, the precision of a touch selection direction can be improved as the frequency | count of touch selection by a user increases.

  In addition, the CPU 302 passes the information on the conversion candidate that has been touch-selected to the kana-kanji conversion processing program. As a result, the conversion candidate that has been touch-selected is determined as a conversion target (Op 418). FIG. 10C is a diagram illustrating an example of the state of the display 301 after touch selection. Specifically, the conversion candidate “Fuji” touch-selected by the user is displayed in the input area 51 of the editor, and the other conversion candidates (“Mt. Fuji” and “Mt. Fuji”) are deleted from the screen.

[1-3-8. Summary]
As described above, the candidate display device 1 determines the display position of the conversion candidate based on the combination of the hand that performs keyboard input and the hand that performs touch selection. Candidates can be displayed to improve user convenience during touch selection.

  In this embodiment, the input operation reception unit 201 includes the processing function of Op 401 in FIG. 4 as an example. The touch selection control unit 204 includes processing functions of Op 416 and Op 417 in FIG. 4 as an example. The input operation status acquisition unit 202 includes the processing function of Op407 or Op408 in FIG. 4 as an example. The display position determination unit 203 includes the processing function of Op410 or Op412 in FIG. 4 as an example. The candidate determination unit 205 includes the processing function of Op 418 in FIG. 4 as an example. The candidate prediction unit 206 includes the processing function of Op 403 in FIG. 4 as an example. The candidate acquisition unit 207 includes the processing functions of Op 404 and Op 405 in FIG. 4 as an example. The input operation direction determination unit 210 includes the processing function of Op 414 in FIG. 4 as an example. The input operation direction acquisition unit 211 includes the processing function of Op407 in FIG. 4 as an example. The touch selection direction acquisition unit 212 includes the processing function of Op 408 in FIG. 4 as an example. The touch selection direction determination unit 213 includes the processing function of Op415 in FIG. 4 as an example.

[2. Second Embodiment]
Similarly to the first embodiment, the candidate display device according to the present embodiment can also be configured using a so-called notebook computer device, a mobile phone, or a PDA (Personal Digital Assistance) device.

[2-1. System configuration and hardware configuration]
An example of the system configuration and the hardware configuration of the candidate display device 1 according to the present embodiment is basically the same as that of the first embodiment described with reference to FIG.

[2-2. Candidate display processing]
The contents of the candidate display process in the candidate display device 1 of the present embodiment are basically the same as those of the first embodiment described with reference to FIGS. However, in this embodiment, the conversion candidate display methods shown in FIGS. 8 to 10C are different. Specifically, the candidate display position calculation process of Op410 in FIG. 4 is different.

[2-2-1. Op410 Candidate Display Position Calculation Process]
Hereinafter, the process of calculating the candidate display position in Op 410 (FIG. 4) of the present embodiment will be specifically described. FIG. 11 is a diagram showing an example of candidate display in the present embodiment. In the present embodiment, a straight line m1 determined by the last key input position P1 and the cursor position P2 of the editor input area 51 is projected onto a plane on the display 301 at a position on the straight line m2. The candidate with the highest priority ("Fuji" in FIG. 11) is displayed.

  FIG. 12 shows a point P4 on a straight line determined by the position P1 of the last input key on the keyboard 305 and the cursor position P2 on the three-dimensional coordinate space by the XYZ axes, and this point P4 is displayed. It is a schematic diagram which shows the relationship with the point P3 (x1, y1) projected on the plane (coordinate plane of X0-Y0 axis | shaft) on 301. FIG. Note that a straight line n indicates a reference line of a candidate display position (height).

  If the projected point P3 is (x1, y1) in the X0-Y0 coordinate system, this is expressed as follows in the XYZ coordinate system.

  Here, since P4 is in the middle of the vector P1P2, it can be expressed as follows.

  When the vector P1P2 and the vector P3P4 are orthogonal to each other, the inner product is 0, and the following equation is established.

  At this time, the unknowns are X1 and t. By solving the above inner product equation, the reference point X1 of the high probability candidate is obtained. The straight line connecting P3P4 is preferably a straight line passing through the user's viewpoint. Furthermore, it is desirable that the straight line connecting P3P4 coincides with the user's line of sight.

  Thus, in Op410, the CPU 302 calculates P3 and displays the conversion candidate with the highest display priority on P3. Thereby, a conversion candidate can be arrange | positioned on the user's eyes | visual_axis which go to a cursor position from the key input last, and visibility can be improved. It should be noted that the second and subsequent priority conversion candidates are preferably displayed with priority on the direction that does not block the line of sight. For example, in FIG. 11, “Mt. Fuji”, which is the second priority, is arranged on the right side of the highest priority conversion candidate, thereby improving the operability so as not to block the line of sight when touching “Mt. Fuji”. ing.

[3. Third Embodiment]
Similarly to the first embodiment, the candidate display device according to the present embodiment can also be configured using a so-called notebook computer device, a mobile phone, or a PDA (Personal Digital Assistance) device.

[3-1. System configuration and hardware configuration]
An example of the system configuration and the hardware configuration of the candidate display device 1 according to the present embodiment is basically the same as that of the first embodiment described with reference to FIG.

[3-2. Candidate display processing]
The contents of the candidate display process in the candidate display device 1 of the present embodiment are basically the same as those of the first embodiment described with reference to FIGS. However, in this embodiment, the conversion candidate display methods shown in FIGS. 8 to 10C are different. Specifically, the candidate display position calculation process of Op410 in FIG. 4 is different.

[3-2-1. Op410 Candidate Display Position Calculation Process]
Hereinafter, the process of calculating the candidate display position in Op 410 (FIG. 4) of the present embodiment will be described in a limited manner. FIG. 13 is a diagram illustrating an example of candidate display in the present embodiment. In the present embodiment, when the keyboard operation hand is different from the touch selection hand, the predetermined distance from the position P2 at which the distance between the last key input position P1 and the position on the display 301 is the smallest among the candidates is set. The candidate with the highest priority is displayed at the separated position P3.

  Here, the method of calculating the position P2 at which the distance between the last key input position P1 and the position on the display 301 is the smallest among the candidates is the same as in the first embodiment (FIGS. 8 and 9). . Further, the position of P3 is a position that is separated from P2 by a predetermined distance in the direction of the touch-selected hand on the X axis. For example, if the touch-selected hand is the left hand, the position is in the minus direction of the X axis. The predetermined distance may be an average width of the left hand as an example.

  As a result, it is possible to prevent the hand that has input the last input key from crossing the hand that has been touch-selected. For this reason, the operativity at the time of touch selection can be improved.

[4. Fourth Embodiment]
Similarly to the first embodiment, the candidate display device according to the present embodiment can also be configured using a so-called notebook computer device, a mobile phone, or a PDA (Personal Digital Assistance) device. In the present embodiment, in the candidate display device 1 shown in the first embodiment, the directivity at the time of the input operation, which is determined by the number of times the input operation is performed with the keyboard, the input key that is pressed last, or the like. Based on this, an example of determining the display position of the conversion candidate will be described.

[4-1. System configuration and hardware configuration]
An example of the system configuration and the hardware configuration of the candidate display device 1 according to the present embodiment is basically the same as that of the first embodiment described with reference to FIG.

[4-2. Candidate display processing]
The contents of the candidate display process in the candidate display device 1 of the present embodiment are basically the same as those of the first embodiment described with reference to FIGS. 4 to 10C. However, the present embodiment is different in that the touch selection direction is determined in consideration of the directivity of the user's key input operation. FIG. 14 is a diagram illustrating an example of an operation chart of candidate display processing based on a candidate display program executed by the CPU 302 of the candidate display device 1 in the present embodiment. Hereinafter, the description will be limited to the processing portion based on the key input directivity.

[4-2-1. Candidate display position calculation processing of Op 408a and Op 408b]
In FIG. 14, after acquiring the touch selection direction in Op408, the CPU 302 determines whether or not there is a key input directivity (Op408a). The key input directivity is determined based on, for example, directivity recording data. FIG. 15 is a diagram illustrating an example of directivity recording data. The directivity recording data is created at an arbitrary timing based on log data that records a series of operations from key input to touch selection. The directivity record data of the present embodiment includes at least an “immediate key” 151 indicating a key that has been last input, and an “input character string” indicating the length of a character string input in one Kana-Kanji conversion process. Number “152”, “touch selection direction (touch selection hand)” 153 indicating whether the hand that performed the touch operation is left or right are recorded.

  FIG. 16 is a diagram illustrating an example of an operation chart of directivity recording data creation processing. The CPU 302 acquires a pair of hand entry data (three-dimensional data (XYZ) group) and the final entry position (XY) of the hand on the display (Op1601). As described above, for example, a capacitive touch panel capable of sensing in the normal direction of the screen may be used to acquire hand approach data.

  Next, the CPU 302 determines a touch selection hand indicating the touch selection direction (Op1602). As described above, for example, the touch-selected hand may be determined by calculating the approach vector of the hand and calculating the approach position (vertical entry position) that always has a strong vertical tendency.

  The CPU 302 acquires information on the keystroke key of the key input immediately before the touch selection operation (Op1603). For example, the previous key is acquired from the key information in the memory 33 or the like in Op402. Subsequently, the CPU 302 acquires the number of input character strings (Op 1604). For example, the number of input character strings handed over to the kana-kanji conversion processing program is recorded in the memory 33 or the like each time, and the number of input character strings is acquired from the memory 33 or the like in the processing.

  The CPU 302 records the input key acquired in Op 1603 and the number of input character strings acquired in Op 1604 in the directivity recording data in association with the touch selection hand determined in Op 1602 (Op 1605).

  Returning to the processing of FIG. 14, if the CPU 302 determines that there is key input directivity (Op 408a, Yes), it determines the touch selection direction based on the key input directivity data (Op 408b). For example, as shown in the record 150 of FIG. 15, when the previous key is “I” and the number of input character strings is “10” or more, the touch selection hand indicating the touch selection direction is “right hand”. It is determined that there is a key input directivity. In this case, for example, even if the touch selection direction acquired in Op 408 is “left hand” or “both hands”, the touch selection hand is set to “right hand” and the subsequent processing (Op 409 and subsequent steps) is continued.

  As described above, by determining the touch selection direction in consideration of the directivity of the user's input operation, the conversion candidate can be displayed at a position according to the user's input characteristics (for example, 癖). For this reason, the operativity at the time of touch selection can be improved.

  In the above description, the “number of input character strings” is used as a determination index for key input directivity, but other indexes may be used. For example, the number of key inputs indicating how many times the user has pressed a key on the keyboard may be adopted as a determination index.

[5. Fifth Embodiment]
Similarly to the first embodiment, the candidate display device according to the present embodiment can also be configured using a so-called notebook computer device, a mobile phone, or a PDA (Personal Digital Assistance) device. In the present embodiment, in the candidate display device 1 shown in the first embodiment, the vertical direction (height direction) of the conversion candidate is determined by the number of input operations performed using the keyboard, the input key pressed last, and the like. An example of determining the display position will be described.

[5-1. System configuration and hardware configuration]
An example of the system configuration and the hardware configuration of the candidate display device 1 according to the present embodiment is basically the same as that of the first embodiment described with reference to FIG.

[5-2. Candidate display processing]
The contents of the candidate display process in the candidate display device 1 of the present embodiment are basically the same as those of the first embodiment described with reference to FIGS. 4 to 10C. However, the present embodiment is different in that, before Op 416, the position in the vertical direction in which the conversion candidates are finally displayed is adjusted in consideration of the current situation of the user's key input operation. 18A to 18D are diagrams illustrating an example of a display 301 with a touch panel that is a conversion candidate in the present embodiment.

  In general, when a cooperative operation between a keyboard and a touch panel is performed on a relatively long character string, the user is highly likely to perform an input operation by staring only at the keyboard. This is because if the character string is long, it may become obsessed with input and difficult to notice on the display.

  Therefore, when the input character string is relatively long, when the face is raised and the editor input area is viewed, at the same time, in order to make it easy to notice the predictive conversion candidate, at a position close to the editor input area on the display. , Display a high-probability predictive conversion candidate with priority. For example, as shown in FIG. 18A or 18B, the highest priority conversion candidate 180 is displayed at a position that is higher in the vertical direction than the normal display position. Thereby, the line-of-sight movement at the time of input can be reduced. For this reason, operability and visibility are improved.

  On the other hand, when the input character string is relatively short, for example, as shown in FIG. 18C or 18D, a high-probability prediction is performed at a position close to the keyboard side on the display so that the user can easily recognize the prediction conversion candidate. The conversion candidate 180 is displayed with priority. Thereby, the line-of-sight movement at the time of input can be reduced. For this reason, operability and visibility are improved.

  Also, when the user performs a key input operation while looking at each keystroke key, the user's line of sight and field of view vary depending on which position the previous input key belongs to in the vertical direction of the keyboard. For example, when the final keystroke position directivity is found in the “upper region” of the key input device, it can be assumed that the user is staring at the key input device and is not likely to notice a prediction candidate on the display device. .

  Therefore, in order to prompt the user to use the prediction candidate by changing the display position (up and down) of the prediction candidate according to the vertical position of the key input, for example, as shown in FIG. 18C or FIG. The predictive conversion candidate 180 with high probability is displayed preferentially at a close position. Thereby, the line-of-sight movement at the time of input can be reduced. For this reason, operability and visibility are improved.

[5-2-1. Candidate display position calculation processing of Op 413a and Op 413b]
FIG. 17 is a diagram illustrating an example of an operation chart of candidate display processing based on a candidate display program executed by the CPU 302 of the candidate display device 1 in the present embodiment. Hereinafter, description will be limited to the difference between FIG. 4 and FIG.

  In FIG. 17, after calculating the candidate display position on the touch panel in Op410, Op412 or Op413, the CPU 302 determines whether or not the number of key inputs according to the current input status of the user is equal to or greater than a predetermined value (Op413a). ). For example, when the input character string is 10 characters or more, the display position of the conversion candidate is set higher (Op 413b). For example, a high-probability predictive conversion candidate is preferentially displayed at a vertical position (that is, upward) near the editor input area 51 on the display 301.

  Next, the CPU 302 determines whether or not the number of key inputs according to the current input status of the user is equal to or less than a predetermined value (Op 413c). For example, if the input character string is 3 characters or less, the display position of the conversion candidate is set lower (Op413d). For example, a high-probability predictive conversion candidate is preferentially displayed on the display 301 at the upper and lower positions closer to the keyboard 305 (that is, downward).

  Next, the CPU 302 determines whether or not the last input key recorded in Op 402 is a key located on the upper stage of the keyboard 305 (Op 413e). For example, when using a JIS layout keyboard, the upper row of keys aligned with “Q, W, E,..., I, O, P” is “A, S, D,. , L ”is the middle row, and the key row that is aligned with“ Z, X, C,..., B, N, M ”is the lower row. For example, if the last input key is “I”, this input key is determined as a key located in the upper stage, and the display position of the conversion candidate is set lower (that is, lower) (Op 413f).

  In the above description, “number of input character strings” is used as an index for determining the number of times of key input, but other indexes may be used. For example, the number of key inputs indicating how many times the user has pressed a key on the keyboard may be adopted as a determination index.

[6. Sixth Embodiment]
Similarly to the first embodiment, the candidate display device according to the present embodiment can also be configured using a so-called notebook computer device, a mobile phone, or a PDA (Personal Digital Assistance) device. The candidate display device 1 of the present embodiment measures the speed related to touch selection based on the time when the candidate is displayed on the display selection device and the time when the touch selection from the user is received in the display selection device. The candidate display device 1 of the present embodiment adjusts the display timing of candidates to be displayed on the display selection device based on the speed history information related to touch selection measured by the touch selection measurement unit. The candidate display device 1 of the present embodiment determines the candidate display position based on the adjusted display timing and displays the candidate.

[6-1. System configuration and hardware configuration]
An example of the system configuration and the hardware configuration of the candidate display device 1 according to the present embodiment is basically the same as that of the first embodiment described with reference to FIG. However, the system configuration example of the present embodiment further includes a touch selection measurement unit and a display timing adjustment unit in addition to FIG. FIG. 19 is a diagram illustrating an example of the relationship between the functional units in the candidate display device according to the present embodiment.

  In FIG. 19, the touch selection measurement unit 209 touches based on the time when the candidate is displayed on the display 301 which is a display selection device and the time when the touch selection from the user is received on the display 301 (display selection device). Measure the speed of selection. Further, the display timing adjustment unit 208 adjusts the display timing of candidates to be displayed on the display 301 (display selection device) based on the history information of the speed related to touch selection measured by the touch selection measurement unit 209. Then, the display position determination unit 203 displays candidates based on the display timing output from the display timing adjustment unit 208.

  For example, the touch selection measurement unit 209 and the display timing adjustment unit 208 included in the candidate display device 1 illustrated in FIG. 19 are realized by executing a candidate display program 304a (FIG. 3) on the CPU 302.

[6-2. Candidate display processing]
The contents of the candidate display process in the candidate display device 1 of the present embodiment are basically the same as those of the first embodiment described with reference to FIGS. 4 to 10C. However, in this embodiment, after the conversion candidate is determined in Op418 in FIG. 4, evaluation data is recorded, and feedback control is performed at the next candidate display time.

[6-2-1. Op416 candidate display display process]
FIG. 20 is a diagram illustrating an example of an operation chart of candidate display processing based on a candidate display program executed by the CPU 302 of the candidate display device 1 in the present embodiment. Hereinafter, the description will be limited to the difference between FIG. 4 and FIG.

  In FIG. 20, after determining a kana-kanji conversion candidate in Op418, the CPU 302 records evaluation data in the evaluation data holding unit 200 (Op419). The evaluation data holding unit 200 is recorded in the memory 303 or the hard disk 304, for example.

  FIG. 21 is a diagram illustrating an example of evaluation data. The evaluation data 200 includes a “conversion target character string” 211 indicating a character string determined as a Kana-Kanji conversion candidate, a “confirmation time” 212 indicating a time when the user determines a candidate by a touch selection operation, and a user performing a key input operation “Last input key” 213 indicating the last key input at ”,“ Input time ”214 indicating the input time of the key last input by the user by the key input operation, and last input by the user by the key input operation The “touch selection speed” 215 and the like calculated from the distance between the key and the editor input area and the elapsed time from the time when the user inputs the last key to the time when the user performs touch selection are recorded.

  For example, when the touch selection shown in FIGS. 10A to 10C is performed, as shown in the record 210 of FIG. 21, “Fuji” as “conversion target character string” 211 and “12: “00:05”, “Last input key” 213 “I”, “Input time” 214 “12:00:04”, and “Touch selection speed” 215 “0.3 m / s” are recorded.

  After the evaluation data is recorded in the evaluation data holding unit 200, in the next processing of Op416, the CPU 302 refers to the evaluation data holding unit 200 and evaluates the candidate display status (Op416). Specifically, referring to the evaluation data holding unit 200, a plurality of records including the latest evaluation data record are acquired.

  If the touch selection speed is improved from the past history of the evaluation data record, it is determined that the touch selection state is good, and the current setting state is maintained. In other words, no processing is performed. On the other hand, when the touch selection speed is not improved, the display timing is adjusted.

  For example, in adjusting the display timing, the time interval from when the user performs key input to when the conversion candidate is displayed is increased or decreased. In particular, when the user is an elderly person, it may be desirable to display the conversion candidate at the end of the user's key input by delaying the display timing. In addition, when the user is young, it may be desirable to display conversion candidates in accordance with the user's key input situation by advancing the display timing.

  In the above description, the speed related to touch selection is calculated based on the time when the candidate is displayed on the display 301 and the time when the touch selection from the user is received. You may calculate based on these conditions. For example, instead of the time when the candidate is displayed on the display 301, the time when the user releases the keyboard 305 may be used. In this case, whether or not the user has released his / her hand from the keyboard 305 may be determined by a sensor switch or the like.

  In this embodiment, the touch selection measurement unit 208 includes, as an example, the processing function of Op419 or FIG. The display timing adjustment unit 209 includes the processing function of Op 416 in FIG. 4 as an example.

[7. Other Embodiments]
A part or all of the configurations described in the first to sixth embodiments may be combined with two or more.

  In the above embodiment, the candidate display device 1 is configured using a keyboard as the input operation receiving unit, but other devices capable of detecting the position of the key operation may be used. For example, a pen tablet input device, a touch panel keyboard or a mouse may be used.

  In the above embodiment, the editor input area and the conversion candidate are displayed on one display with a touch panel. However, the editor input area and the conversion candidate are not necessarily displayed on the same display. For example, the conversion candidates may be displayed on a sub-display (with a touch panel function) independent from the display that displays the input area of the editor.

  In the above embodiment, each functional block shown in FIG. 2 and the like is realized by processing of a CPU that executes software. However, some or all of them may be realized by hardware such as a logic circuit. In addition, you may make it make an operating system (OS) further process a part of program.

DESCRIPTION OF SYMBOLS 201 Input operation reception part 202 Input operation condition acquisition part 203 Display position determination part 204 Touch selection control part 205 Candidate determination part 206 Candidate prediction part 207 Candidate acquisition part 208 Display timing adjustment part 209 Touch selection measurement part 210 Input operation direction determination part 211 Input operation direction acquisition unit 212 Touch selection direction acquisition unit 213 Touch selection direction determination unit

Claims (16)

An input operation accepting unit for accepting a user's input operation on the input device;
A touch selection control unit that displays candidates so that the user can perform touch selection on the display selection device, and receives a touch selection from the user for the candidates displayed on the display selection device;
A candidate acquisition unit for acquiring at least one candidate determined based on an input operation from a user received in the input operation reception unit;
An input operation status acquisition unit for acquiring an input operation status including information on the position of the input operation last performed in the input device;
A candidate display device comprising: a display position determination unit that determines a display position of a candidate to be displayed on the display selection device based on the input operation status.   The display position determination unit according to claim 1, wherein the display position determination unit determines the display position based on a distance between a position on the input device and a position on the display selection device in the last input operation. Candidate display device. The input operation status includes information on a touch selection direction indicating from which direction the user performs touch selection,
The candidate display device according to claim 1, wherein the display position determination unit determines the display position based on the touch selection direction. The input operation in the input operation reception unit includes a key input operation performed by inputting a desired key from a plurality of keys,
The candidate display device according to any one of claims 1 to 3, wherein the input operation status is information relating to a key position at which a key input operation was last performed. An input operation direction acquisition unit that acquires an input operation direction indicating from which direction the user performs an input operation on the input device;
A touch selection direction acquisition unit that acquires a touch selection direction indicating a direction in which the user performs touch selection with respect to the display selection device;
The candidate display device according to any one of claims 1 to 4, wherein the input operation status is information relating to a combination of the input operation direction and the touch selection direction. The candidate acquisition unit acquires a priority order for displaying the candidates together with the at least one candidate,
When the input operation direction and the touch selection direction are common, the display position determination unit determines the distance between the position of the last input operation performed on the input device and the position on the display selection device as each candidate. The candidate display device according to claim 5, wherein the display position is determined so that the candidate with the highest priority is displayed at a position that is the smallest in between.   When the input operation direction and the touch selection direction are common, the display position determination unit is determined by the position of the last input operation performed on the input device and the position of the input cursor on the display selection device. 6. The display position according to claim 5, wherein the display position is determined so that the candidate having the highest priority is displayed at a position on a straight line obtained by projecting a straight line to be projected onto a plane constituted by the display selection device. Candidate display device.   When the input operation direction and the touch selection direction are opposite to each other, the display position determination unit is at a position where the distance from the end on the touch selection direction side in the display selection device is the smallest among the candidates. The candidate display device according to claim 5, wherein the display position is determined so as to display a candidate having the highest priority.   When the input operation direction and the touch selection direction are opposite to each other, the display position determination unit determines the distance between the position of the input operation last performed in the input device and the position on the display selection device. The display position is determined so that the candidate with the highest priority is displayed at a position that is a predetermined distance away from a position that is the smallest among the candidates in the touch selection direction side. The candidate display device according to item.   The candidate display as described in any one of Claims 5-9 further provided with the input operation direction determination part which determines the said input operation direction based on the input time interval about two or more input operation on the said input device. apparatus.   In the case where the keys arranged on the input device are divided into left and right areas, the input operation direction determination unit determines the input time interval of two or more keys spanning the left and right areas, and the left and right areas. The candidate display device according to claim 10, wherein the input operation direction is determined based on a difference between input time intervals of two or more keys that do not span.   12. The touch selection direction determination unit according to claim 5, further comprising a touch selection direction determination unit that determines the touch selection direction based on a vertical approach direction with respect to the display selection device when the user performs touch selection. Candidate display device. The input operation status includes information on the number of times the input operation has been performed,
The candidate display device according to any one of claims 1 to 13, wherein the display position determination unit determines the display position based on whether or not the number of times the input operation has been performed is a predetermined number or more. . A touch selection measuring unit that measures a speed related to touch selection based on the time when the candidate is displayed on the display selection device and the time when the touch selection is received from the user in the display selection device;
A display timing adjustment unit that adjusts display timings of candidates to be displayed on the display selection device based on history information of speed related to touch selection measured by the touch selection measurement unit;
The candidate display device according to any one of claims 1 to 13, wherein the display position determination unit determines the display position based on a display timing output from the display timing adjustment unit. An input operation accepting process for accepting a user input operation on the input device;
Touch selection control processing for displaying a candidate so that the user can select a touch on the display selection device, and receiving a touch selection from the user for the candidate displayed on the display selection device;
A candidate acquisition process for acquiring at least one candidate determined based on an input operation from a user received in the input operation reception process;
An input operation status acquisition process for acquiring an input operation status including information on the position of the input operation last performed in the input device;
A candidate display program for causing a computer to execute display position determination processing for determining a display position of a candidate to be displayed on the display selection device based on the input operation status. An input operation accepting step for accepting a user input operation on the input device;
A touch selection control step of displaying candidates so that the user can perform touch selection on the display selection device, and accepting touch selection from the user for the candidates displayed on the display selection device;
A candidate acquisition step of acquiring at least one candidate determined based on an input operation from a user received in the input operation reception step;
An input operation status acquisition step of acquiring an input operation status including information on the position of the input operation last performed in the input device;
A candidate display method including a display position determination step of determining a display position of a candidate to be displayed on the display selection device based on the input operation status.

Images