JP4852627B2 - Input device and input method - Google Patents

Description

  The present invention relates to an input device and an input method for inputting information using a user's line of sight.

  2. Description of the Related Art Conventionally, there has been proposed an apparatus that detects the position of a user's line of sight on a display and inputs a user's intention such as “Yes” or “No” to a computer (see, for example, Patent Document 1).

JP-A-9-204287

  However, for example, when considering putting 50 kana characters on the display and using the user's line of sight, the user inputs the line of sight accurately and quickly because there are many types of input candidates. It may be difficult to input according to the character you want.

  The present invention has been made in view of the above, and provides an input device and an input method capable of easily realizing accurate and quick input in an input device that inputs information using a line of sight. Objective.

In order to achieve the above object, an input device according to the present invention includes a display for displaying information, input information display means for displaying a plurality of information to be input on the display, and input information display means for the display. Line-of-sight detection means for detecting the position of the line of sight of the user in the area where a plurality of input targets are displayed, operation detection means for detecting a predetermined operation from the user, and timing when the predetermined operation is detected by the operation detection means Based on the line-of-sight position detected by the line-of-sight detection means, input information determination means for determining input information, and information input by the input information determination means is detected by the line- of- sight detection means at the timing determined . The input information determined by the input information determination means is appropriate according to the time-series change in the position of the line of sight. Whether the judge, characterized in that it comprises an input correction means for outputting information indicating the determination result.

  In the input device according to the present invention, it is determined whether or not the input information is valid based on a time-series change in the position of the line of sight. Therefore, for example, when the user performs a predetermined operation to input information, if the line of sight deviates from the information that the user intends to input, it is determined that the input information is not appropriate, and accordingly Processing can be performed. That is, when an input unintended by the user is performed, an appropriate process can be performed, and thereby accurate and quick input can be easily realized.

The input correction unit is configured to input information determined by the input information determination unit according to a time-series change in the position of the line of sight detected by the line of sight detection unit when the input information is determined to be invalid. And information corresponding to the time-series change are displayed on the display as input information candidates. According to this configuration, when an input unintended by the user is made, information that is a candidate for the input intended by the user can be presented, and more accurate and quick input can be easily realized.

  It is desirable that the input information display unit highlights the information to be input to be displayed according to the position of the line of sight detected by the line of sight detection unit. According to this configuration, it is possible to appropriately direct the user's line of sight to information to be input intended by the user.

  The input device preferably further includes an input information display means for displaying the input information on the display based on the determination by the input correction means. According to this configuration, it is possible to check information that has been input by the user, and to improve usability.

Input device, the position of the predetermined operation by the operation detecting means is detected by the sight line detection means is detected timing glance, whether the position of the information of the completed input displayed by the already input information display means It is desirable to further include a correction unit that makes a determination and makes the input information correctable. According to this configuration, input information can be easily corrected.

  The input information display means desirably highlights the information to be input displayed around the information to be input corresponding to the input information that has been corrected by the correction means. According to this configuration, it is possible to present information that is a candidate for correction intended by the user, and it is possible to easily realize more accurate and quick input.

  By the way, the present invention can be described as an input device invention as described above, and can also be described as an input method in the input device as follows. This is substantially the same invention only in different categories, and has the same operations and effects.

That is, the input method according to the present invention is an input method by an input device including a display for displaying information, and an input information display step for displaying a plurality of information to be input on the display, and the input information for the display In the display step, a line-of-sight detection step for detecting the position of the user's line of sight in a region where a plurality of input targets are displayed, an operation detection step for detecting a predetermined operation from the user, and a predetermined operation detected in the operation detection step An input information determination step for determining information to be input based on the position of the line of sight detected in the line of sight detection step at the determined timing, and a line of sight detection step in which the information input in the input information determination step is determined . Depending on the time-series change in the detected gaze position, the input information A time-series change in the position of the line of sight detected in the line-of-sight detection step when it is determined whether or not the input information determined in the determination step is appropriate and the input information is not valid And an input correction step for displaying information corresponding to the time-series change on the display as a candidate for input information, which is different from the input information determined in the input information determination step. It is characterized by.
Input method based on the determination at the input correction step, the already input information display step of displaying the information already entered in the display, a predetermined operation in the operation detection step is detected in the visual axis detection steps were detected timing gaze And a correction step for determining whether or not the position of the input information is at the position of the input information displayed in the input information display step and making the input information in a correctable state. In the information display step, it is desirable to highlight the information to be input displayed around the information to be input corresponding to the input information that has been corrected in the correction step.

  According to the present invention, for example, when the user performs a predetermined operation to input information, if the line of sight deviates from the information that the user intends to input, it is determined that the input information is not valid. Thus, the processing corresponding to that can be performed. In other words, according to the present invention, it is possible to perform appropriate processing when an input unintended by the user is made, and thereby it is possible to easily realize an accurate and quick input.

It is a figure which shows the external appearance structure of the portable terminal which is an input device which concerns on embodiment of this invention. It is a figure which shows the function structure of the portable terminal which is an input device which concerns on embodiment of this invention. It is a figure which shows the display of a display when the character input by a user's eyes | visual_axis is performed. It is a figure which shows a user's eyes | visual_axis at the time of the input of a character. It is a figure which shows the display of a display when the input information is corrected. It is a figure which shows the hardware constitutions of the portable terminal which is an input device which concerns on embodiment of this invention. It is a flowchart which shows the process (input method) performed with the portable terminal which is an input device which concerns on embodiment of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of an input device and an input method according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 shows an external configuration of a mobile terminal 10 that is an input device according to the present embodiment. Specifically, the mobile terminal 10 corresponds to an electronic device that is carried and used by a user such as a mobile phone or a PDA (Personal Digital Assistants). As shown in FIG. 1, the mobile terminal 10 includes a first housing 20 and a second housing 30. The first casing 20 and the second casing 30 constitute a hinge and are connected to each other, and the mobile terminal 10 is a so-called foldable terminal that can be folded. The first casing 20 and the second casing 30 have substantially the same size and a substantially rectangular parallelepiped shape, and are overlapped so that the largest surfaces (main surfaces) face each other when folded. The The first casing 20 and the second casing 30 are formed so that the length in the thickness direction is shorter than that in the vertical and horizontal directions, that is, the first casing 20 and the second casing 30 are thin and easy to use by the user. It has become. In addition, the first casing 20 and the second casing 30 are each formed vertically long.

  A display 21 for displaying information such as characters and images is provided on the main surface of the first housing 20. The display 21 includes an image display device such as a liquid crystal display, and displays an image controlled by a CPU (Central Processing Unit), a memory, and the like included in the mobile terminal 10. The display 21 has a vertically long shape that matches the rectangular shape of the main surface on which the display 21 is provided. The size of the display 21 is about 3.0 inches, for example. A camera 22 is provided on both sides of the display 21 on the main surface of the first housing 20 and substantially in the center in the longitudinal direction. Normally, the main surface of the first housing 20 is used so as to face the user's face, and the camera 22 captures the user's eyes when used in such a manner. Information taken by the camera 22 is used to detect the user's line of sight. The camera 22 need not be arranged as in the present invention, but is preferably arranged so as to reduce the line-of-sight error.

  For example, the portable terminal 10 has a document input function for inputting a plurality of characters, which is used for an e-mail function or the like. The mobile terminal 10 can input characters using the user's line of sight. For example, as shown in FIG. 1, characters (50 kana characters) that are a plurality of pieces of information to be input are displayed on the first area 21 a of the display 21. The user inputs a character to the mobile terminal 10 by looking at the character portion that the user wants to input, that is, by adjusting the position of the user's line of sight to the character portion. The characters input by the user are displayed in the second area 21a located below the first area 21a of the display 21 (in the state shown in FIG. 1). The display 21 may display a display 21c for inputting information indicating an operation other than characters (for example, conversion of characters input as shown in FIG. 1).

  The second housing 30 is provided with an operation unit (not shown) that receives an operation on the mobile terminal 10 by the user. Further, buttons 31 and 32 are provided in the vicinity of the connection portion between the left and right side surfaces of the second housing 30 with the first housing 20, respectively. The determination button 31 located on the left side (in the state shown in FIG. 1) is a button for performing overall input determination and confirmation based on the user's line of sight. For example, it is a button for inputting the character to the mobile terminal 10 when the user presses the enter button 31 when the position of the user's line of sight is adjusted to the character position. The return button 32 located on the right side is a button for performing an operation of returning or deleting the operation in the input by the user's line of sight.

  Further, the mobile terminal 10 may be provided with functions such as a microphone, a speaker, and a camera (not shown) provided in the mobile phone.

  Subsequently, functions of the mobile terminal 10 according to the present invention will be described. As shown in FIG. 2, the mobile terminal 10 includes a first region display unit 11, a line-of-sight detection unit 12, an operation detection unit 13, an input information determination unit 14, an input correction unit 15, and a second region display unit 16. And a correction unit 17.

  The first area display unit 11 is input information display means for displaying characters to be input on the first area 21 a of the display 21. The first area display unit 11 stores in advance information on characters to be input and information indicating in which part of the first area 21a each character is displayed (display coordinate position). Based on, the character to be input is displayed. For example, as shown in FIG. 1, kana of 50 tones are displayed evenly arranged at regular intervals of 5 characters.

  The line-of-sight detection unit 12 is line-of-sight detection means for detecting the position of the user's line of sight on the display 21 (the position of the display the user is looking at). The line-of-sight detection unit 12 receives an image taken from the camera 22 provided in the mobile terminal 10 and detects the position of the user's line of sight based on the image. An existing method can be used as a method for detecting the position of the line of sight. In detecting the line of sight, for example, the user is prompted to view the four corners of the display 21 (by display or the like), and the line of sight when the four corners are viewed is detected, so that the line of sight is detected more appropriately. You may do it.

  The line-of-sight detection unit 12 continues to detect the line of sight continuously (while the line-of-sight input function is used). The line-of-sight detection unit 12 outputs information on the detected position of the line of sight of the user to the first region display unit 11, the input information determination unit 14, the input correction unit 15, and the correction unit 17. The information on the position of the user's line of sight is information indicating the coordinate position on the display 21, for example. The line-of-sight detection unit 12 causes the display 21 to display the detected position of the viewpoint on the display 21 as a target T (cursor), as shown in FIGS. Thereby, it can be grasped which part of the display 21 the user is looking at.

  The operation detection unit 13 is an operation detection unit that detects a predetermined operation on the mobile terminal 10 from the user. The predetermined operation is pressing of the determination button 31 or the return button 32. This operation is, for example, an operation for inputting a character designated by the user with a line of sight. When the operation detection unit 13 detects the operation from the user, the operation detection unit 13 notifies the input information determination unit 14, the input correction unit 15, and the correction unit 17 to that effect.

  The input information determination unit 14 determines a character to be input according to the position of the user's line of sight detected by the line-of-sight detection unit 12 at the timing when the operation detection unit 13 detects that the user presses the enter button 31. This is input information determination means. The input information determination unit 14 stores a range in the first region 21a that accepts input for each character, and the line-of-sight position notified from the line-of-sight detection unit 12 at the timing when the pressing of the determination button 31 is detected. The character to be input is determined by determining whether it is included in the range of characters. The range in the first area 21a that accepts input for each character is a rectangular range in which the character is displayed in the first area 21a.

  For example, as shown in the left diagram of FIG. 3, when the target T is on the character “ki”, the character “ki” is determined as an input character, and is shown in the right diagram of FIG. 3. Thus, when the target T is on the character “SU”, the character “SU” is determined as the input character. The input information determination unit 14 notifies the input correction unit 15 that information input based on an operation from the user has been determined.

  Further, in a state where pressing of the determination button 31 is not detected, the first area display unit 11 may highlight the character to be displayed according to the position of the user's line of sight detected by the line of sight detection unit 12. Good. Specifically, the first region display unit 11 determines which character range includes the line-of-sight position, and determines the character related to the range including the line-of-sight position as an input character candidate. . Then, the determined input candidate characters are highlighted as shown in FIG. Specifically, the highlighting includes the character color (for example, if the normal display color is black, it is displayed in red) and the size (for example, 1.5 times the normal size). Change. In addition to the above, the distance between the line-of-sight position and the position of each character may be calculated, and the character closest to the line-of-sight position may be determined as an input character candidate and highlighted.

  In addition, the third character in order of increasing distance from the line-of-sight position can be displayed as another highlighted display (for example, the color is green). Here, when there is a line of sight at the end of the display 21, the number thereof may be appropriately reduced. The highlighting may be performed only when the character closest to the line of sight does not change for a certain time (for example, several seconds) (in that case, the time is measured). The first area display unit 11 determines whether or not the position of the line of sight indicated by the information input from the line-of-sight detection unit 12 is included in the first area 21a, and determines whether or not the first area 21a is included in the first area 21a. The above highlighting is performed only when By performing highlighting in this way, the user can easily confirm where the line of sight is located on the display 21, and appropriately direct the user's line of sight toward the input target character intended by the user. be able to.

  The input correction unit 15 determines whether the input character determined by the input information determination unit 14 is valid based on the time-series change in the position of the line of sight detected by the line-of-sight detection unit 12. These are input correction means for outputting information indicating the judgment result. Similarly to the input information determination unit 14, the input correction unit 15 also stores a range in the first area 21a that accepts input for each character. The input correction unit 15 stores information on the position of the line of sight input from the line-of-sight detection unit 12 in time series. The input correction unit 15 detects the line of sight detected by the line-of-sight detection unit 12 at a timing when the character input by the input information determination unit 14 is determined and a predetermined time (for example, 0.1 second) before the timing. It is determined whether or not there is any change in the position. The input correction unit 15 stores in advance timings to be referred to in order to determine a change (in the above example, the determined time point and the time point 0.1 seconds before).

  For example, as shown in FIG. 4A, the position of the user's line of sight is in the range of “ki” (rectangular range) 0.1 seconds before the timing when the input character is determined. As shown in b), when the input character is determined to be in the range of “ku” (in this case, the input information determination unit 14 determines “ku” is input), The input correction unit 15 determines that the determination by the input information determination unit 14 is not appropriate. In this state, “ku” has the current user's viewpoint, but the target T exists within the range of “ki” 0.1 seconds before, so it is expected that the line of sight is moving at high speed. The If the enter button 31 is pressed in this state, “ku” is recognized and selected in a time shorter than the human recognition response time of 0.1 seconds. In the present embodiment, it is assumed that it takes 0.1 seconds for the brain to visually recognize the light reaching the retina.

  In this case, since there is a very high possibility of a “malfunction”, the input correction unit 15 is like “Is it a“ ki ”?” Even if the target position is in the “ku” region. The user is instructed to correct (correct) the characters in the range where the target has entered. The purpose is to proactively suggest the candidate characters that the user would like. The above suggestion is performed as an output of information indicating a determination result by the input correction unit 15.

  Specifically, the display 21 displays the above suggestion and accepts an input of whether or not correction is possible from the user (this input may also be performed based on the position of the user's line of sight). That is, when the input correction unit 15 determines that the input information is not valid, the input information determination unit 14 determines the time-series change in the line-of-sight position detected by the line-of-sight detection unit 12. Information different from the information is displayed on the display 21 as input information candidates. Here, if there is an input indicating that the user does not correct the information, the information determined by the input information determination unit 14 (in the above example, “ku”) is the input character (input information). On the other hand, when there is an input indicating that the correction is received from the user, the information related to the suggestion ("ki" in the above example) is set as the input character (input information).

  On the other hand, as shown in FIG. 4B, the position of the user's line of sight is “near” at both 0.1 seconds before the timing when the input character is determined and at the timing when the input character is determined. "Is within the range, the input correction unit 15 determines that the determination by the input information determination unit 14 is appropriate. In this case, the information (in the above example, “ku”) determined by the input information determination unit 14 is the input character (input information).

  The input correction unit 15 determines the character input from the user as described above and outputs it to the second region display unit 16. This output also depends on the result of determination by the input correction unit 15.

  As shown in FIG. 3B, the second area display unit 16 is input information display means for displaying input characters on the second area 21 b of the display 21 based on the input from the input correction unit 15. is there. By performing the display in this way, the user can confirm the input characters. If there is an input character that is already displayed, it is displayed after that. If the entered character is before confirmation, the user inputs his / her line of sight to the conversion display displayed on the upper right of the display 21 as shown in FIG. Conversion to katakana may be performed. Note that conventional techniques are used for character conversion. When the input character is confirmed or no character is input, the user looks at the document confirmation display displayed on the upper right of the display 21 as shown in FIG. May be entered to end the input of characters by line of sight and shift to a mode for confirming the input document.

  The correction unit 17 is a correction unit that makes it possible to correct the input characters displayed in the second area 21b of the display 21. The correctable state is a state in which the inputted character is replaced with another inputted character. In order to be able to correct the input character, the line of sight is aligned with the input character displayed in the second area 21b, and the enter button 31 is pressed. The correction unit 17 receives the position of the user's line of sight detected by the line-of-sight detection unit 12 at the timing when the operation detection unit 13 detects that the user presses the enter button 31 and is displayed in the second region 21b. It is determined whether the character is at the position of the character. When the correcting unit 17 determines that the position of the user's line of sight is at the position of the input character displayed in the second area 21b, the correcting unit 17 sets the input character in a correctable state.

  The correction unit 17 notifies the first region display unit 11 of the characters that can be corrected. The first area display unit 11 highlights the character to be input displayed around the information to be input corresponding to the character that can be corrected. The surrounding characters to be highlighted are, for example, characters adjacent to the characters that can be corrected. The highlight display is a display in which the color and the size of characters are changed from the normal display. Prominent colors and larger letters are used.

  This will be described with reference to FIG. It is assumed that “ku” (displayed in the second area 21b), which has been input, is corrected. The correction unit 17 determines that “ku” is a correction target based on the input from the user, and notifies the first area display unit 11 to that effect. The first area display unit 11 highlights “U”, “KI”, “KE”, and “SU” adjacent to “KU” to be corrected in the first area 21a. The first area display unit 11 stores character arrangements in advance, and determines characters to be highlighted based on the arrangements. The user selects a character to be corrected from the display in the first area 21a, and inputs the character in the same manner as described above. Here, the first area display unit 11 further highlights the character at the position where the user's line of sight is detected in the first area 21a (for example, “?” Is added to the character as shown in FIG. 5). In addition, the second area display unit 16 displays the character at the position where the user's line of sight is detected as a candidate character to be corrected in the second area 21b (display of an arrow toward “K?”). In this state, when the user presses the enter button 31, an input correction process is performed in the same manner as the character input process described above.

  For example, when the user's line of sight deviates from the first area 21a or the second area 21b without correcting the character, the correction unit 17 performs normal character conversion as illustrated in FIG. Move to the selection screen. Further, when the position of the user's line of sight deviates from the highlighted character range, a normal character selection screen as shown in FIG. The above is the functional configuration of the mobile terminal 10 according to the present embodiment.

  FIG. 6 shows a hardware configuration of the mobile terminal 10. As shown in FIG. 6, the mobile terminal 10 includes a CPU 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, an operation unit 104, a wireless communication unit 105 and an antenna 106, and the display 21 and camera 22 described above. It is comprised by the hardware of these. The determination button 31 is included in the operation unit 104 described above. The functions of the mobile terminal 10 described above are realized by the above-described components operating.

  Subsequently, processing (input method) executed by the mobile terminal 10 according to the present embodiment will be described using the flowchart of FIG. This process is started, for example, by shifting to a character input mode based on the user's line of sight by an operation on the mobile terminal 10 of the user.

  In the mobile terminal 10, first, display is performed on the first area 21 a of the display 21 by the first area display unit 11 and on the first area 21 a of the display 21 by the second area display unit 11 (S01, information display for input). Step). Thereby, the character used as input object is displayed on the 1st field 21a. On the other hand, in the second area 21b, a frame for displaying the input characters is displayed.

  Subsequently, the user's face is photographed by the camera 22, the photographed image is input to the line-of-sight detection unit 12, and the line-of-sight detection unit 12 detects the position of the user's line of sight on the display 21 (S02, line-of-sight detection step). ). Information on the position of the detected line of sight of the user is output to the first region display unit 11, the input information determination unit 14, the input correction unit 15, and the correction unit 17. The detected line-of-sight position is displayed as the target T on the display 21. The detection of the line-of-sight position is continued continuously while the present process is being performed. Subsequently, the process is divided as follows depending on whether the position of the line of sight is in the first area 21a or the second area 21b in the display 21 (S03).

  If the line-of-sight position is in the first area 21a, then the first area display unit 11 determines a candidate character to be input according to the detected line-of-sight position of the user (S04, input). Information display step). Subsequently, as shown in FIG. 3, the determined character candidates are highlighted by the first region display unit 11 (S05, input information display step).

  Here, in order to input the character indicated by the line of sight, when the determination button 31 of the portable terminal 10 is pressed by the user, the operation detection unit 13 detects the operation (S06, operation detection step). Here, when the determination button 31 is not pressed by the user and the operation is not detected by the operation detection unit 13, if the position of the line of sight is in the first region 21a, the display of characters to be input (S03 to S05) is performed. Continued. On the other hand, when the operation is detected by the operation detection unit 13, the input information determination unit 14 is notified to that effect.

  If the operation is detected by the operation detection unit 13, then the input information determination unit 14 performs input according to the position of the user's line of sight detected when the user presses the determination button 31. The character to be determined is determined (S07, input information determination step). Information indicating the character to be input, determined by the input information determination unit 14, is input to the input correction unit 15. Subsequently, whether or not the input character determined by the input information determination unit 14 is valid based on the time-series change in the position of the line of sight detected by the line of sight detection unit 12 by the input correction unit 15. Determination is made (S08, input correction step).

  If it is determined that the determination by the input information determination unit 14 is not valid, the input correction unit 15 displays a suggestion of correction of the input character on the display 21 (S09, input correction step). The user performs selection input (for example, by the same line of sight as described above and pressing of the enter button 31) indicating whether or not to correct the input character by seeing this display. Subsequently, the input correction unit 15 receives the input from the user and determines the input character (input character) (S10, input correction step).

  On the other hand, if it is determined in S08 that the determination by the input information determination unit 14 is appropriate, the input correction unit 15 determines that the character determined by the input information determination unit 14 is an input character (input character). Is done. Information indicating the character determined as described above is output from the input correction unit 15 to the second region display unit 16. Subsequently, as shown in FIG. 3B, the second region display unit 16 displays the input characters on the second region 21b of the display 21 (S11, input completion information display step). Subsequently, the process returns to S03.

  If the position of the line of sight is in the second region 21b in S03, then, when the user presses the enter button 31 of the mobile terminal 10 to correct the character pointed to by the line of sight, the operation detection unit 13, the operation is detected (S06, operation detection step). If the determination button 31 is not pressed by the user and the operation is not detected by the operation detection unit 13, the process returns to S03. On the other hand, when the operation is detected by the operation detection unit 13, the correction unit 17 is notified to that effect.

  When the operation is detected by the operation detection unit 13, the second region is then determined according to the position of the user's line of sight detected by the correction unit 17 when the pressing of the determination button 31 by the user is detected. The character to be corrected is determined from 21b (S12, correction step). The determined character is in a correctable state. Subsequently, the correction unit 17 notifies the first area display unit 11 of the characters that can be corrected. As shown in FIG. 5, the first region display unit 11 highlights the input target character displayed around the input target information corresponding to the correctable character (S13). , Correction step, input information display step). The user sees this display and inputs the corrected character (for example, by the same line of sight as described above and pressing the enter button 31). Subsequently, the correction unit 17 receives the input from the user and determines the corrected character (the input character) (S15, correction step). Information indicating the character determined as described above is output from the correction unit 17 to the second region display unit 16. Subsequently, the input characters are displayed on the second area 21b of the display 21 by the second area display unit 16 (S16, input information display step). Subsequently, the process returns to S03.

  The above is the processing executed by the mobile terminal 10 according to the present embodiment. Note that this processing is terminated by, for example, shifting from a character input mode based on the user's line of sight to another mode by an operation on the mobile terminal 10 of the user.

  As described above, according to the present embodiment, it is determined whether or not an input character is valid based on a time-series change in the position of the line of sight. Therefore, for example, when the user presses the enter button 31 to input information, if the line of sight deviates from the information that the user intends to input, it is determined that the input information is not valid. A corresponding process (for example, suggesting correction as in the present embodiment) can be performed. Appropriate processing can be performed when an input unintended by the user is made, and thereby accurate and quick input can be easily realized.

  Further, if correction is suggested as in the present embodiment, information that is a candidate for input intended by the user can be presented when an input unintended by the user is made, and more accurate and quick. Input can be easily realized. That is, by correcting the ambiguity of line-of-sight input as in this embodiment, rapid character input is realized while preventing erroneous user input. As in the present embodiment, it is desirable to suggest corrections by presenting characters that are candidates for correction, but display output that allows the user to confirm whether or not the characters input by line of sight are appropriate It is good also as performing.

  Furthermore, as in the present embodiment, it is possible to correct already input characters, and it is possible to easily correct already input information by highlighting characters that are candidates for correction. In addition, this makes it possible to easily realize more accurate and quick input.

  In the present embodiment, the input device is the mobile terminal 10, but the application of the present invention is not necessarily limited to the mobile terminal 10. The present invention can be applied to any apparatus in which information is input by the user pointing the display on the display with a line of sight. In the present embodiment, the input information is characters, but is not necessarily limited to characters. For example, information such as numbers and alphabets may be used, and it can also be used for inputting information indicating control contents.

  DESCRIPTION OF SYMBOLS 10 ... Portable terminal, 11 ... 1st area | region display part, 12 ... Eye gaze detection part, 13 ... Operation detection part, 14 ... Input information judgment part, 15 ... Input correction part, 16 ... 2nd area | region display part, 17 ... Correction part 20 ... first housing, 21 ... display, 21a ... first region, 21b ... second region, 22 ... camera, 30 ... second housing, 31 ... decision button, 101 ... CPU, 102 ... RAM, 103 ... ROM, 104 ... operation unit, 105 ... wireless communication unit, 106 ... antenna.

Claims (7)

A display that displays information;
Input information display means for displaying a plurality of information to be input on the display;
Line-of-sight detection means for detecting the position of the line of sight of the user in the area where the plurality of input targets are displayed by the input information display means of the display;
Operation detecting means for detecting a predetermined operation from the user;
Input information determination means for determining information to be input based on the position of the line of sight detected by the line-of-sight detection means at a timing when a predetermined operation is detected by the operation detection means;
The input determined by the input information determination unit according to a time-series change in the position of the line of sight detected by the line-of-sight detection unit at a timing when the information input by the input information determination unit is determined. The input is determined according to a time-series change in the position of the line of sight detected by the line-of-sight detection means when it is determined whether the information is valid and the input information is not valid. Input correction means for displaying information corresponding to the time-series change, which is different from the input information determined by the information determination means, on the display as input information candidates;
An input device comprising:   2. The input device according to claim 1, wherein the input information display unit highlights information to be displayed to be displayed according to the position of the line of sight detected by the line of sight detection unit.   The input device according to claim 1, further comprising an input information display unit that displays input information on the display based on the determination by the input correction unit. Whether or not the position of the line of sight detected by the line of sight detection means at the timing when a predetermined operation is detected by the operation detection means is the position of the input information displayed by the input information display means. The input device according to claim 3, further comprising a correcting unit that determines and makes the input information correctable.   The input information display means highlights the information to be input displayed around the information to be input corresponding to the input information that has been corrected by the correction means. The input device according to claim 4. An input method using an input device including a display for displaying information,
An input information display step for displaying a plurality of information to be input on the display;
A line-of-sight detection step for detecting the position of the user's line of sight in a region where a plurality of the input targets are displayed in the input information display step of the display;
An operation detection step for detecting a predetermined operation from the user;
An input information determination step of determining information to be input based on the position of the line of sight detected in the line of sight detection step at a timing when a predetermined operation is detected in the operation detection step;
The input determined in the input information determination step according to a time-series change in the position of the line of sight detected in the line-of-sight detection step at the timing when the information input in the input information determination step is determined. It is determined whether or not the information is valid, and when the input information is determined to be invalid, the input is performed according to a time-series change in the position of the line of sight detected in the line of sight detection step. An input correction step for displaying information corresponding to the time-series change, which is different from the input information determined in the information determination step, on the display as input information candidates;
An input method that includes Based on the determination in the input correction step, an input information display step for displaying input information on the display;
Position of the line of sight a predetermined operation is detected in the visual axis detecting step with detected timing in the operation detection step, whether the position of the already input information display an entered information displayed in step A correction step for determining and making the input information correctable; and
In the input information display step, the information to be input is highlighted around the information to be input corresponding to the input information that has been corrected in the correction step.
The input method according to claim 6.

Images