JP2005196250A - Information input support device and information input support method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information input support device capable of improving operability and convenience. <P>SOLUTION: In this information input support device, a position indicated by a user is acquired as a pointer position in response to operation of a pointing device by receiving indication input by the pointing device of the user; a first candidate presenting window is displayed for presenting a candidate for information; and when selecting one of these presented candidates in relation to moving operation of the pointer position, a second candidate presenting window for presenting a candidate for information to be inputted in the next place, is adjacently displayed on the first candidate presenting window. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information input support device and an information input support method for supporting information input to a computer or the like.

  In recent years, communication using e-mail has become widespread, and a handheld device such as a PDA (Personal Digital Assistant), a mobile phone, etc., a keyboard (having at least the number of keys that can input all alphabets) Opportunities to input characters without using are increasing.

  As a method of inputting characters without using a keyboard, for example, using the numeric keypad of a cellular phone, “a”, “b”, and “c” are assigned to “1”, and the number of times of pressing is changed. There is a method of selecting one of the characters. In addition, as a so-called predictive conversion method, a character string input in the past using a dictionary that associates a character string that is an input candidate with context information that causes the character string to appear (information about a character string that has been input so far) is used. A method (for example, “POBox” (trademark)) for displaying a character string as a next input candidate based on the column is considered.

In addition, when inputting a character string with a handwritten character recognition device or the like, a method of limiting the choices of the predicted character string to be obtained without impairing the prediction accuracy of the predicted character string that follows the character string directly input in Kanji Is disclosed in Patent Document 1.
JP-A-8-255157

  However, in the above conventional character input method, for example, when inputting “at the meeting last week”, first, when “s” “e” is input, a window including a prediction result such as the character string “last week” is displayed. The When “last week” is selected here, the window including “last week” is deleted, and a window including a prediction result such as “in a meeting” is displayed.

  Since there is no continuity in the arrangement of the windows to be selected in this way, even if each word is enumerated by prediction for a character string consisting of n words, the button operation for the selection operation or the pen The tap operation must be performed n times, and the operability is low.

  Further, when there is an error in the selected word, it is necessary to perform an operation of deleting a part of the input word and to repeat the input operation of the part, which is not convenient.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an information input support device that can improve operability and convenience.

  The present invention for solving the problems of the above-described conventional example is an information input support apparatus that supports information input using a pointing device, and is an operation means for receiving a user's instruction input, which is presented information An operation means capable of accepting an instruction input for selecting at least one of the information processing apparatus, a first candidate for acquiring a position indicated by a user as a pointer position in accordance with the instruction input received by the operation means and presenting a candidate for information Displaying a presentation window, and when one of the presented candidates is selected in connection with the movement operation of the pointer position, a second candidate presentation window for presenting a candidate for information to be input next is displayed in the second candidate presentation window. Display control means for displaying adjacent to one candidate presentation window.

  Since the candidate presentation windows are displayed adjacently in this way, the selection operation of the pointing device can be made an operation of passing the pointer while maintaining the selection operation, for example, for a character string consisting of n words, When each word is enumerated by prediction, a character string is input one after another by simply sliding with the pen pressed, and operability can be improved. If there is an error in the selected word, the same effect as the deletion operation can be realized by returning the pen to the original window, and convenience can be improved.

  Here, the first and second candidate presentation windows are adjacent to the sequence display area for displaying the presented candidates in sequence, and at least one instruction input area for instruction input in a part of the sequence display area. When the second candidate presentation window is displayed, the display control means connects the current pointer position and the apex of the array display area in the second candidate presentation window. The display position of the second candidate presentation window may be controlled so that at least one of the instruction input areas in the first and second candidate presentation windows is not included in the polygon area formed in step (b).

  The first and second candidate presentation windows are arranged adjacent to the array display area for displaying the presented candidates, and at least one instruction input area for instruction input in a part thereof. The operation means may include an instruction input related to the instruction input area when the pointer position is within the instruction input area for a predetermined time or more.

  An information input support method according to an aspect of the present invention is an information input support method for supporting information input to a computer using a pointing device, and a pointer pointed to by a user according to an operation of the pointing device A first candidate presentation window that presents candidates for information to be acquired and input is displayed, and when one of the presented candidates is selected in connection with the movement operation of the pointer position, the next input is performed. A second candidate presentation window for presenting information candidates to be displayed is displayed adjacent to the first candidate presentation window.

  Embodiments of the present invention will be described with reference to the drawings. As shown in FIG. 1, the information input support device according to the present embodiment includes an operation unit 11, a control unit 12, a storage unit 13, and a display unit 14. The operation unit 11 is a pointing device such as a pen input device, and is mounted as a transparent touch panel overlaid on the display unit 14. The operation unit 11 accepts an instruction input by a user's pen operation performed on the touch panel and outputs it to the control unit 12. The operation unit 11 is not limited to this and may be a mouse or the like.

  The control unit 12 operates in accordance with a program stored in the storage unit 13 and performs processing according to the content of the instruction input input from the operation unit 11. Further, in the present embodiment, the control unit 12 acquires a position where the pen touches the touch panel as a pointer position, displays a window for presenting information candidates to be input, and performs a process for supporting information input. In the present embodiment, a process for supporting character string input will be described as an example. This process (information input support process) will be described in detail later.

  The storage unit 13 stores a program executed by the control unit 12. Further, as shown in FIG. 2, the storage unit 13 stores character strings (words) as input candidates and context information listing other words appearing before the word as dictionary data in association with each other. doing. Specifically, FIG. 2 shows an example in which “once” is associated as a word preceding the word “upon”.

  The display unit 14 is, for example, a liquid crystal display, and an operation unit 11 that is a transparent touch panel is overlaid thereon. The display unit 14 displays information according to instructions input from the control unit 12.

  Here, the specific content of the information input assistance process in the control part 12 is demonstrated. The control unit 12 acquires a position where the pen is pressed on the operation unit 11 as a pointer position, and performs predetermined processing based on the information on the pointer position.

  For example, it is assumed that the user operates a pen as the operation unit 11 and inputs a part of a character string. This input method can use a known technique related to handwritten character recognition. Here, for example, it is assumed that “on” of “once” is input. As each character is sequentially input, the control unit 12 searches the dictionary data stored in the storage unit 13 for a character string candidate that matches forward with the input character part, and obtains it as a result of the search. When the number of candidates to be obtained is equal to or less than the predetermined number, a candidate presentation window including the candidate list is displayed on the display unit 14.

  Here, the number of character string candidates starting with “o” is not displayed because it is larger than the predetermined number, and when “on” is entered, the number of character string candidates is smaller than the predetermined number, and “on” ”,“ Onboard ”,“ once ”,“ one ”...

  Here, as shown in FIG. 3, the candidate display window displayed on the display unit 14 includes an array display area (A) for displaying a candidate list, operation buttons and scroll bars (B) for page movement, and the number of pages. Are displayed in the form of “current page / total number of pages” and a “function” button for instruction input set in a part of the area adjacent to the array display area (A). Region (D). Here, the array display area (A) is divided into pages so that it can be scrolled and displayed when the list of all candidates cannot be displayed in this area, and a downward arrow in FIG. When selected, it moves to the next page and displays a candidate list for the next page, and when an upward arrow is selected, it moves to the previous page and displays the candidate list for the previous page.

  Assuming that the user inputs “once upon a time”, the candidate display window is displayed when the user inputs characters to “on”, and the “once” portion is selected from the candidate list. In this case, an operation of pressing the pen against the portion (usually corresponding to an operation of selecting a button or an element at the pressed position is referred to as a selection operation hereinafter).

  Then, the control unit 12 acquires the selected candidate, and searches the dictionary data stored in the storage unit 13 for a word in which the acquired candidate word is associated as context information. Here, since the word “once” is selected, a list of words including this in the context information is provided. In this example, as shown in FIG. 2, since the word “once” is associated with the word “upon” as context information, a list including the word “upon” is provided as another candidate presentation window. What is characteristic in the present embodiment is that a candidate presentation window including “once” (referred to as a first candidate presentation window) and a candidate presentation window including “upon” to be input subsequently (second candidate) (Referred to as a presentation window) is displayed adjacently on the display unit 14 (FIG. 4).

Therefore, as shown in FIG. 4, the user keeps the selection operation (the operation of pressing the pen) of the word “once” on the first candidate presentation window while maintaining the second candidate presentation window. By sliding the pen to the word "upon",
The word string “upon” can be entered.

When the pen is moved while the selection operation is maintained up to the word “upon”, the control unit 12 assumes that the word “upon” has been selected, and this “upon” (or “ once
A process of providing a list of words including a series of word strings up to “upon” in the context information is performed. For example, the word “a” is associated with the context information of the word string “once upon” and registered in the dictionary data.
If the word “time” is associated with the context information “upon a” and registered in the dictionary data, the user keeps pressing the pen on the operation unit 11 overlaid on the display unit 14 (maintaining the selection operation). Just slide the pen to pass over each word in the candidate presentation window that appears one after another.
The word group “upon a time” is input.

  The control unit 12 stores the display order of each candidate presentation window. When the user operates the pen to move the pen from the second candidate presentation window to the first candidate presentation window, that is, after the pointer position enters the display area of the second candidate presentation window, the first When the pointer position returns to the candidate presentation window displayed in the past or the candidate presentation window presented immediately before, such as being recognized as having entered the display area of the candidate presentation window, the control unit 12 selects the input word group. You may return to the input state in the candidate presentation window displayed in the past or immediately before.

For example, when the user mistakes “upon” and selects the word “in” displayed on the second candidate presentation window, “a” is displayed on the candidate presentation window that is displayed without being noticed. A case is assumed where it is found that “upon” and “in” are mistaken for the first time when it is selected and it is found that there is no “time” on the next candidate presentation window. At this time, the input word group is “once
In a ”, when the user moves the pen and returns the pen to the area of the second candidate presentation window, the input state of this word group returns to“ once ”.

  At this time, the control unit 12 may remove the candidate presentation window displayed after the candidate presentation window displayed in the past or immediately before from being displayed on the display unit 14. When the user returns the pen to the second candidate presentation window, the user can select the correct word “upon” and continue the subsequent input.

  In addition, when the pointer position is moved to the area (D) of the “function” button on the candidate presentation window, the control unit 12 displays a menu for font designation or the like (FIG. 5). When the user traces this menu (hierarchical menu) and makes a specification regarding the font of the input word string, such as font → style → bold, etc., the control unit 12 performs the menu selection for the font designation. The font of the word string input in is set to the font specified by the menu selection.

  For example, when the user releases the pen from the operation unit 11, the control unit 12 assumes that the input content is confirmed, and the application program that is activated at that time, for example, the word string input by the previous operation To the execution process (for example, the execution process of the notepad application).

  In addition, when a word is selected from a certain candidate presentation window (first candidate presentation window) and the next candidate presentation window (second candidate presentation window) is displayed, the control unit 12 displays the current (at the time of the selection). The instruction input area (D) of the candidate presentation window displayed so far in the polygonal area (shaded area in FIG. 6) formed by connecting the pointer position and the apex of the array display area (A) in the second candidate presentation window. The display position of the second candidate presentation window may be adjusted so that it is not included. For example, as shown in FIG. 7A, when the first candidate presentation window and the second candidate presentation window are displayed, in order to move from the pointer position P to the candidate Q of the second candidate presentation window, It is natural to pass through the instruction input area (D) of the one candidate presentation window, but at that time, the menu is displayed on this area (D).

  Therefore, as shown in FIG. 7B, the position of the second candidate presentation window is controlled and displayed so that the pointer position can be moved from the pointer position P to any candidate in the second candidate presentation window. When the instruction input area (D) does not naturally pass through and the pointer position is moved over the instruction input area, it can be determined that the user is operating intentionally.

  Further, when the pointer position is in the instruction input area (D) for a predetermined time or more, the menu display may be performed on the assumption that the instruction input related to the instruction input area is accepted.

  Furthermore, the candidate presentation window is sequentially displayed on the right next to the immediately preceding candidate presentation window, and when the right displayable width is less than or equal to the predetermined value, it is folded back to the left and sequentially displayed on the left. It may be. As a result, when inputting a long word string, the pen can be input while moving in a zigzag manner.

  In this example, the candidate presentation window is rectangular. However, as shown in FIG. 8, the candidate presentation window may be developed in a circle. In this case, a button (B) for scroll instruction and an instruction input area (D) may be included in the array display area (A).

  Furthermore, the list displayed in the array display area may be in the order of frequency selected in the past. At this time, the highest frequency candidate may be displayed at a position adjacent to the current pointer position, and then the candidates may be displayed in the order of adjacent as shown in FIG. In FIG. 9, the second candidate is displayed on the lower side of the highest frequency candidate, but instead, it may be displayed on the upper side.

  Moreover, you may display separately the window which displays the present input state on the display part 14 (FIG. 10).

[Processing specific to Japanese]
In Japanese, a candidate is generally displayed by inputting a reading and selected from the candidates. Accordingly, the dictionary data is obtained by associating reading data, words, and context information. For example, the word “last week” is associated with the reading of “senshu”.

  Furthermore, in Japanese, for example, a specific part of speech or a word (such as a particle) following a specific word may be defined. For example, since the word “last week” is a noun, “NO”, “GA”, “HA”, “MO”, and the like can be considered as particles following the noun. Therefore, the context information may include a condition related to the part of speech of the immediately preceding word.

  As a result, when "se" is entered, words such as "Last week", "Line", "Set", "World" are displayed as candidates, and when "Last week" is selected, "No" Candidates such as “End”, etc. are presented. Further, immediately after the particle, a part of speech word other than the particle that is input immediately before may be used as the context information. That is, when “last week” or “no” is selected, a word including “last week” as context information is presented.

[Modification of menu contents in the instruction input area]
In the description so far, the menu displayed when the instruction input area is selected is related to the input word string, such as a font. However, the menu is output from the application program to which the word string is output. The contents (menu item name) included in the menu and the pointer indicating the storage location of the program to be executed when the menu is selected (the pointer here is a pointer indicating the position in the memory. Therefore, the control unit 12 may include the received menu item in the menu and present it.

  For example, if it is a memo pad application, it accepts the information of the memory pointer to the execution routine of the search command, displays the menu item name of “search”, and is presented last after the user inputs a word group When the pointer position is moved to the instruction input area in the candidate presentation window, a menu including “search” is presented.

  When the user selects the “search” menu, the process jumps to the destination indicated by the memory pointer associated with the element and starts searching for the input word group.

It is a block diagram of the configuration of the information input support device according to the embodiment of the present invention. It is explanatory drawing showing the example of dictionary data. It is explanatory drawing showing an example of a candidate presentation window. It is explanatory drawing showing the state of input operation. It is explanatory drawing showing the example of the menu displayed on an instruction | indication input area. It is explanatory drawing showing the example which controls the display position of the next candidate presentation window. It is explanatory drawing showing the example which controlled the display position of the next candidate presentation window. It is explanatory drawing showing another aspect of a candidate presentation window. It is explanatory drawing showing the example of the display order of the candidate in a candidate presentation window. It is explanatory drawing showing the example which displays an input state.

Explanation of symbols

  11 operation unit, 12 control unit, 13 storage unit, 14 display unit.

Claims (4)

An information input support device that supports information input using a pointing device,
An operation means for accepting an instruction input by a user, the operation means capable of accepting an instruction input for selecting at least one of the presented information;
The position indicated by the user according to the instruction input received by the operation means is acquired as a pointer position, a first candidate presentation window for presenting information candidates is displayed, and one of the presented candidates is the pointer position Display control means for displaying, next to the first candidate presentation window, a second candidate presentation window that presents candidates for information to be input next when selected in connection with the movement operation of
An information input support device comprising: The information input support device according to claim 1,
The first and second candidate presentation windows include an array display area for displaying the presented candidates in sequence, and at least one instruction input area for instruction input in a part of the array display area. When the second candidate presentation window is displayed, the display control means can connect the current pointer position and the vertex of the array display area in the second candidate presentation window. An information input support apparatus, wherein a display position of the second candidate presentation window is controlled so that at least one of the instruction input areas in the first and second candidate presentation windows is not included in the square area. The information input support device according to claim 1 or 2,
The first and second candidate presentation windows include an array display area for displaying the presented candidates in sequence, and at least one instruction input area for instruction input in a part of the array display area. Including the adjacent area
The information input support apparatus according to claim 1, wherein when the pointer is within the instruction input area for a predetermined time or more, the operation means accepts an instruction input related to the instruction input area. An information input support method for supporting information input to a computer using a pointing device,
A position indicated by a user according to an operation of the pointing device is acquired as a pointer position, and a first candidate presentation window for presenting a candidate for input information is displayed, and one of the presented candidates is the pointer position An information input support method for displaying a second candidate presentation window that presents a candidate for information to be input next when adjacent to the first candidate presentation window when selected in connection with the moving operation.

Images