JP2009277221A - Character input device, character input method, and character input program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a character input device, a character input method and a character input program which can be used by an operator intuitively even while effectively using a limited space. <P>SOLUTION: The character input device is provided with a selection element generating means for generating a selection element 701 obtained by associating an area R 701 with a character C 701, and a hierarchy element 601 being a selection element associated with a selection element included in a hierarchical structure, and a selection element managing means for managing selection elements by the hierarchical structure 500, adjusting an area so that a representative selection element 701 can be immediately selected when a selected selection element is the hierarchy element 601, and making a drawing means draw a selection element constituting a hierarchy associated with the hierarchical element, and when the selected selection element is not the hierarchy element, deciding a character associated with the selection element as an input character. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a character input device, a character input method, and a character input program for inputting characters by selecting a region by operating an input device such as a pointing device.

  In a conventional character input device, character input method, or character input program that inputs characters by operating an input device such as a pointing device, the area is arranged on the screen like a software keyboard, and the operator points to the area. There are two types: one that uses a device to input characters, and one that uses donut-shaped regions as a guide, such as a pie menu, to determine input characters based on stroke information entered by the operator. Kinds are widely known.

  In the case of a software keyboard, it is common to arrange the areas so that the key arrangement is the same as the keyboard arrangement of the keyboard device, but it has been widely recognized that it is never easy for operators to use. That is. In 1994, T-Cube (Non-Patent Document 1) was proposed, but this system succeeds in reducing the number of options prepared on the screen for input. In one embodiment of T-Cube, a pie menu divided into eight is assigned to each of the nine areas displayed on the screen, and one of the nine areas is operated by a pointing device operation. After the stroke operation is started from, the pie menu assigned to that area is displayed. Since nine pie menus divided into eight are available, 72 types of characters that can be input in one stroke are prepared.

  Also, a keyboard using a numeric keypad keyboard (Non-Patent Document 2) generally used in mobile phones has been proposed, and one of the embodiments is a software keyboard using a numeric keypad layout. Is disclosed. Although the pie menu is not displayed in the system, the input character is determined by the start position and direction of the stroke started from one of the areas arranged in the numeric keypad, and the T-Cube method has been developed. It has become. The difference from T-Cube is that another input character is determined when a tap operation is performed as well as a stroke operation. For example, the character “V” is assigned to the input character when the stroke is started from the area representing “1” of the numeric keypad and the stroke is continued diagonally downward to the right, and in the area representing “1” of the numeric keypad. The character “A” is assigned to the input character when the tap operation is performed.

Dan Venolia, Forrest Neiberg, T-Cube: a fast, self-disclosing pen-based alphabet, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.265-270, April 24-28, 1994. Saied B. Nesbat, `` A system for fast, full-text entry for small electronic devices, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003.

  The conventional general software keyboard has a problem that it has too many options and is difficult to use. Moreover, in T-Cube (Non-Patent Document 1), which is a system with few options displayed on the screen, although feedback is returned by displaying the pie menu, the central area of the pie menu is not effectively used. There was a problem that all options were handled in the same line. Although the tap operation is used in addition to the stroke operation in the system of Non-Patent Document 2, since the input operation by the stroke operation and the input by the tap operation are combined, the input character confirmation operation is performed by the operator. There was a problem that it was not intuitive. In addition, in such a system in which an input character is determined based on the stroke operation locus, there is a problem that it is difficult to perform a cancel operation after the stroke is started.

  In view of the conventional problems as described above, the present invention manages the choices displayed on the screen by a hierarchical structure while performing an intuitive operation by selecting a region, and controls the number of displayed regions. It is an object of the present invention to provide a character input device, a character input method, and a character input program for making it easier for an operator to input characters by reducing the number.

  Another object of the present invention is to provide a character input device, a character input method, and a character input program that can assist an operator's understanding by clarifying options that represent each layer in a hierarchical structure. There is to do.

  Another object of the present invention is that when an operator selects an option associated with a hierarchy rather than a character, an option representative of the newly displayed option hierarchy can be immediately selected. Thus, a character input device, a character input method, and a character input program that allow an operator to perform an input operation intuitively while the options representing the hierarchy are treated specially while being treated in the same row as the other options Is to provide.

  Another object of the present invention is to provide a character input device, a character input method, and a character input program that allow an operator to cancel a character input operation in the middle of a selection operation.

  According to the present invention, in a character input device including an input device including a pointing device and a display device, the character input device includes a region setting means for setting a region on a screen of the display device, and coordinates obtained from the input device. Detection means for detecting the confirmation operation, area determination means for determining whether coordinates are included in the area, selection element generation means for generating a selection element in which the area and the character are associated, and the selection element A selection element management unit that manages the hierarchical structure; and a drawing unit that causes the display device to perform drawing of the area and drawing of the character, and the selection element generation unit includes the selection included in the hierarchy in the hierarchical structure A selection element associated with an element is generated as a hierarchical element, and the selection element management means includes one or more selection elements The selection means management means determines the coordinates detected by the detection means and the area associated with the selection element by the area determination means when the detection means detects a confirmation operation. When the result of performing is true and the selected element is the hierarchical element, the selected element constituting the hierarchy associated with the hierarchical element is drawn by the drawing means, and the selected element managing means When the detection means detects a confirming operation, the result of the determination by the area determination means for the coordinates detected by the detection means and the area associated with the selection element is true, and the selection element Is not the hierarchical element, the character associated with the selected element is confirmed as an input character. There is provided.

  In the character input device as described above, the display on the screen changes based on the coordinate information obtained from the pointing device, and feedback is returned to the operator. At this time, the selection element that is an option displayed on the screen depends on the hierarchical structure. Since it is managed, it is possible to reduce the number of options displayed simultaneously on the screen. The confirmation operation detected by the detection means is when the pointing device button is pressed, released, or clicked, and it is selected which of these operations is used as the confirmation operation. Managed by element management means. In the case of a pen device, it corresponds to when the pen is touched or separated, or when a tap operation is performed. In the case of a touch panel, it corresponds to when a finger touches or leaves, or when a tap operation is performed. In this case, each of the operation of pressing the button and the operation of releasing the button in one click operation is detected as a confirmation operation, and when the operator performs one click operation, two confirmation operations are detected. It is also possible to set so that one click operation is detected as one confirmation operation. Similarly for the tap operation, whether to detect when the pen or finger touches or separates as a separate confirmation operation, or whether to detect a combination of touching and leaving as a confirmation operation. Either can be set. In addition, it is possible to detect a single drag operation or slide operation as two finalize operations by setting that it is detected that a finalize operation has been performed at each of the start and end points in the drag operation or slide operation. Can also be set.

  The selection element generation means may further associate a representative selection element, which is a representative of the associated hierarchy, with the hierarchy element when generating the hierarchy element.

  In this case, when a hierarchical element is displayed, it becomes possible to present to the operator a character representing a new option that will be displayed by selecting the hierarchical element before selecting the hierarchical element. It becomes possible to help the operator understand the options displayed next when selected.

  The selection element management means detects the area associated with the representative selection element in the hierarchy and the detection means when the selection means constituting the hierarchy associated with the hierarchy element is drawn by the drawing means. The region of the representative selection element may be adjusted so that the determination by the region determination unit for the coordinate is true.

  In this case, the area of the representative selection element among the new options to be displayed by the selection of the hierarchy element is already adjusted to a position or shape where the determination by the area determination unit is true when displayed. The operator can immediately perform the confirming operation, and can provide an environment in which the operator can easily input characters that are representative of options. In addition, the selection element management means adjusts the shape of the representative selection element when the selection element generation means generates the representative selection element in an area of the same size as other selection elements. It can also be replaced by generating as a selection element associated with an area such that an area to be selected immediately after being displayed is added.

  In addition, the selection element management means, when the detection means detects a definite operation, a result of determination by the area determination means for the coordinates detected by the detection means and the area associated with the selection element If there is no selection element such that is true, a cancel process may be executed.

  In this case, the operator cancels the input operation at any stage during the operation by performing a confirming operation at a position on the screen where the pointing device does not point to the coordinates in the area of any selected element. Is possible.

  Further, according to the present invention, in a character input method in a character input device including an input device including a pointing device and a display device, the character input method includes a region setting step of setting a region on a screen of the display device, A detection step for detecting coordinates obtained from the input device and a determination operation; a region determination step for determining whether the coordinates are included in the region; and a selection element generation step for generating a selection element associated with the region and the character A selection element management step for managing the selection element in a hierarchical structure; and a drawing step for causing the display device to perform drawing of the area and drawing of the character, and the selection element generation step includes: Generate a selection element associated with the selection element included in the hierarchy to generate a hierarchy. The selection element management step includes a step of drawing one or more selection elements by a drawing step, and the selection element management step includes the step of: If the result of the determination in the region determination step is true for the coordinates detected in the detection step and the region associated with the selection element, and the selection element is the hierarchy element, The step of drawing the selection elements constituting the associated hierarchy by the drawing step, wherein the selection element management step detects the coordinates detected by the detection step and the selection when the detection step detects a confirmation operation. The region associated with the element is determined by the region determination step. Fruit is true, the selection element is Not found the hierarchical elements, a character input method which comprises a step of determining the character associated with the selected element as an input character is provided.

  The selection element generation step may include a step of further associating a representative selection element, which is a representative of the associated hierarchy, with the hierarchy element when generating the hierarchy element.

  In the selection element management step, when the selection element constituting the hierarchy associated with the hierarchy element is drawn by the drawing step, the detection of the region associated with the representative selection element of the hierarchy and the detection step is performed. The step of adjusting the region of the representative selection element may be included so that the determination by the region determination step for the coordinate is true.

  In addition, when the detection step detects a definite operation, the selection element management step is a result of the determination in the area determination step regarding the coordinates detected by the detection step and the area associated with the selection element. If there is no selection element such that is true, a step of executing a cancellation process may be included.

  According to the present invention, there is provided a character input program for causing a computer to function as the character input device according to any one of claims 1 to 4.

  According to the present invention, there is provided a character input program for causing a computer to execute the character input method according to any one of claims 5 to 8.

  According to the first or fifth aspect of the present invention, the options displayed on the screen are managed by a hierarchical structure and the number of displayed areas is reduced while the operation is intuitive by selecting the areas. Thus, a character input device or a character input method for facilitating an operator to input characters is provided.

  According to the invention described in claim 2 or 6, there is provided a character input device or a character input method capable of assisting an operator's understanding by clarifying options representing each hierarchy in the hierarchical structure. .

  According to the invention described in claim 3 or 7, when the operator selects an option associated with a hierarchy rather than a character, the option representative of the newly displayed option hierarchy is immediately selectable. This provides a character input device or a character input method that allows operators to perform input operations intuitively, while the options that represent the hierarchy are treated specially while being treated in the same row as the other options. Is done.

  According to invention of Claim 4 or 8, the character input device or the character input method with which an operator can cancel character input operation in the middle of selection operation is provided.

  According to the invention described in claim 9, the computer functions as the character input device described above.

  According to the invention described in claim 10, the character input method described above is executed by a computer.

The block diagram which shows the structure of a character input device. The figure which shows an example of the hierarchical structure by a selection element and a hierarchy element. The figure which shows an example of a selection element. The figure which shows an example of a representative selection element. The figure which shows an example of the state by which the selection element was drawn on the screen. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element was drawn on the screen. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element was drawn on the screen. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The figure which shows an example of the state by which the selection element of the hierarchy linked | related with the hierarchy element was drawn and the representative selection element was highlighted. The flowchart which shows an example of the process after a definite operation is detected. FIG. 27 is a flowchart illustrating an example of processing that branches from the flowchart of FIG. 26 and continues. The flowchart which shows an example of the process which branches from the flowchart of FIG. 27 and continues. The flowchart which shows an example of the cancellation process which branches off from the flowchart of FIGS. 26-28, and continues.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a character input device 400 according to the present invention. The apparatus includes a computer 100 such as a personal computer, an input device 200, and a display device 300. The computer 100 may take various forms such as, for example, a desktop computer, a laptop computer, a handheld computer, a pocket computer, and an electronic notebook. In FIG. 1, the computer 100, the input device 200, and the display device 300 are separated as an example. However, as will be apparent to those skilled in the art, all or some of them may be integrated. For example, the screen 301 and the pointing device 201 may be integrated.

  The pointing device 201 included in the input device 200 can take various forms such as a mouse, a trackball, a trackpad, a touch panel, and a tablet device. As will be apparent to those skilled in the art, the pointing device 201 can be replaced by other devices, such as a keyboard or dial.

  The screen 301 included in the display device 300 can take various forms such as a CRT, LCD, and plasma display. As will be apparent to those skilled in the art, the screen 301 may take the form of a head mounted display.

  Further, the computer 100 is equipped with or executes a character input program that causes the built-in hardware such as a CPU, a memory, and an auxiliary storage device to function as various means in response to an operation input from the input device 200. Can do. Further, the computer 100 is equipped with or executes a character input program for executing various steps using hardware such as a built-in CPU, memory, auxiliary storage device or the like in response to an operation input from the input device 200. Can be. Although not shown in the figure, in addition to hardware such as a memory and an auxiliary storage device as storage means in a general computer, various external storage devices such as storage means controlled by another computer connected by a network line Or a computer readable medium may be available. Various data may be distributed and stored in a plurality of storage means.

  The detection unit 101 receives data from the input device 200. For example, when x-axis and y-axis movement data obtained by the pointing device 201 such as a mouse is received and the coordinates of the pointer displayed on the screen 301 are changed, the x-axis obtained by the pointing device 201 such as a touch panel It is used when receiving value data on the y-axis and reflecting it on the coordinates of the pointer displayed on the screen 301, and the coordinates of the pointer on the screen 301 can be provided to other means. Further, for example, information on the state of the button, pen, or finger of the pointing device 201 and a change in the state is received, and is also used to detect whether or not a confirmation operation has been performed. It is possible to set either a mode that assigns two confirmation operations to click and click or a mode that assigns two confirmation operations to a drag operation by changing the setting of which operation is a confirmation operation . For example, in the mode in which the confirm operation is assigned twice for the drag operation, the first confirm operation is performed at the pointer coordinates when the drag operation is started, and the second confirm operation is performed at the pointer coordinates when the release operation is performed. It is possible to set so that it is determined that has been performed. In addition, it is also possible to set the mode to confirm when there is no change in pointer coordinates for a certain period of time when a button is pressed or a pen or finger is touched. It is. Also, in the case of an input operation that requires three or more finalizing operations, such as when the selected element associated with the hierarchical element is another hierarchical element, it can be obtained by combining these modes. It is possible to select and set from many variations.

  The area setting unit 103 sets an area on the screen 301. For example, the rectangular area is set by specifying the upper left coordinates and lower right coordinates of the rectangle, or the upper left coordinates, width, and height of the rectangle. Also, for example, a circle area can be set by specifying the center coordinates and radius, a polygon area can be set by specifying a set of coordinate values, an area can be set by specifying a coordinate relational expression, or a combination of these An area may be set. In the case of an area usable for a pie menu, the area is generated by dividing a donut-shaped area formed by arranging circles having different sizes as concentric circles by a straight line drawn outward from the center of the circle.

  The region determination unit 102 determines whether or not the coordinates are included in the region based on the coordinate value obtained from the detection unit 101 and the property of the region set by the region setting unit 103. For example, when the region is a rectangular region, the determination can be made by comparing the x coordinate and y coordinate of the coordinate with the upper left coordinate of the rectangle and the x coordinate and y coordinate of the lower right coordinate, respectively. Also, for example, if the area has a shape that can be used as a pie menu, the pie menu is determined by comparing the distance from the coordinates of the center of the area to the coordinates to be determined and the radius of the circle that forms the area of the pie menu. In the pie menu, it is possible to determine which region is included in the pie menu based on the angle from the coordinate of the center of the region to the coordinate to be determined. In the case of a circular area including the center of the circle that is not used in the general pie menu, it is determined whether it is included by comparing the distance from the center coordinates to the coordinates to be determined and the radius of the circle can do. Similarly, in the case of a polygon region or a region specified by a relational expression, it is possible to determine whether a certain coordinate is included in the region.

  The selection element generation unit 104 generates a selection element associated with the region set by the region setting unit 103. A character is also associated with the selected element. When the hierarchy of the selected element is associated, the selected element is specially handled as a hierarchical element. A character associated with a representative selection element that represents the associated hierarchy is associated with the hierarchy element. In order to help the operator understand, it is also possible to add and associate characters of selection elements other than the representative selection element. Information for configuring these selection elements is stored in a storage unit that the computer 100 normally has, and is read out as necessary.

  The selection element management unit 105 manages the selection elements in a hierarchical structure, and can reduce the number of selection elements displayed on the screen 301 at the same time. When the detection unit 101 detects a confirmation operation, the selection element management unit 105 displays the coordinate information detected by the detection unit 101 and the selection element generated by the selection element generation unit 104 on the screen 301. It is checked whether there is a selection element for which the determination by the region determination unit 102 is true for all of the valid items. If there is such a selection element, it is checked whether or not the selection element is a hierarchical element. If it is a hierarchical element, the drawing means 106 displays the display of the selection element in the hierarchy associated with the hierarchical element. If it is not a hierarchical element, the character associated with the selected element is determined as the input character. Here, when the selected element of the hierarchy associated with the hierarchy element is displayed by the drawing unit 106, the display of the selected element displayed on the screen 301 before the hierarchy associated with the hierarchy element is displayed is as follows. It may be deleted once, or the previous hierarchy display may be left so that the operator can recognize it, and the selection element of a new hierarchy may be overwritten on it.

  In addition, the selection element management unit 105 can immediately select the representative selection element of the hierarchical element when the hierarchical element is selected as a result of the determination by the area determination unit 102 when the detection unit 101 detects the confirmation operation. Then, the position or shape of the region associated with the representative element is adjusted. Specifically, the selection element management unit 105 moves the region to a position including the coordinates obtained from the detection unit 101 when the detection unit 101 detects the confirmation operation, or has a shape including the coordinates. The area is deformed so that (The deformation of the area may be performed in advance by the selection element generation means 104.) As a result, a circular area including the center of the pie menu that has not been effectively used in the system of Non-Patent Document 1 is effective. In addition, an input operation that requires a combination of two different operations in the system of Non-Patent Document 2 is selected from options in a state where a representative selection element is selected in advance. Therefore, it is possible to provide an intuitive character input environment for the operator.

  The drawing unit 106 sends data or a signal to the display device 300 so as to draw the characters and areas used by the selected element management unit 105 and associated with the selected element on the screen 301. In drawing the selected element by the drawing means 106, it is necessary to draw a character associated with the selected element, but it is not always necessary to draw a region associated with the selected element. It is not necessary to display the area on the screen 301 because the area is mainly used for determination by the area determination means 102, but for display as a guide to the operator and operation feedback. Used for highlighting and so on. Further, not only simple areas and characters but also decorations or animation effects by graphics display such as icons may be added.

  FIG. 2 is a diagram showing a hierarchical structure 500 managed by the selected element management unit 105. Although the data is actually stored in the storage means normally provided in the computer 100 by an array or a list structure, the relationship is shown for the sake of explanation. In this figure, the information about the area associated with the selected element is omitted, and only the characters that are associated are shown. The character “A” is associated with the selection element 511. Similarly, the character “I” is associated with the selection element 512, and the character “U” is associated with the selection element 513. The selection element 510 expresses that it is a hierarchical element with a double circle. In FIG. 2, the representative selection element of the hierarchy associated with the hierarchy element 510 is the selection element 511, and the character “A” associated with the selection element 511 is also associated with the hierarchy element 510. Hierarchies are similarly associated with the hierarchy element 520 and the hierarchy element 530, but in FIG. 2, the existence is simply indicated by a dotted line. Hierarchical elements for the hierarchical element “sa” and thereafter are similarly omitted. In addition, the first hierarchy 590 in this hierarchical structure 500 represents a selection element that is initially displayed, and is shown to include hierarchy elements 510, 520, and 530.

  FIG. 3 is a diagram illustrating an example of a selection element when displayed on the screen 301. The selection element 701 is associated with a rectangular area R701, and is associated with the character C701 “A”. Information on the selection element 701 is generated by the selection element generation unit 104 as information as shown in Table 1, for example, and is managed by the selection element management unit 105. Since the selection element 701 is not a hierarchical element, in Table 1, the hierarchical element flag is false, and it is expressed by “-” that there is no information related to the hierarchical element. FIG. 3 shows an example in which a rectangle is used as a region. However, this does not mean that the region of the selected element is limited to a rectangle, and there can be regions of various shapes (see below). The same applies to the shape of the region in the other figures). As another example of the selection element, for example, a combination of frequently used characters such as “th” for alphabet input is allocated, and two characters can be input continuously at a time. There may be a selection element associated with the character. It will be apparent to those skilled in the art that an indication such as “RETURN” or “TAB” can be assigned and used as an alternative to the function key.

  FIG. 4 is a diagram illustrating an example of a hierarchical element when displayed on the screen 301. The hierarchical element 601 is associated with a rectangular region R601 and is associated with a character C601 that is “A”. The information of the hierarchy element 601 is generated by the selection element generation unit 104 as information as shown in Table 2, for example, and is managed by the selection element management unit 105. Although the same character as the character C701 of the selection element 701 which is the representative selection element is used for C601, the contents may be duplicated or may be referred to by a pointer. In FIG. 4, the characters “I”, “U”, “E”, and “O” surrounded by dotted lines indicate the characters of the selection elements 702 to 705 that are not representative selection elements among the selection elements associated with the hierarchical elements. A supplementary character S601. Hierarchical elements do not necessarily have information on supplementary characters, but if supplementary characters are displayed, they serve to help the operator understand. The auxiliary character S601 is information that helps the operator to understand more when each character is arranged so as to represent the arrangement of the selected elements when the selected element associated with the hierarchical element 601 is displayed.

  Table 3 shows an example of information for the selection element generation unit 104 to generate a selection element to be initially displayed and to be managed by the selection element management unit 105. Each selection element has its display position on the screen 301 determined by its x coordinate (X01 to X12) and y coordinate (Y01 to Y12), and is managed as information such as Table 1 and Table 2 and characters Using this information, the drawing unit 106 draws the image on the screen 301.

  FIG. 5 is a diagram illustrating an example when the selection elements are displayed side by side on the screen 301. FIG. 5 shows an example in which the selection elements are arranged in an arrangement corresponding to the numeric keypad arrangement. This means that the arrangement of the selection elements initially displayed is limited to such an arrangement. Rather, there can be various arrangements. In FIG. 5, the areas of the selection elements 601 to 612 are in contact with each other, but the areas may not be in contact with each other or may overlap. In the case of overlapping, it is possible to determine a region having an overlap by determining by the region determining unit 102 in a certain order such as the order of generation (the same applies to the examples in the other drawings below). In the following description, it is assumed that 601 to 609 and 611 are hierarchical elements among the selection elements displayed in this figure. Since no characters are associated with the selection elements 610 and 612, the selection elements 610 and 612 can be used for blank input or input cancellation. Also, the arrangement of the area as shown in FIG. 5 is made to correspond to a numeric keypad arrangement generally used in a cellular phone, and the detection means 101 detects a change in the state of whether or not the numeric key has been pressed. Thus, the area determination unit 102 can make a determination on the selection elements 601 to 612. The detection means 101 detects the operation before and after the dial operation and the operation to be pushed, and the area determination means 102 places the selection elements 601 to 612 in the order from 601 to 612, for example, and the determination result is changed according to the operation before and after the dial operation. It is also possible to substitute the operation such that the dial is pushed and the operation that the dial is pushed in is detected as the confirmation operation when the detection means 101 detects it.

  FIG. 6 shows that the drawing unit 106 performs drawing by the selection element management unit 105 when the detection unit 101 detects a determination operation when the pointer coordinate is in the selection element 601 that is a hierarchical element in the state of FIG. It is an example of the display on the screen 301 after a short time. The character associated with the selection element 701 is “A” and the character associated with the selection element 601 in FIG. 5 is the same as “A”, but the relationship between the selection element 701 and the selection element 601 is 511 in FIG. And 510 are the same, and are selection elements in different layers. Here, since the area associated with the selection element 701 is an area including the area associated with the selection element 601, the representative selection element can be selected immediately after the confirmation operation performed in the state of FIG. It has become. In FIG. 6, a highlight display for feeding back to the operator that selection is possible is indicated by the selection element 701 being colored. When the pointer coordinates are moved to a position included in the selection element 702 by a pointing device operation from this state, the selection element 702 is highlighted. The highlighted display of the selection element 701 is canceled when the pointer coordinates are not included in the area of the selection element 701. The representative selection element can be input immediately, but also has an aspect as a selectable option in the same row as other selection elements. In FIG. 6, the characters of the selection elements 603 to 609 and the selection element 611 are thin to distinguish the selection element associated with the hierarchical element 601 from the selection elements other than the selection element. This means that the selected element is not valid (the same applies to the examples in the other figures below). When the confirming operation is detected by the detecting means 101 when the pointer coordinates are on any area of the selection elements 701 to 705, the input character is confirmed, and the pointer is also located on any area of the selection elements 701 to 705. When a determination operation is detected by the detecting means 101 when there is no coordinate, the input is canceled (the same applies to the examples in the other drawings below).

  2, 5, 6, Table 1, Table 2, and Table 3 express the relationship between the selection elements in different ways. Of the selection elements 590 that are initially displayed, the hierarchy element 510 is the same as the hierarchy element 601 and is displayed at the coordinates (X01, Y01) on the screen 301. The representative selection element 511 of the hierarchy associated with the hierarchy element 510 is the same as the selection element 701. Similarly, the hierarchy element 520 and the hierarchy element 602, and the hierarchy element 530 and the hierarchy element 603 are the same, and are displayed at the coordinates (X02, Y02) and the coordinates (X03, Y03), respectively. The selection elements 512 to 515 are the same as the selection elements 702 to 705, respectively.

  FIG. 7 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a determination operation is detected by the detection means 101 when the pointer coordinates are in the selection element 602 in the state of FIG. It is an example of a display on 301. It is possible to set selection elements having muddy character such as the selection elements 716 to 720 to be included in the same hierarchy, but it is not always necessary to include the selection elements, and the selection element 610 or the selection element 612 has a function of converting muddy sound. There may be a selection element with (same for semi-sounds for characters with semi-sounds).

  FIG. 8 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 608 in the state of FIG. It is an example of a display on 301.

  FIG. 9 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 609 in the state of FIG. It is an example of a display on 301. When there are three selection elements associated with the hierarchical element, either the arrangement shown in FIG. 8 or the arrangement shown in FIG. 9 is possible.

  FIG. 10 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 601 in the state of FIG. It is an example of a display on 301. The pie menu is displayed with the pointer coordinates detected by the detecting means 101 as the center, but the difference from the conventional pie menu is that the area of the representative selection element is expanded to an area including the center. Since the area including the center is assigned to the representative selection element 741, it is indicated by highlighting that the representative selection element “A” is selected immediately after the pie menu is displayed. If the operator performs a confirming operation in this state, “A” is confirmed as the input character. However, if the operator performs the confirming operation after moving the pointer coordinates to the selection element 742, “I” is the input character. As confirmed. In FIG. 10, since no character is assigned to the selection elements 746 to 748, these can be used for blank input or input cancellation. In addition, when the confirming operation is detected by the detecting unit 101 after the pointer coordinates are moved outside the pie menu, the input is canceled. As described above, since the pointer coordinates when the confirming operation is detected by the detecting unit 101 are important, no matter how the pointer coordinates move before the confirming operation is detected, the highlight display only changes accordingly. Thus, it does not affect the input characters that are finally determined. For this reason, the operator can confirm the input character before the input character is confirmed, which is an intuitive operation for the operator as compared with the operation of the system for confirming the input character by the stroke operation locus.

  FIG. 11 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a determination operation is detected by the detection means 101 when the pointer coordinates are in the selection element 601 in the state of FIG. Only the pie menu is extracted from an example of the display on 301. FIG. 10 shows that it is possible to generate a selection element corresponding to the selection elements 746 to 748 displayed.

  FIG. 12 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 601 in the state of FIG. Only the pie menu is extracted from an example of the display on 301. The position of the representative selection element 761 is different from the position of the representative selection element 741 in FIG. 10, indicating that the position of the representative selection element may be another position. When a right-handed operator operates the pen device with the right hand, the pie menu of FIG. 12 is easier to use than the pie menu of FIG.

  FIG. 13 is an example of the arrangement of hierarchical elements for realizing the selection of main keys in a general keyboard layout within the area arranged in the numeric keypad format according to the present invention. FIG. 14 shows a state after the hierarchical element 613 is selected, FIG. 15 shows a state after the hierarchical element 616 is selected, and FIG. 16 shows a state after the hierarchical element 617 is selected. FIG. 17 shows the state after 618 is selected, and FIG. 18 shows the state after the hierarchical element 623 is selected.

  FIG. 14 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 613 in the state of FIG. It is an example of a display on 301. This shows that the representative selection element 801 is highlighted.

  FIG. 15 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a determination operation is detected by the detection means 101 when the pointer coordinates are in the selection element 616 in the state of FIG. It is an example of a display on 301. This shows that the representative selection element 816 is highlighted.

  FIG. 16 shows the screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 617 in the state of FIG. It is an example of a display on 301. This shows that the representative selection element 829 is highlighted.

  FIG. 17 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 618 in the state of FIG. It is an example of a display on 301. The representative selection element 842 is highlighted.

  FIG. 18 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a determination operation is detected by the detection means 101 when the pointer coordinates are in the selection element 623 in the state of FIG. It is an example of a display on 301. This shows that the representative selection element 859 is highlighted. FIG. 18 shows a group of selection elements in which characters indicating functions are displayed instead of options for inputting the characters assigned to the selection elements. Selection element 852 is a tab key, selection element 855 is a control key, selection element 856 is an ALT key, selection element 857 is a delete key, selection element 858 is a shift key, selection element 859 is a space key, selection element 860 is a return key, etc. Assigned. Blank selection elements such as 849 to 851 leave room for assigning characters meaning other functions.

  The state after the hierarchical elements 619 to 621 in FIG. 13 are selected is the same arrangement as in FIGS. 15 to 17, and lower case alphabets are arranged, and each selected element is compared with FIGS. 15 to 17. And the state displayed in the area one line below. In the state of FIG. 13, there are still four places to arrange the hierarchical elements. Therefore, in the state where more than 48 characters can be added, when two finalizing operations are assigned to the stroke operation called the drag operation, 14 to 17 can be input with one stroke, one click, or one tap, and the function keys in FIG. 18 can also be used with one stroke, one click, or one tap. However, one click or one tap in this case is an operation when the operator quickly operates a stroke operation having a length of almost zero.

  FIG. 19 is an example of an arrangement of hierarchical elements for inputting alphanumeric characters, four arithmetic operation symbols, and characters meaning functions. The state after the hierarchical element 625 is selected is shown in FIG. 20, the state after the hierarchical element 627 is selected is shown in FIG. 21, the state after the hierarchical element 628 is selected is shown in FIG. FIG. 23 shows a state after 633 is selected. The state after the hierarchical element 635 is selected is the same as in FIG.

  FIG. 20 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 625 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 901 is highlighted. These selection elements are adjusted by the selection element management unit 105 to a position where the lower part of the selection element 903 in the area of the selection element 901 overlaps the hierarchical element 625 and drawn on the screen 301 by the drawing unit 106. Is done.

  FIG. 21 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 627 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 911 is highlighted. These selection elements are adjusted by the selection element management unit 105 to a position where the lower part of the selection element 913 in the area of the selection element 911 overlaps the hierarchical element 627 and drawn on the screen 301 by the drawing unit 106. Is done.

  FIG. 22 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 628 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 921 is highlighted. These selection elements are adjusted by the selection element management unit 105 to a position where the lower part of the selection element 923 in the area of the selection element 921 overlaps the hierarchical element 628 and drawn on the screen 301 by the drawing unit 106. Is done.

  FIG. 23 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 633 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 931 is highlighted. These selection elements are adjusted by the selection element management unit 105 to a position where the lower part of the selection element 933 in the area of the selection element 931 overlaps the hierarchical element 633, and drawn on the screen 301 by the drawing unit 106. Is done.

  FIG. 24 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when a determination operation is detected by the detection means 101 when the pointer coordinates are in the selection element 627 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 943 is highlighted. These selection elements are adjusted by the selection element management means 105 to a position where the right side of the selection element 941 in the area of the selection element 943 overlaps the hierarchical element 627, and drawn on the screen 301 by the drawing means 106. The FIGS. 24 and 21 are display examples in which selection elements associated with the same hierarchical element are arranged in different arrangements, and indicate that the area associated with the representative selection element is not limited to a horizontally long area.

  FIG. 25 shows a screen after the drawing means 106 has drawn by the selection element management means 105 when the confirmation operation is detected by the detection means 101 when the pointer coordinates are in the selection element 627 in the state of FIG. In this example, only selected elements associated with hierarchical elements are extracted from the display example on 301. This shows that the representative selection element 952 is highlighted. These selection elements are adjusted to a position where the selection element 956 overlaps the hierarchical element 627 by the selection element management unit 105, and are drawn on the screen 301 by the drawing unit 106. The selection element 956 is colored to indicate a highlight display. When the selection element 956 is selected, the selection area 952 is also selected at the same time. 25, 24, and 21 are display examples in which selection elements associated with the same hierarchical element are arranged in different arrangements, and an area for selecting a representative selection element immediately after display is prepared by another selection element. It shows that this is possible. Alternatively, since the area of the selection element is not limited to a rectangle, it can be set that the area such as the area 952 and the area 956 can be associated with the representative selection element.

  FIG. 26 is a flowchart illustrating an example of processing after the confirmation operation is detected. This program is started in step F01 when the confirming operation is detected by the detecting means 101. First, in step F02, it is determined whether the confirmation operation is within the region associated with the valid selection element. If it is determined that the confirmation operation is not within the valid selection element, the cancel process of FIG. 29 is executed. Is done. If it is determined in step F02 that the confirming operation is within the region associated with the effective selection element, it is determined whether or not the selection element is stored in step F03. When the selected element is stored, since the confirmation operation has already been detected in the selected element that has been effective at least once and the cancel process has not yet been executed, the process of FIG. 27 is executed.

  As a result of determining whether or not the selected element is stored in step F03, if the selected element is not stored, a confirming operation within the effective selected element has not been detected yet, or a cancel process has been executed. Since it is in the state, if the pointer coordinates at the time when the confirmation operation is detected in step F04 are included, the selection area determined in step F02 is stored and stored in the storage means that the computer 100 normally has. Next, in Step F05, it is determined whether or not the determination in Step F02 is true and the selected selection area is a hierarchical element. If the determination is true, the selected element included in the hierarchy associated with the selected hierarchical element is drawn and displayed on the screen 301. At this time, the selection elements other than the newly drawn selection elements (the selection elements drawn before the new drawing) are set to be invalid.

  FIG. 27 is a flowchart illustrating an example of processing that branches from the flowchart of FIG. Step F07 is executed when the selected element is stored as a result of determining whether or not the selected element is stored in step F03. In step F07, it is determined whether or not the stored selection element is a hierarchical element. If the determination result is true, the process of FIG. 28 is executed. If the determination result in step F07 is false, it is determined in step F08 whether the operation is a definite operation in the area associated with the stored selection element. If the determination result in step F08 is true, the character associated with the stored selection element is determined as the input character in step F10, and the cancel process of FIG. 29 is executed. Even if the determination result in step F08 is false, it is determined in step F09 whether the operation is a confirmation operation in a selected element that is not a hierarchical element, and if the determination result is true, storage is performed. Although the selected element is different from the selected element, the character associated with the selected element determined in step F02 is confirmed in step F10 as the input character when the coordinates where the confirm operation is detected are included in FIG. Cancel processing is executed. In FIG. 27, the cancellation process of FIG. 29 is shown to be executed when the determination result of step F09 is false. Instead, the execution is changed to step F14 of FIG. It is also possible.

  FIG. 28 is a flowchart illustrating an example of processing that branches from the flowchart of FIG. 27 and continues. Step F11 is executed when it is determined that the selected element stored in step F07 is a hierarchical element as a result of determining whether or not the selected element stored in step F07 is a hierarchical element. In step F11, it is determined whether or not the confirming operation is a confirming operation in the selected element associated with the stored hierarchical element. If the determination result is false, the cancel process of FIG. 29 is executed. If the determination result in step F11 is true, it is determined in step F12 whether the selected element selected in the determination in step F02 is a hierarchical element. If the determination result is false, the character associated with the selected element is determined as an input character in step F13, and the cancel process of FIG. 29 is executed. If the determination result in step F12 is true, this is a case where a hierarchical element is further associated with the hierarchical element. In step F14, the selected element is stored and stored in a storage unit that is normally provided in the computer 100. At this time, if a plurality of hierarchies are stored using a stack structure or the like, the hierarchies can be returned one by one in the cancel process. When not using the stack concept, etc., multiple hierarchies are not stored at the same time, so the selection element already associated with another hierarchy element is drawn before newly drawing the selection element associated with the selected hierarchy element. If it has been drawn, it is necessary to delete the hierarchy. After step F14, step F15 is executed, and the selected elements included in the hierarchy associated with the selected hierarchical element are drawn and displayed on the screen 301. At this time, the selection elements other than the newly drawn selection elements (the selection elements drawn before the new drawing) are set to be invalid.

  FIG. 29 is a flowchart illustrating an example of a cancellation process that continues after branching from the flowcharts of FIGS. In step F16, it is determined whether the selected element is stored. If the determination result is true, it is determined in step F17 whether the stored selected element is a hierarchical element, and the determination result is true. In step F18, the rendering unit 106 renders a display of the result of deleting the display of the selected element associated with the hierarchical element on the screen 301. At this time, if a plurality of hierarchies are stored using the stack structure or the like in step F14, it is possible to delete them in order from the latest one. If multiple layers are not stored using a stack structure etc., only the selection element associated with one hierarchy element should be drawn, so if the selection element is deleted, the selection that is displayed initially Only the element is drawn on the screen 301. Even when a plurality of hierarchies are stored using a stack structure or the like, it is possible to erase all of them at once. Subsequently, in step F19, the memory of the selected element is erased and released. As for the erasure in step F19, when the stack structure or the like is used, it is possible to erase in order from the latest one. Even when a plurality of selected elements are stored using a stack structure or the like, it is possible to erase all of them at once.

  While the invention has been particularly shown and described with reference to specific embodiments thereof, it will be apparent to those skilled in the art that it will depart from the spirit and scope of the invention as encompassed by the claims. Rather, various changes, modifications, variations or applications may be made in form and detail and are considered to be included in the invention limited only by the scope of the claims.

  Since the present invention is a character input device, a character input method, and a character input program for inputting characters by selecting from choices managed by a hierarchical structure, a large space like a general keyboard is allocated to the input device. This is particularly effective for such devices. For example, in a PDA, a mobile phone, or a remote controller that cannot perform pen input by using a numeric keypad or a dial operation instead of a pointing device operation, in addition to a PDA, a mobile phone, or a remote controller that includes a pointing device such as a pen input or a touch panel It can also be applied to character input. In addition, since the area to be used may be small and it is possible to assign a single confirmation operation to the click operation, it is also effective for use in situations where the physical functions available to the operator are limited. . In addition, it can also be used for character input in ATMs and library terminals equipped with touch panels.

DESCRIPTION OF SYMBOLS 100 Computer 101 Detection means 102 Area determination means 103 Area setting means 104 Selection element generation means 105 Selection element management means 106 Drawing means 201 Pointing device 200 Input device 300 Display device 301 Screen 400 Character input device R601, R701 Area C601, C701 Character 511 515, 510, 520, 530, 601-636, 701-705, 711-723, 731-733, 741-748, 751-755, 761-768, 801-860, 901-905, 911-915, 921 -925, 931-933, 941-945, 951-956 Selection element 500 Hierarchical structure 510, 520, 530, 601-609, 611, 613, 616-621, 623, 625-633, 6 5 hierarchy element 511,701,711,721,731,741,751,761,801,816,829,842,859,901,911,921,931,943,952 representative selection element

Claims (10)

In a character input device including an input device including a pointing device and a display device, the character input device includes:
Area setting means for setting an area on the screen of the display device;
Detecting means for detecting coordinates obtained from the input device and a determination operation;
Region determination means for determining whether the coordinates are included in the region;
Selection element generation means for generating a selection element associated with the region and the character;
Selection element management means for managing the selection element by a hierarchical structure;
Drawing means for causing the display device to draw the area and draw the character;
The selection element generation means generates a selection element associated with the selection element included in the hierarchy in the hierarchical structure to form a hierarchy element,
The selection element management means causes one or more selection elements to be drawn by the drawing means,
When the detection unit detects the confirming operation, the selection element management unit determines that the result of the determination by the region determination unit is true for the coordinates detected by the detection unit and the region associated with the selection element. And when the selected element is the hierarchical element, the drawing means is configured to draw the selected element constituting the hierarchy associated with the hierarchical element,
When the detection unit detects a confirming operation, the selection element management unit determines that the result of determination by the region determination unit on the coordinates detected by the detection unit and the region associated with the selection element is true. When the selected element is not the hierarchical element, the character input device determines the character associated with the selected element as an input character. The character input device according to claim 1,
The selection element generation unit is a character input device that further associates a representative selection element, which is a representative of an associated hierarchy, with the hierarchy element when generating the hierarchy element. The character input device according to claim 2,
The selection element management unit, when the drawing unit draws the selection element constituting the hierarchy associated with the hierarchy element, the area associated with the representative selection element of the hierarchy and the coordinates detected by the detection unit A character input device that adjusts the region of the representative selection element so that the determination by the region determination unit is true. The character input device according to claim 3,
When the detection unit detects a confirming operation, the selection element management unit determines that the result of determination by the region determination unit on the coordinates detected by the detection unit and the region associated with the selection element is true. If there is no such selection element, cancel processing is executed. In a character input method in a character input device including an input device including a pointing device and a display device, the character input method includes:
An area setting step for setting an area on the screen of the display device;
A detection step of detecting coordinates and a confirmation operation obtained from the input device;
An area determination step for determining whether the coordinates are included in the area;
A selection element generation step of generating a selection element associated with the region and the character;
A selection element management step for managing the selection element by a hierarchical structure;
A drawing step of causing the display device to perform drawing of the region and drawing of the character,
The selection element generation step includes a step of generating a selection element associated with the selection element included in a hierarchy in the hierarchical structure to form a hierarchy element,
The selection element management step includes a step of drawing one or more selection elements by a drawing step,
In the selection element management step, when the detection step detects a confirmation operation, the result of the determination in the area determination step regarding the coordinates detected in the detection step and the area associated with the selection element is true. And when the selected element is the hierarchical element, the step of drawing the selected element constituting the hierarchy associated with the hierarchical element by the drawing step,
In the selection element management step, when the detection step detects a confirmation operation, the result of the determination in the area determination step regarding the coordinates detected in the detection step and the area associated with the selection element is true. When the selected element is not the hierarchical element, the character input method includes a step of determining the character associated with the selected element as an input character. The character input method according to claim 5,
The selection element generation step includes a step of further associating a representative selection element, which is a representative of an associated hierarchy, with the hierarchy element when generating the hierarchy element. The character input method according to claim 6,
In the selection element management step, when the selection element constituting the hierarchy associated with the hierarchy element is drawn by the drawing step, the area associated with the representative selection element of the hierarchy and the coordinates detected by the detection step A character input method including the step of adjusting the region of the representative selection element so that the determination by the region determination step is true. The character input method according to claim 7,
In the selection element management step, when the detection step detects a confirmation operation, the result of the determination in the area determination step is true for the coordinates detected by the detection step and the area associated with the selection element. A character input method comprising a step of executing a canceling process when there is no such selection element. The character input program which makes a computer function as a character input device as described in any one of Claim 1 to 4. The character input program which makes a computer perform the character input method as described in any one of Claims 5-8.