JP2004013381A - Virtual key one hand input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily make input without requiring recognition of a key arrangement position by a visual sense and a tactile sense. <P>SOLUTION: Virtual keys are set by respectively arranging key section image screens 23a to 23e on a two-dimensional object 19 by program software on the basis of a coordinate value obtained by contact of five fingers of one hand with a key operation surface 16 after storing one two-dimensional object 19 corresponding to input point coordinates of the key operation surface 16 and the five key section image screens 23a to 23e. The program software executes key arrangement by a determination of the left and right of an input hand, the expansion-reduction of the key section image screens 23a to 23e and a rotational movement on the basis of the coordinate value obtained by the contact of the five fingers of one hand with the key operation surface 16, and sets the virtual keys adapted to the size of a hand of an input person and an input position. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an input device such as a device and a computer, in which five fingers of one hand are brought into contact with a key operation surface capable of inputting coordinates, and a virtual key is set based on the contact position. Shape can be diversified.
[0002]
[Prior art]
As a key in an input device such as a conventional device or a computer, an insertion-type key is often used, and a touch panel key integrated with a display device is well known.
A typical example of a conventional computer input device is a computer keyboard having 109 keys.
According to these key systems, the key arrangement position is determined and fixed from the input device side, and the size of the key top is also fixed.
[0003]
[Problems to be solved by the invention]
Since the conventional input device is configured as described above, the input device at the fixed key arrangement position needs to recognize the input key visually or tactilely. As a result, barriers for visually impaired persons have increased with the automatic systemization of society, such as automatic ticket vending machines, ATMs, and computer acceptance systems at general hospitals. Further, for a blind person who is not good at braille, it is inconvenient to operate an elevator or the like, which is a more serious problem.
For sighted persons, there is also a problem that a rapid input operation is hindered by movement of the line of sight, and a danger occurs such as an input operation of a car navigation system and audio while driving a car. Was.
[0004]
In addition, since the size of the key top is fixed, a tight input operation is forced depending on the size of the hand and the finger. For example, in an input device of a miniaturized device such as a mobile phone or an electronic dictionary, since a key top is also small, it is difficult for a person with a thick finger to operate.
[0005]
Furthermore, while it is easy to simultaneously touch the key operation surface with multiple fingers of one hand, the reason why it does not develop as an input form is that the key arrangement position and the size of the key top are fixed, which is a conventional key structure. It is thought that this is one of the reasons. With a key structure that facilitates the combination input of a plurality of fingers of one hand, it is possible to reduce the size of the computer keyboard and to improve the input capability and operability of an electronic mobile device or the like.
[0006]
The present invention has been made to solve the above-described problem, and sets a virtual key based on a contact position of a finger on a key operation surface, and does not require visual and tactile recognition of a key arrangement position. It is an object to provide a virtual key one-handed input device.
[0007]
In addition, the input device performs left / right determination of the input hand from the contact information of the finger, and sets a key layout suitable for the input hand. The purpose is to provide.
[0008]
In addition, the input device calculates the size of the input hand from the contact information of the finger, and makes the partition area of the virtual key suitable for the size of each input user's hand, so that the virtual key one hand suitable for various input users The purpose is to provide an input device.
[0009]
Also, by calculating the axial direction of the input hand from the finger contact information and setting the key layout to match the axial direction of the input hand, it is unnecessary to determine the input position according to the key layout direction at the start of input. The purpose is to do.
[0010]
Furthermore, a virtual key one-handed input device having a shape suitable for the shape of an output destination device and a system or a shape of an input hand is provided as a device capable of changing the shape of a key operation surface. Aim.
[0011]
[Means for Solving the Problems]
According to a first aspect of the present invention, there is provided a virtual key one-hand input device in which one or a plurality of keys assigned to five fingers of one hand are graphically divided into five keys for each assigned finger. A screen provided as a screen and provided in correspondence with the input point coordinates of the key operation surface based on coordinate values obtained by touching one finger and five fingers on the key operation surface capable of multi-point input of two-dimensional coordinates. By arranging the five key section screens on the dimensional object respectively, a key arrangement adapted to the input hand is set.
[0012]
A virtual key one-hand input device according to a second aspect of the present invention determines a left or right of an input hand based on coordinate values obtained by touching a five-finger finger with a key operation surface, and provides a key area screen provided in the input device. In the case of an input hand different from the input hand, a key arrangement suitable for the input hand is set by symmetrically moving the key section screen.
[0013]
A virtual key one-hand input device according to a third aspect of the present invention calculates the size of an input hand based on coordinate values obtained by touching a five-finger finger with a key operation surface, and enlarges or reduces a key area screen. The key arrangement is adapted to the input hand.
[0014]
The virtual key one-hand input device according to claim 4 of the present invention calculates the axial direction of the input hand based on the coordinate value obtained by touching the five-finger finger with the key operation surface, and operates the key in accordance with a change in the axial direction. The key arrangement is adapted to the input hand by rotating and moving the section screen.
[0015]
A virtual key one-handed input device according to a fifth aspect of the present invention has a plurality of key operation surfaces and the same number of two-dimensional objects for arranging key area screens as the key operation surfaces can diversify the shape of the input device. Is what you do.
[0016]
The virtual key one-hand input device according to claim 6 of the present invention diversifies the shape of the key operation surface by changing the input coordinates of the key operation surface to three-dimensional coordinates and replacing the object on which the key area screen is arranged with a three-dimensional object. Is what you do.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Prerequisite technology.
Prior to the present invention, a one-handed input device was presented in Japanese Patent Application No. 2001-351358.
FIG. 1 is a perspective view showing the one-handed input device. Fourteen keys are arranged on a key operation surface of the input device. The fourteen keys are arranged as follows. Each home position key is arranged at a position where five fingertips of the left hand naturally touch the key operation surface of the input device.
In the figure, key 1 is a home position key of a thumb, key 2 is an index finger, key 3 is a middle finger, key 4 is a ring finger, and key 5 is a little finger.
[0018]
The moving direction from each home position key is determined for each finger, and one key is arranged in one direction. The thumb has the key 11 in the direction to open the first joint and the key 12 in the direction to close it, the index finger has the Delete key 6 in the direction to spread the middle finger to the opposite side, the Alt key 7 in the direction to extend the finger, and the middle finger has the finger. Shift key 8 in the direction of extending the finger, Esc key 14 in the direction of bending, Ctrl key 9 in the direction of extending the finger, Num Lock key 10 in the direction of extending to the opposite side to the middle finger, and the little finger in the direction of the ring finger. Back Space keys 13 are arranged in the direction in which the back space key 13 is extended to the opposite side.
[0019]
A total of seven keys, three keys assigned to the thumb and the home position key of the other finger, are keys for inputting a key code by single input or up to five duplicate inputs. Each of the three keys assigned to the thumb has a key arrangement that enables combination input with the home position key of another finger.
By combining a plurality of keys as described above, nearly 200 key codes can be obtained.
According to the present invention, the keys as in the above example are arranged as virtual keys so that an input operation on a key operation surface can be easily performed.
[0020]
Embodiment 1 FIG.
An embodiment of the present invention will be described below with reference to the drawings. Although the present invention is a one-handed input device for both left and right, the following description mainly deals with left-handed input.
FIG. 2 is a perspective view of the input device in which the key operation surface is a one-dimensional two-dimensional plane which is a basic shape of the present invention. The input device 15 is provided with a key operation surface 16, and the rest 17 is provided with a switch 18 which is curved to make the palm or the wrist easy to access.
[0021]
In the housing of the input device 15, a storage device and a CPU are provided. The power switch of the input device 15 is not shown because it can also be used as an output destination device and a computer.
The storage device has program software for setting virtual keys, determining input keys, and converting key information, one two-dimensional object corresponding to the input point coordinates on the key operation surface 16, and five key arrays. A screen in which key screens are combined into one (hereinafter, referred to as a “key layout panel”) and key assignments for converting input keys into information are stored. Alternatively, the storage device is a storage medium in which the program processing is performed by the output destination CPU.
[0022]
The key operation surface 16 of the input device 15 is a rectangular flat surface, and is a touch panel or the like that enables multi-point input of coordinates. The lower side of the key operation surface 16 is an X axis, the left side is a Y axis, The coordinates are orthogonal coordinates with the origin at the lower left.
[0023]
FIG. 3 illustrates the two-dimensional object stored in the input device 15. The two-dimensional object 19 is modeled to have the same shape and size as the key operation surface 16, and the input points of the key operation surface 16 correspond to the same coordinate position using the same coordinate axes. ing.
In FIG. 3, a plane represented by a rectangle with the X axis as the lower side and the Y axis as the left side is the two-dimensional object 19. The two-dimensional object 19 is a surface on which a key section screen is arranged in order to set a virtual key, and the entire surface is set to 0 for binarization.
[0024]
FIG. 4 illustrates a key array panel stored in the input device 15. A rectangle having the X axis as the lower side and the Y axis as the left side is the key array panel 20, and uses the same coordinate axes as the two-dimensional object 19 and the like.
The size of the key layout panel 20 is such that the key layout described below can be performed, and any size may be used as long as the key partition is not hindered by coordinate conversion described later.
In the key arrangement panel 20, sections of the home position keys 21a to 21e are graphically illustrated in a positional relationship in which five fingertips of the left hand naturally contact the key operation surface 16.
[0025]
In FIG. 4, 21a is a thumb, 21b is an index finger, 21c is a middle finger, 21d is a ring finger, and 21e is a home position key of a little finger. In the input device 15, in addition to the home position key, a moving direction from the home position key is determined, and one or two keys are further assigned to each finger, and the sections thereof are graphically illustrated. Are key sections 22 including nine sections other than the home position keys 21a to 21e.
[0026]
The key layout panel 20 of FIG. 4 illustrates an example of the key layout with reference to FIG.
According to the present invention, the number of key arrangements can be changed according to the requirements of the output destination device and system.
Although the present invention is a one-handed input device for both left and right, the key arrangement panel 20 to be stored is one in which either left or right key arrangement is performed.
[0027]
The key array panel 20 is binarized into 0 and 1, where each key section is 1. In FIG. 4, the closed area surrounded by the solid line of the home position keys 21 a to 21 e and the nine key sections 22 is 1, and the other areas are 0.
In addition, the attribute of the identification label is given to each section of each key.
The home position keys 21a to 21e and key sections 22 assigned to each finger are divided into five key section screens 23a to 23e for each assigned finger by a rectangular shape shown by a dotted line in FIG. The key section screens 23a to 23e are respectively pasted to the two-dimensional object 19, and one reference point 24a to 24e serving as a reference for position calculation at the time of pasting is set near the center of each home position key. I have.
[0028]
FIG. 5 is a flowchart showing a virtual key setting program for pasting the key section screens 23a to 23e to the two-dimensional object 19 and setting a virtual key suitable for the input user. Hereinafter, the setting operation of the virtual key and the program processing will be described.
[0029]
The switch 18 shown in FIG. 2 has a switch structure that is turned on when the input person inputs his / her palm or wrist to the rest 17 to input, and turned off when the input is stopped and the hand is released from the rest 17. .
When the switch 18 is turned on, the virtual key setting program starts. If it is turned off, the virtual key setting program is terminated, or the input mode is closed if it is in the input mode described later after the virtual key setting.
[0030]
When the switch 18 is turned on and the virtual key setting program is started, the input user makes five fingertips of one hand touch the key operation surface 16 in a natural manner.
The program processing for setting the contact position of each finger to the position of each home position key is performed as follows.
[0031]
The input points of the key operation surface 16 are pseudo-pixelated by the image processing technique of the computer, and each set of the points input by touching the five fingertips is divided into five points by the four connection method and the eight connection method. It is formed on the contact surface of each finger. The maximum value and the minimum value of the X and Y coordinate values of each contact surface are averaged to provide a center point near the center of each contact surface.
FIG. 6 is a diagram showing the contact surface and the center point of the finger when the processing by the left hand is completed. A rectangle having two sides on the coordinate axis represents the key operation surface 16, reference numerals 25a to 25e represent contact surfaces of the left five fingers with 25a as the thumb, and reference numerals 26a to 26e represent the center points of the respective contact surfaces.
The data of the contact surfaces 25a to 25e and the center points 26a to 26e are stored until the end of the virtual key setting program.
[0032]
The key array panel 20 performs coordinate conversion for pasting by the following method based on the contact surfaces 25a to 25e and the center points 26a to 26e. That is, symmetrical movement, enlargement or reduction, and rotational movement are performed. The conversion method in each case is as follows.
First, the symmetric movement will be described.
[0033]
As described above, the input device 15 is a single-handed input device for both left and right, but the key layout panel 20 is provided with only a left-handed key layout. If the input hand is the right hand, the key arrangement panel 20 is moved symmetrically with the Y axis as the symmetry axis, and converted to the right hand key arrangement. If the key array panel 20 symmetrically moved to the second quadrant is moved in parallel to the first quadrant so that the lower left becomes the origin, coordinate conversion by rotational movement described later can be easily performed.
When the input hand is the left hand, the coordinate conversion by the above-described symmetric movement is unnecessary.
[0034]
The determination as to whether or not it is necessary to perform the symmetric movement described in the preceding paragraph is made by comparing the shapes and sizes of the contact surfaces 25a to 25e or by the distribution of the center points 26a to 26e.
The determination in FIG. 6 is made by comparing the rightmost contact surface 25a with the leftmost contact surface 25e. That is, when five fingers of one hand come into contact with the plane in a natural manner, the side of the fingertip of the thumb comes into contact, and the thumb becomes an elongated contact surface. On the other hand, the little finger forms a circular shape by contacting the abdomen of the fingertip. Thus, the ratio between the length and width of each contact surface is calculated to determine which is the contact surface of the thumb.
[0035]
Alternatively, since there is a difference between the contact position between the thumb and the index finger and the contact position between the ring finger and the little finger, the distance between the right center points 26a and 26b and the distance between the left center points 26d and 26e are larger or smaller, For example, it is determined whether the input hand is left or right.
[0036]
Next, a case where the key section screens 23a to 23e are enlarged or reduced according to the size of the input hand will be described.
The method of making the virtual key a size suitable for the input person is performed by coordinate conversion by enlarging or reducing the key arrangement panel 20. The enlargement or reduction ratio is calculated by comparing any one of the data of the contact surfaces 25a to 25e and the center points 26a to 26e with the corresponding home position keys 21a to 21e on the key array panel 20 and the reference points 24a to 24e. Performed by the ratio of
[0037]
For example, the width of the contact surface of the finger differs depending on the size of the hand and the finger, and the same person has little change in the same finger at each input start time. The width of the contact surface of the position key 21c) is set as comparison data, and the enlargement / reduction ratio is calculated based on the ratio with the width of the contact surface 25c of the middle finger.
Alternatively, since the distance between the middle finger and the ring finger varies depending on the size of the hand, and the same person changes little at each input start time, the distance (length of 24c and 24d) suitable for the key array panel 20 as described above. And the ratio of the distance between the center points 26c and 26d.
The key arrangement screens 20 are enlarged or reduced by enlarging or reducing the key arrangement panel 20 based on the enlargement or reduction ratios calculated as described above.
[0038]
The axial direction of the hand at the start of input is not the same direction even for the same person. There is no problem when the keys to be arranged are only the home position keys, but when there is a key arrangement other than the home position keys as shown in FIG. 4, the division positions of these keys are shifted due to a change in the axis of the hand. It will be.
[0039]
In order to avoid such a problem, coordinate conversion is performed by rotating the key array panel 20 described below. The following description will be made on the assumption that the symmetric movement has been performed in the above description, assuming that the above-described parallel movement has also been performed.
At any two points of the center points 26a to 26e shown in FIG. 6 and two reference points 24a to 24e of the key array panel 20 corresponding to those points, a straight line passing through each of the two points is a Y-axis or an X-axis. By calculating the rotation angle so as to be the same angle with respect to the axis and rotating the key array panel 20 with the origin as the rotation axis, the problem of the position of the hand in the axial direction can be solved. In addition, since the axis of the middle finger is in the axial direction of the hand, it is preferable to target a straight line passing through the center points 26b and 26d of the index finger and the ring finger on both sides and a straight line passing through the reference points 24b and 24d.
[0040]
The key array panel 20 that has been subjected to the above coordinate conversion processing is pasted to the two-dimensional object 19 by matching the corresponding reference points 24a to 24e with the coordinates of the center points 26a to 26e for each of the key section screens 23a to 23e. Done.
FIG. 7 illustrates the two-dimensional object 19 on which the key section screens 23a to 23e are pasted according to the coordinates of the center points 26a to 26e shown in FIG.
[0041]
When the pasting is completed, the two-dimensional object 19 is stored while the key section screens 23a to 23e are pasted, the virtual key setting program ends, and the mode shifts to the input mode.
The storage of the two-dimensional object 19 to which the key section screens 23a to 23e shown in FIG. 7 are pasted is held until the switch 18 is turned off.
[0042]
The above is the flow of the virtual key setting operation and the program processing shown in the flowchart of FIG. The operation for setting the virtual key to the arrangement position and size suitable for the input person is as follows. The palm or the wrist is addressed to the rest 17, the switch 18 is turned on, and the five fingertips are naturally applied to the key operation surface 16. It is only necessary to make contact with the device, and it is simple.
[0043]
Further, in the above description, it is assumed that five key section screens 23a to 23e are set as one key arrangement panel 20 and are pasted to the two-dimensional object 19 for each of the key section screens 23a to 23e after the coordinate conversion processing. I went. As another method, the key arrangement panel 20 is not provided, and the five key section screens 23a to 23e arranged in advance in the two-dimensional object 19 as shown in FIG. Can be used to perform the coordinate conversion processing.
In this case, the coordinate conversion processing of the key section screens 23a to 23e may be performed as follows based on the above-described determination and calculation of the conversion rate.
[0044]
If symmetrical movement is required for left / right determination of the input hand, line symmetrical movement with the Y axis of the two-dimensional object 19 as the symmetric axis is performed first with the key section screens 23a to 23e arranged. When this movement is performed, the parallel movement is also performed so that the lower left of the two-dimensional object 19 becomes the origin. Next, enlargement or reduction is performed using the reference points 24a to 24e as the centers of the key section screens 23a to 23e. Further, the key section screens 23a to 23e are rotated with the reference points 24a to 24e as their rotation axes. Finally, the key section screens 23a to 23e are translated so that the coordinates of the center points 26a to 26e match the corresponding points of the reference points 24a to 24e, respectively.
After the coordinate conversion processing is performed as described above, the mode shifts to the input mode as described above.
[0045]
The input operation to the input device 15 in which the virtual key is set and the mode is shifted to the input mode is assumed to be a key arrangement while the switch 18 is turned on while the palm or the wrist is addressed to the rest 17 following the above operation. This is performed by touching the key operation surface 16 with a finger.
The input point position information on the key operation surface 16 is converted into coordinates and collated with the corresponding points of the two-dimensional object 19 on which the key section screens 23a to 23e are arranged. If the corresponding point of the two-dimensional object 19 is binarized 1, the key input is made, and the input key is determined based on the identification label which is the attribute of the section of the key to which the corresponding point belongs. The determined input key is output as key information based on the stored key assignment.
[0046]
When the palm or wrist separates from the rest 17 and the switch 18 is turned off, the input mode ends.
In order to input again, the palm or wrist is again addressed to the rest 17 and the switch 18 is turned on. While the switch 18 is OFF, the input from the key operation surface 16 is not accepted.
[0047]
As described above, the input device 15 is a touch-typing input device that does not require a display device because a virtual key is set according to the contact position of the finger. The number of keys and the arrangement position of the key arrangement can be determined according to the requirements of the output destination device and system.
A key arrangement method for facilitating touch typing may be as follows. That is, if the key arrangement is only the home position key of each finger, touch typing becomes easy.
[0048]
When a key arrangement is performed in addition to the home position key, the input finger of the key is determined, and the moving direction of the corresponding finger from the home position key is determined. In this case, it is preferable to arrange one key per one moving direction.
The key arrangement panel 20 of FIG. 4 determines the direction of movement of the finger from the home position key in the direction of extending, bending, or moving sideways in the same manner as in FIG. 1, one key per movement direction, for a total of 14 keys. It is an array.
[0049]
The present invention is a one-handed input device, and the number of keys that can be arranged is small. As shown in FIG. 1, as a method of enabling many inputs with a small number of keys, a key code type by overlapping input of a plurality of keys, a hierarchical type of key allocation, a time lag between inputs, The assignment may be made based on the number of inputs. Further, by combining these input methods, it becomes possible to cope with an input to a complicated system requiring many inputs.
[0050]
Embodiment 2 FIG.
The above is the description of the input device 15 in the present invention in which the key operation surface is a one-dimensional two-dimensional plane having a basic shape.
The following description describes a method for dealing with a case where the key operation surface is other than one two-dimensional plane in order to make the shape of the input device of the present invention various.
[0051]
As described above, the basic shape of the key operation surface of the present invention is a one-dimensional two-dimensional plane. Although the input device 15 of FIG. 2 has a rectangular shape, the input device can be diversified by adopting another two-dimensional shape.
Further, if a single input device is provided with a plurality of key operation surfaces to form a single key operation surface, the compatibility is further enhanced. If the key operation surface shape is a curved surface, the shape of the input device can be further varied.
[0052]
As described above, the object on which the key section screens 23a to 23e are arranged is a model of a key operation surface, and uses the same coordinate axes as the key operation surface in order to correspond input points. If the key operation surface is two-dimensional, it is a two-dimensional object, and if it is three-dimensional, it is a three-dimensional object. If one input device is provided with a plurality of key operation surfaces, objects are modeled by the number corresponding to the coordinates.
[0053]
FIG. 8 is an example in which the key operation surface is a plurality of two-dimensional surfaces, and is a plan view showing three key operation surfaces and two-dimensional orthogonal coordinate axes on each key operation surface.
In the figure, three surfaces of the triangular pyramid are key operation surfaces 27a to 27c, and a switch having the same function as the switch 18 shown in the first embodiment is provided at the vertex 28 of the three key operation surfaces. It is conceivable that the thumb is applied to the key operation surface 27a, the index finger, the middle finger, the ring finger, and the little finger is applied to the key operation surface 27c. Alternatively, depending on the size of the key operation surface and the orientation of the installation surface, a two-sided input form using a thumb and other fingers regardless of the input surface is also conceivable.
The setting directions of the following coordinate axes are settings as an input form in which a palm is applied to a vertex formed by the key operation surfaces 27a to 27c.
[0054]
Even with the same key operation surface configuration, the setting position of the coordinate axis may be changed if the input form changes, such as placing a palm on the ridge.
The rectangular coordinate axes shown in FIG. ₁ Y ₁ The axis is the coordinate axis of the key operation surface 27a, and X indicated by a dashed line ₂ Y ₂ The axis is the coordinate axis of the key operation surface 27b, and X indicated by a two-dot chain line ₃ Y ₃ The axes indicate the positions of the coordinate axes on the key operation surface 27c, and the three sets of coordinate axes shown are the same coordinate axes.
[0055]
FIG. 9 is a diagram showing two-dimensional objects 29a to 29c modeled in correspondence with the coordinates of the key operation surfaces 27a to 27c and their coordinate axes.
When each key operation surface is treated as a two-dimensional plane in an input device in which the key operation surface is three-dimensionally composed of a plurality of two-dimensional planes, as shown in FIG. It is sufficient that the coordinates of the respective key operation surfaces do not overlap within the coordinate axes, and the two-dimensional object is modeled by associating the coordinates by the number of the key operation surfaces as shown in FIG. That is, in FIG. 9, the two-dimensional objects 29a to 29c are arranged so as not to overlap in the Y-axis direction.
Then, key section screens 23a to 23e are arranged on each surface in the same manner as in the first embodiment.
[0056]
FIGS. 10A and 10B are perspective views for explaining the axial movement of the finger of the input device having the two-dimensional key operation surface on the front and back sides of the flat plate, and FIGS. 11A and 11B. , (C) are diagrams for showing the key operation surface and the coordinate axes of the two-dimensional object.
In FIG. 10, reference numerals 30a and 30b denote front and rear key operation surfaces, and a dashed line 31 indicates a thumb axis, and a two-dot chain line 32 indicates an index finger axis. When a flat object is sandwiched between fingers, the thumb comes into contact with the opposite surface of the other finger as shown in FIG. When the axis of the hand is moved in this mode, the thumb and the other fingers move in a mirror relationship as shown by the axis 31 of the thumb and the axis 32 of the index finger.
[0057]
If the above-described method of setting the coordinate axes using the plurality of two-dimensional planes as the key operation surfaces is applied to the key operation surfaces 30a and 30b having such a mirror relationship as they are, it will cause trouble.
In the key operation surface configuration in which the axial movement of the finger has a mirror surface relationship, X shown in FIGS. 10A and 10B and FIGS. 11A and 11B is used. ₁ Y ₁ Axis and X ₂ Y ₂ Like the axis, it is necessary to set the coordinate axis of the key operation surface such that the X axis has a mirror relationship with the Y axis as the axis. The two-dimensional object may be modeled in the same coordinate axis so that the input point coordinates of the respective key operation surfaces correspond to each other, such as 33a and 33b shown in FIG.
As the setting of such coordinate axes, the key section screens 23a to 23e are arranged on the two-dimensional objects 33a and 33b in the same manner as described in the first embodiment.
[0058]
Although the curved surfaces of the cylinder and the cone have a three-dimensional shape, they can be treated as one or a plurality of surfaces and a two-dimensional key operation surface in a mirror relationship. That is, in a cylinder, when it is expanded, it becomes a rectangular plane, and when it is expanded, it becomes a fan-shaped plane. Therefore, it can be treated as a two-dimensional key operation surface.
Modeling when handling as a two-dimensional key operation surface is performed by the respective methods described above.
[0059]
The triangular pyramid of FIG. 8, the key operation surfaces of the front and back surfaces of FIG. 10, and the above-described cylinder / cone have a three-dimensional key operation surface. It was a method of treating as. However, a key operation surface having a three-dimensional configuration can be treated as three-dimensional, and modeling can be performed as a three-dimensional object by a technique of three-dimensional computer graphics (hereinafter, referred to as “3DCG”).
As a modeling method in 3DCG, there are various techniques for using a triangular patch, a polygon, a curved surface patch, and the like to form a surface model, a solid model, and the like. Which method is used may be selected depending on the shape of the key operation surface, the amount of data, and the like.
The following description of the method of modeling a three-dimensional object is made as a surface model using polygons.
[0060]
FIG. 12 illustrates a method of modeling a three-dimensional object when the shape of the input device is an ellipsoid and a part of the free-form surface is a key operation surface.
FIG. 12A is a perspective view showing an ellipsoidal input device 34, and FIG. 12B is a diagram showing a three-dimensional object 36 that models a key operation surface 35. The key operation surface 35 is provided on the free-form surface of the ellipsoidal input device 34 in the form of a three-dimensional object 36 shown in FIG. The rest-cum-switch 37 has the same function as the switch 18 of the input device 15 shown in FIG. 2, has a convex shape, and is used also as a rest for the palm.
[0061]
As shown in FIG. 12B, the three-dimensional object 36 uses the right-handed three-dimensional orthogonal coordinate axes to set the bottom surface to the XY plane and the plus direction to the Z axis upward. The origin position is set at the center on the side of the rest and switch 37 in consideration of the input form in which the palm is addressed to the rest and switch 37.
The key operation surface 35 of the ellipsoidal input device 34 also has the same coordinate axis setting corresponding to the three-dimensional object 36, and the input points are converted into three-dimensional coordinates.
[0062]
The three-dimensional object 36 illustrated in FIG. 12B is modeled by a polygon mesh 38 composed of polygons.
The modeling is performed such that each vertex of the polygon mesh coincides with the input point coordinates of the key operation surface since the surface of the polygon constituting the polygon mesh is basically a plane. However, depending on the resolution of the key operation surface, if the amount of data is increased by using a polygon mesh with all the input points of the key operation surface as vertices, a polygon with the input points of the key operation surface omitted. It can also be a mesh. In the three-dimensional object from which the input points are omitted, information from the omitted input points that do not match the vertices of the polygon mesh may be dealt with by converging to the vertices of the nearest polygon mesh.
[0063]
The three-dimensional object 36 in FIG. 12B illustrates a model obtained by omitting the input points on the key operation surface.
The density of the polygon mesh may be determined in consideration of the number of key arrangements given to the input device, the shape of the key operation surface and the assumed contact state of the input finger, and the storage capacity and processing capacity of the input device. For example, if the arrangement is only the home position key, the arrangement may be coarse, and if the arrangement number is large, the arrangement may be dense.
The key section screens 23a to 23e are arranged on the three-dimensional object 36 that models the three-dimensional key operation surface 35 described above.
[0064]
The above is the description of the object modeling method when the key operation surface is other than one two-dimensional plane.
In order not to limit the input form on the key operation surface and the input person configured in such a manner, it is necessary to determine the direction of the input hand, left, right and palm, and to enlarge or reduce the key section screens 23a to 23e. It is necessary to calculate the rate and the rotation angle, but this process may be performed according to the shape and size of the contact surface of the finger and the distribution of the center point, as described with reference to the input device 15 in FIG.
[0065]
However, the formation of the contact surfaces 25a to 25e described with reference to FIG. 6 is based on a computer image processing technique, and is therefore possible only on a two-dimensional surface. If the input point from the key operation surface is three-dimensional coordinates, the following method may be used.
Each set of the contact points of the five input fingers is converted into three-dimensional coordinates into two-dimensional coordinates by using any of the three-dimensional coordinate axes (XY plane, XZ plane, YZ plane). Similarly, the contact surfaces 25a to 25e are formed by the 4-connection method and the 8-connection method of a computer image processing technique. In this case, it is preferable to use a coordinate plane close to a plane parallel to the contact surface to be formed. When the above processing is completed, they are converted into the original three-dimensional coordinates, and the center points 26a to 26e are set by averaging the respective coordinate values similarly to the input device 15.
[0066]
As another method, the key operation surface is converted into voxels by the 3DCG technique, divided into eight parts recursively up to the resolution of the key operation surface, and each set of the touch points of the five input fingers is divided into five blocks. It is formed. Each center point is set from the three-dimensional coordinate values of each block.
The center points 26a to 26e set in the above two examples are preferably set in a three-dimensional object modeled for later processing. In such a case, the center point may not be located on the surface of the three-dimensional object, but this does not hinder the subsequent processing. Alternatively, in the above-described example of modeling using polygons, the polygons may be converged on the vertices of the nearest polygon mesh.
[0067]
As an example of the determination of the direction of the input hand, the direction of the left and right and the palm, the input device having two-dimensional key operation surfaces on the front and back sides described with reference to FIGS.
FIG. 13 shows the contact surfaces 25a to 25e of the fingers on which the left and right hands contact the key operation surfaces 30a and 30b of FIG. 10 by changing the direction of the palm, using the coordinate axes of FIG. 11C. In this case, the illustration of the center points 26a to 26e is omitted, and the illustration is similar to that of FIG. When a finger is naturally contacted when a plurality of key operation surfaces are provided for one hand, the thumb contacts a surface different from other fingers as shown in FIG.
When the position to which the hand is to be assigned is designated as one side (for example, the surface 39 in FIG. 10), there are four types of contact depending on the directions of the left and right hands and the palm. FIGS. 13 (a) and 13 (b) show the left hand, and FIGS. 13 (c) and (d) show the right hand.
[0068]
When a plate-like object is naturally sandwiched between five fingers of one hand, the thumb faces the index finger and the middle finger. Therefore, the X coordinate value corresponding to the midpoint connecting the center points of the contact surfaces 25b and 25e formed by the four key operation surfaces on the four key operation surfaces, and the center point X of the contact surface 25a of the other key operation surface. By comparing the magnitude with the coordinate value, it is possible to further determine the left and right and palm directions of the input hand from the number of contact surfaces on the key operation surface.
The calculation of the size of the input hand may be performed in the same manner as the input device 15 based on the comparison data created in the same manner as described above with the stored hand size suitable for the key array panel.
[0069]
Even when a plurality of key operation surfaces are treated as two-dimensional, the key operation surface configuration is three-dimensional. Therefore, the rotation angle of the movement direction to a key other than the home position key due to the hand axis movement is determined by the key operation surface. Due to the angle of the surface configuration, the coordinate axes of the respective two-dimensional objects are not uniform as described in the first embodiment. However, by using the key section 22 shown in FIG. 4 as follows, the rotation angle can be calculated in the same manner as in the first embodiment.
The section of the key section 22 on the key section screen arranged on the two-dimensional object on the key operation surface that is touched only by the finger not used for calculating the axis movement is widened by estimating the displacement due to the rotational movement. As shown in FIG. 9, since a plurality of two-dimensional objects are related but distinct, if the coordinate interval between the two-dimensional objects is set sufficiently, a key to be arranged on another two-dimensional object is set. The ward screen will not be disturbed.
The rotational movement accompanying the axis movement of the hand when the key operation surface and the object are three-dimensional will be described later.
[0070]
When the plurality of key operation surfaces are a plurality of two-dimensional objects, the arrangement of the key section screens 23a to 23e is determined according to the left / right determination of the input hand and the calculated enlargement or reduction ratio and rotation angle. What is necessary is just to carry out similarly to 2 examples of 1. However, as illustrated in FIG. 13, in the key operation surface configuration in which the direction of the palm of the input hand can be changed with respect to the key operation surface, even if the input hand is on the same side or on the other side, it is symmetric. The determination of whether or not to perform coordinate conversion by movement changes.
As shown in FIGS. 13A to 13D, (a) and (b) require symmetric movement by changing the direction of the palm even if they are the same left hand, and in (a) and (d), Even if the input hand changes, symmetric movement is not required.
[0071]
When the object is three-dimensional, the key section screens 23a to 23e are arranged by a texture mapping technique based on 3DCG. The mapping techniques include a parallel projection method, a cylindrical projection method, a wrapping method, and the like. Distortion of the pasted texture is characteristic by a combination of those techniques and the shape of the three-dimensional object. For this reason, the selection of the mapping method may be performed based on the shape of the three-dimensional object (key operation surface) and the number of keys arranged.
Since the mapping is performed as texture mapping, the key array panel 20 in FIG. 4 is pixelized into a binarized image in which the key section is 1.
[0072]
As an example, a method of mapping the key section screen 23a of FIG. 4 to the three-dimensional object 36 shown in FIG. 12 by the parallel projection method will be described below.
The mapping by the parallel projection method is performed after the mapping position is determined by the following method by the program software after the left / right determination of the input hand. That is, when the key arrangement has a three-dimensional object shape in which distortion is likely to occur, the three-dimensional object is rotationally moved. When a key arrangement other than the home position key is provided, the rotational movement of the three-dimensional object accompanying the movement of the hand axis at the start of input. Calculation of the presence / absence of inversion of the key area screen and mapping position by enlargement / reduction according to the left / right and size of the input hand. Pasting by mapping.
The above processing is performed for each of the key section screens 23a to 23e.
[0073]
FIG. 14 is a diagram showing two sets of coordinate systems used for mapping. In FIG. 14, a three-dimensional coordinate axis represented by a small letter xyz is a mapping coordinate axis xyz, which is a world coordinate system. The three-dimensional coordinate axis represented by capital letters XYZ is the three-dimensional object coordinate axis XYZ, which is a local coordinate system.
14A to 14C show the mapping coordinate axes xyz, FIG. 14A shows the xz plane, FIG. 14B shows the xy plane, and FIG. 14C shows the yz plane. FIG. 4 is a diagram in which a three-dimensional object is arranged such that each coordinate plane of a three-dimensional object coordinate axis XYZ is parallel to a coordinate plane of a mapping coordinate axis xyz. In FIG. 14, illustration of the polygon mesh is omitted, and the same applies to the subsequent drawings.
[0074]
In 3DCG, the coordinate plane used for performing mapping by the parallel projection method is any one of the three planes on the mapping coordinate axis xyz. The coordinates given to the reference points 24a to 24e for calculating the mapping positions of the key section screens 23a to 23e are the coordinates of the corresponding center points 26a to 26e on the coordinate plane used for mapping on the mapping coordinate axes xyz. Then, the key section screens 23a to 23e are pasted so that the reference points 24a to 24e correspond to the corresponding center points 26a to 26e, respectively.
The example of FIG. 14 is based on the assumption that the xy plane is used. FIG. 14B illustrates the key section screen 23a so that the reference point 24a coincides with the center point 26a on the xy plane of the mapping coordinate axes xyz. FIG.
[0075]
In the example of the parallel projection method in FIG. 14, when the two-dimensional key section screen 23a is pasted on the surface of the three-dimensional object 36 that is not parallel to the xy plane used for mapping, distortion occurs. This is not a problem when the keys to be arranged are only the home position keys. However, when a key arrangement for moving and inputting a finger is performed, a problem may occur depending on the degree of distortion. In order to prevent such a problem, the surface of the polygon to which the center point 26a belongs (the polygon surface 41 indicated by oblique lines in FIG. 12B) is set so as to be parallel to the xy surface of the mapping coordinate axes xyz. The rotational movement of the three-dimensional object 36 with the origin 40 of the three-dimensional object as a rotation axis is performed on the xz plane and the yz plane of the mapping coordinate axes xyz.
Thus, the entire three-dimensional object 36 is rotationally moved so that the polygon surface 41 is parallel to the xy surface.
[0076]
In the polygon 41 shown in FIGS. 14A and 14C, the z value of each vertex on the mapping coordinate axis xyz is the same or the normal of the surface is perpendicular to the xy plane which is the mapping coordinate plane. If the three-dimensional object 36 is rotated in the direction of the rotation direction arrow A shown in the drawing so as to be in the direction, the plane becomes a parallel plane.
If four or more vertices of the polygon do not form a plane, an approximate value or three of them may be used. When the vertex of the polygon mesh is set as the center point, it may be performed by one of the polygons sharing the vertex.
[0077]
FIG. 15 is a diagram in which the rotational movement processing of the three-dimensional object 36 has been completed as described above.
Next, in the case of a key arrangement other than the home position key, if the movement of the hand at the start of input interferes with the key arrangement, the three-dimensional object origin 40 is further moved from the state shown in FIG. Is performed on the xy plane of the mapping coordinate axis xyz.
[0078]
In the case where the key operation surface is three-dimensional, the moving direction differs for each finger with respect to the three-dimensional coordinate axis depending on the surface direction of the contact position of each finger even in the same operation of moving the finger sideways. Therefore, the change in the angle of the movement direction of each finger due to the movement of the axis of the hand is not uniform with respect to the same coordinate plane as in the two-dimensional input device 15.
However, the difference in the angle at which each finger changes with respect to the same coordinate plane can be estimated from the shape of the key operation surface and the form of the input hand. From this, the correction of the rotation of the key section screen accompanying the movement of the hand axis when the key operation surface is three-dimensional is solved by setting a coefficient for the rotation angle for each of the key section screens 23a to 23e. You can do it.
[0079]
The rotation movement accompanying the movement of the hand axis at the start of input will be specifically described with reference to FIGS. 6 and 15, taking the ellipsoid-like input device 34 of FIG. 12 as an example.
The rotation angle is calculated using any one of the three surfaces on the three-dimensional coordinate axis of the key operation surface. Since the axial direction of the hand is determined with the middle finger as the center, it is preferable to use the center points 26b and 26d of the index finger and the ring finger sandwiching the finger, and it is preferable to use a coordinate plane that makes it easy to grasp the positional relationship. In the example, the center points 26b and 26d and the XY plane are used.
[0080]
The three-dimensional coordinates of the center points 26b and 26d set from the contact surface or the like by the method described above are converted into two-dimensional XY coordinates. The angle at which the straight line passing through the center points 26b and 26d intersects the Y axis is defined as the axis setting angle. Assuming that there is no hand axis movement, an axis setting angle set similarly to the above is set as comparison data, and a temporary rotation angle is calculated based on the comparison data and the axis setting angle. On the XY coordinate plane of the ellipsoidal input device 34, when it is estimated that the change in the angle of the key direction in which the thumb is moved with respect to the axial movement of the middle finger is 1/5, the key section screen 23a is displayed. A coefficient related to rotation correction is set to (0.2). The rotation angle is calculated by multiplying the calculated temporary rotation angle by a coefficient.
Based on the calculated rotation angle, the three-dimensional object 36 is rotationally moved about the three-dimensional object origin 40 on the xy plane of the mapping coordinate axis xyz shown in FIG.
[0081]
After the above-described rotational movement processing, the mapping position of the key section screen 23a is calculated.
The position of the mapping is defined by four vertices of the map, which is a rectangle. Therefore, the mapping position of the four vertices of the key section screen 23a is set to the center point 26a in order to match the reference point 24a with the center point 26a on the xy plane of the mapping coordinate axis xyz. The back calculation is performed from the xy coordinates of the mapping coordinate axis xyz. In this back calculation processing, the presence / absence of left / right inversion of the map and the enlargement / reduction processing are simultaneously performed based on the above-mentioned left / right determination of the input hand and the calculated enlargement / reduction rate, thereby determining the mapping position.
The arrangement of the key section screen 23a on the three-dimensional object 36 is performed by pasting by mapping after performing the above processing.
[0082]
In the above description of the mapping method, pasting is performed for each key section screen by the parallel projection method. As another method, it is also possible to perform coordinate conversion on each of the five key section screens in one map and paste them in one mapping process.
For example, in the wrapping method, mapping is performed such that one map wraps a three-dimensional object in a wrap. Texture distortion is caused by the mapping. In this case, the position of the mapping is defined by the vertices of the map, the vertices of the object, and the control points, so that the degree and position of the distortion can be sufficiently estimated. The five key section screens 23a to 23e divided into keys in consideration of the estimated distortion and position are used for enlarging or reducing and moving the hand axis with respect to the reference points 24a to 24e in one map. After performing coordinate conversion processing by rotational movement using the accompanying coefficient and parallel movement from the center points 26a to 26e to the position calculated backward, mapping may be performed according to the presence / absence of horizontal inversion processing of the map.
[0083]
In the present invention, it is only necessary that the input points on the key operation surface correspond to the coordinates of the object, and strict coordinate accuracy of the input points on the key operation surface is not required.
Depending on the shape of the three-dimensional key operation surface including the free-form surface, or the arrangement of keys provided to the input device, etc., the three-dimensional key operation surface is devised to simplify the program processing and improve the processing speed. Alternatively, the three-dimensional key operation surface and the three-dimensional object can be made two-dimensional by coordinate conversion. In particular, when the key given to the input device is only the home position key, this method can be easily performed.
[0084]
Therefore, in the following description, a case will be described in which a matrix and coordinates are used to make the three-dimensional key operation surface two-dimensional.
If the input points on the key operation surface are the intersections of the matrix, the input points can be two-dimensional coordinates by the rows and columns of the matrix.
FIG. 16 is a diagram for explaining the coordinate conversion of the intersections using the matrix as a line. FIG. 16A illustrates a matrix of a three-dimensional key operation surface, and FIG. 16B illustrates a two-dimensional orthogonal coordinate axis and a coordinate grid. The intersection Q of the matrix in FIG. ₁ Is the fourth row from the bottom in the fifth column from the left, and is located at the intersection number (4, 3) of the matrix. Point Q in FIG. ₂ As shown by, by taking a point at (4,3) in the same column and row of the coordinate grid, the intersection of the matrix can be easily coordinated.
[0085]
As described above, by forming a matrix suitable for the shape of the key operation surface while taking into consideration the form of the input hand and the key arrangement, a three-dimensional key operation surface can be modeled as a two-dimensional object.
In particular, if a matrix is formed on a projection line such as a cylindrical projection, the above-described three-dimensional object can be made two-dimensional by coordinate transformation, and the mapping is performed in three dimensions, and the input mode corresponds to two-dimensional. I can do it.
[0086]
The above is the method of coping with the object and the virtual key setting program accompanying the diversification of the key operation surface shape.
The processing in the input mode can be performed in the same manner as the processing in the input device 15 shown in the first embodiment, even if the key operation surface shape is diversified.
In order to ensure the setting and key input of the virtual key, it is preferable that the rest / switch 37 shown in FIG.
[0087]
As described above, according to the present invention, even if the touch position of the input finger is different at each input start time in an unspecified number of inputs or the same person's input, the virtual key is set to a position suitable for the input person by a simple operation. It can be set as a virtual key one-handed input device having a shape corresponding to various input forms.
[0088]
【The invention's effect】
According to the virtual key one-hand input device according to the first aspect of the present invention, one or a plurality of keys assigned to each of the five fingers of one hand are formed into a graphic and divided into five fingers. It is provided as a key section screen and further provided with one two-dimensional object modeled corresponding to the input point coordinates of the key operation surface, based on the coordinate values obtained by touching the key operation surface with one finger and five fingers. Since the virtual keys are set by arranging five key sections on the two-dimensional object, it is not necessary to visually and tactually recognize the key arrangement position, and the key input operation can be easily performed. Can be.
[0089]
According to the virtual key one-hand input device according to claim 2 of the present invention, the left and right of the input hand are determined based on the coordinate values obtained by the touch of the five fingers of one hand on the key operation surface, and provided on the input device. In the case of an input hand different from the key area screen, a key arrangement suitable for the input hand is set by symmetrically moving the key area screen, so that a left / right dual-purpose device that does not require a left / right switching operation can be provided. .
[0090]
According to the virtual key one-hand input device according to claim 3 of the present invention, the key area screen is enlarged or reduced according to the size of the input hand based on the coordinate value obtained by touching the five-finger finger with the key operation surface. The same input device can be adapted to various input persons.
[0091]
According to the virtual key one-hand input device according to claim 4 of the present invention, the key section screen is displayed in accordance with the change in the axial direction of the input hand based on the coordinate value obtained by touching the five fingers of one hand on the key operation surface. Since the rotation is performed, it is possible to eliminate a deviation between the axial direction of the input hand and the key arrangement position, which differs at each input start time.
[0092]
According to the virtual key one-handed input device according to claim 5 of the present invention, a plurality of key operation surfaces are provided, and the number of two-dimensional objects modeled corresponding to the input point coordinates of the key operation surface is equal to the number of the key operation surfaces. And a virtual key one-handed input device having a shape corresponding to various input forms can be provided.
[0093]
According to the one-handed input device according to the sixth aspect of the present invention, the two-dimensional object on which the key area screen is arranged is replaced with a three-dimensional object, and the key operation surface can be a three-dimensional shape such as a curved surface. Therefore, it is possible to provide a virtual key one-handed input device having a shape corresponding to various input forms.
[Brief description of the drawings]
FIG. 1 is a perspective view showing a one-handed input device.
FIG. 2 is a perspective view showing a virtual key one-handed input device in which the key operation surface according to the first embodiment of the present invention has one two-dimensional plane.
FIG. 3 is a diagram illustrating a two-dimensional object.
FIG. 4 is a diagram showing a key array panel.
FIG. 5 is a flowchart of a virtual key setting program.
FIG. 6 is a diagram illustrating a contact surface and a center point of a finger.
FIG. 7 is a diagram showing a two-dimensional object on which a key area screen is arranged.
FIG. 8 is a plan view showing three two-dimensional key operation surfaces and two-dimensional orthogonal coordinate axes of the respective surfaces.
FIG. 9 is a diagram illustrating coordinate axes of three two-dimensional objects.
FIGS. 10A and 10B are perspective views illustrating the axial movement of a finger.
FIGS. 11A, 11B, and 11C show front and back two-dimensional key operation surfaces and coordinate axes of a two-dimensional object. FIGS.
FIGS. 12A and 12B are perspective views for explaining a method of modeling a three-dimensional object; FIGS.
13A, 13B, 13C, and 13D are diagrams showing contact surfaces of a finger with two key operation surfaces on the front and back sides.
FIG. 14 is a diagram showing two sets of coordinate systems used for mapping.
FIG. 15 is a diagram in which the rotational movement processing on the xz plane and the yz plane of the three-dimensional object 36 has been completed.
FIGS. 16A and 16B are diagrams for explaining the coordinate conversion of the intersection points of the matrix.
[Explanation of symbols]
16 key operation surface, 19 two-dimensional object, 23a to 23e key area screen.

Claims (6)

In an input device having one key operation surface capable of performing multipoint input in two-dimensional coordinates with five one-hand input fingers, a graphic representation of one or a plurality of keys assigned to each of the five fingers of one hand is assigned. The screen is provided as five key section screens divided for each finger, and provided corresponding to the input point coordinates of the key operation surface based on the coordinate values obtained by touching the five-finger finger with the key operation surface. A virtual key one-hand input device, wherein a key arrangement suitable for an input hand is set by arranging the five key sections on each of the two two-dimensional objects. The left and right sides of the input hand are determined based on the coordinate values obtained by touching the five-finger finger with the key operation surface. If the input hand is different from the key section screen provided on the input device, the key section screen is symmetric. The virtual key one-handed input device according to claim 1, wherein the virtual key is moved. 3. The virtual system according to claim 1, wherein the magnitude of the input hand is calculated based on coordinate values obtained by touching the five fingers of one hand with the key operation surface, and the key area screen is enlarged or reduced. Key one-hand input device. 4. The key operation screen according to claim 1, wherein an axis direction of the input hand is calculated based on coordinate values obtained by touching the five-finger finger with the key operation surface, and the key section screen is rotated. The one-handed virtual key input device according to claim 1. The virtual key one-handed input according to any one of claims 1 to 4, wherein a plurality of key operation surfaces are provided, and the same number of two-dimensional objects for arranging the key area screens as the key operation surfaces are provided. apparatus. The virtual key one-handed input according to any one of claims 1 to 4, wherein the input coordinates of the key operation surface are three-dimensional coordinates, and the object on which the key area screen is arranged is replaced with a three-dimensional object. apparatus.

Images