JP5815173B2 - A multilingual virtual keyboard emulating method and a multilingual virtual keyboard emulated by the method. - Google Patents

Description

  The present invention forms a human interface in a computer. In particular, each real (real) keyboard corresponding to multiple languages is associated with a character selection virtual switch such as a touch panel, and character assignment is associated with each language. A multi-language virtual keyboard emulating method that emulates a compatible real keyboard into a virtual (virtual = virtual) keyboard to improve the compatibility between the multi-language keyboard and the virtual keyboard, and is emulated by the method. Related to multilingual virtual keyboard.

  For the human interface for inputting characters in the computer, the keyboard is the most practical means from the Genesis to the present of the computer, and it is still used from the large computer to the portable ultra-small mobile computer. In particular, it is said that it is practically sufficient for input of alpha beds in Western countries.

  However, the CPU that forms the brain of the computer has become ultra-compact, the computer itself has been incorporated into various electrical products, the era has entered the century of ubiquitous computing, and the relationship between humans and computers must maintain an increasingly strong relationship. The situation has to come.

  In Patent Document 1, four characters are assigned to one key top, the assigned characters are displayed on the key top, and a plurality of key tops each consisting of a set of four characters are selected and selected. An actual keyboard character selection means using an actual key switch that selects a character group and then selects the character by tilting the selected key top toward the character display side. Has been.

  In Patent Documents 2 and 3, almost the same as Patent Document 1, five characters are assigned to one key top, the assigned characters are displayed on the key top, and a set of five characters is formed. Select one or more key tops to select a group of characters, then press the key tops vertically to select the character displayed in the center, or tilt the key tops and press to display them in the tilted direction. A character selection unit for an actual keyboard is disclosed in which a selected character is selected.

  On the other hand, as a human interface for transmitting information to a computer, a pointing device such as a mouse or a trackball, a means for recognizing the movement of a human body by a camera, a voice recognition means, a handwritten character recognition means, etc. Various interface devices have been proposed as to whether characters cannot be input.

  Among them, the character palette displayed on the monitor screen of the computer is selected by using a pointer that is moved by a mouse or trackball, and the characters are selected and a touch sensor is provided on the upper surface of the character palette. Recently, a number of virtual switches, such as selecting characters directly with a finger, have been proposed and put into practical use.

  In the case of input using a conventional real keyboard (hereinafter referred to as an actual keyboard), a switch that forms a human-operated entity is indispensable. The object that a person operates is a virtual switch. Similarly, the pointer that the person operates is composed of virtual figures and patterns in the shape of arrows and fingers that can move freely on the screen. A virtual keyboard with no entity projected on it.

  Similarly, even in a virtual keyboard using a touch sensor, a switch that is touched by a human becomes a virtual switch that does not have a substance, which increases the flexibility of the character arrangement of the character palette and the shape and size of the key top. The display form can be changed instantaneously.

  As a result, in the character input method of the virtual keyboard by the virtual switch, the character arrangement of the character palette and the selection specification of the character selection are various, and the specification of the attack to the virtual switch, for example, the one by the pointer, A touch sensor such as a double-click has a variety of touch, tap, flick, etc., which are complicated.

In Patent Literature 4, the first character group of each line of the Japanese syllabary diagram in Japanese kana characters is displayed on the key top of each character selection virtual switch, and the key top is indicated, and the subsequent pointer of the pointer indicated is indicated. A method of selecting five characters related to the first character group according to the moving direction and behavior is described.
This patent document 4 also describes the one using an actual key switch. In this case, what characters are assigned in the direction in which the key top is tilted is indicated on the key top. Not.

  Further, in Patent Document 5, the first character group of each line of the Japanese syllabary diagram in Japanese kana characters is displayed on the key top pattern of each character selection virtual switch, and the key top pattern is displayed on the fingertip or stylus pen. A method is described in which the user taps or flicks in either the vertical or horizontal direction (referred to as a gesture in Patent Document 5) and selects five character groups related to the line. .

  Further, in Patent Document 5, by arranging the selection corresponding characters diagonally, the selection can be made by flicking in the diagonal direction, and another selection corresponding element is arranged in the direction between the four vertical and horizontal directions. It is described that the number of alternative selection elements can be increased to four or more by flicking in an oblique direction.

  On the other hand, the specifications of the character arrangement of the character palette and the attack to the virtual switch have produced various specifications depending on the language of the characters that require input, and there is a difficulty that the character input method cannot be unified at present. .

  In particular, in order to standardize multiple languages and try to apply the language of each country or region to a predetermined alternative selection virtual switch pattern, Japanese kana characters or English (French, German) Since the origin of the language itself is different from the alphabet characters of the alphabet using the alphabet, etc.), it is difficult to coexist on a compact character palette.

  Now that the world has become stateless, in order to be able to handle multiple languages on the Internet, it is necessary to find some commonality and create an integrated human interface environment.

For example, paying attention to the unique attributes of characters, hiragana characters (hereinafter referred to as kana or kana characters), katakana characters (hereinafter referred to as kana or kana characters), vowels, consonants, clear sounds, Attributes can be divided into muddy sounds, semi-turbid sounds, straight sounds, stuttering sounds, etc. In the case of the English alphabet, attributes can be divided into uppercase letters, lowercase letters, vowels, consonants, accents, and the like.
Similarly, a Hangul character can be divided into consonant vowels, vowel vowels, single vowels, compound vowels, and the like.

However, it is difficult and practically impossible to find attributes that are common to all multilingual languages such as national languages and regional languages around the world. In consideration of the above, a virtual keyboard in which virtual switches for each language are arranged, that is, a character input standby screen (corresponding to a character palette, but in this specification, a basic input screen that is always displayed) is formed, Furthermore, when constructing a new character array and operation method, there are as few exceptions as possible between languages, simplifying the operation procedure, sharing operability between different languages, and the flow of operations. the stop methallyl, without or back, between those languages, between attributes, and makes it possible to come and go between such numbers and symbols in a seamless, new virtual keyboard Character input methods and devices has been demanded by.

  In particular, in the future of computer generation, digital devices are becoming smaller and the form is far from independent personal computers, electronic dictionaries, mobile phones, digital cameras, still image viewers, video viewers, audio recording and playback devices, music playback Multi-functions of devices, electronic book readers, textbooks, other portable terminals, etc., and a human interface with a monitor screen equipped with a touch panel has been adopted for all of them. However, the transition from a real keyboard to a virtual keyboard is considered essential.

  When moving from this real keyboard to a virtual keyboard, keep in mind that a digital divide that will make a difference in gaining the benefits of digital evolution due to differences in the language used should never occur. Don't be.

  The present invention provides a method for emulating a multilingual keyboard and a virtual keyboard emulated by the method, in which the real keyboard can be easily emulated from the virtual keyboard to the virtual keyboard. It is to provide.

JP 63-24636 A Japanese Patent Laid-Open No. 05-265618 Japanese Patent Laid-Open No. 10-49272 JP 2000-112636 A JP 2009-266236 A

  The issues we are trying to solve are that in the era of ubiquitous computing, Japanese kana characters, alpha-bed characters such as English, French and German, Korean Hangul, Thai, Arabic, etc. Corresponding to each language, it eliminates complicated rules and complicated procedures, and even with low skill level that does not rely on the operator's memory and training, characters, words, sentences intended to be input by the operator It is possible to provide a human interface adapted to a virtual switch type multi-language corresponding to a pointing means related to the most important character input when a person is involved with a computer.

  In the future mobile computing era, the character input interface uses a touch panel or a character input pad with a virtual switch displayed on the monitor screen, and the virtual switch is operated by appropriate pointing means to input characters. Japanese kana characters have achieved easy-to-understand and easy-to-use character input using a character input screen with a small number of characters as in Patent Documents 4 and 5, while others In this language, no measures are taken, consistency with Japanese kana characters is lost, and character input for portable terminal devices, e-books, electronic dictionaries, mobile laptop computers, etc. that do not specify nationality Inconvenience.

As a request regarding character input, an elderly person or an unskilled person is desired to have an easy-to-understand even at a low speed, no complicated rules, and few options that are not hidden and displayed.
However, on the other hand, there is certainly a need for a character input method that can input characters at a high speed even if a high level of skill is required.

  Therefore, the present invention has been made in view of such a situation, using Japanese virtual kana characters, English alphabets, etc., using a virtual switch with a common input standby screen, operability and basic specifications. Several character input methods and devices having an approximated interface have been proposed, but it is an object to provide a character input method and device using a virtual keyboard having the same operability in other languages. To do.

  In addition, for multilingual character input, there are languages that are assigned to each standard English keyboard that is an existing entity. For each language, a real keyboard and a virtual keyboard are assigned to each character. There is also a problem in compatibility, and keyboards with alphabetic key layouts that are widely used as standard are compatible with, for example, the IBM keyboard 101 type (IBM is a trademark of IBM) and multilingual specifications. An object is to provide a character input method and apparatus using a high virtual keyboard.

According to the present invention, the above problem is solved as follows.
(1) In an actual keyboard with a standard key layout for selecting a required character from a character set including a plurality of characters included in one attribute,
A group of five keys for each step operated with the left hand and a group of five keys for each step operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing the character group,
On the other hand, in a virtual keyboard that displays characters representing a character group and selects one of a plurality of characters arranged around the character,
A plurality of character groups defined in the real keyboard are assigned to each key of the virtual keyboard, while maintaining the order of the steps of the real keyboard, and by assigning other characters around the representative character in the center,
The character arrangement of the real keyboard of the character set included in one attribute is emulated to the character arrangement of the virtual keyboard.

With such a configuration, the character arrangement of the actual keyboard corresponding to each existing language can be applied to the character arrangement of the virtual keyboard as it is, and compatibility between the real keyboard and the virtual keyboard can be maintained.
In addition, the first alternative virtual switch can be formed without significantly changing the character arrangement of the actual keyboard, and the second alternative virtual switch can be formed as a 3 × 3 matrix or a cross (cross) And can be compressed or folded so as to be unfoldable.
In addition, because the key layout features that are familiar to the actual keyboard are displayed as characters that represent the character group of the virtual keyboard, the image of the character arrangement on the virtual keyboard can be easily associated with the image of the actual keyboard. it can.
In addition, on the real keyboard, the part of the key operated with the left and right index fingers is the part that displays the characters that represent the character group on the virtual keyboard. Because it is a special part that can be selected only by tapping without selecting by sliding movement, assigning a character with high appearance frequency that is operated with the index finger in the real keyboard to the part, the virtual keyboard In this case, the efficiency of character input can be increased.
(2) In a real keyboard with a standard key layout for selecting a required character from a character set including a plurality of characters included in one attribute ,
A group of five keys each operated with the left hand and a group of five keys operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing each character group, and maintains the order of the steps of the actual keyboard. A plurality of character groups are assigned to a plurality of virtual switches, and a first selection selection virtual switch for selecting each character group is configured.
A first selection selection means for selecting one of a plurality of character groups, wherein the first selection selection virtual switch is displayed on the image display screen and selected by the pointing means; ,
A plurality of characters in association with the selection of the first selection selection virtual switch, in which a plurality of character groups determined on the actual keyboard are centered on the representative character and other characters are assigned around the character group. The second alternative selection virtual switch for selecting one of the above is provided with second alternative selection means for selecting a desired character by selecting one of the virtual switches by pointing means .

With such a configuration, the character arrangement of the real keyboard corresponding to each existing language can be applied to the character arrangement of the virtual keyboard as it is, and compatibility between the real keyboard and the virtual keyboard is maintained.
In addition, when a new application using a virtual keyboard is used for a new electronic terminal, the character layout of the existing real keyboard can be transferred without creating a new common specification. Therefore, it is possible to easily adapt to a new terminal.
Furthermore, by referring to the actual keyboards that are compatible with existing languages, the most standard keyboards used around the world, a new virtual keyboard is created based on the layout of the actual keyboard with a fixed basic form . The display of characters on the virtual keyboard that has been transferred is displayed with the characters at the center of the real keyboard arranged side by side. In this case, it is possible to easily correspond to the target language after commercialization.
In addition, the first alternative virtual switch can be formed without significantly changing the character arrangement of the actual keyboard, and the second alternative virtual switch can be formed as a 3 × 3 matrix or a cross (cross) And can be compressed or folded so as to be unfoldable.

According to the present invention, the character arrangement of the actual keyboard corresponding to each existing language can be applied as it is to the character arrangement of the virtual keyboard, and compatibility between the real keyboard and the virtual keyboard is maintained.
In addition, when a new application using a virtual keyboard is used for a new electronic terminal, the character layout of the existing real keyboard can be transferred without creating a new common specification. Therefore, it is possible to easily adapt to a new terminal.
By referring to the actual keyboard that supports the existing language, the actual keyboard that is most commonly used all over the world, based on the layout of the actual keyboard with a fixed basic form , a new virtual keyboard is added. The character array can be easily transferred, and the display characters of the transferred virtual keyboard are displayed with the characters in the center of the real keyboard arranged side by side. In addition, it is possible to easily correspond to the target language after commercialization.

FIG. 1 is a perspective view showing a use state of a tablet to which a character input screen according to the present invention is applied. FIG. 2 is a perspective view showing a use state of the smartphone to which the character input screen according to the present invention is applied. 3 is a detailed view of a character input screen applied to the tablet of FIG. 1 and the smartphone of FIG. FIG. 4 is a perspective view showing a use state of a tablet using a stylus pen to which a character input screen according to the present invention is applied. FIG. 5 is a perspective view showing a use state of a two-screen type notebook personal computer to which the character input screen according to the present invention is applied. FIG. 6 is a perspective view showing a usage state of the electronic dictionary to which the character input screen according to the present invention is applied. FIG. 7 is a front view of a television showing a character input state of a digital television to which a character input screen according to the present invention is applied. FIG. 8 is a detailed view of a character input editing screen including the character input screen according to the present invention shown in FIGS. FIG. 9 is a front view of each actual keyboard showing a standard keyboard corresponding to a multilingual language and English, Japanese, and Korean character arrays assigned to the keyboard. FIG. 10 shows a real key address code attached to a standard keyboard that determines the position of each character key on the real keyboard, and a plurality of keys are grouped into a key group based on the real key address code. It is a figure which shows the relationship of the virtual switch which represents the key group selected and selected in the 1st alternative selection opportunity by giving a representative pattern with a real key address code. FIG. 11 emulates an alphabetic character (alphabed) assigned to an English standard keyboard into a virtual switch representing a character group selected or selected at the first alternative selection opportunity based on the actual key address code. It is explanatory drawing to do. FIG. 12 shows the virtual switch emulated by the virtual switch representing the character group selected at the first alternative selection opportunity at the second alternative selection opportunity based on the real key address code. It is a figure which shows the relationship allocated to each virtual switch selected. FIG. 13 is a diagram showing the character arrangement of the first and second alternative selection virtual switches applied to the character input standby screen based on the actual key address code as the character arrangement of the standard alphabetic keyboard. FIG. 14 is a diagram in which character groups assigned to a standard alphabetic keyboard are arranged in a first alternative selection virtual switch in a 3 × 3 matrix arrangement according to the emulation of the present invention. FIG. 15 shows a 3 × 3 matrix that opens around the selected virtual switch when one of the virtual switches representing the character group selected in the first alternative selection opportunity shown in FIG. 14 is selected. It is a figure which shows the 2nd alternative selection virtual switch of arrangement | sequence, and the relationship of each character group. FIG. 16 is similar to FIG. 14 for each virtual switch that represents a group of characters that is selected in the first alternative selection opportunity, and when it is selected, opens around the selected virtual switch. It is a figure which shows the 2nd alternative selection virtual switch of normal mode in the character group currently allocated to the standard alphabet keyboard. FIG. 17 is a diagram showing the second alternative selection virtual switch in the shift mode of the English keyboard, as in FIG. FIG. 18 is a diagram showing a display form corresponding to each language of the first alternative virtual switch on the character input standby screen. FIG. 19 is a diagram showing an alphabetic lowercase mode and an alphabetic uppercase mode similar to those in FIG. 14 with each character group selection virtual switch in the first alternative virtual switch as an assist display frame. FIG. 20 is a diagram illustrating a state where the second alternative selection virtual switch is opened by touching the upper left virtual switch t in the small letter mode of FIG. 19. FIG. 21 is a diagram illustrating a state in which each character group selection virtual switch of the first alternative selection virtual switch is compared with a display character of the second alternative selection virtual switch using a frame with an assist display. FIG. 22 is a diagram showing details of a touch detection virtual switch area provided in a thin character portion of a frame with an assist display relating to English character input. FIG. 23 is a diagram showing details of the touch detection virtual switch area provided in the thin character portion of the frame with assist display related to the kana character. FIG. 24 is a diagram showing the key top pattern of the first alternative virtual switch according to the Korean character input with a figure representative of the character group included in the character group selection virtual switch. FIG. 25 shows a small character in the assist display frame of the first alternative virtual switch related to the Korean alphabet input, and a figure representative of the character group included in the character group selection virtual switch is attached in the center. FIG. FIG. 26 is a diagram illustrating a character arrangement of each character group selection virtual switch and the second selection virtual switch in the first alternative selection virtual switch.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The method for carrying out the method of the present invention and the embodiment of the apparatus of the present invention will be described below with reference to the accompanying drawings.
The method of the present invention is a real keyboard having a standard key layout for selecting a desired character from a character set including a plurality of characters included in one attribute.
A group of five keys for each step operated with the left hand and a group of five keys for each step operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing the character group,
On the other hand, in a virtual keyboard that displays characters representing a character group and selects one of a plurality of characters arranged around the character,
By assigning a plurality of character groups defined on the actual keyboard to each key of the virtual keyboard, maintaining the order of the steps of the actual keyboard, and assigning other characters around the representative character in the center, one attribute Is to emulate the character array of the real keyboard of the character set included in the character array of the virtual keyboard.

The device of the present invention is a real keyboard having a standard key layout for selecting a required character from a character set including a plurality of characters included in one attribute .
A group of five keys each operated with the left hand and a group of five keys operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing each character group, and maintains the order of the steps of the actual keyboard. A plurality of character groups are assigned to a plurality of virtual switches, and a first selection selection virtual switch for selecting each character group is configured.
A first selection selection means for selecting one of a plurality of character groups, wherein the first selection selection virtual switch is displayed on the image display screen and selected by the pointing means; ,
A plurality of characters in association with the selection of the first selection selection virtual switch, in which a plurality of character groups determined on the actual keyboard are centered on the representative character and other characters are assigned around the character group. A virtual switch comprising second alternative selection means for selecting a desired character by selecting a second alternative virtual switch for selecting any one of the above by using a pointing means. Is to constitute.

  FIG. 1 to FIG. 22 emulate the character arrangement of the real keyboard from the real keyboard of the standard English specification to the virtual keyboard that is formed on the appropriate image display means and operates the virtual switch with the appropriate pointer. The execution point and one example based on the method are shown.

  First, how to implement the virtual keyboard displayed on the character input screen in various electronic device terminals equipped with a computer function that requires a character input interface will be described as to how to implement the present invention. .

  FIG. 1 shows an electronic device terminal (hereinafter abbreviated as a tablet) 1 referred to as a tablet type, which is a flat plate with a board surface size of a standard size B5 or A5 and a thickness of about 20 mm. On the surface of the tablet 1, a touch panel 2 in which an image display monitor and a touch sensor are integrated is provided.

  The touch panel 2 displays a character input standby screen 3 that forms a virtual keyboard according to the present invention.

On the character input standby screen 3, as shown in FIG. 3A or 3B, nine character group selection virtual switches 4 are displayed in a 3 × 3 matrix structure. A set of character group selection virtual switches 4 is used as a set to form a first selection selection virtual switch 5 for selecting a character group selection that constitutes a first selection selection opportunity.
FIG. 3C is an enlarged view of one of the character group selection virtual switches 4 having a 3 × 3 matrix structure. In each figure described below, details of the character group selection virtual switch 4 are shown. Those omitted from the reference numerals shall conform to FIG.

On both sides of the first alternative virtual switch 5, two mode switching virtual switches 6 for changing the input mode are provided on each of the left and right sides.
The character input standby screen 3 constitutes a virtual keyboard composed of the nine character group selection virtual switches 4 and the left and right mode switching virtual switches 6.
The character input standby screen 3 is configured to correspond to the mode switching virtual switch 6 as a function switch (a key for inputting a control code other than a character key) in the actual keyboard. In the following description, this mode switching screen 3 The case of only nine character group selection virtual switches 4 without the virtual switch 6 will be described as being within the category of the virtual keyboard.

  FIG. 2 shows a state in which a character input standby screen 3 forming a virtual keyboard according to the present invention is displayed on the touch panel 2 of a high-function mobile phone 7 (hereinafter referred to as a smartphone) called a smart phone smaller than the tablet 1. Show.

  In the specification, when the components according to the present invention are displayed in various electronic devices with the same display form, the same reference numerals are used for the display parts such as virtual switches of the same components. A description will be given.

  The smartphone 7 has a flat plate shape with a width of about 60 mm, a width of about 110 mm, and a thickness of about 18 mm. The touch panel 2 is provided on the surface, and the character input standby screen 3 is displayed on the touch panel 2. Yes.

  Since the display screen of the smartphone 7 is smaller than the tablet 1 in the character input standby screen 3 on the tablet 1 and the smartphone 7, the character input standby screen 3 of the smartphone 7 is displayed smaller than the tablet 1.

  However, in reality, the size of the character input standby screen 3 of the smartphone 7 is set to a standard size that matches the size of the finger 8 that forms the pointer, and what is displayed on the tablet 1 is enlarged and displayed. .

  3 (a) or 3 (b), each character group selection virtual switch 4 on the character input standby screen 3 is a figure 9a representing a character group with a waveform underlined at the center, as shown in an enlarged view (c). In each of the left, right, top, and bottom sides, an assisting fine character (signified as a small character, which is confused with a lower case letter), which is significantly smaller than the character indicated on the figure 9a, A figure 9 representing a character group included in the character group selection virtual switch 4 by a frame 9b with an assist display surrounded by a surrounding line that divides the switch area of the character group selection virtual switch 4 has a 3 × 3 matrix structure 9. The virtual switches are displayed on the first alternative virtual switch 5 on the character input standby screen 3.

  In the following description and the description of each figure, the detailed reference numerals of the elements included in each character group selection virtual switch 4 in the first alternative selection virtual switch 5 are representatively shown in FIG. In each of the drawings, it may be omitted to describe detailed symbols for each character group selection virtual switch 4.

  Each character group selection virtual switch 4 in which a graphic 9a representing a character group is shown with a waveform underline at the center of the assist display frame 9b in the figure 9 is included in the character group of the character group selection virtual switch 4. A character is represented, and one of the nine character group selection virtual switches 4 is pointed (touched) with a finger 8 that makes a pointer, and this character input standby screen 3, That is, the first alternative selection opportunity of the virtual keyboard according to the present invention is formed.

  Each assist character displayed in the small characters 10 in the assist display frame 9b is flicked in the direction in which each assist character is displayed in the second alternative selection virtual switch 11, and selectable characters are displayed as an assist. Therefore, the display pattern of the virtual switch of the second alternative selection virtual switch 11 described later is substantially the same.

The first choice option is for languages such as Japanese, English, Korean, and other languages as one attribute, and for character sets of kana, alpha bed, hangul, and other languages included in that attribute. Each character is subdivided into a small number of character groups from a large number of character groups constituting the entire character set, and the selection is temporarily narrowed down.
In the conventional patent documents 1 to 4, for the purpose of selecting one character from a plurality of actual switches in which a plurality of characters are assigned to one switch, one of the plurality of actual switches is selected. The selection opportunity for searching for a switch (selection selection) fulfills the same function as the first selection selection opportunity according to the present invention in which the above-mentioned options are once narrowed down.

  When the options are narrowed down to a small number of character groups by the first alternative selection opportunity, the second alternative selection opportunity is formed by the second alternative selection virtual switch 11 for character selection.

That is, when the finger 8 touches one of the character group selection virtual switches 4, the second selection selection virtual switch 11 is centered on the touched character group selection virtual switch 4 as shown in FIG. open.
Performing the first and second alternative selection opportunities in the virtual switch is disclosed in Patent Documents 4 and 5.

In the following description, a situation where a new virtual switch screen is displayed or disappears is expressed as opening a screen or closing a screen.
In particular, in the present invention, when virtual switches that form a plurality of groups are displayed so as to open petals around the pointed virtual switch, the display is changed so that another petal opens, or pointing is stopped. Immediately stop the display to close the petals.

  Such an image leaves a strong impression as a human interface with pointing as a fingertip.

  FIG. 3 shows an example in which a standard alphabetic keyboard, for example, the IBM alphabet 101 keyboard shown in FIG. 9B, is used as a real keyboard, and the character arrangement of the real keyboard is applied to the character input standby screen 3 constituting a virtual keyboard. 3A shows a character arrangement in the lower case mode with the shift key set to normal, and FIG. 3B shows a character arrangement in the upper case mode with the shift key in the shift state or the caps lock key in the ON state.

  3A and 3B show the upper left virtual switch 4 (t) (T) of the 3 × 3 matrix for character group selection in each of (a) and (b). May be represented by a waveform figure ~), and in a state where the finger 8 is touched, the second alternative selection virtual switch 11 for character selection that forms the second alternative selection opportunity is opened. Show.

  The second alternative selection virtual switch 11 has a cross shape in the conventional Patent Documents 4 and 5, but in the present invention, a 3 × 3 matrix is adopted, and the diagonally lower left and the diagonally right. An extended function for flicking downward is provided, and details thereof will be described later. Note that Patent Document 5 shows that there are also options in an oblique direction.

Figure 4 shows a broad mobile terminal 12 substantially of the same size or slightly width smartphones 7 shown in FIG. 2, the pointer using the stylus pen 13, the difference between the smartphone 7, the direction of the stylus pen 13, a finger Since the resolution pointed to by the pointer is higher than that of 8, an example is shown in which the fine character 10 of the character group selection virtual switch 4 on the character input standby screen 3 shown in FIG.

  As described above, since the display figure of the tablet 1 is larger than the smartphone 7 in the relationship between the tablet 1 and the smartphone 7 as described above, when the pointer is the finger 8 having the same thickness, the tablet 1 is more In the character input standby screen 3, the resolution indicated by the pointer is relatively high.

  FIG. 5 shows a character input standby screen 3 according to the present invention displayed on a second screen 16 provided on the main body 15 side on the main body 15 side where a keyboard is conventionally installed in the two-screen type notebook computer 14. This is an example of a character input editing screen 17 in which each character group selection virtual switch 4 is applied to the character input standby screen 3.

  The character input editing screen 17 includes a character input standby screen 3 instead of a keyboard, an input character display screen 18, a predicted word display screen 19, and a text editing screen 20, as shown in FIG.

  The character input editing screen 17 works to send the character string selected and input on the character input standby screen 3 to the input character display screen 18 and to the text editing screen 20 if the spelling of the word is appropriate. ing.

  In addition, the character strings selected on the character input standby screen 3 are sent to the predicted word processing unit (not shown) of the predicted word display screen 18 in the order of selection, and words or words predicted from the selected character string are displayed. The sentence is displayed on the predicted word display screen 18 with an appropriate priority, and the displayed word or sentence is touched on the word or sentence displayed there (they are displayed via a touch sensor). Although the operation will be complicated, the following special situation will be omitted, and the operation of touching a virtual switch or the like displayed with display characters, patterns, symbols, and figures will be referred to as touch, and description of the intervention of the touch sensor will be omitted. By doing so, when the predicted word is recognized as an appropriate word or sentence, it can be touched and sent to the text editing screen 20 without inputting the full character string of the word. Nina To have.

  Note that the touch in the normal operation not related to the character input of the present invention operates so as to confirm the input when it is confirmed that the finger touches the touch sensor in the display image area such as the virtual switch. Behaves so that the finger 8 or the stylus pen 13 touches the target graphic and then leaves immediately, and such behavior of the pointer is an operation called a so-called tap.

  On the other hand, when the touch operation is accurately classified in the present invention, a touch sensor of a display image area such as a virtual switch (not the touch sensor itself of the touch panel 2 in which the image display monitor and the touch sensor are integrated, but a virtual switch) A finger 8 or a stylus is used as an image display unit that detects an attack to the virtual switch, or an image display unit that indicates the touch detection area or the vicinity thereof, or a touch detection coordinate value designated for determination of the detected coordinate position of the pointer in the program). When it is confirmed that the pen 13 is touched and the touch state is maintained, and then the finger 8 and the stylus pen 13 are confirmed to be separated from the touch sensor and operated, the appearance of the finger 8 and the stylus pen 13 is apparent. The tip behavior is the same as that of the tap described above, but in the present invention, it is referred to as touch. When describing the touches in the (upon contact) in both a touch-out (upon withdrawal), and those that generate a separate event.

  Further, in the present invention, a flick operation in which a finger is made to move may be detected so as to touch out while sliding the finger in a certain direction after touch-in during the touch operation.

  The detection of this flick action generates a separate event at the time of touch-in and touch-out, and the event is centered on the touched-in pointer by the event of the virtual switch touched in at the same time as the touch-in. When another virtual switch is opened and the virtual switch touches in the direction of the pointer when the pointer touches out, the virtual switch that is set in the virtual switch to be opened later by an event due to the touch-out immediately after touch-in Select one of the virtual switches.

  In the detection of the flick action, the behavior of the finger 8 touching the touch sensor, the stylus pen 13 and the pointer such as an arrow to be described later is graphically analyzed by a software program to obtain a predetermined required behavior. The gesture may be identified.

  For example, as a method for detecting a flick motion, in the operating system (OS) that controls the touch panel 2 that integrates the image display monitor and the touch sensor, the behavior of the finger 8 touching the touch panel 2 or the tip of the stylus pen 13 is used as a gesture. Using the detection function, the left, right, up and down directions can be detected from the direction in which the tip of the pointer moves toward the touch-out.

  In the present invention, the touch detection virtual switch area for detecting a touch at the portion of the thin character 10 displayed around the frame 9b with the assist display in the figure 9 representing the character group included in the character group selection virtual switch 4 21 (see FIGS. 18 and 22), the behavior of the finger 8 or the tip of the stylus pen 13 is not detected as a flick action (predetermined required behavior) by a series of gestures, but to the figure 9 After the touch detection of the touch detection virtual switch area 22 for detecting the touch of the touch, the touch detection of the touch detection virtual switch area 21 is sequentially detected, and at this time, the touch detection virtual switch area 21 detected at the time of touch-out is detected. Corresponding characters can also be selected.

  As will be described in detail later, if the pointer has a high resolution like the stylus pen 13, the touch detection virtual switch area 21 is directly tapped at the first alternative selection opportunity to select a character. You can also

  In the case of the notebook computer 14, with the right hand 23, the first alternative selection virtual switch 5, the second alternative selection virtual switch 11 including the character group selection virtual switches 4 on the character input standby screen 3, and The mode switching virtual switch 6 is operated.

  In addition, the left hand 24 performs an operation of selecting an appropriate predicted word or sentence from a plurality of predicted words displayed on the predicted word display screen 19, and narrows down the predicted words provided on the upper side and the right side of the predicted word display screen 19. By operating the tab 25, the operability can be improved as compared with the conventional real keyboard without disturbing the behavior of the character selection operation by the right hand 23.

  Furthermore, by causing the right hand 23 and the left hand 24 to perform the role assignment, the behavior of the right hand 23 is devoted to a series of “hand gestures” (hereinafter referred to as actions or gestures in the present invention) that form a mapping relationship with the spelling of words, which will be described later. It can be used effectively as a training to increase proficiency.

  In the present invention, a single basic operation of a pointer such as touch, tap, and flick (representing the basic behavior of a feature point) is shown as “shake”, and a plurality of “swings” are connected in series. The behavior is expressed as an action (“hand gesture” when the fingertip is used as a pointer) or a gesture, and the action or gesture has a one-to-one mapping relationship with the target concept such as a word, sentence, or idiom. Have it.

  FIG. 6 is a portable terminal type electronic dictionary 26 that is slightly larger than a notebook and can be stored in a chest pocket of a male suit. The electronic dictionary 26 includes a first monitor screen 28 on the inner surface of a lid 27 and an upper surface of a main body 29. A second monitor screen 31 is provided at 30.

  In a conventional electronic dictionary, a keyboard with a large number of switches arranged on the upper surface 30 of the main body 29 is arranged, and around the keyboard, function switches, operation switches, mode change switches, handwritten character input touch panels, etc. Switches for various human interfaces are arranged.

  Around each switch, an index display of the function that the switch operates is printed with characters and symbols, and it is very difficult to understand which switch is operated in which scene.

  Today's electronic dictionaries are multi-functional and have functions equivalent to or better than mobile laptop computers. Not only text search display functions such as dictionaries and dictionaries, but also still image display, video playback, music playback, text translation, A text-to-speech, electronic book, and other contents of 100 types or more are recorded in a built-in storage means, and an input / output port of a portable exchangeable memory means such as a flash memory is also provided.

  At present, touch panel technology has advanced, and the use of virtual switches has become widespread in everything from large computer devices to small mobile terminals and mobile phones. Has been completely abolished, leaving all operations to the virtual switch.

  Although the conventional electronic dictionary is equipped with such functions, it is necessary to install an actual real keyboard on the upper surface 30 of the main body 29 because the character input means using an appropriate virtual keyboard in place of the current real keyboard is used. It ’s nothing but nothing.

  This is the same for the conventional ones in the above-described tablet 1, smartphone 7, mobile terminal 12, notebook computer 14, and other electronic devices.

  The present invention is used in Japanese Kana, Western Alphabet (hereinafter abbreviated as English for English), Korean Hangul alphabet, and many other countries and regions. The language that is the native language of each ethnic group is input using the touch panel and the virtual switch having a common structure, so that the upper surface 30 of the main body 29 of the electronic dictionary 26 can be As the two-monitor screen 31, it is possible to effectively use a large number of contents loaded in the electronic dictionary 26 as a multi-language.

  For example, in the case of electronic book content, the first and second monitor screens 28 and 31 can be used to read a book in a double-sided spread style, such as a single book. In the translation function, both the monitor screens 28 and 31 It is possible to exert a great effect such as displaying pre-translational and post-translational parallel translations, and the conventional real keyboard surface is displayed on a character input editing screen 17 by a virtual switch having a character input standby screen 3 shown in FIG. Therefore, it is possible to easily change the notation of index characters and symbols related to the key, and in the operation scenes of various contents, unnecessary symbols and characters are not displayed, making it easy to use, Even between countries with different symbol display specifications, the product can be applied to different countries by changing only part of the program without changing the structure of the main unit. Kill Although, in the description of the present invention, it will be omitted usage and its effect of the second monitor screen 28.

  Although the electronic dictionary 26 shown in FIG. 6 is illustrated as being operated by the stylus pen 13, the finger 8 can also be used as a pointer, like the smartphone 7 shown in FIG. 2.

  FIG. 7 is a screen for operating the Internet browser 33 on the digital television 32. The browser 33 requests input of required characters, and opens the character input editing screen 17 shown in FIG. Indicates a situation where an attempt is made to enter.

  Since the digital television 32 uses a large monitor screen 34, it is separated from the operator, and a touch panel cannot be adopted. An arrow pointer used for a graphical user interface (GUI) of a personal computer. By 35, the character group selection virtual switch 4 and the mode switching virtual switch 6 on the character input standby screen 3 are pointed.

  In the character input by the pointer 35, since the touch-out event that is possible in the touch sensor cannot be performed, naturally the flick input cannot be performed. It should be noted that the flick input is characterized in that the switch operation for confirming the selection is not performed, and the click operation using the pointer does not fall within the category of the flick operation. However, if the software can be operated so that the passing virtual switch turns on in the selection confirmation state without a click operation when the pointer passes over the virtual switch, It can be handled in the same way.

  In this digital TV 32, a desired word / phrase can be input with a smaller number of input characters by using a large monitor screen 34 and a predictive word assist function, etc., so that input is performed slowly without requiring an input speed. It is suitable for inputting characters while visually checking.

  Regarding the input of characters to the digital TV 32, it is of course possible to input the English alphabet shown in the figure, and the same applies to the input of Japanese kana characters and Korean Korean characters, and the elimination of the digital divide in the aging society in the future. It is desirable to have a human interface that can be used in common with any language.

  Furthermore, the pointing means also uses the pointer 35 of the arrow to synchronize with the pointer 35 and sequentially move the virtual switch area in each character group selection virtual switch 4 with the display brightness and display color. In combination with the cursor displayed in a different manner, each virtual switch is selected by the movement of the pointer 35 that moves in an analog manner and the cursor that digitally moves up and down, left and right between the virtual switches. You can also.

  As described above, it is desirable that selection of a virtual switch does not require precise control by a pointing device, and eliminates advanced training and skill in character selection.

  Next, a description will be given of how to specifically configure the character input standby screen 3 that forms the virtual keyboard shown in FIG. 3 from an actual standard real keyboard.

  FIG. 9 shows an arrangement of key switches in each language on a typical standard actual keyboard.

FIG. 9 (a) shows that each character in the character set indicated by hatching is displayed on a real keyboard having a standard key layout for selecting a required character from a character set including a plurality of characters included in one attribute. For each character key to be assigned, an address code (hereinafter referred to as a real key address) for determining the position of each character key on the actual keyboard is attached, and the character assignment is undefined. Is shown.
Note that the function keys are assigned to the keys with cross-hatching, the assignment positions are slightly different depending on the operating system to be used, and are not particularly used in the present invention.

  FIG. 9B shows an English alphabet keyboard 37 in which an alpha bed layout assigned to a standard keyboard, for example, the alphabet specification (USA) of an IBM keyboard 101 type is assigned to each character key with a diagonal line. The front view of is shown.

  FIG. 9C also shows a front view of a Japanese kana keyboard 38 in which a Japanese kana character is assigned to each hatched character key on an IBM keyboard 101 type real keyboard. .

  FIG. 9 (d) also shows a front view of the Korean Hangul keyboard 39, in which the Korean Hangul alphabet is assigned to the hatched character keys on the IBM keyboard 101 type real keyboard. ing.

  Many of the real keyboards called multilingual type are assigned to the alphabetic keyboard 37 of (b) showing the real keyboard of the IBM keyboard 101 type, and the characters of the target language are assigned to the alphabetic array, The character notation is doubled on the surface of each key top.

  9 (c) and 9 (d) are shown by omitting the English letters. In the actual real keyboard, the kana keyboard 38 is (b) + (c), and the Korean keyboard 39 is (b) +. It is expressed on the surface of the key top in the notation (d).

  In addition, the keyboards 37, 38, 39 of each language are structurally common to each character key portion to which each character is assigned in the undefined keyboard 36 which is undefined in (a). The keyboard is (a) + (b) in the alphabet keyboard 37, (a) + (b) + (c) in the kana keyboard 38, and (a) + (b) + (in the Korean keyboard 39. The structure of d) is included.

  The virtual keyboard of the character input standby screen 3 according to the present invention includes a first keyboard and a first keyboard that compress or fold the character arrangement of the real keyboards 37, 38, and 39 in each language in the time axis direction. The selection is divided into two alternative selection opportunities.

  The first alternative selection opportunity is provided with a graphic 9a representing a character group in which each character of a character set included in one attribute is a set of a plurality of characters with a waveform underlined at the center thereof, A graphic 9 representing a character group included in each character group selection virtual switch 4 is constructed and divided into a plurality of character groups, and each graphic 9 is selected by selecting a character group. By linking to the switch 5 and displaying it on the touch panel 2, and selecting the first selection / selection virtual switch 5 by pointing means, one of a plurality of character groups can be selected / selected, This first alternative selection opportunity is formed.

  The second alternative selection opportunity is a touch panel in which each character included in the character group selected in the first alternative selection opportunity is linked to the character group selection virtual switch 4 selected in the first selection opportunity. The second alternative selection virtual switch 11 for selecting and selecting each character is selected by pointing means to select a desired character, and this second alternative selection is selected. Opportunities are formed.

  FIG. 10 explains the point of compressing or folding the real keyboard with respect to the time axis, and shows only the keys with the respective real key addresses attached to the undefined keyboard 36 in FIG. 9A. It is.

  First, in the undefined keyboard 36 of FIG. 9A, a key group operated with the left hand and a key group operated with the right hand are provided with a narrow left-downward slanted line, and each of the five steps is a left key group L. In addition, the right-side key group R is divided into five right-down diagonal lines with right-down diagonal lines, and a slightly wider left-down diagonal line that is further to the right side of the right-side key group R is applied. Each key is classified as another key group E.

  Further, as described above, the left hand key group is assigned an L division code, the right hand key group is assigned an R division code, and the keys are arranged in a horizontal row. From the bottom to the top, the first, second, third, fourth, fifth, and column numbers are assigned to each column from the second to the fifth. The left and right division symbols L and R and column numbers 2 to 5 are combined, and the respective columns of the left key group L and the right key group R are represented as 2L to 5L and 2R to 5R, respectively. At the same time, the numbers 1 to 5 are assigned in order from the left to the key groups 2L to 5L and 2R to 5R in each column in the left key group L and the right key group R, respectively, to obtain the actual key addresses.

That is, in the key group in each column of the left key group L, 2L1 to 2L5 are provided for the second key group 2L, 3L1 to 3L5 are provided for the third key group 3L, and the fourth key group 4L is provided. 4L1 to 4L5, and 5L1 to 5L5 for the fifth-stage key group 5L. (Note that the description of the real keyboard and the virtual switch with the address code is for understanding both structures.)

  In the key group in each column of the right key group R, the second-stage key group 2R has 2R1 to 2R5, the third-stage key group 3R has 3R1 to 3R5, and the fourth-stage key group 4R. 4R1 to 4R5, and 5R1 to 5R5 are assigned to the key group 5R at the fifth stage, and the address code of each real key address is assigned to each.

  Further, the other key groups that are not aligned on the right side of each column are marked with a division symbol E, and are sequentially shifted from the left to the right side of the upper key column and sequentially changed to the lower column, and the serial number E1. ˜E7 and an address code are added to make each real key address of the other key group E.

  In FIG. 10, the left key group L, the right key group R, and the other key group E are extracted and arranged as five key groups 2L to 5L, 2R to 5R, and E in each of the left and right stages and others, respectively. On the right side of the key group constituting each column, a key top pattern 9c is represented as a figure 9 representing the character group included in the character group selection virtual switch 4 on behalf of the key group included in each column. Then, a figure 9a representing a character group with a waveform underline at the center is drawn, and the key tops of five real keys are combined into one virtual key switch (compressed or folded), It is shown.

  Each of the character group selection virtual switches 4 in the first alternative selection virtual switch 5 includes five characters selected by the second alternative selection virtual switch 11 in each of the character group selection virtual switches 4. A graphic 9a including the character group and representing the character group is displayed in the key top pattern 9c.

  In addition, in FIG. 10, each of the five keys of each key top corresponding to the graphic 9 combined into one and represented by each real key (key top pattern arranged five on the left side) includes the key. The virtual key corresponding to the character group selection virtual switch 4 grouped together is underlined with the actual key address code displayed on behalf of each key group. It is marked with

  In FIG. 10, the selection of one of the character group selection virtual switches 4 in the first selection / selection virtual switch 5 is performed by selecting a group of five keys as a representative. The set of five keys selected as a representative is selected one by one by the second second selection virtual switch 11.

  In the first alternative selection opportunity, a virtual switch with a symbol representing each key group in FIG. 10 is imaged as a set of five key groups compressed or folded into one virtual switch. By selecting one of them, the image that has been imaged in a compressed or folded state is displayed on the virtual switch in a specific expanded or opened state by the second alternative selection opportunity with the time axis shifted. By selecting one of the opened key groups, it is possible to select one of the virtual switches corresponding to many characters on the virtual switch display screen having a small area.

FIG. 11 shows an embodiment of the present invention . The character arrangement of the alphabetic keyboard 37 shown in FIG. 9B is selected as shown in FIG. The virtual switch 4 shows a grouped state.

In the present invention, figure 9a that is displayed in each character group selection virtual switch 4 displays the character representing the five character group, 2-stage to fourth stage of the left key group L is alphabetic keyboard 37 In FIG. 9, the right end b, g, t touched with the left index finger is used as a representative character, and the waveform is underlined to form a figure 9a.

  Similarly, in the second to fourth steps of the right key group R, in the alphabet keyboard 37, characters such as n, h, and y at the left end touched with the index finger of the right hand are represented and the waveform is underlined. As a figure 9a.

  This is because, when typing on the actual keyboard, paying attention to the position of the index finger of both hands, when placing both hands to the third-tier home position, b, g, t and n, h and y appear vertically in two rows, and are characters that are characteristically impressed as characters representing the character group in each row.

In addition, since the uppermost fifth digit character groups 5L and 5R are represented by serial number groups, the left key group 5L is 1 to 5, so the first number 1 is represented by the right key group. Since the group 5R is 6 to 0, the first numeral 6 is a representative figure 9a.
Since the other key group E is entirely a symbol character, the @ symbol is used as a characteristic character, and this is represented as a figure 9a.

  The undefined keyboard 36 shown in FIG. 9A and the English keyboard 37 shown in FIG. 9B are obtained by assigning alphabetic characters (alphabed) on the undefined keyboard 36. Includes an address code (actual key address) that determines the position of each key attached to the undefined keyboard 36, and the English keyboard 37 includes the structure (a) + (b) as described above.

  FIG. 12 is a diagram illustrating the first selection virtual switch 5 to the second alternative selection virtual switch 11 based on the real key address to which the characters shown in FIGS. 9A and 10 are assigned. The relationship between the actual key address included in the character group selection virtual switch 4 in the one alternative selection virtual switch 5 and the actual key address opened as the second alternative selection virtual switch 11 is shown.

  In FIG. 12, the character group selection virtual switch 4 in each stage represents a virtual switch in which five key groups in each column in FIG. 10 are combined into one, and the left side L, the right side R, and the other E , 2L to 5L, 2R to 5R, and E representing the key groups of each stage are shown, and in the description of FIG. 12, the codes that identify the character group selection virtual switches 4 of each stage are Description will be made based on reference numerals 2L to 5L, 2R to 5R, and E representing the key groups of the respective stages.

  In FIG. 12, a figure 9a indicated by an independent key top pattern 9c and underlined in reference numerals 2L to 5L, 2R to 5R, and E representing the key group of each stage is shown in the key top pattern 9c. Each character group selection virtual switch 4 on the right side thereof is selected and selected on behalf of a set of five keys indicated by a cross pattern.

  When each character group selection virtual switch 4 is selected, the second selection virtual switch 11 of the cross pattern shown on the right side is connected to the selected character group selection virtual switch 4 at the center switch of the cross pattern. Is opened (displayed on the image display screen).

  The left, right, top and bottom four sides of the cross pattern shown on the right side are also virtual switches for selecting one character, and these five (substantially nine) characters can be selected together with the virtual switch for character selection at the center. The second virtual switch 11 forms a second alternative virtual switch 11.

  The virtual lines shown outside the cross pattern indicate the arrangement of virtual switches when the second alternative virtual switch 11 has a 3 × 3 matrix structure.

  The actual key addresses shown in the cross pattern frame are assigned to the second selection virtual switches 11 at the left, right, and other stages in an appropriate order.

  The positions of the five real key addresses included in each character group selection virtual switch 4 are arbitrarily assigned to any of the five cross patterns, and no particular rule is defined.

However, in the present invention, considering the proper arrangement from the operation state of the first and second alternative selection virtual switches 5 and 11, the selection of the center of the cross pattern is completed by the tap operation of the pointer. as can be assigned to a large frequency of appearance characters are then taken into account.

Similarly, in the present invention, in order to define the figure 9 representing the key group in the first alternative virtual switch 5, it is preferable to display characters that characteristically represent the five key groups. , same characters of figure 9 attached to the character group selection virtual switch 4 is Ru assigned to the center of the cross pattern.

FIG. 13 shows a state where the English keyboard 37 is emulated corresponding to the actual key address assigned to each cross pattern of FIG .

In FIG. 13, the normal mode and shift mode of the real keyboard are shown separately on the left and right, and they are displayed separately.
The first alternative virtual switch 5 is indicated by a key top pattern 9c on the left side of both modes, and each character group selection virtual switch 4 in the first alternative virtual switch 5 arranged vertically is shown in FIG. 11 shows a character arrangement in the normal mode (lower case mode) of the English keyboard 37 shown in FIG.

  Similarly, in FIG. 13, the character group selection virtual switches 4 in the first alternative selection virtual switch 5 which are indicated by the key top pattern 9 c on the right side of both modes and are arranged vertically are shown in FIGS. 9B and 11. The character arrangement of the shift mode (uppercase character mode) of the English keyboard 37 is shown.

  In FIG. 13, the second alternative selection virtual switch 11 has a 3 × 3 matrix structure, and the virtual switch portion corresponding to the cross pattern shown by the solid line in FIG. Characters corresponding to the actual key address shown in FIG.

  Furthermore, each character group selection virtual switch 4 in the first alternative selection virtual switch 5 is provided with a graphic 9a shown in FIG. 11, and in the uppercase mode of the shift mode, characters and symbols assigned to the shift mode Is displayed as a graphic 9a.

  The virtual switch 11a, 11b in the lower left diagonal and the lower right diagonal of the 3 × 3 matrix in the second alternative selection virtual switch 11 has a function for instructing attribute changes other than characters and a delimiter symbol for instructing the end of a word. (Space symbol).

The flicking operation from the center position of the 3 × 3 matrix in the normal mode to the diagonally lower left temporarily changes the attribute of the current mode to the opposite mode.
For example, when the current mode is the normal mode, flicking to the virtual switch 11a diagonally to the lower left changes the attribute to the shift mode and reverses the character selection mode even at the selection opportunity at that time (shown in the center of FIG. 13). White arrows and black arrows on the left and right indicate temporary inversion between normal mode and shift mode).

  This indicates that it is possible to input characters by arbitrarily changing attributes in the single mode without performing attribute conversion between lowercase and uppercase characters using the mode switching virtual switch 6 in the character input standby screen 3. .

  The flick to the virtual switch 11b diagonally to the lower right is the right diagonal at the character group selection virtual switch 4 in the first alternative selection virtual switch 5 that is always selected last regardless of the character that ends the word. By flicking down, you can enter a space symbol to separate words.

  In order to assign this space symbol as a part of a character, since there is no space symbol in each character key to which each character of the character set is assigned in the alphabetic keyboard 37 of the standard IBM keyboard 101 type, it functions separately. The key must be provided at the same level as the mode switching virtual switch 6, and the screen configuration of the character input standby screen 3 becomes complicated.

  As described above, when inputting characters continuously and inputting sentences by arranging words, the mode switching virtual switch 6 that is always outside the first alternative selection virtual switch 5 is provided for each word break. Since the finger 8 as a pointer has to be moved to the same level position, the result of losing the sense of relative position in the 3 × 3 matrix of the first alternative selection virtual switch 5 relating to “hand gesture” or gesture input. This will impede smooth input without delay.

  In the second alternative selection virtual switch 11, the flicking operation on the lower left and the lower right is performed as a prefix operation and a suffix operation in inputting a word, in one second alternative selection virtual switch 11, It can be operated completely.

For example, the word “the” is often entered in capital letters with “The” and the first letter at the beginning of the sentence. In other words, the first letter of the proper noun is usually expressed in capital letters in the sentence.
In an actual keyboard for inputting characters with both hands, a shift key for shift switching is provided on the left and right, so that the mode can be easily switched.

  However, since “hand gesture” for character input on the virtual keyboard is based on one-handed operation, the finger 8 is moved outside the 3 × 3 matrix area of the first alternative selection virtual switch 5 by mode switching. It is necessary to hinder the continuity of the input operation.

  As shown in FIG. 13, in one area of the second alternative selection virtual switch 11 opened in each character group selection virtual switch 4 in the first alternative selection virtual switch 5, mode switching and space symbols If the input is made possible, the above disadvantages are solved.

  FIG. 14 shows the first alternative selection virtual switch 5 shown in FIGS. 9A and 9B and FIGS. 10 to 13 on the character input standby screen 3, and each character group selection virtual switch 4 is 3 ×. 3 shows an example of arrangement in a matrix of three.

  FIG. 14A shows the first alternative virtual switch 5 for inputting a lower case character in the normal mode, and FIG. 14B shows the key top display pattern of the first alternative virtual switch 5 for inputting the upper case character in the shift mode. Show.

  14A and 14B, the arrangement of the character group selection virtual switch 4 in the first alternative selection virtual switch 5 in FIG. 14 is compared with the arrangement of the character group selection virtual switches 4 in FIGS. ) In the 3 × 3 matrix on the left side and the middle two columns are t, g from the top of the left side column with respect to the second, third, and fourth stage character groups in the English keyboard 37 that forms the actual keyboard. , B and the arrangement of y, h, n from the top in the center column correspond to the same vertical and horizontal arrangement.

  However, the position of the fifth digit of the alphabet keyboard 37, the arrangement of the numerals 1 and 6 of the first selection / selection virtual switch 5, and the positions of other symbols on the alphabet keyboard 37 and the first selection / selection Other positions of @ of the virtual switch 5 are different.

In the present invention, the purpose is to emulate real keyboards of many languages into one style of virtual keyboard, rather than to obtain a mapping that accurately corresponds to the real keyboard and virtual keyboard. The virtual keyboard in the alternative selection virtual switch 5 is compactly gathered as a 3 × 3 matrix and is used for the character input standby screen 3.
The first alternative virtual switch 5 according to the present invention is not limited to the 3 × 3 matrix structure according to the status and use state of the character input standby screen 3, and the numbers 1 and 6 and other Switch structure with either @, t, g, b columns and y, h, n columns in 3 rows by 2 columns or 2 rows by 3 columns matrix, or 1 row or 1 column array Can be

  In FIG. 14 (a), key top patterns 9c representing lower case figures 9 in the normal mode, shown in one column vertically in FIG. 13, are arranged in a 3 × 3 matrix.

  Similarly, in FIG. 14 (b), the key top pattern 9c representing the upper case graphic 9 in the shift mode, shown in one row vertically in FIG. 13, is arranged in a 3 × 3 matrix. Yes.

  The arrangement of the key tops having the 3 × 3 matrix structure is an example of a display form on the image display screen of the first alternative selection virtual switch 5 that is always waiting for character input on the character input standby screen 3 described above. Is shown.

  As shown in FIG. 15, when the first alternative selection virtual switch 5 touches one of the character group selection virtual switches 4, for example, t, in FIG. The 3 × 3 matrix second alternative selection virtual switch 11 corresponding to the touched figure 9 (t) shown on the right side of each key top pattern 9c is opened.

  16 and FIG. 17, when all the nine character group selection virtual switches 4 constituting the first selection / selection virtual switch 5 shown in FIG. 14 are touched with the finger 8, as shown in FIG. 15, The second selection / selection virtual switch 11 is opened at the touched position.

  16 shows a state in which lowercase letters are input in the normal mode, and FIG. 17 shows a state in which uppercase letters are input in the shift mode.

  In both figures, the second alternative selection virtual switch 11 always opens the second alternative selection virtual switch 11 in a 3 × 3 matrix with the character group selection virtual switch 4 touched by the finger 8 as the center. ing.

  In this state, if the touched finger 8 is touched out as it is, the character group selection virtual switch 4 in the first selection selection virtual switch 5 assigned to the central virtual switch of the second selection selection virtual switch 11 is used. The same character as the character drawn as the graphic 9 representing the character group is input.

  To detect this touch-out, the second selection / selection virtual switch 11 is opened for a short time (touch detection sensor is functioning) immediately after the finger 8 touches, and the finger 8 flicks. Then, the character of the second alternative selection virtual switch 11 to be touched out is detected.

  If there is no touch-out of the finger 8, the second selection / selection virtual switch 11 is displayed, and the event of character selection confirmation by the subsequent touch-out does not occur, and the matrix displayed at that time The second alternative selection virtual switch 11 is not closed, continues to be displayed, and is selected by tapping the finger 8 on any of the second alternative selection virtual switches 11 displayed again. One selection is confirmed and the selection operation is completed, and the character displayed at the tapped position is input.

  This alternative selection when the second alternative selection virtual switch 11 is displayed can be tapped at any of the center, left and right, upper and lower sides of the matrix, and the attribute conversion on the lower left and the right diagonal You can also enter a space below.

Even when the screen is not displayed, a flick downward diagonally to the left and right is detected.
In addition, the positions of the virtual switches on the left and upper right corners of the matrix are undefined and no corresponding virtual switch is set, but the display form is framed in a 3 × 3 matrix, The display area of the second alternative virtual switch 11 is clarified.
This undefined switch on the left and right diagonally outputs a command to return the procedure to the previous one when the second selection / selection virtual switch 11 is once opened in the display state but the target character cannot be found. Can be used to do.

  In the alternative selection operation of the second alternative virtual switch 11, when the touched finger 8 touches out, if the touchout is performed at the touched position as it is, a tap operation is performed. If the character at the center of the virtual switch 11 is input and the touched finger 8 is touched out while sliding in the left, right, up or down direction, a flick operation is performed, and the second option is selected. A character in the direction in which the finger 8 is slid from the center of the selected virtual switch 11 is input.

The detection of the flick operation is performed as follows.
The matrix-like virtual switch opened as the second alternative selection virtual switch 11 is provided with a virtual switch region in the matrix cell for detecting that the cell is touched. The virtual switch of the second alternative virtual switch 11 touched next without touching the finger 8 from the area overlapping the virtual switch area touched first in the center of the character group selection virtual switch 4 in the virtual switch 5 When an area is detected, a character assigned to the detected area is selected.

  In this operation, the behavior of the finger 8 is the same as that of the flick action, but the detection means for the behavior is a sequential detection means for detecting on / off of a plurality of conventionally used detection sensors in time series. When the handwriting is examined, the behavior of the finger 8 is different from that detected as a gesture.

  In the present invention, a character group selection virtual switch 4 to be described later can be used as a figure 9 with an assist display in combination with the detection of the flick operation by the operating system described above to select a character.

  Furthermore, the behavior of sliding the finger 8 diagonally downward left or diagonally downward to the right from the touched virtual switch in the center is also the same as that of the virtual switch provided in the diagonally downward left or diagonally right direction. Detect and change attributes or enter spaces.

  Note that the flicking operation in the diagonally lower left direction or the diagonally lower right direction is not a character input as disclosed in Patent Document 5, but corresponds to the output of a kind of function command that extends the function of the character input operation. Thus, the same function as that of the mode switching virtual switch 6 in the character input standby screen 3 is achieved, so that the finger 8 and the stylus pen can be used from the range of the first alternative selection virtual switch 5 in the continuous operation of character input. The movement of 13 pointers coming out is reduced.

  The character group selection virtual switch 4 in the first alternative selection virtual switch 5 shown in FIGS. 13 to 17 is a figure 9a as a figure 9a representing a character group with a waveform underline in the key top pattern 9c. What character is included in the character group of the second alternative virtual switch 11 that is displayed, and which character is assigned in which direction of the virtual switch in the second alternative virtual switch 11 Since it is not clearly shown whether it is done or not, the figure 9 showing the single representative character shown in FIGS. 13 to 17 needs to be mastered by training.

  In particular, in a language with a low computer usage rate, the character arrangement of a real keyboard is emulated in a virtual keyboard, and the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital TV 32, etc. When the user first encounters the selection screen of the first alternative selection virtual switch 5 displayed with the key top pattern 9c without any prior knowledge, the character input standby screen 3 is used. I don't know how to deal with the many hidden characters.

  However, even a beginner who is an experienced user who has operated a real language keyboard, the character group included in each character group selection virtual switch 4 in the first alternative selection virtual switch 5 is an arrangement of keys on the real keyboard. From the above, it can be assumed that the character group is included in each of the second alternative selection virtual switches 11. Therefore, in the initial stage of use, the input speed is slow, but the display of the second alternative selection virtual switch 11 is viewed. After that, it is possible to input slowly by selecting one by tapping, and it is possible to increase the input speed to flick input by continuing to master this through training.

  Further, when the proficiency level reaches the flick input range, the display relation positions of the first alternative selection virtual switch 5 and the second alternative selection virtual switch 11 are displayed on the character input standby screen 3 according to the present invention. Like a real keyboard, characters are selected at predetermined positions and selected according to a predetermined operation procedure without exception, so the locus of movement of the fingertip 8 for inputting a word to spell a series of character strings is The trajectory of the word and the finger 8 forms a one-to-one mapping relationship, and the trajectory of the “hand gesture” of the fingertip can be said to be gesturing the word.

  FIG. 18 illustrates various display forms of the first alternative selection virtual switch 5 on the character input standby screen 3.

  FIG. 18 illustrates each of the first alternative selection virtual switches 5 that can be applied to the character input standby screen 3 of the tablet 1, the smartphone 7, the mobile terminal 12, the notebook computer 14, the electronic dictionary 26, the digital television 32, and the like. The example of a display corresponding to various languages of the character group selection virtual switch 4 is shown.

FIG. 18 (a1) shows a conventional standby screen P1 using a Japanese syllabary diagram used for inputting Japanese kana characters described in Patent Document 5, which includes the first Each character group selection virtual switch S1 constituting an alternative selection opportunity and a graphic Q1 representing the alternative selection character group displayed on the key top of each character group selection virtual switch S1 are shown.
In addition, the code | symbol with the parenthesis put in order with the code | symbol which shows the conventional component has shown the thing corresponding to this invention.

(A2) shown on the right side of FIG. 18 (a1) is a second alternative selection of characters included in the character group of each character group selection virtual switch S1 at the second alternative selection opportunity in (a1). An example in which an index is displayed according to the allocation position of the virtual switch W1 is shown in the same manner as that used in the description of the implementation procedure of the present invention.
This is the first alternative selection virtual switch on the character input standby screen 3 displayed on the image display screen of the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital television 32, or the like. 5 can be used as the character group selection virtual switch 4 and the second alternative selection virtual switch 11.
Although not shown in the drawings, the image display screen according to the present invention includes a monitor screen of the computer, a monitor screen of a mobile phone, a monitor screen of a mobile terminal, a monitor screen of an electronic dictionary, a monitor screen of a digital television, and the like. Computer monitor screen, game console monitor screen, electronic puck monitor screen, karaoke song selector monitor screen, home appliance monitor screen, medical device monitor screen, ticket vending machine monitor screen, etc. It can be used for all electronic devices that are built-in and require character input.
In addition, what displayed the character selected by the 2nd alternative selection opportunity on the real key switch in the 1st alternative selection opportunity is disclosed by FIG.

  The standby screen (P1) shown in the above (a1) is configured to be vertically long with each character group selection virtual switch S1 as a 4 × 3 matrix structure. When inputting kana characters, ten character group selection virtual switches S1 are provided. Is used.

  Since the blank key top is assigned as a function switch not directly related to character input, detailed description thereof is omitted.

  The conventional character selection based on the Japanese syllabary diagram of kana characters requires ten virtual switches as each character group selection virtual switch S1 in the first alternative selection opportunity, and therefore ten-key type 4 rows × 3 A virtual switch having a matrix structure of columns is used, and 10 of 12 virtual switches are used as each character group selection virtual switch S1 (see Patent Document 5).

  The conventional one-selection virtual switch using the first and second alternative selection opportunities is mainly proposed for Japanese kana characters, and in particular, the characters used for the first alternative selection opportunity. In Japanese kana characters, characters representing the group and each character of the character group selected at the second alternative selection opportunity are well known since childhood. From the relationship based on the Japanese syllabary diagram, only the characters related to the consonant written in the first alternative selection opportunity, and the character group selected in the second alternative selection opportunity is the consonant selected first. Because of the well-known relationship that five vowels can be selected and combined with the characters related to, it is possible to obtain a character that requires selection. In the first to select the target character of the selection target Alternatively selection is adapted to be easily.

  In a Japanese syllabary diagram, a group of characters represented as characters related to the same consonant is represented as a row, a vowel added to the consonant is represented as a column, and a matrix of 10 rows and 5 columns (column). ).

  For consonant-related characters, “Akasata Hamayawara” combined with the first vowel “A” in “Aiueo”, which represents the column, is used as the first character of the line as the representative character of the character group that combines five vowels. Has been.

  And in the notation of the Japanese syllabary, the notation that represents each line with the letters in the row is expressed as “A line”, “Ka line”, “Sa line”,. The five characters included in each line are usually familiar to those who are native speakers of Japanese.

  Furthermore, since the number of vowels is five, the characteristic of the Japanese syllabary diagram is that the number of sets of one character group selected at the first alternative selection opportunity is five, Assigning 5 switches to alternative selection means of alternative selection, adopting one cross in the center and four cross-type virtual switches in its four sides, means for detecting central push and lever tilting in four directions It is easy to adopt a real switch (see Patent Documents 3 and 4), and the virtual switch of the first alternative selection opportunity and the virtual switch of the second alternative selection opportunity are superposed on each other. In the second selection opportunity, the virtual switch is configured in a cross shape (cross characters) so as to tap the central virtual switch and flick the four virtual switches (see Patent Documents 4 and 5). For character input divided into two selection opportunities Information, using the characteristics that specific to the Japanese syllabary view, main components of the character selection to the feature relies.

  FIG. 18 (b1) is similar to (a1) in that each character group selection virtual switch S2 and each character group selection virtual constituting the first alternative selection opportunity in the conventional standby screen P2 using a Japanese syllabary diagram. It shows an example of a graphic Q2 representing an alternative selection character group displayed on the key top of the switch S2.

(B2) shown on the right side of the above (b1) in FIG. 18 indicates that characters included in the character group of each character group selection virtual switch S2 are displayed as the second alternative at the second alternative selection opportunity in (b1). An example in which an index is displayed according to the allocation position of the selected virtual switch W2 is shown in the same manner as that used in the description of the implementation procedure of the present invention.
This is because the character group selection virtual switch 4 of the first alternative selection virtual switch 5 on the character input standby screen 3 of the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital television 32, or the like. , And the second alternative virtual switch 11 can be used.

  In the standby screen (P2) shown in (b1) above, each character group selection virtual switch S2 has a 3 × 3 matrix structure, and nine character group selection virtual switches S2 are used for inputting kana characters. .

  At that time, that line and line are assigned to virtual switches of the same character group, and the number of virtual switches of the first alternative virtual switch W2 is grouped into 9 in a 3 × 3 matrix. is there.

  This example is based on the relationship between the real address of the base real keyboard corresponding to each character group selection virtual switch of the virtual keyboard when constructing the virtual switch of the alphabet, Korean and other languages of the present invention. In order to maintain compatibility, even a virtual keyboard that supports the Japanese syllabary used for character input has a 3 × 3 matrix.

  FIG. 18C1 shows the character assignment of the Japanese kana keyboard 38 in FIG. 9C based on the real key address of the real keyboard shown in FIG. 10, as shown in FIG. The real key address is assigned to the virtual keyboard using the two alternative virtual switches 2, and the kana characters assigned to the same keys as those of the alphabetic keyboard 37 in FIG. , And a Japanese kana keyboard 38 emulated on the virtual keyboard of the character group selection virtual switch 4 is shown.

  (C2) shown on the right side of the above (c1) in FIG. 18 indicates that characters included in the character group of each character group selection virtual switch 4 are displayed as the second alternative at the second alternative selection opportunity in (c1). An example is shown in which similar graphics similar to the character arrangement of the second alternative virtual switch 11 are indexed as the graphic 9 based on the allocation position of the selected virtual switch 11. This is because the character group selection virtual switch 4 of the first alternative selection virtual switch 5 on the character input standby screen 3 of the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital television 32, or the like. , And the second alternative selection virtual switch 11.

  18 (d1), the alphabet keyboard 37 is assigned to the first alternative selection virtual switch 5 and the second alternative selection virtual switch 11 in the manner shown in FIGS. The virtual keyboard of the character group selection virtual switch 4 is emulated.

  (D2) shown on the right side of the above (d1) in FIG. 18 indicates that the character included in the character group of each character group selection virtual switch 4 is replaced with the second alternative at the second alternative selection opportunity in (d1). Based on the assigned position of the selected virtual switch 11, an index is displayed, and waiting for character input on the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital television 32, etc., shown in FIGS. On the screen 3, it is used as an example of the first alternative selection virtual switch 5.

  FIG. 18 (e1) shows the character (moji) assignment of the Korean Hangul keyboard 39 in FIG. 9 (d) based on the actual key address of the actual keyboard shown in FIG. Assigned to the actual key address of the virtual keyboard, and in FIG. 13, each letter assigned to the same key as the character of the English keyboard 37 is assigned to the second alternative selection virtual switch 11, so that the Korean Korean keyboard 39 emulates the virtual keyboard of the character group selection virtual switch 4.

  (E2) shown on the right side of the above (e1) in FIG. 18 is the second choice of characters included in the character group of each character group selection virtual switch 4 at the second choice selection opportunity in (e1). Based on the allocation position of the selection virtual switch 11, an index similar to the character arrangement of the second selection / selection virtual switch 11 is displayed as the figure 9, and the tablet 1, the smartphone 7, the portable terminal 12, and the notebook computer are displayed. 14, on the character input standby screen 3 of the electronic dictionary 26, the digital television 32, etc., as an example of the first alternative selection virtual switch 5.

  19 (a) and 19 (b) show the character keyboard selection switch 4 and the second selection selection virtual in the first selection selection virtual switch 5 in the manner shown in FIGS. The alphabet keyboard 37 is assigned to the switch 11 to emulate the virtual keyboard of the character input standby screen 3, and the characters included in the character group of each character group selection virtual switch 4 are displayed at the second alternative selection opportunity. Based on the allocation position of the second alternative selection virtual switch 11, the first alternative selection virtual switch 5 based on the figure 9 displayed as an index with a similar figure to the arrangement of the second alternative selection virtual switch 11, It is shown in detail.

FIG. 19A shows a lowercase mode of alphabetic characters, and FIG. 19B shows the first alternative selection virtual switch 5 of the same uppercase mode of alphabetic characters.
19A and 19B, each character group selection virtual switch 4 that forms the first alternative virtual switch 5 in a 3 × 3 matrix is the character included in the character group selection virtual switch 4. A character representing the group is written in the center, and the left, right, top, and bottom characters in the second alternative selection virtual switch 11 displayed around the center at the second alternative selection opportunity are indices that form the fine character 10. It is written as a character.
The fine character 10 is an index that suggests that a corresponding character can be selected by flicking in the direction in which it is displayed or tapping it.

  The Japanese syllabary chart is a unique table that is well known to the Japanese and is not found in any language, even in the English Alphabed based on the most popular Greek language. There is no table or the like well-known to many people as a character group divided every five characters.

  There are also Chinese Pinyin tables and Korean anti-cut tables, but there are too many vowels and consonants, and the table is divided into multiple selection opportunities like the Japanese syllabary chart. Not suitable for use.

  An object of the present invention is to perform character input by emulating character arrays of real keyboards of many languages on a virtual keyboard without using a table specific to the language.

  However, if a person in a country where the spread of electronic devices is delayed cannot use the native language immediately after holding the electronic terminal for the first time, the spread of the electronic devices cannot be further promoted. If it is impossible to recognize in advance what kind of character is assigned to each character group of the second character group selection and selection opportunity at the character group selection and selection opportunity, practical application becomes substantially difficult. .

  Therefore, as the second alternative selection virtual switch 11, a display pattern representative of the character group of the character group selection virtual switch 4 similar to the image of the virtual switch displayed there is formed, and the display pattern is displayed for each character. The graphic 9 of the group selection virtual switch 4 is used, and characters attached to the graphic 9 as a pattern are used as index notation.

There are a number of alternative selection means having a plurality of choices that explicitly display the contents of each choice and make a choice.
For example, in the virtual switch imaged in the same joystick as the tilting switch shown in Patent Document 5 and the characters displayed in the tilt direction of the tilting actual switch of Patent Documents 1 to 4, There is a display of selectable characters that are explicitly shown in the switch direction of a movable switch object (animation display by animation).

  However, in the conventional character selection means using a virtual switch that selects a required character from a character set including a plurality of characters included in one attribute, the first and second opportunities for selecting a character are selected. The selection target characters are narrowed down, and the virtual switch characters displayed in the second alternative selection opportunity are explicitly displayed on the virtual switch display screen of the first alternative selection opportunity. 1st alternative selection according to the size of the display screen of the virtual switch of the first alternative selection opportunity and the alternative selection virtual switch of the second alternative selection opportunity None of the occasions allowed direct selection of explicitly displayed characters.

  FIG. 19 shows each character group selection virtual switch 4 of the first alternative selection virtual switch 5 in the character input standby screen 3 similar to FIG.

  In FIG. 14, each character group selection virtual switch 4 is drawn with a square frame key top pattern 9c so as to divide the area of the virtual switch, and a waveform underline is added to the key top pattern 9c. A graphic 9a representative of the character group included in the character group selection virtual switch 4 is drawn.

  In FIG. 19, as shown in FIG. 3 (c), the second alternative selection opened when the character group selection virtual switch 4 is selected instead of the square frame key top pattern 9c in FIG. A figure 9 with an assist display frame 9b representative of a character group included in the character group selection virtual switch 4 is drawn, which is similar to the display pattern of the virtual switch 11.

  The graphic 9 is representative of a character group with an assist display frame 9b in which fine characters 10 representing each character are arranged in four directions and surrounded by a surrounding line and a waveform underline in the center so as to suggest the selection direction of each character. The figure 9a to be displayed is shown as a representative of the character group included in the character group selection virtual switch 4 with assist display.

  FIG. 20 shows the first alternative virtual switch 5 on the character input standby screen 3 displayed on the tablet 1 in FIG. 1. The touch panel 2 of the tablet 1 has a larger display area than the display screen of the smartphone 7. Therefore, the character input standby screen 3 displayed on the tablet 1 is enlarged as compared with the character input standby screen 3 of the smartphone 7 shown in FIG.

  The relative dimensions of the first alternative selection virtual switch 5 and the second alternative selection virtual switch 11 on the character input standby screen 3 of the smartphone 7 shown in FIG. 11, the areas for dividing one virtual switch region are substantially the same, and the 3 × 3 matrix arrangement of the first alternative virtual switch 5 is the same as the arrangement of the key top pattern 9 c in FIG. 14. In order to achieve matching, a slight space is provided between the switches. Apparently, the matrix shape of the first alternative virtual switch 5 is slightly larger than the matrix shape of the second alternative virtual switch 11. ing.

  However, the key top area of each character group selection virtual switch 4 in FIGS. 3 and 14 and the size of the nine virtual switch areas divided by the second alternative selection virtual switch 11 are substantially the same area. The size of the character input standby screen 3 in the smartphone 7 is a standard size for the finger 8 that is determined as a pointer that allows the finger 8 to operate properly.

  The relative size of each character group selection virtual switch 4 of the first alternative selection virtual switch 5 and the second alternative selection virtual switch 11 on the character input standby screen 3 shown in FIG. 3 and FIG. The same applies to FIGS. 16 and 17.

  In FIG. 20, the size of the character input standby screen 3 is enlarged without changing the size (relative dimension with the finger 8) of the second alternative selection virtual switch 11, and the first alternative selection virtual switch 5. FIG. 20 shows the arrangement of each character group selection virtual switch 4 in FIG. 20, in which the finger 8 is touched to the character group selection virtual switch 4 at the upper left corner in which the character “t” is represented in the figure 9. A state in which the second alternative selection virtual switch 11 of the character group is opened is shown.

  In FIG. 20, the size of the switch area of one character group selection virtual switch 4 in the first alternative selection virtual switch 5 and the overall size of the second alternative selection virtual switch 11 are displayed substantially the same. ing.

  In FIG. 3A and FIG. 20, the second alternative selection virtual switch 11 to be opened later is illustrated in a transparent state for comparison between the two virtual switch areas and is displayed in advance. The character group selection virtual switch 4 is normally closed and is not displayed, but in this figure, it is displayed in a non-closed state.

  20 and 3A, as described above, the relative size of the second alternative selection virtual switch 11 and the finger 8 (the ratio of the thickness of the finger to the pitch of the virtual switch) is the same in each figure. Shows what you did.

  At this time, when the flick operation is performed from the position where the finger 8 selects and touches the character group selection virtual switch 4 in both cases, the second alternative selection virtual switch 11 has an alternative selection function for detecting the behavior. In addition, since the relative size of the second selection / selection virtual switch 11 (the pitch of each virtual switch) and the thickness of the finger 8 are the same, the flick action by the second selection / selection virtual switch 11 is detected. The resolution is the same for both.

  Further, even when the second alternative selection virtual switch 11 remains open and any character is selected by tapping, the detection resolution is the second alternative selection virtual switch 11. Therefore, the resolution for detecting the tap by the finger 8 does not change.

  In FIG. 20, the size of the switch area of one character group selection virtual switch 4 and the overall size of the second selection selection virtual switch 11 in the first alternative selection virtual switch 5 are displayed substantially the same. Has been.

  Each character group selection virtual switch 4 in FIG. 20 displays a graphic 9a representative of a character group with a waveform underline in the center, an assist display frame 9b around it, and a central part included in the character group in all directions. Four figures other than characters are arranged, and a graphic 9 representing a character group included in the character group selection virtual switch 4 with an assist display is displayed.

  FIG. 21 shows the key top pattern 9c of each character group selection virtual switch 4 in FIG. 13 replaced with a frame 9b with an assist display, and the figure 9 with an assist display of each character group selection virtual switch 4 is shown in FIG. It is similar to the alternative selection display image of the alternative selection virtual switch 11 shown in FIG.

  In FIG. 20, the finger 8 touching the upper left character group selection virtual switch 4 of each character group selection virtual switch 4 of the first selection selection virtual switch 5 is in the state of touching the display screen and the second selection A state where the one-selection virtual switch 11 is opened is shown.

  When the overlap between the two virtual switches, that is, the character group selection virtual switch 4 and the second alternative selection virtual switch 11 is compared with the second alternative selection virtual switch 11 as shown in FIG. The four small characters 10 and the characters corresponding to the selected characters displayed on the virtual switches arranged in the 3 × 3 matrix in the virtual switch 11 are displayed almost superimposed.

  In this state, the virtual switch 11 is displayed in an open state and waits for the next operation.

  In the state where the second alternative selection virtual switch 11 is opened, the alternative selection of each character is a tap operation in which each display character of the 3 × 3 matrix is directly touched and touched out as it is. One of the characters will be selected.

However, the center character is selected by tapping, but if the touch-out is a separate character region, the character in the touch-out region is selected.
That is, in the opened second alternative selection virtual switch 11, flick input is enabled.

  The detection resolution of the finger 8 in this alternative selection operation is determined by the pitch of each virtual switch in the 3 × 3 matrix of the second alternative selection virtual switch 11.

  From the above, in FIG. 20, the pitch between the small characters 10 in the frame 9 b with the assist display displayed on the character group selection virtual switch 4 in the first selection selection virtual switch 5 is the second selection selection. Since the pitch of the virtual switch corresponding to the selected character in the virtual switch 11 is substantially equal, the character displayed in the small character 10 is directly displayed at the first alternative selection opportunity in which the first alternative virtual switch 5 is displayed. It can be seen that selecting an alternative by attacking has the same resolution as an attack to the second alternative virtual switch 11.

  FIG. 22 (a) shows a state in which lowercase letters in the normal mode of English letters are input as in FIG. 19 (a), and FIG. 22 (b) shows uppercase letters in the shift mode of alphabetic letters in the same manner as in FIG. 19 (b). The first alternative selection virtual switch 5 in the input state is shown.

  In FIG. 22, in the frame 9b with an assist display of each character group selection virtual switch 4 of the first alternative selection virtual switch 5, the character 10 is omitted, and instead the pointer touch is detected at the position of that character. An example in which a virtual switch area is provided is shown.

  In FIG. 22, a circular chain line is displayed so as to surround the display character there, centering on the display of the left, right, top and bottom thin characters 10 in the assist display frame 9 b, and the inside of the circular chain line is a character detection The touch detection virtual switch area 21 is a virtual switch that senses the touch of a pointer.

  In addition, a circular chain line provided around the figure 9a representing a character group with a waveform underline at the center constitutes the original first alternative selection virtual switch 5 to achieve the alternative selection function. This is a touch detection virtual switch area 22 in the group selection virtual switch 4. When a touch of a pointer such as the finger 8 is detected in this circular chain line area, the second selection selection virtual switch 11 is opened.

  Each of the diagrams (b2), (c2), (d2), and (e2) shown on the right side in FIG. 18 can be applied to the character input standby screen 3, and a frame with an assist display of the first alternative selection virtual switch 5 is shown. If the touch detection virtual switch area 21 for character detection indicated by the circular chain line is provided in the portion of the thin character 10 shown in 9b, and the resolution of the pointer used corresponds to the touch detection virtual switch area 21, In the first alternative selection opportunity by the first alternative selection virtual switch 5, it is possible to select a target character.

  For example, the tablet 1 in FIG. 1 or the notebook computer 14 in FIG. 5 with a large screen touches the touch detection virtual switch area 21 with the finger 8, and the mobile terminal 12 in FIG. 4 or the electronic dictionary 26 in FIG. 6. The touch detection virtual switch area 21 is directly touched with the stylus pen 13 and a desired character can be input without opening the second alternative selection virtual switch 11.

  Similarly, on the digital television 32 of FIG. 7 and the character input editing screen 17 of FIG. 8, the character input editing screen 17 is enlarged and displayed, and the touch detection virtual switch area 21 is directly clicked by the pointer 35 and the second The desired character can be input without opening the alternative selection virtual switch 11.

  FIGS. 23A and 23B show the first alternative selection virtual switch 5 of the kana keyboard 38 of FIG. 9C which is the same as FIG. 18C2.

  FIG. 23A is a diagram representing a character group included in the character group selection virtual switch 4 by providing each character group selection virtual switch 4 in the first alternative selection virtual switch 5 with a frame 9b with an assist display. The touch detection virtual switch region 22 is provided at the position of the figure 9a representing the character group with the waveform underlined at the center of each character group selection virtual switch 4.

  In this example, even if the character of the small character 10 is tapped, the event for selecting the character does not occur. The character of the fine character 10 only suggests the character arrangement of the second alternative selection virtual switch 11.

  FIG. 23B shows a touch detection virtual switch area 21 provided at the position of the fine character 10 in the assist display frame 9b attached to each character group selection virtual switch 4 in FIG. In the display state of the selection virtual switch 5, it is possible to select by touching the character of the thin character 10 directly.

  The character arrangement of the first alternative virtual switch 5 with the kana keyboard 38 of FIG. 23 and the first alternative virtual switch 5 of FIGS. 18 (a1) (a2) and 18 (b1) (b2) are compared. Accordingly, in FIG. 18A1 and FIG. 18B1, the second alternative selection virtual switch 11 has only the figure 9 without the assist display frame 9b and having the character representing the character group. The Japanese character group is easily predicted from the table of the Japanese syllabary chart for Japanese whose native language is Japanese. However, a predetermined rule is followed regarding the arrangement direction and order of characters.

  For example, when selecting one of “Kakikukeko” in the line, “ka” is displayed in the center as the figure 9a representing the character group in the line, and can be selected by tapping the center. It is a rule.

  Next, for the four characters “Kikukeko”, decide where to place the next character after “ka” in the left / right / up / down direction, then place them clockwise or counterclockwise. The rule determines in advance whether or not to place them, so after touching the center “ka”, flicking in the expected direction of the target character allows the target character to be entered. By knowing the cross diagram, the target character can be easily input without the assist display frame 9b and the thin character 10.

  However, in the first alternative selection virtual switch 5 of FIG. 18 (c1) that emulates the character arrangement of the kana keyboard 38 with the same kana characters, the right hand, left hand, second stage, Prediction can be made from the arrangement image of the kana keyboard 38 such as the fourth stage, the fourth stage, the uppermost stage with numbers, etc., but in order to quickly open the second alternative selection virtual switch 11 or quickly flick input Proficiency is required and a great deal of training is required.

  In the first alternative selection virtual switch 5 of FIG. 18C2 and FIGS. 23A and 23B, each character group selection virtual switch 4 is provided with an assist display frame 9b. The target character that requires (input) is displayed either in the center of the assist display-attached frame 9b or in the portion of the small character 10, and can be searched visually.

  When a character group including the target character is found, the next selection is confirmed depending on whether the target character is a character representing the center character group or the thin character 10 in the assist display frame 9b. Prepare to attack, if it is the middle character, prepare to tap quickly, touch the desired character (touch-in), and quickly release the touch (touch-out).

  If the target character is located on the left, right, top, or bottom of the assist display frame 9b, prepare to slide the touched pointer in the direction of the target character and touch the center character. (Touch-in), then quickly move in that direction and release the touch (touch-out).

  That is, the behavior of the pointer at this time is commonly referred to as a flick, and this behavior is also referred to as a gesture.

  In the present invention, the character selection behavior of the pointer is one character one behavior, in other words, one character can be selected with one touch (one touch), and one touch at this time is a tap, and a flick And also a gesture.

  FIG. 23B is similar to FIG. 22 in FIG. 23A around the thin character 10 of the assist display frame 9b of each character group selection virtual switch 4 in the first alternative selection virtual switch 5. In FIG. This is an example in which a touch detection virtual switch region 21 is provided.

  Also in FIG. 23 (b) and in FIGS. 8, 18 (d2), 22 (a) and 22 (b), the display area of the first alternative selection virtual switch 5 on the character input standby screen 3 Is larger than the display area of the second alternative virtual switch 11 and the touch detection virtual switch area 21 provided at the position of the small character 10 can sufficiently identify the pointer, the first alternative In the first alternative selection opportunity displaying the selection virtual switch 5, a desired target character can be directly selected.

  Depending on the resolution of the touch panel 2 or the monitor screen 34, the size of the second alternative virtual switch 11 may be slightly different depending on the case of the finger 8 or the stylus pen 13 or the pointer 35 such as an arrow. Although it may be changed, in one type of image display screen, a substantially constant resolution is maintained in a mutual relationship with the pointer to be used.

  However, it may be more convenient to use the display screen of the first selection / selection virtual switch 5 by changing the size of the display screen of the application even in one type of electronic device terminal. Therefore, it is preferable to change the size freely.

  In this case, if the size of the first selection / selection virtual switch 5 is smaller than the size (usually constant) of the second selection / selection virtual switch 11, the character at the position of the small character 10 is used. In some cases, the first selection / selection virtual switch 5 cannot be directly selected.

  However, the touch detection virtual switch area 22 of the figure 9a representing the character group with the waveform underlined at the center in the first alternative selection virtual switch 5 has a resolution that can distinguish between adjacent ones sufficiently. Therefore, the touch detection virtual switch region 22 is touched to switch to the second alternative selection virtual switch 11, and the second alternative selection virtual switch 11 detects touch, tap, and flick, Enter the desired target character.

  In the tablet 1 of FIG. 1, since the first alternative virtual switch 5 can be displayed in a large size, it is displayed in the assist display frame 9 b of each character group selection virtual switch 4 in the first alternative virtual switch 5. The character 10 can be directly selected and entered.

  Also, in the selection using the stylus pen 13 in FIGS. 4 and 6, since the substantial resolution is higher than that of the finger 8, each character group selection virtual switch 4 in the first alternative selection virtual switch 5. It is possible to directly select and input the character of the fine character 10 displayed in the assist display frame 9b.

  Of course, in any example of the display screen of the first alternative virtual switch 5, the touch detection virtual switch region 22 provided around the figure 9 a representing the character group with the waveform underlined at the center is touched. It is possible to input characters by touching, tapping, and flicking after that, and the operation procedure of the selection operation is arbitrary, but when the resolution for discriminating the fine characters 10 of the first selection selection virtual switch 5 is low As described above, the second selection / selection virtual switch 11 must be opened before it can be input properly.

The selection of the operation procedure can be appropriately determined by the character input operator according to the situation, so that it is not necessary to provide a special control means.
However, from the ratio of the display area of the first alternative virtual switch 5 and the display area of the second alternative virtual switch 11, the touch detection virtual switch area 21 in the first alternative virtual switch 5 is determined. Since the resolution can be predicted or estimated (substantially calculated), the reaction of the touch detection virtual switch region 21 can be regulated according to the resolution.

  In the first alternative selection virtual switch 5, the state in which the characters of the fine characters 10 displayed in the frame 9 b with the assist display can be directly selected and input is operating the actual keyboard shown in FIG. 9. In other words, one character is selected by one touch (the same applies to FIG. 6 of Patent Document 4).

  However, as in the present invention, a graphic 9 representing the character group included in the character group selection virtual switch 4 is displayed, and the character group of the first alternative selection opportunity is searched for that graphic 9, The process of searching for the target character at the second alternative selection opportunity from the character group is a character string (hereinafter referred to as a word) that has one meaning, such as one word or idiom, spelling a plurality of characters. Abbreviated to "hand" or "gesture", a hand movement, eye movement, stylus pen tip movement, arrow pointer movement, etc., and a mapping relationship corresponding to each other. It is established.

  “Swing” or “gesture” corresponding to this word (hereinafter, abbreviated as “hand gesture” representing the movement of the hand with the fingertip as a pointer) opens the second alternative selection virtual switch 11 and flicks it. In the operation procedure that mainly performs the operation, it always passes through the graphic 9a representing the character group with the waveform underlined in the center, taps and flicks from the graphic 9a as a starting point, and the waveform is formed at the center of the next character. It moves toward the figure 9a representing the underlined character group, continues for the number of characters of the word, and ends one word.

  The “hand gesture” for moving the fingertip in order to input the character string of one word always follows a certain route (route), and is stable without changing the route.

  Next, when “hand gesture” in which the same word as the above word is input by directly touching the character of the thin character 10 of the assist display frame 9b in the first alternative selection virtual switch 5 is checked, the fingertip has a waveform in the center. Pass the vicinity of the figure 9a representing the underlined character group, make the figure 9a a visual target point, move the fingertip toward the target character in the vicinity, tap at the position of the target character, The graphic 9a representing the character group with the waveform underline in the center of the next character is set as the next visual target point, the fingertip is moved toward the vicinity, and the target character is found in the vicinity of the graphic 9a. Tap it and continue this action for the number of characters in the word to finish one word.

  Even when the second alternative selection virtual switch 11 is opened and a word is input, or when the word is input by directly tapping the thin characters 10 of the assist display frame 9b in the first alternative selection virtual switch 5, The “hand gesture” route in one word, the sense of distance and direction until touching and tapping are almost the same. Regardless of the operation procedure, the operation procedure to the other can be done with very little correction. It can be changed to "hand gesture" with high closeness.

  The operation procedure including the flick operation after the second alternative selection virtual switch 11 is opened can be input at high speed. However, in order to obtain a continuous flow for the “hand gesture” operation, the proficiency level should be increased. Is required.

Note that when the second selection selection virtual switch 11 is opened, only the function of the virtual switch works even if the virtual switch 11 is not actually displayed, and the waveform is underlined in the center. When the finger 8 or the stylus pen 13 touches the touch detection virtual switch area 22 provided around the figure 9a representing the character group, the second alternative selection virtual switch 11 is substantially opened.
Therefore, the tap and flick input by the second selection / selection virtual switch 11 can be executed at a high speed immediately before the second selection / selection virtual switch 11 is displayed.

  In the operation procedure of directly tapping the thin characters 10 of the assist display-attached frame 9b in the first alternative virtual switch 5, a degree of concentration for accurately tapping an appropriate position rather than the operation speed is required.

However, by continuing the operation procedure of directly tapping the fine character 10 and mastering the “hand gesture” route related to the word, it is possible to increase the skill level that enables high-speed input by flick operation.
Further, when the display area of the first selection / selection virtual switch 5 is small and the resolution is such that the character of the thin character 10 cannot be directly selected, the touch detection virtual of the graphic 9a representing the character group with the waveform underline is represented. The switch area 22 is touched to open the second alternative selection virtual switch 11 to perform flick input. The flick input when the second alternative selection virtual switch 11 is opened is indicated by a small character 10. Regardless of resolution, it is always executable.

  By making it possible to execute both of these input procedures at the same time, even beginners can input without actually being confused while slowly visually confirming them, and training to fully master them. It is possible to perform.

  In addition, when an input procedure using flick input is used, high-speed input is possible, and when fully mastered, as shown in FIGS. 11 and 13 to 17, without using the assist display frame 9b, the key top pattern is used. Only the figure 9a representing the character group with a waveform underline in the center of 9c is displayed, and the character input standby screen 3 can be displayed with a simple structure and used.

  In such a state, a simple standby screen similar to the character input standby screen 3 using the Japanese syllabary diagram shown in FIGS. 18A1 and 18B1 can be obtained.

  FIG. 24 shows a first alternative virtual switch for the Hangul keyboard 39 shown in FIG. 9D with the conversion procedure shown in FIGS. 10 and 12 based on the actual key address shown in FIG. 18 (e1), the assignment of the Hangul alphabet of the real keyboard in the Hangul keyboard 39 is emulated in the virtual switch to each character group selection virtual switch 4 and the second selection selection virtual switch 11 in FIG. Each character group selection virtual switch 4 in the first alternative selection virtual switch 5 for Hangul character selection applied to the character input standby screen 3 for Hangul character input is shown.

  25 assists each character group selection virtual switch 4 in the first alternative selection virtual switch 5 shown in FIG. 18 (b2) around the figure 9a representing the character group with the waveform underlined in the center. FIG. 25 shows each character group selection virtual switch 4 in the first alternative selection virtual switch 5 for selecting the Hangul alphabet similar to FIG. 24 and provided with the display-attached frame 9 b and the fine character 10.

  FIG. 26 shows each character group selection virtual switch 4 in the first alternative selection virtual switch 5 shown in FIG. 24 with a figure 9a representing a character group with a waveform underline at the center of the key top pattern, Each character group selection virtual switch 4 in the first selection selection virtual switch 5 and the second selection, similar to FIG. 13, showing the relationship between the letters assigned to the second selection selection virtual switch 11. The assignment of each letter of the one selection virtual switch 11 is shown.

  For each language other than the English alphabet, the Japanese kana character, and the Korean Hangul alphabet described above, each language assigned to the same actual keyboard as the undefined keyboard 36 shown in FIG. Each character group selection virtual switch 4 in the first selection selection virtual switch 5 for applying characters to the character input standby screen 3 on the basis of the actual key address attached to the undefined keyboard 36, and the second It is possible to emulate a virtual switch for character input consisting of the alternative selection virtual switch 11.

  In the above embodiment, the character group selection virtual switch 4 of the first selection selection virtual switch 5 is set so that all the character key areas of the undefined keyboard 36 correspond to the virtual keyboard of the character input standby screen 3. Are arranged in a 3 × 3 matrix, but the character occupied by the finger 8 or the stylus pen 13 is reduced even in an electronic device having a small area image display monitor by reducing the area occupied by the first selection / selection virtual switch 5. In order to enable input, two character group selection virtual switches 4 related to the numbers on the left side (L) and right side (R) of the fifth stage in FIGS. 9B and 9D, and the other ( E) The three character group selection virtual switches 4 of the character group selection virtual switch 4 of the symbol are omitted, and each of the character group selection virtual switches 4 shown in FIG. 3, FIG. 14, FIG. 3x3 The matrix arrangement may be 3 rows × 2 columns by omitting one column on the right side from the 3 × 3 matrix in FIG.

In addition, each character group selection virtual switch 4 in the matrix arrangement of 3 rows and 2 columns is rotated in the counterclockwise direction with each column and each character group selection virtual switch 4 having the left column at the top and the right column at the bottom. Thus, a matrix arrangement of 2 rows and 3 columns can be applied to the character input standby screen 3.
Furthermore, the character group selection virtual switches 4 with only the six characters can be arranged in one row or one column and applied to the character input standby screen 3.
By doing so, the flexibility of the display form of the virtual keyboard can be enhanced when the image display monitor in various computer terminals coexists with the display screen of the application.

  As described above, the character input standby screen 3 including the character group selection virtual switch 4 and the second selection selection virtual switch 11 in the first alternative virtual switch 5 according to the present invention is a standard real keyboard. Are emulated in a multilingual virtual keyboard, and each terminal and language used in each electronic device terminal such as the tablet 1, the smartphone 7, the portable terminal 12, the notebook computer 14, the electronic dictionary 26, the digital TV 32, etc. A human interface that forms usage situations that are equal to each other is provided without causing individual differences between the two.

  The present invention is not limited to the above-described embodiment, and can be implemented in various modified forms without departing from the scope of the claims.

DESCRIPTION OF SYMBOLS 1 Tablet 2 Touch panel 3 Character input standby screen 4 Character group selection virtual switch 5 1st alternative selection virtual switch 6 Mode switching virtual switch 7 Smartphone 8 Finger 9 Graphic 9a Graphic 9b representing the character group with the waveform underline Assist display Attached frame 9c Key top pattern 10 Fine character 11 Second selection virtual switch 12 Mobile terminal 13 Stylus pen 14 Laptop 15 Main body 16 Second screen 17 Character input edit screen 18 Input character display screen 19 Predictive word display screen 20 Text edit Screen 21 Character detection virtual switch 22 Character group detection virtual switch 23 Right hand 24 Left hand 25 Predictive word narrowing tab 26 Electronic dictionary 27 Lid 28 First monitor screen 29 Main body 30 Upper surface 31 Second monitor screen 32 Digital television 33 Browser 34 Monitor screen 35 Pointer 36 Defined keyboard 37 alphabetic keyboard 38 Kana keyboard 39 Hangul keyboard

Claims (2)

In a real keyboard with a standard key layout for selecting a desired character from a character set including a plurality of characters included in one attribute,
A group of five keys for each step operated with the left hand and a group of five keys for each step operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing the character group,
On the other hand, in a virtual keyboard that displays characters representing a character group and selects one of a plurality of characters arranged around the character,
A plurality of character groups defined in the real keyboard are assigned to each key of the virtual keyboard, while maintaining the order of the steps of the real keyboard, and by assigning other characters around the representative character in the center,
A method for emulating a multilingual virtual keyboard, wherein a character arrangement of a real keyboard of a character set encompassed by one attribute is emulated to a character arrangement of a virtual keyboard. In an actual keyboard with a standard key layout that selects a desired character from a character set including a plurality of characters included in one attribute ,
A group of five keys each operated with the left hand and a group of five keys operated with the right hand are divided into character keys to which each character of the character set is assigned, thereby defining a plurality of character groups. The key group operated with the left hand determines the character of the rightmost key, the key group operated with the right hand determines the character of the leftmost key as a character representing each character group, and maintains the order of the steps of the actual keyboard. A plurality of character groups are assigned to a plurality of virtual switches, and a first selection selection virtual switch for selecting each character group is configured.
A first selection selection means for selecting one of a plurality of character groups, wherein the first selection selection virtual switch is displayed on the image display screen and selected by the pointing means; ,
A plurality of characters in association with the selection of the first selection selection virtual switch, in which a plurality of character groups determined on the actual keyboard are centered on the representative character and other characters are assigned around the character group. And a second alternative selection means for selecting a desired character by selecting a second alternative virtual switch for selecting one of the above by using a pointing means. A featured multilingual virtual keyboard.

Images