KR20050119112A - Unambiguous text input method for touch screens and reduced keyboard systems - Google Patents

Abstract

A method for entering text unambiguously. The method includes detecting, on a screen, sensor pad, or reduced keyboard system, a stroke across of an individual character or symbol; and displaying the character or symbol unambiguously. This allows for unambiguous inputting in reduced keyboard systems without the need of changing modes or auxiliary keys.

Description

UNAMBIGUOUS TEXT INPUT METHOD FOR TOUCH SCREENS AND REDUCED KEYBOARD SYSTEMS}

The present invention relates to clear text input for screen, sensor pad or pen based input with sensors in any keyboard system and arrangement of characters. It also does not have a method for switching modes between additional buttons, soft keys or indistinct text input and intelligibility text input, for example, in order to supplement the intelligibility key stroke method, for example, TenGo (Singapore Patent Application No. 200202021- 2) allows a clear text input system to be executed unauthorizedly for the reduced keyboard system. The invention also relates in particular to touch screen or soft key text input applications in mobile devices, cellular telephones, handhelds, PDAs, pocket computers, tablet PCs, sensor pads or any pen-based and virtual keyboard systems.

The growth of PDAs, handhelds and mobile devices has taken place in a phenomenal short time. In almost every place you go, everyone carries unorganized mobile devices. The emergence of this new era has proliferated online text-based communication. Online text communication has been initiated by computers and the Internet and has become accepted and popular with short message services (SMS). Email has in fact formed communication for personal and business, and compact electronic devices have become smaller, more functional and highly integrated. Unidirectional directed by mobile phones, handhelds, PDAs, and pocket computers is online text-based communication in one or more forms, such as email, SMS, or instant messaging (IM).

For text entry, pen-based paradigms have been offered in the handheld market, but this is in parallel with the use of keyboard-based technology. Pen-based input utilizes an object for writing on a screen using handwriting recognition to decode the “digital ink” left by tapping or writing the stylus, finger or virtual keyboard on the screen. Pen-based tapping is inconvenient with small virtual keyboards that appear on the screen or large buttons that damage the display area, while apparently "more natural" pen-based writing (signature) is slow and not accurate enough to achieve high user expectations. However, the maximum bottleneck of signature entry allows a person to limit the signature speed. In terms of speed and efficiency, keyboard entries are still the fastest and most convenient for text-based communication. Thus, with the significant and growing demand for online text-based communication, many device manufacturers are forced to use small, full-size QWERTY keyboards. Visually appealing small keyboards are prone to accidental text entry as the keys are too small and too close. Because of this, a reduced keyboard system that uses predictive text input is another alternative that appears to be promising because of space limitations and large buttons, but text input (eg, unpredictability similar to the multi-tap or double key stroke method). Or a more efficient mode of clear text entry), which causes problems when pressing keys of words that are not in a dictionary or database that often require mode changes. Examples of general clear text input methods of multi-tap, double keystroke or multi-stroke translation are disclosed in US Pat. Nos. 6,011,554 and 6,307,549 for reduced keyboard systems.

Various attempts have been made to improve the pen-based tap method incorporating the forward prediction engine for the pen-based tap method and the clear text input for reduced keyboard systems. The main problem with the pen-based tap method is that it is so small to type correctly that it often requires tapping a virtual button that generates a failure when the wrong key is pressed, and still requires a great deal of attention and attention when tapping. Thus, it is not surprising that users often use mobile text-based applications such as email and word processing only for reading and not for writing. Text input on a mobile device takes up most of the limited time only for filing short messages, short notes and contact information.

In the present invention for inputting screen text instead of tapping character keys, you can simply stroke across the characters. By implementing these strokes or writing methods for clear pen-based text input, they require less concentration and attention, and because of the more generous flexibility of handwriting, which allows inaccurate starting points and quick adjustments with only a slightly longer step process than tapping. Accurate. Quick adjustments can also be made easier because of the digital ink traces left behind the virtual keyboard during writing. The digital ink trajectory provides distinct visual feedback to the user to properly guide the user to make any adjustment quickly to write the correct letter. The elegant design for pen-based text entry can be implemented in any virtual keyboard design or character arrangement and character format (for example, Chinese characters, Japanese characters, Chinese and Japanese stroke symbols, etc.) without requiring a change in device form factor. have.

The writing method has two functionalities in a keyboard system reduced by constant intelligible text input with indistinct text input (eg, without the need for a mode change button). Unauthorizedness is created by the present invention to enable identification of two different forms of input of the same key (eg, tap versus handwriting). The reduced keyboard keys allow multi-character keys to function normally for opaque text input when tapping and to accept clear text input when writing. This applies equally to reduced keyboard systems using physical keys by simply providing better degrees of freedom allowing the keys to move in the opposite direction to the tapping direction, thus simulating strokes for individual characters. This is done by having a multi-directional key (with a normal tap mechanism) that is a multi-character key or having a multi-character key composed of individual keys that can be moved in the opposite direction of the tapping direction.

Gestures or strokes based on the input itself have been used in computer systems as "shortcuts" for command operations such as file open, file close, file execution, and the like, and are not novel. For pen-based text entry, it is also used on Windows CE standard keyboards to make it easier to enter basic characters in uppercase letters. This is done by touching the letter to be capitalized and sliding the pen up, and an uppercase version of the touched letter is displayed. The Windows CD standard keyboard also detects backspace by sliding the pen to the left and detects space when the pen slides to the right. In US Patent Application No. 20030014239, the slide is also used for pen-based text input to enter accents or other extended characters by having different slide directions, the slide length determining various versions or customized outputs of the touched letters. do. The main problem with the Windows CE standard keyboard and US patent application 20030014239 is that it still requires touching a small virtual button / key that represents a letter before sliding. In the writing method of the present application, you can actually start the slide by touching a button space of another letter, and the slide through the detection area of the letter to be inputted enters the letter. Another major difference is that the present application is used for the actual selection of the desired letters without tapping, but the other solutions described above function while the slide still relies on tapping for the actual selection of accents, capitalization, extended letters or letters. As with the instruction based on, it is used to select an alternative shape of the selected letter. Only when the present invention uses handwriting consistent with tapping is used in virtual multi-character keys to create an unauthorized transition between obscure and clear text input. The use of a sliding method for unauthorized discrimination of obscurity and intelligible text input for reduced keyboard systems is included in US Pat. No. 6286064, but the sliding motion requires exactly touching each symbol of each key first. Also, in the prior art, the required character can be displayed to contact the writing movement in the detection area by displaying the rise of the pen from the screen or by identifying the other direction of the sliding movement after this length has been slid.

The present invention further improves the use of digital ink trajectories and line detection areas for fast detection, and the diversity with spacebar-like functionality is shrunk to lines or thin bars, saving space, but speeding up text input on the virtual keyboard. To do this, you can place the line space bar in a more strategic location.

These and other features, objects, and advantages of embodiments of the present invention may be better understood and readily understood by those skilled in the art from the following description with reference to the accompanying drawings.

1 illustrates a method of similarly displaying an on-screen keyboard (formerly a QWERTY keyboard) on a touch screen or screen input interface.

Fig. 1A shows a method of similarly showing an on-pad keyboard (a conventional QWERTY keyboard) on a sensor pad.

FIG. 2 illustrates a method of similarly viewing an on-screen reduced keyboard system (eg, TenGO) on a touch screen or screen input surface.

Fig. 3 shows a method of displaying the character input according to which the individual characters on the on-screen are traversed stroked.

4 shows an example of the detection area.

4A shows an example of the line detection area.

5 shows a writing method applied to a keyboard system with reduced hard keys having multiple letter keys composed of individual buttons.

Fig. 5A shows a writing method applied to a keyboard system with reduced hard keys having a joystick type multi-character key.

6 is a block diagram showing the main components associated with the software program of the present invention.

7 is a flow chart showing the main steps involved in the operation of the software program of the present invention.

8 is a flow chart showing the main steps associated with the input routine of the software program of the present invention.

Aspects of the present invention provide a method for a screen text input system, for clearly inputting a data value or data symbol of a virtual keyboard using a finger or an object to stroke across a character representing a keystroke of a virtual keyboard of a screen. Detecting a touch of the screen, detecting a stroke movement from a point of contact of the screen, and a detection area of the screen to which a data value or data symbol is assigned indicating a character displayed on the screen located or proximate thereto And matching the position points of the stroke path and displaying the data values or data symbols assigned to the transverse stroked detection area as text input.

Embodiments may include strokes over other gestures, such as circle drawing, traversing, cross drawing, and zigzag drawing on a character, and may have the same functionality as the stroke over them. In addition, a gesture may be left behind the digital ink trajectory of the virtual keyboard during the gesture.

Another embodiment of the method of matching the detection area of the screen with the position point of the stroke path is performed in a matching order having the most appropriate or the least common to the most common or final common detection area.

In another embodiment, a detection area representing a character is within or covers the character, and the character detection box may have any shape and size. In addition, the detection area may be a detection line that traverses or adjoins the character. In addition, the detection line is visible on the keyboard. In addition, the spacebar can be displayed as a single line or thin bar on the virtual keyboard, which is selected as the detection line.

Another embodiment also includes displaying data values or data symbols in different cases, such as upper cases, phonetic symbols and accent forms or functions thereof, and wherein the auxiliary key or sticky auxiliary key (the meaning of the sticky is different) Requiring only pressing a secondary key once (eg, sticky shift) is used in conjunction with a gesture without the need to keep pressing and holding the key to work in cooperation with the key.

Another embodiment of the method has a character in which the first character of the gesture, ignoring any character after the gesture, is displayed. Optionally, the displayed character is the gestured final character ignoring any previous character that was gestured. Another variation is that the displayed character displays the most gestured character that ignores any other character that is gestured. In the detection line, the most gestured character is gestured close to the center of the detection line. In another variation, the characters are displayed in the gestured order of each character.

In another embodiment of the method, the screen is a screen or virtual screen that acts as a sensor object or sensor similar to a touch screen or sensor pad or pen based input.

In another embodiment of the method, the character may be one of the characters of a multi-character key. In addition, embodiments may be performed with input of multiple character keys if a character or multiple character key is tapped instead of stroked across.

Another aspect of the present invention provides a screen text input system, which includes a display routine for displaying a virtual keyboard on a screen, the data values and data symbols assigned to various detection areas of the virtual keyboard representing the displayed characters of the virtual keyboard. A stored set, an input routine for detecting a touch of the virtual keyboard and a writing path in contact with the virtual keyboard, a matching routine for matching the writing path and a detection area of the virtual keyboard and determining a selected detection area, a data value or data representing the selected detection area It includes an output routine that displays a symbol.

In this embodiment, the system incorporates an input method for the screen text input system.

Another aspect of the invention has a plurality of keys, each key having at least one property, said property being a data value, function or data symbol representing a keystroke of a keyboard, consisting of individual data values or data symbols. It is a multi-character key consisting of individual keys that represent, the key can move in the opposite direction of the normal tapping motion of the multi-character key, and does not require changing the mode between obscure and clear text input using the stroke text input method. An input method for a reduced keyboard system, the method comprising: moving individual character keys in a direction opposite to normal tapping for input of multiple character keys; Displaying the data value or data symbol that it represents. The. Optionally, instead of a multi-character key consisting of individual character keys, there is a single button that can be moved in multiple directions spaced apart from the tapping, each stroke consisting of individual character keys opposite to the tapping and moving stroke text input. The method is shown.

Another embodiment provides a method of displaying data values or data symbols in different cases, such as upper cases, phonetic symbols and accent forms, or functions, when auxiliary keys or sticky keys are used in conjunction with movement of individual characters against tapping. It may further include.

Another embodiment may further comprise the step of performing the multi-character key upon input if the button representing the character is tapped instead of the stroke and moved in the opposite direction of tapping. In addition, if more than one individual character key is tapped together from the same multi-character key set, a single multi-character key is performed upon input.

Another aspect of the invention provides a reduced keyboard system for entering information, comprising a plurality of keys each having at least one characteristic, a database for storing data, and a display for displaying information; The characteristic is a data value, function or data symbol representing a keystroke of a keyboard, the individual character indicating that the key consists of individual data values or data symbols that can be moved in the opposite direction of the normal tapping motion of a multi-character key. A multi-character key consisting of keys, the data being a data character or data symbol associated with the key's input keystroke sequence.

In another embodiment, normal multi-character keys do not require changing modes between ambiguity and clarity text input by moving individual character keys in opposite directions to tapping in order to enter characters clearly.

In another embodiment, a multi-character key consisting of individual character buttons is instead a single button that can be moved in multiple directions spaced apart by tapping, and the equivalent of the movements constituting the individual keys in opposite directions to each tapping direction. Indicates.

In another embodiment, the multi-character key functions upon input as the multi-character key is tapped. Multi-character keying input is any existing reduced keyboard as disclosed in US Pat. Nos. 5,818,437, 5,945,928, 5,953,541, 6,011,554, 6,286,064, 6,307,549 and Singapore Patent Application 200202021-2. The system is available.

Embodiments shown throughout this specification are considered by way of example and not by way of limitation.

As mobile devices shrink in size and include more text-based computer applications that require text entry similar to email and word processing, they are not only fast, easy and intuitive for the user, but also support or be used for extended text input. There is a challenge to provide a text input solution.

In general, there are two main types of software-based text input methods, including hardware-based text input methods similar to small keyboards, and mainly pen-based or touch screen methods similar to signature recognition and virtual keyboards, or hands-free methods similar to speech recognition. There is a solution. On the surface, it is a notable substitute for typing, and speech recognition through further improvements is still a matter of other human factors, such as inaccuracy, long training and learning durations, speed, privacy, and thinking and typing are more natural than speaking and thinking. Have difficulty. Because of the constraints and constraints of space, hardware-based solutions such as small keyboards with small buttons and keys are difficult to type and often errors occur by pressing keys of the wrong neighbors. Pen-based solutions are not superior to signature recognition and are still much inaccurate, slow, and require long learning exercises to train the recognition software. Other pen-based solutions similar to virtual keyboards face the same pitfalls as their hardware counterparts: small areas allocated on the virtual keyboard also have small buttons that require a lot of attention and attention to typing, and typos often occur. . Clearly, all solutions are impossible to provide a suitable text input platform for continuous or more intensive text entry.

The inventors have recognized that there are two main directions in creating a mobile text input solution that is easier to understand. One is more efficient than tapping a small virtual keyboard button, and the other is a reduced keyboard system that enables large keyboard buttons by reducing the number of keyboards required.

To type small buttons on the virtual keyboard, the applicants demanded a more tolerant method than tapping, which is slightly slow but requires too much attention and concentration. Thus, the present invention is a gesture or stroke input text input method. Gesture or Stroke Input The text input method utilizes a slower step process (gesture) rather than tapping to be a more efficient, accurate, and tolerant method of selecting characters from the on-screen keyboard. The method is based on a QWERTY keyboard similar to English, French and German keyboards, and also Fititaly [Textware Solutions Inc.-US Pat. No. 5,487,616], Opti I, It can be used in any way, including non-QWERTY keyboards such as the Opti II, Metropolis keyboard, and Chinese and Japanese keyboards.

The idea and object of the present invention is to have a more accurate, more tolerant, and therefore faster overall input method without requiring more attention and concentration when tapping a small on screen or on pad key. This is also improved with the present invention, which neglects the digital ink trajectory of the virtual keyboard, which is provided as a virtual feedback for the user to adjust his text input gliding. This periodically translates actions that hinder the more intensely focused tapping of errors, causing more interesting stroke gestures to be used for screen-based or pen-based text input. Applications of the present invention will be small, medium sized devices such as mobile devices, PDAs, handhelds, pocket PCs, cell phones, tablet PCs or virtual keyboards or any device using screen based or pen based input. 1 illustrates a method for on-screen execution of a virtual keyboard 12 that looks similar to a handheld device 10. 1A illustrates a method of on pad execution of a virtual keyboard 56 that looks similar to a typing surface pad 54. Surface pads 54 are generally linked to computer processor 52 and display 50, and text inputs are shown on separate screens 50 linked to the same computer processor.

The embodiments shown in the figures and the systems described herein are generally computer implementations that may be executed and / or known in the art. The functionality of the embodiments of the invention described above can be implemented in hardware or software mode. In the sense of software, system components may be processes, programs or portions thereof that generally perform particular or associated functions. In the sense of hardware, a component is a functional hardware unit designed for use with other components. For example, the components may be implemented using individual electrical components or may form part of an overall electronic circuit, such as an application specific semiconductor (ASIC). These are various other possibilities that exist, and those skilled in the art will clearly understand that the system can also be implemented as a combination of hardware and software components.

Personal computers and computing devices are examples of computer architectures in which embodiments may be practiced. Such computer architectures include a central processing unit (CPU) with a microprocessor, random access memory (RAM), read only memory (ROM), hard drive, memory stick, diskette or CD ROM, each of which temporarily and permanently stores information. Components and / or modules, such as mass storage devices, and the like. This computer architecture also includes a bus that interconnects the components and controls the information and communication between the components. In addition, user input and output interfaces are generally provided for user input with keyboards, mice, microphones, and the like, and for output with displays, printers, speakers, and the like. In general, each input / output interface is connected to the bus by a controller and executes controller software. Of course, it is apparent that any number of input / output devices may be implemented in such a system. Computer systems are typically controlled and handled by operating system software residing on the CPU. These are a number of operating systems commonly utilized and known. Thus, embodiments of the invention may be implemented within and / or within this computer architecture.

Stroke input The text input method can be implemented by software, hardware and hybrids thereof. In general, if the softkey is executed purely through software, for example by means of a virtual keyboard on a touchpad, the device on which the stroke input text input method is typically executed may be an operating system, a BIOS (basic input / output system), a display. And input mechanisms (ie, touch screen and stylus). The software for stroke input text input method then comprises a software program (covering these methods) written in a programming language supported by the operating system, and a stored database covering the assignment of data values and data symbols with a detection area. Include.

Stroke input If the text input method is implemented with a keyboard system reduced in hardware, for example as a hardkey accessory, the hardware may include a processor, memory modules such as ROM / RAM, input mechanisms such as buttons, keys, etc. and mobile devices, PDAs, handhelds. Interface sockets to devices such as computers, mobile phones, console devices, and the like. Various combinations are possible. Programs and databases may be stored in a processor, a comprehensive microprocessor that drives programs in memory modules and memory and relays information to display and interface sockets. The program can also be mapped to a database stored in a memory module and a processor, for example a digital signal processor (DSP). In general, the processor is the main central unit. At the input of the input mechanism, a signal is sent to the processor. The processor, for example, processes a signal or queries memory when a program is stored in the processor, and processes information in memory with respect to the signal from the input / output device. The processor of the hardware solution of the reduced keyboard system may output a signal to the display and / or via an interface socket to a device, for example a PDA, a hardware accessory or the like.

In a hybrid solution, for example, the memory of a running device, such as a PDA, can be used to store programs and databases via software or software drivers, and similarly to the first case described above, the processor of the device to process the program. Use The hardware may include input mechanisms such as buttons, keys, sensors, and interfaces. If the input mechanism is installed on the device, for example with additional buttons, the interface can be a simple wired or wireless means to connect and communicate with the device. If the input mechanism is on an external device such as an accessory, the interface may be an interface socket similar to the second case described above, and the display may be implanted on a hardware solution similar to the previous case with an accessory or the display of the device Can be used.

Of course, in order to implement a reduced keyboard system of hardware, it can be connected by wires similar to circuit boards for housing circuits, processors, memory, etc., and the housing mounts entire hardware components such as buttons, displays and circuit boards. .

Handwriting or stroke crossing

Because tapping is a momentary step process, it also makes it more tedious and inconvenient to use to select lowercase letters or characters in small virtual buttons that require a lot of attention and concentration and still make a lot of mistakes and need to make a lot of error correction. do.

What is required is a slightly longer process step that is not only intuitive, easy and quick to use, but also reduces the need for concentration. The "slow down" process step is in the form of a gesture on the character required to enter the text instead of tapping it.

Many gestures may be used to delay process steps such as drawing circles, traversing, crosshairs or zigzag drawing, but they are one desirable gesture that is a cross stroke or handwriting of a character. Handwriting is desirable because, unlike tapping, it is generally faster than other gestures that provide enough delay to prevent you from requiring too much attention on your handwriting. It acts for a screen with any touch screen input or sensor pen or sensor input or for a virtual keyboard or sensor pad with sensor pen and sensor detector. Basically, all ways in which letters can be written can be written in numbers, alphabets or punctuation.

Handwriting gestures further improve using digital ink trajectories reflected on the virtual keyboard during handwriting exercises. This provides the user with real-time visual feedback, makes it easy to adjust "on the fly," and the user can actually see his notes.

3 illustrates an example of a writing method that may be used to select characters of the virtual keyboard 156 for the handheld device 150. The user uses an object for writing to the letter “y” 160 of the stylus pen 158 or the keyboard 156. This enters the character in which the text cursor is present in display 152. As can be seen, the handwriting can begin with the neighboring letter “g” 161, thereby creating more flexibility and error tolerance for the user.

Example 1 to illustrate the validity of a handwriting with two small rectangles positioned slightly spaced apart to simulate distance separation, such as on-screen keyboard, is as follows.

When comparing between quickly alternating tabs between two rectangles and quickly stroke across two boxes, you will have more hits (rectangle touch) / minutes, fewer mistakes, and more rectangular notes Requires less effort.

Detection area

The main mechanism of the present invention is to make more efficient writing, achieve without requiring attention, and the tap of a small button uses the detection area. All previous gesture methods are similar to US Pat. No. 6,286,064 and US Patent Application No. 2003-0014239, which all require initial contact with the displayed key.

The detection area for characters will be a detection box (any shape or size) that covers or is smaller than and maintained within the character. In the use of the detection area, the user can start writing by touching the button space of another character and sliding through the detection area of the required character. 4 shows detection areas 202, 210, and 214 assigned to characters 204, 208, and 216 and free spaces 205, 209, and 215, which are combined with detection areas to make the selection of characters more tolerant to errors. Created between each normal button space 200, 206, 212. The detection area makes the error tolerance more tolerant at the start of the handwriting motion because of the increased space between the detection areas (ie, start writing in any free space 205, 209, 215 without the start of any input), Too small a detection area makes it difficult to detect writing on a character. As can be seen, the detection region acts the same as any character or symbol (ie Chinese character 216).

Also in the prior art US Patent Application No. 2003-0014239, a sliding method is used to select an alternating form of a character, such as an accent, uppercase letter, an extended character, or a function based instruction, and in the present invention, for tapping for actual selection of letters. Still relying on, handwriting is an improvement in tapping to select characters from clear virtual keyboard input.

The detection area mechanism is greatly improved when used with the line detection area as described below, which is a preferred embodiment of the present invention.

Line detection area

4A may be assigned on characters 244 and 250 to which normal button spaces 240 and 248 are assigned. This embodiment creates more space between line detection areas to select characters more tolerant of errors (larger space between line detection areas), but reduces the difficulty of selecting characters through writing. That is insufficient. Again, the line detection area can work equally well for any character or symbol (eg, Chinese character 250).

Example 2 to illustrate the effectiveness of the line detection area, with two small rectangles (represented by the box detection area) positioned slightly spaced to simulate distance separation, such as on-screen keyboard, is as follows.

Next, two lines (to indicate the line detection area) slightly spaced apart to simulate distance separation of an on-screen keyboard or the like are drawn below.

When comparing the fast alternating writing between two rectangles and the quick cross stroke of two lines, it is easier than writing across the lines and attention is required to prevent writing another area first. It seems that less attention is required than writing.

By extrapolating the result of the entire virtual keyboard with all the characters in close proximity to each other, you will know the validity of the line detection area. The detection line can be shown on the virtual keyboard to facilitate writing.

With the line detection area, it is possible to combine with a space which functions like a space bar into a single line or thin bar. The selection of this function can be simplified to write across the line or thin bar, depending on the normal line detection area. Lines or thin bars make it easier to execute / position the function of an area or space to maximize text input efficiency and minimize the space consumed. An example of how the line spacebar is performed is shown by vertical line 110 in FIG.

The flexibility and capability of the detection area is also implemented using selection rules.

Selection rules

By the detection area, in particular the detection line area, it is very easy to write characters with small virtual buttons without the need for attention, concentration and obstructions associated with the small buttons. Since it may have a starting point of handwriting at any location, no selection rule is required to determine which handwritten characters are selected.

Basically there are four rules that can be used to determine which characters are selected.

1. Character where the first detection area to be written is selected

2. The character whose last detection area to be written is selected

3. A detection line written most closest to the center in the selected character-line detection area means the most-written detection area. In the boxed detection area, this may be a detection area that is cut closest to half or the most gestured detection area (eg, a gesture of circle drawing, cross drawing, zigzag, etc.).

4. All of the detected detection areas are characters selected in the order in which they were written.

In rules 2 and 3, it is meant that the selection decision can only be made after a touch contact has ended (eg, after the pen has fallen off the screen) or after a fixed time interval after contact with the surface. Rules 1 and 4 do not require the touch contact to end to provide the best flexibility, but provide the best response time and speed. Rule 1 is a preferred embodiment as it allows for more "casual" writing so that there is no need for attention and concentration where writing is more natural and desired after writing. In other words, the handwriting can be more "lacklustre" by reinforcing the ease, naturalness and fun part of the present invention without compromising speed or effectiveness. Using Rule 1, clear text input using the writing method can be very quick and easy without having to worry about the first touch and movement after writing across the desired detection line. The selection of letters takes place simultaneously with crossing the bass detection line. This is different from the prior art which requires lifting the pen from the screen before the selection can be determined or requiring sliding in a given line and / or direction before the character selection can be determined.

Entering a Specific Character or Function

Auxiliary keys are used in cooperation with handwriting to enter characters in different cases, such as upper cases, uppercase letters, phonetic symbols, accents, extended characters or function calls. By selecting and writing a supplementary key to select a character, certain characters are displayed or a function is performed. A preferred embodiment may be arranged to execute a sticky auxiliary key that does not require the auxiliary key to be pressed simultaneously with writing. The auxiliary key requires only one press before writing (the flag is activated) and is followed by entering the required character.

Certain characters or functions are defined in the database with characters, data values and data symbols associated with each detection area.

Screen text input system

Gesture or stroke input text input methods may be implemented in pen-based systems and devices as software programs or device drivers. 6 shows the main components associated with a software program for the screen text input system according to the present invention. The screen text input system 300 has a function associated with a virtual keyboard display 306 having a detection area 302 at an appropriate location for input, and a character displayed on the virtual keyboard and any particular character or auxiliary key and sequence of detection areas. A software program 300 having a database 308 for storing a set of data values and data symbols assigned to various detection regions representing a representation, an input routine 302, a matching routine 304, as well as an output routine 306. Or device driver 300. The database primarily resides in memory 310 (e.g., email, word processor, spreadsheet), and all applications 314, software program 300 or device driver 300, and memory are Windows CE or Palm. May operate under the control of an operating system 312, such as an OS.

7 shows the main steps associated with the operation of the software program. As shown at 302 in FIG. 6, the input routine detects the touch on screen 350 followed by the writing movement 352. As shown in FIG. At this time, a matching routine as shown at 304 in FIG. 6 may monitor the writing path and match any detection area 354. When the detection area is touched or traversed (eg, using rule 1 of the detection rule), the matching routine detects the handwritten detection in combination with a data value, data symbol, specific character or any auxiliary key 360 pressed. The function matching the area is retrieved and the information is passed to the output routine as shown at 306 in FIG. The output routine can be displayed on the display of device 356 where the cursor or input point is currently located. If a handwriting movement is not detected at 352 following the touch 350, the touch operates according to the normal touch input of the keyboard, or, if touched by the reduced multi-character button of the keyboard system 358, then touches the normal multi-character. Works accordingly.

8 illustrates a method by which the input routine analyzes the handwriting motion and matches with the detection area (ie, the line detection area). When the first touch is detected on the virtual keyboard 400, the contact coordinates are retrieved as X ₁ and Y ₁ 402. The handwritten motion is traced and each coordinate detected is retrieved 404 at individual time intervals 1 through n, which are generally determined by the operating system as X _n and Y _n 406. Line equations are calculated as the writing progresses from X _n-1 and Y _n-1 to X _n and Y _n 408, and these line equations are written if any line region is written (eg, two line equations). Blocked between the equations) is matched during the writing process 410 with the equation of the line detection area.

A database in which an auxiliary key stores not only a detection area combo but also a set of data values and data symbols assigned to various detection areas is shown as follows.

Detection area text X ₁ Y ₁ , X ₂ Y ₂ q X ₃ Y ₃ , X ₄ Y ₄ w X ₅ Y ₅ , X ₆ Y ₆ e X ₇ Y ₇ , X ₈ Y ₈ r X ₉ Y ₉ , X ₁₀ Y ₁₀ t ... ...

X ₁ Y ₁ , X ₂ Y ₂ show the coordinates of the opposite coordinates of the detection long direction box (X _x is the horizontal axis and Y _y is the coordinate of the vertical axis). If a shape other than a rectangle is used (eg a triangle), more coordinates can be used, or in the case of a circle a center point and radius can be used. In a preferred embodiment of the detection line region, X ₁ Y ₁ , X ₂ Y ₂ are X ₁ Y ₁ , X ₁ Y ₂ for the vertical line and X ₁ Y ₁ , X ₂ Y ₁ for the horizontal line.

For the combo of the auxiliary key plus detection area, the database is as follows.

Auxiliary key, detection area text Shift, X ₁ Y ₁ , X ₂ Y ₂ Q (uppercase / upper case) Shift, X ₃ Y ₃ , X ₄ Y ₄ W Shift, X ₅ Y ₅ , X ₆ Y ₆ E Auxiliary 1, X ₅ Y ₅ , X ₆ Y ₆ 2, X ₅ Y ₅ , X ₆ Y ₆ 3, X ₅ Y ₅ , X ₆ Y ₆ ё ... ...

Thus, in the above database example, pressing the shift (sticky shift) and writing the detection area (X ₅ Y ₅ , X ₆ Y ₆ ) selects and displays the letter "e" as the letter "E" in the upper case, Pressing the auxiliary key 1 (sticky auxiliary key) and writing the detection area (X ₅ Y ₅ , X ₆ Y ₆ ) "And display.

In order to match the routine more efficiently, the detection areas are stored in order from the most commonly handwritten characters to the most commonly unwritten characters. The most common letters used in this list can easily be obtained from any desired or referenced statistics. By using the simple common letters used in the list to set up the database, this ensures that the matching routine always matches the handwritten coordinates / equations from the first (most common) detection area that is used most often to the second most frequently used. do.

An example of English characters arranged in order from most commonly used to least commonly used (when used in a QWERTY keyboard layout) is as follows.

E, T, A, O, I, N, S, H, R, D, L, C, U, M, W, F, G, Y, P, B, V, K, J, X, Q, Z

Thus, a database that stores data values and sets of data symbols assigned to various detection areas is as follows.

Detection area text X ₁ Y ₁ , X ₂ Y ₂ e (most often used) X ₃ Y ₃ , X ₄ Y ₄ t X ₅ Y ₅ , X ₆ Y ₆ a ... ... X ₂₆ Y ₂₆ , X ₂₆ Y ₂₆ z (least used)

Reduced keyboard system

The stroke input text input method is particularly useful for clear text input for reduced keyboard systems, for example TenGO (Singapore Patent Application 200202021-2). This allows to perform clear text input without the need to switch modes from normal obscure text input and without the need for additional buttons. It is also a direct clear text input method that does not require an alternate multi-step method similar to the multi-tap and two-step method disclosed in US Pat. Nos. 6,011,554 and 6,307,549 for reduced keyboard systems.

The main factor is to allow the stroke input text input system to distinguish between handwriting and tabs so that distinct text input (handwriting) and obscure text input (tab) can be distinguished at the same time. The use of a sliding method for unauthorized discrimination between indistinct and clear text input for a reduced keyboard system has already been disclosed in US Pat. No. 6,286,064, but the sliding motion must first touch each symbol of each key in advance. There is. This does not need to be the case with the improved stroke input text input system herein. In fact, any individual virtual key need not represent the individual characters that make up the multi-character key 106 as shown in FIG. 2 illustrates how a reduced keyboard system is implemented in the handheld device 100. The reduced keyboard system generally consists of a virtual keyboard 104 and a database 108 consisting of multiple character buttons 106. The characters can be displayed normally on a multi-character key and start typing indistinct text that can be determined by the clarity algorithm by tapping the multi-character key, and writing individual characters (e.g., detection area) starts the clear text input. And display a character representing the first detected detection area (eg, using Rule 1 of the selection rule). This can be easier and faster when using a virtual reduced keyboard system in a pen-based device to switch between clear and unclear text input.

This same method can be applied to reduced keyboard systems using physical keys by simply using physical multi-character keys that can simulate "writing" movements in the opposite direction to normal tapping or pressing of the keys. In the present invention, there are two preferred embodiments for implementing the stroke input text input method for a physically reduced keyboard system.

Normally, a reduced keyboard system has large buttons that run similarly to a normal keyboard, as disclosed in Singapore Patent Application 200202021-2, but the same multiple (to compress space and utilize large buttons to improve text input). Having individual characters that assign letter keys or normals as disclosed in US Pat. Nos. 5,818,437, 5,945,928, 5,953,541, 6,011,554, 6,286,064, 6,307,549, and Singapore Patent Application 200202021-2. It has small buttons that do not resemble the keyboard, but can be represented in two ways that minimize the space utilized by the keyboard.

In the device of a large button, the writing method is a physical multiple consisting of individual keys represented to constitute the character 264 of the multi-character key 270 that can be moved in the opposite direction of the tapping motion as shown in FIG. It can be implemented in the shape of a letter key. 5 illustrates how a keyboard utilizing this method / mechanism 268 is implemented in the handheld device 260. When tapped or pressed, the individual buttons 264 are moved together as one 270, and a normal multi-character key is entered upon input. However, the individual keys can move in opposite directions (ie, up or down) to the tapping motion, which can simulate a "handwritten" motion, entered as clear text input, and represented by the individual keys. Display characters. In Fig. 5, the individual key " O " 264 is moved upwards, so that the letter " o " is entered where the text cursor currently resides on the display 266. Of course, if the "up" exercise is used for clear text input, the "down" exercise may be used to enter a specific character or function thereof.

In a physically reduced keyboard system using small keys or having only a small area (eg small form factor) for the keyboard, the writing method moves in multiple directions, in addition to the normal tapping motion as shown in FIG. 5A. Can be implemented in the form of a physical multi-character key that is a button (e.g., joystick button 288). 5A illustrates how a keyboard 288 using a joystick-like button 288 may be executed on the handheld device 280. Thus, in order to enter the individual characters clearly, each direction is represented by the characters represented by the multi-character keys 288 (eg, "Q", "W", "E", "R", "T"). Each individual character in a set of " In general, since the multi-character key does not represent more than five characters of the basic set (without using a secondary key or menu / selection list), the preferred embodiment is a multi-direction in five directions towards a semicircle as shown in Fig. 5A. Direction. In FIG. 5A, the multi-character key 288 is moved to the right, thus entering the character "t" at the position where the text cursor is currently present in the display 282. In FIG. Of course, fewer directions may be used for multi-character keys with less than five characters, or more directions (eg, backward semicircle direction, pull, clock and counterclockwise twist, etc.) may be capitalized, accented, extended Or may be implemented to accommodate a non-literal based set such as a phonetic alphabet character or function.

Thus, moving a button in various directions clearly selects / displays data values or data symbols or even functions associated with the button and the direction of movement. This integrates clear text input (directional input) and unclear text input (tapping) for a physically reduced keyboard system.

Of course, clear text input for a reduced keyboard system operates in accordance with conventional clear text input for functions such as storing new words in a library.

Gesture or Stroke Input Certain design factors that consider and implement text input methods are frustrations when tapping small soft-keys on the screen for small mobile devices such as handhelds, PDAs, mobile phones, pocket PCs, and tablet PCs. . Quick application and low teaming curves, QWERTY-type keyboards such as English, French and German keyboards, for entering text, without compromising the display screen size (ie, larger buttons), and also Compatible with all manner of keyboards, including Fitaly (Textware ^TM Solutions Inc.-US Pat. No. 5,487,616), Opti I, Opti II, Metropolis keyboards and even non-QWERTY-type keyboards such as Chinese keyboards, Japanese keyboards, etc. There is a need for a better and more efficient way. The developed method does not require the ability to change modes between indistinct and intelligible text input, and is run on a reduced keyboard system using multi-character keys to allow unauthorized execution of intelligible text input for reduced keyboard systems (virtual keys or Use any one of the physical keys).

Tapping on small buttons or characters is a problem, allowing for adjustment of the fly, but with less error frequency and fewer user errors, accelerating overall text input, and due to less need for attention and attention There is a need for a processing step with a more flexible starting point that takes slightly longer time than tapping to increase the user's skill level (because accuracy is resistant and allows adjustment). Accordingly, gesture or stroke based text input has been developed. Preferred embodiments of gestures are transverse strokes or handwriting, although slower, all other gesture-like circle, cross, cross-cross or zigzag movements and the like are applicable. Thus, in handwriting, only a cross stroke of any character of the keyboard on the screen is all that must be done with the stylus, finger or the object, and the character is input. Handwriting does not have to place the starting point on the letter itself. In fact, the starting point may be another button, and may be a movement of handwriting through the character desired to be input. This works for a screen with any touch screen input or sensor pen or sensor input or even a virtual keyboard or sensor pad with a sensor pen or sensor detector. Basically, any type of character can be written, which can be numbers, alphabets, symbols, punctuation, and the like.

The emphasis of the handwriting can be made such that the digital ink trajectory is shown on the virtual keyboard during handwriting to guide the user in the handwriting operation and serve as visual feedback.

To enable more effective writing, instead of forming the character in the detection area, a detection box (any shape or size) that covers the character or is smaller than the character and retained within the character may be used. A preferred embodiment of the detection area is a line traversing the text (which may be visible or invisible to the user). All the user has to do is to write across the line and the characters are considered stroked across. This enables ultra-fast handwriting operation and even adds elements of pleasure to text input. An additional use of line detection is to reduce the space consuming functions like spacebar with a single line or thin bar. Thus, the selection of a function is simply to write across the line representing the function. As a line or thin bar, it becomes much easier to place functions within one area to minimize space occupancy and optimize text input flow.

The logic that determines which character is written is that the first character, the last character, or the stylus that has been written out of contact with the screen / surface, or after a predetermined time interval since the start of the handwriting, The area percentage of the written detection area). In the use of the preferred embodiment where a transversal line of characters is used as the detection area, then, the good logic for determining the handwritten character is the first character across which the detection line is handwritten.

The handwriting element means that any auxiliary key or sticky auxiliary key (sticky only needs to press the auxiliary key once, without having to hold the key down in order to work in concert with other keys-eg sticky shift) Harmonization can be used to create special variations of handwritten characters such as capital letters, identifying characters or even function calls.

The writing method works well with multi-character keys in a reduced keyboard system, since the writing is characteristically different from tapping, so there is no need to invalidate the original obscure tapping function. Thus, for multi-character buttons, reduced keyboard systems such as TenGO or T9® (Tegic Communications, Inc.), iTAP ^™ (Motorola, Inc.), eZiText® (Zi Corporation) or WordWise® (Eatoni Ergonomics, Inc.). As used by the same number phone pad system, when a user taps on a multi-character button, the normal function is triggered, causing predictive text entry or multi-tapping, but writing over a specific character in the multi-character set If is made, at this time, the character is clearly entered without permission.

The extension of this method also applies to hard-key execution of the reduced keyboard system. This requires some changes to the hard button. In addition to the larger multi-character buttons that can be pressed, the buttons also consist of individual buttons representing individual characters of the character set that can be moved oppositely (eg, pulled up, pressed forward or pressed backward). Another alternative to multi-character buttons is to have a joystick-like move function or radial press function, in addition to pressing down in a straight line, each move or directional press represents one character in the character set of the multi-character button.

In view of the above description, the integer of the embodiment of the present invention is to provide a less real way of entering text clearly on a small virtual button, and also to incorporate unambiguous text input and clear text input. will be. Although referred to letters, the teachings of the system of the present invention can be easily extended to any symbol, number or function. Many embodiments of the teachings of the present invention are possible, except those specifically described herein, and that do not extend beyond the scope of these teachings as defined in the appended claims. In particular, the application of the system is not limited to applications in conventional devices or mobile devices that require standard clear code or text input, and in other applications and embodiments, even recording surface pads, sensor pens, and optical or moving recognition inputs. It is also well suited for any electronic device that requires means for inputting strings of non-criminal characters, as long as it can detect "ultra-modern" (less conventional) or coordinates or distinguish handwriting movements, such as devices.

In addition, the text input methods described herein may be mixed-and-matched with other well-known word completion mechanisms to further reduce the number of key strokes required for some variety of text input. In addition, as long as the integer remains and the text input function is complete, not all methods and mechanisms have to be implemented to complete a reduced keyboard system, thus, cost, software size, implementation requirements and / or even It is possible to omit certain methods and mechanisms in order to reduce the functionality desired (but not critical) for some ownership.

Although embodiments of the invention have been described herein for purposes of illustration, it will be appreciated that various modifications may be made without departing from the scope of the invention. Accordingly, the invention is not limited except as by the appended claims.

Claims (48)

Input method for the screen text input system for clearly inputting data values or data symbols of the virtual keyboard using gesture and stroke input methods. Using a finger or an object to stroke across a character representing a key stroke on a virtual keyboard of the screen; Detecting a touch of the screen; Detecting stroke movement from a point of contact of the screen; Matching a location of the stroke path with a detection area of the screen to which a data value or data symbol indicative of a character displayed on the screen is assigned; And displaying the data value or data symbol assigned to the transverse stroked detection area as a text input. The input method of claim 1, wherein the gesture also includes circle, cross, cross and zigzag motion on a character, in addition to the cross stroke, and has the same functionality as the cross stroke. The input method of claim 2, wherein the gesture leaves the digital ink trajectory of the virtual keyboard during the gesture. The input method according to claim 1, wherein the matching of the position point of the stroke path with the detection area of the screen is performed most frequently or in matching order of least or last common detection area from the first common detection area. The input method according to claim 1, wherein the detection area representing the character is a detection box within or covering the character, wherein the detection box has any shape and size. The input method according to claim 1, wherein the detection area representing the character is a detection line traversing or adjacent to the character. The input method of claim 6, wherein the detection line is displayed on a keyboard. The input method of claim 6, wherein the space bar is represented by a single line or a thin bar of a virtual keyboard and is selected according to a detection line. The input method of claim 1, further comprising performing the normal button input when tapping instead of a gesture. The input method of claim 1, further comprising displaying data values or data symbols in different cases, such as upper cases, phonetic symbols, and accent type cases or functions when the auxiliary key or sticky auxiliary key is used in concert with a gesture. . The input method of claim 1, wherein the displayed character is the first character that is gestured, ignoring any subsequent characters that are gestured. The input method of claim 1, wherein the displayed character is the last character gestured, ignoring any previous characters that have been gestured. The input method according to claim 1, wherein the displayed character is the most frequent character of the gesture ignoring any other character of the less frequent gesture. The input method according to claim 6, wherein the displayed character is a gestured character closest to the center of the detection line ignoring any other characters gestured away from the center of the detection line. The input method of claim 1, wherein the characters display respective gestured characters in a gestured order. The input method of claim 1, wherein the screen is a screen or a virtual screen acting as a sensor object or a sensor similar to a touch screen or a sensor pad or pen-based input. The input method of claim 1, wherein the character is one of characters of a multi-character key. 18. The method of claim 17, further comprising the step of performing the multi-character key upon input if a character or multi-character key representing the character is tapped instead of the cross stroke. Screen text input system, A display routine for displaying a virtual keyboard on the screen; A stored set of data values and data symbols assigned to various detection areas of the virtual keyboard representing characters displayed on the virtual keyboard; An input routine for detecting a touch of the virtual keyboard and a writing path in contact with the virtual keyboard; A matching routine for matching the detection area of the virtual keyboard with a writing path and determining a selected detection area; And an output routine for displaying a data value or data symbol representing said selected detection area. 20. The screen text input system of claim 19 wherein the writing path in contact with the virtual keyboard leaves the digital ink trajectory of the virtual keyboard during writing. 20. The screen text of claim 19, wherein the matching routine matches the writing path with the writing path in a matching order from the detection area of the virtual keyboard to the highest frequency or the lowest frequency or the last common detection area. Input system. 20. The screen text input system of claim 19, wherein the detection area representing the character is a detection box within or covering the character, wherein the detection box can be any shape and size. 20. The screen text input system according to claim 19, wherein the detection area representing the character is a detection line crossing or proximate the character. The screen text input system of claim 23, wherein the detection line is viewed on a virtual keyboard. 24. The screen text input system of claim 23 wherein the space bar is represented by a single line or a thin bar of the virtual keyboard, which is selected according to the detection line. The screen text input system of claim 19, wherein the input routine detects a touch without a writing path of a virtual keyboard according to a normal button input. 20. The screen text input system of claim 19, wherein an auxiliary key or sticky auxiliary key is used in conjunction with a gesture to display data values or data symbols in different cases, such as upper cases, phonetic symbols, and accent type cases or functions. 20. The screen text input system of claim 19, wherein the matching routine ignores any next detected detection area that is written and determines the first detection area that is written as the selected detection area. 20. The screen text input system of claim 19, wherein the matching routine ignores any written previous detection area and determines the written last detection area as the selected detection area. 20. The screen text input system of claim 19, wherein the matching routine ignores any other less frequently detected detection area that is written down and determines the most frequently detected detection area as the selected detection area. 20. The screen text input system of claim 19, wherein the matching routine ignores any other detection area written away from the center of the detection line and determines the written detection area closest to the center of the detection line as the selected detection area. 20. The screen text input system of claim 19, wherein the matching routine determines that a detection region is selected for each stroked stroked region in stroked order. 20. The screen text input system of claim 19 wherein the screen is a screen or virtual screen acting as a sensor object or sensor similar to a touch screen or sensor pad or pen based input. 20. The screen text input system of claim 19 wherein the virtual keyboard is a reduced keyboard system having multiple character keys with each multiple character key representing a set of characters. 35. The screen text input system of claim 34 wherein the input routine detects a touch without a handwriting path in the multi-character key in accordance with the normal multi-character key input. A plurality of keys, each key having at least one characteristic, said characteristic being a data value, function or data symbol representing a keystroke of a keyboard, said key being opposite to the normal movement of tapping on a multi-character key It is a multi-character key consisting of individual character keys representing a configured data value or data symbol that can be moved, and is used to enter characters clearly without having to change modes between ambiguity and clarity text input using the stroke text input method. Input method of reduced keyboard system, Moving the individual character keys in the opposite direction to tapping according to the normal multi-character keys input; Displaying a data value or data symbol representing the individual character key. 37. The method of claim 36 wherein there is a single button that can be moved in multiple directions in addition to tapping instead of multiple letter keys consisting of individual letter keys, each direction moving individual letter keys configured in opposite directions to tapping. Input method that indicates. 37. The input method of claim 36, further comprising displaying data values or data symbols in different cases, such as upper cases, phonetic symbols, and accented type cases or functions when the auxiliary key or sticky auxiliary key is used in concert with a gesture. . 37. The input method of claim 36, further comprising the step of performing a normal multi-character key upon input if the button representing the character is tapped instead of stroked and moved in the opposite direction to tapping. 40. The method of claim 39 wherein if a same multi-character key is tapped together from one or more individual character keys, a single multi-character key is still performed according to the input. Reduced keyboard system for entering information Plural kiwis, A database for storing data, A display for displaying said information, Each key has at least one characteristic, the characteristic being a data value, function, or data symbol representing a key stroke of a keyboard, wherein the key is a configured individual capable of moving in the opposite direction to the normal movement of tapping on a multi-character key. Is a multicharacter key consisting of individual character keys that represent a data value or data symbol, Said data is a data character or data symbol associated with said key's input sequence of strokes. 42. The method of claim 41, wherein in order to enter characters clearly, the reduction does not require changing the mode between ambiguity and clarity text input as the multi-character keys move individual character keys in the opposite direction to normal tapping for input. Keyboard system. 42. The method of claim 41, wherein there is a single button that can be moved in multiple directions in addition to tapping instead of multiple letter keys consisting of individual letter buttons, each direction representing the same as moving individual letter keys configured in opposite directions to tapping Reduced keyboard system. 44. The method of claim 43, wherein in order to enter characters intelligibly, ambiguity and intelligibility text input as the multi-character key moves the button in a direction representing an individual data value or data symbol constituting it in a direction opposite to normal tapping for input. Reduced keyboard system that does not require changing modes between. 42. The method of claim 41, further comprising: shifting individual character keys in opposite directions to tapping to input data values or data symbols in different cases, such as upper cases, phonetic symbols, and accent type cases or functions. Reduced keyboard system used in concert. 44. The method of claim 43, wherein the auxiliary key or sticky auxiliary key represents the data value or data symbol in a direction opposite to tapping to enter a data value or data symbol in a different case, such as an upper case, a phonetic symbol, and an accent type case or function. Reduced keyboard system used in conjunction with moving a button in a direction. 42. The reduced keyboard system of claim 41 wherein a multi-character key representing a character is tapped for inputting the multi-character key in accordance with the input. 44. The reduced keyboard system of claim 43, wherein a multi-character button representing a character is tapped for input according to the multi-character key.