JPS63184130A - Input/output device - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

Detailed Description of the Invention (Disclosure Document) January 14, 1986 [Disclosure Document No. 144, 64 of 1 Application]
According to No. 4.

(Comparison of Related Applications) This application is a continuation-in-part of US Patent Application No. 06/8B9,513, filed July 25, 1986, which has already been abandoned.

FIELD OF THE INVENTION This invention relates to a keyboardless input system for a computer and, when combined with a central processing unit, to a computer system for non-keyboard input. Further, the present invention provides that text, data, computer commands and functions are entered by a human hand writing alphanumeric characters or other characters and symbols on a human output (Ilo) screen using a pen-like stylus. related to information storage, manipulation and transfer equipment. In one preferred embodiment, the I10 screen includes a transparent touch screen built into a substantially flat output display. The present invention has its desirable fruits '6
Although in some embodiments a self-contained computer system, it can also function as a peripheral to a host computer.

BACKGROUND OF THE INVENTION A large amount of information and sophisticated application software is available today on conventional keyboard computers. The utility of this information and application software can be significantly enhanced if text and data can be entered and processed by the application software by writing directly onto a flat display in the usual way. Good morning. Therefore, there is a need to extend the utility of computer technology to be used by individuals who are not adapted to keyboards.

There is also a need for a portable computer system that is lightweight, reliable, accurate, inexpensive, and can be used while standing or walking. One way to reduce cost and size and increase utility is to use keyboardless input systems such as touch screens. However, this type of input device
It does not easily enable accurate and intricate input within a real-time frame structure with high resolution in a way that is both familiar and natural to the user.

Many positioning techniques can be used to meet the requirements of input techniques for detecting position.

Physically, these requirements include accuracy, resolution, and speed. Techniques include mechanical, electrostatic, electromagnetic, acoustic, optical and inertial methods. A requirement in this system is that it can be used as closely as possible to writing on paper with a pen or pencil. One problem is proximity, ie, a pen on paper leaves a mark only when it is in actual contact.

Many of these approaches require a separate "pen down" sensor that is difficult to use in many commercially available pens. Another problem is the writing angle, and the pen leaves the same ffl'F trace regardless of the writing angle. Many of these methods shift the position detection side from the pen tip,
This results in incorrect displacement of the angle of the ben. Beyond the general problem of stiffness, each technique has many advantages and disadvantages in the following respects. Namely: (1) Ben: size, weight, shape, and whether power supply and/or wiring is required. (2) Depiction surface: transparency, smoothness, "feel",
and whether physical contact (such as resistance to pressure transmitted by stacked papers) is required.

Many self-contained devices for displaying and processing large amounts of information are known. Most use optical, magnetic, or solid-state electronic storage for data storage. An example of such a group of technologies is l1u
b income U.S. Patent No. 4. ! No. 59,417, the patent discloses a portable electronic book form for page-by-page selective retrieval of large amounts of digital data, which can be stored in a flat, solid-state format.・Display on screen.

The preferred embodiment in the 11ubincam patent uses an insertable holographic card that holds hundreds of pages of text in digital form as the primary storage device.
I-I can do it. However, the l1ub incam device cannot input or process new information or text.

Azurc, US Pat. No. 4,016,542, discloses an electronic data acquisition system that uses solid state random access memory (RAM) as its secondary memory.

This patent, which discloses a conventional keyboard for data entry, is close to a hand-held portable data storage and transmission system, as well as an LED display and various human output (Ilo) connectors.

US Pat. No. 3,487,731 to F.R.A.N.K. discloses a means for converting handwritten motions into character data through the use of a computer system. The disclosed invention is based on matrix pattern matching and does not use -number display technology.

11rown US Patent No. 4.4! II, 960, describes a system for the recognition of handwritten single symbols, in which a sequence of image points in the form of rask line sampling is converted into a list of segments that are filtered and compressed to obtain topological features; This feature is then analyzed by a logic tree decision mechanism.

U.S. Pat. No. 4,262,2 to
No. 81 discloses a handwriting recognition device. Although the disclosed embodiment is used by a host computer, it does not use a minus number notation.

Van Ilaamsdonk U.S. Pat. No. 4,475
, No. 239 discloses a text editing device. No. 4,75,239 calls for the use of paper as a medium for inputting editing functions and requires a conventional keyboard for text entry.

Viang US Pat. No. 4,521,909 shows a two-level pattern recognition system. This system is designed for use with optical equipment.

[; asLIcbcrry et al., U.S. Pat. No. 4,520.
: ] No. 57 discloses a system for displaying and inputting information on voltage detection using a writing stylus. The actual IM examples disclosed are not claimed to have speed or granularity that allows recognition of handwritten characters.

Other prior art disclosing portable electronic devices that provide large amounts of stored information in various forms include U.S. Pat. No. 4,218,760 to Levy;
No. 115,486, and Kr1akides et al. No. 3.9:+2. [Includes No. 159. The Levy and RIAKIDCS et al. patents relate to electronic dictionaries, while the 1.Ainc patent discloses a programmable television-like system. None of these devices disclose the use of handwritten input.

U.S. Patent No. 4,0 to Vl, l'cpper, Jr.
No. 71,691, No. 4.129.7117, No. 4.198, 5:19, No. 4,293,734, No. 4. : No. 102,011, No. 4.35:1,
No. 552, No. 4,371,746 and No. 4.
CIo, 917 discloses various methods or man-machine interfaces using fingertip touch. The preferred embodiments of each of these inventions lack sufficient speed and resolution to enable stylus handwriting recognition and are designed for other purposes. PeppCr U.S. Patent No. 4. :1
No. 18,096 teaches the use of a stylus that provides electrical conductivity. This U.S. patent No. 4. :II8,
No. 096 is concerned with graphic design, where the line [11] and line strength are varied by applying pressure to a stylus, and the results are displayed on a conventional CRT screen. Turner U.S. Patent Nos. 3 and 6
No. 99,4419 and Turner et al. No. 4,05
No. 5,726 discloses two methods for electronic position detection through the use of probes.

[Failure to solve the problem]

The present invention provides the ability to recognize and display legacy symbols, cause a computer to display font symbols, and, if desired, perform editing functions regarding editing symbols quickly, easily, and at a reasonable cost. It is a unique keyboardless computer system.

The present invention provides a computer housing with a flat display panel on which a user can "write" with a stylus, and a computer housing that recognizes handwritten symbols written on the panel with a stylus and displays these symbols. to the displayed font symbols, or alternatively the ability to perform editing functions with the editing symbols, all with minimal technical flexibility for the user.

Another feature of the invention is that once the keyboardless, portable computer is loaded with the required information and application software, it does not require any proficiency or knowledge associated with state-of-the-art computers or other data sources. The information and software should be available and responsive without having to do anything.

The ease of use of the input technology of the present invention enhances the utility of the computer for keyboard-adapted individuals. The portability of the present invention also allows it to be used in applications and settings where portable keyboard computers are difficult, difficult, or impossible to use. For example, many blank fully or partially completed forms may be stored in the memory of a portable computer. In hospitals, patient data "sheets" are stored in the memory of portable computers and can be recalled by nurses as they make their rounds, and relevant data such as blood pressure, body temperature, etc. are then manually recorded using a stylus. can be entered with .

These corrected or expanded forms can be downloaded into central computer memory.

The requirements for position sensing input techniques are accuracy (in points), resolution (in absolute positions) and speed (in points per unit time) to sufficiently define the archaic stroke order for recognition analysis.

For recognition devices and methods used today, the current minimum requirement is approximately 0.127
mm (0,005 inch) particle size, approximately 0.38I n
+ m (0,015 inch) resolution and 150 m/s
is the velocity of the point. This accuracy is approximately 6.5 mm with more than 10 input points along one stroke of a small character. :15mm (1
74 inches) thick writing lines are allowed. This resolution provides symbol positioning within 2 pixels on today's displays of 640 pixels for approximately 229 mm (9 inches). Said speed allows approximately 50 primary input points for one character written quickly (5 seconds).

One embodiment of the invention includes a transparent input screen. When a user writes alphanumeric characters or other characters or symbols on an input screen, the characters are represented as a stream of dots that emulates the input of a pen on paper. Once l! Once the lost alphanumeric characters and other characters or symbols are completed, they are converted into computer text or computer instructions and displayed on the display screen at a location preferably below the area on the input screen where this was entered. can be displayed. This embodiment also constitutes a pattern recognition algorithm that allows the conversion of written characters or symbols, such as ideograms and scientific symbols, into computer text.

In certain presently preferred embodiments, a keyboardless computer according to the present invention has a transparent touch screen.
a screen and associated electronic components located on a display screen of 80 columns x 25 lines or more, a stylus for data entry, a microprocessor and storage device, artificial intelligence/pattern recognition software and editing software, and a battery Tj. , a source system, and other I10 devices as an operation and display device.

In this text, a "handwritten symbol" is a symbol that can be handwritten and has an information conveying effect. Examples include, but are not limited to, numbers, letters, "kanji" (Japanese ideograms) or other language symbols, editorial symbols, and technical, scientific, architectural, and mathematical symbols that are handwritten symbols. It is. Other examples of handwritten symbols include free drawings, or signatures, or other written information such as those formed characteristically by a particular scribe. Handwritten symbols may also include editing symbols (defined below).

In this text, a "font symbol" is a computer-generated symbol that is displayed in a certain predetermined font format. As a non-limiting example, alphanumeric symbols are font symbols and are displayed in a numeric font format. Japanese or Chinese "ideographs" are also font symbols, and may be technical, scientific, mathematical, architectural, or other such characters. Other examples of font symbols include graphics that can be stored and displayed by a computer, such as an auto or house diagram.

In this text, an "editing symbol" means, when recognized, a specific editing function (defined below), such as inserting text (caret symbol), deleting text (horizontal line), or deleting character (short vertical line).
These are symbols (carets, horizontal lines, short vertical lines, long vertical lines, etc.) that cause the computer to perform the following, or to move margins (long vertical lines) and to type out lists in some typical cases.

``The editing function j is not limited to this example,
Refers to computer-generated text editing operations such as text insertion, text deletion, text movement, and text replacement.

The main editing functions are listed at the end of the text.

OBJECTS OF THE INVENTION Therefore, the main object of the invention is that normal computer functions are performed in the usual way using a pen-like stylus on an input screen placed directly on a flat display. An improved method and apparatus for providing a keyboardless computer is provided.

The provided keyboardless computers are intended for use by individuals who are not adapted to keyboards and who do use keyboards where the utility of the computer is enhanced, and for use in a variety of settings and applications where keyboard input is difficult or impossible. It has an ideal configuration.

It is also an object of the present invention to provide computer-based information and application software in a portable manner for later viewing, for processing text and data, and for adding new text and data in normal handwriting mode. The purpose is to provide a means by which the device can be loaded. The user can then send the computer text to another computer, a comparable device, external electronic storage, a hard copy printer, or even via a telephone communication system. Yet another object of the present invention is to provide a computer that is capable of recognizing old symbols with a high degree of granularity and that is capable of "learning" individual handwriting styles.

Yet another object of the invention is a portable keyboardless computer in which data and commands are entered by use of a stylus.

〔Example〕

Referring now to the drawings, in which like numerals refer to similar elements in different countries, and in particular to FIG. 1, a portable keyboardless handwriting input computer system 10 is shown. The entire computer system is contained within a housing 12, shown schematically in dotted lines, and includes a conventional general purpose digital microcomputer 14, which will be described in more detail below. Input information is provided to the microcomputer by writing or "writing" on the input screen 18 with the stylus 16. The stylus 16 (FIG. 2) is connected to the wire 17 (second
(Fig.) to the computer of the system 10. The stylus 16 displays "
A plurality of positioning signals representing coordinates of a plurality of corresponding positions are sent to the microcomputer 14. The microcomputer 14 is programmed to recognize the stream of positioning signals and store these signals in one memory of the computer according to a computer program described below. The programmed microcomputer 14 also provides a corresponding plurality of display signals to the display screen 2°. Both input screen 18 and display screen 20 are described in further detail below.

Referring now to FIG. 2, a perspective view of a keyboardless computer system IO embodying features of the present invention is shown. Keyboardless computer system IQ is housed within a housing 12, which is a rectangular sealed enclosure including a sloped top surface 22 having a multi-line solid state display area 24.

Input screen 18 is shown in FIG. 2A superimposed on display screen 20. Input screen 18 is shown in FIG.

In this example, the display screen 20 displays a plurality of horizontal lines 25 with the following markings.

That is, handwritten input is performed on each line 25. 2 between two tree lines
The distance or interval indicated at 6 is used by the system to normalize all distances, and the line 2m itself becomes the reference axis or base line.

Below the display area 24 on the top surface 22 is a key input section 26 consisting of a plurality of "soft keys" 28.

Soft keys 28 can be programmed by the operator for any purpose, such as inputting computer commands. Examples of commands for soft keys 26 include "store,""recall," and "delete." Furthermore,
Soft keys 28 can be used to switch between different programs or modes (data entry mode and edit mode). However, soft key 2
8 is of the highest rank and is used to supplement the input obtained by handwriting the input. The stylus 16 used to write input data and commands to the display area 24 is also used to activate selected soft keys 28. ON10 FF switch JO
are located on the side of housing 12 adjacent soft keys 28. A data output or peripheral connector 31 is located on the U of housing 12.

Input screen 18 may be a conventional resistive touch screen in which a voltage is applied to the edge of the screen to detect the voltage at the location touched by the stylus. The writing surface is a transparent material, typically glass coated with a thin, uniform, electrically conductive layer (in this example, vacuum deposited indium tin oxide). stylus position r
A longitudinal bus wire 11 or a conductive strip (not shown) is used along the two sides to apply a reference voltage to determine the X axis coordinate, and also to determine the position of the stylus.
Lateral bus wires or conductive strips (not shown) are used along the bottom and top to apply a reference voltage to determine the "Y" axis coordinate. In this example,
The stylus 16 is simply an electrical probe that detects the local voltage at the point of contact when it is in physical contact with the conductive layer; If the origin is placed at the voltage system point, the X-Y coordinate will be inversely proportional to the applied voltage.

The stylus 16 must make good contact to minimize the increase in resistance, which can drop the sensed voltage and thus increase the incremental distance error. In the presently preferred embodiment, soft graphite pieces are used. The voltage is sent from the pen via a wire, such as wire 17 in FIG. 2, to an analog-to-digital converter used in the calculations described below.

The stylus may be an electrically charged "pen" as described herein, a light pen as is well known in the art, or any other hand-held device capable of outlining handwritten symbols on a screen.

An example of a conventional electrostatic screen is Pepper, US Pat. :118,096.

This resistive screen has the advantage of minimizing disturbances caused by the user's hand touching the screen.

Both lateral and vertical position sensing alternates the voltage applied on the conductive layer between the paired lateral and vertical bus wires by an interface and multiplexer controlled by a microcomputer or microcontroller. This is done by In some commercially available input or touch screens, this bus wire is split into a series of short strips containing diodes to prevent the horizontal strips from shorting to the vertical strips or vice versa. To prevent. This method was developed by To
It is used in touch screens commercially available from uch Technologies Inc. and Elographics Inc. of Oak Ridge, Tennessee.

Referring now to FIG. 3, another embodiment of the novel input screen 33 for low power position sensing is described in more detail. The input screen 33 also has an X-
This is for determining the Y coordinate position. battery 36
The stylus 35 is used to contact the screen 34 with a voltage applied to the stylus 35 from an external source such as a voltage source, such as a power source of the system, or a system power supply, to apply the voltage at the location of the contact. When the touched position is charged with a positive voltage by the stylus 35 to the measurement points 37 on the plurality of plates, the voltage at these points is equal to the distance to the pen position as indicated by 38, xI, Yl. change with. These voltages are determined by X
and YIIIth direction. Third
In the figure, these means are interface/multiplexers 42, which are well known in the art. A conventional analog-to-digital converter 43 converts this detected voltage to a digital signal. The microcontroller 44 receives this digital signal, performs standard checks to ensure that the value of the signal is "reasonable" (e.g., within the range of possible voltages that may occur), and then states this voltage in the text. Convert to distance in the X and Y axis directions. Microcontroller 41 is well known in the art, but may be replaced by the system's computer. The microcontroller 44 has the following functions for the output boat 46K:
A digital signal representing the distance to the measurement point 38 in the X and Y directions is provided. Boat 46 is a conventional RS 23
Two boats are enough. Alternatively, the microcontroller 44 sets the point XI%Y to the base line 25 (FIG. 2).
It is also possible to convert to other reference points, such as the points above.

As long as there is no contact by stylus 35 at location 38 or other locations on plate 34, no current flows and power consumption is minimal. A concomitant measurement of the voltage at the measurement point can occur by using a voltage ramp at the positioning point and the timing at which the measurement point voltage exceeds some preset back voltage.

The scope of the invention includes the following selections of input screen 18 and touch screen 33. That is, the resistive plate 34 or its equivalent relative to the screen 34 may be transparent or translucent, position points may be made with a stylus or the user's finger, and a polymeric conductive screen (Touch Tec, Annapolis, Maryland, USA) may be used.
The connection point may be a touch screen (such as a touch screen available from hnology). Input screens 18 and 3
3 may be a physically solid surface that is transparent or translucent, or may be glass or plastic such as Mylar. This surface can be coated with a highly conductive/resistive material such as indium tin oxide. Other physical aspects may use the transmission of sound or electromagnetic waves from the location of contact to the reference point(s), and the distance is determined by a time delay or phase shift. Alternatively, input screens 18 and 33 can use etheric or geometric surfaces defined by fields of electromagnetic waves, light or sound.

Position sensing can be achieved using resistive, capacitive or inductive coupling,
and acoustic range, electric field or light (
This can be achieved by electrical contact closure by remote sensing by ultraviolet, infrared or microwave) scanning.

The advantages of the low power position sensing input invention over such screens are as follows. That is: (1) the present invention minimizes reserve power requirements; (2) The present invention eliminates the distortion caused by opposing parallel "bus" lines in conventional touch screens. (3) When using ramp voltages, the present invention eliminates the need for A/D chips, which are a major cost factor in state-of-the-art touch screen technology.

The coefficient of friction of the screen 111 is desirably selected to provide sufficient "roughness" to provide some resistance to movement of the stylus 16 over the screen.

If the screen is too smooth, the stylus will slide too easily and be difficult to control.

Reference is now made to FIG. 4, which shows an overall system block diagram of the major electronic circuits used in the preferred embodiment of the present invention. Microcomputer 14 includes a microprocessor 50 interconnected with a plurality of other electronic components by a data path or bus 52 . Read only memory (ROM) 54 and battery powered random access memory (RAM) 56 programmed with operating and application programs are connected to bus 5.
2 to provide bidirectional data flow to the 2. Microprocessor 50 may be a conventional single-chip 8-bit or 16-bit device, which functions to execute fixed control programs residing in ROM 54 and also from other electronic devices via bus 52. It receives a control program or provides a ;tal control signal to this element. microprocessor 5
0 is in the format commercially known as 280 (ZHog Microcomp of Cubertino, California, USA).
8088 (manufactured by InLc1, Sunta Clara, California), or a similar more powerful microprocessor. ROM5
4 are both Texas Ins located in Ulas City, Texas, USA.
Type 2564 or 4764 manufactured by LrumcnLs
It's fine. The storage capacity of RAM 56 is determined in part by the size of the application program, operating program, and database. As stated below, R
AM56 is static RAM or dynamic RAM
Any type is fine. The primary requirements for RAM 56 are that it has sufficient storage capacity and that it requires minimal input power.

A battery 58, such as a lithium battery, resists electrical power to sustain the memory of RAM 5B over long periods of time. Batteries, including rechargeable types of batteries known to provide long-lasting power resistance.

Batteries, including batteries of known rechargeable types;
Microcomputer using pack 60! 4 and other electronic components to provide the various voltage levels required.

Alternatively, the storage and functionality of the RAM S6 may be accomplished by non-volatile elements that require no electrical power to hold the memory, such as electronically erasable/reprogrammable memory (EEPROM) or elements that use magnetic bubbles or capacitance. Served. State of the art disks or tapes can also be used as mass storage devices.

Suitable bubble memory devices are type 711O with storage capacities of 1 and 4 megabits, respectively.
and 7114 (both manufactured by Intel1). Furthermore, the microprocessor 50 and at least the ROM
It is possible to use a single integrated circuit comprising part of RAM5fi and at least part of RAM5fi.

Also, connected to the bus 52 is EIA's RS-
232 serial interface 62, which provides a means for data input and output. RS-
Data is provided to bus 52 by connecting external data sources to 2:12 port 62 directly to microprocessor 50 and other elements of microcomputer 14. Offloading of data from RAM 56 is also performed by microprocessor 50 to an external computer, other data collection device, mass storage device (e.g., floppy disk and hard disk drive), or electronic communication system. be able to.

Similarly, data may be communicated from serial bus 52 via boat 62 to a printer (not shown).

A stylus 16 is used to write on an input screen 18, causing the electronics of a conventional touch screen interface to generate X, Y coordinate information. The coordinate information is stored on bus 52 for control purposes by system 10.
communicated via. A solid state screen 20, illustratively consisting of a multi-line display of 80 columns by 25 lines, is connected via a display interface 66 to a bus 5.
2 and communicated with each other. J about this display
, (a final requirement is that it be substantially flat and sufficiently thin for use in the present invention. The display may be of the following types: cathode ray tube;
Projection formats such as rear projectors, point-type light emitting arrays (e.g. electroluminescence or plasma discharge) and point-type shading arrays (e.g. liquid crystal displays, solid state PLTZ or magneto-optical).
It is a scanning format as shown below. Furthermore, this display can be shared in size, form and transparency with the input screen 18, and both are of low power consumption type. , are entered into the keyboardless computer 14 via input screen interface electronics 64 and sent via bus 52 to microprocessor 50 which executes programs stored in ROM 54 and RAM 5B.

The number of points (ie, X-Y coordinate set) used in defining each handwritten symbol and the speed at which the points are identified are important to the practical utility of the invention. inch(
It is desirable to use at least about 100 points per 25.4 mm) and at least about 100 points per second. The more points per inch that are identified, the more accurate the system is at identifying handwritten symbols, but the more points that are identified, the slower the recognition speed and the more computer memory is required. do. Therefore, a trade-off must be made based on the size of the computer system and the speed of response and accuracy requirements. For most purposes, a standard within the range of about 100 points per inch and per second to about 200 points per inch and per second will be appropriate.

Also, the greater the accuracy of the system in identifying the X-Y coordinates of each point, the fewer points per inch and per second must be identified to accurately identify handwritten symbols. Conversely, the lower the accuracy, the more points are required.

For example, point resolution is required to place the point exactly where it is intended to write an editing symbol between two characters.

Ideally, a resolution of one display pixel is desired. However, for display with 640 pixels within a horizontal scan line of approximately 228.6 nun (9 inches), a resolution within two displayed pixels is sufficient.

When switchco 0 (FIG. 2) is placed in the "power on" state, the basic display mode is activated and the microcomputer 14 (FIG. 4), programmed by the operating system, displays on the display screen 20. to display the menu.

This menu; L- displays various software selections. The main software feature, editing, is similar to traditional word processing software, except that characters, symbols, and commands that have been typed are interpreted by the system as if they were entered from a traditional keyboard. It works in a way. The system can learn the editing symbols used by a particular scribe for indentation, insertion, deletion, movement, and formatting, and converts these symbols into digital command functions. As an optional feature, these areas on the input screen can be moved using the stylus 16.
Soft key 28 activated by contact with K
(FIG. 2) function similarly to traditional hard function keys on a computer keyboard.

The invention is particularly adapted for use as an interactive screen editor or word processor. After the scribe searches for a document by touching (for example) the display name of an existing file with the stylus or by writing the file name on the screen, all normal editing functions are performed by stylus input. can do. When a user wishes to change a displayed character or symbol, the user simply overwrites the displayed character or symbol, and the pattern recognition algorithm uses the written input as described below. Transform into computer text. For example, editing software can cancel text by simply drawing a line through the text, and traditional caret symbols can also be used to change the mode of operation to insert mode. In insert mode, display screen 20 provides another space for handwritten or synchronized input to be inserted into the text after the point where the caret is written.

Simply place a parenthesis or other user-defined strikeout symbol around the displayed phrase or word, and write a caret or other user-defined symbol in the area of the text where the user wants this portion to be displayed. You can move the text by New margins can be set by drawing a vertical line down the side of the displayed text that should represent the new margins.

This basic editing software also allows you to form new documents by simply writing handwritten symbols on the screen. All documents have these functions on screen (optional)
are stored and modified in the manner provided in conventional word processing devices, except that these functions are performed simply by touching softkeys using handwritten editing symbols and/or using a stylus. , can communicate. The composite text so prepared and stored may be sent to another computer, similar device, or external data collection or recording device via an R S 232 port 6.
2 (FIG. 4), it can later be offloaded to a printer or to a communications system.

In addition to these primary modes of operation, a number of auxiliary elements and features add to the utility of the invention. To support alphanumeric input, a conventional alphanumeric keyboard (not shown) containing a complete set of keys can be connected to a conventional keyboard interface (not shown). When portability is not required and when it is needed to meet the power requirements of screen technologies such as gas plasma displays and electroluminescent displays, AC
/DC power connectors can also be used in these applications.

In practical use, computers that do not use a keyboard function well in applications or environments where a variety of inputs that are converted to computer text are useful or necessary. do. As an example, one device is
Can function as a Shinkeiyo word processor,
Alternatively, among the many uses of the present invention (to name just a few), it can be used in fields such as payroll calculation, D!I w filling, inventory management, accounting investigation, and complaints handling.

Pattern recognition software may also serve as a general teaching and testing device in education (e.g., languages that do not consist of a small or limited alphanumeric set)
This software is particularly useful for word processing and communication processing in these ij5s, as it can learn and translate computer text from Japanese, Korean, and Chinese.

In practicing the present invention, a single computer screen is used to display initial formatting, font symbols, or other indicia to be edited, one handwritten symbol is written, displayed and identified, and the hand;! It is particularly desirable to form a close "window" of blank areas in which the T symbol and the corresponding font symbol are to be displayed; in this way the user can
The user can see the text as it is being assembled and can see the desired insertions or changes without having to move his head or eyes much (even if he has to).

This is illustrated in Figures 11A-11D.

This feature of the invention (the proximity of the text to be executed and the window in which the new text is to be handwritten on one screen) is very important for an easy, quick and comfortable use of the invention. It is.

In one preferred implementation of the invention, the system "learns" a particular user's handwriting prior to actual use.
0 For example, if you use the Roman alphabet, 26 letters and numbers 0 through 9 will be inserted into the database.

Punctuation marks such as periods, commas, question marks, colons, semicolons, and hyphens are also inserted.

In the data base! ! Ancient symbols that can be recognized and stored actually have no t1 limit.

For the conversion of handwritten symbols, the computer must store the appropriate font symbol strings in the computer's persistent memory, such as in the ROM chip 54.For example, in the use of English, , a given chip may also include one (or more) number and letter fonts, appropriate punctuation marks, and appropriate mathematical symbols. Other chips include Arabic letters, Cyrillic alphabet or Greek letters 5 Japanese, Chinese or Korean "kanji".

and font symbols for symbols (eg, benzene, etc.) for use by architects or engineers.

In FIG. 10, one of a series of learning screens is displayed in which the user is instructed to write in the numbers O through 4. The computer attempts to match the numbers written against its internal database (if one exists).

If this cannot be matched, either because the database is not powered or because it is not sufficiently matched with the internal database, this character is added to the database. This learning process includes all alphanumeric (or other) letters and letters to be used.
, continues for 1,76 and 10 chapters. The present system requires capacity to store a large number of handwriting characterization databases for systems used by more than -A users. The existence of a unique handwriting characterization database for each user,
It has the added advantage of making the writing angle irrelevant. As a result, the present invention can be adapted to any thousand styles;
It can also be used by right-handed and left-handed people. It is desirable to incorporate one feature into the device of the present invention to accommodate right-handed and left-handed people. This feature consists in the fact that there is also an outlet (not shown) for the stylus connector on the totora side of the housing 12, so that the stylus 16 is placed on the left side for left-handed people and on the left side for right-handed people. can be joined on the right side.

FIG. 1O also shows an example of the use of "soft keys." In addition to the input line, various softkeys are displayed.

Each softkey corresponds to one function that can be performed by the system. To perform the function,
The user simply touches the displayed point with the pen.

The softkey then appears in reverse video and the touched function is performed. Softkeys have many advantages over traditional function keys. Some of the more important of these advantages are that the user is no longer required to remember which function keys perform which function, that no keyboard covering is required, and that the user can use different soft keys within one program. It is possible to enable (display and activate) at different points.

Figures 11A to 11! The figure illustrates some of the simplifications in word processing that are made possible through the use of the present invention. In FIG. 11A, a standard screen of text is displayed. Users of input systems that do not use a keyboard may need to add additional information and place an insertion symbol (
For example, try to draw a caret symbol). At this time, a data entry "window" appears (Figure 11B). The text is written as handwritten symbols (FIG. 11C), matched (converted to font symbols) (FIG. 11D), and then inserted (FIG. 11E). The operator thinks about adding again and writes a horizontal line using a new material (Figure 11F). This is immediately erased (Figure 11G).

The operator then determines that the text would be better served by a larger right margin. A vertical line is drawn on the screen (Figure 11) and the margins are automatically adjusted (Figure 1II).

A schematic block diagram of the editing process is shown in FIG. 13, a description of which is provided below.

Figures 12A-12G illustrate how blank sheets can be used for patients in a hospital. The user of the system first calls up the appropriate blank form (Figure 12A). This can be done, for example, by touching the appropriate softkey. The area in which information, in this case a pulse, is to be inserted is touched by the pen (FIG. 126). After the desired location is highlighted, a "window" appears directly below the blank space where the display is to be recorded (Figure 12c).
. Next, the mistress touches the small block with the pen, and this block becomes bright (Figure 12D). The software then matches the handwritten input with the corresponding font symbols and displays the results (Figure 12E). If a correct match exists, touch the "Insert" block (Figure 12F) and the display will be added to the patient's record (
Figure 12G). It is clear that this mechanism can accommodate a wide range of "blank forms" in which data is inserted and corrected in the form. For example, this method can be used to correct or update financial information in a spreadsheet program. All such uses are included within the scope of this invention. Other information can be recorded in the same way.

The reason why black backs and white characters are used for newly input font symbols is to facilitate checking the accuracy of input characters.

Although this is desirable, it is not a requirement; a white background and black text are also acceptable.

It is an important feature of the invention that one window and the input data can be formed on the same screen in close physical proximity to the text to be edited or the space for the data to be input; This is to allow ease and speed in the use of the invention. The user's ability to focus on the space where the data is to be inserted, and when the system misreads the handwritten symbol, being able to display the handwritten symbol and the corresponding font symbol simultaneously makes it easier to spot errors. , thus correcting errors quickly and easily.

First, with reference to FIG. 5, the overall operation and mechanism of the pattern recognition software will be described. When the operating system calls the pattern recognition program, the program starts at terminal 75 where a number of variables and counters are initialized. The software now advances to decision block 76K, where the program determines that the stylus 16 (Figure 25) is connected to the input screen 18 (2A).
Determine whether or not the device is in contact with the device (see Figure). The system ``pen down'' as shown in processing block 78.
The X-Y coordinate voltage is generated as a signal, as well as a positioning signal as described above. The microcomputer +4 (FIG. 4) using the software according to the present invention converts the X-Y coordinate positioning signal into handwriting characteristics using a program stored in the ROM 54 (FIG. 4) or the microcontroller 44. A separate microcomputer, such as a microcomputer, can perform this conversion. If a pen down signal is received, the software proceeds to processing block 80;
Here, the individual positioning signals are combined into a "handwriting" and one handwriting is defined as the positioning signal of the point occurring between the signal "pen down" and the signal "pen up".

The system then calculates a transformation; t for each point, converting the coordinates of the point from the X-Y Cartesian coordinate system to the associated coordinate system, as described below.

The software then proceeds to processing block 82 where the handwriting is compared to the handwriting stored in the database entered at 11" to determine whether the handwriting is represented by a certain symbol in the database. If a match is found (if the font symbol represented by this handwriting is recognized), as shown in decision block 84, microprocessor 50 (second 4) Displays symbols on screen 2
0 (Figure 4). If a match is not found, the microprocessor 50 (FIG. 4) displays a message, as indicated by process block 88, which indicates whether the input is a near match by flashing or by flashing an unrecognized symbol. Request further input from the stylus on input screen 18 (FIG. 4).

As described above, the software compares the handwriting characteristics of the Jinbei-gaki symbols to previously stored data inputs in the database. In a preferred embodiment, this database is organized for each part of a character or symbol by the number of strokes necessary to form the character or symbol.

In each part, inputs are initially placed randomly, but after use, the most frequently used inputs "climb" to the top of the database, as described in the text. You should know that each user has his or her own particular handwriting style, and that the Jinbei writing style strikes many different habits.

For example, many people write a lowercase "h" with one stroke. These people start moving the pen at the point on the writing tablet where they want to place the If part of this letter, draw a vertical line down towards the base line, and then, without lifting the pen from the paper,
Return to the midpoint of the previously drawn vertical line, extend it to the right and lower it to the base line, then pull the pen up from the paper to write. On the other hand, these same people write a capital "H" with two strokes. These people are lowercase "h"
This is done by drawing a vertical line on the left, drawing a horizontal line, lifting the pen from the tablet, and then writing a vertical line on the right. Appendix ■ describes how these two types of data are stored in memory after they are generated according to an embodiment of the present invention.
The graph shows handwriting data points for two characters.

As shown in Annex I, the letter "h" written by - users at a particular time has 20 points (np=20
) with the minimum, average and maximum normalized numbers (one line (7) Ill (7) l/
80) The characteristics of the two X-Y coordinates are as described above. i.e. -17 and -6, 0 and 18, respectively;
and 19 and 60° The number in the first column is 36
0°/256K normalized slope between points. The numbers in the second column are the average vertical positions between points on the base line normalized to 1/80 of the line width.

A typical line 11] is approximately 10.1601111 (0,4
inch).

Next, in FIG. 6, the software hierarchy of the program is shown. At the top, overseeing all operations of computer system 10 (FIG. 1) is an operating system, as indicated by block 90. The applications shown in blocks 92 and 94 reside in RAM 56 (FIG. 4) and ROM 54 (FIG. 4).
The simulation program can be executed by microprocessor 50 (FIG. 4) under the control of the operating system. When handwriting is requested or displayed by an interrupt, the handwriting recognition software 9
6 is called. The first subroutine, shown in block 9B, encodes the X-Y coordinates into the handwriting. Characteristics of the handwriting are then defined by subroutine 100, which then compares the handwriting to a database loaded from ROM 54 (FIG. 4) into RAM 56 (FIG. 4). This comparison is performed by subroutine +02. When the operating system is in "learn" mode, the database is updated with new handwriting data and symbols as shown at block 104. Similarly, a previously stored document can be edited by the application program 92 by using the editing mechanism 94 as invoked by the operator, and by the operator using subroutines 98.100 of the handwriting recognition program 92.
102 to provide instructions as input.

In addition, in FIG. 7, the operating system L
Jo (FIG. 6) starts handwriting recognition software 96 by accepting as input the X-Y coordinate point shown in block +10 at the location of stylus 1B (FIG. 2) on input screen 1B (FIG. 2). (FIG. 6) and encode these points into a handwriting as shown in block +12. The program then characterizes the handwriting by a certain set of descriptions, such as length, curvature, slope, and location requirements of the handwriting, as shown at block 114. In buffer 116K, the best comparison with that in the database is then found for the characterized stroke or series of strokes. If a close enough match is found, the character is identified in block +18;
The entries in the database are swapped with the above entries as shown in block 120. In this way, the most frequently identified characters will "climb" to the top of the database, increasing overall system performance as measured for finding matches. If no match is found, the user can add to the bottom of the database as shown at block 122.

Referring now to FIGS. 8 and 9, there is shown a flowchart of a computer program for recognizing a particular handwriting sequence.
52, the voltages are converted to digital signals. The program then proceeds to decision block +54 where the program indicates that the pen or stylus 16 (FIG. 2) is on the input screen 1.
It is determined whether the contact state with 8 has been removed. This determination is made based on both the X-coordinate voltage and Y-coordinate voltage, which are zero.

If the program determines that the pen has been lifted, the writing is determined to be complete and the program branches to decision block 15B.

At decision block 156K, the program determines whether there are fewer than three dots in the handwriting;
If so, the program branches to decision block 158. At decision block 15B, the program determines whether a zero point exists in the handwriting. If there are zero points in the handwriting, the program returns to the beginning of ring block 152 where another set of points is read. If the points counter (incremented in processing block 164) indicates that there are points greater than zero, the program branches to processing block 172. In processing block 172, the handwriting is identified as a dot and the height above the base line is HA.
BL) is calculated in processing block 173. From processing block l 7 :I, the program proceeds to processing block 17+.

However, if a pen down signal is received, the program branches to processing block 160 where the voltages are scaled to determine the coordinate point using the following equation. That is, X = a, v, +b.

Y = a2v, +b2 The constants a1 and s are scaling parameters determined from the calibration of the input surface of a particular display.

Once the FI voltage has been normalized, the program proceeds to decision block 162 where the program determines whether it is a false point. This compares the distance between points and if this distance is too large (approximately 2.54mm (
0,10 inches) and remove points (values larger than 0.10 inches are currently used). On the other hand, if the points are too close together, remove them. If the dots are within about 0.15 inches, the dots are subtracted for that time.

The comparison problem that exists for function points is solved by determining whether the claw is the function point after the pen is lowered.1 Then this point is determined to be the maximum pressure 1! ! It is used only to determine the next point that is accepted as being within t (approximately 2.54 nm (0.10 inch)).

If the distance between points is determined to be outside the two criteria, the program drops this point and processes block 1
Return to the top of 52 and read out another pair of coordinate point voltages.

If, on the other hand, the point meets the criteria, the program continues to processing block 164 where a point counter is incremented to record the score. This number is used in decision block 156K as described above. The program then continues to processing buffer 166 where the points are smoothed according to any of a number of formats. Smoothing measures are used to minimize noise from counting, erroneous hand movements and electronic noise. The simplest smoothing method is multipoint averaging, which results in new points (Xj・, yJ
・) will be calculated. That is, X J-= Σ x1/ (n 2- n 1+ 1
) Also, the same holds true for yj· smoothed across the points <n2-n+).

Another simple method is called the moving weighted average method and uses the following formula. That is, x,・=αxj+(1−α)xj・−1α is a weighting constant of the normal type (also smaller than 1), and is 0.25
It is used in The summation was done by n2-n, =1. A third method involves what is called a spline fit, where the following equation is used. That is, XJ': (Xj-+ + 4 X j+)C, +
+1) Any of the above methods can be applied either before or after filtering measures.

This filtering action is taken to reduce the number of input points and provide space for data so that calculations of differences and/or angles can be performed within acceptable random error limits. It has been discovered that a simple process of decimating a series of points by eliminating the acceptance of subsequent points within a set distance of previously accepted points is an effective filter.

From processing block 166, the program proceeds to processing block t
68, where each new point since the last Penn Dow 248 is stored in an incremented array. For this purpose, an array of addressable points or a series of points resulting from the pen down to pen up signal is formed. This series of points is called a stroke. From processing block 168, the program returns to the beginning of processing block 152 where another point is obtained until the pen up signal ends the stroke.

In decision buffer 156K, a determination is made as to whether there are fewer than three points in the - stroke. By definition, if there are three or more points in a stroke, then the stroke is a line and not a point. If - there are three or more points on the stroke, the program starts in block 1 of the subroutine.
Branch to 70. In subroutine block 170, the stroke is characterized with respect to its slope and base line height, as discussed in more detail below with respect to FIG.

As can be seen from the above, the delimitation of the flow of coordinate points into the handwriting is primarily based on determining when the stylus 16 is "lifted", ie, when it is not in contact with the surface of the input screen 8.

Alternatively, the stream of dots can be segmented to form a handwriting based on other considerations.

For example, the stream of points can be separated based on changes in locally calculated curvature or large local curvatures. Local curvature is calculated by the change in distance along the input coordinates divided into changes in slope. This results in a radius of curvature. When the radius of curvature changes rapidly with respect to the distance along the input coordinates, or if this radius is too small, it is assumed that the dividing stroke has ended and a new stroke has begun. Other separation methods are
Relevant maximum and minimum values in one or both coordinate axes and/or intersection points of curves in the coordinates can be searched. However, these two methods were determined to be relatively ineffective.

Handwriting characterization reduces the set of coordinates that define a handwriting or segment to a unique, membraned, and trivial set of features. Uniqueness refers to the factors both that the same feature is produced by the same coordinates and that this feature is sufficient to reproduce the closeness with the underlying coordinate sequence. The tool "membrane" means that the feature remains unchanged under such a transformation, and therefore the symbol remains unchanged (e.g., transformation and scaling, or stretching or small tilting)
It is used to mean something. All distances are scaled by taking the ratio of the distances to [11] of the write input line.

The set of minimal segment features has the following characteristics:

(1) Handwriting position: one or more graphical centers/average, extent of extent or beginning and end points (2) determined in relation to the writing input line, previous handwriting, or character extent or center; ) The shape of the handwriting has one or more average inclinations, changes in inclination (model Measured value of uniform curvature)
and/or a change in curvature; (3) the length of the stroke as characterized by a curve along the coordinate system and/or a distance along the limit extrema; Positioning by the extreme values of and the beginning and end coordinates was successfully used. The shape of a handwriting is determined by a series of inclinations and vertical positions (
relative to the center of the handwriting). The length of the handwriting can be approximated by the number of points filtered. Alternatively, the average curvature can be encoded in the total change in slope (with respect to length), the change in slope from beginning to end, or the fit of a slope angle versus length curve to the rate of change in slope angle. . Other features that can be used include the location of the relative extrema of the coordinates, the intersection of the curves, the saddle of the curves, and the direction of the stroke. The specific methods used to determine unique characteristics are discussed below.

1. A reference numerical value for each handwriting of handwritten symbols is determined.

2. Data on the handwriting of previously learned handwritten symbols.
Base values are determined and deducted from each newly determined value.

3. The absolute value of the left surface is scaled to make each of the five measurements equal to another measurement, such as length scaled to the height between the lines.

4. The five thus determined values are added.

5. A certain p threshold is the “validity” of a recognition test.
to be used as If the value is too high, the recognition rate of font symbols will decrease, and if the value is too low, the font symbols will be recognized incorrectly.

A threshold of approximately 1,000 is used initially and then switched to approximately 100 to improve recognition. If the threshold is exceeded, the comparison is abandoned and an error message is generated and displayed.

6. Search the database to find the minimum value of the numerical difference. If the minimum k is lower than the threshold accepted for recognition, the corresponding font symbol is displayed on the screen or the command is implemented, as the case may be.

It has also been found that the desirable classification of handwriting is not entirely discrete, but continuous. For example, it is desirable to determine the tilt by angle in 256 directions rather than in 8 directions.

Other non-continuous classifications include lines, bows, hooks, number of cups and closures, or horizontal or vertical handwriting.

From subroutine 170, the program moves to processing block +
Proceeding to 71, both the individual handwriting and one or more previous handwritings are compared with entries in the data base stored in RAM 56 (FIG. 4).

This comparison is first performed at decision blocks 174, 176.1
We begin with three screening questions asked by the program at 78. In each case, if the data
If the base entry is eliminated, the program proceeds to processing block 180 where the address of the next data input is received, from which the program returns again to the beginning of processing block 171. At decision block 174,
The first elimination question is asked by looking for differences in the number of strokes. If the number of handwriting is the same.

The program proceeds to decision block 176 where the average height above the baseline (HABL) is calculated and compared to the HABL of the data entry. This entry is
If the difference in average HABL is greater than half the entry line height, it is rejected. If the determination at decision block 176K is negative, the program returns to decision block 17
Proceed to step 8, where the number of dots per stroke is compared and if the difference in the number of dots is greater than lO, the entry in the data base is eliminated. , this decision differs from the one made in decision block +74 because it only relates to the number of points per stroke. However, at decision block 174, the uppercase "E" and rAJ
Some characters, such as , have more than one stroke per character.

If the entry of data is not eliminated by decision block 178, the program proceeds to processing block 182 where the program determines the closeness of match between the selected entry in the database and the written handwriting. Calculate the gauge used to determine the The currently desirable gauge is the handwriting value and the following data/
It is the sum of the absolute values of the differences between the base entry value and the base entry value.

(a) the distance l/80 of the line height or unit length n (e.g. space 26 in Figure 2), and (b) the 360° l across all points along the diagonal of the comparison matrix.
This is the slope in units of /256.

Alternatively, dynamic programming can be used to optimize the comparison using off-diagonal elements as well.

From processing block 182, the program executes decision block 1.
Proceeding to 86, where consistency is determined. In practice, consistency is determined by (applying) the (maximum tolerance) of the gauge (any) gauge, which is a combination of the characterization of the input handwriting and the characterization of the stored database entries. is the sum of the absolute values of the differences between Processing block 18
2, the smaller of the current gauge and the previous lower gauge is complemented as the best match.

The program then reaches decision block 184 where a determination is made as to whether the current entry is the last database entry. If not, the program branches to processing block 180 where the next entry is selected. If this is the last entry, the program proceeds to decision block 185 where a match determination is made based on the gauge being below some predetermined threshold. This threshold is set by the user based on experience with the system.

If no match is obtained, the program branches to decision block 18B where a determination is made as to whether all handwriting has been examined. If the handwriting after rJi is examined, the current handwriting is sequentially compared with the previous handwriting for all two-stroke entries. As in the comparison with all single stroke dictionary entries, the best-number comparison for all input strokes is the recognized symbol or series of symbols.

However, if the last stroke was read and still does not match, the program proceeds to processing block 190 where a question is displayed to the user on display screen 20 asking whether a new font symbol should be added to the database. displayed for. The user responds and this response is used in decision block +92. Either the handwriting sequence is added to the database at processing block 194 and the program returns again to the beginning of processing block 152, or the program branches immediately to the beginning of processing block 152.

On the other hand, if a match is determined at decision block 18B, the program branches to processing block 195 where the program updates the data by swapping the serial location of the matched entry with the entry above it.
Shirtfull the base. The program then proceeds to processing block 196 where the program zeroes the point counter and the increment counter. The program then proceeds to processing block 198 where the matched and characterized handwriting(s) are displayed by the computer as identified font symbols. This display is placed where the entry was made on the input screen 18 (FIG. 2).

From processing block 198, the program proceeds to processing block 2.
00, where the program can process the commands it has interpreted.

Another characterization of handwriting uses the points themselves rather than length, slope, curvature and position.

Next, in FIG. 9, this subroutine for characterizing handwriting is shown in more detail. The handwriting characterization subroutine 170 mainly performs mathematical transformation of each point point by point, and converts the point from the X-Y orthogonal coordinate system to the normalized slope of each point and the base line. Convert to the normalized height of each point above (HABL).

Subroutine +70 first calculates the slope between points at processing block 220, and then calculates the height of each point above the base line at processing block 222. Then, in processing block 224, the slope of each point and H
ABL is 1/256 of 2Pi and input line IJ
of! Normalized to /80.

The system runs from processing block 224 to processing block 22F.
Proceed to i, where the normalized value computed for each point is stored in an addressable array.

The subroutine then returns to the program via terminal 226.

When a comparison is made between each stroke and the stored value, the comparison is made by the normalized slope of the point and the height of the point above the base line. As mentioned above, matches are determined by an arbitrary gauge that is the sum of the absolute values of the differences between the written handwriting and the stored or dictionary handwriting. The system learns by adding new handwriting to the abatement database. Once the database is full, these less frequently used font symbols are replaced by new entries.

In an embodiment of the invention, an algorithm sequentially identifies uppercase and lowercase letters and numbers when they are written discretely from each other. In the case of handwritten symbols that are written as letters, direct extrapolation requires sequentially searching a database for one, two, three, etc., handwritten symbols to find the best match. do. At the same time as identifying a match for one handwriting, the next few handwritings are
The "new" characters are temporarily recognized, except that these handwritings are analyzed to see if they change the 11 symbols. For example, two handwritings identified as rlJ would be combined and changed to an uppercase "H" once the horizontal line was identified.

The system design shown in FIGS. 7-9 can be easily encoded into any computer language by one having ordinary skill in the computer programming arts. A source code listing for one application program having the invention disclosed herein is included as Appendix I. The software in Appendix ■■ is based on Microsoft's 13AsIG, a common computer language that can be used on almost all microcomputers and operating systems.
It is written in This program is a complete text editing program that takes advantage of many of the main features of the present invention and demonstrates the improvements that can be made over traditional word processing systems by utilizing the present invention. It is something.

Lines 2600 to 4000 of the program contain X-YJI
Contains a character recognition subroutine that contains the software code necessary to obtain the mark. This part of the program corresponds to FIG.

Lines 2600 to 2699 of the program are
It constitutes a subroutine designed to obtain the Y coordinate. What is this code? Block +52-154 in S8 diagram
, 160, 162%'164, 166 and 1
It corresponds to 68.

Lines :l 000 to 3339 of the program correspond to processing blocks 156, 158, 170, 172,
The point of performing 173 and the analysis and characterization of handwriting constitutes a routine.

Lines 3700-3790 of the program constitute a subroutine configured to compare the analyzed handwriting to a database of handwriting. These program lines embody blocks 171-184 in FIG.

Lines 381O through 3980 of the program constitute a subroutine designed to learn new characters. This code is shown in block 186.188%190 in Figure 8.
, 192, 194 are materialized.

Lines 3060 to 3273 of the program constitute a subroutine designed for [1] of handwriting characterization.

This code portion corresponds to FIG.

Lines 3060-3095 of the program are used to calculate the slope between points and instantiate block 220.

Lines 3058.3241 and 3262 of the program are
It is used to calculate the height above the base line (HABL) and corresponds to block 222 in FIG.

Lines 3253.3270-3273 of the program are used to normalize the height and slope of the points and correspond to block 224 in FIG.

Line 3253 of the program is used to store the height above the base line and instantiates block 226 in FIG.

The above program can be stored in the memory of a microcomputer with a microprocessor that takes up about 25 minutes of machine memory, so that the use of the program does not dedicate a lot of expensive memory.
Relatively quick in executing program operations. If the program is written in a language other than SIC, such as assembly language, the size of the program can be made even smaller.

Blocks 195-200 of FIG. 8 appear in local locations throughout the code.

A dictionary of variables for the relevant code sections is included as Appendix III.

Next, in FIG. 13, the editing software ("editor") shown in FIGS. 11A to 1II and described above is shown. Once the editor is loaded on the system (
Block 229) and control of the screen is returned to the system. The system then proceeds in the usual manner as described in Section 2, acquiring and displaying the points (block 23G), converting the points to handwriting (block 2:11), characterizing each handwriting (block 232), and characterizing each handwriting (block 232). Handwriting (singular or plural)
(Block 2)
33). At processing block 234, the system sends the number hand symbol to an editor to interpret and execute the command as necessary. At decision block 235, the editor determines whether the handwritten symbol is an editing symbol or a font symbol.

If the character is determined to be an edit symbol, the editor proceeds to processing block 236 where it determines that an edit symbol has been entered to perform an edit function. If it is determined that the character is not an editing symbol, the alphanumeric character corresponding to the handwritten input is displayed at processing block 237. Another form of editor only accepts font symbols when the editor is in "insert mode." This structure ensures that each font symbol is validated before being added to the document.

Editors use a variety of systems configured to perform editing in a system similar to, but far more efficient than, traditional pencil and paper editing. These features include, but are not limited to:

i.e. the deletion symbol "□" A horizontal line drawn across two characters (singular or plural). The editor formats the text by removing the characters below it.

Margin change symbol "1": Vertical line longer than the height of the displayed single line. The editor formats the text by adjusting the margins to the displayed positions.

Insertion symbol "△": At the point where text should be added; IF
Caret symbol to be included. The editor uses the input write line (No. 11B)
) and inserts it into the text when the input is recognized.

Text mark symbols “〈” and “〉”: Smaller and larger than the 8ψ signs written at the beginning and end of a block of text. Text marked with this mark is displayed with an inverted video signal, and then special block functions can be performed.

Text marked for deletion: A deletion symbol written within marked text erases the marked text and makes the change obsolete.

Move Marked Text: An insertion symbol placed anywhere in a text formats the text by moving the marked text to the displayed position and deleting it from its original position.

Replace Marked Text: An insertion symbol in marked text displays the line entered and replaces the marked text with the text entered.

The editing symbols mentioned above can be changed to specific editing symbols preferred by each user, thereby making the editor unique to the user and allowing new users to use it! This eliminates the need to memorize editing symbols without gI dyeing.

For further modifications and enhancements to this invention,
It will be clear to those skilled in the art.

For example, it is also possible to extract common features of each font symbol and configure them into one composite symbol.

Features of composite symbols can also be exaggerated to highlight the change from all other composite symbols. This results in
This will create an optimal database that is compatible with non-wealth. On the other hand - by way of example, a database constructed in accordance with the preferred embodiment of the invention described herein typically results in two to three different characterizations for each symbol.

The present invention has many useful applications, including: The most obvious use is for text lA
This is the addition and modification of the Collection and Type 117. Many other uses that don't come easily to mind include i! in languages that use multiple symbols, such as Japanese or Chinese. F writing, writing in Arabic and similar languages consisting of a limited number of complex symbols, < T writing of chemical structural formulas, including those involving mechanical compounds (for music, with five parallel lines ”), the writing of symbols and codes for the formal processing of data, including the conversion of graphical data into spreadsheets, predetermined questions are presented on the screen and the answers are normally CAD/CAM related to educational applications written in written form, teaching of mathematics where numbers are manually inserted into formulas and the formulas are analyzed to determine results using these numbers, symbols, geometric figures, etc. There are other uses.

Although the present invention has been described with respect to selected preferred embodiments covering keyboardless computer system apparatus and methods, other embodiments and modifications will readily occur to those skilled in the art. However, the present invention should not be considered limited thereto.

祁υ ψ − 000000000000000000000 0ro
0000000001/l a atmouth+N1II?
+/11o % 101% FIMma ψ−a F”
n9v'11ar+ aoot to middle 5'l o2.

M I'M 94P 9 W W MP MP W 9
? X hn +71 X X v'+ +/I X
X J J Z 44 J to J J 41.1
1 F+-= −−−−, −, −1, −−−−−−−
-------, -o ++-+1+++p-one 18- MMI+ll"lF'lFIMfflF1ml'll'
lF1ml'lF'1iF11'1MF11'lPIF
IMI”1PIFIFIFTl”ll”1PIFI
1”1 inside - O( n el Oel OX o us Roro elOFl+A
Rolo N +/I C+ +n o + IN M! r
4R6m lN M M 豐? t/l tll I
'+ gl al gl a 9 drops w +/l +/I
4 J J J +J # J-FI IN IN
IN I'll ＾ Lock he he he he he he ni's FIM 1-I FI M PI
tsu tsu＋－＋
1-I
H tototokube
BeoQ ψmouth FI F+ O chain mouth 0 post 0 post ψ sa ψ■mouth n octopus 10° mouth.

To MM 豐每 41 ψ sa ^^ Han ψ Q ■ φ at m o
口00－彎1トψψく1ψ111ψψψ－t11tot
6t1i1totl)to', otc+144J444
The candle slope ψψψψψ of the Wψ mountain Roro ψψｑφ Φ0−Φ―
Fake fist, fake hee, gate to gate 9iI'Iφ0-! -10Q Roro 0 Ro-to M w <mouth, heh, chain. Mouth 1” F'P
-N a) CR■at P” iP-1” P” Sio-11111+-2211II PI l+1
, +1111 M! ! 10 J +a 111to
w +a +j o o o o o o low-22, 1, 22, 2゜gl ch@ @ @
@ffi (R+---F--1+ -F+ F-
% +−−+−# l−+ % −+ + +−−#
F-u.

(Appendix III) Angle of inclination between points M and Ml in A2: Previous angle DAI: Change in angle (AI-A2) SEND: Handwriting end flag zx: Two angles due to weighting of arc length Double precision sum of X positions zY: Double precision sum of Y positions weighted by arc length ZA: Double precision sum of angles weighted by arc length ZDA: Double precision sum of angles weighted by arc length Amount of change ZL: Length of doubleness NSP: Number of points in handwriting, counter N5TR: Number of handwriting XX: @ Large X value XN: Minimum X value YX: @ Small Y value YN: Minimum Y value Ml: Pointer to previous point M2: (1) Minimum number of points to be adjusted to obtain an angle of 2π M3: (2) Minimum number of points to calculate the amount of change in angle NLONG: Counter (not used) M : Number of pointers N22 points to the target point DS: Pseudo arc length ADX+ADY AY: Calibration multiplier for vertical (Y) direction.

Example) AY) O is the true lower part of the coordinate system ADA: Moving average change in angle DA2: Previous change in angle ASTRT: Column for the starting angle of handwriting SZL: Single precision handwriting length SNO: First of each handwriting Column of points LHT5: Height between lines divided by 5 in the display coordinates used as a unit SL: Column of handwriting length stopped at the height between lines AEND:
Angle sequence at the end of handwriting SC: A sequence of changes in angle for each handwriting AZA: Average angle in handwriting SX: A sequence of average center X-axis coordinates for each handwriting SA: Average angle (inclination) row for each handwriting SXX: Maximum for each handwriting X coordinate string SXN: Minimum X coordinate string for each handwriting SYN: Minimum Y coordinate string for each handwriting SYX: Minimum Y coordinate string for each handwriting DBUG: Debug flag INPUT for printing
+ String of input bytes to be excluded XP, YP: Coordinate input XPA: 2 average points in the X direction YPA: 2 average points in the Y direction Y average value ■: Display pixel corresponding to x coordinate input J: Display pixel corresponding to Y coordinate input N: Input point counter MM: Timing pen up counter NU: Timing pen up counter

[Brief explanation of the drawing]

FIG. 1 is a schematic system block diagram illustrating the present invention;
The figure shows a perspective view of a housing containing the actuating element of the invention;
FIG. 2A is a partial view of FIG. 2 with parts removed to show the positional relationship between the touch input screen and the display screen, and FIG. 3 is a partial view of the input screen, stylus, and related electronic elements. FIG. 4 is an overall schematic system block diagram showing the arrangement of a computer system for keyboardless input according to the present invention; FIG.
Figure 6 is a schematic block diagram showing the movement of data within the system as modified by handwritten text and commands; Figure 6 is an overall system block diagram showing the hierarchical structure of the software used to operate the system; FIG. 7 is a schematic block diagram showing the character and pattern recognition algorithm; FIG. 7B is a detailed block diagram showing the pattern recognition algorithm; FIG. 9 is a schematic block diagram showing the handwriting characterization subroutine; 11A-111 are a series of top views of screens showing operation of the text editing system; FIGS. 12A-12G; FIG. The figures are a series of plan views of screens showing the operation of the data entry system, and FIG. 13 is a schematic block diagram of the Linus editor. IO... Computer system that does not use a keyboard, 12... Housing, 14-... Microcomputer, 1 [)... Stylus, 17...- Wire, 18... Input screen, 20-... Display screen, 22... Slanted top surface, 24-... Display area, 25.
-Horizontal line, 26... Key input section, 28-... Soft key, 3O-ON10FF switch, 31... Data output connector, 33... Input screen, 34... Electric resistance plate, 35-...・Stylus, 36...Battery, 37-...Measuring point on board, 38...Measuring point, 42...-
Interface/multiplexer, 43... Analog/digital converter, 44... Microcontroller, 46... Output port, 50...-Microprocessor, 52...-Bus, 54...-ROM, 56-R
AM, 62-RS-232 serial interface, 64--Interface electronic element, 66...
Display interface. (4 others) Engraving of drawings (no change in content) -19 (・l −≦r7 ke, 2A −Ik・7 −nowa 4.126 −r, 120 −1 ψ, 12F Procedural amendment □ Showa February 1963≠Kunito Ogawa, Commissioner of the Japan Patent Office1, E'l-0, Patent Application No. 185313 of 19852, IQ″l08m,,,,<-Relationship with the case Applicant Address Name: Linus φ Chichnosis Incorporated 5, Date of amendment order: October 27, 1985 (Shipping date) 6, Proper drawing in the [Brief description of drawings] column of the specification subject to amendment 7, Amendment Contents (1) "Figures 11A to 111" on page 94, line 8 of the specification are corrected to "Figure T 11". (2) The drawings are as shown in the attached sheet. No change)

Claims (1)

Claims: 1. An input signal for providing a utility device with an input signal representing a graphical character generated by a user, receiving an output signal from the utility device, and producing a visual display of the output signal. at an output or I/O device: (a) a display device for providing a visual display of a graphic character in response to an output signal provided by the utility device; and (b) when the graphic character or symbol is rendered by a user. an input screen device for producing a series of input signals;
The input screen device comprises a translucent input screen having a top and a bottom surface, the bottom surface being configured to display the display such that the visual display produced by the display device is visible from the top surface of the input screen. (c) a device for determining whether the graphic characters match and providing an output signal representing this to the display device; 2. the display device includes a display surface on which the graphical characters are generated; a bottom surface of the input screen device is configured such that the visual display generated by the display device is visible from the top of the input screen; The I/O device according to claim 1, wherein the I/O device is arranged close to the display surface. 3. The I/O device of claim 1, wherein said input screen device comprises a substantially flat plate, and a top surface of said input screen is a top surface of said plate. 4. When the display device is in a predetermined position relative to the top surface of the board, the input screen device cooperates with the top surface of the input screen to produce the series of input signals. 4. The I/O device according to claim 3, further comprising a display device operated by a user. 5. The I/O device of claim 4, wherein the input screen device produces an input signal when the display device is in contact with the top surface of the input screen. 6. (a) said board has electrical characteristics such that it varies in a known manner with the distance of a point thereon from where a voltage is applied; and (b) said input screen device further comprises: (c) the display device is elongated and has a tip at one end thereof; Claim 5, characterized in that the input screen includes a voltage detection device having a tip and producing a signal representative of the voltage present at the location where the tip comes into contact with the plate of the input screen.
I/O device described in section. 7. (a) the voltage at any point has electrical characteristics such that it varies in a known manner with distance from where the voltage is applied; and (b) the input screen device is further connected to the board at its origin. (c) the display device is elongated with a tip at one end; , and a device for applying a known voltage to the tip, the sampling device producing a signal representative of the voltage detected when the tip comes into contact with a plate of the input screen, the voltage at the origin; 6. The I/O device according to claim 5, wherein the I/O device detects. 8. The input screen has a display area in which graphical coordinates can be generated and a key input area in which a common signal to the utility device can be generated when in contact with a corresponding area on the input screen. An I/O device according to claim 2. 9. A display device having: (a) a display surface for visually displaying graphic characters in response to a plurality of display signals; and (b) a writing surface device for receiving graphic characters handwritten by a user; (c) a substantially translucent surface having positional coordinates disposed in close proximity to and associated with said display device of a surface; (c) manipulated by a user in conjunction with said writing surface device; a display device that cooperates with a writing surface device to produce a write signal; (d) a position sensing device that converts the write signal into a positioning signal representative of the coordinates of the position of the display device relative to the writing surface; a processing device for receiving and storing the positioning signal when it is generated, and for generating the display signal so that the display device can graphically display the graphical character after it has been generated; , the processing device is
A handwritten character recognition device comprising a character recognition device that compares the generated positioning signal representing the graphical character with a plurality of stored data base signals to identify the graphical character. 10. The handwriting recognition device of claim 9, wherein the writing surface device includes a substantially flat plate that produces a signal when the display device is in contact. 11. The handwritten character recognition device according to claim 9, further comprising a device for converting the coordinates of the position into related coordinates. 12. The invention further comprises a device for dividing the series of positioning signals into portions representing handwriting, and a device for calculating handwriting characteristics that can be compared with the handwriting characteristics of the data base signal. The handwritten character recognition device according to scope 11. 13. The processing apparatus further comprises means for updating the stored data base signal with the generated positioning signal when a proper graphic character is not identified. The handwritten character recognition device according to item 9. 14. A method for recognizing handwritten symbols, comprising: (a) generating a series of positioning signals by moving a stylus to a location proximate a writing surface device that generates signals representative of the location of the stylus; (b) a series of positioning signals; (c) calculating handwriting features; (d) comparing the computed handwriting features with handwriting features previously stored in a database; (e) determining the optimal and determining whether the best comparison result is good enough for matching. 15. A device for recognizing handwritten symbols and displaying handwritten symbols and font symbols on a screen, comprising: (a) a visual display screen having graphical processing capabilities for displaying font symbols and executing predetermined commands; (b) a device held in a hand to write or draw handwritten symbols on the screen; and (c) a device for accurate display of the handwritten symbols on the screen as they are formed. (d) a digitizing device for detecting the position of said hand-held device and converting it into a series of electrical signals defining the location, size and shape of each handwritten symbol; The predetermined characteristics of each handwritten symbol are converted into data of the predetermined characteristics of the font symbol.
(f) optionally converting said handwritten symbol into a predetermined font symbol in the screen area in which said handwritten symbol was originally entered; and a device for displaying the font symbol or for executing a command on a screen close to the device. 16. By displaying a predetermined font or typeface of symbols in a text typeface on the screen, said handwritten symbols can be used to input information to complete the typeface or to edit the predetermined text. 16. Device according to claim 15, characterized in that it is provided with a device. 17. The device has a size of approximately 406 x 406 x 102 mm (1
6 x 16 x 4 inches) and approximately 6.8 kg (
16. The device of claim 15, comprising a portable device having a weight of 15 lbs.) and having a self-contained power source. 18. A device for displaying predetermined symbols with fonts and symbols representing commands on the screen, and allowing handwritten symbols representing each of the predetermined symbols to be manually defined on the screen; 16. The apparatus of claim 15, further comprising means for identifying manually defined symbols by corresponding predetermined symbols on the base. 19. A device is provided for correcting the database when handwritten symbols cause incorrect font symbols to be displayed on the screen or commands to be executed, depending on the case. The device described. 20. The apparatus according to claim 16, further comprising a device for forming a window of empty space on the screen simultaneously with a predetermined command and inputting handwritten symbols into the window. 21. The device according to claim 15, characterized in that an area on the screen is provided for detecting contact in order to perform a predetermined action. 22. The apparatus of claim 15, wherein the screen is substantially flat and adapted for use in a substantially horizontal position. 23. The device of claim 15, further comprising a soft key on the screen and a device for executing an operating command in response to contact with the soft key. 24, in a microprocessor-assisted process for the recognition, translation and display of handwritten symbols and execution of instructions: (a) the handwritten symbol for each character corresponding to the font to be initially displayed to the user and the command to be executed; (b) determining a unique set of features to characterize each such symbol and storing the same in said database; (c) using a stylus to write or draw handwritten symbols on a computer screen; (d) digitizing each handwritten symbol to identify the X-Y coordinates of a number of points defining the symbol; and (e) (f) processing the digitized features of each handwritten symbol to determine predetermined features of the symbol; (g) displaying a font symbol or executing a command most closely related to the "hit" feature. 25. (a) determine whether the displayed font symbol or executed command is in error; and (b) if so, re-enter the required font symbol or handwritten symbol for the command to update the data.・Claim 2 further comprising the step of modifying the base.
Process described in Section 4. 26. (a) When a handwritten symbol is written or drawn,
Claim 24 further comprising the step of displaying the handwritten symbols on a screen substantially simultaneously.
Process described in section. 27. Steps (b) and (c) are based on (i) length, (ii) average slope, (iii) center height on the base line, and (iv) curvature (rate of change in slope). 25. The process of claim 24, comprising: determining, and (v) comparing the location of the center figure of each handwriting with the center figure of the handwritten symbol. 28. said step (f) comprises: (a) determining the value of each of said five features; (b) subtracting the feature database value from the newly measured value; and (c) each measurement. (d) add all five values; (e) if a predetermined threshold is exceeded, the result of the comparison is (f) searches the database to find a numerical "hit" and, if there is no match, compares the database value with the newly entered value; 28. The process of claim 27, comprising the step of finding the closest match between. 29. The process of claim 24, wherein the error rate is less than or equal to 5%. 30. The process of claim 28, wherein the program of step (f) requires less than 6K of body memory. 31. The process of claim 24, wherein the handwritten symbols include editing symbols, and the process includes recognizing the editing symbols written on the screen and performing the displayed editing functions. . 32, text in the form of font symbols is displayed on a screen, a) forming a window on the screen that approaches but does not overlap the area of said text to be edited, and (b) placing said handwritten symbols within said window. 25. The process of claim 24, including the step of inputting and displaying, and (c) displaying a font symbol corresponding to the handwritten symbol in close proximity to the handwritten symbol. 33. (a) forming one or more soft keys on said screen to perform an operating function; and (b) touching one or more of said soft keys to perform a corresponding function. 25. The process of claim 24 characterized. 34, in characterizing said handwritten symbols, 1 inch (
25. The process of claim 24, including the step of determining the X-Y coordinates of about 100 to 200 points per 25.4 mm) and about 100 to 200 points per second.