JPH0350621A - Interactive electronic data processing/ storage equipment with data display - Google Patents

Abstract

PURPOSE: To perform the interactive electronic data processing by providing an input pen means and inputting text characters and graphic information to a display means by user's handwriting. CONSTITUTION: A display device 1 is combined with a pen sensing control means 2 which senses the front end position of the input pen on the display device 1 and encodes it; and when an input pen 3 comes sufficient contact with the surface of the display device or is sufficiently close to it, the location (for example, the matrix coordinate position) of a display element under the input pen is encoded and can be used in a control subsystem 4. The subsystem 4 operates display elements to the on/off state, and matrix coordinates are referred to for storage or another processing.

Description

BACKGROUND OF THE INVENTION This invention relates to devices for handling electronic data, and more particularly to interactive electronic data processing and storage devices with integrated data displays. In particular, the present invention provides portable interactive electro-optical data input/output responsive to handwritten text and graphics as well as manual input instructions entered directly onto the display surface to provide electronic description and drawing slates.
Directed to processing, storage, and display devices. The device also allows input/output with other information processing devices such as printers, block-1s or computers.

Various display systems are known that have the ability to sense the position of a user's finger or a writing stylus and instruct or write on the display with a detector for symbolizing and drawing graphical information on the display surface. I can do it. These display systems include a separate sensing substrate (e.g. touch screen), a radiation device (e.g. CI
? These display systems, including devices utilizing various non-emissive displays (T, LED, EL), and which use display element location as an input point, have various drawbacks.

Touch screens and other display systems that utilize separate hardware on the display surface to sense the position of a writing stylus (or finger), such as a dedicated sensing layer, are less desirable for interactive input or processing detailed graphics. Low input accuracy is represented, and input resolution is usually limited by the characteristics of the sensing layer rather than the display. Input positioning and parallax become problems for interactive graphics when physically separate sensing and display elements are employed at the desired resolution for detailed graphics. Also, display contrast is reduced when a separate overlay is utilized as a sensing layer. Additionally, the need for dedicated sensing hardware at the display surface increases manufacturing cost and complexity, as does the need for sensing locations to be interfaced with display hardware to properly coordinate with the appropriate display elements. do.

CRT and display systems that employ other emissive displays (e.g., LEDs or ELs) in communication with a light-receiving pen do not require additional sensing hardware on the display surface; This is obviated by the use of a light-receiving pen that senses the light emitted by the display element. Optical output from the emissive display element sensed by the light-receiving pen is used to determine pen position. (See U.S. Pat. No. 4,268.826.) Because these display systems use emissive display elements,
It consumes more power than a portable battery-powered device.

A non-emissive mechanical display with a writing device is designed to display a non-emissive mechanical display even if the state of these elements changes (i.e., “ON”).
(or "OFF"), employing mechanical display elements that are moved through a fluid (see U.S. Pat. No. 4,520,357). ) requires more operating power than the display.Furthermore, the writing device can write the display by physically moving the touched display element, leaving the previously stored state of the touched display element in memory unchanged. Change the state of an element. Input to memory is done by sensing the state of each display element after input by the writing device, and comparing the sensed state with the state previously stored in memory. That memory The input is dependent on a change in the state of the display element, and the writing device can only change the display element from 'ON' to 'OFF' or vice versa. Therefore, the user can input only one display element "ON" or "OFF" at any time.
to any display element location (if they are
This is a real limitation in interactive word processing and graphics, as well as in other input operations that allow the input to be applied favorably (whether "N" or "OFF").

Other non-radiative displays are also known that utilize display elements as input points. These are interactive electrophoretic displays (“A 5tylusWritab
le [! 1electrophoretic Displ
ay DiviceSID Digest, 1979
, p. 44) as well as thermally addressed smectic liquid crystal devices
ressed Liquid-Crystal F
latDisplay with La5er Lig
ht Pen″5ociety forInforma
tion Display, Digest of
Technical Papers, 1985, 289
-See page 292).

Thermal addressing devices require a total display write time of 10 seconds and an operating power of 25 to 35 watts, which is inappropriate for high portability and interactive applications. Electrophoretic devices require pen voltages of 200 volts or more to achieve proper writing speeds.

A major problem with interactive mechanical, thermal addressing, and electrophoretic displays is that they all physically control the state of the display material to be "ON" or "OFF."
, then update those pen inputs by periodically comparing new inputs from the pen with the display state stored in memory, and updating memory with the new inputs. It is to perform a function.

Therefore, all of these devices have the problem that pen input cannot be performed on any display location regardless of whether these locations are 'ON' or OFF. This limitation makes these devices undesirable for most interactive applications involving pointing to arbitrary locations on a display. Additionally, pen input is performed by changing the state of display elements, so
The achievable input speeds depend on the display fluid and mechanical attributes. This is a limitation of pen operation, especially at high resolutions and high refresh rates.

In addition, low power electro-optical displays suitable for displaying text and graphics are known. These displays are constructed with high pixel densities, including surface areas with thousands of individually addressable pixel display elements. The compactness, flat profile, light weight, and low power consumption of these displays make them flat panel information displays with sufficient pixel density to display graphics and an active surface large enough to display multiple lines of characters. Facilitate at least some degree of portability of products such as laptops and personal computers. However, these displays are typically associated with additional components, such as keyboards, which reduce the overall compact portability advantage and do not allow for direct manual input of data onto the display surface. Further issues relating to the use of known techniques in conjunction with high resolution, portable data input/output, processing, storage, and display devices will become apparent from the following description.

Low power consumption is essential for portability, as is the use of inexpensive, readily available batteries that occupy minimal space and allow long-term operation until battery replacement. In addition, low power consumption allows the use of other types of compact and portable power such as solar cells. Low power consumption also allows for long-term
Enables storage of large amounts of information in low-cost, high-capacity, volatile memory.

Non-emissive displays (e.g. twisted nematic LC)
D) offers very low power consumption and low cost compared to other known flat panel devices, and can be made by known manufacturing processes with high resolution active matrix addressing for high contrast and wide angles. The problem with employing these displays lies in their potential for sensing writing stylus position.

In contrast, on the one hand, non-emissive displays that use display elements as pointers (e.g., mechanical displays) have a display shape B (e.g., '
is visible as a change in
and the display element itself as a pen sensing point by providing an input writing device that physically switches the position of the display element or its state so that it is both detectable by the display electrodes (e.g., as a change in local capacitance). This avoids the need for additional sensing hardware on the display. In order to perform input, these displays are used before writing device input (stored in memory).
and the state of the display element after the writing device input. Any input changes to the display are then updated in memory. Emissive display systems, on the other hand, eliminate the need for additional sensing hardware by utilizing light pens with the ability to sense the optical output of the emissive display element itself. In contrast, non-radiative displays (e.g. twisted nemetic LCDs) where pen input does not physically switch the state of a bistable display element do not switch display elements due to electronic sensing, but whose display elements do not switch states due to pen input. It is also not luminescent, as in emissive displays.

A further problem with such displays is related to speed, at which speed writing stylus input must be sensed to apply high input resolution without additional sensing hardware on the display. Emissive, mechanical, and other display systems that use the display element itself as a pen-sensing point can sample each pen-sensing location on the display surface, either in conjunction with the display output or in separate cycles. performs a sensing function and determines for each pen-sensing (display element) location the presence or absence of a writing device or light-receiving pen.
is determined. For the observer, the interactive display checks all pen-sensing locations on the display surface for new input, and then checks all pen-sensing locations on the display surface for new input within a "frame time" of approximately 30 milliseconds. In this regard, sampling of display elements in a display system that employs display elements as pen-sensing points is sufficient, but the natural pen movement at frame time is limited to each display element location. is of low enough input resolution that it does not traverse display elements more times than it is sampled for input during that frame time. This is necessary to provide fast tracking of any writing stylus movements. Although known display systems that incorporate high power emissive display elements achieve much faster pen sensing, the display system itself (e.g., the display constructed in Japanese Patent Publication No. 58-17247 that incorporates a piezoelectric pen sensing layer) This is possible by providing an additional pen sensing device.

High pixel resolution (and incidentally pen-sensing element density)
For interactive graphics, where is desirable and given a suitable pen-sensing element feel of, for example, 10 mils,
It is an important point to note that the writing device or light-receiving pen can move from one pen-sensing element to another in less time than would be possible to sample all pen-sensing elements on the display. This is conceivable in known displays that employ display elements as . Regarding this issue, known interactive displays typically interpolate between pixels by drawing straight lines between successively sensed pixel locations, and are equipped with dedicated sensing hardware (e.g., a dedicated sensing layer or an external digitizing system). . Alternatives to interpolation are reduced resolution and/or display area (to reduce the number of points sampled in frame time), or limiting the speed of pen movement. For example, in handwriting and signature recognition, where fast, natural pen movements are preferred and accurate pen tracking is desirable, interpolation, reduced resolution, and limited pen speed are drawbacks. These shortcomings will be accentuated as displays capable of providing higher resolutions become available in the future.

It may also be pointed out that known display systems have hitherto been limited in the amount of information that can be stored internally on electronic memory devices; this limitation is limited by storage capacity, physical size, power requirements, available electronic In addition to the cost of memory, A
It also depends on the extent to which commonly used symbols such as text characters and graphics figures can be directly stored in a compact and orthographic system such as SCII.

In the future, typeface text characters that will be displayed as patterns in a number of individual subcell display elements will be ASCII
entered into the display via the keyboard in a standardized code format such as This facilitates efficient text storage, word processing, and interfacing with common text processing devices such as printers that accept standardized text formats.

However, in order to input text characters compactly and orthographically, additional devices for text character selection, such as a keyboard, are usually employed.

The keyboard must be interfaced to a display or display storage means, which requires a stand-alone structure to accommodate the customary arrangement of one-size-fits-all keypads required for comprehensive keyboard text entry, or as desired. This reduces the portability of the display system by occupying limited surface area on the display itself to accommodate text selection devices, thereby increasing size and weight, and/or increasing the size and weight of full-page documents. The display area required for increased viewing and editing is limited.

In advanced botple, interactive data input/output, processing, storage, and display devices, text and high-resolution graphics capabilities are provided without the need for additional text selection hardware such as a keyboard, and additionally on the display itself. It is desired that the text selection device can be operated without occupying the available display surface area of the text selection device.

SUMMARY OF THE INVENTION Therefore, it is an object of the present invention to provide highly portable interactive information input, processing, and
An object of the present invention is to provide a display device.

Another object of the invention is to provide a flat, compact, lightweight portable data input/output, processing and display device that operates with low power.

A more specific object of the invention is that textual or high-resolution graphics information is entered directly onto the display surface with individual point controls, and display processing functions such as word processing and graphics editing are performed on the display surface. providing a data input/output, processing and display device in conjunction with a writing pen with additional means provided for sensing and encoding the position of the pen on the display surface to be controlled in response to pen contact; It is to be.

It is a further object of the present invention to provide a portable data input/output, processing and display device that displays handwritten text or graphics information when the information is drawn directly onto the display surface by the action of a writing pen.

It is a further object of the present invention to combine non-mechanical, non-radiative display elements and to be able to perform without the use of an auxiliary pen sensing layer and without subordination to display fluids or metanic properties, and for pen sensing. Employing a display bridge to provide pen sensing fast enough to accommodate high-resolution large-area displays and subject to display distortion effects associated with a writing pen in contact with a display surface (e.g., an LCI surface) It is an object of the present invention to provide a portable data input/output, processing, and display device that includes means for sensing and encoding a writing pen location and that can be manufactured economically and economically.

It is a further object of the present invention that character display information is internal to the device and responsive to a writing pen activation command to be directed to the particular text to be processed by touching the writing pen to the display portion containing the text to be processed. Portable data input/output, processing and editing with onboard word processing computer program
An object of the present invention is to provide a display device.

A further object of the present invention is to provide a portable data input/output in which handwritten graphic display information can be edited in response to writing pen activation commands and with individual point controls in response to pen position on the display surface with respect to the graphics being processed. , processing and display.

It is another object of the present invention that pages of display data containing textual/graphics information are stored and redisplayed for viewing or further processing, or on an auxiliary device such as a printer, plotter, or plot viewer. The purpose of the present invention is to provide a portable data input/output, processing, and display method for processing text storage means so that it can be compiled into a searchable file that can be output to a computer.

A further object of the invention is that the file names associated with texts stored in the device can be collectively viewed in a file directory and selected for output, display or further processing by the action of a writing pen. The purpose is to provide multiple data input/output, processing, and display.

It is an object of the present invention to provide a votuple data input/output, processing and display capable of interfacing with external devices as well as accepting and accepting the programming of personalized applications.

The present invention utilizes known display systems and flat panels by providing an integrated display and pen sensing device that is configured for high resolution interactive graphics and includes only non-mechanical, non-emissive display elements, resulting in low power operation. Writing on the Display Improves the mechanical display for stylus input.

The present invention is not only suitable for portability, but also for low cost volatile devices that require a continuous power source.
To provide a portable device with lower power consumption than required by conventional interactive displays for long-term, low-cost storage of large amounts of data in electronic memory devices.

When used with an input pen, the display and pen sensing device of the present invention does not require a separate pen sensing infrastructure and can be manufactured economically using readily available technology. Manufacturing complexity is reduced by utilizing display element hardware for pen sensing, thereby requiring additional manufacturing of dedicated pen sensing or electrodes to the device and associated wiring to associate pen sensing locations with display element locations. The present invention, which requires no electronic configuration, eliminates the high power requirements associated with non-radiative interactive displays that use display element position as an input point.
No input position restrictions or pen movement restrictions.

The present invention also provides high-speed sensing on low power, built-in address displays, or active matrix address displays to enable natural pen movement on large, high resolution displays while allowing input to any display element location. provide the means to do so. Advantageously, the means for fast sensing does not add manufacturing complexity to the manufacturing technology of display-specific devices.

A further form of interactive electro-optic slate according to the present invention facilitates the fabrication of time-multiplexed and active matrix addressed electro-optic slates with minimal modifications to common non-radiative, non-mechanical display-specific structures. Despite using an arbitrarily narrow spacing between the proximity display/sensing bridges on the upper and lower substrates, sufficient transmission of the input pen signal between the lower substrate and the input pen is facilitated.

By slightly modifying the lithographic pattern of the display electrodes located on the upper substrate to include small notches compared to the pixel pitch, the signals can be transferred between the electrodes located on the upper plate and the lower steering plate. It is possible to sufficiently connect the two. The notch is small enough to have a negligible effect on display quality. This is applicable to the top base electrodes of time multiplexed address interactive electro-optic slates and the backplane column electrodes of active matrix address interactive electro-optic slates.

Additional forms of interactive electro-optic slates facilitate fabrication of active matrix-addressed interactive electro-optic slates with minimal modification to the common active matrix-addressed non-radiative, non-mechanical display-specific structure and without the need for separate sensing layers. do. Rather than requiring the backplane to be split into backplane row electrodes to sense the row input pen position with a notch to couple the input pen signal to the drain pad for column position sensing, the backplane is not split. , both column and row input pen positions are sensed. Once the position of the input pen is sensed, the backplane is connected to sensing electronics on the periphery of the backplane. These sensing electronics detect the row and column position of the input pen. Therefore, the backplane acts as an input layer for position sensing as well as a regular backplane for displaying information, so that when the backplane needs to be photolithographically partitioned, additional and separate sensing layers can be used. The use of is avoided. Additionally, combining the sensing electronics with only the backplane is less complex and cost-effective than combining the sensing electronics with both the backplane and active matrix layer electronics.

These additional forms of interactive electro-optic slates allow combination of display circuitry with most input pen position sensing circuitry.

This minimizes component count and cost associated with the need to wire many display I10 channels between separate integrated circuits.

These additional forms of interactive electro-optical slates allow for the simultaneous use of input pen position sensing and display electrodes for information display. This eliminates the need to perform stylus position sensing and display functions at independent time intervals, thereby improving display contrast and
Promotes manufacturability by using standard display drive hardware and firmware.

These further forms of interactive electro-optical slates are
To enable the use of an input pen that does not require an electrical connection between the input pen and the slate. One contemplated configuration is possible without including active electrical components within the input pen.

When text or graphics is entered, it becomes dynamically visible on the same surface as it is entered, and is presented to the user in the form of printed text characters or drawn graphics.

As with text or graphic input, display processing changes (i.e., graphic or word processing) can be done by simply touching the writing pen at the desired position of the displayed text in the appropriate order. Alternatively, it is possible to specify a specific character or position within the graphic body.

By minimizing the need for additional controls on the display itself, device weight and auxiliary equipment are minimized and portability is enhanced.

Additionally, a larger display area of the device itself is available for displaying the text, minimizing the hassle of the user having to scroll to different locations on a multi-line page or text.

1 and 2, a portable data input/output, processing, storage and display device according to the present invention comprises a non-mechanical, non-radiative, flat panel, low power display 1. Associated with the display 1 are pen sensing control means for sensing and encoding the location on the display where sufficient contact is made or proximity is sensed with the associated input pen 3.

Also provided is a control subsystem 4 for process control. The control subsystem 4 includes a pen sensing control means 2, a graphics processing subsystem 5, a file management subsystem 6, a text processing subsystem 7, a character recognition subsystem 8, and a data I 10.
It is interfaced with subsystem 9, data memory 10 and display control means 11.

Display 1, pen-sensing control means 2, subsystems 4-9, data memory 10, and display control means 11 are all housed and operably connected within a single button pull housing as shown in FIG. has been done. As shown in FIG.
is connectable to the pen sensing control means 2 by a flexible, electrically conductive cable 12 carrying pen signals or voltages. Otherwise, the input pen is connected by a cable to the pen-sensing control means 2, as described below.

The display 1 shown in FIG. 1 is preferably divided into five functional subsections. At the right edge and bottom of the display 1, individual areas 41-60 are provided which allow the user to select text or graphic display processing instructions by simply touching a selected one of these areas with the input pen 3. Possible 0 individual areas 41-
Each of 60 may be displayed with a symbol indicating its function, and each area may have a different size depending on the frequency or importance of the user's associated commands, and each area may have a given function in conjunction with area 41-60. is associated with a range of each matrix coordinate position that corresponds to each of the horizontal and vertical boundaries of each region, so that touching the input pen to the display surface within these boundaries results in a The function will start.

Therefore, the effect is the same as that of the input key.

The top of display 1 is user message area 6
1, on which the status of the device, commands, or references to guide the user can be visually displayed. The bottom of the display 1 is a text conversion area 62 in which strings of handwritten text characters are entered by the input pen 3 and identified for conversion to type font text for efficient storage and text listing/processing area 63. to be displayed.

Text that is being input into the text conversion area 62 by the user or being output from the data memo manager 0 is displayed on the text/processing area 63. Graphic information or handwritten text may be drawn with the input pen 3 directly on the surface of the text list/processing area 63. The text list/processing area 63 occupies the main surface of the display l, and preferably contains text or Has enough area to display pages of graphic information.

When handwritten text is entered onto the text conversion area 62, the movement of the input pen 3 is tracked and becomes visible on the underlying display surface so that the user can see what is written. The text conversion area 62 is filled with text, or the user selects C0NV[! RT'
When the input pen 3 touches the area 59 indicated by , the handwritten text displayed in the text conversion area disappears and reappears as type font text in the text list/processing area 63. Text conversion area 6
2, new text can then be entered. When a new line of type font text is thus added to the text list/processing area 63, the previous converted type font text displayed there will be 'LEFT M
reformatted to provide space for additional text with automatic horizontal positioning according to user-configurable left and right margins invoked by touching areas 53a and 53b labeled "ARGIN" and "RIGHT MERGIN" .

Graphic information or handwritten text drawn directly on the text list/processing area 63 can be drawn directly on the text list/processing area 63 when the device is in graphics mode (if the device is in text mode,
The user presses input pen 3 to T[! XT/GRAPH" to operate the device in graphics mode) and then edit according to the graphics command initiated. Next, the user uses the input pen 3 to select the area 47.
48 or 49, i.e. “lN5II!RT
R""ERASE""NOI? MAL") and touch the input pen to the displayed graphic to be processed by the selected action. Similarly, the word processing function sets the device to text mode and then moves input 3 to area 47. -60 and touch the input pen to the text to be edited.

A wide range of graphics editing and word processing capabilities can be provided that can rival those found in professional graphics and text processing systems known to those skilled in the art.

An area 50 labeled "PAGE 5CAN" is provided near the bottom of the display 1 for rapidly navigating back and forth through pages of multi-page text.

By moving the input pen 3 from side to side across the area 50, the page is scrolled back and forth, respectively, in proportion to the speed at which the input pen is moved.

As shown in FIG. 2, the display 1 incorporates a pen sensing control means 2 that senses and encodes the input pen tip position on the display 1, so that the input pen 3
Once in sufficient contact or proximity with the display surface, the location range (e.g., matrix coordinate position) of the underlying display element is encoded and made available to the control subsystem 4. The control subsystem 4 is capable of operating the display elements into the "ON°" or "OFF" state and referring the matrix position coordinates to storage or further processing. The display is preferably a flat panel passive matrix or active matrix (e.g. thin film transistor) electronically addressed non-emissive display that can be viewed in a known reflective mode. l can be turned on or off at individual point controls depending on input from data memory 10 or sufficient contact or proximity to the input pen.
'' (e.g., visible or invisible) includes elements that can be manipulated.

In FIG. 3A, a form of passive matrix addressing for display 1 is shown. Display l has a transparent upper substrate 13 spaced apart from a lower substrate 14 and having a cavity therebetween containing an electro-optic (eg, liquid crystal) material.

At the internal surfaces of the top substrate 13 and bottom substrate 14 of the passive matrix addressed display 1 shown in FIG. Since the 0 row and column electrode intersections, which are configured perpendicular to the column electrodes, form the display element matrix, a potential of opposite polarity can be applied to one of the top substrate row electrodes (e.g. 16B) or to one of the bottom substrate column electrodes. By applying one (e.g. 17C) to an intervening electro-optical (e.g.
(liquid crystal) material is manipulated to become "visible", for example.

To promote display clarity and eliminate distortion during pen input, a spacing member 22 of a suitable transparent, electrically insulating material is provided between the upper substrate 13 and the lower substrate 14 as known to those skilled in the art. Suitable known thin film deposition methods for making the zero spacing member 22 made by all deposition and masking processes include, for example, sputtering and e-beam evaporation, which are commonly employed to manufacture display-specific devices.

The spacing member 22 prevents the input pen pressure on the upper substrate 13 from causing thickness variations within the cavity 15 and thus prevents distortion of the display 1.

To minimize display quality degradation, spacing member 22 is preferably transparent, narrower than the distance separating adjacent display element locations, and maintains sufficient cavity thickness within an acceptable range under input pen pressure. Separated by maximum allowed distance. Additionally, rather than providing the full length and width of display 1, spacing member 22 desirably provides a gap to allow display fluid to flow more easily across the display during manufacturing.

In the passive matrix addressed display shown in FIG. 3A, the respective row and column electrodes 16 and 17 themselves are preferably employed to sense the presence of the input pen 3. In one form, the ends of the display matrix electrodes include pen sensing control means 2 for sensing touch or sufficient proximity of the input pen 3 and display control means for operating the display element into an "ON" or "OFF" state. 11. (In other embodiments described below, the sensing of touch or sufficient proximity of the input pen 3 and the operation of the display element occur simultaneously.) Therefore, the companion electrodes 16 or column electrodes used to operate the display element Since 17 is also used to sense the position of the input pen 3, the configuration of the display 1 may include additionally substantial input pen sensing electrodes and associated conductive lines or other substrates configured within the device. Simplified by reducing need. Additionally, parallax and positioning problems due to display element position sensing points being located on dedicated substrates that are located at a distance above the associated display element itself are avoided. Furthermore, problems associated with wiring multiple display element locations to their associated input pen sensing locations are minimized. Finally, the problem associated with formatting the input data from the input pen 3 for display is
Input row and column coordinates are stored in data memory 10 and display 1
The matrix coordinates of the display are the same for both itself and are thus kept to a minimum.

The pen-sensing control means 2 does not independently display information, but may be used in conjunction with digitizing systems that employ an X-Y grid of conductors to perform stylus sensing or position encoding functions. Such a device, which may include sensing and encoding means, is sensed by the stylus and used to determine the stylus position on its grid (US Pat. No. 4,02
2,971) typically output an analog or digital signal on the input pen sensing electrode to create an electrostatic field on the X-Y grid.

When implemented in conjunction with analog signals, these techniques typically do not use sensing electrodes for each matrix that can be sensed; rather, analog techniques utilize only a small number of electrode lines per inch ( For example, an equivalent input resolution on the order of 1000 lines per inch (4 lines per inch) is achieved.

In FIG. 3A, in analog electrostatic sensing, only some of the available row and column electrodes 16 and 17 are connected to the pen sensing control means 2. In FIG. Additionally, analog electrostatic sensing is typically performed with row resistors 80^ placed between the access electrodes 16 to facilitate the formation of an electrostatic field on the grid, and secondary resistors 80
0B is required to be placed between adjacent column electrodes 17. As shown in FIG. 3A, these resistors are located after the function selection switch 39 so that only when the sensing function is activated, resistors 80A and 808 form part of the X-Y grid, and A zero function selection switch 39, which does not interfere with the display function, connects the pen sensing control means 2 or the display control subsystem 11 to the row and column electrodes 16 and 17 for selecting input pen sensing or data display, respectively.

Alternately, a digitizing technique for input pen sensing and position encoding with digital signals guided on an X-Y grid (see US Pat. No. 4,560,830) is used in connection with the pen sensing control means 2 It is possible to implement. This implementation, however, requires that a large number of row and column electrodes be employed for input pen sensing, and that the associated amplifiers and wiring between bridges be located behind the function selection switch 39.
Row and column electrodes 16 and 17 only for input pen sensing operations.
It becomes possible to restrict their connections to. The pen-sensing control means 2 may additionally include suitable electronic arrangements for imposing level and timing constraints on the signal conveyed by the input pen 3, and for sensing and encoding the input pen position. Upper board 13
are electrostatically coupled to the sufficiently wide row and column electrodes 16 and 17 via.

In FIG. 3B, this is accomplished by electrostatically connecting the input pen signal originating from the tip of the input pen 3 to the row and column electrodes 16 and 17 in the pen signal source 24. The ends of the row and column electrodes 16 and 17 can be periodically connected to the row sensing means 2A and the column sensing means 2B, respectively, by the action of bidirectional switches 25A and 25B, respectively. For example, level sensing means 19 (analog or digital comparison means and analog/digital If a signal of sufficient amplitude is detected by the level sensing means 19, the synchronization logic means 20 compares the timing characteristics of the sensed signal with those of the pen signal source 24.

Finally, the encoding means 21 transforms the input from one of the plurality of input electrodes into a suitably coded binary number representing the matrix coordinate position at the proper level, offset and timing.

Alternately, it serves as both a means for sensing the sufficient proximity of the input pen 3 to the display 1 as well as a means for manipulating the display fluid (e.g. liquid crystal) and forming an extension to the active matrix addressed display dedicated device. Display devices with display element electrodes can be used.

In FIG. 4A, a conventional active matrix addressed (e.g., LCD) display shows details of several individual display elements 28A-28F and their associated control electronics 304-30F and 31A-
Shown with 31F. Such active matrix address displays are known and how such displays can be employed such that the display surface hardware used for the display function is also employed to sense and encode the position of the associated input pen. It will be described only to the extent necessary to explain what is changed.

In FIG. 4A, row display element drive electrode 1
7 and vertical gate electrodes 16 are shown arranged in respective columns and rows, their ends connected to horizontal drive electronics 32 and vertical drive electronics 33, respectively. Vertical drive electronics 33 manipulate display row enable electrodes 16 sequentially, one at a time, in directed directions 34 essentially in the manner of a vertical shift register.

A selected one of the display row enable electrodes 16 is operated by vertical drive electronics 33 to connect the display elements of the selected row to the associated display element drive electrodes 17.

When one of the display row enable electrodes 16 is operated by the vertical drive electronics 33 to enable a given row of display elements, the respective data enable transistors 3 of the enabled rows are activated.
1 are enabled to enable input of display data to all of the respective display elements in the enabled row from the display element drive electrodes 17 .

During the next cycle of the vertical drive electronics configuration 33, the just-enabled display row enable electrode is operated to disconnect all of the display elements of the previously enabled row from the associated display element drive power 117. .

When displaying information, the entire line of the liquid crystal display element 29 is displayed like 1! (For example, “ON゛.

or OFF”) is loaded into the horizontal register 38 via the input bus 37. After this data is loaded, it is latched onto the horizontal drive electronics 32 and outputs the data onto the display element drive electrodes 17. .This display data is displayed in vertical drive electronic configuration 33.
is gated to any display launch that is enabled by the output line of . The entire liquid crystal display element 29 is formed from drive electrodes 35 and a backplane 36 made of a sufficiently transparent and conductive material and which can be provided continuously over both horizontal and vertical display surfaces. When the potential on a given drive electrode is sufficiently different from that of the backplane,
The associated display fluid in an area sufficiently close to the drive electrode 35 is, for example, manipulated to become 'visible'.

For example, horizontal drive electronics 32 outputs display information on display element drive electrodes 17 while data is being loaded into horizontal registers 38 . Display element electrodes 17 are connected to display rows L (e.g. 16
L) is gated on the display row and operates the data enable transistor (e.g. 31^-3 IC) of each display element in the row to receive and take data present on the display element drive electrode 17. has its display elements (eg, 28A-28C) gated in response to a signal on the Lth output line from the vertical drive electronics 33 for. When this data is input to each respective display element in the row L (e.g. 28A-28C), the storage capacitors associated with each display element in the row (e.g. 30^-30C) The input data is stored for when a display row is disabled and the next display row is enabled in the next cycle of vertical drive electrodes 33.

Storage capacitor 30 drives each display element's associated liquid crystal 29 until the next row is available for receiving or taking input data. During the next cycle of the vertical drive electronics 33 in the indicated direction 34, the row display elements are disconnected from their associated display element drive electrodes and the row storage capacitors 30 store their associated input data. , extend the influence of the data on their associated liquid crystals 29. With the next shift of the vertical drive electronics 33, the data in the horizontal drive electronics 32 meant to drive the display elements in row M (i.e., L+1) is latched into the horizontal drive electronics 32, and The Mth output line (i.e., 16M) of vertical drive electronics 33 connects the data enable transistors (e.g., 310-31F) of each display element in row M to receive and take new data on display element drive electrodes 17. ) to gate. This process is repeated for row M (ie, L+2) and repeats until the bottom display row is available, at which time vertical drive electronics 33 begins again with the top display row.

The display state previously entered into each display element of the previously enabled row is then stored in the associated storage capacitor 30 of each associated display element, so that the stored charge on each capacitor is transferred to its associated display element 29. can be sufficiently driven for a longer time than the dielectric relaxation period of the display element. Preferably, this time exceeds the time required to shift through all of the other display rows and back to the first one again.

In the case of an active matrix addressed display applying pen input, as shown in FIG. 5C, spacers 22 are preferably provided above the display element drive electrodes themselves to prevent distortion due to input pen pressure on the display surface. ing. The spacer 22 is placed above the display electrodes themselves to maintain space for the display fluid (note that in Figure 3A the spacing members are placed between the electrodes). Additionally, rather than running the entire length and width of the display, spacers 22 desirably provide a gap through which display fluid can more easily flow throughout the display during manufacturing.

In FIG. 48, similarly to the display function, the 4A
To apply the input pen in the active matrix address display in the figure, the ends of the display element drive electrodes 17 are alternately switched by a function selection switch 39, which turns the display element "ON" or "OFF". ” is arranged between the horizontal drive electronic arrangement 32 and the pen-sensing control means 2 for sensing the contact or sufficient proximity of the input pen 3 to the display 1 and encoding the input pen position. .

In FIG. 4B, in the case of an active matrix address display applying input pen sensing, a display sensing transistor 79 is placed in series with each data enable transistor. Additionally, for each display element 29, a sufficiently transparent and conductive sensing pad 72 is preferably provided directly on an insulating layer (e.g., silicon dioxide) atop the display electrode 35 as shown in FIG. 4C. be deposited. As shown in FIG. 4B, sensing pad 72 is electrically connected to a point between display sensing transistor 79 and data enable transistor 31. As shown in FIG. The conductive display sensing electrode 78 is at right angles to the data enable electrode 1.
6'. As shown in FIG. 4B, display sense electrode 78 and data enable electrode 16' form a pair.

During display operation, display element drive electrode 1
The row of display elements enabled to receive display data from the horizontal drive electronics 32 via the display sense transistor 79 and data enable transistor 31 associated with all display elements of the enabled row. Both associated display sense electrodes 78 and data enable electrodes 16 are connected via vertical function select switches to a potential sufficient to activate the
' has. The configuration of the vertical function selection switch during display operation is shown in FIG. 4B.

In FIG. 4D, during the input pen sensing operation, the vertical function selection switch 39^ connects only the display sensing electrode 78 of the enabled row to the vertical drive electrode 33;
For example, an electrostatic signal emanating from input pen 3 (as shown in FIG. 4B) is dependent upon the display data stored in capacitor 30 charging or discharging onto display element drive electrode 17 through data enable transistor 31. without being guided to the display element drive electrodes 17. In addition, the frequency and amplitude of the signal generated by the input pen 3 and the thickness of the insulating layer separating the sensing pad 72 and the display electrode 35 determine whether the input pen signal is stored in the capacitor 30 or displayed on the associated liquid crystal element 29. It is such that it does not interfere with the displayed display data.

When a device having a display element such as that shown in FIGS. 4B and 4C displays only information, the vertical drive power 8i33 is connected to the output point on the vertical drive electronics arrangement via each row enable electrode 16. Sequentially shifting a single 'ON' bit, and vertical function selection switch 39A connects each row enable electrode 16 to its associated display sense electrode 78 in the same way as data enable electrode 16'. When data enable electrode 16' and display sense electrode 78 are activated to connect each display element in a display row to an associated display element drive electrode 17, each display element in the display row has both gated data enable transistors 31 and Having display sensing transistors 79 allows each row of liquid crystal elements 29 and associated capacitors 30 to be connected at associated display element drive electrodes 17 .

However, when a display row is first enabled by its associated row enable electrode 16 from the vertical drive electronics 33 to apply input pen sensing, the vertical function selection switch 39^ will cause the row's associated display sensing electrode 78 to be activated. At the same time, the vertical function selection switch 39A is initially activated so that the pen sensing control means on the display l is activated only to connect to the vertical drive electrode 33 (as shown in Figure 4D). The display element drive electrode 17 is connected to the pen sensing control means 2 long enough to sense and encode the input pen position 111F. During this period, if the input pen 3 is in contact with or in close proximity to a display row other than the one gated by the display sensing electrode 78, the display sensing associated with each display element in the row being touched by the input pen The transistor 79 is turned off and therefore cannot fully transmit the input signal capacitively coupled on the sensing pad 72 associated with the touch display element to the pen sensing control means 2, but if the input pen 3 is not sensing The input pen signal is sufficiently coupled to the pen sensing control means 2 if its associated display electrode 7 is positioned in the display row end enabled, thereby activating the row's associated display sensing transistor 79.

As in the example of FIG. 3B, the pen sensing control means 2 receives as input a plurality of column electrodes, and the input pen 3 is in substantial contact with or in close proximity to an enabled display row. It consists of level sensing means known in the art for determining the input pen's column coordinate position, synchronization logic, and an encoder that outputs the column coordinate position of the input pen as a suitably encoded binary number. - Once the column coordinate position of the input capen 3 has been determined, the column coordinate is associated with the number of display rows currently available; the 0 matrix coordinate is associated with the number of display rows currently available; output to the control subsystem 4 for use in connection with mapping to interface functions).

After sensing input, the currently available row receives data for display. At this point, the vertical function select switch 39^ is activated, connecting both display sense electrodes 78 and data enable electrode 16' to the vertical drive electronics 33. Additionally, function selection switch 39A connects display element drive electrode 17 to horizontal drive electronic arrangement 32.
The vertical drive electronic arrangement 33 is then actuated to connect to the pen-sensing control means 2 (the display element drive The next display row is enabled to be operatively connected to the horizontal drive electronics (via electrode 17) and subsequently shifted to receive output (display) data from the horizontal drive electronics 32. The process is repeated for each row of display 1 in turn.

The input pen sensing techniques described above are configurable such that the present invention simultaneously senses an entire row of input pen sensing elements and provides an encoded input pen position, which is sufficient for high resolution and natural pen motion. This is an example illustrating that it is possible to provide a means for high speed input pen tracking.

Suitable for interactive displays with high resolution and large surface area, and for application in high-speed input pen position sensing and position encoding, the device according to the invention is suitable for interactive displays with high resolution and large surface area. It is configured to perform a time-independent input pen sensing function and is therefore limited only by the speed of the associated input pen sensing electronics. To facilitate high-speed continuous input pen sensing, the display data is transmitted to each display row prior to each time a display row is enabled to receive display data on the display element drive electrodes (during the transfer of display data to each display row). All four display lines (rather than having only one display line available at a time for input sensing functions) can be addressed and sampled at high speed. This is accomplished by clocking the vertical drive electronics 33 at a higher frequency than that of the clock frequency associated with the display function during the moments that occur between each display data that is available. During this period, each row of the display 1 is used for a short period of time, long enough to determine whether the input pen 3 is in substantial contact with or in close proximity to any of the display elements in the enabled row. It becomes possible.

In FIG. 5A, for each row, the determination of column position is made as follows for all display columns simultaneously:
This is only done if it is determined that the input pen 3 is substantially in contact with or in close proximity to the enabled row. This capacitively couples the input pen signal from the input pen 3 through the top board (to the sensing pad 72) and of the enabled row (enabled for sensing).
This is achieved by directing all display element drive electrodes 17 via level sensing means 19. The level sensing means 19 polls all column electrodes simultaneously and performs analog comparison or digital comparison and analog-
A digital conversion can be included to determine whether the actual amplitude input pen signal is in contact with or in close proximity to an available row of display element locations.

If so, the synchronization logic means 20 will respond to the input pen 3 to ensure that the sensed signal originates from the input pen rather than from other signal sources such as ambient noise. The reception from the TETI playback is provided for comparing the received signal with that of the pen signal source 24. After i, the encoding means 21 act to transform the sensed column electrode location or column identification into a suitably encoded binary number.

A suitable alternative to active matrix addressed liquid crystal devices handles the sensing signal generated from the pen signal source 24 and that sensing signal is connected to the vertical drive electronics arrangement 33.
is directed to the display surface (rather than directly to the input pen 3 as described above) when the input pen 3 is momentarily clocked at a high frequency.

In this configuration, the same signal for all display element drive electrodes is transmitted via display element drive electrodes 17 to all display elements (specifically sensing pads 72) in the enabled row. For each enabled row, this signal is communicated for a period sufficient to enable the pen-sensing control means 2 to identify the row receiving the highest amplitude signal from the input pen 3 (i.e., when the display element is exceeds a given threshold, as determined by the level detection means 19).

The synchronization logic means are further adapted to identify the sensed signal to the 0th order, which identifies the sensed signal as a pen input, allowing determination of the column closest to the input point of the touch by one of the following alternatives: .

In FIG. 5B, determining adjacent columns involves sending a pulse-coded column identification signal, or sequentially a non-coded signal, onto the display element drive electrodes 17 to be picked up by the input pen 3, and the associated columns and It involves determining a maximum transmission value with respect to row coordinate position, eg, with respect to a threshold window set for an acceptable or expected display element positional offset.

The input pen signal transmitted on the display element drive electrode 17 is picked up by the input pen 3 when in contact with or in close proximity to an enabled row and is detected with a substantial amplitude by the level sensing means 19 and by the synchronization logic means 20 checked for synchronization by Once the signal is detected by the input pen 3 with appropriate level and timing characteristics,
An enable signal is sent to means 71 for switching display element drive electrodes 17 to column level sensing means 72A, column synchronization logic means 72B, and column encoding means 72C for determining the column coordinate position of the enabled row. The modifications consist in providing bi-directional ports, the required level comparison means, the synchronization logic, and the encoding means associated with the pen signal source 24.

The modification is shown in Figure 5C, where the fast input pen sensing is
It has the advantage of being accomplished on an active matrix addressed display without the need for display sensing electrodes and transistor multi-vertical function selection switches and associated wiring to be constructed. The display element is constructed as in FIG. 4A and in this form, with the display electrodes 35 being used to sense input pen signals originating from the input pen 3. Active matrix addressing display and associated backplane 36 (
4A and 4B) is a continuous conductive surface to which a potential may be applied, when that potential is sufficiently different from that of a given display element drive electrode, that potential is to be activated. Display state given the associated display fluid below (e.g. ON'' or O
FF'').

The backplane 36 shown in FIG. 5C is vertically and horizontally continuous and electrically conductive, and is separated by a distance substantially less than the width distance of the display elements of the display. With a comparable width,
It is formed from multiple electric bridges. These backplane electrodes are electrically isolated from each other except when the device is displaying data, at which time the switch means 75 is operated to connect them together and make them work together with special features.

During input pen sensing, which occurs between shifts of vertical drive electrode 33 (as described in the examples of FIGS. 5A and 58),
The row switch means 75 is operated to electrically isolate each backplane row electrode from its immediate vicinity, and connects each electrode individually to, for example, the level sensing means 19, the synchronization logic means 20, and the example of FIG. 5A. Connected to row sensing means 76 comprising encoding means 21 as shown.

This input pen sensing operation is reduced to a two step process. First, the row switch means 75 is operated to connect the row electrodes of the backplane 36 to the row sensing means 76.The row in which the input pen 3 is sensed is then enabled by the vertical drive electronic arrangement 33. and connects the row of the display element where the input pen is sensed to the display element drive voltage i17. At the same time, column switch means 74 connects display element drive electrode 17 to force sensing means 77 configured similarly to row sensing means 76 and outputs the resulting column coordinate position.

The display data is then transferred to the row switch means 75 to connect the row electrodes in the normal functioning of the backplane.
and is output to the display 1 by operating the column switch means 74 to connect the horizontal drive electronics 32 to the display element drive electrodes 17. During input pen sensing, the row touched by the input pen 3 keeps it activated for a sufficient time for all data enable transistors 31 of the touched row to determine the column coordinate position by the force sensing means 77. It should be noted in the above embodiment that the following is required.

Therefore, in the frame time (i.e. approximately 30 ms)
, during which the input vents 3 are in contact with or in close proximity to rows of display elements, and only certain rows cannot display the information stored in their associated storage capacitors 30, in the case of high-resolution displays (many displays per inch). row), this may not be a significant drawback; however, an alternative is, as shown in FIG. 4B,
By employing a display sensing electrode 78, a transistor 79, and a vertical function selection switch 39A,
Thereby, the data in the capacitor 30 can be protected when determining the month. This latter alternative provides the fast input pen sensing described in connection with FIG. Row display data can also be protected. It is also anticipated that analog or digital input pen sensing techniques used in connection with digitization, known to those skilled in the art, could be employed; such implementations are as described in connection with FIG. 3A. It is similar and has the advantage that only the row enable transistors need to be configured. Such implementation is facilitated by pre-existing matrix electrodes of active matrix addressed displays. However, the input pen sense signal generated on row enable electrode 16 must be of a sufficiently small amplitude to prevent activating data enable transistor 31, thereby converting the input pen signal into display data. prevent interference.

Forms of passive matrix addressed displays, or time multiplexed and active matrix addressed displays, which utilize the display electrodes themselves as a means of sensing the input pen 3, have been described above. 6th
In the figure, the configuration that utilizes time multiplexing and active matrix addressing to sense the input pen 3 typically has a signal on the top glass 1004 and the top electrode 1001.
It takes some time to bond to the lower electrode layer 1002 through the layers. During these periods, upper type ff1
loo1 are grounded and spaced closely together such that the signal from the input pen 3 coupled to the bottom electrode 1002 is sufficiently shielded by the top display electrode 1001 located on the top substrate.

This effect becomes increasingly important as display panels become available with low indium tin oxide (rTo) electrode resistance and high resolution.

In FIG. 7, the top electrode 1001 of a time multiplexed or active matrix address display is photolithographically patterned to include a notch 1005 that allows input pen position sensing. Notsuchi 100
5 has a sufficiently small area so as to minimize the impact on display quality.

The absence of an electrode at the notch 1005 causes only the area immediately below the notch to be in the OFF state at any given time, regardless of the state of the rest of the associated pixel area (i.e., the area where the top and bottom electrodes overlap). In the process of coupling the input pen signal to the bottom electrode 1002 for column sensing, the field line associated with the input pen signal is connected to the grounded notch 10 of the top mold 11001A.
05 to the lower electrode 1002.

In the cross-sectional view of FIG. 8A, the input pen It can be seen that the electric field lines 1007 generated from the tip of 3 terminate on the lower electrode 1002. In FIG. 8B, without the bottom electrode 1002 in such relative proximity to the bottom electrode 1001, the electric field lines 1007 either terminate directly on the top surface of the bottom electrode 1001 or have a length beyond the notch 1005. , bend back, and terminate on the underside of the top electrode.

The ability of the notched electrode configuration to allow coupling of the input pen signal onto the bottom electrode has been experimentally confirmed using the TO electrode and is plotted in FIG.

In FIG. 9, the horizontal axis represents the ratio of the notch area to the area associated with each pixel, and the vertical axis represents the measurement at the bottom electrode relative to the signal level coupled to the bottom electrode through the notch 1005 without interfering with the top electrode. Represents the ratio of signal levels. The plot in Figure 9 is 50
: Applied to the display panel with a ratio of top glass thickness: pixel pitch: liquid crystal cavity thickness of 10:0.2. This applies, for example, to a 50 mil top glass with a 10 mil pitch and a 5 micron cavity thickness.

It should be noted that a notch area/pixel area ratio of 0.05 usually applies to most standard displays manufactured without notched electrodes and is sufficient. That is, the distance separating the conventional "non-notch" electrodes of a standard display often allows sufficient coupling of the input pen signal to the bottom electrode.

Furthermore, while the time-multiplexed form of the display described above does not require substantial slate changes from traditional display-only panel structures, in active matrix addressed display form the backplane electrodes are preferably split so that the input pen 3 row coordinates can be provided for position sensing. These backplane electrodes act as independent sensing electrodes during row sensing operations and are shorted together during display operation so that they can provide single potential backplane functionality.

A further complication is that the sensing electrode is typically closely interfaced with both backplane electrodes and the active matrix layer control electronics. Display operation is complicated by the fact that display operation must be interrupted during input pen position sensing.

In FIG. 10, these shortcomings are explained by the use of a backplane 1 consisting of a continuous sheet of conductive transparent material such as ITO for sensing the position of the input pen 3 that generates the input pen signal.
008 with an active matrix address display. While the device is displaying data,
Backplane 1008 is connected to display electronics 1009 via analog switch 1010, allowing it to operate as a conventional backplane. At a momentary interval imperceptible to the user, the backplane 1008, via the switch 1008,
The bank plane acts as a resistive position sensor for these spacings as it is connected to the position sensing electronics as shown in FIG. During position sensing, pen signal source 1
The input pen signal generated from 012 is led to the input pen 3 via a conductive cable. The input pen signal is capacitively coupled onto the backplane 1008 via the top glass 1017. For row (or column) input pen position sensing, there is a varying impedance between the input pen tip 1015 and the backplane edge 1016 due to the distance between the input pen tip and the backplane edge.

Since row and column input pen position sensing are the same, the explanation of row coordinate input pen position sensing would be sufficient to explain the hundred row and column sensing.In the case of 0 row coordinate sensing, the input pen signal is the top glass 1017 and along backplane 1008 to backplane edge 1016A.
is combined with As the input pen tip 1015 moves further away from the backplane edge 1016A at the apex of the display panel, the contribution of the backplane impedance to the current path increases. backplane edge 1
016^, backplane 1008 is connected to the input of switch 1010 at multiple contacts.

During display operation, switch 101O is operated to short all contacts 1018A and 10188 to display electronics 1009. During input pen position sensing, switch 1010 connects each contact 1018A and 10188 to position sensing electronics 1011. Contacts 1018^ may be connected to the row sensing electronics one at a time through other analog switches or multiplexers, or there may be dedicated row sensing electronics associated with each contact. In any case, the latter case is assumed and the sensing electronic configuration associated with a single contact is described. The sensing electronic configuration of all row and column contacts is preferably the same.

In FIG. 11, input pen 3 generates an AC signal Vstylus which is capacitively coupled to a transparent, conductive backplane layer (eg ITO) via a top glass capacitor Ctop glass. The signal is routed along the backplane resistor Rbackplane to the display edge (1016^ in FIG. 10) and row edge wiring 1018A.

Each row edge wire 1018 is sequentially routed to the output 1020 of an analog multiplexer for subsequent processing. The individual multiplexer inputs 1018A passed to multiplexer outputs 1020 are controlled by counters 1021 so that the multiplexer input channels are processed sequentially. Since clock 1022 controls the speed of the sequence, counter 1021 is incremented on each clock pulse. The signal at multiplexer output 1020 is processed by an operational amplifier configured as a current-to-voltage converter 1023. 6 inch edge, 150 ohm resistance per square, 10 mil pixel pitch backplane, 50 mil top glass thickness, 50 MHz sine input pen signal at current-to-voltage converter input (fin) for all input pen positions. Current range is 9
．． 7 to 9.9 microamps. R1-R2
-250,000 ohms, the corresponding range of voltages at the output of the current-to-voltage converter is from 2.425 to 2.
It is 475 volts.

Differential amplifier 1024 amplifies this range of voltages for the above parameters from zero volts to 5 volts. To do this for the above parameters,
Vref in Figure 11 is 2.425 volts, R6-R3=
lO00,000 ohms, and R4=R5-1,0
00 ohms, the differential amplifier 1024 gains a gain of 100, and the differential amplifier output 1025 has a range comparable to that of the following analog-to-digital (A/D) converter 1027.

A peak sense and hold circuit 1026, of a type known to those skilled in the art, then generates a DC voltage level corresponding to the peak amplitude at the output 1025 of the differential amplifier 1024.

A/D converter 1027 is peak detection and holding circuit 102
generates a digital representation of the DC voltage level appearing at the output of 6.

The clock signal to the counter 1021 is also delayed 102.
8 to the peak detection and holding circuit 1026, and then to the A/D converter 1027 via the second delay 1029. Clock pulse is counter 1
021 and new multiplexer input line 1
Once a path is established from I018A to multiplexer output 1020, peak detect and hold circuit 1026 is activated until sufficient time has elapsed for the signal to propagate via current to voltage converter 1023 and differential multiplexer I024.
Delay 1028 provides sufficient delay so that the signal cannot be captured by the signal. Similarly, until the end of the current clock pulse (i.e., until sufficient time has elapsed for the peak detect and hold circuit 1026 to obtain the peak amplitude from the signal)
029. As the current clock pulse approaches its end, the peak amplitude from peak detect and hold circuit 1026 is converted from analog to digital by one shot 1030, allowing for digital representation.

The output from the AID converter is processed by the microprocessor-10
31, it is determined whether a threshold level has been exceeded, and contact or proximity between the input pen and the display surface is displayed.

If the signal level from A10 converter 1027 does not exceed the input pen proximity threshold value, such A/D output is ignored and counter 1021 is incremented to sample the next multiplexer input 1018A. On the other hand, when such a signal exceeds the input pen threshold, the A/D output is compared to the previous maximum^/D output. If such current A/D output is the maximum value ever, that output is stored in memory along with the maximum output of counter 1021 and the counter is incremented to sample the next multiplexer input 1018A. It will be done. The process continues until all multiplexer inputs 1018A have been sampled.

Counter settings related to maximum A/D output are related to display line numbers. This means, for example, that each counter setting is previously associated with a line number in memory 1032, so that the counter setting associated with the maximum A/D output only matches the associated line number stored in said memory. Possible in good cases. The counter settings and row number hits can also be calculated mathematically by the microprocessor-1031. Once the line number corresponding to the current input pen position is determined, the line number can be output for display electronics 1009 processing as shown in FIG.

Preferably, the same hardware is used and the same processing is performed for determining the position of the sub-input pen. However, although connections 1018^ were brought out from row backplane edge 1016A as described above in connection with row coordinate determination, multiplexer connections 1o18B are brought out from column backplane edge 1016B.

Also, in the time multiplexed and active matrix addressed display described above, separate circuits are used to perform the display function and the input pen position sensing function. Furthermore,
Although display electrodes are used for both the input pen position sensing and display functions, these display electrodes are not used simultaneously to perform the two functions, and for this reason, some examples (in particular, For high definition and/or large display areas), the display drive function of conventional displays requires some modification and some contrast loss occurs due to the reduction in pixel dwell time. These drawbacks appear in both the time multiplexed and active matrix addressed displays described above.

As a means of integrating the display function and input pen position sensing function into the conventional drive device as much as possible, eliminating the need for display operation interruptions, and minimizing the total number of additional devices, the following display drive/sensing circuitry is provided. , applies to both time multiplexed and active matrix addressing displays. This allows simultaneous operation of display and input pen position sensing.

Referring to FIG. 12, each display electrode channel 1034
A transmission gate (1035) is incorporated on the modified drive/sense integrated circuit 1033 to provide two possible current paths for each drive/sensor integrated circuit 1033. Current path selection for each transmission line 1035 is determined by the voltage level on control line 1036. One of the two current paths (to facilitate normal display functions) connects the display electrode 1034 to the amplifier 10.
The display driving electronics 1037 is connected to the display electronics 1034 while creating a high impedance between 38 and 38.
and the other current path couples display electrode 1034 to amplifier 1038 while creating a high impedance between the display electrode and display drive electronics 1037.

Simultaneously with the display operation, the shift register 1039 changes the display electrodes 1034 associated with each pulsed transmission game 035.
A very short (eg, less than 200 nanoseconds) pulses are sequentially shifted into each of the transmission gates 1035 to sequentially couple them to an amplifier 1038 .

When one of the transmission gates 1035 is pulsed as described above, an input pen that is in contact with or in close proximity to the display at a position sufficiently close to the display electrode 1034A (associated with the pulsed transmission gate 1035A) high frequency,
The low amplitude signal is coupled to amplifier 1038.

The function of the display drive electronics 1037 is the same as that of a conventional display driver. A transmission gate 1035^ is used to couple the display electrode 1034 to an amplifier 1038^.
When pulsed, capacitor 10428 connects display electrode 1
Daniri C held on the liquid crystal cell related to 034^
It also blocks the drive voltage, allowing any low level high frequency input pen signal from an input pen on the display surface (sufficiently close to electrode 1034) to reach amplifier 1038A.

It is also possible to replace capacitor 1042A with one single capacitor for each input to amplifier 1038. Displays input pen signal frequency (rows and columns)
Because it is considerably larger than the drive and shift register frequency,
Any such components of the signal coupled to amplifier 1038A can be filtered out in the next step.

Referring to FIG. 12B, it is also possible to configure transmission gate 1035 such that display electrodes 1034 are typically coupled to display drive electronics 1037.

In such a configuration, one voltage level on control line 1036 couples the associated display electrode 1034 to the surrounding electronic structure in two ways. In one method, an input pen signal level on an associated display electrode 1034 can be sensed while providing a certain display voltage level on the display electrode. That is, as shown in FIG. 12B, display electrode 1034 is coupled to both display drive electronics 1037 and input pen position sensing electronics. This configuration requires the addition of only one gate 1035 per display channel in addition to the shift register to provide both display drive and input pen position sensing functionality.

Standard display driver chips, such as the Philips 220180 channel driver, have unused pins that can be used for input pen position sensing signals. Therefore,
A modified version of the conventional drive chip may include input pen position sensing functionality in a particular drive that is a pin replacement part for the conventional drive to be replaced. Since the frequency of the input pen position sensing signal is much higher than the frequency of the signals related to display operation, the input pen position sensing signal is
decoupling capacitor 1042 further facilitates sensing. Shift register 1039 allows continuous display channels for sensing so that the display drive voltage level is low relative to the composite sensing signal. In the other way in which transmission gate 1035 operates, display voltage 11034 appears as a low amplitude component.The amplitude of the input pen position sensing signal is low enough to have no effect on display quality. 8i1037 only.

Clock 1040 controlling shift register 1039
The display electrode 1034 is also coupled to an amplifier 1038 to control a counter 1041 that keeps track of the sensing being performed. In this way, display electrode 1
When the input pen signal at 034 is sensed to be at maximum amplitude, the position on the display is determined by the output from counter 1041.

Using this method, there is no need to modify or interrupt the display driving operation, and the contrast is improved over the case where the display operation had to be interrupted during input pen position sensing. Other than the addition of one transmission gate 1035 for each channel and the addition of a shift register 1039, the hardware related to the display driving function is the same as that of conventional display-only panels, resulting in low cost and simplicity. This makes it easier to It is therefore possible to construct an application specific integrated circuit that performs both the display driving function and a portion of the input pen position sensing function that requires input from the display mold 11034. It is also possible to provide part of the transmission gate function to an existing analog multiplexer (for supplying drive voltage to the display) already present on a conventional display drive chip. In addition, it is manufactured today (
A typical channel drive 80 (such as the Philips 2201i1 drive) has up to eight extra pins to replace existing drive pins that can be used to convert a standard LCD module into a conversational display panel at low cost. It is also possible to manufacture replacement parts.

In the time-multiplexed and active matrix addressing display described above, the input pen signal is transmitted to the display, but the input pen sense signal is generated independently by the input pen, thereby providing electrical coupling between the input pen and the display and sensing electronics. It is possible to use an input pen 3 that does not require the following. By simply providing an oscillator with its own power supply in the input pen, it is possible to provide an input pen 3 for transmitting a disk signal without the need for electrical coupling between the input pen and the drive and sensing electronics. For example, it is possible to power the oscillator by providing a battery assembly during the input and connecting a conductive wire to the oscillator output in the input pen and leading it to the end of the input pen. Similar to the method of a constrained input pen, where the oscillator output to the input pen end acts as an antenna to couple the oscillator signal to the display electrode and sense the input pen position, a ground shield is placed around the line carrying the oscillator signal. , only the end of the input pen is exposed to improve directionality.

However, this requires a pen signal source, such as an oscillator, to be provided and powered in the input pen. According to this method, the conductive wire 12 between the devices of the input pen 3 is not required, but the manufacturing complexity increases compared to the case where a conductive wire is used.

To overcome the above disadvantages, it is possible to simplify the input pen to the extent that it does not include any active electronics in the input pen. In fact, the input pen only requires a conductive material at the end of the input pen, which is preferably coated with something like Teflon to minimize friction at that end.

Referring to Figure 13, the input pen 3' is not provided with an oscillator or other active electronics, but is simply provided with a conductive tip used in input pen position sensing as described below. . The signal generated by drive electronics 1140 turns the pixel display elements "on."

“Offer drive and provide input pen position sensing signals that are processed by sensing electronics. When such sensing signals are coupled by drive electronics 1140 to display electrodes 1142A, analog multiplexer 1043 is actuated to Display electrode 1142B is coupled to position sensing electrode 1141 while preventing electrical contact with the position sensing electronics of other display electrodes.

Referring to FIG. 14, an input signal produced by input pen 3' at display electrode 1142A is normally coupled by nearby electrode capacitance 1045 to nearby display electrode 1142B to enable amplitude sensing, but a series of capacitances 1045A and 10458 allow the same thing between the respective display electrodes 1142A and 1142B and the conductive input pen end 1044.

Therefore, the input pen end 1044 is connected to the display electrode 104.
If 2A and 10428 are close to each other, sensing electrode 1
141 measures an increase in the amplitude of the sense signal on display electrode 1142B while a sense signal is generated on display electrode 1142A.

In input position sensing, an input pen sensing signal is sequentially pulsed to each row and column display electrode 1142 while at the same time analog multiplexer 1043 is activated to electrically connect display electrodes near display electrode 1142 receiving the pulse to sensing electrode 11141. Combined with input pen! Sensing takes place. The input pen position sensing electronics 1141 performs the row (
The column) display compares the amplitude of the input pen sense signals coupled to each of both the row and column electrodes as determined to be closest to the input pen end 1044.

Coupling between nearby lower bridges is achieved in the same way as above, but
As with other examples, partial shielding by the top electrode and finite top electrode resistance are considered in determining the required sense signal amplitude and gain provided by the position sensing electronics 1141.

The input pen sense signal is preferably coupled to the display electrode 1142 at the same time as the display drive voltage; the frequency of the fundamental harmonics of the input pen sense signal is significantly higher than the frequency of the drive waveform (e.g., the input pen sense signal is (the fundamental frequency of the drive waveform is preferably on the order of 10 kilohertz), so the input pen sense signal is perceptible "above the peak" of the display drive waveform, after which the drive waveform Decoupled from. In addition, the input Ben sensing signal is a sinusoidal (square wave) biased to the voltage level of the drive voltage on which it is superimposed.
, therefore there is no variation in the composite RMS drive voltage result and the contrast and display drive firmware are unaffected.

Referring to FIG. 15A, a conventional display driver includes, in part, an output point 1046 and a level shifter (used to vary the drive voltage to the display electrodes coupled to the output point 1046). a shifting transistor 1047 and a control n-line 1049 coupled to an output point 1046 to the shifting transistor 1047 to control the voltage level driving the display electrodes. With reference to FIG. 15B, sensing signal generator 10
The output of 50 is preferably coupled to a sense signal gating transistor 1051 which is controlled by control line 1052 to selectively couple the input pen sense signal to one of the display drive electrodes via an associated output point 1046. To keep the RMS drive voltage unchanged, the input pen sense signal (eg, a simple sinusoid or square wave) is biased to the level of the drive voltage throughout. This is accomplished by decoupling the DC component of the input pen sense signal with capacitor 1053. Furthermore, the display driving level shifting transistor 1047 is about 10.000
It typically has an ohmic "ON" impedance, which acts as a biasing resistor (the smaller the sense signal gating transistor 1051 is, the lower the "ON" impedance will be).

A sense transistor 1054 couples the input pen sense signal to sensing electronics 1141 and is also controlled by control line 1052. These transistors act as the analog multiplexer 1043 described in connection with FIG.

Shift register 1055 sequentially (and concurrently with display operation) pulses each line of control line 1052 "ON" so that each of the display electrodes coupled to output point 1046 is activated for a short period of time (e.g., 5 MHz). 3 periods of the signal) are individually coupled to the input pen sense signal. Further, the control line 1052 has an output point 1046 coupled to the input pen sense signal by the actuation control I line to turn the input pen sense signal gating run sister 1051A "ON".
'', the nearby sense transistor 10548 is also turned to ``0'' at the same time, and the display electrode coupled to the output point 1046B is configured to be coupled to the sensing electronics 1141 via a decoupling capacitor 1056. 1056 is intended to decouple the low frequency drive waveform from the high frequency input pen sense signal. Active components such as filters can be used as well.

“OFF” state transistors 105 arranged in parallel
It is also possible to limit the number of output channels coupled to each of the multiple circuit paths to the sensing electronics 1141 to minimize leakage from the sensing electronics 1141. Existing conventional drives have a sufficient number of unused pins that can be used as additional input pen sensing signal output points, thereby allowing input pen sensing while still allowing input pen sensing.
It is also possible to use the pinout structure of a conventional display drive device as is.

It is also possible to selectively couple input pen sensing signals (via nearby electrodes) to the sensing electronics 1141 as well as data display using analog multiplexers that are present in conventional drive chips. . Although it is possible to provide an auxiliary shift register on-chip to sequentially route the input pen sense signal to each row and column display electrode 1142 as described above and couple the display and sense waveforms to each electrode simultaneously, It is also possible to use shift registers already included in the display drive (used to drive the display rows sequentially) for this purpose.

In order to provide an input pen position sensing resolution that matches the resolution of the display, the input pen sensing signal amplitude and coordinate position for the two display electrodes with the largest amplitude sensing signal are provided by the sensing electronics (in both rows and columns). It will be done. Referring to FIG. 16, a counter 1057 operates a drive 1140 to sequentially pulse each of the display electronics 1142 with a sensing pulse or signal, and
Analog multiplexers 1043 are operated simultaneously to sequentially couple each of the display electrodes near the pulsated display electrodes to sensing electronics 1141 .

Each time counter 1057 is incremented, a new display electrode 1142 is coupled to sensing electronics 1141, as described below.
1 is first amplified by an active bandpass filter 1058 and then by a peak detector 10
1060 and delay 1061 (held for a certain time interval by 59 and then each detection window one shot) 1060 and delay 1061 0 Then the peak value is determined by comparator 1062 (held in primary sample/hold 1063) It is compared with the amplitude value. If the current amplitude value exceeds the value held in the primary sample/hold 1063, the AND gate 1064 activates the primary sample/hold to acquire the new amplitude value, while the coordinate latch 1065 does the same. is activated to latch the current output of counter 1057, allowing the acquired new value to be related to the currently active display electrode, for example by a look-up table.

Also, the voltage amplitude already held in the primary sample/hold 1063 is compared with the voltage amplitude held in the secondary sample/hold 1066, and if the former value is greater than the latter value, the former value exceeds the latter value. Replace.

When this occurs, the counter value already held in coordinate latch 1065 replaces the related counter value held in secondary coordinate latch 1067.

Any voltage amplitude that does not exceed the voltage amplitude held in the primary sample/hold 1063 is compared to the voltage amplitude held in the secondary sample/hold 1066, and if that value is greater than the secondary value; The secondary value is replaced with the current value of counter 1057.

Thus, after every row (column) of the display has been tested by sensing electronics 1141, the two display electrodes 11 with the highest input pen sense signal amplitude
The counter value related to 42 becomes available, and processing that combines the related amplitude values becomes possible.

As described above, a non-radiative, non-mechanical display is provided that utilizes display electrodes as a means for sensing input pens. The advantages of this method over methods that utilize a separate sensing layer (such as disclosed in U.S. Pat. No. 4,639,720) are that it eliminates the additional parallax and opacity of an overlay that is utilized as a separate sensing layer; An advantage of this method over prior art techniques that require local changes in display element materials (see, e.g., U.S. Pat. No. 4,520,357) is that manufacturing costs can be kept low. , quick input pen movement and resolution ability,
In addition, the state of the underlying display element (i.e., O
It can be shown arbitrarily at any position on the display surface, regardless of whether it is "N" or "OFF" and without affecting the state of the underlying display elements. Low manufacturing costs and low operating power consumption are also advantages.

Referring again to FIGS. 1 and 2, the pen sensing control means 2 detects that the input pen is located in one of the text conversion area 62, document list/processing area 63, and processing and document control areas 41-60. responds to input in sufficient contact with or proximity to the surface of the device. The pen sensing control means 2 includes a text conversion area 62, an area 63 and an area 41-6 for activating editing and processing functions.
The input pen coordinate signal is sent to the control subsystem 4 to control the operation of device input and processing functions. Do ■.

Internal control of display processing and character recognition functions and dialogue is performed by a control subsystem 4 consisting of one or more microcomputers. The data memo IJ-10 stores information currently displayed on the display 1, searchable information files for display and processing, and information input from or output to an external device. Ru. A microprocessor suitable for incorporation into the control subsystem 4 and other subsystems is M manufactured by Motorola, located in Phoenix, Alisina, USA.
It is C68QOO. The electronics take up so little space that they can be housed within a generally flat, portable device.

In addition, the power consumption of such electronics is negligible, allowing operation from any available compact power source, such as a rechargeable battery built into the device.

Document creation and processing operations will be briefly described with reference to FIGS. 1 and 2. To create text documents, e.g. characters with typed text, default (DEFA)
UL? ) to place the control subsystem 4 in text mode, or, if the control subsystem 4 is in graphics mode, select “Text/Graphics” with input pen 3 or 3' to place the device in text mode. By specifically touching the area 44 labeled , the control subsystem 4 is put into text mode. Preferably, control subsystem 4 brightly displays ``Text Delete'' in ``Text/Graphics'' or otherwise displays a message in user message area 61 to indicate that it is in text mode.

When the control I subsystem 4 is in text mode, the user can enter handwritten printed text into the text conversion area 62. The handwritten print is on the right.
When expanded into the area 59 labeled ``Conversion Pa'', all handwritten prints written in the text conversion area 62 are stored in the data memory 10 related to the document being edited and removed from the text conversion area, and the document list is / Appears as printed text in the processing area 63.

Therefore, while printing text from left to right in the text conversion area 62, if print characters are written so much that they encroach on the area 59 on the right side of the text conversion area, or the user intentionally touches any point in the area 59. , the text just printed is incorporated into the document being edited, and the text conversion area is cleared to allow new input. If you start a new input from the left side of the text conversion area 62, you can input text without interruption (
It can be done continuously. The text is ASCII (
Preferably, the data memory 10 is stored in a standard format, such as ASCII.

Each printed text character displayed in area 63 is internally related to a range of matrix coordinate positions within which each character is included. In this way, by touching any matrix coordinate position within the character boundary of a given printed character with the input pen 3 or 3', that character is identified and word processing is performed.

For example, consider the case where the words displayed in the area 63 are deleted from the 1st category 1st category. First, the user selects the area 48 where "ERASE" is displayed with the input pen 3 or 3'.
, then touch any printed text character you want to delete. Since all points within each character boundary are mapped to related characters, it is only necessary to touch a single point on any character to be deleted.

It is therefore sufficient to simply traverse the input ben 3 or 3' over the character or word to be deleted.

When the deletion is completed, the next non-deleted text is moved to fill the blank space created by the text deletion.

Touch area 48 with input ben 3 or 3' to select “ERA
Instead of invoking ``SE'', it is also possible to use a spring-loaded ``delete'' control button 40 that is provided on the input pen itself and is easily accessible. This control button 40 only performs "delete" when pressed.

Activates the effect and, while pressed, effectively converts the input pen 3 or 3' into an erasing device.

Similarly, in the text conversion area 62, manually printed characters also relate to the range of columns and rows that they occupy, so that within the character boundaries of the printed characters identified by the character recognition subsystem 8 and displayed in the text conversion area. If you touch any point on the input ben 3 or 3', that character will be deleted. Therefore, as in the case of the document listing/processing area 63, any handwritten printed text word or words can be moved by simply pressing the control button 40 and moving the input pen 3 or 3' across the word or words to be deleted. You can delete it by just letting it go. In the text conversion area 62,
Just like writing with a pen and paper, the area left blank after erasing. In order to properly adjust the text formatting, the white space between characters (i.e. the white space between words) that existed before the deletion is changed to a single white space (e.g. ^5CTI/
ASCII spaces). In another situation, when a deletion is made in the text conversion area 62, the document list/
Any space that would have been occupied by the deleted character in the processing area is then filled by any handwritten printed text entered.

Character recognition subsystem 8 automatically inserts spaces between adjacent printed words if the last and first characters of the printed words are far enough apart.

However, it is also possible to provide a means for the user to explicitly control the input of all spaces by disabling the automatic space recognition function associated with the character recognition function subsystem 8. An area 60 labeled "Space゛°" immediately below the text conversion area 62 and extending over the entire length of the area defines the means for issuing the command to insert one or more spaces. During text printing, the area Touching any point along 60 will specifically insert a space immediately after the last text character or space entered within area 63.

It is also possible to insert a text space by providing a spring-loaded "space" control button 40B located on the input pen 3 or 3'.

If the user desires, it is also possible to insert typed text into blocks of known text.

First, the user selects “INS [
! When the user touches the area 47 labeled "RT", but the above-mentioned erase control button 40A is not provided, the input pen 3 or 3' enters the "IN5EIIT" mode.When the insertion utility is called, the user input pen 3
Or touch any part of the text document where new text is to be inserted in 3'. Next, map the touched position coordinates to the related character position coordinate range in area 63 to determine which character position was touched. , the text conversion area 62 is cleared and any text already printed on that area is temporarily stored.

The user can now use text conversion area 62 to input any text to be inserted into the prespecified position on area 63. As the new text is inserted at the pre-specified position, any subsequent text or graphics that existed prior to the insertion will automatically move to accommodate the newly inserted text. The insertion session continues until the insertion session is specifically terminated by touching the input pen 3 or 3' to the area 49 labeled "NORMAL". Once in normal mode, any text previously displayed in the input text conversion area 62 prior to the insert session is redisplayed and normal operation resumes (e.g., adding any new text to the end of the current file). do).

As in typical word processing computer programs, functionality is preferably provided for copying selected text from a document into a buffer and then inserting the buffered text into another part of the document. For example: - If the text string is to be copied from one location to another, the user must use the input pen 3 or 3'
Touch the area 54 where "CUT" is displayed. At this point, a message is preferably displayed in the user message area 61, such as, ``Move the input pen across any text to be cut.'' Then, any selected text is Stored in internal buffer.

Later in the editing session, the user touches the area 55 labeled "INS[!RT BUFFER" with the input pen 3 or 3' and then touches the document list/processing area 6.
3. Touch the position above where you want to insert the memorized text.

A number of buffers are stored in accessible memory locations such that any selected buffer can be inserted into the document at a selected location. When said function is called, the first multiples in each buffer are preferably visible in the matrix coordinate range associated with each display buffer on area 63, so that the display of a buffer selected from among the available buffers is Touching anywhere within the content inserts the selected buffer at the display position subsequently selected by the user. Provide other insertion effects such as inserting the previous file,
It is possible to carry out the execution in a similar manner, for example, by referring to and displaying the file name with the input pen 3 or 3' and making the user's selection.

Preferably, both top and bottom case printing is possible on the display 1; however, the bottom case prints regardless of whether it is printed on the top or bottom case by the user without implementing the character recognition subsystem 8. It is possible to configure it so that all characters are output in the case. This is convenient for users who primarily prefer printing on the upper case or users who arbitrarily switch between cases when printing.

A default (DI!FAIILT) is initiated by touching the area 51 labeled LOW CASE'' with the input pen 3 or 3', and is canceled by touching the area 51 again. When setting, the spring-loaded "shift degree" control button 40C on the input pen 3 or 3' serves as a default override control, and the control button 4
When 0C is activated, the upper case can be specified for all characters printed.

The character recognition subsystem 8 is configured to accurately recognize and convert any printed character that is recognizable to the average reader, but is provided with the ability to fix unrecognized or misread characters. If the user prints a character that the character recognition subsystem 8 fails to recognize, the space on the area 63 that the character should occupy becomes dark (i.e.
Touch the area 52 labeled "FIX'" with the input pen 3 or 3', then touch the document list/ When you touch any darkened character (or any other character) in the processing area 63, the display element related to the selected character lights up (i.e., all pixels repeat "ON" and "OFF"), and the text is converted. Area 6
The selected character can be rewritten within the range of 1/4 inch from the left end of 2.

Once the character has been rewritten within this quarter-inch area, the user can use the input pen 3 or 3' to
V[! Touch area 59 labeled "RT".

If the rewritten character is recognized by the character recognition subsystem 8, the rewritten character replaces the previous character at the pre-specified position. Thereafter, the left end portion of text conversion area 62 is restored.

As previously mentioned, when a new line of typed text is inserted or added to the document list/processing area 63, any typed text below is moved and automatically reformatted to make room. .

Furthermore, the margins set by the user are recalled by the control subsystem 4.

For example, to set the left margin for existing text, the user first uses the input pen 3 or 3' to
[! Touch the area 53A labeled "FT MARGLN". At this time, a message saying, for example, "Touch the pen to the desired margin position of the first line whose position is to be adjusted" is displayed in the user message area 61. Once this is achieved, the control subsystem 4 aligns the column coordinates of the desired left margin (memorizes the coordinate position and identity of the first character in the first row, e.g. aligns the column coordinates of the desired left margin, Touch the pen to the last line (if any),
Next, a message saying "Touch the pen again on LEFT MARGLN" is displayed in the user message area 61. When you touch the last line whose 0 position is to be adjusted, the control subsystem 4 displays the last line whose position is to be adjusted. Memorize the coordinate position 1 and identity of the last character 0 Then the user touches the area 53 again with the input pen 3 or 3' and the control subsystem 4 moves to left position adjustment of all the text in the particular line. If no lines in the document list/processing area 63 are touched before "LEFT MARGIN" is touched again, all text starting with the first particular line will be processed as well as the next new text entered into the device. , the left position is adjusted.

For other text formatting functions, the user calls the function by touching the input pen 3 or 3' to the relevant area, and the user selects 'Nl! Starting W LINE" (area 58, comparable to line break), nEw PARA" (
area 57, equivalent to an indented line break), or start a NEII PAGF” in the current file and fill the remaining space of the previous page with blanks (area 56,
(comparable to paper feed). The above editing functions only constitute an example of 2.3; in addition,
Numerous other text editing and processing functions are possible and may be performed in conjunction with the device in a manner similar to the functions described above.

When the control subsystem 4 is in the text mode, if the input pen 3 or 3' touches the area 44 labeled "↑I!XT/GRAPH", the control subsystem goes into the graphics mode. In the graphics mode, the path of the input pen 3 or 3' on the document list/processing area 63 is drawn and visually displayed, and the coordinate position of the display element activated in this way is shown in relation to the document to be processed. Stored in data memo January O.

In the graphics mode, the input pen 3 or 3' inserts handwritten graphics onto the document list/processing area 63. If a graphic is drawn in the middle of type font text, the position of the text is moved down to accommodate the insertion of the graphic at the selected location in the document. That is, when a graphic is removed, the coordinates of the top and bottom rows of the graphic are continuously updated and stored, so that when the coordinates fall sufficiently into the area occupied by the type font text, the text moves vertically to create space. In the graphics mode, only the areas 47-49 described above for processing text are used for processing graphics.

For example, if a stroke (-brush) of a graphic is to be erased, the area 48 labeled "ERASE" should be touched with the input pen 3 or 3', or the input pen 3 or 3' By pressing control button 40^,
The input pen becomes an erasing pen. In graphics mode, the erasing pen has a larger "brush width" than is used to draw graphic strokes. Because the larger brush width is provided, the input pen can touch the width within the brush width of the center of the stroke to be erased, compared to the case where the input pen touches all points related to the position of the stroke to be erased. Just need it. The total length of the stroke can also be erased by touching all points along the stroke length with the input pen, and all the coordinates of the points of the stroke are mapped in the data memory 10 in relation to the stroke. Ru. Thus, graphic editing changes can be applied to all of the stroke point coordinates in response to the input pen's brush width in contact with any of the stroke display element points. Brush width is provided by deletion,
To suit each type, some means is provided to provide an apparent brush width that is adjusted for both writing and erasing, depending on the activation of the input pen's command. Additionally, other types of graphics manipulation that are available with mouse devices allow the user to input predetermined shapes such as circles, curves, straight lines, etc.
' can be generated by contacting the appropriate area. Such a predetermined shape is
Only the codes corresponding to selected shapes and basic properties, such as position and dimensions, need to be stored in the data memory 10, with the advantage that they can be stored in a compact and parametric form. This is in contrast to graphical storage representations such as bitmaps, which are appropriate for any graphics in which individual display elements are displayed and require large amounts of memory.

The graph ink features described above are merely illustrative of a few examples. Additionally, numerous other graphical viewing/processing functions are provided and can perform functions similar to those described above.

To return to text mode, the user must press “TI” again.
! Touch the input pen 3 or 3' to the area labeled ``XT/GRAPH''.This causes the control subsystem 4 to cause the word ``TEXT'' in the area 44 to emit high-intensity light, or to display the corresponding mode in the user message area 61. Indicates that the text mode is currently in effect, such as by displaying an explanatory text.

Documents are stored as referenceable files in the data memo January 0 in association with file names collectively displayed as a file dictionary. File management is in area 42-4
executed by touching a selected one of 38;
Allows the user to select, delete or create files containing textual and graphical information.

Area 4 where input ben 3 or 3' is marked "DIR"
2, the document list/processing area 63 displays the first page of the file dictionary containing the file names stored in the file dictionary of the data memory 10. are related to the range related to the display column and row coordinate positions, so touching any point on one of the selected file names will display the first page of the related file in the list/processing. selected for. Area 4 labeled “D[!L FIIJ”
When 3A is touched, a file dictionary is displayed, and the user can delete from the file dictionary the file with the file name successively touched by the input bezel 3 or 3'. By touching the area 43B labeled 'NEW FILE', a file can be created or the file name can be changed. The control subsystem 4 first displays a file dictionary so that the user can either touch the selected file name to change the file name or continuously print the new file name on the text change area 62. , allowing a new file to be opened by inserting the new file name into the text change area (without touching the existing file name). In either case, when a new or renamed file name is written, the user must move the input vent 3 or 3' to the area 5 labeled C0NVERT'.
9, the first page of the new or renamed file is listed/
Displayed for processing.

It should be noted that graphics and text are stored in association with file names represented by handwritten text characters or symbols. For example, the file names of files to be stored in the file dictionary are stored in the document list/processing area 63. Handwritten input is entered in a specific area. Therefore ° “DIR”DELFIl, E” “NEW FI
The dictionary file that should be displayed regarding the selection of the LE' function is:
Contains a series of handwritten file names associated with vertical and horizontal boundaries, respectively, which input ben 3 or 3' displays,
One of these file names for processing, deletion or renaming
used to select one.

The above file management operations are merely illustrative of a few examples. Many other file management examples exist and are provided.

Other commands for text and graphic listing/processing can be activated by touching the input ben 3 or 3' to the area 46 labeled 'COHMano' and specifying the desired command word in the text conversion area 62. , and “C01nl! This feature is not commonly needed among most users or is present on the device to accommodate the presented command square. It offers the possibility of adapting the generic onboard software to areas where it does not.

For example, in a personal computer, general-purpose software includes standard mathematical functions, specific user interface functions, or program compilation (
iii collection) and the possibility to provide implementation.

The character (or symbol) identification subsystem 8 is capable of running one of a variety of well-known character identification software programs.
and writing Recognition,
Figure 7 International Conference on Pattern Recognition m (Cat, Nn84cH
2046-1), Montreal, Quebec (Canada)
, July 30-August 2, 1984 (Silver S
pring, MD: IEEE Comput, Soc.
Published in 1984, Vol. 2. P, IQ04~10Q7
) is disclosed.

Furthermore, interactive graphics, processing, data compression and decompression techniques are known and, therefore, there is no need to describe them in detail herein, as suitable known techniques that can be used for graphics processing include mouse interactive software. MACDRA-, which is commercially available and manufactured by Apple Computer Corporation, can be used. Suitable known techniques that can be used for compressing and decompressing graphic data include, for example, 5TANDARDIZ
ATION 0FGROUP 3FAC5IMILE
APPARATUS FOR[lOCUMENTTRA
NSMISSION" CCITT Recommend
ation↑4 (Geneva+1980). The interactive graphics erasing process used in graphic displays is known as MMCPAINt, produced by Apple Computer, Inc., and therefore does not require detailed description herein.

Referring to FIGS. 1 and 2, an area 45 labeled "Ilo" is displayed on the display 1. When the user touches this area with the input pen 3 or 3', the text/graphics stored in the data memo January 0 is outputted under the control of the data I10 subsystem 9. It is also expected to provide a device for inputting text and graphics data from an external information processing device.

Data I 10 subsystem 9 may include an interface such as an RS-232 port and/or a modem for exchanging information with external text/graphics devices. Text/graphic input from external devices is input by the data I10 subsystem 9 into the data memo 1/0 and output by the control subsystem 4 from the data memory to the display. Conversely, the text/graphic data may be information input by hand on the document list/processing area 63 that is output by the control subsystem 4 from the data memory 10 to the data I10 subsystem 9 to an external device; The information displayed as type font text is output to an external information processing device, such as a printer or plotter to form a hard copy, or other external device such as a computer or external memory.

It will be appreciated that the embodiments of the invention described above are capable of various modifications and applications, such as colloidal suspension displays that can be operated in a reflective mode that allows a flat profile and that can operate with applied power. Non-illuminated flat panel display types are also applicable to the present invention.

Separate input pen sensing bridges are formed in each area of the device that is touched by the input pen. Otherwise, a separate display area may be formed with its own display control subsystem consisting of, for example, operating display memory, horizontal and vertical drive electrodes, etc.
The input text modification area 62 can have its own input pen sensing electrodes and display controls, thus allowing effective interaction with the character recognition subsystem 8 with which it is almost exclusively interfaced.

[Brief explanation of drawings]

FIG. 1 is a perspective view of one form of a portable, interactive electro-optical data input/output processing, storage, and display device according to the present invention; FIG. A block diagram of the onboard electronic control system; FIG. 3A is a perspective view of one form of a passive matrix address display adapted for integration into the apparatus shown in FIGS. 1 and 2; FIG. 3B is a Figures 4A to 4D are block diagrams of modified passive matrix address displays adapted for integration into the apparatus shown in Figures 1 and 2 for high-speed pen sensing; 2; FIG. 5A is a block diagram of an active matrix address display adapted for incorporation into the apparatus shown in FIGS. 1 and 2 for high-speed pen sensing; FIG. FIG. 5B is a block diagram of a modification of the high-speed pen sensing configuration shown in FIG. 5A; FIG. 5C is a modification block diagram of the high-speed pen sensing configuration shown in FIGS. 5A and 5B. FIG. 6 is an explanatory diagram of one form of display to be incorporated into the apparatus shown in FIGS. 1 and 2, and FIG. 7 is a modified block diagram of the device shown in FIGS.
FIG. 8A is a cross-sectional view of an input pen applied to the display according to FIG. 7; FIG. 8B is a cross-sectional view of an input pen applied to the display according to FIG. 7; 9 is a plot of the coupling of the input pen signal to the bottom electrode of the display shown in FIG. 7; FIG. FIG. 11 is a block diagram of an active matrix address display with bank plane input pen position sensing incorporated into the apparatus shown; FIG. 11 is a circuit for matrix coordinate input pen position sensing of an active matrix address display such as that shown in FIG. FIG. 12A is a block diagram of one form of a display drive electronic configuration for a display with simultaneous display and input pen position sensing; FIG. 128 is a display drive for a display with simultaneous display and input pen position sensing. 13 is a block diagram of one form of circuit for sensing input pen position on a time multiplexed display; FIG. 14 is an equivalent circuit diagram of the display shown in FIG. 13; Figure 15A is a conventional driver circuit diagram for a display; Figure 158 is a modified driver circuit diagram for a display incorporated into the device shown in Figures 1 and 2; Figure 16 is an input pen position sensing circuit. 1 shows a block diagram of one form of a circuit for use. 1 display, 2 pen sensing control means, 2A line sensing means, 283 column sensing means, input pen, 4 control subsystem, 5 graphics processing subsystem, 6
file management subsystem, 7 text processing subsystem, 8 character recognition subsystem, 9 data I10 subsystem, 10 data memory, 11 display control means, 12 flexible conductive cable, 13 transparent upper substrate, 14 lower substrate, 16 Conductive electrode, 17 row electrode,
19 level detection means, 2θ synchronization logic means, 21 engineering code means, 22 spacing member, 24 pen signal source, 25A,
25B bidirectional switch, 28A-28F display element, 29 LCD display WL 30f! Capacitor, 30^-30F control electronic configuration, 31
^-3 IC data enable transistors, 32 horizontal drive electronic configurations, 33 vertical drive electronic configurations, 35 drive electrodes, 36 backplanes, 37 inputs, 38
horizontal register, 398!1 function selection switch, 61 user message area, 62 text conversion area, 63 text list and processing area, 72 sensing pad, 72A column level detection means, 72B column synchronization logic means, 72C column encoding means, 78 Display sensing electrode, 79 display sensing transistor, 1001 upper electrode layer, 1002 lower electrode layer, 10041-tube glass, 1005 notch,
1007 electric field line, 1008 backplane, 1010 switch, 1011 position sensing electric sensing 1013 conductive cable, 1015 person tip i, 1016 backplane edge, 1017 tomp glass, 1018A, LO1
8B contacts, 1020 multiplexer output, 1021 counter 1022 clock, 1023 current-to-voltage converter, 1024 differential amplifier, 1026 peak detection and holding circuit, 1027 analog-to-digital converter. (4 others) "Hundred engravings (no change in content) FIG. 2゜FIG. 3A. FIG. 3B. FIG, 4c FIG. 4D. FIG. 5A. FIG, 5C. 9゜FIG. 14゜FIG. 70゜FIG. 12B. FIG. 73゜o49 049 049 049 FIG. 15A. l. Indication of the case 1990 Patent Application No. 153823 2, Title of the invention 3゜ Person making the amendment Relationship to the case Special feature'1 Applicant's address Name: Nidward Nis More (1 other person) 4. Agent's address: 206 Shintemachi Building, 2-2-1 Otemachi, Chiyoda-ku, Tokyo

Claims (1)

[Scope of Claims] 1. In an interactive electronic device for performing at least one of the functions of writing and graphics, an input pen means configured to be held in the hand of a user; A non-mechanical, non-illuminated display means consisting of a plurality of display elements including display electrode means for driving optical material, the display electrode means therebetween for displaying textual/graphics information. a first mode of activating some electro-optical material and an input pen operated by the user and adjacent to the display means, along the path, the display electrode means being brought into electrical contact to produce text characters and graphics; a display means operative in a second mode for forming one of the information in the form of a display means; a pen-sensing control means associated with the display means, the display means being responsive to electrical contact between the input pen means and the display electrode means; is connected to the pen sensing control means and the display means for generating a position signal corresponding to the position of the input pen means with respect to the display means as the input pen means is operated along the path; display control means for energizing selected display electrode means of the display means to display at least one of text characters and graphics corresponding to the path traced by the input pen means in response to the signal; , a device configured to allow a user to manually enter information in the form of text characters and/or graphics into a display means. 2. The apparatus of claim 1, further comprising a data memory connected to the control means for storing data representative of the position signals generated by the pen sensing control means, the stored data being a selected one. Apparatus, characterized in that it is configured to be accessible to the activation of display elements and to display information in the form of one of text characters and graphics. 3. The apparatus of claim 2, further comprising data compression and decompression means incorporated in the control means;
and configured to encode graphics as compressed data in response to the position signal for storage in the data memory and to decode the compressed data to display the graphics in response to the compressed data stored in the data memory. A device characterized by: 4. The device according to claim 2, further comprising: a plurality of function selection areas on the display means, the areas being selectively activated by the user touching the areas with the input pen means; , the pen sensing means is configured to be responsive to the touched area to generate a position signal indicative of the selected function, and is connected to the control means and responsive to the position signal indicative of the selected function. An apparatus characterized in that it is equipped with a file management means for executing a predetermined routine. 5. The device according to claim 2, further comprising: a plurality of function selection areas on the display means, the areas being selectively activated by the user touching the areas with an input pen; The pen sensing means is configured to be responsive to the touched area to generate a position signal indicative of the selected function and is connected to the control means and responsive to the position signal indicative of the selected function. An apparatus characterized by comprising a graphics processing means for executing a predetermined routine. 6. The device according to claim 2, further comprising a function selection area on the display means, the area being selectively activated by the user by touching the area with an input pen, and the area being selectively activated by the user by touching the area with an input pen. The means is configured to generate a position signal in response to the touched area and is connected to the control means, and in response to the position signal generated when the area is touched, the external information processing means and the data A device characterized in that it is equipped with data input/output means for exchanging data. 7. The apparatus according to claim 2, further comprising: a document list/processing area included in the display means for displaying text data in a type font format; a text conversion area included in the display means, Handwritten text to form letters isolated
a text conversion area configured for a user to manipulate an input pen means adjacent to the text conversion area along a path of at least one stroke; character identification means for encoding handwritten input text characters in the form of a standard format representing type font text characters, the handwritten input text characters being displayed as corresponding type font text characters in a document listing/processing area; A device featuring: 8. Apparatus according to claim 7, further comprising a data memory connected to the control means for storing data representing the corresponding type font text characters. 9. The device according to claim 2, further comprising: a plurality of function selection areas on the display means, the areas being selectively activated by the user connecting the areas with the input pen means; The pen-sensing control means is configured to generate a position signal indicative of the selected function in response to the touched area, and is connected to the control means and responsive to the position signal indicative of the selected function. An apparatus characterized by comprising text processing means for executing a predetermined routine. 10. The apparatus of claim 1, further comprising: a pen detection control means and a display control means;
control means comprising microprocessor means and resident software including text/graphics editing/fining software; and a data memory connected to the control means for storing data representing text characters and graphics. A device characterized by the fact that 11. The apparatus of claim 1, wherein the display means is an upper substrate made of transparent material and having an outer surface and an inner surface, the input pen means being configured to be operated adjacent to the substrate by a user. a lower substrate separated from the upper substrate and having an outer surface and an inner surface; a plurality of first electrodes; a plurality of second electrodes separated from the first electrode; and an upper and lower substrate. an electro-optical material in a region sandwiched between the pen sensing control means and the pen sensing control means being connected to at least one of the first and second electrodes, the pen sensing control means being connected to the second electrode of the input pen means; in response to an electrical connection to the input pen means, the display control means generates a position signal corresponding to the position of the input pen means with respect to the intersection of the first and second electrodes as the user manipulates the input pen means; and a second electrode and configured to energize electro-optic material around a corresponding intersection point in response to the position signal. 12. The apparatus of claim 11, wherein the first and second electrodes each have a plurality of notches, and the pen sensing control means is responsive to electrical contact to the second electrode through the notches of the input pen. and is configured to generate a position signal corresponding to the position of the input pen means with respect to the intersection of the first and second electrodes as the user manipulates the input pen means. 13. Apparatus according to claim 11 or 12, wherein a pen signal is coupled to the input pen means for being transmitted by the input pen means and is adapted to be received at the first and second electrodes to generate a position signal. A device characterized by: 14. Apparatus according to claim 11 or 12, wherein a pen signal is coupled to the second electrode for being transmitted from the vicinity of the corresponding intersection and is adapted to be received by the input pen means to generate a position signal. A device characterized by: 15. Device according to claim 11 or 12, characterized in that the electro-optical material is a liquid crystal material. 16. The apparatus of claim 11 or 12, wherein the first electrode is located on the internal surface of the top substrate and the second electrode is located on the internal surface of the bottom substrate, providing a passive matrix addressed display. A device characterized in that it is configured to. 17. Apparatus according to claim 11 or 12, wherein the pen signal is coupled to one of the second electrodes and transmitted to the adjacent second electrode and the input pen means; a device configured to be coupled to an electrode of the device to generate a position signal. 18. The apparatus of claim 1, wherein the first and second electrodes are disposed on one of the upper and lower substrates, the apparatus further comprising:
display electronics having a gating transistor connected to the first and second electrodes and a capacitance associated with the transistor, a backplane disposed on the other of the upper and lower substrates to form an active matrix addressed display; Apparatus characterized in that the pen signal is electrically coupled between the input pen means and the pad means connected to the first and second electrodes. 19. The apparatus of claim 18, wherein the backplane disposed on one of the first and second electrodes and on the top substrate is provided with a notch through which the pen signal is connected to the input pen means and the first and pad means connected to the second electrode. 20. The apparatus of claim 1, wherein the display electrode means includes a non-separated backplane, and pen signals are coupled to and transmitted by the input pen means and received by the backplane to provide position signals. A device characterized in that it is configured to generate electricity.