JPH012128A - Information input/output device - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention is an information input/output device, and in particular, comprises a handwritten information input device and a display device that are arranged one on top of the other. The present invention relates to an information input/output device for displaying written characters or images on the display.

[Prior art 1] Conventionally, there has been a device in which a handwritten information input device composed of various coordinate input devices and a display device are placed one on top of the other, and information such as a single image of a character is input/output by hand, and processing such as editing is performed. Proposed.

In this type of device, a display device is provided at the bottom of the input surface of a handwritten information input device that has an input surface made of a transparent material such as glass or plastic, and a display device is provided at the bottom of the input surface of the handwritten information input device, and the display device is installed one after another directly below the input trajectory input by hand on the input surface. By displaying dots or the like, input characters, images, etc. are displayed in the same size as the input size, and are made visible through the input screen.

That is, characters and images inputted as if written on paper are generated on the input 1 display screen and can be visually recognized by the operator.

[Problems to be Solved by the Invention] However, in the above-mentioned devices, even if the input surface of the information input device is transparent, it has a certain thickness and refractive index, and the distance between the display surface and the input surface is Since it is not O, it is difficult to accurately match the input position and the front claw position due to parallax and refraction.

In other words, a discrepancy occurs between the input position intended by the operator and the information actually input. Particularly, in applications such as editing an image that has already been input, if the deviation between the input position and the display position is large, editing, that is, changing, deleting, adding, etc., to the image is almost impossible.

[Means for Solving the Problems] In order to solve the following problems, the present invention includes a handwritten information input device and a display device arranged one on top of the other,
An information input/output device for displaying characters or images handwritten into the handwritten information input device using an input pen on the display device, comprising means provided in the input pen for detecting information displayed on the display device; A configuration is adopted in which a control means is provided for correcting the display position of the display device based on the output of the means.

[Operation] According to the above configuration, the position of the display information corresponding to the input information can be corrected using the display information detection means of the input pen, so that the input position and the display position for the operator can be surely matched. can be done.

[Example] Hereinafter, the present invention will be described in detail based on the example shown in the drawings.

FIG. 1 shows the structure of an information input/output device employing the present invention. The information input/output device shown in FIG. 1 inputs coordinates to an input tablet made of a vibration transmission plate 8 using a vibrating pen 3, and a display 11' made of a CRT placed over the input tablet according to the input coordinate information. The input image is displayed on the screen.

The input tablet consisting of the vibration transmission plate 8 functions as a handwritten information input device capable of inputting handwritten characters and images using the vibrating pen 3. First, the configuration of this input section will be explained.

The vibration transmission plate 8 is made of acrylic, glass plate, etc.
The vibrations transmitted from the vibrating pen 3 are transmitted to three vibration sensors 6 provided at the corners thereof. In the unimplemented example, vibrating pen 3
The coordinates of the vibrating pen 3 on the vibration transmitting plate 8 are detected by measuring the transmission time of the ultrasonic vibrations transmitted from the vibration transmitting plate 8 to the vibration sensor 6.

The vibration transmitting plate 8 has its peripheral portion supported by an anti-reflection material 7 made of silicone rubber or the like in order to prevent vibrations transmitted from the vibrating pen 3 from being reflected at the peripheral portion and returning toward the center. ing.

The vibration transmitting plate 8 is placed on a display 11' capable of displaying dots, such as a CRT (or liquid crystal display), and displays dots at the position traced by the vibrating pen 3. That is, a dot is displayed at a position on the display 11' corresponding to the detected coordinates of the vibrating pen 3, and an image composed of elements such as points and lines inputted by the vibrating pen 3 is displayed as if it were written on paper. Appears after the trajectory of the vibrating pen as if it were done.

Further, according to such a configuration, a menu is displayed on the display 11', and an input method such as having the vibrating pen select the menu item or displaying a prompt and touching the vibrating pen 3 at a predetermined position is possible. You can also use

The vibrating pen 3 transmits ultrasonic vibration to the vibration transmitting plate 8,
It has a vibrator 4 made of a piezoelectric element or the like inside, and transmits ultrasonic vibrations generated by the vibrator 4 to a vibration transmission plate 8 via a horn portion 5 having a sharp tip.

FIG. 2 shows the structure of the vibrating pen 3. A vibrator 4 built into the vibrating pen 3 is driven by a vibrator drive circuit 2. The drive signal for the vibrator 4 is supplied as a low-level pulse signal from the arithmetic and control circuit 1 shown in FIG. is applied to

The electrical drive signal is converted into mechanical ultrasonic vibration by the vibrator 4 and transmitted to the diaphragm 8 via the horn section 5.

The vibration frequency of the vibrator 4 is selected to a value that can generate plate waves on the vibration transmission plate 8 made of acrylic, glass, or the like. Further, when driving the vibrator, a vibration mode is selected in which the vibrator 4 mainly vibrates in the vertical direction in FIG. 2 with respect to the vibration transmission plate 8. Also, the vibration frequency of the vibrator 4 is set to
Efficient vibration conversion is possible by setting the resonance frequency to .

The elastic waves transmitted to the vibration transmission plate 8 as described above are plate waves, which have the advantage that they are less susceptible to the effects of scratches, obstacles, etc. on the surface of the vibration transmission plate 8 compared to surface waves.

Again, in FIG. 1, the vibration sensor 6 provided at the corner of the vibration transmission plate 8 is also constituted by a mechanical to electrical conversion element such as a piezoelectric element. The output signals of each of the three vibration sensors 6 are input to the waveform detection circuit 6 and converted into detection signals that can be processed by the arithmetic control circuit 1 in the subsequent stage. Arithmetic control circuit
performs vibration transmission time measurement processing and detects the coordinate position of the vibrating pen 3 on the □ vibration transmission plate 8.

The detected coordinate information of the vibrating pen 3 is processed in the arithmetic control circuit 1 according to the output method by the display 11'.

That is, the arithmetic control circuit controls the output operation of the display 11' via the video signal processing device 10 based on the input coordinate information.

FIG. 3 shows the structure of the arithmetic control circuit l shown in FIG.

Here, the structure of the drive system of the vibrating pen 3 and the vibration detection system using the vibration sensor 6 are mainly shown.

The microcomputer 11 includes an internal counter, ROM, and RAM. The drive signal generation circuit 12
It outputs a drive pulse of a predetermined frequency to the vibrator drive circuit 2 shown in the figure, and is activated by the microcomputer 11 in synchronization with the coordinate calculation circuit.

The count value of the counter 13 is latched into the latch circuit 14 by the microcomputer 11.

On the other hand, the waveform detection circuit 9 obtains timing information of a detection signal for measuring vibration transmission time for coordinate detection and signal level information for pen pressure detection from the output of the vibration sensor 6 as described later. Output. These timing and level information are input to input ports 15 and 17, respectively.

The timing signal input from the waveform detection circuit 9 is input to the input port 15, and the latch circuit 1 is input by the determination circuit 16.
4 and the result is transmitted to the microcomputer 11. That is, the vibration transmission time is expressed as the latch value of the output data of the counter 13, and the vibration transmission time value is used to determine the position of the seat! M operations are performed.

Output control processing for the display device 11' is performed via the input/output port 18.

Here, the basic operations in the above structure 4TO& will be explained.

FIG. 4 explains the detected waveform input to the waveform detection circuit 9 of FIG. 1 and the vibration transmission time measurement process based on the detected waveform. In FIG. 4, reference numeral 441 indicates a drive signal pulse applied to the vibrating pen 3.

The a-sonic vibration transmitted from the vibrating pen 3 driven by such a waveform to the vibration transmission plate 8 passes through the vibration transmission plate 8 and is detected by the vibration sensor 6.

After traveling within the vibration transmission plate 8 for a time tg corresponding to the distance to the vibration sensor 6, the vibration reaches the vibration sensor 6. The reference numeral 42 in FIG. 4 indicates the signal waveform detected by the vibration sensor 6. The plate wave used in this embodiment is a dispersive wave, so the envelope 42 of the detected waveform
The relationship between 1 and phase 422 changes depending on the vibration transmission distance.

Here, the speed at which the envelope advances is assumed to be group velocity Vg, and the phase velocity is assumed to be Vp. The distance between the vibrating pen 3 and the vibration sensor 6 can be detected from the difference in group velocity and phase velocity.

First, if we focus only on the envelope 421, its velocity is Vg, and when a point on a certain waveform, for example a peak, is detected as indicated by reference numeral 43 in FIG. fllld is the vibration transmission time tg, and d=Vg・tg
...(1) Although this equation relates to one of the vibration sensors 6, the distance between the other two vibration sensors 6 and the vibrating pen 3 can be indicated using the same equation.

Furthermore, in order to determine coordinate values with higher precision, processing based on phase signal detection is performed. Phase waveform 4 in Figure 4
If the time from 22 specific detection points, for example, vibration application to the zero cross point after passing the peak, is tp, then the distance between the vibration sensor and the vibration pen is d = ne input p + Vp 11t p - (2
). Here, input p is the wavelength of the elastic wave, and n is an integer.

From the above equations (1) and (2), the above integer n is n =
[(Vglltg−VpHtp) / λp +1 /
N]...(3) It is shown as. Here, N is a real number other than 0, and an appropriate value is used. For example, if N=2, n can be determined if it is within ±1/2 wavelength.

By substituting n determined as above into equation (2), the distance between the vibrating pen 3 and the vibration sensor 6 can be accurately measured.

In order to measure the two vibration transmission times tg and tp shown in FIG. 3, the waveform detection circuit 9 can be configured as shown in FIG. 5, for example.

In figure f55, the output signal of the vibration sensor 6 is amplified to a predetermined level by the amplification circuit 51 described above.

The amplified signal is input to the envelope detection circuit 52, and only the envelope of the detection signal is extracted. The timing of the extracted envelope peak is detected by the envelope peak detection circuit 53. From the peak detection signal, an envelope delay time detection signal Tg having a predetermined waveform is formed by a signal detection circuit 54 composed of a mono-multivibrator or the like, and is input to an arithmetic control circuit l.

Further, a phase delay time detection signal Tp is formed by the detection circuit 58 from this Tg times signal timing and the original signal delayed by the delay time adjustment circuit 57, and the phase delay time detection signal Tp is generated by the arithmetic control circuit l.
is input.

That is, it is converted into a pulse of a predetermined width by the Tg multiplied signal monostable multivibrator 55. Further, the comparator level supply circuit 56 outputs t according to this pulse timing.
A threshold value for detecting a p-fold signal is formed. As a result, the comparator level supply circuit 56 is
A signal 44 having a level and timing such as 4 is generated and input to the detection circuit 57.

That is, the monostable multivibrator 55 and the comparator level supply circuit 56 are used to ensure that the phase delay time measurement is activated only for a certain period of time after the envelope peak is detected.

This signal is sent to a detection circuit 5 consisting of a comparator etc.
8 and is compared with the delayed detection waveform as shown in FIG.

The circuit shown above is for one vibration sensor 6, and the same circuit is provided for each of the other sensors.

If the number of sensors is generalized to h, then h detection signals each of envelope delay time Tgl-h and phase delay time "rpl-h" are input to the arithmetic control circuit l.

In the arithmetic control circuit of FIG. 3, the above Tgl~h, Tpl~
The h signal is input from the input port 15, and the count value of the counter 13 is taken into the latch circuit 14 using each timing as a trigger.As mentioned above, the counter 13 is started in synchronization with the driving of the vibrator pen. The latch circuit 14 takes in data indicating the respective delay times of the envelope and the phase.

When three vibration sensors 6 are arranged at the positions S1 to S3 at the corners of the vibration transmission plate 8 as shown in FIG. The straight-line distances d1 to d3 to the position of the vibration sensor 6 can be determined.

Furthermore, the coordinates (x, y) of the position P of the vibrating pen 3 can be determined by the following formula using the arithmetic and control circuit 1 based on the straight lines 111dl to d3 using the three-square theorem.

x-X/2+(dDd2) (di-d2)/2X
-(4)y=Y/2◆(di+d3) (d
i-d3)'/2Y (5) Here, x and Y are the distances along the X and Y axes between the vibration sensor 6 at the positions S2 and S3 and the sensor at the origin (position 31).

As described above, the position coordinates of the vibrating pen 3 can be detected in real time. In addition, by repeating the above input processing in a short period of time and displaying dots one after another at positions corresponding to the input coordinate points on the display 11', handwritten characters input with the vibrating pen 3, Images and other information can be displayed in their original size.

As described in the section on conventional examples, in such applications, it is impossible to input and edit images accurately unless the image is displayed exactly at the position on the display 11' intended by the operator. .

However, as mentioned above, the display 11' and the vibration transmission plate 8
, the refractive index of the vibration transmission plate 8, etc., a deviation occurs between the input position and the display position at the operator's observation point. In other words,
Even if dots are displayed at the same coordinate position as the coordinate input point on the display 11', the dots will be perceived as being shifted from the position of the operator's eyes.

Some configurations for solving this problem are shown below.

The configuration shown in FIG. 7 allows the operator to input and set the control amount for correcting the display position.

The set control amount is thereafter held (stored) in the setting means.

In Fig. 7, the items indicated by numerals 72 and 73 are:
This volume 72. is a volume (variable resistor) through which the operator inputs and sets a control amount for controlling the display position.
Both ends of 73 are connected to the power supply voltage Vcc via a resistor R, and the other end is grounded. Volume 72.73
The terminal voltages of are respectively converted into digital values by A/D converters 74 and 74 and input to the arithmetic control circuit 1.

The operating shaft of the Poly Neem 72.73 is exposed at a predetermined position such as the input tablet or the main body where the arithmetic control circuit 1 is housed, so that the operator can rotate it to adjust the resistance value. . The terminal voltages of the volumes 72 and 73 change according to this manipulated variable, and are recognized by the arithmetic control circuit 1 via the A/D converter 74.

The arithmetic control circuit 1 recognizes the terminal voltages of the volumes 72 and 73 as the amount of correction in the X direction and the X direction of the display position on the display 11', respectively. That is, the volume 72.
The terminal voltage of 73 is recognized as a control amount for correcting the position of the display dot in the x and X directions as shown by reference numeral 71, and the control amount input to the display control unit 10 is given.
Move the dot display in the X and X directions, respectively. This process can be easily performed by moving the coordinates in parallel by adding or subtracting the display coordinate values.

In such a configuration, when the operator inputs a dot (or line, etc.) using the vibrating pen 3 and rotates the volumes 72 and 73 while keeping the tip of the vibrating pen 3 fixed at the input position, the arithmetic control circuit l changes the display. The display dot is moved in the X and X directions via the control unit 10. When the rotation of the volume is stopped, the arithmetic control circuit 1 stops the position of the display dot at a corrected position corresponding to the control amount set by the volume.

Therefore, by adjusting the volumes 72 and 73 so that the input dot matches the tip of the vibrating pen 3, the operator can control the input position and the display position seen from the operator's observation point to match. .

Since the set correction control amount is held as the position of the rotation axis of the volume 72, 73, the same control u4 amount will be calculated even if the power to the device is cut off or the power is turned on next time and processing starts. It can be applied to the control circuit 1. Therefore, if the operating position of the operator does not change, the display position is controlled to a predetermined corrected position after one adjustment.

In the above description, the correction control amount of the display 2 is input and set using the volume, but the configuration is relatively complicated because an A/D converter is required. Therefore, as shown in FIG. 8, DIP switches 81 and 82 may be provided to respectively input correction control amounts for the display position in the x and X directions, and the control amounts in digital values may be directly given to the arithmetic control circuit 1.

The number of elements of the DIP switches 81 and 82 is set to the number of bits corresponding to the required correction resolution.

According to such a configuration, the correction control amount of the display position can be input and set using a simpler structure.

In the configurations shown in FIGS. 7 and 8, when the posture of the operator changes or when an operator with different physical conditions uses the device, the volume 72, 73 is rotated again and 7JJt! fJ must be repeated.

Therefore, as shown in FIG. 9, the DIP switch 81 in FIG.
．． An IC card (or adjustment board, etc.) 91 equipped with an EFROM or the like that stores the digital control amount so as to be set at A possible method is to store the correction control amount of the display position and change the correction control amount by replacing the card 91.

The control amount of the IC card 91 is input to the arithmetic control circuit 1 via the input/output port 92, loaded into the memory 94, etc., and used to control the display control section 10. If the memory 9 is constructed from a non-volatile memory (EE'FROM) or the like, the same correction control amount can be used from now on without using the IC card 91.

According to such a configuration, even if the operator or the operator's posture changes, the display position can be easily corrected and controlled by simply replacing the IC card.

The configurations shown in FIGS. 7 to 8 require some adjustment work. In view of this point, structures as shown in FIGS. 10 to 13 may be considered in order to facilitate the adjustment work of the input position and display position.

FIG. 10 explains the adjustment operation in the following embodiment.

In this embodiment, a point on the display 11'' is first displayed, and then the operator is requested to input coordinates to that point.

Since there is a deviation between the input position and the display position at the operator's observation point before correction, the coordinates should be input to a position such as 3', for example.

Therefore, by taking in the coordinates of this input point and finding the difference between its X coordinate and the x, X coordinate of the initially displayed display point, a correction value for the display coordinate can be found. Thereafter, by correcting the display position based on the collected correction values, it is possible to match the input position and the display position for the operator.

As a configuration for performing such correction processing more accurately, structures as shown in FIGS. 11 to 13 can be considered.

FIG. 11 shows the structure of the vibrating pen 3. In FIG. 11, reference numeral 111 is a pen shaft, and a ring-shaped vibrator 112 is provided inside this pen shaft.
The vibration of the vibrator 112 is configured to be transmitted to the vibration transmission plate 8 via a horn portion 114 made of glass or the like and having optical transparency. The vibration mode of the vibrator 112 is selected in the same manner as in the previous embodiment.

Further, a horn portion 1 is provided at the center of the ring-shaped vibrator 112.
A light sensor 113, such as a photodiode, is provided so as to be able to detect the light transmitted through the light sensor 14.

When actually using the vibrating pen 3 having the structure shown in FIG. 11, most operators tilt the vibrating pen 3 at an angle as shown in FIG. 12 to contact the vibration transmitting plate 8.

When a reflective element such as a liquid crystal display is used as the display 11', light emitted from an indoor lighting source is reflected by the reflective surface of the display 11' along the path shown in the figure, and the pen shaft 11
The light reaches an optical sensor 113 that is provided in alignment with the central axis of 1. However, here, the optical axis is illustrated ignoring refraction at the vibration transmission plate 8.

If pits are displayed as shown by reference numeral 121, the presence or absence of the display can be detected based on the intensity of light input to the optical sensor 113.

While the display dots are being detected by the optical sensor 11 in this manner, the vibrator 112 is driven, and the vibrations input to the vibration transmission plate 8 are processed as described above to obtain input coordinate values. The correction control amount of the display position can be determined by determining the difference from the coordinates of the display point known in advance.

In this method, the operator places a small display dot on the vibrating pen 3.
Since you are asked to point with
It may become difficult to operate.

Therefore, the following method can be considered.

For example, as shown by reference numeral 131 in FIG. 13, a straight line (y=n) parallel to the X-axis is displayed on the display 11', and a line is input using the vibrating pen 3 so as to intersect this straight line. .

While inputting this line, the output of the optical sensor 113 is monitored, and the difference between the y coordinate of the input coordinates when the sensor 113 detects the displayed straight line 131 and the y value n of the straight line 131 is corrected in the X direction. It becomes the control amount.

Similarly, the amount of correction in the X direction can be obtained by displaying a straight line of x=n, making an input using the vibrating pen 3 so as to intersect the straight line, and performing similar processing.

In the above, a reflective display was exemplified, but EL.

A structure similar to that shown in FIGS. 1O to 13 can also be used for a light-emitting type display such as a CRT.

[Effects of the Invention] As is clear from the above, according to the present invention, the handwritten information input device and the display device are arranged one on top of the other, and characters or images handwritten into the handwritten information input device with an input pen can be displayed. The information input/output device for displaying information on the display includes means for detecting display information on the display provided in the input pen, and control means for correcting the display position of the display based on the output of the detection means. Since the display information detecting means of the input pen can be used to correct the position of the display information corresponding to the input information, it is possible to ensure that the input position and the display position relative to the operator match. This has the notable effect of improving the operability of the device.

[Brief explanation of drawings]

Fig. 1 is an explanatory diagram showing the configuration of an information input/output device adopting the present invention, Fig. 2 is an explanatory diagram showing the structure of the vibrating pen shown in Fig. 1, and Fig. 3 is an explanatory diagram showing the structure of the vibrating pen shown in Fig. 1. A block diagram showing the structure of , Figure 4 shows the distance fl between the vibrating pen and the vibration sensor.
Figure 5 is a block diagram showing the configuration of the waveform detection circuit in Figure 1.
The figures are explanatory diagrams showing the arrangement of vibration sensors, figures 7 to 9.
The figure is an explanatory diagram showing different configurations for correcting the input position J and the display position, and FIGS. Figure 10 is an explanatory diagram showing the operating procedure;
12 is an explanatory diagram showing the structure of the vibrating pen, FIG. 12 is an explanatory diagram showing detection of a correction control amount, and FIG. 13 is an explanatory diagram showing detection of different correction control amounts. l... Arithmetic control circuit 3... Vibration pen 4... Vibrator 6... Vibration sensor 8... Vibration transmission plate 51... Preamplifier 15.16... Input boat 52...・Envelope detection circuit 54.58... Signal detection circuit 72.73... Volume 81.82... DIP switch 91... IC card 112... Vibrator 113... Optical sensor Fig. 4 Figure 8 Figure 9 Figure 10

Claims (1)

[Claims] An information input/output device comprising a handwritten information input device and a display device arranged one on top of the other, and displays characters or images handwritten into the handwritten information input device using an input pen on the display device. An information input/output device comprising: means for detecting display information on the display; and control means for correcting the display position of the display based on the output of the detecting means.