JPS59139433A - Information processing device - Google Patents

Abstract

PURPOSE:To shorten the correcting operation time of characters inputted through an optical character reader or the like, by watching only information displayed on a display screen to designate a correction position without key operations of the operator. CONSTITUTION:For example, Kanji (Chinese character) ''yama'' (''mountain'' in English) is displayed on a display device 14 and should be corrected. When an operator 11 sees character ''yama'', the position of the operator's eye is detected by a television camera 13. The position of his eye is converted to coordinates, and they allowed to correspond to character ''yama''. When the position of character ''yama'' is detected, a cursor is moved automatically to the position to report it to the operator. The operator inputs information to be corrected to a microphone 12. Correction information is recognized by a voice recognizing processing part of a processor 15. The processor replaces character ''yama'' with information from the operator and displays this information on the display device. Though correction information can be inputted by a keyboard, position information of his eye is prevented from being lost in this case.

Description

[Detailed Description of the Invention] [Field of Application of the Invention] The present invention relates to a device that can modify information displayed on a display device by simple means, and particularly relates to a 1i1 information processing device suitable for Japanese word processors, image processors, etc. .

[Prior art]

Using a conventional Japanese word processor as an example9, we will discuss its problems.

Conventionally, the means for manually inputting word processors has generally been a keyboard, but other methods include voice input, online character recognition using a tablet, and optical character reading devices. These manual methods are generally prone to human errors and require work to confirm the manually-generated information. The most common method is for the operator to manually move the cursor to the character position to be corrected. In this case, it takes time t to move the cursor to the position of the character to be corrected using a shift key or the like, which slows down the correction work.

[Purpose of the invention]

The object of the present invention is to provide a device that detects the position of the correction tube by looking at the correction tube (hereinafter referred to as gazing) and performs the correction without having to perform the above-mentioned correction work by operating keys. be.

[Summary of the invention]

Considering the procedure for modifying the information displayed on the display device (
1) View the displayed information, (2) Decide whether to correct it, (3)
) is done by repeating three steps. Among these, (3) is the correction work itself, and (2) J' is information recognition, so the only procedure for the correction work is (1), which is always performed. The present invention focuses on this point, determines which point on the display device the user is gazing at based on the position of the eyes when viewing the displayed information, and uses this information to determine the position of the information to be corrected. For example, there is a similarity in that the work is proceeded by manually inputting information for correction from a voice input device or the like.

[Embodiments of the invention]

FIG. 1 shows an embodiment of the present invention, FIG. 1 (1) is an overview diagram thereof, and FIG. 1 (2) is a system configuration diagram corresponding to FIG. 1 (1). First, an outline of the operation of the present invention will be explained using FIG. In FIG. 1, 15 is a processing device such as a Japanese word processing sensor and a 14Vi display device. Assume that the character ``yama'' is currently displayed at 14,
Fix this. When the operator 11 looks at the "mountain" 14, the television camera 13 detects the position of the eyes 11. 13
The coordinates of the eyes projected on the image are converted to a position on 14 by the processing device 15, and the eyes are correlated with the "mountain".

When the position of the "mountain" is detected, the cursor may be automatically moved to that position, or the "mountain" may be brightly modulated, etc.), and the system 11 is notified. When the eye position is detected, 11 goes to the microphone 12 and manually inputs the information to be corrected by voice.The information from 11 is recognized by the voice recognition processing section also located in 15, and then the Japanese information processing section located inside 15 recognizes the information from 11. Send correction information to.

The Japanese information processing section exchanges the information from 11 with "yama" and displays it on 14. The correction work is completed in the above manner.

Of course, all the correction information may be entered using other correction means, such as a keyboard. In this case, it is necessary to prevent the detected eye position information from being lost.

Next, based on FIGS. 2 and 3, the correspondence between the position of the operator's eyes and the position on the display device, which is a characteristic of the present invention, will be explained.

First, a means for measuring the range of movement of the operator's eyes and correcting the position on the display device based on this value will be described. Second
The figure shows correction symbols 21.22, 23.2 on the display device 14.
4 is displayed.

When the operator 11 manually inputs a message to the entire processing device 15 to perform the correction, a symbol for correction is displayed at the position 21 of 14. When 11 sees this symbol and manually tells 15 to do so, the eye is detected at position 31 on the image pickup tube of television camera 13 as shown in FIG. 3(2). When 31 is detected, 15 displays a symbol at 22 position.

Move your eyes to position 111fi22 and perform the same operation as above. Thereafter, in the same manner as shown in FIG.
Figure 3 corresponding to 24 (1 m3 above the camera shown in 21)
1, 32, 33, and 34 can be detected. Position the eye here and define it as the center of the pupil. I won't talk about how to draw out the center of the pupil laterally, but the usual 11! It can be easily determined using l11J1 processing technology.

However, if the operator's recitation fluctuates within a minute range, it is necessary to provide means for filtering this. FIG. 3 shows the correspondence between 14 and 13. The distance between 21 and 22 is XL, the distance between 21 and 24 is 11M 'fr: Y L
and the corresponding detected distance on the camera is Xo
, Yo.

Figure 4 shows the arbitrary point P shown in Figure 3 (1) on 14 as 1
FIG.

The method for determining Pk will be described below.

In FIG. 4, AA' represents a horizontal distance XL of 21.22 on 14. When you look at 21 now, the eye position is 3
If the position of the eye when looking at 1.22 is 32, the distance the eye moves (deviation of the center of the scale) is E 1 + E 2 . Q
corresponds to the retina and is the distance between the cFi crystalline lens and the tunica membrane.

The distance H1 between 14 and Q can be found using equation (1).

Here, Xt, , C are given, and El + E2 can be measured at the time of correction.

To find the point P that is X away from the center of the eye, we obtain equation (2) and equation (
2) From this, the deviation Ex on the television camera is independent of Hl and C.
By measuring xf on the display device 114, it is possible to obtain xf.

Next, a case will be described when 11 moves by Eo in the horizontal direction after correction. , Let the point when moved by Eo be Q'. 21 at this time.
22′fcThe eye movement path KIi when looking at B4. Assuming E3, from now on E3 + E4 = El + E2
(5) That is, the distance the eyes move when moving in the horizontal direction is constant. Therefore, use El+E2 obtained at the time of correction.

The distance when looking at point P from Q' is the deviation E on the TV camera.
For X'. From this, Eo can be found as the moving distance of the center as described later. Therefore, even if the user moves after correction, it is possible to determine which point on 14 the user is looking at by detecting the position of the eye of the television camera. The same can be said for movement in the Y direction.

FIG. 5 is an explanatory diagram for determining the moving distance Eo. For the sake of simplicity, we will explain the case with one eye. There is an eye at position C now, and the outline of the eye is detected by image processing. Similarly, when the eye moves to position C', the distance traveled between the contour at this time and the contour of C is E. By knowing X and Eoy, the movement of the eyes, that is, the movement of the operator 11 can be detected.

Next, correction when the operator 11 moves back and forth after correction will be described.

If the distance between the operator and the camera at the time of correction is Hl, and the distance the eye moves at this time is E, +E2, then the relationship between the distance H2 after movement and the distance Ew the eye moves is as follows: Hz is the same as the magnification m of the camera. If you do that, you will be asked for a second QOI.

Hz = f (1+m) ... group αω where f is the focal length of the lens.

Next, as for the means for informing whether the operator 15 has confirmed that the operator 11 has viewed an arbitrary position on the display device 14, once the position on the display device 14 has been determined by the above-mentioned means,
This can be realized by moving the cursor to a corresponding position on the screen 14 or by modulating the brightness of information displayed at the corresponding position.

〔Effect of the invention〕

As explained above, according to the present invention, it is possible to specify the correction position by simply looking at the information displayed on the display screen, for example, when correcting manually written characters using an optical character reading device, etc., which has a significant effect on improving the efficiency of correction work. There is.

[Brief Description of the Drawings] Figure 1 is a diagram showing an embodiment of the present invention, Figure 2 is a diagram showing an example of displaying historical symbols on a display device, and Figure 3 of the coffin is a display device for correction symbols. Figure 4 is an explanatory diagram for determining the position of a point on the display device from the position of the point on the image pickup tube; Figure 5 is the distance traveled by the 1st id. FIG. 13...TV camera. Day 1 (+2 3

Claims (1)

[Claims] It is a characteristic that the system is equipped with a display means for displaying information, a detection means for detecting which position on the display means the operator is looking at, and a changing means for changing the information displayed at the detected position. information processing equipment.