SU1215656A1 - Apparatus for recording eyeъs gaze - Google Patents

Description

one

The invention relates to engineering psychology, to technical means for recording and analyzing human visual activity, and can be used in solving ergonomic problems, as well as in medical research.

The purpose of the invention is to reduce the time for determining the spatial coordinates of gaze fixation points.

FIG. 1 shows a block diagram of an apparatus for detecting the direction of gaze5 in FIG. 2 is a block diagram of a block for generating additional information; in fig. 3 is a block diagram of a decryption unit.

The device (Fig. 1) contains an eye movement recorder 1, consisting of a view direction recording unit 2, a timer 3 and a synthesizer 4. Two inputs of the synthesizer 4 are connected in parallel with the outputs of a timer 3 and a view direction recording unit 2. The output of the eye movement recorder 1 is connected to a series of additional information forming unit 5, a key 6, a television monitor 7 and a video recorder 8. The second output of the television monitor 7 is connected to the input of the key 9, the output of which is connected to the second input of the additional information block 5. The third output of the television monitor 7 is connected to a key 10 connected in series with the decryption unit 11 and the computing unit 12. The second and third inputs of the computing unit 12 are connected respectively to the input of the data input unit 13 and the second output of the generator 14 of the figure block 15 controlling the position and size of the figure, the second output of which is connected to the input of block 16 of forming the video signal of the figure.

The second video recorder 17 is connected to the serially connected to the right key 18, the first input of the mixer 19, the first key 20 and the second input of the television monitor 7. The second input of the mixer 19 is connected to the output of the figure 16 signal generating unit 16.

The unit 15 controls the position and size of the figure in the form of a handle connected to three potentiometers, which change the voltage in proportion to the movement of the handle in the horizontal and vertical direction.

directions, as well as the angle of its rotation. In block 15, there is also a figure size adjuster made in the form of a fourth potentiometer.

Block 5 of the formation of additional information (figure 2) consists of three series-connected pending multivibrators 21-23, two

modulators 24 and 25 of the video signal, in series connected analog-to-converter converter 26, counter 27 line elements, sequentially connected 28 line counter

the second digital comparator 29 and the first digital comparator 30, four circuits And 31-34 and two circuits OR 35 and 36. The output of the standby multivibrator 23 is connected to the inputs of the module g

torus 25 and schemes And 32 and 33. Exit

standby multivibrator 21 is connected to the inputs of the circuits And 31 and 34, as well as with the second input of the modulator 25. Digital comparator 30, circuit And 34,

the OR 36 circuit and the modulator 24 are connected in series. The digital comparator 29, the second input of the circuit AND 33, the circuit OR 35 and the second input of the modulator 24 are connected in series. Counter 27 the number of items

rows connected to the second input circuit And 31, the output of which is connected to the second input of the circuit OR 36. The second input circuit OR 35 is connected to the output circuit And 32, and the output of the modulator 25 - to the third input of the modulator 24.

The decryption unit 11 (FIG. 3) consists of three consecutively waiting multivibrators 37-39, a key 40, a threshold element 41, a trigger 42, an AND circuit 43 and a register 44, a serially connected key 45, a threshold element 46, a trigger 47, And circuit 48 and register 49, as well as a 50 line counter. The second output of the standby multivibrator 37 is connected to the input of the key 45. The output of the counter 50 lines connected to the inputs of the circuits And 43 and 48.

The operation of the device consists of the stage of recording data on visual activity and the stage of a posteriori processing of the recorded data. At the first stage, a signal is formed and recorded on the video tape, which contains the basic information of the image of the field of view, marker and digits of the current field.

3

time and additional information about the form of the coordinate codes of the marker on the television raster.

At the first stage, the keys 6 and 9 are closed, and the keys 1.0, 18 and 20 are open and from the visual register 1, the video image of the main image and the codes of the angles of rotation of the eye horizontally and vertically (X ch and UGL) are fed to the additional information formation block 5. Block 5 forms zones in the right and left parts of the television raster, which are raster sections of 10% each of the line length in which the amplitudes of the video signal are maximum (white background). On the first raster line in both zones, block 5 forms a video signal with an amplitude equal to zero (dark line), and these lines serve as reference points.

In the left zone, for example, block 5 counts from the reference line the number of lines equal to the horizontal component code of the angle of rotation of the eyes Xgl, and on the line (code) with the number equal to code X, A, modulates the amplitude of the video signal in this zone to zero, i.e. a dark line is formed. The same block produces a modulation in the right zone of the code line with a marker equal to the code of the vertical component.

The image of the front panel section with zones, a fixing point marker at a glance and the current time numbers are recorded during the experiment on the first VCR 8. The multivibrator 21 receives the sync pulses of the lines of the television monitor 7, and this multivibrator creates a pulse of 5 µs, i.e. 10% of the duration of the entire line, and the back edge of the pulse triggers the multivibrator 22, forming a pulse of 40 μs duration. Then a multivibrator 23 is started, the output pulse duration of which is 5 µs. The video signal of the recorder 1 is supplied to the input of the modulator 25, and in the absence of pulses from the multivibrators 21 and 23, the modulator passes the signal without changes, i.e. for the time of 40 µs, in the middle of the line, the video monitor of the main image passes to the telemonitor 7.

When signals from multivibrators 21 and 23 arrive at the modulator

156564

25, the latter amplifies the signal to the maximum, thereby creating a white background in the right and left zones of the television raster, the output signal of the modulator 25 is fed to the modulator 24 and further to the television monitor 7.

On the converter 26, the analog-code from the TV monitor 7 is fed by a line sawtooth-like scan, which

) 0 the latter converts to a numeric code with a bit depth. The counter 27 of the number of elements of the row counts the number of these gradations and supplies the signal to a digital comparator 30, on the second input of which comes from the recorder 1 of eye movements the code of the horizontal component of the angles of rotation of the eyes (Chr.). When the codes on both inputs match, digital com2Q parator 30 outputs a signal to AND 34 circuit. From counter 27, the number of line elements to AND 31 circuit receives pulses corresponding to the first raster line. At the first inputs of the circuits

25 31 and 34 the enable pulses are received from the multivibrator 21. The output signals of the circuits 31 and 34 are sent to the OR circuit 36 and then to the modulator 24. This modulator receives the inhibit signals only in the left zone at the time of the first row and row, the number of which is is equal to code X of ch. The top-24 module is locked, and dark areas (reference and code lines) are formed on the indicated lines in the left zone. Similarly, the repernaire and the code lines in the right zone are formed using a counter of 28 lines, a digital comparator 30, AND 32 and 33 schemes and HJTIi 35 schemes, while the number of lines between the reference and code lines in the right zone is equal to the GA code

In the second stage of operation, an image of a geometric figure having the same shape as the selected device is formed on the screen of the television monitor 7. The experimenter controls the position of the figure, combining it with the selected instrument, the image of which is moved by moving the human head. At the same time, the position codes of the marker and the data on the position of the figure of the figure and its size are read, and this data is processed to obtain the true coordinates of the sight points on the object of observation.

thirty

40

In the second stage, with a posteriori processing of visual data, the keys 6 and 9 are open, and the keys lOj 18 and 20 are closed and the recorded record is played on the second VCR 17, the signal from which goes to the mixer 19 and further to the TV monitor 7.

The first input of the mixer 19 receives a signal from the block 16 of forming the video signal of the figure controlled by the signal of the block 15 controlling the position and size of the figure. Block

16 forming the video signal of the figure generates signals which, using a mixer 19, form on the screen of the television monitor 7 an image of a geometric figure with a horizontal segment passing through its center superimposed on the image recorded during the experiment.

The experimenter works with the help of the block 15 controlling the position and size of the figure, which changes the signals of block 11, which through block 16 changes the position of the center of the figure (X coordinates, k.) Using the scale setting knob of the block 15, the experimenter changes the size of the figure to match its contours with the contours of the selected instrument and the horizontal line of the figure coincides with the horizontal line of the image of the object of observation.

The keypad of the data input unit 13 dials the number or name of the device with which the figure image is combined, and the time, the value of which is displayed in digits on the screen of the television monitor 7. These data are entered into the computing unit 12, which stores the true coordinates of the instruments on the object observations and their corresponding names or numbers.

At the same time, signals from block 15 are inputted to computing unit 12.

After that, the tape mechanism of the VCR is started.

17 and the main handle of the block 15 tracks the image displacement of the device vertically, horizontally and its inclinations on the screen. If the scale of the instrument is changed, the experimenter stops the tape mechanism of the second

ABOUT

five

0

five

0

five

five

0

five

VCR 17 and freeze frame adjusts the scale.

A television image reproduced during the Processing of data on the second VCR 17 superimposed on it with the image of the process during the processing is recorded on the first VCR 8 for subsequent control of the processing quality.

In the process of reproducing the recording from the second video recorder 17, the decryption unit 11 extracts the video signal in each of the zones, determines the amplitude of the video signal, the reference and code lines, and counts the number of lines located between them in each zone.

The lower pulses from the TV monitor 7 act on the multivibrator 37, the output of which controls the key 15, and the output of the multivibrator 39 controls the key 40, while the left zone is outputted at the output of the key 45, and only the right zone at the output of the key 40 raster.

The threshold elements 41 and 46 allocate the minimum video signal of the zones, and the reference line signals put the triggers 42 and 47 into state 1, and the code line signals into state Oh. Thus, the circuits 43 and 48 pass to registers 49 and 44 the code of the number of lines located respectively in the left and right zones, i.e. X Ch and UGL codes These codes from registers are read into the computing unit by 12 human clock pulses, which simultaneously transfer the triggers to the O state. The obtained values of the number of rows are equal to X,. (and the UGL, and these data are entered into the computing unit 12. By according to the signals of block 15 and the angle of rotation of the head in the frontal plane Y, the number or name of the monitored device, as well as the values of Xp and U (in computing unit 12, calculate the true coordinates of the fixation points: and look at the person at the object of observation.

The calculation of the horizontal coordinate (Xsr) of the point of fixation of the glance in the computing unit 12 is carried out according to the formula

R sih (o) -a sinfr m cosS

os ()

gdes e

HI angle of rotation of the head relative to the vertical axis; horizontal projection of the angle of rotation of the eye, the position of the eye relative to the vertical axis of rotation of the head, respectively, in the sigital and frontal planes

distance from the human head to the object of observation. The values of R, d and m are entered into the computing unit before the video recording is started. Angles l and o (determined from the ratios

t t X ch cos At t RGL

R

about cosot

(JR X -X PVR

R ()

where f is the focal distance of the lens of the registrar 1 of the direction of view; D - distance from vertical

axis of rotation of the human head to the center of the lens; vf - head rotation angle

frontal plane, X - is proportional to (with the proportionality coefficient known for this television system) image position (HF,) in the frontal plane in which the receiving element of the video camera is located; R is the distance from the human head to the object of observation.

Similarly, count

From and From ff / pb fut.l

Claims (1)

DEVICE FOR REGISTRATION OF THE DIRECTION OF GAS, containing an eye movement recorder and a telemonitor connected to a VCR, characterized in that, in order to reduce the time for determining the spatial coordinates of the gaze fixation points, a series-connected figure size and position generator, a mixer and a first key, the output of which is connected to a telemonitor input, a second key connected in series, an additional information generation unit, a third key whose output is connected to a second telemonit input ora, the fourth key in series, the decryption unit and the computing unit, the second video recorder and the fifth key in series, the output of which is connected to the second input of the mixer, the data input unit, the output of which is connected to the second input of the computing unit, the third input of which is connected to the second output of the generator the size and position of the figure, and the output of the eye movement recorder is connected to the additional information generation unit, and the second and third telemonitor outputs are connected to the inputs of the second and fourth on the keys. SU-. 1215656 relates to technical registration and human activity