RU2530660C1 - Method of determining range of conditions for perception of depth of plane images - Google Patents

Abstract

FIELD: physics.

SUBSTANCE: method comprises selecting an image ^SPI^A; verifying perception of depth effects; obtaining dynamic series of the X coordinate of the right and left eye; if the series include the condition X^Ra≠X^Le, perception of image depth is confirmed; constructing dynamic series of the X and Y coordinates for the right and left eye, coordinate differences ΔX, ΔY; obtaining spectrograms of all dynamic series; constructing a histogram contour of the differences ΔX, ΔY; determining the position of the maximum of the contour (Δ_qX)_Max and (Δ_qY)_Max, and the maximum width of the contour at the base level Max (Δ_qX) and Max (Δ_qY).

EFFECT: wider range of determined perception indicators of depth and volume of a plane image.

15 dwg

Description

The invention relates to optics, stereoscopy, physiology, psychology, cognitive science, human ecology and can be used in neuroscience, experimental psychology, neurophysiology, teaching and learning technologies.

It is known that the mechanism of stereoscopic vision, binocular disparity is based on the analysis of three-dimensional scenes obtained with a shift in the observation point [1]. In the event that a planar image enters the field of view, then it is impossible to depict all binocular features on the plane [2]. The resulting depth effects due to monocular features are significantly less than when perceiving the stereo depth of two (or more) stereograms when superimposed.

It is known that training in observing the stereoscopic depth of stereograms, stereoprojections under conditions of their imposition develops the ability of three-dimensional perception of images on planar carriers [3-5]. The projection is superimposed when the gaze is concentrated outside the plane of the stereograms. If the concentration point is located in front of the stereogram, then the direction of the right and left eye is reduced to the point located between the eyes and the stereogram. The second option - the concentration point of the direction of the axes is fixed behind the plane of the stereogram. An integral element of the training is the acquisition of the skill to quickly transfer perception of stereoscopic depth from one observation method to another. There is a constant process of interaction of the mechanism of eye movement with various states of perception of the depth vector of stereograms.

In inventions [3, 4], physical and technical contradictions are eliminated. It is a necessity for three-dimensional perception to use two stereoscopic projections and apply either the conditions for superimposing projections or other technical devices directing stereoscopic projections into the right and left eyes. At the final stage of the training, the effects of the spatial perspective of the images are observed on one plane projection [4]. Subjectively, the effects of depth on one projection are no less than stereoscopic depths when observing a stereo pair.

Known subjective method of identifying the ability of three-dimensional perception of planar images [6]. During its implementation, several stereo pairs are mounted with the displacement of individual images at a distance of 0 to 6 cm. The stereo pairs are presented to the subject who selects the projection that most closely fits the feeling of perceiving depth on one projection.

It is known that eye movement in the perception of images is used in an objective technique to identify the ability of three-dimensional perception of planar images [7]. The test subject is presented with stimulus material in the form of planar images, stereograms, 3D raster images. During the time of exposure to the stimulus material, the direction of concentration of the gaze of the right (Ra) and left (Le) eyes is determined on the binocular IT tracker, X-coordinates are determined, dynamic series of X-coordinates, differences ΔX = X ^Le -X ^Ra , spectrograms of the series, contour of histograms of difference , determines the location of the maximum contour of the histograms of the difference. The ability of three-dimensional perception is revealed from the condition when, at its perception, ΔX ≠ 0. A comparison of the obtained parameters of eye movement activity under the conditions of observing the stereoscopic depth of stereograms, the depth of 3D raster images with similar characteristics when perceiving the depth of a planar image shows that they obey the general laws and at least one level of magnitude. This is the prototype method chosen.

It is known that while solving the inventive problem it is possible to eliminate technical and physical contradictions, such inventions fall under the highest level of classification and are able to structure a new branch of technology [8]. In the inventions [3, 4] at the final stage of the training process, the effects of depth and volume are perceived on a single projection. Therefore, there is no need to use stereoscopic projections, the implementation of their direction in the right and left eye. Experimental data show that the effects of depth on one projection are no less than stereoscopic depth on two (or more) stereoscopic projections. The technical elements in the mentioned inventions are, at a minimum, vision.

The objective of the invention is the expansion of indicators characterizing the ability to perceive the depth, volume of planar images.

The task is achieved by choosing such a planar image ^with PI ^A _, firstly, with subjective perception of depth effects, checking the perception of depth effects with obtaining dynamic series of the gaze direction along the X-coordinates of the right (Ra) and left (Le) eyes, with the identification of X ^Ra states ≠ X ^Le and confirmation of perception of depth images, and secondly, with a content of time series artifacts X coordinates in the form of short (Δt) emission amplitude readings from scale to n times the average value of the dynamic series, and the spectrograms EGISTRATION states with the entire set of frequencies, then during the observation time? T constructing dynamic series X and Y coordinates for the right and left eyes, coordinate difference Δ _q X, Δ _q Y, produce spectrograms of time series contouring histogram difference Δ _q X, Δ _q Y, determining the location of the maximums of the contours (Δ _q X) _Max and (Δ _q Y) _Max , the values of Δ _q X, Δ _q Y with the maximum width of the contours at the base level Max (Δ _q X) and Max (Δ _q Y) , by calculating the distance H to the plane of the perceived image, by choosing the time interval Δτ, in the cat ryh recorded artifacts for their construction changes X and Y coordinates for the right and left eyes, the differences of the coordinates, in the event of conditions where Δ _q X≈d or Δ _q Y≈d, the fixing state of singularity in the calculation of H, determining the occurrence time slots the state of singularity and their number during the observation ^With the PI ^{and the} choice of time intervals Δt is the state of artifacts, building pieces for them time series X and Y coordinates for the right and left eyes, the difference Δ _q X, Δ _q Y obtained for these conditions of Achen H, association of the two states in view of perception readings histograms contours width difference Max (Δ _q X) and Max (Δ _q Y) and finding ranges of variation of the depth perception of images of planar images,

where Δ ₁ X = X ^Le -X ^Ra or Δ ₂ X = X ^Ra -X ^Le , q = 1,2,

Δ ₁ Y = Y ^Le -Y ^Ra or Δ ₂ Y = Y ^Ra -Y ^Le , q = 1,2,

H = hd / (d-Δ _q X), d is the distance between the pupils of the eyes, h is the distance from the eyes to the image ^C PI ^A.

In Fig.1-Fig.15 presents the principle of application of the method. Figure 1 shows a planar photo image of a stone tile ^With PI ^A. It is displayed on the computer monitor screen of the binocular IT tracker at a distance h from the eyes. The origin is in the upper left corner of the monitor. Figure 2 shows the time series in the X-coordinate (figure 2-I) and Y-coordinate (figure 2-II) of the left eye. Relative coordinate values are plotted on a vertical scale, and ΔT on a horizontal scale is the time of image registration or observation. Similar indicators for the right eye are presented in figure 3. The time series of the difference in coordinates Δ ₁ X and Δ ₁ Y obtained in figure 4. For X-coordinates - this is FIG. 4-I, along the Y-coordinate - FIG. 4-II. Figure 4-I relates to the confirmation of the state of perception of the depth of the image of figure 1, in which the difference Δ ₁ X ≠ 0. This is the first requirement for image selection. The second requirement is the presence of perceptual artifacts - these are vertical outliers in the diagram of the dynamic row of the X-coordinate record (Fig. 2-I and Fig. 2-II). Spectrograms of time series of the difference Δ ₁ X and Δ ₁ Y are shown in Fig.5. On the horizontal scale, the recording time ΔT of image perception is plotted, on the vertical - the frequency composition of the time series. The upper figure of FIG. 5-I is obtained for X-coordinates, the lower figure 5-II is obtained from the Y-coordinates. Black vertical lines indicate the presence of synchronous movement of the right and left eye, but occurring with a certain time delay and with different amplitudes in the right and left eyes. They relate to the states of observed artifacts, i.e. the second condition for selecting the image ^With PI ^A. By the values of the spectrograms (and the brightness of the chart filling) of the time series for the X and Y coordinates, we can see the difference in the frequency background in the region up to 10-15 Hz. On the record of the time series, spectrograms, up to 10 cases of the appearance of artifacts are observed.

On the upper diagram of FIG. 6-II, the contour of the difference histogram is plotted in the Y-coordinate, and in the lower FIG. 6-I in the X-coordinate. On a horizontal scale, the values of the differences Δ ₁ X and Δ ₁ Y in cm are given, on a vertical scale, the number of samples of each value of the coordinate difference. The vertical white line indicates the location of the contour maxima - (Δ _q X) _Max and (Δ _q Y) _Max . In the diagram for the Y-coordinate, the black short line shows the zero value of the horizontal scale. The contour of Fig.6 allows you to determine the entire range of changes in the coordinate difference between the right and left eye. These are the values at the base level of the histogram outlines of the difference of FIG. 6 - Max (Δ _q X) and Max (Δ _q Y). They include values from the right wing of the contour for Y coordinates and reach the left wing of the contour for X coordinates. The contour of the histograms of the difference is located in the negative region of the horizontal scale. Negative values of the differences show that the readings for the left eye are always less than for the right. The arrows on the left wing of the contour of FIG. 6-I show a difference value of 6.4 cm at which the expression for calculating the distance H, i.e. to the location of the perceived image becomes infinitely large. The distance H is determined by the previously presented formula. The distance H is the distance to the plane of the perceived image from the location plane ^C PI ^A _, i.e. to the area in which the right and left eyes are concentrated in a point. It is found from equilateral triangles, at the base of which are the distance d between the pupils of the right and left eye and the difference Δ _q X, and the height is the distance from ^C PI ^A to the junction point of the right and left eye - this is H and the sum is H + h.

The condition when d = Δ _q X is a state of singularity and transfer of the plane of the perceived image to infinitely large distances. 7 illustrates a state of a change in distance H at various ratios of Δ _q X and d. On the vertical scale, H is plotted, on the horizontal - ΔX = X ^Ra -X ^Le . Everything that is located to the left of the vertical arrows of FIG. 6-I characterizes the location of the plane of the perceived image in the direction from the plane ^C PI ^A to the eyes of the observer. 7 are negative values of N.

The change in the X and Y readings of the coordinates of the right and left eyes, their difference for ≈100 ms under observation of the singularity is shown in Fig. 8 (X-coordinate), Fig. 9 (Y-coordinate) and Fig. 10 (difference Δ ₂ X and Δ ₂ Y). In Fig. 8 and Fig. 10, vertical arrows indicate readings for X coordinates, difference Δ ₂ X, when singularity conditions appear. The scale of the diagrams of Fig. 8, Fig. 9, Fig. 10 is obtained from the numerical series of XY-coordinate readings taking into account the resolution of the monitor, IT tracker.

Figure 11 (X-coordinate) and Figure 12 (Y-coordinate) shows the values of the distances H (vertical scale of the diagrams) to the plane of the perceived image. The distance H is counted from the location of the monitor of the IT tracker on which the image ^C PI ^{A is located} _. Negative values of H indicate that the plane of the perceived image is located in the direction from the plane of the monitor to the eyes. The singularity state was obtained only for the X-coordinate, its location is indicated by vertical arrows (Fig. 11). The diagrams in FIG. 11 and FIG. 12 show the change in the distances from the plane of the image location ^C PI ^A (i.e., from the monitor screen) to the plane of the perceived image.

Indications of X and Y coordinates, differences Δ ₁ X and Δ ₁ Y outside the conditions of artifacts for a time interval of ≈100 ms are shown in Fig.13-Fig.15. Positive values of the difference (Fig. 15) indicate that the plane of the perceived image is located between the plane of the monitor and the eyes, and negative values fall into the range beyond the plane ^{C of} PI ^A. On the vertical scale of FIG. 13, FIG. 14, and FIG. 15, readings of X, Y - coordinates in units of numerical arrays are postponed. Recalculation into distances H is carried out taking into account the resolution of the monitor of the IT tracker.

The method works as follows. To register the X and Y coordinates of the gaze direction, an SMI HiSpeed eye tracker is selected in binocular mode (recording frequency 500 Hz) and an image in which, according to the subjective opinion of the subject, depth and volume effects are observed. The image is displayed on a 19 ”ViewSonic 90Gf CRT monitor located at a distance of h = 58 cm from the observer’s eyes (resolution 1280 × 1024 pixels; 38 pixels / cm). The exposure time ΔT ranged from 15 to 150 s, and the distance between the pupils of the right and left eyes was d = 6.4 cm.

The image ^C PI ^A is displayed on the monitor screen (Fig. 1). The X, Y coordinates of the gaze direction of the right (Ra) and left (Le) eyes are recorded. For each eye, dynamic rows are built. In Fig.2 shows the dynamic row of the left, in Fig.3 - the right eye. The number I denotes the row in the X-coordinate, the number II - the row of the Y-coordinate.

The dynamic rows of the selected image should consist of stationary sections and artifacts as pulsed short-term modes of eye movements. Pulse modes for the right and left eyes have different amplitudes. The time series of the X and Y coordinates calculate the time series of the difference Δ ₁ X and Δ ₁ Y (figure 4). For all time series, spectrograms are obtained (Fig. 5), histograms of the difference Δ ₁ X and Δ ₁ Y are plotted (Fig. 6). The first necessary condition for choosing the image ^C PI ^A as an objective indicator of depth perception is the presence of the condition Δ ₁ X ≠ 0 or Δ ₁ Y ≠ 0 shown in Fig. 4 and Fig. 6. The second condition is the presence of artifacts seen from the recording of the dynamic series of Fig.2-Fig.4 as amplitude spikes with a range of 2-3 times the average value and spectrograms of Fig.5, in which the same spikes consist of vertical stripes of dark and white hue .

The contour of the histogram of the difference Δ ₁ X shows (Fig.6-I) that the intervals of change of the parameter Δ ₁ X reach values in absolute value of more than 6.4 cm. To calculate the depth of perception, parameter N. The formula for calculating H was presented before.

A singularity in the calculation of H occurs when the denominator in the definition of H (6,4-Δ _q X) = 0. Under such conditions, the plane of the perceived image is located at infinity. When entering the area (6,4-Δ _q X) <0 or 6,4 <Δ _q X - plane location there is an inversion of the perceived image on the negative portions in the remote distance relative to the plane of the ^{C A} _PI. As a result, in regions of small values from a value of 6.4 cm, states with the presence of a plane of the perceived image are possible in both positive and negative directions from plane ^{C of} PI ^A. The entire space from the plane ^C PI ^{A is} filled in with the volumetric content of the images of the selected image (Fig. 7) both in the positive and negative directions. Such states in figure 5 is observed at least 10 times. The singularity in calculating the distance to the plane of the perceived image occurs only for X-coordinate readings in the region indicated by arrows in FIG. 6-I.

The diagram of Fig. 8 shows that in the artifact region, the movement of the right (Ra) and left (Le) eyes is multidirectional. The gaze of the right eye is shifted by 5-6 cm, and the left eye is shifted by 30-32 cm. According to the Y-coordinate, the eyes move synchronously (Fig. 9).

The first state of singularity occurs between the fourth and fifth points of the diagrams (Fig. 8, Fig. 10). Discretization of coordinate measurements was carried out with a resolution of 2 ms. In figure 10, from the first to the 4th reference point, the difference Δ ₂ X first decreased from 5 to 4.2 cm, and at the fifth it reached 9.6 cm. After 6 ms, it decreased to 3.8 cm. Then by 44 ms the difference values become a negative value. The process lasts ~ 80-90 seconds. Then, the achievement of Δ ₂ X values of 6.3-6.4-6.7-6.8 cm is again recorded (this is the second state of singularity) (Fig. 10). In this fragment, with a registration duration of 106 ms, two singularity states arise (Fig. 10, Fig. 11). In the “format” of units of distances to the plane of the perceived image, in the first 4 ms, H decreased from 212 cm to 110 cm, then after a singularity of 8 ms it went into the region of negative values to -584 cm. Then it returned to 84 cm. Next, it was closer to the eyes , but not more than 47 cm. At the end of the artifact cycle, the image perception plane moved beyond the plane ^C PI ^A with a distance of 26 meters or more. The above fragment is obtained from the states of artifacts of the beginning of recording (Fig. 5) in the range up to 15 sec. Under such conditions, the image perception plane for ≈100-120 ms covers a range of at least ± 5-6 m.

The plane of the perceived image is an idealized version of the perception of the depth of images of a plane image. It is necessary to amend this concept, in which the distances are calculated not for the whole image, but for individual distributions of the color palette. Plus, the analysis does not take into account possible errors in the registration of coordinates for determining the viewing directions of the right and left eyes in singularity states.

From the analysis of the distribution of distances along the Y-coordinate (Fig. 9, Fig. 12), it follows that the location of the perception of images is located at a distance of +110 cm from the plane of the monitor and 40 cm in front of it.

Figure 5 shows that the overwhelming time of image perception does not include states of artifacts. Under such conditions, the X coordinate mainly records the excess of readings for the right eye over the left eye (Fig. 13), which indicates the location of the plane of the perceived image beyond the plane of the monitor (Fig. 15). In Fig. 15, the difference in the X coordinate is not more than 1.8 cm. In terms of the value of H, this is ≈23 cm. In the Y coordinate, the plane of the perceived image is located in front of the monitor screen at a distance of 11 cm from it (Fig. 14, Fig. .fifteen). During the registration of a recording fragment in ≈120 ms, a change in the readings of the X, Y coordinates, therefore, and their differences leads to the fact that the plane of the perceived image (or the depth of individual images) covers an interval of 30 cm (Fig. 15).

During the time ΔT in the region of the maximum contour of the histogram of the difference (Δ _q Y) _Max (Fig.6-I), where the main part of the Y coordinate is concentrated, the plane of the perceived image is located at a distance of ≈120 cm from the plane of the monitor. All indications located on the left wing of the contour of the difference histogram for X coordinates (Fig.6-II) increase the distance to the location of the plane of the perceived image. And where vertical lines are located, a state of singularity arises in the definition of N. Along the contour, to the left of the state of singularity, the location is inverted and the plane of the perceived image should be in the direction from the plane of the monitor screen to the eyes. The right wing of the contour at a level of 0.01 from the maximum (Δ _q Y) _Max reaches a difference of ≈1.3 cm or in terms of H it is ≈50 cm. Therefore, from the plane ^C PI ^A in the interval behind it at a distance of 50 cm only single values of perception of the depth of images arise.

Attaching to the contour of the histogram a difference in X-coordinates of a similar contour in Y-coordinate (Fig.6-II) fills the interval of this gap. A joint analysis of the contours of the histograms of the difference shows that it is possible to fill the perception with the effects of perception of depth from remote distances both in front of the location plane ^C PI ^A and at remote distances behind it. The contour of the histograms of the difference of Fig. 6 shows that the maxima of the location of the plane of the perceived image are formed with the difference: by ΔX = 4.49 cm, by ΔY = 1.68 cm. When converted (see Fig. 7) to N, they create maxima in concentration image perception planes at distances of 136 cm (along the X coordinate) and 21 cm (along the Y coordinate) from the ΔY plane. At the level of 0.9 of the maximum (Δ _q X) _{Max of the} contour towards the left wing along the X coordinate, the distance H reaches values of 1102 cm. In this case, the difference ΔX = 6.08 cm.There are short-term states when ΔY becomes a positive value and image perception planes are located in front of ^C PI ^A at a distance of up to 26 cm.

The material presented in the invention shows that when perceiving a planar image, artefacts of non-stationary states may occur with the appearance of a singularity in determining the location of perceived depth effects. In a state of singularity, an extended spatial distribution of images of a planar image from minus to plus infinitely remote distances occurs. The duration of recorded artifacts, including the state of singularity, does not go beyond 20-30 ms. Under the conditions of artifacts, there is an intense movement of the direction of the gaze, primarily the left eye. The right eye moves many times less.

All modern optical systems use elements inherent in the basic simple mechanisms of action of vision. Moreover, the visual system belongs to the most studied brain activity. And it can be one of the “tools” of the study of thinking. The revealed phenomenon of the ability to perceive the depth and volume of a 2D image relates to a new order of processing visual information and thinking in a technogenic environment. Certain aspects of the problem to be solved of the present invention can find application in technical solutions simulating the activity of vision, thinking.

The invention relates to optics, stereoscopy, physiology, psychology, cognitive science, human ecology and can be used in neuroscience, experimental psychology, neurophysiology, teaching and learning technologies.

Bibliography

1. Hubel D. Eye, brain, vision: Transl. From Eng. - M .: Mir, 1990 .-- 239 p.

2. Rauschenbach B. Geometry of the picture and visual perception. - St. Petersburg: ABC classic, 2001 .-- 320 p., Ill.

3. Pat. 2264299 RU. The method of forming three-dimensional images (options) / V.N. Antipov - Publ. 11/20/05; Bull. Number 32.

4. Pat. No. 2391948. A method for the development of stereoscopic vision / V.N. Antipov, A.V. Antipov - Publ. 06/20/2010. - Bull. 17.

5. Antipov VN, Baltina TV, Yakushev RS, Antipov AV Cognitive control of the visual perception of modern man as an object of study of bioecology // Uchenye zapiski KazGU. A series of natural. Sciences. - 2008. - T.150, book 3. - S.145-151.

6. Pat. 2321034 RU. A method for determining the degree of adaptation of the human visual system / Antipov V.N. and others. - Publ. 03/27/2008. - Bull. No. 9.

7. Antipov V.N., Vakhrameeva O.A., Galimullin DZ, Zhegallo A.V., Kharauzov A.K., Shelepin Yu.E. Experimental study of the pollutant perception of images of planar images // “Experimental method in the structure of psychological knowledge / Ed. ed. V.A. Drummers. - M .: Publishing House "Institute of Psychology RAS", 2012. - P.187-194.

8. G.S. Altshuller, B.L. Zlotin, A.V. Zusman, V.I. Filatov. Search for new ideas: from insight to technology, - Chisinau: Cartya Moldovenenasca, 1989. - 381 p., Ill., Tab.

Claims (1)

A method for determining the range of perception of depth of images of planar images, including the use of a planar image, its location at a distance h from the eyes, registration on the image plane of the gaze direction of the right (Ra) and left (Le) eyes, obtaining a dynamic range of X-coordinate readings, the difference ΔX, the construction of spectrograms of the time series, characterized in that they select such an image ^C PI ^A , when perceived which, firstly, the effects of depth are subjectively perceived, the perception of the effects of depth is checked For this, we obtain dynamic series of X-coordinates of the right and left eye, if the series include the conditions X ^Ra ≠ X ^Le , then we confirm the perception of the depth of the images, and secondly, the dynamic series of X coordinates contain artifacts in the form of short-term (Δt) outliers of the reading amplitude with a scale of n times greater than the average value of the dynamic series, and states with the entire set of frequencies are recorded on the spectrograms, after which the dynamic series of X and Y coordinates for the right and left eyes are built, the coordinate difference ΔX, ΔY, spectrograms of all the dynamics are obtained eskih series build contour histogram difference ΔH, ΔU, determine contour of the maximum location (Δ _q X) _Max and (Δ _q Y) _Max, the maximum width of the contour at the level Max base (Δ _q X) and Max (Δ _q Y) by the width of the contour calculate the distance H to the plane of the perceived image, select the time intervals Δτ in which artifacts are recorded, for them build the change in X and Y coordinates for the right and left eye, the difference in coordinates, if conditions arise when Max (Δ _q X) ≈ d or Max (Δ _q Y) ≈ d, then fix the state of singularity in the calculation of N, determine time intervals of the occurrence of the state of singularity and their number during observation ^C PI ^A , choose time intervals Δt outside the states of singularity, construct for them the dynamic series of X and Y coordinates for the right and left eye, the differences ΔX, ΔU get H values for these conditions, combine two states of perception, indications of the width of the contours of the histograms of the difference on its basis for the X and Y coordinates and find the ranges of changes in the depth of perception of images of a planar image,
where Δ ₁ X = X ^Le -X ^Ra or Δ ₂ X = X ^RA -X ^Le , q = 1,2,
Δ ₁ Y = Y ^Le -Y ^Ra or Δ ₂ Y = Y ^Ra -Y ^Le , q = 1,2,
H = hd / (d-Δ _q X), d is the distance between the pupils of the eyes, h is the distance from the eyes to the image ^C PI ^A.

Images