KR0159406B1 - Apparatus for processing the stereo scopics using the line of vision - Google Patents

Abstract

The present invention relates to a stereoscopic image processing apparatus using a gaze direction, wherein a gaze direction of a user is tracked by a gaze tracking unit, and an image signal of an object stored in a memory is differentially rendered by a renderer according to its position information. The image signal is processed by the first post-processing unit as the image signal for the left time and the second post-processing unit as the image signal for the right time, and then displayed by the display device. Therefore, there is an effect that the stereoscopic image signal can be processed at high speed.

Description

Stereoscopic image processing device using gaze direction

1 is a schematic block diagram of a stereoscopic image processing apparatus using a gaze direction according to a preferred embodiment of the present invention.

2 is a view for explaining a method for tracking the eye of a human in the eye tracking unit configured in FIG.

3 is a view for explaining the sorting of objects in the sorting unit configured in FIG.

* Explanation of symbols for main parts of the drawings

110: eye tracking unit 120: selection unit

130: memory 140: render unit

150: first post-processing unit 160: second post-processing unit

The present invention relates to a stereoscopic image processing apparatus, and more particularly, to a stereoscopic image processing apparatus using a gaze direction capable of automatically rendering an image signal by tracking a gaze direction of a user.

Here, rendering refers to generating colors and shades of an image signal for water.

Recently, hardware for processing image signals has been rapidly developed to enable real-time processing of stereoscopic image signals, and in various fields such as molecular structure modeling, photogrammetry, simulation flight devices, CAD, multi-dimensional data visualization and virtual reality systems, and stereoscopic games. The present invention is substantially related to processing into a stereoscopic video signal such as a virtual reality system or a stereoscopic game as described above.

On the other hand, the characteristics of the human gaze are characterized in detail when the object is located in the center of the gaze, and blurry as the object moves away from the center of the gaze.

However, in a conventional virtual reality system or a stereoscopic game, a method of rendering a video signal not only decreases the overall resolution of the video by rendering the video signal in the same way regardless of the direction of the user's line of sight, and thus results in image processing. There is a problem that the time is delayed.

Accordingly, an object of the present invention is to provide a three-dimensional image processing apparatus using a gaze direction that can track the gaze direction of a user and render it according to the position of the gaze. There is this.

In order to achieve such an object, the present invention is provided with.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

FIG. 1 is a schematic block diagram of a stereoscopic image processing apparatus using a gaze direction according to a preferred embodiment of the present invention. As can be seen from the same view, the stereoscopic image processing apparatus using the gaze direction of the present invention is eye tracking. The unit 110, the selection unit 120, the memory 130, the renderer 140, the first post-processing unit 150, and the second post-processing unit 160 are configured.

In the drawing, the eye tracking unit 110 tracks the direction of the user's eye and provides the position information to the selection unit 120, and the selection unit 120 is based on the position information from the eye tracking unit 110. The objects are selected by the first predetermined distance, the second predetermined distance, and the third predetermined distance respectively set from the center of the position.

The memory 130 stores image signals of objects, and the renderer 140 is stored in the memory 130 for each of the first predetermined distance, the second predetermined distance, and the third predetermined distance set by the selector 120. Render video signals of objects.

In addition, the first post-processing unit 150 processes the image signal rendered by the renderer 140 to the image signal for the left time and then provides the image signal to the display device, and the second post-processing unit 160 renders the renderer 140. Processes the rendered image signal into an image signal for the right view and then provides it to the display device.

An operation process of the stereoscopic image processing apparatus using the eyeline direction of the present invention configured as described above will be described in more detail with reference to FIGS. 1, 2, and 3.

First, a method of tracking the gaze direction of the user by the gaze tracking unit 110 will be described with reference to FIG. 2.

Human eyes, or eyes, are selected as a surplus (A) and a white (B), and when the eye irradiates an optical signal, the surplus absorbs the optical signal, and the white has the property of reflecting the optical signal. Therefore, the reflection amount C of the optical signal is small where the surplus is located, and the reflection amount C of the optical signal is large where the white is located.

In FIG. 2, L1 is a range of light signals reflected from the left white of the user's eye, L2 is a range of light signals reflected from the black of the user's eyes, and L3 is a range of light signals reflected from the right white of the user's eyes. Indicates.

It will be readily apparent to those skilled in the art that the apparatus for measuring the range of optical signals reflected by the white and black eyeballs can be implemented using a general optical machine.

Here, as shown in (a) of FIG. 2, when the user's gaze is centered, the range L1 of the light signal reflected from the left white of the user's eyeball and the range L3 of the light signal reflected from the right white are In the same case, the gaze tracking unit 110 provides the selection unit 120 with location information indicating that the gaze of the user is centered.

On the other hand, the selection unit 120 is a first predetermined distance (b in FIG. 3) set from the center of the user's line of sight (a in FIG. 3) as shown in FIG. 3 from the image signal stored in the memory 130, the second Objects existing at a predetermined distance (C in FIG. 3) and a third predetermined distance (D in FIG. 3) are selected and applied to the renderer 140. The renderer 140 renders an image signal of an object stored in the memory 130 based on the selection from the selector 120.

In more detail, the renderer 140 may store an object present at a first predetermined distance (b in FIG. 3) from the center of the user's eye (a in FIG. 3) of the image signal of the object stored in the memory 130. An object that is rendered with less detail than an object existing in the center of the user's line of sight, and an object existing between the second predetermined distance (C in FIG. 3) and the third predetermined distance (D in FIG. 3) is the first predetermined distance (3 Less detail is rendered as compared to the object present between b) of FIG. 2 and the second predetermined distance (c of FIG. 3).

As shown in (b) of FIG. 2, when the user's gaze is on the left side, the range L1 of the light signal reflected from the left white of the user's eyeball is smaller than the range L3 of the light signal reflected from the right white. The eye gaze tracking unit 110 provides the selection unit 120 with positional information indicating that the gaze of the user is left.

Thus, as shown in FIG. 3, the first predetermined distance (b in FIG. 3), the second predetermined distance (a in FIG. 3), and the third predetermined distance (set from the left center of the user's eye (a in FIG. 3)) The object present in FIG. 3D) is sorted by the sorting unit 120, and the renderer 140 renders an image signal of the object stored in the memory 130 based on the sorting from the sorting unit 120. do.

In more detail, the renderer 140 may have an object present at a first predetermined distance (b in FIG. 3) from the left center of the user's line of sight (FIG. 3 in FIG. 3) of the image signal of the object stored in the memory 130. Is rendered in less detail than the object existing in the left center of the user's line of sight, and the object present between the second predetermined distance (C in FIG. 3) and the third predetermined distance (D in FIG. 3) is the first predetermined distance ( Less detail is rendered as compared to objects present between b) of FIG. 3 and the second predetermined distance (c of FIG. 3).

As shown in (c) of FIG. 2, when the user's gaze is on the right side, the range L1 of the light signal reflected from the left white of the user's eyeball is larger than the range L3 of the light signal reflected from the right white. The eye gaze tracking unit 110 provides the selection unit 120 with location information indicating that the user's gaze is right.

Accordingly, as shown in FIG. 3, the first predetermined distance (b in FIG. 3), the second predetermined distance (b in FIG. 3), and the third predetermined distance (set from the right-center (a in FIG. 3) of the user's gaze) The object present in FIG. 3D) is sorted by the sorting unit 120, and the renderer 140 renders an image signal of the object stored in the memory 130 based on the sorting from the sorting unit 120. do.

In more detail, the renderer 140 may have an object present at a first predetermined distance (b in FIG. 3) from the right center of the user's line of sight (a in FIG. 3) in an image signal of an object stored in the memory 130. Is rendered in less detail than the object present in the right center of the user's line of sight, and the object present between the second predetermined distance (C in FIG. 3) and the third predetermined distance (D in FIG. Less detail is rendered as compared to the object existing between b) of FIG. 3) and the second predetermined distance (c of FIG. 3).

Next, the image signal rendered by the renderer 140 is processed by the first post-processing unit 150 into an image signal for the left eye of the user, and then displayed on the display device, and the image rendered by the renderer 140. The signal is processed by the second post-processing unit 160 into an image signal of a right time of the user and then displayed on the display device.

As described above, the user's gaze direction is tracked by the gaze tracking unit 110 and the image signal of the object stored in the memory 130 according to the position information is rendered by the renderer 140 differentially. The first post-processing unit 150 is processed as an image signal for the left time and the second post-processing unit 160 is processed as an image signal for the right time and then displayed on the display device.

Therefore, according to the present invention, since the video signal is differentially processed according to the direction of the user's line of sight, the stereoscopic video signal can be processed at high speed.

Claims (1)

A stereoscopic image processing apparatus comprising: a gaze tracking means (110) for tracking a gaze direction of a user and outputting position information thereof; A memory 130 for storing predetermined image signals; Selection means 120 for selecting an image of the objects that are separated by a predetermined distance from a predetermined object image of the image signal of the memory 130 corresponding to the direction of the user's line of sight based on the position information from the gaze tracking means 110 ; Rendering means (140) for differentially rendering an image signal of an object stored in the memory (130) based on the information selected by the sorting means (120); First post-processing means (150) for image-processing the image signal rendered by the rendering means (140) into an image signal for the left eye of the user and displaying the image signal on a display device; Stereoscopic image processing using the gaze direction, comprising a second post-processing means 160 for processing the image signal rendered by the renderer 140 into an image signal for the right eye of the user and displaying the image signal on the display device. Device.