RU2592458C2 - Method for generating augmented reality images ensuring correct perception of virtual objects removal - Google Patents

Abstract

FIELD: computer engineering.

SUBSTANCE: invention relates to computer engineering. Method for generating augmented reality images ensuring correct perception of virtual objects removal, using an augmented reality system, wherein a helmet of virtual reality with a sensor of local positioning subsystem is used during generating augmented reality images; adaptation unit obtains data on current time from the control computer, and from the local positioning subsystem and data on an observer position and its sight direction from the satellite positioning system, generates virtual object shadow parameters, which shell be visible for the observer in current place and time circumstances; analyses brightness, colour gamma and definition of corresponding picture fragments recieved from a video camera via obtaining from the control computer image position data of virtual objects relative to picture recieved from the video camera and generates adapted parameters for virtual objects, which are transmitted to the control computer for generating stereo image of virtual objects.

EFFECT: technical result is eliminating effect of incorrect evaluation of distance to the virtual objects, which are located at considerable distance from the observer.

1 cl, 1 dwg

Description

The invention relates to augmented reality technologies that allow combining the real world and virtual objects created by a computer in one space.

The level of technology.

Augmented reality systems are known where a stereo picture of the real world is formed using two video cameras placed in front of the user's eyes. An example is a system using a WorldViz VideiVision device http://www.worldviz.corn/products/augmented-reality/videovision. In this case, stereopairs of virtual objects are formed by the control computer and superimposed in accordance with the data of the positioning subsystem on video streams from video cameras with subsequent reproduction of the obtained stereoscopic augmented reality image on the microdisplays of the virtual reality helmet.

Moreover, in the case of reproduction of virtual objects located far enough from the observer, the problem of incorrect perception of the removal of virtual objects arises. Since the elements of the virtual picture look noticeably sharper and brighter than those observed at a great distance of the elements of the real world due to the observation of the latter through the air layer and due to distortions introduced by the optics of the cameras, virtual objects are perceived by the person as being closer than they actually are. This effect is not manifested for virtual objects located close to the observer, since the distance to the virtual object corresponds to the distance that the observer understands according to the external signs of the images of virtual objects - brightness, color gamut, clarity, distinctness of the shadow, which the observer's brain correlates with signs of an image of the real world.

The technical task of the invention is the creation of a method of forming an augmented reality image using video cameras providing the correct perception of the removal of virtual objects.

Disclosure of invention

The technical result of the invention consists in eliminating the effect of an incorrect estimate of the distance to virtual objects that are located at a considerable distance from the observer in an augmented reality picture formed by a system using video cameras to reproduce the real world.

The indicated technical result is achieved by the fact that the adaptation of the nature of the reproduction of virtual objects to the nature of the reproduction of the visible real world is introduced into the augmented reality system, where the picture of the real world is formed using cameras placed in front of the user's eyes.

The functions of the block are:

1) analysis of the current brightness and color gamut of fragments of real-world pictures obtained from video cameras, on which images of virtual objects are supposed to be superimposed;

2) registration of the current time received from the computer system manager;

3) recording the current direction of observation obtained from the positioning subsystem of the augmented reality system;

4) the formation of image parameters of virtual objects adapted to the parameters of fragments of a video picture of the real world on which it is supposed to superimpose images of virtual objects, including a) brightness, b) depending on the lighting conditions of the color gamut, c) clarity, d) the direction and size of the shadows .

The control computer receives adapted image parameters of virtual objects from the adaptation unit and uses them to form these images. As a result, the effect of incorrect assessment of the removal of virtual objects is eliminated.

A brief description of the illustrations.

FIG. 1 - technical implementation of the method of imaging augmented reality, providing the correct perception of the removal of virtual objects.

The implementation of the invention.

Implementation of the proposed method of imaging augmented reality, providing the correct perception of the removal of virtual objects is as follows.

The method involves the use of a system (see Fig. 1), which includes a virtual reality helmet equipped with two microdisplays and two video cameras, a local positioning subsystem containing means for determining three linear and three angular coordinates of the position of the virtual reality helmet in space and a receiver of the global satellite navigation system , a control computer that generates a pair of stereo images for microdisplays of a virtual reality helmet, and the sensor of the local positioning subsystem The company is placed on a virtual reality helmet and a unit for adapting the nature of reproduction of virtual objects to the nature of reproduction of the visible real world. The inputs of the adaptation unit are connected to the control computer, to the local positioning subsystem, to the satellite navigation system and to the video stream coming from any of the cameras. Receiving data about the current time from the control computer, and from the local positioning subsystem and the satellite positioning system, data on the position of the observer and the direction of his gaze, the adaptation unit produces the shadow parameters of the virtual object that the observer should see in the current circumstances of the place and time. Receiving data from the control computer on the position of the image of virtual objects relative to the image from the video camera, on which the image of virtual objects is superimposed, the adaptation unit analyzes the brightness, color gamut and clarity of the corresponding fragments of the image from the video camera and generates adapted parameters for virtual objects. The parameters developed by the adaptation unit are transferred to the control computer for imaging virtual objects.

The adaptation unit is implemented as a separate computing device containing its own processor for generating adapted parameters of virtual objects. As a subsystem of local positioning, a satellite navigation system and a virtual reality helmet, you can use commercially available products, for example Polhemus G4, GlobalSat BU-353, Sony HMZ.

Claims (1)

A method of forming an augmented reality image that provides a correct perception of the removal of virtual objects, including a local positioning subsystem, a global satellite navigation receiver, a control computer that generates a pair of stereo images, characterized in that when creating an augmented reality image, a virtual reality helmet is used, equipped with two microdisplays and two video cameras, and the sensor of the local positioning subsystem is placed on the helmet virtual reality, the adaptation block of the nature of the reproduction of virtual objects to the nature of the reproduction of the visible real world, the inputs of the adaptation block are connected to the control computer, to the local positioning subsystem and the satellite navigation system, to the video stream coming from any of the cameras, while the adaptation block is received from the control computer data about the current time, and from the local positioning subsystem and satellite positioning system data about the position of the observer and the direction of his gaze, develops the parameters of the shadow of the virtual object, which the observer should see in the current circumstances of the place and time; receiving data from the control computer on the position of the image of virtual objects relative to the picture from the video camera, on which the image of virtual objects is superimposed, analyzes the brightness, color gamut and clarity of the corresponding fragments of the picture from the video camera and generates adapted parameters for virtual objects, and the parameters generated by the adaptation unit are transmitted to the control computer for forming a stereo image of virtual objects displayed on the microdisplays of a virtual reality helmet nosti.

Images