Display method and system based on VR device
Technical Field
The embodiment of the invention relates to the technical field of display, in particular to a display method and a display system based on a VR device.
Background
The VR (Virtual Reality) technology is a computer simulation system capable of creating and experiencing a Virtual world, a simulation environment is generated by a computer, and the VR technology is an interactive three-dimensional dynamic view and entity behavior simulation system with multi-source information fusion, and aims to immerse a user into the three-dimensional dynamic view through the simulation system so as to achieve the effect of being personally on the scene.
With successive interviews of VR products such as Oculus, VIVE, etc., the VR industry is gradually coming into the eye of people. However, the prior VR products all objectively have a more obvious technical defect of strong dizzy feeling. Many VR experiences or users experience dizziness, nausea, and even vomiting after use, especially after a period of sustained use. The technical defect becomes a barrier for VR technology development, and solving the dizzy problem becomes the urgent need of VR.
There are many reasons for the users ' dazzling caused by VR products, among which there is a main reason delay display, that is, when the users rotate or move the viewing angle, the switching speed of the VR display image is not synchronous with the user's motion, or the user's motion amplitude is small, the VR display image is not updated and displayed in time, and other asynchronous reasons, which causes the user's expected image and the VR display image to be inconsistent, and further the user is easy to generate a mobility or position illusion to the space positioning obstacle, and further generate the bad reaction such as dizzy and even vomiting, specifically, the user uses the position of his own eyes as the static reference position, and the VR display image is in a shaking state relative to the user's eyes, and the shaking state is severe along with the time, and at this time, the user has positioning obstacle to the image information (or called space information) displayed by the VR, the VR display picture cannot be accurately positioned, and the user is easy to generate position illusion.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a display method and a display system based on a VR device. Aiming at reducing VR display delay, improving the anti-shake effect of VR display and avoiding dizzy feeling.
In one aspect, the present invention provides a display method based on a VR device, including:
when the VR device works in a normal mode state, a first preset area in a display unit works in a display state;
acquiring an eye image in real time, and calculating to form sight focus and eyeball depth of field data based on an eyeball tracking technology;
acquiring collected data of head movement, calculating to form compensation data according to the collected data and the depth of field data, and storing the compensation data;
and forming a first display area according to the compensation data and the first preset area, so that the relative displacement between the first display area and the first preset area is matched with the compensation data.
Preferably, in the VR device-based display method, when the VR device is operated in a normal mode, the first predetermined area in the display unit is operated in a display state, and the method further includes:
reading the compensation data saved by the user last time;
reading an original field angle and a hidden proportion according to the compensation data stored last time;
and calculating to form the first preset area according to the original field angle and the hiding ratio.
Preferably, in the VR device-based display method, before the VR device operates in the normal mode, the method further includes:
forming an original field angle and a hidden proportion according to the external operation setting of a user;
and forming the first preset area according to the original field angle and the hiding ratio.
Preferably, in the display method based on the VR device, the acquired data is acquired, and a compensation data is calculated according to the acquired data; wherein the compensation data comprises a loss field angle, a compensation distance:
the method for calculating the loss angle of view comprises the following steps:
wherein A is the loss field angle;
α is the original field of view;
k% is the hiding ratio;
the calculation method of the compensation distance comprises the following steps:
M=tan(Δβ)*L
wherein L is the depth data;
Δ β is the acquisition data.
Preferably, in the display method based on the VR device, acquired data of head movement is acquired, compensation data is calculated according to the acquired data and the depth data, and the compensation data is stored; specifically, the method comprises the following steps of,
acquiring collected data of head movement;
judging whether the acquired data is matched with a preset standard threshold value;
and under the condition that the acquired data do not match a preset standard threshold, calculating to form compensation data according to the acquired data and the depth of field data, and storing the compensation data.
The present invention further provides a display system based on a VR device, comprising:
the control unit is used for enabling a first preset area in the display unit to work in a display state when the VR device works in a normal mode state;
the first acquisition unit acquires an eye image in real time and calculates and forms sight focus and eyeball depth of field data based on an eyeball tracking technology;
the second acquisition unit is used for acquiring an acquisition signal of head movement and forming acquisition data according to the acquisition signal;
the computing unit is used for acquiring the collected data of the head movement, computing to form compensation data according to the collected data and the depth of field data, and storing the compensation data;
and the adjusting unit is used for forming a first display area by combining the first preset area according to the compensation data so as to enable the relative displacement between the first display area and the first preset area to be matched with the compensation data.
Preferably, the VR device-based display system further includes:
the reading device is used for reading the compensation data in the last use state of the user;
the first calculation device forms an original field angle and a hidden proportion according to the compensation data in the last use state; and calculating to form the first preset area according to the original field angle and the hiding ratio.
Preferably, the VR device-based display system further includes:
the input device forms an original field angle and a hidden proportion according to the external operation setting of a user;
and the second calculation device forms the first preset area according to the original field angle and the hiding ratio.
Preferably, the VR device based display system as described above, wherein the compensation data includes a lost field of view, a compensation distance,
the method for calculating the loss angle of view comprises the following steps:
wherein A is the loss field angle;
α is the original field of view;
k% is the hiding ratio;
the calculation method of the compensation distance comprises the following steps:
M=tan(Δβ)*L
wherein L is the depth data;
Δ β is the acquisition data.
Preferably, the VR device based display system as described above, wherein the computing unit; specifically, the method comprises the following steps of,
the acquisition device acquires the acquired data of the head movement;
a judging device for judging whether the collected data is matched with a preset standard threshold value,
and the third calculating device is used for calculating to form compensation data according to the acquired data and the depth of field data under the condition that the acquired data are not matched with a preset standard threshold value, and storing the compensation data.
Compared with the prior art, the invention has the advantages that:
in the invention, a compensation area is preset, a display unit of the compensation area only displays a first preset area, a displayable area outside the first preset area is hidden, the hidden area is matched with a compensation area of slight movement of a user, when the head movement state of the user changes, the current display area of the VR device is adjusted from the first preset area to the first display area, and the displacement from the first preset area to the first display area is matched with the head movement of the user. In the invention, the VR device reserves a compensation area, when the head movement is sent by a user, the current first preset display area is switched to the first display area matched with the head movement by using the compensation area, the display of the whole screen does not need to be switched, only the current display area is switched, the VR display delay is reduced, the anti-shake effect of VR display is improved, and the dizzy feeling is avoided.
Drawings
FIG. 1 is a schematic flow chart of a VR device based display method according to the present invention;
FIG. 2 is a schematic structural diagram of a display method according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of a VR device based display method according to the present invention;
FIG. 4 is a schematic flow chart of a display method based on a VR device according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
In the prior art, the reason for delayed display of VR devices generally includes two aspects, one is the acquisition accuracy of an acquisition unit, the acquisition accuracy is generally caused by the technology of the acquisition unit itself, which can be overcome by generally improving the sensitivity of the acquisition unit and increasing multi-channel acquisition data, in short, the display delay caused by hardware devices is insurmountable, and the other is the delay caused by picture switching itself, the existing VR devices generally display picture information in a full-screen playing mode, and further generally need full-screen switching in the picture switching process, the delay caused by picture switching is called as inherent delay in the prior art. Aiming at the inherent delay, the invention provides a display method and a display system based on a VR device, aiming at reducing the inherent delay (which is equivalent to reducing the display delay) caused by the switching of pictures, improving the anti-shake effect of VR display and avoiding the dizzy feeling.
The first embodiment,
As shown in fig. 1, the present invention provides a display method based on a VR device, which includes:
step S110, when the VR device works in a normal mode state, a first preset area in a display unit works in a display state; further, the first predetermined area may be formed according to a user operation, and specifically, prior to performing step S110,
step S1091, forming an original field angle and a hidden proportion according to the external operation setting of a user;
step S1092, forming the first predetermined area according to the original angle of view and the hiding ratio.
Step S120, acquiring an eye image in real time, and calculating to form sight focus and eyeball depth of field data based on an eyeball tracking technology;
step S130, acquiring collected data of head movement, calculating to form compensation data according to the collected data and the depth of field data, and storing the compensation data; the acquisition unit can be one of a motion sensing sensor, a gravity sensor or a gyroscope. The acquisition unit is intended to acquire the head movements of the user. Further wherein the compensation data includes a loss field angle, a compensation distance:
the method for calculating the loss angle of view comprises the following steps:
wherein A is the loss field angle;
α is the original field of view;
k% is the hiding ratio;
the calculation method of the compensation distance comprises the following steps:
M=tan(Δβ)*L
wherein L is the depth data;
Δ β is the acquisition data.
Step S140, forming a first display area according to the compensation data and the first predetermined area, so that the relative displacement between the first display area and the first predetermined area matches the compensation data.
The working principle of the invention is as follows: when the VR device is started and in a working state, the display unit only displays the first preset area, but hides the displayable area outside the first preset area, and in the normal use process, the eye image is acquired in real time, and the sight focus and the depth of field data of the eyeball are calculated and formed on the basis of the eyeball tracking technology; when the head of the user moves, the acquisition unit acquires the head movement state of the user and forms acquisition data, calculates and forms compensation data according to the acquisition data and the depth of field data, and stores the compensation data; continuing, forming a first display area according to the compensation data and the first preset area, so that the relative displacement between the first display area and the first preset area is matched with the compensation data.
In the invention, the display unit only displays a first preset area, a compensation area is reserved, the compensation area is a displayable area except the first preset area, the working state of the compensation area is controlled by compensation data, the compensation area is matched with slight movement of a user, when the head movement state of the user changes, the compensation data controls the working state of the compensation area, so that the current display area of the VR device is adjusted from the first preset area to the first display area, and the relative displacement between the first display area and the first preset area is matched with the head movement of the user (because the compensation data is matched with the head movement of the user). According to the invention, the VR device does not display in a full screen mode, the VR device reserves a compensation area, when a user sends head movement, the current first preset display area is switched to the first display area matched with the head movement by using the compensation area, the display of the whole screen does not need to be switched, only the current display area is switched, the VR display delay is reduced, the anti-shake effect of VR display is improved, and the dizzy feeling is avoided.
It should be noted that:
the VR device comprises a plurality of first preset areas for a user to select, the first preset areas belong to a continuous display area in a display unit of the VR device, the larger the area of the first preset areas is, the smaller the area of a compensation area in the display unit is, the smaller the area of the compensation area is, the smaller the angle of field loss of the user is, and the smaller the anti-shake effect is, otherwise, the better the anti-shake effect is.
One embodiment is illustrated:
as shown in fig. 2, the first predetermined area 2 is a portion of the display unit 1, the area outside the first predetermined area 2 is in a non-displayable state, when the head of the user moves in the left-up direction, compensation data is formed according to the data acquired by the acquisition unit, a first display area 3 is formed according to the compensation data and the first predetermined area, the first display area 3 is also a portion of the display unit 1, meanwhile, the first display area 3 is located at the left-up side of the first predetermined area 2, and the displacement change (i.e., the direction indicated by the arrow in fig. 2) of the first display area 3 relative to the first predetermined area 2 matches the head movement of the user.
Example two
In the above embodiment, the first predetermined area is formed according to the operation of the user, that is, the user needs to set the first predetermined area first when using the VR device each time, so as to improve the operation complexity of using the VR device.
As shown in fig. 3, a display method based on a VR device includes, among others,
step S2091, reading the compensation data saved by the user last time;
step S2092, reading an original field angle and a hidden ratio according to the compensation data stored last time;
step S2093, calculating and forming the first predetermined area according to the original field angle and the hidden ratio.
Step S210, when the VR device works in a normal mode state, a first preset area in a display unit works in a display state;
s220, acquiring an eye image in real time, and calculating to form sight focus and eyeball depth of field data based on an eyeball tracking technology;
step S230, acquiring collected data of head movement, calculating to form compensation data according to the collected data and the depth of field data, and storing the compensation data;
step S240, forming a first display area according to the compensation data and the first predetermined area, so that the relative displacement between the first display area and the first predetermined area matches the compensation data.
In an embodiment, an original angle of view and a hiding ratio are formed according to the lost angle of view in the last use state, and the first predetermined area is formed according to the original angle of view and the hiding ratio. The first predetermined display area can be formed without separate setting by a user, greatly reducing the use complexity of the VR device.
Example III,
In the first and second embodiments, the display unit switches the display area when the user moves his head, but when the user is in a relatively unstable state, for example, when the user is in a vehicle, the head cannot be in a stable state, i.e., the head continues to move, the display unit needs to frequently switch the display area, and such frequent switching is also likely to cause dizziness.
As shown in fig. 4, a display method based on a VR device includes, among others,
step S310, when the VR device works in a normal mode, a first predetermined area in a display unit works in a display state,
step S320, acquiring an eye image in real time, and calculating to form sight focus and eyeball depth of field data based on an eyeball tracking technology;
step S330, acquiring collected data of head movement, calculating to form compensation data according to the collected data and the depth of field data, and storing the compensation data; further, the method comprises the steps of,
step S3301, acquiring data of head movement,
step S3302, judge whether the said collected data match the preset standard threshold,
and S3303, in a state that the collected data does not match a preset standard threshold, calculating to form compensation data according to the collected data and the depth of field data, and storing the compensation data.
Step S340, forming a first display area according to the compensation data and the first predetermined area, so that the relative displacement between the first display area and the first predetermined area matches the compensation data.
Setting a standard threshold value, wherein the standard threshold value is matched with the relative motion in the current environment, such as the fluctuation degree of public traffic, and the like, judging whether the acquired data is matched with a preset standard threshold value, if the acquired data is matched with the preset standard threshold value, the display unit is not switched, and if the acquired data is not matched with the preset standard threshold value, calculating to form compensation data according to the acquired data. Reduce the frequency of display area switching caused by environment, and further improve the anti-shake effect of VR set in unstable environment
Example four
In another aspect, the present invention further provides a display system based on a VR device, comprising:
the control unit is used for enabling a first preset area in the display unit to work in a display state when the VR device works in a normal mode state;
the first acquisition unit acquires an eye image in real time and calculates and forms sight focus and eyeball depth of field data based on an eyeball tracking technology;
the second acquisition unit is used for acquiring an acquisition signal of head movement and forming acquisition data according to the acquisition signal;
the computing unit is used for acquiring the collected data of the head movement, computing to form compensation data according to the collected data and the depth of field data, and storing the compensation data;
and the adjusting unit is used for forming a first display area by combining the first preset area according to the compensation data so as to enable the relative displacement between the first display area and the first preset area to be matched with the compensation data.
As a further preferred embodiment, the VR device based display system further includes:
the reading device is used for reading the compensation data in the last use state of the user;
the first calculation device forms an original field angle and a hidden proportion according to the compensation data in the last use state; and calculating to form the first preset area according to the original field angle and the hiding ratio, and storing the compensation data.
As a further preferred embodiment, the VR device based display system further includes:
the input device forms an original field angle and a hidden proportion according to the external operation setting of a user;
and the second calculation device forms the first preset area according to the original field angle and the hiding ratio.
As a further preferred embodiment, the VR device based display system as described above, wherein the compensation data includes a lost field of view angle, a compensation distance,
the method for calculating the loss angle of view comprises the following steps:
wherein,
a is the lost field angle;
alpha is the original field angle;
k% is the hiding ratio;
the calculation method of the compensation distance comprises the following steps:
wherein L' is the length of the display area of the first predetermined area;
beta is the display visual angle of the first preset area;
Δ β is the acquisition data.
As a further preferred embodiment, the VR device based display system as described above, wherein the computing unit; specifically, the method comprises the following steps of,
a judging device for judging whether the collected data is matched with a preset standard threshold value,
and the third calculating device is used for calculating to form compensation data according to the acquired data and the depth of field data under the condition that the acquired data are not matched with a preset standard threshold value, and storing the compensation data.
The product can execute the method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. Therefore, the working principle of the display system is not described herein.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.