CN115561903A

CN115561903A - VR glasses and control method thereof

Info

Publication number: CN115561903A
Application number: CN202211171172.6A
Authority: CN
Inventors: 李源财; 全丽伟; 鲍昭汉; 王浩; 李守林; 肖明志; 邱盛平; 龚俊强
Original assignee: Union Optech Co Ltd
Current assignee: Union Optech Co Ltd
Priority date: 2022-09-23
Filing date: 2022-09-23
Publication date: 2023-01-03

Abstract

The invention discloses VR (virtual reality) glasses and a control method of the VR glasses, wherein the VR glasses comprise a shell, a display screen, a lens structure and a position measuring device, wherein the lens structure is arranged on the shell and is used for being arranged on one side, close to an eye pupil, of the display screen; the position measuring device is arranged on a light path which takes an eye pupil as a luminous object and is used for measuring the position of the eye pupil, and the position measuring device is electrically connected with the display screen. According to the technical scheme provided by the invention, the position of the eye pupil is measured by the position measuring device, so that the display screen can adjust the display adjusting parameters according to the position of the eye pupil, the work of the display screen is controlled, and the VR glasses capable of adjusting the display picture according to the position of the eye pupil are provided.

Description

VR glasses and control method thereof

Technical Field

The invention relates to the technical field of optics, in particular to VR glasses and a control method of the VR glasses.

Background

Because the VR glasses display the picture mainly through two convex lenses arranged inside. Because there is only one screen, the images seen by the left and right eyes must be separated independently to achieve stereoscopic vision. The 3D glasses can simulate real conditions through an electronic system, so that pictures of the left eye and the right eye are continuously and alternately displayed on a screen, and the physiological characteristics of the persistence of human vision are added, so that the stereoscopic 3D images can be seen.

Disclosure of Invention

Because the image is a scene simulated by the electronic system, the displayed picture effect and the displayed information of the VR glasses are closely related to the attention points of the eyes of the user.

The invention mainly aims to provide VR glasses and a control method of the VR glasses, and aims to provide VR glasses capable of adjusting a display picture according to the position of an eye pupil.

In order to achieve the above object, the present invention provides VR glasses, wherein the VR glasses include:

a housing;

a display screen;

the lens structure is arranged on the shell and is used for being arranged on one side, close to the eye pupil, of the display screen; and the number of the first and second groups,

and the position measuring device is positioned on a light path which takes the eye pupil as a luminous object and is used for measuring the position of the eye pupil, and the position measuring device is electrically connected with the display screen.

Optionally, the position determination device comprises an image acquisition device for acquiring a light image of the object illuminated by the eye pupil.

Optionally, the lens structure has an object side and an eye point side oppositely arranged along an extension direction of an optical axis, and the lens structure comprises at least one lens on the optical axis;

the surface shape of any one of the lenses satisfies formula I:

wherein c is the curvature corresponding to the radius, y is the radial coordinate, k is the conic coefficient ₁ To a ₈ The coefficients are respectively corresponding to the radial coordinates.

Optionally, the lens structure includes a first lens, and a semi-reflecting and semi-permeable film is plated on an end surface of the first lens close to the object side;

the position measuring device is arranged on the eyepoint side of the lens structure.

Optionally, the lens structure further comprises a second lens on the optical axis, the second lens being disposed on the eyepoint side of the first lens;

the position measuring device is provided on the eyepoint side of the second lens.

Optionally, the lens structure further includes a third lens on the optical axis, the third lens being disposed between the first lens and the second lens.

Optionally, the first lens is a meniscus lens, and the concave surface of the first lens is arranged towards the eyepoint side;

the second lens is an aspheric lens;

the third lens is a meniscus aspheric lens, and the concave surface of the third lens faces the eye point side.

The invention also provides a control method of VR glasses, which comprises the following steps:

a housing;

a display screen;

the position measuring device is positioned on an optical path which takes an eye pupil as a luminous object and is used for measuring the position of the eye pupil, and the position measuring device is electrically connected with the display screen;

the control method of the VR glasses comprises the following steps:

acquiring a position parameter of an eye pupil;

determining a functional area position parameter of the display screen according to the position parameter;

determining display adjustment parameters according to the functional area position parameters;

and controlling the display screen to work according to the display adjusting parameters.

Optionally, the position determination device comprises an image acquisition device for acquiring a light image with an eye pupil as a light-emitting object;

the step of acquiring the position parameters of the eye pupil comprises the following steps:

acquiring a light ray image of light rays reflected by an eye pupil after the light rays are reflected by the lens structure;

and determining the position parameters of the eye pupil according to the light image.

Optionally, the display adjustment parameter includes at least one of a display definition, a displacement direction of a display screen picture, and a display picture content.

In the technical scheme provided by the invention, a lens structure and a position measuring device are arranged in a shell, the position of an eye pupil is detected by the position measuring device, the eye pupil can reflect light rays projected into the eye pupil, the position measuring device takes the eye pupil as a luminous object and is positioned on a light path taking the eye pupil as the luminous object, when the eye pupil watches the display screen to move, the position and the angle of the light rays reflected by the eye pupil are changed, and the position of the eye pupil is measured by the position measuring device, so that the display screen can adjust display adjusting parameters according to the position of the eye pupil, the work of the display screen is controlled, and the VR glasses capable of adjusting a display picture according to the position of the eye pupil are provided.

Drawings

In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the embodiments or technical solutions of the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.

Fig. 1 is a partial schematic view of VR glasses according to an embodiment of the present invention;

fig. 2 is a partial schematic view of another embodiment of VR glasses provided by the present invention;

FIG. 3 is a partial schematic view of a VR glasses in accordance with another embodiment of the present invention;

fig. 4 is a flowchart illustrating a control method for VR glasses according to a first embodiment of the present invention.

The reference numbers illustrate:

the implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that, if directional indications (such as up, down, left, right, front, back, 8230; etc.) are involved in the embodiment of the present invention, the directional indications are only used for explaining the relative positional relationship between the components, the motion situation, etc. in a specific posture (as shown in the figure), and if the specific posture is changed, the directional indications are correspondingly changed.

In addition, if there is a description of "first", "second", etc. in an embodiment of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, the meaning of "and/or" appearing throughout includes three juxtapositions, exemplified by "A and/or B", including either A or B or both A and B. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.

Because the VR glasses display the picture mainly through two convex lenses arranged inside. Because there is only one screen, the images seen by the left and right eyes must be separated independently to achieve stereoscopic vision. The 3D glasses can simulate the real situation through an electronic system, so that the pictures of the left eye and the pictures of the right eye are continuously and alternately displayed on the screen, and the physiological characteristic of the visual persistence of human eyes is added, so that the stereoscopic 3D images can be seen. Because the image is a scene simulated by the electronic system, the displayed picture effect and the display information of the VR glasses are closely related to the attention points of the eyes of the user.

The invention provides VR glasses 100, and fig. 1 to 3 show specific embodiments of the VR glasses 100 provided by the invention.

Referring to fig. 1 to 3, the VR glasses 100 includes a housing (not shown), a display 1, a lens structure 2 and a position measuring device 3, wherein the lens structure 2 is disposed on the housing and is configured to be disposed on a side of the display 1 near an eye pupil; the position measuring device 3 is located on an optical path for taking an eye pupil as a luminous object and used for measuring the position of the eye pupil, and the position measuring device 3 is electrically connected with the display screen 1.

According to the technical scheme provided by the invention, the lens structure 2 and the position measuring device 3 are arranged in the shell, the position of the eye pupil is detected through the position measuring device 3, the eye pupil can reflect light projected into the eye pupil, the position measuring device 3 takes the eye pupil as a luminous object and is positioned on a light path taking the eye pupil as the luminous object, when the display screen 1 is watched through the eye pupil to move, the position and the angle of the light reflected by the eye pupil are changed, the position of the eye pupil is measured through the position measuring device 3, so that the display screen 1 can adjust the display adjusting parameters according to the position of the eye pupil, the display screen 1 is controlled to work, and the VR glasses 100 capable of adjusting the display picture according to the position of the eye pupil are provided.

It should be noted that, since the VR glasses 100 mainly rely on the electronic system to compose the screen of the display screen 1, it can be understood that the screen area directly corresponding to the eye pupil of the user is the focus of attention of the user, and therefore, the definition of the screen area can be adjusted according to the eye pupil position information of the user. When the user needs to adjust the direction of the image switching movement, the user does not need to rely on a handheld mouse to operate the direction of the image movement, the mouse is linked with the position coordinates of the eye pupil, and the electronic system can control the direction of the image movement of the display screen 1 through the displacement direction of the eye pupil. When the user watches the screen and the user is interested in the picture of some area on the picture, the time for the eye pupil to stay at the position is longer, the picture area on the display screen 1, which is interested by the user, can be calculated through the position information of the eye pupil, and the related picture, namely the picture which is interested by the user, can be automatically pushed according to the picture information of the area by collecting the picture information of the area.

Specifically, the position measuring device 3 may be a sensor, but considering the actual use scene of the user and the difference of the users, the position measuring device 3 is preferably an external device, and in this embodiment, the position measuring device 3 includes an image capturing device for capturing a light image with the eye pupil as the light emitting object. The image acquisition device can be a camera, the spatial coordinates of the eye pupil can be determined through continuous shooting of the camera, the position information of the eye pupil at a certain time point can be obtained, and the information of the change displacement of the eye pupil can be measured, so that the display screen 1 can be conveniently adjusted according to the spatial coordinates.

Further, the lens structure 2 has an object side and an eye point side oppositely arranged along the extension direction of the optical axis, and the lens structure 2 comprises at least one lens on the optical axis; the surface shape of any one of the lenses satisfies formula I:

wherein, the parameter c is the curvature corresponding to the radius, y is the radial coordinate (the unit is the same as the unit of the length of the lens), and k is the coefficient of the conic section. When the k coefficient is less than-1, the surface-shaped curve is a hyperbolic curve, is a parabola when the k coefficient is equal to-1, is an ellipse when the k coefficient is between-1 and 0, is a circle when the k coefficient is equal to 0, and is an oblate when the k coefficient is greater than 0.α 1 to α 8 respectively indicate coefficients corresponding to respective radial coordinates, and the shape and size of the lens can be accurately set by the above parameters.

In an embodiment, the position measuring device 3 is disposed on the object side of the lens structure 2, and the light emitted through the eye pupil is refracted by the lens structure 2 and then projected to the position measuring device 3 to measure the eye pupil position. However, due to the limitation of the space between the end surface of the lens structure 2 close to the object side and the display 1, the thickness of the VR glasses 100 is affected by the position measuring device 3.

Specifically, referring to fig. 3, the lens structure 2 includes a first lens 21, a semi-reflective and semi-transparent film is plated on an end surface (i.e., S1) of the first lens 21 near the object side, and the semi-reflective and semi-transparent film combines characteristics of transmissive and reflective lenses, so that light emitted from an eye pupil can be reflected to an eye point side through the semi-reflective and semi-transparent film, and the position measuring device 3 can be disposed on the eye point side of the lens structure 2 for convenience of measurement. With this arrangement, the position measuring device 3 can reduce the weight of the VR glasses 100 without increasing the thickness of the VR glasses 100.

In this embodiment, the basic parameter table of the S1 surface is shown in table 1, and the basic parameter table of the S2 surface is shown in table 2.

TABLE 1 S1 surface parameters

K	-1.45110144
		a1	0
a2	-1.69674E-07
		a3	-1.76687E-10
a4	8.67723E-13
		a5	4.41232E-15
a6	-9.50856E-18
		a7	3.88244E-21
a8	0

TABLE 2 S2 surface parameters

K	8.290102963
		a1	0
a2	-6.21109E-06
		a3	5.82729E-09
a4	1.98579E-13
		a5	-6.62747E-15
a6	4.45488E-18
		a7	-5.52109E-21
a8	0

Further, referring to fig. 2, in order to enhance the converging and diverging effects of the light emitted from the eye pupil, in this embodiment, the lens structure 2 further includes a second lens 22 located on the optical axis, and the second lens 22 is disposed between the first lens 21 and the position measuring device 3, so that the position measuring device 3 is located at the eye point side of the second lens 22, and the second lens 22 and the first lens 21 cooperate to converge the light emitted from the eye pupil, so that the position measuring device 3 can receive clearer light and position the eye pupil more accurately.

It should be noted that in this embodiment, the basic parameter table of the S3 surface is shown in table 3, and the basic parameter table of the S4 surface is shown in table 4.

TABLE 3 S3 surface parameters

K	0
		a1	0
a2	0
		a3	0
a4	0
		a5	0
a6	0
		a7	0
a8	0

TABLE 4 S4 surface parameters

Further, referring to fig. 1, in the present embodiment, the lens structure 2 further includes a third lens 23 located on the optical axis, and the third lens 23 is disposed between the first lens 21 and the second lens 22. In a similar manner, the third lens 23, the second lens 22 and the first lens 21 cooperate to converge the light emitted from the eye pupil, so that the position measuring device 3 can receive clearer light and position the eye pupil more accurately, and the three lenses can better eliminate distortion and astigmatism.

In this embodiment, the basic parameter table of the S5 surface is shown in table 5, and the basic parameter table of the S6 surface is shown in table 6.

TABLE 5 S5 surface parameters

K	-19.90326745
		a1	0
a2	-5.00601E-06
		a3	4.07281E-09
a4	-7.38046E-13
		a5	1.38994E-14
a6	1.44559E-18
		a7	9.69944E-21
a8	0

TABLE 6 S6 surface parameters

K	20.0000023
		a1	0
a2	-2.95516E-06
		a3	-8.13101E-09
a4	2.01623E-11
		a5	4.67843E-15
a6	1.02105E-19
		a7	9.0501E-21
a8	0

Specifically, referring to fig. 1, in a preferred embodiment, the first lens 21 is a meniscus lens, and the concave surface of the first lens 21 is disposed toward the eye point side; the second lens 22 is an aspherical lens; the third lens 23 is a meniscus aspherical lens, and a concave surface of the third lens 23 is disposed toward the eyepoint side.

Specifically, in the present embodiment, the surface shape coefficient corresponding to each lens is shown in table 7, where the curvature radius and the thickness unit are both millimeters (mm).

TABLE 7 VR glasses structure data and surface shape coefficients corresponding to the lenses

	Surface numbering	Radius of curvature	Spacing or thickness	Material	Radius of
						0			Infinite distance		0
1	Eye pupil	Unlimited in size	10		2
						2	S4	103.391	6.37	K22R	20.43
3	S3	-183.087	0.93		22
						4	S6	-434.857	2.70	OKP1	22
5	S5	117.918	4.02		22
						6	S2	114.577	7.41	K22R	23.5
7	S1	-81.822	-7.41	MIRROR	23.5
						8	S2	114.577	-4.02		23.5
9	S5	117.918	-2.70	OKP1	22
						10	S6	-434.857	-0.93		22
11	S3	-183.087	-6.37	K22R	22
						12	S4	103.391	-5.00		20.43
13	Detecting surface (cam)	Unlimited in size	-

The first lens 21, the second lens 22 and the third lens 23 are aspheric lenses, which are flatter, thinner and more realistic than spherical lenses. Most VR lenses are aspheric lenses, so that the phenomenon that the picture seen by people is locally deformed and distorted can be more truly restored. While spherical lenses produce slight distortion of the object image in the peripheral field of view. And the meniscus aspherical lens can greatly reduce spherical aberration.

Specifically, in one embodiment, the second lens 22 has an abbe number Vd2, wherein 50 < Vd2 < 60; in another embodiment, the third lens 23 has an abbe number Vd3, wherein 15 < Vd3 < 30. In this embodiment, the second lens 22 has an abbe number Vd2, where 50 < Vd2 < 60, preferably Vd2=55.711, and the third lens 23 has an abbe number Vd3, where 15 < Vd3 < 30 and vd3=22.407, which are set such that the chromatic dispersion of the lens structure 2 is not significant and the imaging quality of the lens is good.

Specifically, in one embodiment, the second lens 22 has a refractive index nd2, where 1.5 < nd2 < 1.55. In another embodiment, the refractive index of the third lens 23 is nd3, wherein 1.6 < nd3 < 1.7. In the present embodiment, the refractive index of the second lens 22 is nd2, where 1.5 < nd2 < 1.55, preferably nd2=1.535, and the refractive index of the third lens 23 is nd3, where 1.6 < nd3 < 1.7, preferably nd3=1.6422, so as to ensure that the lens structure 2 can fully project the light emitted from the eye pupil onto the position measuring device 3 within a limited spatial dimension in the moving range of the eye pupil.

The invention further provides a control method of the VR glasses, which is realized based on the VR glasses 100.

In an embodiment, referring to fig. 4, the VR glasses control method includes the steps of:

and S10, acquiring the position parameters of the eye pupil.

In the present embodiment, the position measuring device 3 can determine the position parameter of the eye pupil from the light emitted from the eye pupil.

And S20, determining the functional area position parameter of the display screen 1 according to the position parameter.

In this embodiment, the position parameter may reflect a position of an eye pupil, where the position of the eye pupil corresponds to a region on the display screen 1 focused by the eye pupil one by one, and the region of the display screen 1 focused by the eye pupil is defined as the functional region.

And S30, determining display adjustment parameters according to the functional area position parameters.

The electronic system (i.e. the controller) may determine the required display adjustment parameters according to the position parameters of the functional areas, i.e. to achieve an adjustment of the sharpness thereof, or a control of the direction of movement, etc. in the area at which the eye pupils are gazed.

And S40, controlling the display screen 1 to work according to the display adjustment parameters.

Thus, the position measuring device 3 uses the eye pupil as the light-emitting object and is positioned on the light path using the eye pupil as the light-emitting object, when the display screen 1 is watched by the eye pupil to move, the position and the angle of the light reflected by the eye pupil change, and the position of the eye pupil is measured by the position measuring device 3, so that the display screen 1 can adjust the display adjusting parameters according to the position of the eye pupil, and the display screen 1 is controlled to work.

In the second exemplary embodiment, the position determining device 3 includes an image capturing device for capturing a light image of a luminous object whose eye pupil is a luminous object.

The step S10 includes:

and step S101, acquiring a light ray image of the light rays reflected by the eye pupil after being reflected by the lens structure 2.

The image acquisition device may be a camera, and the spatial coordinates of the eye pupil can be determined by successive shots of the camera.

And step S102, determining the position parameters of the eye pupil according to the light image.

Because the light can be refracted and reflected after passing through the lens structure 2, the deflection angle of the light can be calculated through the refractive index of each lens in the lens structure 2, and the reflection direction of the reflected light can be calculated according to the curvature of the transflective film.

Through the spatial coordinate information of the eye pupil, not only the position information of the eye pupil at a certain time point can be obtained, but also the information of the change displacement of the eye pupil can be measured, so that the display screen 1 can be conveniently adjusted according to the spatial coordinate.

In the third embodiment, the display adjustment parameter includes at least one of display definition, a displacement direction of the screen of the display screen 1, and display screen content.

Because the image area directly corresponding to the eye pupil of the user is the focus focused by the user, the electronic system can adjust the definition of the functional area according to the eye pupil position information of the user. When the user needs to adjust the direction of the frame switching movement, the user does not need to rely on a handheld mouse to operate the direction of the frame movement, and the electronic system can control the direction of the frame movement of the display screen 1 through the displacement direction of the eye pupil. When a user watches the screen and is interested in the picture of some areas on the picture, the time for which the eye pupil stays at the position is long, the picture area which is interested in the user on the display screen 1 can be calculated through the position information of the eye pupil, and the big data can automatically push the related picture, namely the picture which is interested in the user according to the picture information of the area by collecting the picture information of the area.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A VR glasses, comprising:

a housing;

a display screen;

2. The VR glasses of claim 1, wherein the position determining means includes an image capture device for capturing an image of light emitted from an eye pupil.

3. The VR glasses of claim 1, wherein the lens structure has an object side and an eyepoint side disposed opposite each other along a direction of extension of an optical axis, the lens structure including at least one lens on the optical axis;

the surface shape of any one of the lenses satisfies formula I:

wherein c is the curvature corresponding to the radius, y is the radial coordinate, k is the conic coefficient, a ₁ To a ₈ The coefficients are respectively corresponding to the radial coordinates.

4. The VR glasses of claim 3, wherein the lens structure comprises a first lens, and a semi-reflective and semi-transparent film is coated on an end surface of the first lens near the object side;

5. The VR glasses of claim 4, wherein the lens structure further includes a second lens on the optical axis, the second lens disposed on an eyepoint side of the first lens;

6. The VR glasses of claim 5, wherein the lens structure further includes a third lens on the optical axis, the third lens disposed between the first lens and the second lens.

7. The VR glasses of claim 6, wherein the first lens is a meniscus lens, a concave surface of the first lens being disposed toward an eyepoint side;

the second lens is an aspheric lens;

8. A control method of VR glasses, which is implemented based on VR glasses as claimed in any one of claims 1 to 7, wherein the step of the control method of VR glasses includes:

acquiring a position parameter of an eye pupil;

9. The method of controlling VR glasses as set forth in claim 8, wherein the position determining means includes an image capturing means for capturing a light image with an eye pupil as a light-emitting object;

10. The method of controlling VR glasses as claimed in claim 8, wherein the display adjustment parameter includes at least one of a display definition, a displacement direction of a display screen, and a display screen content.