CN111474740A - Eye tracking based automatic focal length detection zoom system and method - Google Patents
Eye tracking based automatic focal length detection zoom system and method Download PDFInfo
- Publication number
- CN111474740A CN111474740A CN201911424742.6A CN201911424742A CN111474740A CN 111474740 A CN111474740 A CN 111474740A CN 201911424742 A CN201911424742 A CN 201911424742A CN 111474740 A CN111474740 A CN 111474740A
- Authority
- CN
- China
- Prior art keywords
- lens
- zoom system
- camera
- eyeball
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C7/00—Optical parts
- G02C7/02—Lenses; Lens systems ; Methods of designing lenses
- G02C7/08—Auxiliary lenses; Arrangements for varying focal length
- G02C7/081—Ophthalmic lenses with variable focal length
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- General Health & Medical Sciences (AREA)
- Eyeglasses (AREA)
Abstract
The invention discloses an automatic zoom system and method for detecting visual range based on eyeball tracking. The method comprises the following steps: wearing the glasses according to the standard; acquiring and transmitting an image through a camera; processing the image and acquiring data using an Alvarez lens zoom system; calculating to obtain a horizontal sight distance; and adjusting the focal power of the lens according to the calculation result. According to the technical scheme, the camera is used for capturing images of left and right eyes and calculating the images by combining a three-dimensional coordinate system to obtain binocular visual range, then binocular visual range signals are output, the focal power of the adjustable-focus lens is controlled to change, automatic focusing is achieved, a user is prevented from frequently taking off and wearing glasses when using the glasses, and the wearing comfort level and the convenient degree of the glasses are improved.
Description
Technical Field
The invention relates to the field of optical zooming, in particular to an automatic zooming system and method for detecting visual range based on eyeball tracking.
Background
With the gradual aging of the population, the proportion of the elderly population is larger and larger. As the human eye ages, the lens of the eyeball is gradually hardened and thickened, and the accommodative ability of the eye muscles is reduced, so that when a person looks at a close object, the person cannot focus because an image is projected on the retina, and thus the person can not clearly see the close object. Generally, the prescription is the most reliable and effective method, and the presbyopic glasses mainly comprise a single-focus lens, a bifocal lens and a gradient multifocal lens at present. Compared with the common single lens and double lens, the gradual change multifocal lens sees near, medium and long distance objects through different areas on the same lens, better solves the problem of intermediate vision blurring caused by the double lens, is an ideal method for correcting presbyopia so far, ensures clear near vision and good medium and long distance vision, but the focus is fixed and can not completely adapt to the requirements of human eyes, and the lens of the frame glasses has a certain distance from the vertex of a cornea, so that the high-power lens has a certain magnification, and a wearer can feel uncomfortable and dizzy easily.
Chinese patent document CN108873337A discloses a "vision zoom helmet with manually and hydraulically adjustable vision field". Including helmet body, helmet body is provided with picture frame and lens, the lens is provided with first lens subassembly and second lens subassembly, first lens subassembly is provided with the vision adjusting device that different users can set up different vision degree scopes according to self vision, second lens subassembly is provided with the visual field adjusting device that the user can be according to setting up different fields of vision distance under different environment, vision adjusting device and visual field adjusting device adopt manual hydraulic pressure to adjust the structure, manual hydraulic pressure is adjusted structure and picture frame and/or helmet body coupling to be connected with the lens, the lens is provided with and holds manual chamber, it adjusts structural connection with hydraulic pressure to hold the chamber. Above-mentioned technical scheme adopts manual regulation lens light focus, and manual focusing produces when not only wearing and rocks and influence and wear the effect, and is difficult to accurate focusing.
Disclosure of Invention
The invention mainly solves the technical problem that the focal power of the original glasses is inconvenient to adjust, and provides a visual distance detection automatic zooming system and method based on eyeball tracking.
The technical problem of the invention is mainly solved by the following technical scheme: an automatic visual range detection zoom system based on eyeball tracking comprises a spectacle frame and is characterized in that an Alvarez lens zoom system is arranged on the spectacle frame, and a camera is arranged on the spectacle frame. The camera is used for collecting data such as required angles and distances, the data are transmitted to the Alvarez lens zooming system, zooming is carried out through calculation and analysis, and the focal length suitable for a user is automatically adjusted.
Preferably, the Alvarez lens zoom system is mounted at the lens mounting of the frame. The zoom system is composed of two lenses, and the zoom function is realized by reversely moving the two lenses perpendicular to the optical axis direction. Each lens comprises a flat surface and a free-form surface, and the free-form surface in the second lens is obtained by rotating the free-form surface in the first lens by 180 degrees. When the two lenses are completely aligned, the whole function is equivalent to that of a parallel glass plate; when the convex surfaces of the two lenses are opposite, the whole function is equivalent to that of a convex lens and the light beams are converged; when the concave parts of the two lenses are opposite, the whole function is equivalent to that of a concave lens, and light beams are diverged.
Preferably, the camera comprises a left-eye camera and a right-eye camera, the left-eye camera is installed on the left side of the Alvarez lens zoom system, and the lens faces towards the left eyeball; the right eye camera is arranged on the right side of the Alvarez lens zoom system, and the lens faces towards the right eyeball. The directions of the cameras are respectively aligned to the left eye part and the right eye part, so that a complete eye image is obtained in real time.
Preferably, the height of the left eye camera and the right eye camera is consistent with the height of the left eyeball and the right eyeball. An application method of an automatic zoom system for detecting visual range based on eyeball tracking is characterized by comprising the following steps:
① the glasses are worn according to the standard, the eyes are worn right, the height of the left eyeball and the height of the right eyeball of the left eye camera and the right eyeball of the right eye camera are ensured to be consistent by adjustment, and the complete eye images can be obtained in real time.
②, the images are obtained by the camera and transmitted, and the images are transmitted to the Alvarez lens zoom system for calculation.
③ processing the image and acquiring data by an Alvarez lens zoom system, wherein the Alvarez lens zoom system comprises a variable-focus lens and a processing chip, and processing the image by the processing chip to acquire the calculated data, the diameter of the human eye is 22-25mm, the geometric center of eyeball rotation is located on the optical axis and 13mm away from the retina, and the binocular eyeball geometric center O is obtained by calibration in combination with the physiological structure of the human eyeLAnd OR。
④ calculating to obtain horizontal visual distance, recording pupil center coordinate C when wearer visual axis is parallelL(x1， y1，0)、CR(x2，y2And 0) as an initial position, wherein the visual axis at the moment is parallel to the x axis of the coordinate system, and the included angle between the optical axis and the visual axis is the Alpha angle, and then the calculation is carried out through a formula.
⑤ adjust the power of the lens according to the calculation, the change of the visual axis angle is small and not easy to observe when the visual distance is far, so the change of the visual distance at far distance is not discussed.
Preferably, the camera is adjusted in the step 2 to enable the lens directions to be respectively aligned to the left eye and the right eye, so that a complete eye image is obtained in real time.
Preferably, the step 3 processes the image to obtain the center C of the binocular pupilLAnd CRAnd the Alpha angle is combined with the physiological structure of human eyes to obtain the geometric center O of the binocular eyeball through calibrationLAnd ORSelecting OLA coordinate system is established as the origin of coordinates.
Preferably, the Alpha angle is an included angle between a visual axis and an optical axis, and an intersection point of the visual axis passing through the crystalline lens and the retina is a central fovea maculae.
Preferably, in step 4, the horizontal view distance calculation formula is as follows:
wherein, the target S watched by human eyes and the geometric center O of binocular eyeballLAnd ORIs a vertexBuilding a triangle, h being the height on the base of the triangle, θLIs the angle between the left eyeball and the target S, thetaRThe included angle between the right eyeball and the target S is shown.
The invention has the beneficial effects that: utilize the camera to catch the image of left and right eyes and combine three-dimensional coordinate system to calculate, obtain binocular stadia, then with binocular stadia signal output, the focal power of the adjustable focus lens of control changes, realizes automatic focusing, frequently takes off when avoiding the user to use and wears glasses, has improved comfort level and convenient degree that glasses were worn.
Drawings
Fig. 1 is a top view of the present invention.
FIG. 2 is an Alpha angle measurement schematic of the present invention.
Fig. 3 is a schematic diagram of the binocular eyeball geometric center distance measurement of the present invention.
FIG. 4 is a schematic representation of the present invention with OLCoordinate axis diagram as coordinate origin.
Fig. 5 is an effect diagram of the present invention for determining the viewing distance by triangulation.
In the figure, 1 eyeball, 1.1 optical axis, 1.2 visual axis, 1.3 retina, 1.4 crystalline lens, 1.5Alpha angle, 1.6 macular fovea, 2 spectacle frames, 3 left eye camera, 4 right eye camera and 5Alvarez lens zoom system.
Detailed Description
The technical scheme of the invention is further specifically described by the following embodiments and the accompanying drawings.
Example (b): in the present embodiment, an automatic zoom system and method for detecting a visual distance based on eye tracking, as shown in fig. 1, includes a frame 2, an Alvarez lens zoom system 5 is disposed on the frame 2, and the Alvarez lens zoom system 5 is mounted at a lens mounting position of the frame 2. The zoom system is composed of two lenses, and the zoom function is realized by reversely moving the two lenses perpendicular to the optical axis direction. Each lens comprises a flat surface and a free-form surface, and the free-form surface in the second lens is obtained by rotating the free-form surface in the first lens by 180 degrees. When the two lenses are completely aligned, the whole function is equivalent to that of a parallel glass plate; when the convex surfaces of the two lenses are opposite, the whole function is equivalent to that of a convex lens and the light beams are converged; when the concave parts of the two lenses are opposite, the whole function is equivalent to that of a concave lens, and light beams are diverged. The camera is arranged on the lens frame 2 and comprises a left-eye camera 3 and a right-eye camera 4, the left-eye camera 3 is arranged on the left side of the Alvarez lens zoom system 5, and the lens faces towards left eyeballs; the right eye camera 4 is arranged on the right side of the Alvarez lens zoom system 5, and the lens faces towards the right eyeball. The camera is used for collecting data such as required angles and distances, the data are transmitted to the Alvarez lens zooming system, zooming is carried out through calculation and analysis, and the focal length suitable for a user is automatically adjusted.
An application method of an automatic zoom system for detecting visual range based on eyeball tracking comprises the following steps:
① the glasses are worn according to the standard, the eyes are worn right, the height of the left eyeball and the height of the right eyeball of the left eye camera and the right eyeball of the right eye camera are ensured to be consistent by adjustment, and the complete eye images can be obtained in real time.
② the camera is used to obtain and transmit the image, and the camera is adjusted to make the lens direction aim at the left and right eyes respectively, ensuring to obtain the complete eye image in real time.
③ processing the image and acquiring data by an Alvarez lens zoom system, wherein the Alvarez lens zoom system comprises a variable-focus lens and a processing chip, the processing chip processes the image and acquires the calculated data, and the image is processed to obtain the binocular pupil center CLAnd CRAnd Alpha angle 1.5. The diameter of human eyes is 22-25mm, the geometric center of eyeball rotation is positioned on the optical axis and is 13mm away from retina, and the geometric center O of binocular eyeball is obtained by calibration according to the physiological structure of human eyesLAnd OR. Selection of OLA coordinate system is established as the origin of coordinates.
The Alpha angle 1.5 is the included angle between the visual axis 1.2 and the optical axis 1.1, and the size of the Alpha angle is different from one person to another and ranges from 4 degrees to 8 degrees, as shown in figure 2. In actual measurement, the size of the Alpha angle is measured in advance, and the optical axis direction is conveniently corrected to obtain the visual axis direction. The intersection of the visual axis 1.2 through the crystalline lens 1.4 and the retina 1.3 is the macular fovea 1.6.
④ pass meterCalculating to obtain a horizontal sight distance; when a person observes a distant target, the visual axes of the two eyes are parallel, and the distance between the visual axes is the distance P between the geometric centers of the binocular eyeballs, as shown in fig. 3. Placing each obtained coordinate point in the same coordinate system, and selecting OLAs a coordinate origin, it is convenient to calculate the coordinates of each point, as in fig. 4.
To obtain the value of Alpha angle, the pupil center coordinate C of the wearer with parallel visual axes is recordedL(x1， y1，0)、CR(x2，y20) as an initial position, the visual axis at the moment is parallel to the x axis of the coordinate system, and the included angle between the optical axis and the visual axis is the Alpha angle, which is represented by the formula:
α1＝arctan(x1/y1)
α2＝arctan(x2/y2)
the values of the Alpha angles of the left and right eyes are obtained, respectively.
Can be obtained in normal use: cL(xm，ym，zm)、CR(xn，yn，zn)、OL(0，0，0)、 OR(0, P, 0). Respectively mixing C withLAnd OL，CRAnd ORConnecting to obtain two vectors m (x) consistent with the optical axis directionm，ym，zm)、n(xn，yn-P，zn). The direction of the visual axis is obtained according to the pupil center coordinates, and the two vector coordinates are corrected by Alpha angles according to the vector coordinates of the visual axis and the optical axis, so that the binocular actual visual axis direction is obtained, as shown in fig. 2.
The included angle between the vector and the x axis can be calculated according to the equation of the two vectors, and S is the target watched by the human eyes. Because there is an Alpha angle in the horizontal direction, a triangle is constructed in the horizontal direction, the distance in the horizontal direction is calculated, one side is sandwiched between two angles of the triangle, and the length of the other two sides is calculated, as shown in fig. 5.
Making the height h on the bottom edge of the triangle, and when two bottom angles are an acute angle and an obtuse angle, ORThe distance to the foot is set to u.
The following can be obtained by simplification:
the following can be obtained:
when both angles are acute (as shown in fig. 5).
The following can be obtained by simplification:
the following can be obtained:
it follows that the calculation formula for finding the apparent distance is the same when the angles of the two visual axes change.
The length of the other two sides of the triangle can be respectively calculated, the included angle between the vector equation and the z axis is calculated, and then the horizontal visual distance L for the left eye is calculatedLAnd right eye horizontal viewing distance LRFurther calculations are performed.
⑤ the power of the lens is adjusted according to the calculation result, because the angle change of the visual axis is small and the lens is not easy to observe when the visual distance is long, the change of the visual distance is not considered.
Claims (9)
1. The automatic vision distance detection zoom system based on eyeball tracking is characterized by comprising a spectacle frame (2) and being characterized in that an Alvarez lens zoom system (5) is arranged on the spectacle frame (2), and a camera is arranged on the spectacle frame (2).
2. An eye tracking based stadia detection auto zoom system according to claim 1, wherein the Alvarez lens zoom system (5) is mounted at a lens mount of the frame (2).
3. The automatic zooming system based on eye tracking for eye distance detection as claimed in claim 1 or 2, wherein the cameras comprise a left eye camera (3) and a right eye camera (4), the left eye camera (3) is installed at the left side of the Alvarez lens zooming system (5), and the lens faces towards the left eye; the right eye camera (4) is arranged on the right side of the Alvarez lens zoom system (5), and the lens faces towards the right eyeball.
4. The eye tracking based stadia detection auto zoom system according to claim 3, wherein the left eye camera (3) and the right eye camera (4) have a height corresponding to the height of the left and right eyes.
5. An application method of an automatic zoom system for detecting visual range based on eyeball tracking is characterized by comprising the following steps:
① wear the glasses according to the standard;
② acquiring and transmitting images through the camera;
③ processing the image and acquiring data using an Alvarez lens zoom system;
④ calculating horizontal visual distance;
⑤ the power of the lens is adjusted according to the calculation result.
6. The method as claimed in claim 5, wherein the step 2 adjusts the camera to make the lens direction align with the left and right eyes respectively, so as to ensure that a complete eye image is obtained in real time.
7. The method as claimed in claim 5, wherein the step 3 of processing the image to obtain the center C of the pupil with two eyesLAnd CRAnd an Alpha angle (1.5) is combined with the physiological structure of human eyes to obtain the geometric center O of the binocular eyeballLAnd ORSelecting OLA coordinate system is established as the origin of coordinates.
8. The method for applying an eye tracking based stadia detection auto zoom system according to claim 7, wherein the Alpha angle (1.5) is an angle between the visual axis (1.2) and the optical axis (1.1), and an intersection point of the visual axis (1.2) passing through the crystalline lens (1.4) and the retina (1.3) is a macular fovea (1.6).
9. The method as claimed in claim 5, wherein the horizontal focal length in step 4 is calculated by the following formula:
wherein, the target S watched by human eyes and the geometric center O of binocular eyeballLAnd ORBuilding a triangle for the vertex, h being the height on the base of the triangle, θLIs the angle between the left eyeball and the target S, thetaRThe included angle between the right eyeball and the target S is shown.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424742.6A CN111474740A (en) | 2019-12-31 | 2019-12-31 | Eye tracking based automatic focal length detection zoom system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424742.6A CN111474740A (en) | 2019-12-31 | 2019-12-31 | Eye tracking based automatic focal length detection zoom system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111474740A true CN111474740A (en) | 2020-07-31 |
Family
ID=71746337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911424742.6A Pending CN111474740A (en) | 2019-12-31 | 2019-12-31 | Eye tracking based automatic focal length detection zoom system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111474740A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112004025A (en) * | 2020-09-02 | 2020-11-27 | 广东电网有限责任公司 | Unmanned aerial vehicle automatic driving zooming method, system and equipment based on target point cloud |
| CN112764227A (en) * | 2021-01-28 | 2021-05-07 | 深圳珑璟光电科技有限公司 | Near-to-eye display system |
| CN113568189A (en) * | 2021-06-04 | 2021-10-29 | 杭州电子科技大学 | Zoom glasses and focusing method thereof |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013030603A1 (en) * | 2011-09-01 | 2013-03-07 | Gici Labs Llp | Adjustable refractive optical device |
| CN103632389A (en) * | 2012-07-17 | 2014-03-12 | 索尼公司 | System and method to achieve better eyelines in cg characters |
| CN103988109A (en) * | 2011-10-07 | 2014-08-13 | 新加坡国立大学 | Mems-based zoom lens system |
| CN106168853A (en) * | 2016-06-23 | 2016-11-30 | 中国科学技术大学 | A kind of free space wear-type gaze tracking system |
| US20170123233A1 (en) * | 2015-11-02 | 2017-05-04 | Focure, Inc. | Continuous Autofocusing Eyewear |
| CN107041156A (en) * | 2014-01-08 | 2017-08-11 | 威动光有限公司 | The lens subassembly and actuator and its method of optical system |
| CN109544640A (en) * | 2018-11-05 | 2019-03-29 | 北京科技大学 | A kind of sight line tracking system Kappa angle scaling method and caliberating device |
-
2019
- 2019-12-31 CN CN201911424742.6A patent/CN111474740A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013030603A1 (en) * | 2011-09-01 | 2013-03-07 | Gici Labs Llp | Adjustable refractive optical device |
| CN103988109A (en) * | 2011-10-07 | 2014-08-13 | 新加坡国立大学 | Mems-based zoom lens system |
| CN103632389A (en) * | 2012-07-17 | 2014-03-12 | 索尼公司 | System and method to achieve better eyelines in cg characters |
| CN107041156A (en) * | 2014-01-08 | 2017-08-11 | 威动光有限公司 | The lens subassembly and actuator and its method of optical system |
| US20170123233A1 (en) * | 2015-11-02 | 2017-05-04 | Focure, Inc. | Continuous Autofocusing Eyewear |
| CN106168853A (en) * | 2016-06-23 | 2016-11-30 | 中国科学技术大学 | A kind of free space wear-type gaze tracking system |
| CN109544640A (en) * | 2018-11-05 | 2019-03-29 | 北京科技大学 | A kind of sight line tracking system Kappa angle scaling method and caliberating device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112004025A (en) * | 2020-09-02 | 2020-11-27 | 广东电网有限责任公司 | Unmanned aerial vehicle automatic driving zooming method, system and equipment based on target point cloud |
| CN112764227A (en) * | 2021-01-28 | 2021-05-07 | 深圳珑璟光电科技有限公司 | Near-to-eye display system |
| CN113568189A (en) * | 2021-06-04 | 2021-10-29 | 杭州电子科技大学 | Zoom glasses and focusing method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100365470C (en) | Binocular optical device in particular electronic spectacles, comprising electronic camera for automatically setting focus that includes correction of different vision defects | |
| CN103595912B (en) | The imaging method and device of local scale | |
| US10551638B2 (en) | Imaging apparatus and imaging method | |
| CN111474740A (en) | Eye tracking based automatic focal length detection zoom system and method | |
| CN103605208A (en) | Content projection system and method | |
| JP6556133B2 (en) | Apparatus and method for measuring subjective refractive power | |
| CN103605209A (en) | Transmission type stereoscopic display glasses device | |
| CN108324239B (en) | Portable intelligent optometry instrument | |
| CN104090371A (en) | 3D glasses and 3D display system | |
| KR101632156B1 (en) | Calibration lens can be seen ultra short distance | |
| JPWO2018003205A1 (en) | Glasses with video display function | |
| CN108259887A (en) | Watch point calibration method and device, blinkpunkt scaling method and device attentively | |
| CN104836999A (en) | Holographic three-dimensional display mobile terminal and method used for vision self-adaption | |
| KR101300670B1 (en) | Method for measuring of eye rotation and calculation length of corridor in progressive lenses and it's device for implementation | |
| CN104102022A (en) | Dynamic vision correction glasses | |
| CN203535311U (en) | Transmissive stereoscopic display glasses device | |
| CN110568627A (en) | Control method of zoom glasses | |
| CN206115057U (en) | Intelligent spectacles | |
| CN111505837A (en) | Sight distance detection automatic zooming optical system based on binocular imaging analysis | |
| CN108064355A (en) | Optical system and the method for adjusting diopter | |
| JP2000249902A (en) | Automatic focusing spectacles | |
| KR20190057871A (en) | Virtual reality device for preventing myopic progression | |
| CN110007475A (en) | Utilize the method and apparatus of virtual depth compensation eyesight | |
| CN109031667B (en) | Virtual reality glasses image display area transverse boundary positioning method | |
| CN204883084U (en) | Contact lens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200731 |