CN111983803A - Eyeball tracking module and electronic equipment - Google Patents

Eyeball tracking module and electronic equipment Download PDF

Info

Publication number
CN111983803A
CN111983803A CN202010837142.9A CN202010837142A CN111983803A CN 111983803 A CN111983803 A CN 111983803A CN 202010837142 A CN202010837142 A CN 202010837142A CN 111983803 A CN111983803 A CN 111983803A
Authority
CN
China
Prior art keywords
light
emitting unit
eyeball
light emitting
receiving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010837142.9A
Other languages
Chinese (zh)
Inventor
王世育
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Interface Optoelectronics Shenzhen Co Ltd
Interface Technology Chengdu Co Ltd
General Interface Solution Ltd
Original Assignee
Interface Optoelectronics Shenzhen Co Ltd
Interface Technology Chengdu Co Ltd
General Interface Solution Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Interface Optoelectronics Shenzhen Co Ltd, Interface Technology Chengdu Co Ltd, General Interface Solution Ltd filed Critical Interface Optoelectronics Shenzhen Co Ltd
Priority to CN202010837142.9A priority Critical patent/CN111983803A/en
Publication of CN111983803A publication Critical patent/CN111983803A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Abstract

The invention relates to an eyeball tracking module and electronic equipment. The eyeball tracking module comprises: the picture frame is formed by sequentially connecting a first long side, a first short side, a second long side and a second short side end to end; the receiving assembly is arranged on the second long edge; the first light-emitting unit and the second light-emitting unit are arranged on the first long edge and located on two sides of the orthographic projection of the receiving assembly on the first long edge, and the third light-emitting unit and the fourth light-emitting unit are respectively arranged on the first short edge and the part, far away from the first long edge, of the second short edge. Above-mentioned eyeball is tracked the module, through the position that acquires the light that receiving assembly received, can acquire the positional information of eyeball, has greatly simplified the pursuit process that the module was tracked to the eyeball, shortens and tracks the length consuming time, promotes user experience.

Description

Eyeball tracking module and electronic equipment
Technical Field
The invention relates to the technical field of virtual reality equipment, in particular to an eyeball tracking module and electronic equipment.
Background
In Virtual imaging electronic devices such as Virtual Reality (VR) devices, Augmented Reality (AR) devices, and Mediated Reality (MR) devices, an eyeball tracking module is usually configured to track the movement of human eyeballs, and the position and angle of an image are changed according to the movement of the human eyeballs, so that a user can feel personally on the scene.
However, the traditional eyeball tracking module has a complex tracking operation process for human eyeball motion, which results in long time consumption in the tracking process and poor user experience.
Disclosure of Invention
Therefore, it is necessary to provide an eyeball tracking module and an electronic device for solving the problems of long time consumption and poor user experience in the tracking process of the conventional eyeball tracking module.
An eye tracking module, comprising:
the picture frame is formed by sequentially connecting a first long side, a first short side, a second long side and a second short side end to end;
the receiving assembly is arranged on the second long edge; and
the receiving assembly comprises a first long edge, a second long edge, a third long edge and a fourth long edge, wherein the first long edge is provided with a first light emitting unit, the second long edge is provided with a second light emitting unit, the first light emitting unit and the second light emitting unit are positioned on two sides of the orthographic projection of the receiving assembly on the first long edge, and the third long edge and the fourth long edge are respectively arranged on the first short edge and the part of the second short edge far away from the first long edge.
In one embodiment, the first long side has a perpendicular line passing through the geometric center of the receiving component, and the first light-emitting unit and the second light-emitting unit are distributed in axial symmetry about the perpendicular line.
In one embodiment, the first long side has a perpendicular line passing through the geometric center of the receiving component, and the third light-emitting unit and the fourth light-emitting unit are distributed in axial symmetry about the perpendicular line.
In one embodiment, the receiving assembly is disposed at a midpoint of the second long side.
In one embodiment, the distance between the geometric centers of the first and second light emitting units is 25.6mm ± 5%; and/or
The distance between the geometric centers of the third light-emitting unit and the fourth light-emitting unit is 47mm +/-5%; and/or
The vertical distance from the geometric center of the receiving assembly to a connecting line between the geometric centers of the first light-emitting unit and the second light-emitting unit is 35.5mm +/-5%; and/or
The vertical distances from the geometric centers of the third light-emitting unit and the fourth light-emitting unit to the first long side are both 24.4 +/-5%.
In one embodiment, the receiving assembly includes a mask layer and a photosensitive element, the mask layer is formed with a light-transmitting pattern, and the light-transmitting pattern is used for adjusting light entering the receiving assembly so that the light can be imaged on the photosensitive element.
In one embodiment, the receiving assembly has a receiving surface for receiving light reflected by an eyeball, and the shortest distance from the receiving surface to the eyeball is 8.09mm +/-5%.
In one embodiment, the two mirror frames are connected with each other, a boundary line is formed between the two mirror frames, and the two mirror frames are in an axial symmetry structure relative to the boundary line.
In one embodiment, the distance between the geometric centers of the two receiving assemblies is 66mm ± 5%; and/or
The distance between the geometric centers of the two third light-emitting units is 23mm +/-5%; and/or
The two first light-emitting units are positioned at the outer sides of the two second light-emitting units, and the distance between the geometric centers of the two second light-emitting units is 40.4mm +/-5%.
An electronic device includes a display and the eye tracking module of any of the above embodiments, wherein the display can adjust a displayed image according to information obtained by the eye tracking module.
When the eyeball tracking module is used for tracking the eyeball, the spectacle frame is placed in front of the eyeball, and the first long edge, the first short edge, the second long edge and the second short edge are arranged around the eyeball. The four light-emitting units emit light towards eyeballs, and the positions of the four light-emitting units and the receiving assembly are reasonably configured. Therefore, when the spectacle frame is placed in front of the eyeball, the light rays emitted by the four light-emitting units are respectively emitted to the eyeball from four different directions, and the position of the eyeball is tracked from the four different directions of the eyeball. When the eyeball moves towards a certain direction, the light emitted by the light emitting unit in the direction is reflected by the eyeball and then received by the receiving component, and the light emitted by the light emitting units in the other directions is emitted to the white of the eye and cannot be reflected by the eyeball to reach the receiving component. And because the light rays emitted by different light-emitting units are emitted to the eyeball from different directions, the light rays emitted by different light-emitting units can enter the receiving assembly from different directions after being reflected by the eyeball and reach different positions of the receiving assembly. Through the position of acquireing the light that receiving assembly received, can acquire the positional information of eyeball, greatly simplified the pursuit process of eyeball tracking module, shortened and tracked the consuming time long, promoted user experience.
Drawings
FIG. 1 is a schematic diagram of an eye tracking module according to some embodiments of the present disclosure;
FIG. 2 is a schematic view of an eyeball tracking module of some embodiments of the present application being placed in front of an eyeball;
FIG. 3 is a schematic diagram of a receiving component in some embodiments of the present application;
fig. 4 is a schematic diagram illustrating an eyeball position obtained by the eyeball tracking module in some embodiments of the present application.
Wherein, 110, the spectacle frame; 111. a first light emitting unit; 112. a second light emitting unit; 113. a third light emitting unit; 114. a fourth light emitting unit; 115. a first long side; 116. a second long side; 117. a first short side; 118. a second short side; 120. a receiving component; 121. a mask layer; 122. a receiving surface; 123. a photosensitive element; 124. connecting the substrates; 130. a line-of-sight space; 131. a center point; 140. a frame; 150. the eyeball.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.
In the description of the present invention, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation, and are not to be considered limiting of the invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical," "horizontal," "upper," "lower," "left," "right," and the like as used herein are for illustrative purposes only and do not denote a unique embodiment.
Referring to fig. 1 and 2, fig. 1 is a schematic diagram illustrating an eyeball tracking module according to some embodiments of the present disclosure, and fig. 2 is a schematic diagram illustrating an eyeball tracking module according to some embodiments of the present disclosure placed in front of an eyeball 150. The eye tracking module comprises a frame 110 and a frame 140 connected to each other, the frame 110 is configured to be mounted on the bridge of the nose of the user, and the frame 140 is configured to be mounted on the ears of the user, so as to place the eye tracking module in front of the eyes 150 of the user. The eyeball-tracking module further comprises a light-emitting unit and a receiving component 120, wherein the light-emitting unit is used for emitting light towards the eyeball 150 of the user, and the receiving component 120 is used for receiving the light reflected by the eyeball 150 of the user and acquiring the position of the eyeball 150 according to the received light, so as to realize the function of tracking the eyeball 150. Of course, to avoid that the light emitted by the light emitting unit affects the visual experience of the user, the light emitted by the light emitting unit should be invisible light, for example, in some embodiments, the light emitting unit is an infrared light emitting diode (IRLED), and the light emitting unit can emit infrared light invisible to human eyes.
Specifically, in some embodiments, the frame 110 includes a first long side 115, a second long side 116, a first short side 117 and a second short side 118, and the first long side 115, the first short side 117, the second long side 116 and the second short side 118 are sequentially connected in an end-to-end manner, and the first long side 115, the first short side 117, the second long side 116 and the second short side 118 enclose a sight line space 130. When the eye tracking module is placed in front of the eye 150, the line of sight of the eye 150 passes through the sight space 130, i.e., the first long side 115, the first short side 117, the second long side 116 and the second short side 118 are disposed around the eye 150. And the sight line space 130 has a center point 131 therein, referring to fig. 2, when the eyeball 150 is looking straight, i.e. the sight line of the eyeball 150 faces straight ahead, the sight line of the eyeball 150 passes through the center point 131. It should be noted that the center point 131 of the sight line space 130 may not be the geometric center of the lens frame 110.
The light emitting units of the eye tracking module include a first light emitting unit 111, a second light emitting unit 112, a third light emitting unit 113, and a fourth light emitting unit 114, and the receiving assembly 120 is disposed on the second long side 116. The first light emitting unit 111 and the second light emitting unit 112 are disposed on the first long side 115, and the first light emitting unit 111 and the second light emitting unit 112 are located at two sides of an orthographic projection of the receiving assembly 120 on the first long side 115. The third light emitting unit 113 is disposed at a portion of the first short side 117 away from the first long side 115. Specifically, in some embodiments, the first short side 117 has a perpendicular line passing through the center point 131, i.e., the perpendicular line a shown in fig. 1, and the third light emitting unit 113 is disposed at a portion between an intersection of the perpendicular line a and the first short side 117 and a connection point of the first short side 117 and the second long side 116. The fourth light emitting unit 114 is disposed at a portion of the second short side 118 far from the first long side 115, that is, the fourth light emitting unit 114 is disposed at a portion between an intersection of the perpendicular line a and the second short side 118 and a connection point of the second short side 118 and the second long side 116. And in some embodiments, the extending direction of the first long side 115 is parallel to the extending direction of the second long side 116, and the extending direction of the first short side 117 is parallel to the extending direction of the second short side 118.
It is understood that the light emitting surfaces of the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113 and the fourth light emitting unit 114 and the receiving surface 122 of the receiving assembly 120 should face the same side, so that the light emitted from the light emitting surfaces of the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113 and the fourth light emitting unit 114 can be received by the receiving surface 122 of the receiving assembly 120 after being reflected by the eyeball 150. Therefore, in some embodiments, the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113, the fourth light emitting unit 114 and the receiving assembly 120 are disposed on a side of the frame 110 facing the eyeball 150. Of course, in other embodiments, the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113, the fourth light emitting unit 114 and the receiving assembly 120 may also be disposed on the inner side or the outer side of the lens frame 110, as long as the light emitting surface of each light emitting unit and the receiving surface 122 of the receiving assembly 120 can face the side of the eyeball 150.
Further, in some embodiments, the first long side 115 has a perpendicular line passing through the center point 131, i.e., the perpendicular line B shown in fig. 1, the receiving element 120 is disposed on the perpendicular line B, the first light emitting unit 111 and the second light emitting unit 112 are axially symmetrically distributed with respect to the perpendicular line B, and the perpendicular distances from the third light emitting unit 113 and the fourth light emitting unit 114 to the perpendicular line B are equal. It should be noted that the vertical line a and the vertical line B are virtual straight lines drawn for conveniently describing the relative position relationship of the light emitting units and the receiving assemblies 120.
Further, in some embodiments, the receiving element 120 is disposed at the midpoint of the second long side 116, the perpendicular a passes through the midpoints of the first long side 115 and the second long side 116, and the perpendicular B passes through the midpoints of the first short side 117 and the second short side 118. At this time, the shortest distances from the first light emitting unit 111 and the second light emitting unit 112 to the midpoint of the first long side 115 are equal, and the third light emitting unit 113 and the fourth light emitting unit 114 are distributed in axial symmetry with respect to the perpendicular line B. It should be noted that the shape of the frame 110 is not limited, for example, in some embodiments, the adjacent sides of the frame 110 may have rounded transitions, and the first long side 115 and the second long side 116, and the first short side 117 and the second short side 118 may not be parallel to each other. When the shape of the frame 110 is changed, the position of the center point 131 of the sight line space 130 may also be changed, that is, the perpendicular line a may not pass through the middle point of the first short side 117 and the second short side 118, and the perpendicular line B may not pass through the middle point of the first long side 115 and the second long side 116, as long as the relative positional relationship between the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113, the fourth light emitting unit 114, and the receiving assembly 120 and the center point 131 is kept unchanged.
It can be understood that the first light emitting unit 111 and the second light emitting unit 112 are axially symmetrically distributed about the vertical line B, and the third light emitting unit 113 and the fourth light emitting unit 114 are axially symmetrically distributed about the vertical line B, so that when the lens frame 110 is placed in front of the eyeball 150, the first light emitting unit 111 and the second light emitting unit 112 are symmetrically distributed on two sides of the eyeball 150, and the third light emitting unit 113 and the fourth light emitting unit 114 are symmetrically distributed on two sides of the eyeball 150, so that the light emitted by the first light emitting unit 111 and the second light emitting unit 112 can be symmetrically distributed in the receiving element 120 after being reflected by the eyeball 150, and the light emitted by the third light emitting unit 113 and the fourth light emitting unit 114 can be symmetrically distributed in the receiving element 120 after being reflected by the eyeball 150, so that the receiving element 120 can more accurately obtain the position of the eyeball 150.
Referring also to fig. 3, fig. 3 illustrates a schematic diagram of a receiving component 120 in some embodiments of the present application. Specifically, in some embodiments, the receiving assembly 120 includes a mask layer 121, a photosensitive element 123, and a connecting substrate 124. The connection substrate 124 may be a Printed Circuit Board (PCB) or a flexible printed circuit board (FPC), and a connection circuit is disposed on the connection substrate 124. The photosensitive element 123 may be a Charge Coupled Device (CCD) or a complementary metal oxide semiconductor (CMOS Sensor), and the photosensitive element 123 is disposed on the connection substrate 124 and electrically connected to the connection circuit on the connection substrate 124. The photosensitive element 123 is used for converting the received light signal into an electrical signal and outputting the electrical signal through the connecting substrate 124. The eyeball-tracking module may further include a processing module (not shown) for performing operation analysis on the electrical signal output by the photosensitive element 123 to obtain the position information of the eyeball 150.
Further, the mask layer 121 is disposed on a side of the photosensitive element 123 away from the connecting substrate 124 and covers a photosensitive area of the photosensitive element 123, and a surface of the mask layer 121 away from the photosensitive element 123 is a receiving surface 122 of the receiving assembly 120. The mask layer 121 has a light-transmitting region (not shown) formed on the receiving surface 122, light enters the receiving element 120 from the light-transmitting region of the receiving surface 122 and reaches the photosensitive element 123 for imaging, and the rest of the receiving surface 122 is opaque. The light-transmitting region forms a light-transmitting pattern for adjusting the light entering the receiving assembly 120, so that the light can be imaged on the photosensitive element 123. For example, the light-transmissive pattern includes a plurality of diffraction slits, and the area of the diffraction front gradually decreases in a direction in which the geometric center of the receiving surface 122 points to the edge of the receiving surface 122. Therefore, independent diffraction can be generated on light rays reflected by the eyeball 150 and then emitted to different parts of the receiving surface 122, the brightness of the light rays penetrating through the middle area of the receiving surface 122 is high, when the light rays penetrate through the receiving surface 122 and reach the photosensitive element 123, the light rays have high uniformity and enough brightness to form images, the imaging quality of the light rays is improved, and the precision of the eyeball tracking module for tracking the eyeball 150 is further improved. Of course, the pattern of the light-transmitting pattern is not limited, as long as the light rays striking the receiving surface 122 can be adjusted to improve the imaging quality of the light rays on the photosensitive element 123.
It can be understood that the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113, and the fourth light emitting unit 114 are disposed in different directions of the receiving assembly 120, and light emitted by any one of the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113, and the fourth light emitting unit 114 may be reflected by the eyeball 150 and enter the receiving assembly 120, that is, the receiving assembly 120 needs to have the capability of receiving light incident from multiple directions. If the receiving element 120 employs a conventional optical system composed of refractive lenses for light adjustment, the maximum field angle of the conventional optical system is limited, which easily causes that part of the light emitted by the light emitting unit cannot be received by the receiving element 120 after being reflected by the eyeball 150, thereby affecting the tracking effect of the eyeball 150. The light is adjusted by the mask layer 121, the maximum field angle of the mask layer 121 is much larger than that of the optical system formed by the lenses, and the movement of the eyeball 150 along each direction can be obtained to the maximum extent by using the first light-emitting unit 111, the second light-emitting unit 112, the third light-emitting unit 113, and the fourth light-emitting unit 114.
Referring to fig. 1 and 2, in some embodiments, two frames 110 are disposed in the frame 110, the two frames 110 are connected to each other, a boundary line is formed at a connection position of the two frames 110, as shown by a boundary line C in fig. 1, the boundary line is parallel to the extending direction of the first short side 117, and the two frames 110 are axially symmetric about the boundary line C. Two mirror frames 110 with axial symmetry structures are arranged, when the mirror frames 110 are erected on the bridge of the nose of a user, each mirror frame 110 is positioned in front of one eyeball 150, and the two mirror frames 110 are matched together to acquire the position information of the two eyeballs 150 of the user.
In addition, in fig. 1, an X, Y rectangular coordinate system is established with the center point 131 of one of the lens frames 110 as the origin, the X-axis is parallel to the extending direction of the first long side 115, the Y-axis is parallel to the extending direction of the first short side 117, the center point 131 of the other lens frame 110 has coordinates (-66, 0), and the unit length of the rectangular coordinate system is 1 mm. Fig. 1 also shows the coordinates of the geometric centers of the light emitting units and the receiving assembly 120, wherein the coordinates of the two first light emitting units 111 are: (-78.8, 18), (12.8, 18); the coordinates of the two second light emitting units 112 are: (-53.2, 18), (-12.8, 18); the coordinates of the two third light emitting units 113 are: (-44.5, -6.4), (-21.5, -6.4); the coordinates of the two fourth light-emitting units 114 are: (-91.5, -6.4), (25.5, -6.4); the coordinates of the two receiving assemblies 120 are: (-66, -17.5), (0, -17.5).
As can be derived from the coordinate values shown in fig. 1, in one lens frame 110, the distance between the geometric centers of the first light-emitting unit 111 and the second light-emitting unit 112 is 25.6mm, the distance between the geometric centers of the third light-emitting unit 113 and the fourth light-emitting unit 114 is 47mm, the vertical distance from the geometric center of the receiving assembly 120 to the connecting line between the geometric centers of the first light-emitting unit 111 and the second light-emitting unit 112 is 35.5mm, and the vertical distance from the geometric centers of the third light-emitting unit 113 and the fourth light-emitting unit 114 to the first long side 115 is 24.4 mm. In addition, in the embodiment shown in fig. 1, the geometric center of each light emitting unit and each receiving assembly 120 is located at the center of the corresponding side of the frame 110 in the width direction, and the width dimensions of the first long side 115, the first short side 117 and the second short side 118 are equal, which are: d2 mm, the width dimension of the second long side 116 is: e is 5 mm. Since the size of the receiving member 120 is generally larger than that of the light emitting unit, the second long side 116 with a larger width is provided to better support the receiving member 120. It can be deduced that the maximum distance from the center point 131 to the first long side 115 in the Y-axis direction is: f is 19 mm; the maximum distance from the center point 131 to the second long side 116 in the Y-axis direction is: g is 20 mm; the maximum distance from the center point 131 to the first short side 117 in the X-axis direction is: h is 22.5 mm; the maximum distance from the center point 131 to the second short side 118 in the X-axis direction is: i-26.5 mm.
Similarly, in the two lens frames 110, the distance between the geometric centers of the two receiving members 120 is 66 mm; the distance between the geometric centers of the two third light emitting units 113 is 23mm, and the distance between the geometric centers of the two second light emitting units 112 is 40.4 mm; the fractional distances can be deduced from the respective coordinate values shown in fig. 1 and are not labeled one by one in fig. 1.
Referring also to fig. 2, in some embodiments, when the frame 110 is placed in front of the eyeball 150, the surface of the frame 110 facing the eyeball 150 forms a plane, and the angle α between the plane and the vertical direction is 8 degrees, that is, the forward inclination angle of the frame 110 is 8 degrees; the shortest distance between the eyeball 150 and the central point 131 is 12mm, namely, the distance between the eyes is 12 mm; the receiving member 120 has a dimension of 1.1mm in the horizontal direction. The horizontal direction is a line of sight direction when the eyeball 150 is looking straight, and the vertical direction is perpendicular to the horizontal direction. When the maximum width of the frame 110 is 40mm and the perpendicular line a passes through the midpoint of the first short side 117, the shortest distance between the eyeball 150 and the receiving surface 122 is 8.09 mm. The distance can ensure that the light emitted from the light emitting unit can better enter the receiving assembly 120 after being reflected by the eyeball 150.
It should be noted that the allowable tolerance of each of the distance values, the size values and the angle values is ± 5%, and in other embodiments, each of the distance values, the size values and the angle values may have other settings as long as the relative position relationship between each of the light emitting units and the receiving assemblies 120 and the central point 131 in one lens frame 110 is not changed. For example, in some embodiments, the pitch is between 10mm and 12mm, the rake angle α of the frames 110 is between 6 degrees and 12 degrees, and the maximum length of the two frames 110 as a whole in the X-axis direction is 132 mm. It can be understood that when the distance values, the dimension values and the angle values satisfy the above conditions, the light emitted by each light emitting unit can be accurately emitted to the eyeball 150 from different directions, and can accurately reach the corresponding position of the receiving module after being reflected by the eyeball 150, thereby improving the tracking accuracy of the eyeball 150.
In addition, referring to fig. 1 and fig. 4 together, fig. 4 is a schematic diagram illustrating a principle of acquiring the position information of the eyeball 150 by the eyeball tracking module according to some embodiments of the present application. Specifically, the point J, the point K, the point L and the point M shown in fig. 4 respectively represent the focus points of the light emitted by the first light-emitting unit 111, the second light-emitting unit 112, the third light-emitting unit 113 and the fourth light-emitting unit 114 on the eyes. When the eyeball 150 is looking straight, the light emitted by the first light emitting unit 111, the second light emitting unit 112, the third light emitting unit 113 and the fourth light emitting unit 114 can all strike the eyeball 150 and be reflected into the receiving assembly 120 by the pupil; when the eyeball 150 looks upward, that is, when the eyeball 150 moves toward a direction close to a connection line between the point J and the point K, the light emitted by the first light-emitting unit 111 and the second light-emitting unit 112 can be emitted onto the eyeball and reflected into the receiving element 120 by the pupil, and the light emitted by the third light-emitting unit 113 and the fourth light-emitting unit 114 can be emitted onto the white of the eye and cannot be reflected into the receiving element 120; when the eyeball 150 looks obliquely toward the upper left corner, that is, the eyeball 150 moves toward the direction close to the point J, the light emitted by the first light-emitting unit 111 and the third light-emitting unit 113 can strike the eyeball 150 and be reflected by the pupil into the receiving element 120, and the light emitted by the second light-emitting unit 112 and the fourth light-emitting unit 114 can strike the white of the eye and cannot be reflected into the receiving element 120. The rest of the movement of the eyeball 150 can be derived from the above description, and the details are not repeated here.
The above-mentioned eyeball tracking module reasonably configures the positions of the four light emitting units and the receiving assembly 120, when the frame 110 is placed in front of the eyeball 150, the light emitted by the four light emitting units is emitted to the eyeball 150 from four different directions, when the eyeball 150 moves towards a certain direction, the light emitted by the light emitting unit in the direction is reflected by the eyeball 150 and then received by the receiving assembly 120, and the light emitted by the light emitting units in the other directions is emitted to the white of the eye and cannot be reflected by the eyeball 150 to reach the receiving assembly 120. And since the light emitted from different light emitting units is emitted to the pupil from different directions of the eyeball 150, the light is emitted by the pupil toward different directions. Therefore, the light emitted by different light emitting units will reach different positions of the receiving assembly 120 after being reflected by the eyeball 150, and the processing module of the receiving assembly 120 can obtain the position information of the eyeball 150 by obtaining the position of the light received by the receiving assembly 120, thereby achieving the function of tracking the eyeball 150. Therefore, by properly arranging the positions of the four light emitting units and the receiving assembly 120, the light emitted by the four light emitting units can be emitted to the eyeball 150 from four different directions, and the movement of the eyeball 150 can be tracked from the four different directions. The eyeball tracking module greatly simplifies the eyeball 150 tracking process, shortens the time consumed by tracking, and improves the user experience.
Specifically, in some embodiments, the processing module can obtain a brightness distribution map or a gray scale distribution map of the photosensitive area of the photosensitive element 123, and according to the brightness distribution or the gray scale distribution of the photosensitive area, the position of the light received by the receiving assembly 120 can be obtained, wherein after the light emitted by the light emitting unit is reflected by the eyeball 150 to reach a certain portion of the photosensitive area, the brightness of the certain portion exhibits a greater brightness in the brightness distribution map of the photosensitive area.
Further, the eyeball tracking module may be assembled with a display to form an electronic device (not shown), specifically, the electronic device may be a virtual imaging device such as a VR device, an AR device, or an MR device. The eyeball tracking module is used for tracking the position information of the eyeball 150 and obtaining the user, and the display of the electronic equipment can adjust the displayed image according to the information obtained by the eyeball tracking module, for example, the display angle of the image is adjusted, so that the viewing experience of the user is improved, and the user can feel personally on the scene.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. An eye tracking module, comprising:
the picture frame is formed by sequentially connecting a first long side, a first short side, a second long side and a second short side end to end;
the receiving assembly is arranged on the second long edge; and
the receiving assembly comprises a first long edge, a second long edge, a third long edge and a fourth long edge, wherein the first long edge is provided with a first light emitting unit, the second long edge is provided with a second light emitting unit, the first light emitting unit and the second light emitting unit are positioned on two sides of the orthographic projection of the receiving assembly on the first long edge, and the third long edge and the fourth long edge are respectively arranged on the first short edge and the part of the second short edge far away from the first long edge.
2. The module of claim 1, wherein the first long side has a perpendicular line passing through a geometric center of the receiving assembly, and the first and second light emitting units are disposed in axial symmetry about the perpendicular line.
3. The module of claim 1, wherein the first long side has a perpendicular line passing through a geometric center of the receiving assembly, and the third and fourth light emitting units are disposed in axial symmetry with respect to the perpendicular line.
4. The eye tracking module of claim 1 wherein said receiving element is disposed at a midpoint of said second long side.
5. The module of claim 1, wherein the distance between the geometric centers of the first and second light emitting units is 25.6mm ± 5%; and/or
The distance between the geometric centers of the third light-emitting unit and the fourth light-emitting unit is 47mm +/-5%; and/or
The vertical distance from the geometric center of the receiving assembly to a connecting line between the geometric centers of the first light-emitting unit and the second light-emitting unit is 35.5mm +/-5%; and/or
The vertical distances from the geometric centers of the third light-emitting unit and the fourth light-emitting unit to the first long edge are both 24.4mm +/-5%.
6. The module of any one of claims 1-5, wherein the receiving assembly comprises a mask layer and a photosensitive element, the mask layer is formed with a light transmissive pattern, and the light transmissive pattern is used for adjusting the light entering the receiving assembly so that the light can be imaged on the photosensitive element.
7. The eye tracking module according to any one of claims 1-5, wherein the receiving assembly has a receiving surface for receiving light reflected from an eye, and the shortest distance from the receiving surface to the eye is 8.09mm ± 5%.
8. The module for tracking an eyeball as set forth in any one of claims 1 to 5, wherein said frame is provided in two, said two frames are connected with each other, a boundary line is formed between said two frames, and said two frames are axially symmetric about said boundary line.
9. The eye tracking module of claim 8 wherein the distance between the geometric centers of the two receiving assemblies is 66mm ± 5%; and/or
The distance between the geometric centers of the two third light-emitting units is 23mm +/-5%; and/or
The two first light-emitting units are positioned at the outer sides of the two second light-emitting units, and the distance between the geometric centers of the two second light-emitting units is 40.4mm +/-5%.
10. An electronic device, comprising a display and the eye tracking module of any one of claims 1-9, wherein the display is capable of adjusting the displayed image according to the information obtained by the eye tracking module.
CN202010837142.9A 2020-08-19 2020-08-19 Eyeball tracking module and electronic equipment Pending CN111983803A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010837142.9A CN111983803A (en) 2020-08-19 2020-08-19 Eyeball tracking module and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010837142.9A CN111983803A (en) 2020-08-19 2020-08-19 Eyeball tracking module and electronic equipment

Publications (1)

Publication Number Publication Date
CN111983803A true CN111983803A (en) 2020-11-24

Family

ID=73435138

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010837142.9A Pending CN111983803A (en) 2020-08-19 2020-08-19 Eyeball tracking module and electronic equipment

Country Status (1)

Country Link
CN (1) CN111983803A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955255A (en) * 2011-09-26 2013-03-06 微软公司 Integrated eye tracking and display system
CN104834381A (en) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 Wearable device for sight focus positioning and sight focus positioning method
CN106873158A (en) * 2017-02-27 2017-06-20 阿里巴巴集团控股有限公司 Virtual reality helmet
CN209167698U (en) * 2019-01-11 2019-07-26 北京七鑫易维信息技术有限公司 A kind of sub-assembly and wearable device of eyeball tracking mould group
CN110208947A (en) * 2019-06-03 2019-09-06 歌尔股份有限公司 Display equipment and display methods based on human eye tracking
WO2020038015A1 (en) * 2018-08-20 2020-02-27 余姚舜宇智能光学技术有限公司 Head-mounted viewable device and eye tracking system for use in head-mounted viewable device
CN110927973A (en) * 2019-12-16 2020-03-27 Oppo广东移动通信有限公司 Display device
CN111273441A (en) * 2020-02-25 2020-06-12 业成科技(成都)有限公司 Optical module and electronic equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955255A (en) * 2011-09-26 2013-03-06 微软公司 Integrated eye tracking and display system
CN104834381A (en) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 Wearable device for sight focus positioning and sight focus positioning method
CN106873158A (en) * 2017-02-27 2017-06-20 阿里巴巴集团控股有限公司 Virtual reality helmet
WO2020038015A1 (en) * 2018-08-20 2020-02-27 余姚舜宇智能光学技术有限公司 Head-mounted viewable device and eye tracking system for use in head-mounted viewable device
CN209167698U (en) * 2019-01-11 2019-07-26 北京七鑫易维信息技术有限公司 A kind of sub-assembly and wearable device of eyeball tracking mould group
CN110208947A (en) * 2019-06-03 2019-09-06 歌尔股份有限公司 Display equipment and display methods based on human eye tracking
CN110927973A (en) * 2019-12-16 2020-03-27 Oppo广东移动通信有限公司 Display device
CN111273441A (en) * 2020-02-25 2020-06-12 业成科技(成都)有限公司 Optical module and electronic equipment

Similar Documents

Publication Publication Date Title
CN108471487B (en) Image device for generating panoramic depth image
US10972715B1 (en) Selective processing or readout of data from one or more imaging sensors included in a depth camera assembly
US20160313558A1 (en) Near-eye light-field display system
JP6270674B2 (en) Projection device
CA3035303A1 (en) Method of calibration for holographic energy directing systems
KR102471370B1 (en) Information processing apparatus, information processing method, and program
CN106663336B (en) Image generation device and image generation method
US11611197B2 (en) Addressable vertical cavity surface emitting laser array for generating structured light patterns
WO2022017447A1 (en) Image display control method, image display control apparatus, and head-mounted display device
US10928891B2 (en) Method and arrangement for calibrating a head-mounted display
US11675429B2 (en) Calibration, customization, and improved user experience for bionic lenses
TW202121008A (en) Head mounted display device and near-eye light field display device thereof
US20170277949A1 (en) Head-mounted display
CN114815468A (en) Multi-plane projection with laser beam scanning in augmented reality displays
CN110088662B (en) Imaging system and method for generating background image and focusing image
US20190213933A1 (en) Head mounted display
CN111983803A (en) Eyeball tracking module and electronic equipment
US20210051315A1 (en) Optical display, image capturing device and methods with variable depth of field
US20230280468A1 (en) Addressable projector for dot based direct time of flight depth sensing
US20230408253A1 (en) Three-dimensional scanner having sensors with overlapping fields of view
CN213091888U (en) Depth measurement system and electronic device
US6833858B1 (en) Image input apparatus
CN114035335B (en) Display device, control method thereof and display system
CN216210246U (en) Head-mounted device
US20240007604A1 (en) Image sensing device and head-mounted display

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201124