CN108387993B - Rotatable lens device and tracking method based on eyeball tracking technology - Google Patents
Rotatable lens device and tracking method based on eyeball tracking technology Download PDFInfo
- Publication number
- CN108387993B CN108387993B CN201810184255.6A CN201810184255A CN108387993B CN 108387993 B CN108387993 B CN 108387993B CN 201810184255 A CN201810184255 A CN 201810184255A CN 108387993 B CN108387993 B CN 108387993B
- Authority
- CN
- China
- Prior art keywords
- lens
- guide rail
- eyeball
- surface type
- cambered surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/023—Mountings, adjusting means, or light-tight connections, for optical elements for lenses permitting adjustment
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Accessories Of Cameras (AREA)
- Eyeglasses (AREA)
Abstract
The invention relates to a rotatable lens device, which comprises a main body part, a lens holder and a lens holder, wherein the main body part comprises an arc surface type rotating seat, and the arc surface type rotating seat is arranged on the main body part; the lens component comprises a lens and an arc-surface-shaped accommodating groove, the lens is fixed in the arc-surface-shaped accommodating groove, the arc-surface-shaped accommodating groove is accommodated in the arc-surface-shaped rotating seat, and the arc-surface-shaped accommodating groove can rotate along the arc-surface-shaped rotating seat; a rotating part disposed between the body part and the lens part to drive the lens part to rotate; the control component is arranged in the main body component and is electrically connected with the rotating component; a tracking method based on eyeball tracking technology utilizes a rotatable lens device to realize eyeball tracking; the cambered surface type accommodating groove rotates relative to the cambered surface type rotating seat, so that the efficiency is high, and the real-time performance is good; the lens component is controlled by the control component to rotate along with the eyeballs of the observer, so that automatic rotation is realized, and the automatic rotation device is convenient and flexible to operate and accurate and instant in positioning.
Description
Technical Field
The invention relates to the technical field of eyeball tracking technology and lenses, in particular to the technical field of rotatable lenses combined with the eyeball tracking technology, and specifically relates to a rotatable lens device based on the eyeball tracking technology and a tracking method thereof.
Background
With the coverage of the fourth generation mobile network and the optical network, the network enters the era with faster speed, more products and lower expenses, the lowest network speed can reach more than 10M, the definition and the fluency of video pictures are better and better, the video chat is more and more popular, and an efficient, quick and convenient video chat mode becomes a development direction in the future, and the main part of the video chat is a lens, so that the intelligent lens becomes a hot spot of future research. In addition, human beings realize the observation of scenes at different angles through head movement or eyeball movement, and according to the characteristics, the application of the method to the intelligent lens is a very effective and meaningful way.
Most products such as cameras, mobile phones and tablet computers in the market can only shoot people, objects, landscapes and the like in front of a lens, the lens is fixed, the fixed lens brings inconvenience to certain functions of the products such as the mobile phones, especially, the visual field captured in the lens of the other party cannot be changed in real time in the video chat process, the effect can be achieved only by informing the other party and rotating the position of the product, and the camera, the camera and the mobile phone have the defects of inconvenience in operation, very low efficiency, poor real-time performance and incapability of real-time accurate positioning. In addition, a small part of mobile phones or other products with rotatable lenses also exist in the market, although the effect of changing the field of view can be achieved by manually changing the direction of the lens, the field of view cannot be intelligently changed in real time, especially in video chat, the effect of capturing the field of view in the lens of the other party cannot be changed by the user, and the mobile phones or other products have the defects of low efficiency, poor real-time performance and the like.
Chinese patent CN103293828B discloses an electronic product with a rotatable lens, which changes the position and direction of the lens through manual control, and the specific content is shown in patent CN 103293828B. Similar patents also include patent CN1882044A and patent CN 103019010A. Basically, no patent is seen about rotatable lenses based on eye tracking technology.
Therefore, a novel intelligent lens is urgently needed, the change of the position of the lens is realized according to the eyeball motion, the real-time active observation of the surrounding environment of the other party can be realized in the video chat process, and the novel intelligent lens has the characteristics of convenience and flexibility in operation, high efficiency, good real-time performance, real-time accurate positioning and the like.
Disclosure of Invention
In order to overcome the defects of the background art, the invention provides a rotatable lens device and a tracking method based on an eyeball tracking technology.
The technical scheme adopted by the invention is as follows: a rotatable lens device comprises a main body part, a lens driving part and a lens driving part, wherein the main body part comprises a cambered surface type rotating seat which is arranged on the main body part; the lens component comprises a lens and an arc-surface-shaped accommodating groove, the lens is fixed in the arc-surface-shaped accommodating groove, the arc-surface-shaped accommodating groove is accommodated in the arc-surface-shaped rotating seat, and the arc-surface-shaped accommodating groove can rotate along the arc-surface-shaped rotating seat; a rotating part disposed between the body part and the lens part to drive the lens part to rotate; and the control component is arranged in the main body component and is electrically connected with the rotating component.
The rotating component comprises a first driving piece, a second driving piece, a first rotating component and a second rotating component, wherein the first driving piece is arranged on the main body component and drives the first rotating component to drive the lens component to rotate left and right along the cambered surface type rotating seat; the second driving piece is arranged on the main body part and drives the second rotating assembly to drive the lens part to rotate up and down along the cambered surface type rotating seat.
The first rotating assembly comprises a rack and a gear which are matched with each other, or a guide rail and a sliding block which are matched with each other, and the second rotating assembly comprises a rack and a gear which are matched with each other, or a guide rail and a sliding block which are matched with each other.
Cambered surface type roating seat includes first cambered surface type roating seat and second cambered surface type roating seat, guide rail or rack are installed in the inboard of first cambered surface type roating seat and/or are installed in the inboard of second cambered surface type roating seat along the fore-and-aft direction along left right direction, slider or gear are fixed in the outside of cambered surface type holding tank or the outside of first cambered surface type roating seat, and with guide rail or rack looks adaptation.
The guide rails comprise a first guide rail and a second guide rail, and two ends of the first guide rail are fixed on the inner side of the cambered surface type rotating seat by taking the axis of the cambered surface type rotating seat as a symmetrical center; the both ends of second guide rail use first guide rail as the symmetric center, fix the inboard at cambered surface type roating seat, the slider includes first slider and second slider, all fixes the outside at cambered surface type holding tank, and with corresponding first guide rail and second guide rail looks adaptation, the inboard swing of cambered surface type roating seat is followed to part homoenergetic between the first guide rail both ends, the part between the second guide rail both ends.
The sliding block is made of magnetic materials, a magnetic block used for fixing the sliding block is correspondingly arranged, and the magnetic block and the sliding block are located on two sides of one surface.
The cambered surface type rotating seat is a shell with a hollow inner part, the sliding block and the corresponding guide rail are hidden in the cambered surface type rotating seat, the sliding block is a magnetic sliding block, and the sliding block and the guide rail can freely swing in the cambered surface type rotating seat.
The cambered surface type rotating seat is a shell with a hollow inner part, the guide rail comprises a first guide rail and a second guide rail, and two ends of the first guide rail are fixed in the cambered surface type rotating seat by taking the axis of the cambered surface type rotating seat as a symmetric center; the both ends of second guide rail use first guide rail as the symmetric center, fix the inside at cambered surface type roating seat, the slider includes first slider and second slider, all fixes the inside at cambered surface type holding tank, and with corresponding first guide rail and second guide rail looks adaptation, the inside swing of cambered surface type roating seat is followed to part homoenergetic between the part between the first guide rail both ends, the second guide rail both ends, the slider is the magnetism material to and correspond the fixed magnetic path that is equipped with one and inhales mutually with the slider in cambered surface type holding tank inboard.
A tracking method based on eyeball tracking technology comprises the following steps:
1) the lens faces to eyes, the head of an observer is required to face the main body part and can move in parallel, the eyes watch the display part, the image at the moment is collected, and the image is sent to the control part;
2) extracting all external eye images in the image by a control component, and performing image noise reduction, rotation and correction;
3) calculating the amount of the iris center point deviating from the outer eye center point by taking the outer eye center point as a reference point, averaging to obtain the eyeball deviation amount, and converting by a formula to obtain the rotation angle of the rotating part;
4) the control part sends the rotation angle to the rotating part to drive the lens part to rotate.
The relationship between the eyeball offset and the rotation angle of the rotating part in the step 3) is specifically calculated as follows:
31) establishing a rectangular coordinate system XOY in the transverse direction of eyes, taking the right direction of an eye corner connecting line as the positive direction of an X axis, taking the center of the connecting line vertically upwards as the positive direction of a Y axis, recording the offset of the eyeball in the X axis as X, and recording the offset of the eyeball in the Y axis as Y;
32) establishing a rectangular coordinate system ZOY in the longitudinal direction of the human eye, taking the eye axis as the Z axis, and the length of the eyeball axis as Z, then the eyeball radius R is Z/2, the left-right offset of the eyeball is y, and the corresponding up-down rotation angle theta 2 of the eyeball is according to the geometrical relation, thus obtaining the right-left rotation angle of the eyeball
Similarly, the eyeball left-right rotation angle θ 1 is:
33) the turning member 3 is two-dimensionally turned, and the attitude angles are a left-right turning angle α 1 and an up-down turning angle α 2, and according to the geometrical relationship, the left-right turning angle α 1 and the up-down turning angle α 2 are respectively:
the direction specification coincides with the eyeball rolling direction.
The invention has the beneficial effects that: the cambered surface type accommodating groove rotates relative to the cambered surface type rotating seat, so that the efficiency is high, and the real-time performance is good; the lens component is controlled by the control component to rotate along with the eyeballs of the observer, so that automatic rotation is realized, and the automatic rotation device is convenient and flexible to operate and accurate and instant in positioning.
Drawings
FIG. 1 is a schematic view of a body member construction of the present invention.
Fig. 2 is one embodiment of the lens assembly of the present invention.
Fig. 3 is one embodiment of the lens assembly of the present invention.
Fig. 4 is one embodiment of the lens assembly of the present invention.
Fig. 5 is one embodiment of the lens assembly of the present invention.
Fig. 6 is a flowchart of the eyeball displacement amount of the present invention.
Fig. 7 is a schematic view of the eye and lens assembly of the present invention.
FIG. 8 is a schematic diagram of the XOY coordinate system of the present invention.
Fig. 9 is a schematic diagram of the YOZ coordinate system of the present invention.
Fig. 10 is a use embodiment of the present invention.
Detailed Description
In the invention, the inner side refers to the outer surface of the concave layer, for example, the inner side of the cambered surface type rotating seat refers to the outer surface of the concave layer of the cambered surface type rotating seat; the outer side refers to the outer surface of the convex layer, for example, the outer side of the cambered surface type rotating seat refers to the outer surface of the convex layer of the cambered surface type rotating seat.
The embodiments of the invention will be further described with reference to the accompanying drawings in which:
as shown in fig. 1 and 2, a rotatable lens apparatus includes a body member 1 including a cambered surface type rotary mount 11, the cambered surface type rotary mount 11 being provided on the body member 1; the lens component 2 comprises a lens 21 and an arc-surface-shaped accommodating groove 22, the lens 21 is fixed in the arc-surface-shaped accommodating groove 22 through screws, the arc-surface-shaped accommodating groove 22 is accommodated in the arc-surface-shaped rotating seat 11, and the arc-surface-shaped accommodating groove 22 can rotate along the arc-surface-shaped rotating seat 11; a rotating member 3 disposed between the body member 1 and the lens member 2 to drive the lens member 2 to rotate; the control component 5 is arranged in the main body component 1 and is electrically connected with the rotating component 3, and the cambered surface type accommodating groove 22 rotates relative to the cambered surface type rotating seat 11, so that the efficiency is high, and the real-time performance is good; the lens component 2 is controlled by the control component 5 to rotate along with the eyeball of the observer, so that automatic rotation is realized, and the automatic rotation device is convenient and flexible to operate and accurate and instant in positioning.
The rotating component 3 can realize one-dimensional rotation and two-dimensional rotation.
As shown in fig. 2, the rotation can be one-dimensional, can be left-right rotated, or can be up-down rotated; the rotating component 3 comprises a driving part and a rotating component, the driving part is arranged on the main body component 1, and the driving rotating component drives the lens component 2 to rotate left and right or up and down along the cambered surface type rotating seat 11.
As shown in fig. 3, the two-dimensional rotation can be realized by both left and right rotation and up and down rotation; the rotating part 3 comprises a first driving part 31, a second driving part 32, a first rotating component and a second rotating component, the first driving part 31 is arranged on the main body part 1, and drives the first rotating component to drive the lens part 2 to rotate left and right along the cambered surface type rotating seat 11; the second driving member 32 is disposed on the main body member 1, drives the second rotating assembly to drive the lens member 2 to rotate up and down along the arc surface type rotating seat 11, and the first driving member 31 and the second driving member 32 are motors, more preferably, servo motors, so as to realize instant emergency stop and accurately control the rotating angles of the first rotating assembly and the second rotating assembly.
The first rotating assembly may comprise a guide rail 41 (or a rack) and a sliding block 42 (or a gear) matched with the guide rail, and the second rotating assembly may also comprise a guide rail 41 (or a rack) and a sliding block 42 (or a gear) matched with the guide rail, wherein one rotating assembly can be allowed to adopt the matching of the guide rail 41 and the sliding block 42, and the other rotating assembly adopts the matching of the rack and the gear.
As shown in fig. 3, 2 arc surface type rotating bases are taken as an example, and the first rotating assembly and the second rotating assembly are matched by a guide rail 41 and a sliding block 42.
The cambered surface type rotating seat 11 includes a first cambered surface type rotating seat 111 and a second cambered surface type rotating seat 112, and the first cambered surface type rotating seat 111 is higher than the second cambered surface type rotating seat 112, one guide rail 41a is installed on the inner side of the first cambered surface type rotating seat 111 along the left-right direction, the other guide rail 41b is installed on the inner side of the second cambered surface type rotating seat 112 along the front-back direction, the sliding block 42a corresponding to the guide rail 41a is fixed on the outer side of the cambered surface type accommodating groove 22, and the sliding block 42b corresponding to the guide rail 41b is fixed on the outer side of the first cambered surface type rotating seat 111. The rotation of lens part 2 relative first cambered surface type roating seat 111 can not cause any influence to second cambered surface type roating seat 112, when first cambered surface type roating seat 111 reciprocates relatively second cambered surface type roating seat 112, the cooperation of guide rail 41a and slider 42a between first cambered surface type roating seat 111 and cambered surface type holding tank 22 just in time constitutes first cambered surface type roating seat 111 spacing to cambered surface type holding tank 22, thereby make first cambered surface type roating seat 111 and cambered surface type holding tank 22 reciprocate relatively second cambered surface type roating seat 112 simultaneously. Similarly, the first cambered surface type rotating base 111 can be rotated up and down, and then the cambered surface type accommodating groove 22 can be rotated left and right; or may be performed simultaneously.
The guide rail 41 is installed on the inner side of the cambered surface type rotating seat 11, and the guide rail 41 can be directly fixed on the outer surface of the inner side of the cambered surface type rotating seat 11, and the guide rail 41 is higher than the inner side of the cambered surface type rotating seat 11; more preferably, the guide rail 41 is embedded into the arc surface type rotating base 11 from the inner side surface of the arc surface type rotating base 11, and the guide rail 41 is flush with the inner side of the arc surface type rotating base 11, or a guide rail groove is directly processed on the inner side of the arc surface type rotating base 11 to form the guide rail 41.
The sliding block 42 may be a common sliding block, and thus, it is directly installed at the corresponding position by a fastening member.
The slider 42 may be a magnetic slider, and a magnetic block 43 for fixing the slider 42 is correspondingly provided, where the magnetic block 43 and the magnetic slider refer to magnetic materials that can attract each other, such as an iron block and a magnet, a magnet and a magnet, and the like, where the magnetic slider may be a slider itself adopting magnetism, or may be formed by fixing the magnetic block on the slider 42.
In the above embodiment, the slider 42a is located outside the arc surface type receiving groove 22, the magnetic block 43a is located inside the arc surface type receiving groove 22 or embedded inside the arc surface type receiving groove 22, the slider 42b is located outside the first arc surface type rotating base 111, the magnetic block 43b is located inside the first arc surface type rotating base 111 or embedded inside the arc surface type receiving groove 22, the slider 42a and the magnetic block 43a are attracted together, the slider 42b and the magnetic block 43b are attracted together, the slider 42a on the guide rail 41a is driven by the first driving member 31, and the slider 42a drives the magnetic block 43a fixed on the arc surface type receiving groove 22, so as to be in transmission connection and control the lens component 1 to rotate left and right around the first arc surface type rotating base 111; similarly, after the left-right rotation is completed, the up-down rotation is completed under the driving of the second driving part 32; or may be performed simultaneously.
As shown in fig. 4, 1 arc surface type rotary base is taken as an example, and the first rotary component and the second rotary component are both matched by a guide rail 41 and a sliding block 42.
The guide rail 41 comprises a first guide rail 411 and a second guide rail 412, and two ends of the first guide rail 411 are fixed on the inner side of the cambered surface type rotating seat 11 by taking the axis of the cambered surface type rotating seat 11 as a symmetric center; the two ends of the second guide rail 412 are fixed at the inner side of the cambered surface type rotating base 11 by taking the first guide rail 411 as a symmetrical center, the sliding block 42 comprises a first sliding block 421 and a second sliding block 422, both fixed on the outer side of the cambered surface type containing groove 22, and is matched with the corresponding first guide rail 411 and second guide rail 412, the portion between two ends of the first guide rail 411 and the portion between two ends of the second guide rail 412 can swing along the inner side of the cambered surface type rotating base 11, and when the left and right rotation is performed, the first sliding block 421 can slide left and right along the first guide rail 411, since the left-right rotation drives the cambered surface type containing groove 22 to generate offset relative to the cambered surface type rotating seat 11, and the second slider 422 is fixed to the arc-shaped receiving groove 22, and rotates with the arc-shaped receiving groove 22, and the second slider 422 is always in contact with the second guide rail 412, so that during the left-right rotation, the second slider 422 drives the portion between the two ends of the second guiding rail 412 to simultaneously shift along the left or right direction; after the left-right rotation is completed, the second sliding block 422 slides up and down along the second guide rail 412, or rotates up and down first and then rotates left and right, and the guide rails are driven by the corresponding sliding blocks to shift to adapt to the rotation in the other direction to be generated.
As shown in fig. 5, 1 cambered surface type rotating base with a hollow inner part is taken as an example, the first rotating assembly and the second rotating assembly are matched by a guide rail 41 and a sliding block 42.
The cambered surface type rotating seat 11 is a hollow shell, the guide rail 41 comprises a first guide rail 411 and a second guide rail 412, and two ends of the first guide rail 411 are fixed inside the cambered surface type rotating seat 11 by taking the axis of the cambered surface type rotating seat as a symmetric center; the both ends of second guide rail 412 use first guide rail 411 as the symmetric center, fix the inside at cambered surface type roating seat 11, slider 42 includes first slider 421 and second slider 422, all fixes the inside at cambered surface type holding tank 22, and with corresponding first guide rail 411 and second guide rail 412 looks adaptation, the inside swing of cambered surface type roating seat 11 can be followed to part between the first guide rail 411 both ends, the part between the second guide rail 412 both ends, slider 42 is the magnetism material to and correspond the fixed magnetic path 43 that is equipped with one and attracts mutually with slider 42 in cambered surface type holding tank 22 inboard.
As shown in fig. 6 and 7, a tracking method based on the eyeball tracking technology includes the following steps:
1) the lens 21 faces the eyes, the head 7 of the observer faces the main body part 1 and can move in parallel, the eyes watch the display part 6, the image at the moment is collected, and the image is sent to the control part 5;
2) extracting all external eye images in the image by a control component 5, and carrying out image noise reduction, rotation and correction;
3) calculating the amount of the iris center point deviating from the outer eye center point by taking the outer eye center point as a reference point, averaging to obtain the eyeball deviation amount, and converting by a formula to obtain the rotation angle of the rotating part 3;
4) the control part 5 sends the turning angle to the turning part 3 to drive the lens part 2 to rotate.
As shown in fig. 8 and 9, the relationship between the eyeball displacement amount and the rotation angle of the rotating member 3 in step 3) is calculated as follows:
31) for simplicity, a rectangular coordinate system XOY is established in the transverse direction of human eyes, the right direction of a line connecting the eye corners is taken as the positive direction of an X axis, the center of the line is vertically upward taken as the positive direction of a Y axis, and the eyeball offset is recorded as (X, Y);
32) because the eyeball of the human eye is an axial (eye axis) symmetry system, for the sake of simplicity, a longitudinal section of the human eye is taken for analysis, a rectangular coordinate system ZOY is established in the longitudinal direction of the human eye, the eye axis is taken as a Z axis, the length of the eye axis of the human eye is recorded as Z, the length Z of the eye axis (the distance between the cornea and the retina) of the normal human eye is known to be about 24mm, the eyeball of the human eye is approximately spherical, the rotation of the eyeball is controlled by six muscles beside the eyeball, the eyeball rotates approximately around the center of the eyeball (the sphere center of the eyeball), the radius R of the eyeball is Z/2 which is 12mm, the left-right offset of the eyeball is assumed to be y, and the corresponding up-down rotation angle theta 2 of the eyeball is
Similarly, the eyeball left-right rotation angle θ 1 is:
33) the rotation component 3 is two-dimensional rotation, the posture angle is a left-right rotation angle α 1 and an up-down rotation angle α 2, the rotation mode is consistent with the eyeball rotation mode, the eyeball rotation angle is the same as the lens component rotation angle by simulating the human eye rotation, and according to the geometrical relationship, the left-right rotation angle α 1 and the up-down rotation angle α 2 are respectively:
the direction specification coincides with the eyeball rolling direction.
The main body part 1 may be any suitable product, and may be an electronic product such as a mobile phone, a tablet computer, a notebook computer, and the like.
In order to realize that the lens can rotate intelligently and actively along with eyeballs of human eyes of an observer so as to realize full visual angle and free observation of the environment around the observed person, of course, the active rotation can be realized by setting an authorization program in the corresponding main body component 1, and the rotatable lens device can rotate actively only in the state that the authorization program is started. In the embodiment of the invention, the specific eyeball tracking method and steps in the video chat process are as follows:
as shown in fig. 10, assuming that a is used as an observer, B is used as an observed person, and the head a7 of the observer faces the main body component a1, first, the function of automatically tracking the lens of the observed person along with the eyeball of the observer is started by authorization of the observed person, the face video collected by the lens component a2 is sent to the main body component B1 through the main body component a1, and at the same time, the control component B5 collects the image at that time, extracts all the images of the outer eye in the image, performs image preprocessing such as image noise reduction, rotation and correction, analyzes the center of the outer eye and the center of the iris, calculates the amount of the center point of the iris deviating from the center point of the outer eye with the center point of the outer eye as a reference point, and averages; secondly, performing formula conversion according to the relation between the eyeball offset and the rotation angle of the rotating component B3, analyzing the angle of the lens component B2 needing to rotate, transmitting the calculated rotation angle to the rotating component B3, and driving the lens component B1 to rotate; then the video shot by the B lens is transmitted to the main body part A1, the main body part A1 is displayed through the display part A6, the observer A can see the scenery on the side of the other side which is expected to be seen, finally, the observer A can observe the display part A6 through translating the head part A7, the eyes of the observer A focus on the display part A3625, the head part A7 is opposite to the main body part A1, and the steps are repeated, so that the observation of different angles of the B area is realized. Similarly, the observer B can view the scene of the observer a through the display unit B6.
The embodiments described above with reference to the drawings are only preferred embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications made based on the spirit of the present invention should be construed as being within the scope of the present invention.
Claims (3)
1. A tracking method based on an eyeball tracking technology is characterized in that: it employs 2 rotatable lens devices each including
A main body member (1) including a cambered surface type rotating seat (11), the cambered surface type rotating seat (11) being provided on the main body member (1);
the lens component (2) comprises a lens (21) and an arc-surface-shaped accommodating groove (22), the lens (21) is fixed in the arc-surface-shaped accommodating groove (22), the arc-surface-shaped accommodating groove (22) is accommodated in the arc-surface-shaped rotating seat (11), and the arc-surface-shaped accommodating groove (22) can rotate along the arc-surface-shaped rotating seat (11);
a rotating member (3) disposed between the main body member (1) and the lens member (2) to drive the lens member (2) to rotate;
a control member (5) which is provided inside the main body member (1) and electrically connected to the rotating member (3);
the rotating part (3) comprises a first driving part (31), a second driving part (32), a first rotating assembly and a second rotating assembly,
the first driving piece (31) is arranged on the main body part (1) and drives the first rotating assembly to drive the lens part (2) to rotate left and right;
the second driving piece (32) is arranged on the main body part (1) and drives the second rotating assembly to drive the lens part (2) to rotate up and down;
the first rotating assembly comprises a rack and a gear which are matched with each other, or a guide rail (41) and a sliding block (42) which are matched with each other, and the second rotating assembly comprises a rack and a gear which are matched with each other, or a guide rail (41) and a sliding block (42) which are matched with each other;
the guide rail (41) comprises a first guide rail (411) and a second guide rail (412), and two ends of the first guide rail (411) are fixed on the inner side of the cambered surface type rotating seat (11) by taking the axis of the cambered surface type rotating seat as a symmetric center; the two ends of the second guide rail (412) are fixed on the inner side of the cambered surface type rotating seat (11) by taking the first guide rail (411) as a symmetric center, the sliding block (42) comprises a first sliding block (421) and a second sliding block (422), the first sliding block and the second sliding block are both fixed on the outer side of the cambered surface type accommodating groove (22) and are matched with the corresponding first guide rail (411) and the second guide rail (412), and the part between the two ends of the first guide rail (411) and the part between the two ends of the second guide rail (412) can swing along the inner side of the cambered surface type rotating seat (11);
the method comprises the following steps:
1) a control unit (5) for capturing a real-time image of the observer's eyes with the lens (21) of the observer's eyes facing the observer's eyes and transmitting the image to the observer's eyes;
2) extracting all external eye images in the image by a control part (5) of an observed person, and performing image noise reduction, rotation and correction;
3) calculating the amount of the center point of the iris deviating from the center point of the outer eye by taking the center point of the outer eye as a reference point, averaging to obtain the eyeball deviation amount, and converting by a formula to obtain the rotation angle of the rotating part (3) of the observed person;
4) the control part (5) of the observed person sends the rotation angle to the rotating part (3) of the observed person to drive the lens part (2) of the observed person to rotate, then the scenery shot by the lens part (2) of the observed person at the moment is transmitted to the main body part (1) of the observed person, the main body part (1) of the observed person is displayed by the display part (6) of the observed person, and the observer can see the scenery hopefully seen by the observed person.
2. The eyeball tracking technology-based tracking method according to claim 1, wherein: the sliding block (42) is made of magnetic materials, a magnetic block (43) used for fixing the sliding block (42) is correspondingly arranged, and the magnetic block (43) and the sliding block (42) are located on the inner side and the outer side of the cambered surface type containing groove (22).
3. The eyeball tracking technology-based tracking method according to claim 2, wherein: the relation between the eyeball offset and the rotation angle of the rotating part (3) in the step 3) is specifically calculated as follows:
31) establishing a rectangular coordinate system XOY in the transverse direction of eyes, taking the right direction of an eye corner connecting line as the positive direction of an X axis, taking the center of the connecting line vertically upwards as the positive direction of a Y axis, recording the offset of the eyeball in the X axis as X, and recording the offset of the eyeball in the Y axis as Y;
32) establishing a rectangular coordinate system ZOY in the longitudinal direction of the human eye, taking the eye axis as the Z axis, and the length of the eyeball axis as Z, then the eyeball radius R is Z/2, the left-right offset of the eyeball is y, and the corresponding up-down rotation angle theta 2 of the eyeball is according to the geometrical relation, thus obtaining the right-left rotation angle of the eyeball
Similarly, the eyeball left-right rotation angle θ 1 is:
33) the turning member 3 is two-dimensionally turned, and the attitude angles are a left-right turning angle α 1 and an up-down turning angle α 2, and according to the geometrical relationship, the left-right turning angle α 1 and the up-down turning angle α 2 are respectively:
the direction specification coincides with the eyeball rolling direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810184255.6A CN108387993B (en) | 2016-04-01 | 2016-04-01 | Rotatable lens device and tracking method based on eyeball tracking technology |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610205550.6A CN105700103B (en) | 2016-04-01 | 2016-04-01 | A kind of rotatable lens assembly and the tracking based on eye tracking technology |
| CN201810184255.6A CN108387993B (en) | 2016-04-01 | 2016-04-01 | Rotatable lens device and tracking method based on eyeball tracking technology |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610205550.6A Division CN105700103B (en) | 2016-04-01 | 2016-04-01 | A kind of rotatable lens assembly and the tracking based on eye tracking technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108387993A CN108387993A (en) | 2018-08-10 |
| CN108387993B true CN108387993B (en) | 2020-09-18 |
Family
ID=56219010
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610205550.6A Active CN105700103B (en) | 2016-04-01 | 2016-04-01 | A kind of rotatable lens assembly and the tracking based on eye tracking technology |
| CN201810184255.6A Active CN108387993B (en) | 2016-04-01 | 2016-04-01 | Rotatable lens device and tracking method based on eyeball tracking technology |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610205550.6A Active CN105700103B (en) | 2016-04-01 | 2016-04-01 | A kind of rotatable lens assembly and the tracking based on eye tracking technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN105700103B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107875526B (en) * | 2017-11-27 | 2020-01-24 | 温州医科大学附属第一医院 | Accurate control method of radiotherapy instrument in self-adaptive radiotherapy of eye tumor |
| CN110995908B (en) | 2020-01-07 | 2021-08-03 | 维沃移动通信有限公司 | Electronic equipment, photographing method and photographing device |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1984246A (en) * | 2006-04-18 | 2007-06-20 | 华为技术有限公司 | Camera |
| CN101282699A (en) * | 2005-08-25 | 2008-10-08 | 卡尔蔡司医疗技术股份公司 | Contact glass for ophthalmic surgery |
| US7446813B2 (en) * | 2003-07-25 | 2008-11-04 | Kabushiki Kaisha Toshiba | Active camera apparatus and robot apparatus |
| CN202168140U (en) * | 2011-07-04 | 2012-03-14 | 鸿富锦精密工业（深圳）有限公司 | Device for adjusting angle of pick-up head |
| CN102599934A (en) * | 2012-03-13 | 2012-07-25 | 华中科技大学 | Data acquisition device of three-dimensional ultrasound image based on rear-end scanning |
| CN102822714A (en) * | 2010-10-26 | 2012-12-12 | 松下电器产业株式会社 | Lens unit |
| CN202806604U (en) * | 2012-07-27 | 2013-03-20 | 长城汽车股份有限公司 | Angle-adjustable back-up camera |
| CN103072140A (en) * | 2012-12-18 | 2013-05-01 | 北京理工大学 | Binocular three-dimensional bionic eye mechanism with panoramic capture and positioning functions |
| CN103353663A (en) * | 2013-06-28 | 2013-10-16 | 北京智谷睿拓技术服务有限公司 | Imaging adjustment apparatus and method |
| CN203759720U (en) * | 2013-11-18 | 2014-08-06 | 原相科技股份有限公司 | Image acquisition module |
| KR20150018924A (en) * | 2013-08-09 | 2015-02-25 | 한국전자통신연구원 | Shape-variable optical element |
| JP2015052772A (en) * | 2013-08-06 | 2015-03-19 | 孝郎 林 | Eyesight correction device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7307798B2 (en) * | 2003-07-29 | 2007-12-11 | The Brunton Company | Multi-step locking eye cup twist up device |
| CN201170835Y (en) * | 2008-03-13 | 2008-12-24 | 深圳市同洲电子股份有限公司 | Camera |
| CN101732870A (en) * | 2008-11-07 | 2010-06-16 | 鸿富锦精密工业（深圳）有限公司 | Simulated eye |
| CN101670584B (en) * | 2009-09-25 | 2011-06-08 | 上海大学 | Bionic mechanical eyeball |
| CN202548498U (en) * | 2012-05-03 | 2012-11-21 | 合硕科技股份有限公司 | Spherical lens device capable of automatically tracking and focusing |
| CN103209287A (en) * | 2013-03-11 | 2013-07-17 | 张国柱 | Photographing method of regulation and control camera lens, special camera and special glasses frame |
| JP6072621B2 (en) * | 2013-06-18 | 2017-02-01 | オリンパス株式会社 | Imaging device and control method thereof |
| CN104199553B (en) * | 2014-09-15 | 2016-01-27 | 苏州思源科安信息技术有限公司 | For guiding instruction human-computer interface device and the method for mobile terminal iris recognition |
| CN204775056U (en) * | 2015-06-15 | 2015-11-18 | 金百盛电子科技（深圳）有限公司 | Electronic equipment for multi -function vehicle |
| CN105243362A (en) * | 2015-09-23 | 2016-01-13 | 努比亚技术有限公司 | Camera control apparatus and method |
-
2016
- 2016-04-01 CN CN201610205550.6A patent/CN105700103B/en active Active
- 2016-04-01 CN CN201810184255.6A patent/CN108387993B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7446813B2 (en) * | 2003-07-25 | 2008-11-04 | Kabushiki Kaisha Toshiba | Active camera apparatus and robot apparatus |
| CN101282699A (en) * | 2005-08-25 | 2008-10-08 | 卡尔蔡司医疗技术股份公司 | Contact glass for ophthalmic surgery |
| CN1984246A (en) * | 2006-04-18 | 2007-06-20 | 华为技术有限公司 | Camera |
| CN102822714A (en) * | 2010-10-26 | 2012-12-12 | 松下电器产业株式会社 | Lens unit |
| CN202168140U (en) * | 2011-07-04 | 2012-03-14 | 鸿富锦精密工业（深圳）有限公司 | Device for adjusting angle of pick-up head |
| CN102599934A (en) * | 2012-03-13 | 2012-07-25 | 华中科技大学 | Data acquisition device of three-dimensional ultrasound image based on rear-end scanning |
| CN202806604U (en) * | 2012-07-27 | 2013-03-20 | 长城汽车股份有限公司 | Angle-adjustable back-up camera |
| CN103072140A (en) * | 2012-12-18 | 2013-05-01 | 北京理工大学 | Binocular three-dimensional bionic eye mechanism with panoramic capture and positioning functions |
| CN103353663A (en) * | 2013-06-28 | 2013-10-16 | 北京智谷睿拓技术服务有限公司 | Imaging adjustment apparatus and method |
| JP2015052772A (en) * | 2013-08-06 | 2015-03-19 | 孝郎 林 | Eyesight correction device |
| KR20150018924A (en) * | 2013-08-09 | 2015-02-25 | 한국전자통신연구원 | Shape-variable optical element |
| CN203759720U (en) * | 2013-11-18 | 2014-08-06 | 原相科技股份有限公司 | Image acquisition module |
Non-Patent Citations (1)
| Title |
|---|
| 高帧频紧凑型自适应光学扫描激光检眼镜;江慧绿;《光学学报》;20151130;第35卷(第11期);第1117002-3-1117002-8页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105700103A (en) | 2016-06-22 |
| CN108387993A (en) | 2018-08-10 |
| CN105700103B (en) | 2018-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9441781B2 (en) | Positioning apparatus for photographic and video imaging and recording and system utilizing same | |
| CN109285216B (en) | Method and device for generating three-dimensional face image based on shielding image and electronic equipment | |
| US20140135062A1 (en) | Positioning apparatus for photographic and video imaging and recording and system utilizing same | |
| CN111787207B (en) | Miniature camera with two-direction free rotation and camera shooting method | |
| WO2013123725A1 (en) | Mobile device | |
| CN108614638A (en) | AR imaging methods and device | |
| CN108377398B (en) | Infrared-based AR imaging method and system and electronic equipment | |
| CN108387993B (en) | Rotatable lens device and tracking method based on eyeball tracking technology | |
| DE102016005917A1 (en) | Camera of any kind, preferably designed for a mobile phone | |
| CN110324553A (en) | Outdoor scene window system based on video communication | |
| DE102016004665A1 (en) | Image or video recording device with a camera with a digital image sensor | |
| CN110324554A (en) | Video communication device and method | |
| CN106851252A (en) | Adaptive strain baseline binocular solid camera system | |
| CN105739053A (en) | Closed loop double drive automatic focusing device used by double cameras | |
| CN108615243B (en) | Method, device and system for determining stereoscopic multimedia information | |
| CN116661149A (en) | AR enhancement display device with vision correction function | |
| CN206658265U (en) | Adaptive strain baseline binocular solid camera system | |
| CN108337466B (en) | Video call method and electronic equipment | |
| CN106713898B (en) | Three-lens panoramic 3D camera | |
| CN205507192U (en) | Closed loop dual drive auto focus device that two cameras used | |
| CN114584742A (en) | Video monitoring device | |
| DE102016004676A1 (en) | Camera system for a mobile phone / mobile / smartphone | |
| CN105739054A (en) | Closed loop single drive automatic focusing device used by double cameras | |
| CN109309827B (en) | Multi-user real-time tracking device and method for 360-degree suspended light field three-dimensional display system | |
| DE202016002484U1 (en) | Image or video recording device with a camera with a digital image sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |