CN112244762A - Pupil tracking system and method in sleep state - Google Patents
Pupil tracking system and method in sleep state Download PDFInfo
- Publication number
- CN112244762A CN112244762A CN202011157047.0A CN202011157047A CN112244762A CN 112244762 A CN112244762 A CN 112244762A CN 202011157047 A CN202011157047 A CN 202011157047A CN 112244762 A CN112244762 A CN 112244762A
- Authority
- CN
- China
- Prior art keywords
- pupil
- tracking
- shooting
- head fixing
- transparent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000001747 pupil Anatomy 0.000 title claims abstract description 150
- 230000007958 sleep Effects 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 title claims abstract description 25
- 210000003128 head Anatomy 0.000 claims description 48
- 230000033001 locomotion Effects 0.000 claims description 8
- 230000000452 restraining effect Effects 0.000 claims description 8
- 210000003625 skull Anatomy 0.000 claims description 8
- 230000001678 irradiating effect Effects 0.000 claims description 5
- 238000002474 experimental method Methods 0.000 abstract description 17
- 230000000694 effects Effects 0.000 abstract description 12
- 210000005036 nerve Anatomy 0.000 abstract description 5
- 241000699666 Mus <mouse, genus> Species 0.000 description 14
- 238000005286 illumination Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 7
- 210000001508 eye Anatomy 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 210000001525 retina Anatomy 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 210000004556 brain Anatomy 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 210000004087 cornea Anatomy 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000002310 reflectometry Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000028327 secretion Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 229920000049 Carbon (fiber) Polymers 0.000 description 1
- 208000003556 Dry Eye Syndromes Diseases 0.000 description 1
- 206010013774 Dry eye Diseases 0.000 description 1
- 241000699670 Mus sp. Species 0.000 description 1
- 206010064996 Ulcerative keratitis Diseases 0.000 description 1
- 241001504424 Zosteropidae Species 0.000 description 1
- 238000010171 animal model Methods 0.000 description 1
- 230000037007 arousal Effects 0.000 description 1
- 230000006383 arousal process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 210000004958 brain cell Anatomy 0.000 description 1
- 239000004917 carbon fiber Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 201000007717 corneal ulcer Diseases 0.000 description 1
- 230000026058 directional locomotion Effects 0.000 description 1
- 230000002740 effect on eyes Effects 0.000 description 1
- 238000002567 electromyography Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000037308 hair color Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 description 1
- 210000001087 myotubule Anatomy 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000007230 neural mechanism Effects 0.000 description 1
- 238000002610 neuroimaging Methods 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001179 pupillary effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006748 scratching Methods 0.000 description 1
- 230000002393 scratching effect Effects 0.000 description 1
- 208000019116 sleep disease Diseases 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/11—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils
- A61B3/112—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils for measuring diameter of pupils
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0008—Apparatus for testing the eyes; Instruments for examining the eyes provided with illuminating means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0075—Apparatus for testing the eyes; Instruments for examining the eyes provided with adjusting devices, e.g. operated by control lever
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0083—Apparatus for testing the eyes; Instruments for examining the eyes provided with means for patient positioning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4806—Sleep evaluation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/40—Animals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/42—Evaluating a particular growth phase or type of persons or animals for laboratory research
Abstract
The embodiment of the invention discloses a pupil tracking system and a pupil tracking method in a sleep state, wherein the system comprises: transparent constraining means for constraining an active region of the tracked object; the shooting device is provided with a coaxial light source to irradiate the pupil of the tracking object and shoot the pupil image of the tracking object in a sleeping state; and one end of the control device is connected with the shooting device and is used for controlling the shooting position of the shooting device so that the shooting device can carry out tracking shooting on the pupil of the tracking object. According to the technical scheme of the embodiment of the invention, the pupil tracking is carried out by the coaxial light source arranged on the shooting device, the pupil tracking without direct contact with a tracking object can be realized, the realization of other nerve experiments can not be hindered, and the technical effect of continuously carrying out the long-time pupil tracking for ten hours to tens of hours can be achieved by adopting the system.
Description
Technical Field
The embodiment of the invention relates to the technical field, in particular to a pupil tracking system and a pupil tracking method in a sleep state.
Background
In daily life, sleep disorders tend to significantly reduce the quality of life. Therefore, studies on sleep are particularly important. In sleep research, pupillary measurement is recognized as a noninvasive, sensitive and robust method for quantifying the arousal level, and is used for researching internal and external factors influencing the brain arousal process in a waking state and neural mechanisms. The animal most frequently selected for research is a mouse, but the mouse has no white eyes, and the hair color of the mouse is the same as the color of the iris and the pupil of the eye, so that the difficulty is caused in separating and extracting the pupil in the eye movement tracking process. Currently, there are two types of methods for pupil tracking to separate pupils, one is a dark pupil mode and the other is a bright pupil mode.
The dark pupil mode utilizes a high-power light source to illuminate laterally, the hair and the iris of a mouse reflect light, the transparent pupil penetrates light, the direction of the light which is transmitted reversely is different from the direction of a shooting device and cannot be shot, so the pupil is dark, and the pupil is distinguished from the iris. The biological heat effect of the near infrared light is obvious, and the mice are easy to have dry eyes and corneal ulcer under the high-power infrared light, so that the visual stimulation given by the experiment is influenced.
The two-photon brain imaging needs stronger near-infrared laser to irradiate the brain, and the near-infrared laser can reach the eyeball along the optic nerve and is emitted out through the pupil to present the bright pupil, while the other part of the eyeball is opaque, and the color is darker. However, the two-photon experiment needs to be carefully ground to penetrate the skull and then sealed by a slide, so that the technical requirement on experimenters is high, if bright pupils are realized by directly fixing the LEDs above the skull, the layer-by-layer scattered light penetrates the pupils to be recorded, the required LED power is high, the high-power LEDs generate extremely strong heat and can generate heat effect on delicate brain cells to further influence the experimental result, and the bright pupil tracking mode needs to fix the LEDs and the light collecting device above the skull of a mouse, occupies a large part of the brain of the mouse, and prevents the use of other nerve experimental techniques.
Disclosure of Invention
The embodiment of the invention provides a pupil tracking system and a pupil tracking method in a sleep state, which aim to solve the technical problems that a high-power light source adopted in a related pupil tracking technology influences pupil tracking time, tracking results and the like, can realize long-time continuous pupil tracking, and can reduce the damage of the light source to pupils on the premise of realizing bright pupils, thereby ensuring the pupil tracking effect.
In a first aspect, an embodiment of the present invention provides a pupil tracking system in a sleep state, where the system includes:
transparent constraining means for constraining an active region of the tracked object;
the photographing device is provided with a coaxial light source and is used for irradiating the pupil of the tracking object through the coaxial light source and photographing the pupil image of the tracking object in a sleeping state;
and one end of the control device is connected with the shooting device and is used for controlling the shooting position of the shooting device so that the shooting device can carry out tracking shooting on the pupil of the tracking object.
Optionally, the system further comprises: a head fixing device; the head fixing device comprises a head fixing rod and a head fixing piece, wherein the fixing piece is fixedly arranged on the skull of the tracked object, and the head fixing rod is detachably connected with the head fixing piece and used for fixing the head of the tracked object through the head fixing piece when the tracked object is in a sleeping state.
Optionally, the control device includes a first stepping motor and a second stepping motor, wherein the first stepping motor is configured to control a shooting angle of the shooting device relative to the transparent constraint device, and the second stepping motor is configured to control a shooting height of the shooting device relative to the transparent constraint device.
Optionally, the control device includes a linkage rod with a parallelogram structure, and one end of the first stepping motor and one end of the second stepping motor are connected to the shooting device through the linkage rod respectively.
Optionally, the system further comprises: and the shading device is provided with a shading layer and is used for accommodating the transparent restraining device, the shooting device and the control device.
Optionally, the first stepping motor is located above the center of the tracked object moving area, and is fixed to the light shielding device through a motor fixing seat.
Optionally, a lighting device is arranged in the shading device.
Optionally, the system further comprises: and the carrying platform is used for carrying the transparent constraint device.
In a second aspect, an embodiment of the present invention further provides a pupil tracking method in a sleep state, where the apparatus includes:
constraining an active region of the tracked object by a transparent constraining means;
irradiating the pupil of the tracking object through a coaxial light source of a shooting device, and shooting a pupil image of the tracking object in a sleeping state;
and controlling the shooting position of the shooting device through a control device so that the shooting device carries out tracking shooting on the pupil of the tracking object.
Optionally, the controlling the shooting position of the shooting device by the control device includes:
when the pupil of the tracking object moves, determining the rotation angle of the pupil based on the pupil image;
determining an adjustment angle of the control device based on the rotation angle of the pupil;
and adjusting the shooting position of the shooting device through the control device according to the adjustment angle.
According to the technical scheme of the embodiment of the invention, the original high-power lateral light source or the light source fixed on the head of the tracking object is replaced by the coaxial light illumination, the coaxial light source keeps a certain distance from the tracking object, the head of the tracking object does not need to be contacted, other nerve experiment operations are not hindered, and the experiment record is not interfered because the cornea of the tracking object is burnt or excessive secretion is generated due to overlarge light intensity. By adopting the system, long-time pupil tracking for ten hours to tens of hours can be continuously carried out, the technical problems that the time and the result of pupil tracking are influenced by adopting a high-power light source in the related pupil tracking technology are solved, the long-time continuous tracking can be realized, and the damage of the light source to the pupil can be reduced on the premise of realizing bright pupil, so that the pupil tracking effect is ensured.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, a brief description is given below of the drawings used in describing the embodiments. It should be clear that the described figures are only views of some of the embodiments of the invention to be described, not all, and that for a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 is a schematic structural diagram of a pupil tracking system in a sleep state according to a first embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a principle of tracking a bright pupil based on a coaxial light source according to a first embodiment of the present invention;
fig. 3 is a schematic structural diagram of another sleep state pupil tracking system according to an embodiment of the present invention;
fig. 4 is a schematic view of an installation structure of a first stepping motor and a second stepping motor according to a first embodiment of the present invention;
FIG. 5 is a schematic diagram of a head of a tracked object fixed by a head fixing device according to an embodiment of the present invention;
fig. 6 is a flowchart illustrating a pupil tracking method in a sleep state according to a second embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a schematic structural diagram of a pupil tracking system in a sleep state according to an embodiment of the present invention. As shown in fig. 1, the pupil tracking system provided in this embodiment includes: a transparent constraint device 11, a camera device 12 and a control device 13. Wherein, the transparent constraint device 11 is used for constraining the activity area of the tracking object; a photographing device 12 provided with a coaxial light source, configured to irradiate the pupil of the tracking object with the coaxial light source, and photograph a pupil image of the tracking object in a sleep state; and a control device 13, one end of which is connected to the imaging device 12, for controlling the imaging position of the imaging device 12 so that the imaging device 12 performs tracking imaging on the pupil of the tracking target. The tracking object can be an experimental animal selected by the user according to the self requirement, and can be a mouse, for example.
Fig. 2 is a schematic diagram illustrating a principle of tracking a bright pupil based on a coaxial light source according to this embodiment. The shooting device can load a coaxial light source module in front of a common lens, and can also directly adopt a coaxial optical lens as shown in figure 2. The power is supplied by a battery or a power line 214, and the light emitted by the coaxial light source 212 is reflected by the half-transmitting mirror 213 at 90 degrees and then is in the same direction with the central axis of the shooting device and the lens to illuminate an object in front of the lens. The light striking the eye passes through the aperture in the center of pupil 221 and reaches retina 222. Due to the high light reflectance of the retina 222, most of the light can be reflected and pass through the pupil to reach the camera, and the bright pupil is displayed on the image. Many muscle fibers in the iris 223 around the pupil 221 are criss-crossed, rough, slightly weak in reflected light, dark in color, and thus distinguishable from a bright pupil. If a light source which forms a certain included angle with the shooting device is used instead of coaxial light, strong reflected light on the retina is reflected back to the direction of the light source due to the blocking of the peripheral structure of the pupil, so that the light cannot reach the shooting device, and the shot pupil only can present a dim image.
According to the technical scheme of the embodiment of the invention, the difference between the high reflectivity of the retina and the low reflectivity of the iris is utilized, the contrast of the bright pupil is high, the bright pupil is easy to separate from the iris boundary, and the measured result of the darker pupil is more accurate. Moreover, experiments show that for the same tracking object, a dark pupil formed by high-power side illumination and a bright pupil formed by illumination of the coaxial light source provided by the embodiment of the invention respectively need only about 1/2 to 2/3 of side light in coaxial light power under the same contrast ratio of the pupil and the iris. Only needs a near infrared light source with smaller power, has weaker heat effect on eyes and smaller interference on experiments, and can prolong the experiment time from two hours to three hours to continuously record tens of hours to tens of hours. Under the same illumination intensity, the technical scheme of the embodiment of the invention meets the requirement of a shooting device with higher speed, and can improve the pupil tracking speed of the tracked object from 30-60 frames/second to 1000 frames/second.
For example, when shooting, a lens and a high-pixel camera with proper focal length can be selected as the shooting device, the shooting range of the shooting device is equal to the size of the transparent constraint device for the movement of the tracking object, and the tracking object at any position in the transparent constraint device can be shot.
In the embodiment of the present invention, the transparent constraint device is made of a transparent material, and is used for transmitting the illumination light and shooting. The shape of the transparent constraint device can be regular or irregular such as a cylinder, a cuboid, a cube, and the like, and the specific shape is set according to actual requirements, which is not limited herein. Optionally, the edge portion inside the transparent constraint device may be provided with a smooth structure to avoid scratching the tracking object. It should be noted that the transparent constraint device is a non-enclosed device, and for example, the transparent constraint device may be configured as an open structure at the upper end, or the transparent constraint device is provided with at least one through hole, so as to ensure air circulation in the transparent constraint device.
Considering that it may be necessary to adjust the position of the moving transparent restraining device, a moving part may be provided to the moving transparent restraining device, and the moving part may include at least two wheels to facilitate easy movement of the transparent restraining device. The moving part may also include a pulley, a slide rail, and the like for controlling the directional movement of the transparent constraint device, if it is required to control the moving direction of the transparent constraint device. Taking the transparent constraint device as a cylinder structure with an open upper end as an example, the inner side of the bottom can be used for bearing a tracked object, and the adjacent edge of the outer side of the bottom can be provided with two or more wheels for sliding the movable constraint device.
Optionally, the bottom of the transparent constraint device may be mounted with a fixing component for fixing the relative position of the constraint transparent device between the platforms carrying the constraint transparent device.
Because the freely moving tracking object is more consistent with the natural state, in order to enable the pupil tracking system of the embodiment of the invention to better realize the pupil tracking under the free movement of the tracking object so as to realize the sleep recording of the moving tracking object, the embodiment of the invention restricts the moving area of the tracking object through the transparent restraint device, so that the moving range is limited because the tracking object moves in the transparent restraint device, and the shooting distance of the shooting device is relatively far, and the pupil measurement error caused by the movement of the tracking object can be effectively reduced.
Fig. 3 is a schematic structural diagram of another sleep state pupil tracking system according to an embodiment of the present invention. Considering that there may be a plurality of neural experiments implemented based on the same tracking object in practical application, in order to optimize the experiment resource configuration, the pupil tracking system of the present application may be fused with other experiment systems. As shown in fig. 3, the pupil tracking system provided in the embodiment of the present invention may further include: a carrier 14 for carrying the transparent constraint device 11. The advantage of this setting is that the moving range of transparent restraint device 11 can be restricted through stage 14, and the system building space is provided for other experiments while pupil tracking is not disturbed.
Optionally, the control device includes a driving module and a linkage module, wherein the driving module sends a driving signal for adjusting the shooting position of the shooting device, and the connection module is connected to the driving module and the shooting device, respectively, and is configured to receive the driving signal sent by the driving module and control the shooting device to adjust to the shooting position according to the driving signal. In particular, the drive module may comprise at least one drive motor. Illustratively, the driving motor may be a stepping motor. In the embodiment of the present invention, the photographing position may include a photographing angle of the lens with respect to the transparent constraint device, a photographing height, and the like.
In order to enable the control device 13 to flexibly adjust the imaging position of the imaging device 12. Specifically, the control device 13 includes a first stepping motor 131 and a second stepping motor 132, wherein the first stepping motor 131 is used for controlling the photographing angle of the photographing device 12 with respect to the transparent restraining device 11. Specifically, the first stepping motor 131 may control the photographing device 12 to rotate around the transparent constraint device 11. The second stepping motor 132 is used to control the photographing height of the photographing device 12 with respect to the transparent constraint device 11.
Optionally, the control device includes a linkage rod 134 having a parallelogram structure, and one end of each of the first stepping motor 131 and the second stepping motor 132 is connected to the photographing device 12 through the linkage rod 134. Namely, the photographing device for tracking the pupil can be fixed on the linkage rod of the parallelogram structure. And then adjusting the shooting device to the position right facing the pupil, and collecting and analyzing the pupil image in real time. The linkage rod 134 adopting the parallelogram structure can enable the shooting range of the shooting device to be relatively fixed.
In the embodiment of the present invention, the perpendicular projection of the first stepping motor on the moving plane of the tracking object may at least partially overlap with the perpendicular projection of the first stepping motor on the moving plane of the tracking object, which is advantageous in that the shooting range of the shooting device may be fixed to the perpendicular projection area of the first stepping motor 131 on the moving plane of the tracking object, and smooth pupil tracking may be better assisted based on the relatively fixed shooting range.
Because the pupil tracking system of the embodiment of the present invention is used for tracking the pupil of the object in the sleep state, in order to achieve a good sleep environment and reduce the influence of external environmental factors on pupil tracking, the pupil tracking system of the embodiment of the present invention may further include: and a light shielding device 15 provided with a light shielding layer for accommodating the transparent constraint device 11, the photographing device 12 and the control device. The advantage of this arrangement is that pupil tracking can be performed in a stable environment, so as to ensure smooth implementation of pupil tracking.
On this basis, specifically, the first stepping motor 131 is fixed to the shade 15 by the motor fixing base 133, wherein the first stepping motor 131 is directly above the center of the moving region of the tracking target. Always aligned with the area under the first stepping motor 131, encompassing the transparent restraint area, to prevent the animal from leaving the shooting range. It should be noted that the first stepping motor 131 may be fixed to other devices or apparatuses as long as precise control of the photographing device is ensured.
Fig. 4 is a schematic view of an installation structure of a first stepping motor and a second stepping motor according to a first embodiment of the present invention. As shown in fig. 4, optionally, the second stepping motor 132 is fixed on the first stepping motor 131 through a connecting fixing base 135, wherein a slide rail 136 is provided on the connecting fixing base 135 for moving the second stepping motor when adjusting the shooting height of the shooting device 12.
In view of the light shielding effect of the light shielding device 15, optionally, a lighting device 16 is provided inside the light shielding device 15. This has the advantage that the light source may be provided by the illumination device 16 when illumination conditions are required during implementation of pupil tracking or during implementation of other collaborative experiments.
Fig. 5 is a schematic structural view of a head of a tracking target fixed by a head fixing device according to an embodiment of the present invention, and as shown in fig. 5, in order to ensure a tracking effect of pupil tracking when the tracking target is in a sleep state, the pupil tracking system according to an embodiment of the present invention may further include: a head fixation device 17. The head fixing device 17 includes a head fixing rod and a head fixing member, wherein one end of the head fixing member is fixedly disposed on the skull bone of the tracking object, for example, one end of the head fixing member can be adhered to the skull bone of the tracking object, and one end of the head fixing rod is detachably connected to the head fixing member, and is used for fixing the head of the tracking object through the head fixing member when the tracking object is in a sleeping state. It should be noted that the other end of the head fixing rod may be fixed on the light shielding device 15, or may be fixed on other specified equipment or device, and may be set by a user according to actual needs, which is not specifically limited herein.
In order to ensure a good tracking effect, the head of the tracking object is fixed based on the head fixing device, and then the tracking object can select a relatively comfortable sleeping posture to fall asleep. The method mainly considers that part of sleep experiments need to be combined with a nerve technology with fixed positions, such as electromyography which is easy to be interfered by movement, and the recording is carried out in a fixed state. The head fixing rod of the head fixing device provided by the embodiment of the invention can adopt the light and firm carbon fiber three-section movable rod, and further can be connected with the head fixing piece embedded in the skull of the tracking object, so that the tracking object can only move back and forth and change the posture, and can not obliquely block eyes from side to side. For example, the head fixing rod may include at least two sub-fixing rods, wherein an active connection portion may be disposed between each two sub-fixing rods to adjust a state and an angle of the head fixing rod through the active connection portion. It will be appreciated that the articulating portion may be fixed or locked to ensure stability of the head fixation. In the implementation process of pupil tracking, after the tracked object falls asleep and does not bounce for a period of time, the head fixing rod is automatically locked at rest through hydraulic pressure, so that the tracked object keeps the same position and the same posture in the pupil tracking process, and a good pupil tracking effect is achieved.
Compared with the direct head fixation of most pupil tracking experiments of the tracked object, the technical scheme of the embodiment of the invention allows the tracked object to select a comfortable sleep posture by self, and avoids the problems that the posture of the tracked object is rigid and the sleep process and the sleep depth are influenced due to the fact that the fixed height and the angle are not suitable. Compared with the method for comparing the spine shape of a natural and fixed tracked object by using X-rays, the method is simple and easy to implement, a rare X-ray machine is not required to be arranged, the tracked object is freely selected, and the tracked object is closer to the natural state.
The conditions that the movement of the tracked object is relatively small and the range is small in the sleeping process are considered, the position and the angle of the moving mechanism of the shooting device are controlled, the moving mechanism is enabled to be always over against the pupil of the tracked object, the illumination uniformity and the pupil high contrast are guaranteed, and meanwhile the pupil target is prevented from being lost after the tracked object rotates. Compared with the method in the related art that the nose of the tracked object is attracted to extend into the side wall small ventilation hole, and the eyes of the tracked object are just opposite to the shooting device in the posture and can be recorded, the technical scheme of the embodiment of the invention can really allow the tracked object to move freely and can track the pupils of the tracked object in any direction.
The technical scheme of the embodiment of the invention utilizes coaxial light illumination to replace the original high-power lateral light source or the light source fixed at the head of the tracked object, the coaxial light source keeps a certain distance with the tracked object, pupil tracking directly contacted with the tracked object is not needed, devices such as the light source and the like are not needed to be arranged near the head of the tracked object, therefore, the realization of other nerve experiments is not hindered, and the recording is not stopped because the cornea of the tracked object is thermally burnt or excessive secretion is generated due to the light source, the pupil tracking for ten hours to tens of hours can be continuously carried out for a long time by adopting the system, the technical problems that the tracking time and the tracking result of the pupil tracking are influenced by adopting the high-power light source in the related pupil tracking technology are solved, the pupil tracking for a long time can be realized, and the damage of the light source to the pupil can be reduced, thereby ensuring the pupil tracking effect.
Example two
Fig. 6 is a flowchart illustrating a pupil tracking method in a sleep state according to this embodiment. The pupil tracking method in the sleep state provided in this embodiment can be implemented based on the pupil tracking system in the sleep state provided in the first embodiment of the present invention.
As shown in fig. 6, the pupil tracking method provided in this embodiment may specifically include:
s110, restraining the activity area of the tracking object through a transparent restraining device;
s120, irradiating the pupil of the tracking object through a coaxial light source of a shooting device, and shooting a pupil image of the tracking object in a sleeping state;
and S130, controlling the shooting position of the shooting device through a control device so that the shooting device carries out tracking shooting on the pupil of the tracking object.
Specifically, controlling the shooting position of the shooting device by the control device may include: when the pupil of the tracking object moves, determining the rotation angle of the pupil based on the pupil image; determining an adjustment angle of the control device based on the rotation angle of the pupil; and adjusting the shooting position of the shooting device through the control device according to the adjustment angle.
Taking the tracking object as a mouse as an example, when the mouse sleeps, the pupil generally keeps at the middle rest position, when the mouse rotates, the pupil turns to one side, the circular pupil becomes elliptical, the rotation angle θ is arccos (short diameter/long diameter), and the included angle γ between the short diameter of the ellipse and the horizontal line can be obtained based on the collected pupil image processing. When the body of the mouse rotates too much, the pupil becomes very flat. The first stepping motor may be controlled to rotate an angle α if a ratio of a minor axis/a major axis of the elliptical pupil is below a certain threshold, wherein the angle α is arcsin (sin θ sin γ); when the mouse rotates along the body axis and one eye is higher than the other eye, the second stepping motor can be controlled to operate, so that the linkage rod in the shape of a parallelogram can adjust the angle beta, wherein the angle beta is arctan (tan theta cos gamma), the height and the angle of the camera can be adjusted, and the condition that the shooting device is aligned with the mouse can be ensured.
On the basis of the above technical solution, after adjusting the shooting position of the shooting device, the method further includes: judging whether the ratio of the short diameter to the long diameter of the ellipse of the pupil of the mouse is increased or not and the difference value between the ratio and 1 is within a preset error range, if so, stopping adjusting the shooting position of the shooting device; if not, the shooting position of the shooting device is adjusted by reversely rotating based on the adjusting angle. According to the technical scheme of the embodiment of the invention, the rotation direction of the pupil can be acquired by analyzing the pupil image of the tracked object, and the photographing device is further controlled to move along with the pupil, so that the pupil is always in the visual field of the photographing device and is opposite to the photographing device.
Of course, if the pupil target is lost due to too fast rotation or too large amplitude of the tracked object, the orientation of the positioning shooting device can be manually adjusted through a manual control function in software. That is, the pupil tracking method provided in this embodiment may further include: and receiving an adjusting parameter which is input by a user and used for adjusting the shooting position of the shooting device, and adjusting the shooting position of the shooting device based on the adjusting parameter. The adjustment parameters may be preset by a user according to actual requirements, and may include, for example, a shooting height of the shooting device, a shooting angle, and/or a set distance moved along a set direction.
Under the conditions of high video acquisition speed and large image processing load, a gyroscope, an accelerometer or the like can be used for acquiring the movement data of the tracking object instead of the mode of carrying out image processing on the pupil image to acquire the pupil position of the tracking object. For example, a micro gyroscope or a six-axis or more accelerometer may be fixed on the head of the tracked object, the rotation direction and the rotation angle of the tracked object around the gravity axis may be obtained through conversion, and then the first stepping motor may be controlled according to the rotation direction and the rotation angle to rotate around the horizontal axis, and/or the second stepping motor may be controlled to rotate the camera around the vertical axis or the gravity axis.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A sleep state pupil tracking system, comprising:
transparent constraining means for constraining an active region of the tracked object;
the photographing device is provided with a coaxial light source and is used for irradiating the pupil of the tracking object through the coaxial light source and photographing the pupil image of the tracking object in a sleeping state;
and one end of the control device is connected with the shooting device and is used for controlling the shooting position of the shooting device so that the shooting device can carry out tracking shooting on the pupil of the tracking object.
2. The system of claim 1, further comprising: a head fixing device; the head fixing device comprises a head fixing rod and a head fixing piece, wherein the head fixing piece is fixedly arranged on the skull of the tracked object, one end of the head fixing rod is detachably connected with the head fixing piece, and the head fixing rod is used for fixing the head of the tracked object through the head fixing piece when the tracked object is in a sleeping state.
3. The system of claim 1, wherein the control device comprises a first stepper motor for controlling a photographing angle of the photographing device relative to the transparent constraint device and a second stepper motor for controlling a photographing height of the photographing device relative to the transparent constraint device.
4. The system as claimed in claim 3, wherein the control device comprises a linkage rod with a parallelogram structure, and one end of the first stepping motor and one end of the second stepping motor are respectively connected with the shooting device through the linkage rod.
5. The system of claim 3, further comprising: and the shading device is provided with a shading layer and is used for accommodating the transparent restraining device, the shooting device and the control device.
6. The system of claim 5, wherein the first stepping motor is located above the center of the movement area of the tracked object and is fixed to the shade device by a motor fixing base.
7. The system of claim 5, wherein a lighting device is disposed within the shade device.
8. The system of claim 1, further comprising: and the carrying platform is used for carrying the transparent constraint device.
9. A method for pupil tracking in a sleep state, comprising:
constraining an active region of the tracked object by a transparent constraining means;
irradiating the pupil of the tracking object through a coaxial light source of a shooting device, and shooting a pupil image of the tracking object in a sleeping state;
and controlling the shooting position of the shooting device through a control device so that the shooting device carries out tracking shooting on the pupil of the tracking object.
10. The method of claim 9, wherein the controlling the shooting position of the shooting device by a control device comprises:
when the pupil of the tracking object moves, determining the rotation angle of the pupil based on the pupil image;
determining an adjustment angle of the control device based on the rotation angle of the pupil;
and adjusting the shooting position of the shooting device through the control device according to the adjustment angle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011157047.0A CN112244762A (en) | 2020-10-26 | 2020-10-26 | Pupil tracking system and method in sleep state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011157047.0A CN112244762A (en) | 2020-10-26 | 2020-10-26 | Pupil tracking system and method in sleep state |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112244762A true CN112244762A (en) | 2021-01-22 |
Family
ID=74262100
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011157047.0A Pending CN112244762A (en) | 2020-10-26 | 2020-10-26 | Pupil tracking system and method in sleep state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112244762A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6152563A (en) * | 1998-02-20 | 2000-11-28 | Hutchinson; Thomas E. | Eye gaze direction tracker |
| US20060110008A1 (en) * | 2003-11-14 | 2006-05-25 | Roel Vertegaal | Method and apparatus for calibration-free eye tracking |
| JP2010017205A (en) * | 2008-07-08 | 2010-01-28 | New Opto Corp | Pupil imaging apparatus for small animals |
| US8077914B1 (en) * | 2006-08-07 | 2011-12-13 | Arkady Kaplan | Optical tracking apparatus using six degrees of freedom |
| US20150077543A1 (en) * | 2013-05-23 | 2015-03-19 | Stiftung Caesar - Center of Advanced European Studies and Research | Ocular Videography System |
| CN108542348A (en) * | 2018-03-15 | 2018-09-18 | 中国人民解放军陆军军医大学 | The monitoring of non-human primate pupil and sight line tracking system and its experimental method |
| CN208769755U (en) * | 2017-08-18 | 2019-04-23 | 上海青研科技有限公司 | A kind of Eye-controlling focus device |
| US10772494B1 (en) * | 2018-03-20 | 2020-09-15 | Facebook Technologies, Llc | Systems and methods for reducing eye-related aberrations |
-
2020
- 2020-10-26 CN CN202011157047.0A patent/CN112244762A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6152563A (en) * | 1998-02-20 | 2000-11-28 | Hutchinson; Thomas E. | Eye gaze direction tracker |
| US20060110008A1 (en) * | 2003-11-14 | 2006-05-25 | Roel Vertegaal | Method and apparatus for calibration-free eye tracking |
| US8077914B1 (en) * | 2006-08-07 | 2011-12-13 | Arkady Kaplan | Optical tracking apparatus using six degrees of freedom |
| JP2010017205A (en) * | 2008-07-08 | 2010-01-28 | New Opto Corp | Pupil imaging apparatus for small animals |
| US20150077543A1 (en) * | 2013-05-23 | 2015-03-19 | Stiftung Caesar - Center of Advanced European Studies and Research | Ocular Videography System |
| CN208769755U (en) * | 2017-08-18 | 2019-04-23 | 上海青研科技有限公司 | A kind of Eye-controlling focus device |
| CN108542348A (en) * | 2018-03-15 | 2018-09-18 | 中国人民解放军陆军军医大学 | The monitoring of non-human primate pupil and sight line tracking system and its experimental method |
| US10772494B1 (en) * | 2018-03-20 | 2020-09-15 | Facebook Technologies, Llc | Systems and methods for reducing eye-related aberrations |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11844586B2 (en) | Eyelid illumination systems and methods for imaging meibomian glands for meibomian gland analysis | |
| US7726814B2 (en) | Reflection microscope and method | |
| US9770168B2 (en) | Device for imaging an eye | |
| JP2007513703A (en) | Retina imaging system | |
| US9050035B2 (en) | Device to measure pupillary light reflex in infants and toddlers | |
| CN106491074B (en) | Turnover type eye vibration graph instrument | |
| CN108089326A (en) | A kind of device for adapting to use with glasses | |
| US9131837B2 (en) | Method and apparatus for imaging the choroid | |
| EP2853937B1 (en) | Goggle-like mobile apparatus and method for recording images of a pupil of a person | |
| CA2840124C (en) | Method and apparatus for imaging the choroid | |
| CN112244762A (en) | Pupil tracking system and method in sleep state | |
| KR102148157B1 (en) | Fundus image photography apparatus having auto focusing function | |
| CN111714081A (en) | Optical nondestructive special child detector based on multi-wavelength LED and detection method | |
| US20230064792A1 (en) | Illumination of an eye fundus using non-scanning coherent light | |
| KR102263830B1 (en) | Fundus image photography apparatus using auto focusing function | |
| US11617897B2 (en) | Head worn electronic device | |
| Holmgren et al. | Freely-moving mice visually pursue prey using a retinal area with least optic flow | |
| Rizzo et al. | The effect of bilateral visual cortex lesions on the development of eye movements and perception | |
| KR102221915B1 (en) | External fixation lamp for fundus camera | |
| ES2963329T3 (en) | System for measuring an eye | |
| CN116982927B (en) | Multi-lens ophthalmic examination equipment and method | |
| CN114157815B (en) | Inspection imaging system and inspection image acquisition method | |
| CN216248723U (en) | Light supplementing device used during iris shooting | |
| CN104487030A (en) | System for inserting an intracorneal lens | |
| CN105496352A (en) | Method and apparatus for imaging the choroid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |