WO2022109858A1 - Eye movement tracking apparatus and method - Google Patents

Eye movement tracking apparatus and method Download PDF

Info

Publication number
WO2022109858A1
WO2022109858A1 PCT/CN2020/131432 CN2020131432W WO2022109858A1 WO 2022109858 A1 WO2022109858 A1 WO 2022109858A1 CN 2020131432 W CN2020131432 W CN 2020131432W WO 2022109858 A1 WO2022109858 A1 WO 2022109858A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
circuit board
target
tracking unit
head
Prior art date
Application number
PCT/CN2020/131432
Other languages
French (fr)
Chinese (zh)
Inventor
杨琴
蔚鹏飞
王立平
Original Assignee
中国科学院深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院深圳先进技术研究院 filed Critical 中国科学院深圳先进技术研究院
Priority to PCT/CN2020/131432 priority Critical patent/WO2022109858A1/en
Publication of WO2022109858A1 publication Critical patent/WO2022109858A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the invention relates to the technical field of life sciences, in particular to an eye-tracking device and method for recording eye movements when small animals move freely in real time and can move freely.
  • Eye tracking is a technology that obtains information about changes in eye characteristics and movement.
  • the information obtained by eye tracking is suitable for neuroscience research because the eyeball is controlled by 3 pairs of nerves and 12 pairs of muscles. Compared with the whole body movement, it is sensitive and fast, and the indicators are fine and rich. There are more than 100 eye movement indicators; Some manifestations, such as nystagmus, pupil dilation, and early eye movement are regulated by inherent neural circuits and are less subject to conscious intervention, so the information conveyed by eye movement performance is more stable and reliable.
  • eye tracking is also widely used in neuropsychological research in visual information processing, reading, motivation and attitude, etc.
  • Physiological analysis indicators of diseases such as autism, schizophrenia, and affective disorders.
  • the camera To observe the eye movements of freely moving small animals, the camera should be kept relative to the small animal. If sensors and electric devices are used to make the camera automatically follow the small animal, when the small animal runs and jumps quickly, the image delay and jitter will be more obvious, which will affect the accuracy of the observation results. Therefore, the camera device needs to be fixed on the head of the small animal. In the prior art, there is no device specially designed for eye tracking of small animals.
  • the existing devices that are fixed on the head of small animals to realize the function of eye tracking are complicated in design, and the design of integrated tracking arm light-emitting elements, accelerometers, and nerve electrophysiological electrodes, etc. Used to observe more information, therefore, such devices have the following disadvantages:
  • the volume and weight are large, and the head of the small animal has to bear the entire device. Compared with the small animal, the device is relatively bulky and will affect the movement of the small animal. The long-term load will also interfere with the small animal. The behavior of small animals in the experiment, which in turn affects the accuracy of the information obtained. This disadvantage is exacerbated by devices such as integrated acceleration and electrophysiology.
  • the device was surgically fixed and installed on the head of the small animal one week before the experiment. Due to the large size and complex design of the device, and the relatively small size of the small animal, it is necessary to coordinate the position of the device when installing the device, and it is necessary to coordinate the position of the device during the operation. Operate carefully to avoid damage to the device, which is very troublesome to install and remove. Once the device is installed, it needs to be fixed on the head of the small animal for a long time, the utilization rate of the device is low and it is easy to be damaged outside the experiment.
  • the structure and function of the existing device are fixed, and it is difficult to adapt to the specific needs of the experiment, and the functions provided by the design of the device are not suitable for the experimental research of neuroscience.
  • some devices incorporate accelerometers, but accelerometers are rarely used in neuroscience research, so accelerometers are redundant for most neurological experiments; some devices integrate neural electrophysiological electrodes to test the movement of live animals
  • the structure of the device is fixed, only electrodes can be used and the position cannot be adjusted during the experiment, which cannot be adapted to different experimental designs of brain research. Electrodes are placed in different positions and depths of the brain, The need for optical fibers, microlenses, etc.
  • the quality of the eye image obtained by the existing eye tracking device is not good, the pixel resolution is small, and some even the image is blurred.
  • the image will produce slight flare .
  • the black pupils will turn into white pupils, which will affect the later image processing.
  • the existing small animal eye tracking technology has the disadvantage that the small animal needs to be fixed in a certain place for observation, and it is not suitable for the experimental paradigm of free movement in neuroscience.
  • an eye-tracking device fixed on the head of the small animal that allows the small animal to move freely, the device is cumbersome and bulky, lacks pertinence for neurological research applications, and is difficult to coordinate with other neurotechnical equipment applications.
  • the image quality also needs to be further improved.
  • the present invention proposes an eye tracking device and method that can be flexibly fixed and disassembled, facilitates coordination with other neural technologies, and has good image quality.
  • the eye tracking device of the present invention includes an eye tracking unit device and a computer, and an ultra-micro camera and a near-infrared light source are fixedly arranged in the eye tracking unit device.
  • the entire circuit board of the eye tracking device is divided into two parts: an eye tracking unit circuit board and a peripheral circuit board.
  • the eye tracking unit device is also provided with the eye tracking unit circuit board and a mounting part.
  • the circuit board includes an imaging module and an encoding module; a decoding module corresponding to the encoding module is arranged on the peripheral circuit board, and the peripheral circuit board is arranged outside the eye-tracking unit device and is connected to the computer; the peripheral The circuit board is connected to the eye tracking unit device in a wired or wireless manner.
  • the eye-tracking unit circuit board and the peripheral circuit board respectively carry different functions, so when the eye-tracking device is installed and used, the target only needs to load the part of the eye-tracking unit device, which reduces the burden of the target. load.
  • the main heat source of the circuit board is the image decoding module, and the decoding module is arranged on the peripheral circuit board away from the target, which reduces the influence of heat on the behavior of the target.
  • the eye tracking device includes a head holder, the head holder is fixed on the target head, and the eye tracking unit device is detachably mounted on the head through the mounting portion and fixed on the head on the device.
  • the part of the eye tracking device except the head immobilizer can be installed only during the experiment period, so as to improve the utilization rate of the device and prevent the device from being damaged outside the experiment.
  • the head holder includes a pin base and a pin set on the pin base.
  • the head holder is provided with two pin bases with a certain distance, the pins protrude from the pin bases to both sides of the target head, and the target is vacated Top of the head position for use in synergy with other neurotechnologies in neuroscience experiments.
  • the eye tracking unit device and the peripheral circuit board are connected by a signal line, and a conductive slip ring is connected between the peripheral circuit board and the computer.
  • the conductive slip ring enables the signal line to rotate freely when the target rotates freely to avoid knotting.
  • the ultra-micro camera and the near-infrared light source are disposed outside the target eye, on the target visual axis, and directly aimed at the target eye.
  • the eye tracking unit device further includes a near-infrared total reflection mirror, the near-infrared total reflection mirror is arranged on the front and outside of the target eye, the ultra-micro camera and the near-infrared light source are arranged Out of the target field of view, toward the near-infrared total reflection mirror.
  • the near-infrared total reflection mirror can transmit visible light, and the target can see any object behind the lens without affecting the target's field of view.
  • the near-infrared total reflection mirror is 45° to the target eye axis and the optical axis of the ultra-micro camera, and is aimed at the target eye, and this structure enables the camera to be indirectly aimed at the target Eyes, and maximize the reflection intensity of near-infrared light, improve the contrast of the final image, and reduce the difficulty of post-image processing.
  • the near-infrared mirror is finally set so that the angle between the mirror surface and the central axis of the mouse body is 75°, and the angle between the mirror surface and the horizontal plane is 25°.
  • the near-infrared light source is arranged beside the ultra-micro camera, forming an angle of 10-20° with the target eye and the ultra-micro camera, which solves the problem of image quality caused by the light source in the prior art.
  • the suboptimal problem improves the quality of the acquired eye image.
  • the eye tracking unit device further includes a near-infrared band-pass filter, which is arranged in front of the ultra-micro camera lens, and can filter out ambient stray light and prevent visible light from affecting the experiment.
  • the interference of the eye movement image, otherwise the obtained image is the superposition of the eye image and the image of the environment behind the mirror.
  • the present invention also provides an eye tracking method.
  • the eye-tracking unit device on the target head, and set the decoding module on a peripheral circuit board outside the eye-tracking unit device; the peripheral circuit board is connected to the eye-tracking unit device in a wired or wireless manner, and the Peripheral circuit boards are not provided on the target header.
  • the target only carries the part of the eye-tracking unit device, reducing the weight of the target.
  • the head holder including a pin base and a pin to fix the eye tracking unit device, the pin being arranged on the pin base;
  • the pin base is fixed on the target head, and the mounting part of the eye tracking unit device is mounted on the pin.
  • the eye-tracking unit device can be easily and quickly installed and disassembled, and the part of the eye-tracking device other than the head immobilizer can be installed only during the experimental period, thereby improving the utilization rate of the equipment and preventing the equipment from being damaged outside the experiment.
  • the head holder has two pin bases, and the two pin bases are fixed to the target head at a certain interval, and the pins extend from the pin base to the two pins of the target head. It is extended laterally to vacate the position on the top of the target's head, which is convenient to be used in conjunction with other neurological technologies in neuroscience experiments.
  • a conductive slip ring is used to connect the peripheral circuit board, so that the signal line can also rotate freely when the target is free to rotate, so as to avoid knotting.
  • the two parts of the circuit board are designed to load different functions, so that the target only needs to bear the weight of the eye tracking unit when the eye tracking device is installed and used, which reduces the weight of the target.
  • the installation method of the device has been changed so that the device can be flexibly fixed and disassembled, and the parts of the eye tracking device except the head holder can be installed only during the experimental period, thereby improving the utilization rate of the equipment and preventing the equipment from being damaged outside the experiment.
  • the head immobilizer is installed on both sides of the target's head, which is convenient to use in conjunction with other neurological technologies in neuroscience experiments; the eye tracking unit device can change the specific position of the fixation on the head immobilizer, which can ensure that all the target eyes are included in the shooting scope.
  • the optimized design of changing the light source surrounding the camera to the side of the camera in the prior art improves the quality of the acquired eye image.
  • FIG. 1 is a schematic diagram of a structural framework of an eye tracking device according to the present invention.
  • FIG. 2 is a schematic diagram of the installation state of the eye tracking device of the present invention
  • FIG. 3 is a schematic diagram of the internal design scheme of the eye movement unit device of the eye movement tracking device of the present invention.
  • FIG. 4 is another schematic diagram of the internal design of the eye movement unit device of the eye tracking device of the present invention.
  • Figure 5 (a) is a schematic diagram of a ring-shaped light source surrounding a lens in the prior art
  • Fig. 5 (b) is the schematic diagram that the near-infrared light source is arranged on the side of the lens in the present invention.
  • FIG. 6 is a schematic view of fixing the eye movement unit of the eye tracking device of the present invention.
  • 1-eye tracking unit device 11-supermicro camera; 12-near infrared light source; 13-near-infrared total reflection mirror; 14-near-infrared bandpass filter; 2-head holder; 21-pin; 3 - Peripheral circuit board; 4 - Conductive slip ring.
  • the present invention provides an eye-tracking device, which is used in small animals (hereafter, mice are used as the tracking object in the embodiment. If the device is available in mice, the volume of other experimental mammals is larger than that of mice. It can be used after the device) to continuously and accurately track and detect eye movements in a free movement state.
  • the eye tracking device mainly includes an eye tracking unit device 1, a head holder 2, a peripheral circuit board 3 and a computer. In some cases, a conductive slip ring 4 may also be included, which will be described later.
  • the eye-tracking unit device 1 includes an ultra-micro camera 11, a near-infrared light source 12, an eye-tracking unit circuit board, a housing and a mounting portion.
  • the eye movement unit device 1 is used for photographing eye movements of small animals, and transmits the acquired data to the connected peripheral circuit board 3 through signal lines.
  • the eye tracking unit device 1 is fixed and removed by a head holder 2 surgically embedded in the head of the small animal.
  • the head holder 2 includes two parts, which are respectively arranged on both sides of the head of the small animal. According to the experimental needs, you can choose to install the eye tracking unit device 1 only on the head holder 2 on one side to observe the unilateral eye movement, or install the eye movement unit device 1 on the head holder 2 on both sides.
  • the design of the eye-tracking device provided by the present invention includes two parts of circuit boards: the eye-tracking unit circuit board and the peripheral circuit board 3 arranged on the eye-tracking unit device 1.
  • the circuit that must be close to the small animal is arranged on the ground of the eye-tracking unit.
  • the circuit boards, such as the imaging module and the encoding module; other circuits such as the decoding module, etc., are all arranged on the peripheral circuit board 3 . Therefore, the two parts of the circuit boards respectively carry different functions.
  • the eye tracking unit circuit board can encode the captured eye motion image
  • the peripheral circuit board 3 has a decoding function. The specific content of the circuit boards will be described in detail later. Therefore, when the eye-tracking device in the present invention is installed and used, the mouse only needs part 1 of the weight-bearing eye-tracking unit, see FIG. The corresponding hardware, the weight of which is not loaded on the mouse.
  • the eye-tracking unit circuit board on the eye-tracking unit device 1 only has an imaging module and an encoding module, so that the eye-tracking unit circuit board only has to be close to the small animal.
  • the circuit part of the eye tracking unit device 1 is minimized.
  • the eye movement unit device 1 captures the eye movement of the small animal, and converts the captured image into digital signal transmission, so that any long distance can be transmitted without noise, and the eye movement unit circuit board encodes the acquired image and transmits it to the periphery.
  • Circuit board 3 decode in the peripheral circuit board 3 part. Because the circuit board generates strong heat during the image acquisition process, the heat generated by the circuit board will interfere with small animals, and the most important heating part in the circuit board is the image decoding part, so the image decoding part is designed on the peripheral circuit board 3, so that the It is far away from small animals, does not make small animals feel uncomfortable, and reduces the influence of heat on the behavior of small animals.
  • the peripheral circuit board 3 and the eye movement unit device 1 are connected through a signal line, and the eye movement unit device 1 converts the captured eye movement image into a digital signal, and the image is encoded through a signal line with a length of about 50 cm It is transmitted to the peripheral circuit board 3 for decoding, converted into a USB signal, and then transmitted to the computer.
  • the digital signal transmission encoded by the eye tracking unit device 1 may also be transmitted to the peripheral circuit board 3 by means of wireless transmission.
  • the ultra-micro camera 11 and the near-infrared light source 12 are fixed on a fixed position inside the casing, and the casing is made of a material that can transmit near-infrared light, or the casing is formed by the near-infrared light source 12 and the ultra-micro camera 11.
  • the window design is made on the position of the optical path to ensure the smooth transmission of near-infrared light.
  • the size of the eye tracking unit circuit board can be greatly reduced, and it can be only 1/7 of the size of the circuit board of the device in the prior art, and a pair of eye tracking
  • the total length of the unit device 1 and the head holder 2 can be only 28mm, thereby greatly reducing the volume and weight of the load required by the small animal.
  • the internal structure of the eye-tracking unit device 1 can be partially changed according to the specific needs of the experiment, see Figure 3 in the description, in this embodiment, a scheme 1 is designed.
  • the light source 12 is composed of an eye-tracking unit circuit board, and a pair of eye-tracking unit devices weighs only 0.8g.
  • the ultra-micro camera 11 is set on the outside of the mouse's eye and is directly aimed at the mouse's eye.
  • the preferred solution provided in this embodiment is to use a 1280*720 pixel 3.8mm endoscope camera to directly aim at the mouse at a distance of about 12mm eye.
  • the setting of the light source will cause problems such as light spots in the image, which will affect the accurate processing of the eye movement information in the later stage.
  • the layout of the light source Referring to Figure 5 (a) of the description, it is a ring-shaped light source that surrounds the camera used in the prior art. Due to the light-passing characteristics of the pupil, the ring-shaped light source setting of this layout will cause the black pupil to turn into a black pupil when the eyeball is turned to certain directions. White pupils affect post-image processing. Therefore, in this embodiment, referring to Fig.
  • the near-infrared light source 12 is changed to the side of the ultra-micro camera 11, for example, two near-infrared light sources 12 are arranged side by side beside 11, and are directly aimed at the mouse Eye lighting.
  • two 940nm near-infrared LEDs are illuminated at 5mm beside the camera, forming an angle of 10-20° with the mouse's eyes and the camera, which will neither cause white pupils nor excessive shadows around the eyeballs Affects black pupil extraction.
  • a near-infrared bandpass filter 14 can be set in front of the lens of the ultra-micro camera 11 to transmit near-infrared light, block visible light, and prevent the environment from interfering with the imaging of eye movement recording, otherwise
  • the acquired image is a superposition of the eye and environment images.
  • the near-infrared cut-off filter in front of ordinary cameras transmits the image of visible light, filters out the near-infrared to adjust the color balance and prevent the image from turning red.
  • the images obtained by tracking eye movements in neuroscience research need to be clear and precise.
  • the eye movement unit device 1 may also include a near-infrared total reflection mirror 13 inside.
  • the near-infrared total reflection mirror 13 is arranged on the front and outside of the mouse's eye.
  • the function of the near-infrared total reflection mirror 13 is to transmit visible light, and the mouse can see any object behind the lens without affecting the mouse's field of vision.
  • the near-infrared total reflection mirror 13 can reflect near-infrared light, so that the near-infrared light emitted by the near-infrared light source 12 is reflected to the mouse eye through the near-infrared total reflection mirror 13 for illumination, and the mouse eye image is reflected to the ultra-micro camera through the near-infrared total reflection mirror 13 11 Imaging.
  • the near-infrared mirror adopts a 45° total reflection mirror, that is, when the incident and exit angles of light are 45°, the reflection is the strongest, the contrast and clarity of the final image are the best, and subsequent image processing is easier.
  • both the eye and the camera face toward the near-infrared reflector, and the two lines connecting the eye-reflector and the camera-reflector form an included angle of 45° with the mirror surface.
  • the ultra-micro camera 11 and the near-infrared light source 12 can be arranged on both sides of the rear of the mouse head, facing the near-infrared total reflection mirror 13 , and the near-infrared bandpass filter 14 is in front of the lens of the ultra-micro camera 11 . Therefore, the parts other than the near-infrared total reflection mirror 13 are all outside the mouse's field of vision, and the mouse's sight is no longer blocked, thereby reducing the influence on the mouse's activity.
  • the near-infrared total reflection mirror 13 is made of quartz material, which makes the near-infrared total reflection mirror 13 occupy most of the weight of the eye unit device 1 in this solution. Even so, the near-infrared total reflection mirror is included at this time. Including the 13 and the near-infrared bandpass filter 14, the weight of the pair of eye tracking unit devices 1 is only 2g. Although the mice can bear it, the weight of the eye tracking unit device 1 of the second solution is still 2.5 times heavier than that of the first solution. Therefore, in studies where other brain research techniques are simultaneously applied and other weight-bearing objects need to be immobilized on the head, option 1 is more suitable.
  • the eye-tracking unit device 1 is fixed by the head holder 2.
  • the head holder 2 is implanted in the head of the small animal and used in conjunction with the mounting part designed on the eye-tracking unit device 1 to realize the quick installation of the eye-tracking unit device 1. , dismantling.
  • the connecting part can be designed as any miniature, lightweight and firm structure such as screw connection, snap connection, etc. Referring to Fig. 6 of the description, preferably, a pin connection is used, and the head holder 2 is a pin base provided with multiple rows of parallel pins 21. The bottom of the pin base is hollow, and the top of the head is exposed after being inserted into the mouse head. position to facilitate the implantation of nerve electrodes, optical fibers, microlenses and other devices in the mouse head.
  • the pin 21 protrudes from the pin base toward the outside of the mouse body.
  • the distance between two adjacent rows of pins 21 is the same.
  • the mounting part provided on the eye tracking unit device 1 is a parallel socket, and there are reeds, silica gel or hollow needle cannula inside to prevent the pin 21 from swinging and slipping, and the distance between the adjacent two rows of sockets is Corresponding to the pitch of the pins 21 .
  • the eye tracking unit device 1 is fixed by inserting the pins 21 into the sockets of the installation part.
  • the head immobilizer 2 was surgically implanted into the skull of the small animal.
  • the pin connection design of the head immobilizer 2 enables the eye tracking unit device 1 to be directly inserted and removed when it is fixed and disassembled, which is convenient to operate. fast. Therefore, only the head holder 2 of the eye-tracking device 1 needs to be fixed on the head of the small animal for a long time, and the rest of the eye tracking device can be used in the experimental period of multiple small animals in time-sharing, so as to improve the utilization rate of the equipment and avoid small animals due to external factors. Battle damage equipment.
  • the head holder 2 provides three parallel rows of pins 21, and the eye tracking unit device 1 actually only needs two rows of pins 21 to achieve fixation, so there are three or more pins at the pin base
  • the eye tracking unit device 1 can be easily adjusted back and forth, which can solve the problems caused by the surgical habits of different experimenters.
  • the experimental brain regions are different, and the position of the implanted head immobilizer 2 is different to a certain extent, which leads to the problem that the mouse's eyes are beyond the imaging range of the eye-tracking device, which further ensures that all the mouse's eyes are included in the shooting range.
  • the device needs to be applied to animals such as rats, it is only necessary to adjust the dimensions of the head immobilizer 2 and the mounting portion on the eye tracking unit device 1 .
  • a conductive slip ring 4 can be connected to the signal conduction line. 4.
  • the signal line can also rotate freely when the small animal is free to rotate, avoiding knots, and at the same time, the image signal can continue to be transmitted stably through the conductive slip ring 4.
  • the resistance of the slip ring increases rapidly with the number of conductive channels, so the fewer the number of conductive channels, the better.
  • the eye tracking unit device 1 and the peripheral circuit board 3 transmit signals through 8 lines, and there are only 4 lines between the peripheral circuit board 3 and the computer USB interface, so the conductive slip ring 4 is arranged between the peripheral circuit board 3 and the computer.
  • the present invention provides an eye-tracking device and method with a small size and light weight.
  • the circuit board in the design of the eye-tracking device includes two parts of the eye-tracking unit circuit board and the peripheral circuit board.
  • the mouse When the device is installed, the mouse only needs the part of the weight-bearing eye-tracking unit, which reduces the weight of small animals.
  • the eye-tracking unit device can be quickly installed and fixed by the head holder embedded in the head of the small animal before the experiment, so that only the head holder part of the eye-tracking device needs to be fixed on the head of the small animal for a long time, and the other parts can be fixed on the head of the small animal for a long time.
  • the specific position of the eye tracking unit device can be changed on the head holder, which can ensure that the eyes of small animals are all included in the shooting range.
  • the hollow design in the middle of the head holder facilitates the eye-tracking device to cooperate with other neurotechnologies to detect small animal brains in neuroscience experiments.
  • the optimized design of changing the light source surrounding the camera to the side of the camera in the prior art improves the quality of the acquired eye image.

Abstract

The present invention provides an eye movement tracking apparatus and method for real-time recording of eyeball movement of an animal during free movement. The eye movement tracking apparatus comprises: a head holder used for conveniently mounting and dismounting a device; an eye movement unit apparatus used for photographing the eyeball movement of the animal; a peripheral circuit board provided with a circuit which is not necessarily close to the eyes of a small animal; a conductive slip ring ensuring stable transmission of image signals during the free movement of the animal; and a computer collecting and storing images and extracting eyeball movement data in real time. The eye movement tracking apparatus of the present invention can be used for real-time tracking of the eyeball movement condition of the animal in the free movement state. A portable and firm structure convenient to mount and dismount is equipped, so that the eye movement tracking apparatus can be applied to a plurality of animals, the utilization rate of the device is increased, and the damage of the device due to animal fighting outside an experiment is avoided. For the requirements of neural research, the eye movement tracking apparatus is mounted on both sides of the head of the animal, so that other neural technology implants can be conveniently implanted in the top of the head of the animal to cooperatively detect the brain.

Description

一种眼动追踪装置及方法An eye tracking device and method 技术领域technical field
本发明涉及生命科学技术领域,尤其涉及一种用于实时记录小动物自由活动时眼球运动并且能够自由移动的眼动追踪装置及方法。The invention relates to the technical field of life sciences, in particular to an eye-tracking device and method for recording eye movements when small animals move freely in real time and can move freely.
背景技术Background technique
眼动追踪即获取眼球特征变化和运动信息的技术。眼动追踪所获得的信息适用于神经科学研究是由于眼球由3对神经12对肌肉控制,相比于全身运动灵敏高速,指标精细丰富,现已有一百多个眼动指标;而且,眼球部分表现,如眼震、瞳孔扩缩和早期眼动受固有的神经环路调节,较少受到意识的干预,因此眼部运动表现所传达出的信息更为稳定可靠。除了应用在视觉和前庭科学外,眼动追踪在神经心理研究中的视觉信息加工、阅读、动机与态度等等方向也应用广泛,并且作为一些认知和精神异常状态,如阿兹海默症、自闭症、精神分裂症、情感障碍等疾病的生理分析指标。Eye tracking is a technology that obtains information about changes in eye characteristics and movement. The information obtained by eye tracking is suitable for neuroscience research because the eyeball is controlled by 3 pairs of nerves and 12 pairs of muscles. Compared with the whole body movement, it is sensitive and fast, and the indicators are fine and rich. There are more than 100 eye movement indicators; Some manifestations, such as nystagmus, pupil dilation, and early eye movement are regulated by inherent neural circuits and are less subject to conscious intervention, so the information conveyed by eye movement performance is more stable and reliable. In addition to applications in vision and vestibular science, eye tracking is also widely used in neuropsychological research in visual information processing, reading, motivation and attitude, etc. Physiological analysis indicators of diseases such as autism, schizophrenia, and affective disorders.
现有的眼动装置基本是用于人和猴,但神经原理的彻底阐明需要在大量小动物身上进行有创研究。因为可用于人类神经系统的研究技术,如核磁共振、脑电图、经颅磁刺激、诱发电位等,具有时空分辨率有限,无法探究精确的神经环路和细胞网络的结构和功能的缺点。这些技术的局限导致我们对情绪和行为的形成机理、发展过程很难进行透彻的分析。目前包括基因编辑修饰、光遗传学、在体电生理和双光子成像等从微观至介观尺度对神经环路进行剖析的研究技术都是侵入式和损伤不可逆的。因此,对神经环路进行剖析的研究主要是以小动物(大、小鼠)为实验模型展开。Existing eye-tracking devices are basically used in humans and monkeys, but a thorough elucidation of neural mechanisms requires invasive studies in a large number of small animals. Because the research techniques that can be used in the human nervous system, such as MRI, EEG, transcranial magnetic stimulation, evoked potentials, etc., have the disadvantage of limited spatial and temporal resolution, they cannot probe the structure and function of precise neural circuits and cellular networks. The limitations of these technologies make it difficult for us to conduct a thorough analysis of the formation mechanism and development process of emotions and behaviors. Current research techniques including gene editing modification, optogenetics, in vivo electrophysiology, and two-photon imaging to dissect neural circuits from microscopic to mesoscopic scales are invasive and irreversible. Therefore, the research on the dissection of neural circuits is mainly carried out with small animals (large and mouse) as experimental models.
然而,现有的对小动物的神经行为实验较多基于动物在一定空间中的自由活动。例如迷宫测试记忆,十字高架测试探索行为,三箱装置测试社交障碍等这些方法多年来是国际通用的标准实验范式,但这些方法仅仅分析动物整体行为,检测指标单一,且不便与人类认知与情感反应进行比对。因此, 神经科学急需在已有的自由活动实验范式下引入稳定精确、指标丰富的眼动追踪技术。However, the existing neurobehavioral experiments on small animals are mostly based on the free movement of animals in a certain space. For example, the maze test for memory, the elevated cross test for exploratory behavior, and the three-box device test for social barriers have been the international standard experimental paradigms for many years, but these methods only analyze the overall behavior of animals, the detection index is single, and it is inconvenient to compare with human cognition and human cognition. Emotional responses were compared. Therefore, neuroscience urgently needs to introduce stable, accurate and index-rich eye tracking technology under the existing free-motion experimental paradigm.
现有的小动物眼动追踪技术绝大部分是采用手术固定小动物头部在某处,然后在斜前方放置一摄像头记录动物眼睛中瞳孔活动情况。小动物不能够随意移动位置,所以不适用神经科学中自由活动的实验范式。Most of the existing small animal eye tracking technologies use surgery to fix the head of the small animal somewhere, and then place a camera obliquely in front of the animal to record the pupil activity in the animal's eye. Small animals cannot move freely, so the experimental paradigm of free movement in neuroscience does not apply.
如需观察自由活动的小动物的眼动,摄像头应与小动物保持相对位置。如果采用传感器和电动器件使摄像头自动追随小动物,在小动物快速奔跑跳跃时,图像延迟和抖动会比较明显,影响观测结果的准确度,因此需要将摄像装置固定在小动物头部。现有技术中没有专门针对小动物眼动追踪的设备,已有固定在小动物头部实现眼动追踪功能的装置设计复杂,而且集成跟踪臂发光元件、加速度计、神经电生理的电极等设计用于观测更多信息,因此,此类装置会造成如下缺点:To observe the eye movements of freely moving small animals, the camera should be kept relative to the small animal. If sensors and electric devices are used to make the camera automatically follow the small animal, when the small animal runs and jumps quickly, the image delay and jitter will be more obvious, which will affect the accuracy of the observation results. Therefore, the camera device needs to be fixed on the head of the small animal. In the prior art, there is no device specially designed for eye tracking of small animals. The existing devices that are fixed on the head of small animals to realize the function of eye tracking are complicated in design, and the design of integrated tracking arm light-emitting elements, accelerometers, and nerve electrophysiological electrodes, etc. Used to observe more information, therefore, such devices have the following disadvantages:
一、体积和重量较大,而小动物的头部要负担整个装置,装置相对于小动物而言比较笨重,会影响到小动物的行动,长时间的负重还会对小动物产生干扰,影响小动物在实验中的行为,进而影响到所获取的信息的准确性。集成的加速度和电生理等器件加剧该缺点。1. The volume and weight are large, and the head of the small animal has to bear the entire device. Compared with the small animal, the device is relatively bulky and will affect the movement of the small animal. The long-term load will also interfere with the small animal. The behavior of small animals in the experiment, which in turn affects the accuracy of the information obtained. This disadvantage is exacerbated by devices such as integrated acceleration and electrophysiology.
二、装置在实验前一星期通过手术固定安装在小动物头部,由于装置体积大且设计复杂,而相对地小动物的体积较小,安装装置时需要协调装置的位置、在手术过程中要小心地操作以避免损坏装置,装置的安装、拆卸十分麻烦。装置一经安装则需要长时间地固定在小动物头部,装置利用率低且容易在实验之外的情况下损坏。2. The device was surgically fixed and installed on the head of the small animal one week before the experiment. Due to the large size and complex design of the device, and the relatively small size of the small animal, it is necessary to coordinate the position of the device when installing the device, and it is necessary to coordinate the position of the device during the operation. Operate carefully to avoid damage to the device, which is very troublesome to install and remove. Once the device is installed, it needs to be fixed on the head of the small animal for a long time, the utilization rate of the device is low and it is easy to be damaged outside the experiment.
三、现有装置的结构和功能是固定的,难以针对实验的具体需要进行适应性调整,装置的设计所具备的功能不适用于神经科学的实验研究。例如,有些装置结合了加速度计,但神经科学研究中很少用到加速度指标,所以加速度计对绝大多数神经实验是多余的;有些装置虽然集成了神经电生理的电极,可测试活体动物运动下多个神经细胞的活动,但是由于装置的结构是固定的,因此在实验过程中仅能用电极且位置不可调节,不能适应脑研究不同 的实验设计在大脑不同位置、不同深度置入电极、光纤、微透镜等的需要。3. The structure and function of the existing device are fixed, and it is difficult to adapt to the specific needs of the experiment, and the functions provided by the design of the device are not suitable for the experimental research of neuroscience. For example, some devices incorporate accelerometers, but accelerometers are rarely used in neuroscience research, so accelerometers are redundant for most neurological experiments; some devices integrate neural electrophysiological electrodes to test the movement of live animals However, because the structure of the device is fixed, only electrodes can be used and the position cannot be adjusted during the experiment, which cannot be adapted to different experimental designs of brain research. Electrodes are placed in different positions and depths of the brain, The need for optical fibers, microlenses, etc.
除此之外,现有的眼动追踪装置所获取的眼睛图像质量欠佳,像素分辨率较小,部分甚至图像模糊,例如,因光源设置离摄像头上的镜头太近,图像会产生轻微光斑,环形光照明下,因瞳孔的通光特点,眼球转到某些方向时,黑色瞳孔会变成白色瞳孔,影响后期图像处理。这些都将影响对眼动信息的准确获取等等。In addition, the quality of the eye image obtained by the existing eye tracking device is not good, the pixel resolution is small, and some even the image is blurred. For example, because the light source is set too close to the lens on the camera, the image will produce slight flare , Under the ring light illumination, due to the light-passing characteristics of the pupils, when the eyeballs turn to certain directions, the black pupils will turn into white pupils, which will affect the later image processing. These will affect the accurate acquisition of eye movement information and so on.
如上述所提到的现有的小动物眼动追踪技术,存在着需要将小动物固定在某处观测,不适用神经科学中自由活动的实验范式的缺点。虽然有固定在小动物头部的可以让小动物自由活动的眼动追踪装置,但是,装置笨重、体积较大,缺乏对于神经研究应用的针对性、难以协同其他神经技术设备应用,而且所获取的图像质量也有待进一步提高。As mentioned above, the existing small animal eye tracking technology has the disadvantage that the small animal needs to be fixed in a certain place for observation, and it is not suitable for the experimental paradigm of free movement in neuroscience. Although there is an eye-tracking device fixed on the head of the small animal that allows the small animal to move freely, the device is cumbersome and bulky, lacks pertinence for neurological research applications, and is difficult to coordinate with other neurotechnical equipment applications. The image quality also needs to be further improved.
发明内容SUMMARY OF THE INVENTION
有鉴于此,为了克服上述现有技术的缺陷,本发明提出了一种可灵活固定拆卸、便于协同其它神经技术、图像质量良好的眼动追踪装置及方法。In view of this, in order to overcome the above-mentioned defects of the prior art, the present invention proposes an eye tracking device and method that can be flexibly fixed and disassembled, facilitates coordination with other neural technologies, and has good image quality.
具体地,本发明的眼动追踪装置,包括眼动单元装置和计算机,眼动单元装置中固定设置有超微摄像头和近红外光源。整个所述眼动追踪装置的电路板分为眼动单元电路板和外围电路板两部分,所述眼动单元装置中还设置有所述眼动单元电路板和安装部,所述眼动单元电路板包括成像模块和编码模块;与所述编码模块对应的解码模块设置在所述外围电路板,所述外围电路板设置在所述眼动单元装置外,与所述计算机连接;所述外围电路板通过有线或者无线的方式连接所述眼动单元装置。所述眼动单元电路板和所述外围电路板分别承载了不同的功能,因此所述眼动追踪装置在安装使用时,目标仅需负载所述眼动单元装置部分,减轻了所述目标的负重。而且,图像采集过程中电路板最主要发热的是图像解码模块,解码模块设置在所述外围电路板远离所述目标,降低了热量对所述目标行为的影响。Specifically, the eye tracking device of the present invention includes an eye tracking unit device and a computer, and an ultra-micro camera and a near-infrared light source are fixedly arranged in the eye tracking unit device. The entire circuit board of the eye tracking device is divided into two parts: an eye tracking unit circuit board and a peripheral circuit board. The eye tracking unit device is also provided with the eye tracking unit circuit board and a mounting part. The circuit board includes an imaging module and an encoding module; a decoding module corresponding to the encoding module is arranged on the peripheral circuit board, and the peripheral circuit board is arranged outside the eye-tracking unit device and is connected to the computer; the peripheral The circuit board is connected to the eye tracking unit device in a wired or wireless manner. The eye-tracking unit circuit board and the peripheral circuit board respectively carry different functions, so when the eye-tracking device is installed and used, the target only needs to load the part of the eye-tracking unit device, which reduces the burden of the target. load. Moreover, during the image acquisition process, the main heat source of the circuit board is the image decoding module, and the decoding module is arranged on the peripheral circuit board away from the target, which reduces the influence of heat on the behavior of the target.
具体地,所述眼动追踪装置包括头部固定器,所述头部固定器固定在所述 目标头部,所述眼动单元装置通过所述安装部可拆卸地安装在所述头部固定器上。所述眼动追踪装置除头部固定器以外的部分可以仅在实验时段安装,从而提高设备使用率并避免设备在实验外损坏。Specifically, the eye tracking device includes a head holder, the head holder is fixed on the target head, and the eye tracking unit device is detachably mounted on the head through the mounting portion and fixed on the head on the device. The part of the eye tracking device except the head immobilizer can be installed only during the experiment period, so as to improve the utilization rate of the device and prevent the device from being damaged outside the experiment.
具体地,所述头部固定器包括插针底座以及设置在所述插针底座上的插针。Specifically, the head holder includes a pin base and a pin set on the pin base.
优选地,所述头部固定器设置有两个具有一定间距的所述插针底座,所述插针从所述插针底座向所述目标头部两侧伸出,空出了所述目标头顶的位置,便于在神经科学实验中协同其它神经技术使用。Preferably, the head holder is provided with two pin bases with a certain distance, the pins protrude from the pin bases to both sides of the target head, and the target is vacated Top of the head position for use in synergy with other neurotechnologies in neuroscience experiments.
具体地,所述眼动单元装置和所述外围电路板通过信号线连接,所述外围电路板与所述计算机之间连接有导电滑环。所述导电滑环使得在目标自由转圈时信号线也可自由旋转,避免打结。Specifically, the eye tracking unit device and the peripheral circuit board are connected by a signal line, and a conductive slip ring is connected between the peripheral circuit board and the computer. The conductive slip ring enables the signal line to rotate freely when the target rotates freely to avoid knotting.
具体地,所述超微摄像头和所述近红外光光源设置在所述目标眼部外侧,处于所述目标视轴上,直接对准所述目标眼部。Specifically, the ultra-micro camera and the near-infrared light source are disposed outside the target eye, on the target visual axis, and directly aimed at the target eye.
在一些实施例中,所述眼动单元装置还包括近红外全反射镜,所述近红外全反射镜设置在所述目标眼部前外侧,所述超微摄像头和所述近红外光光源设置在所述目标视野之外,朝向所述近红外全反射镜。所述近红外全反射镜能够透射可见光,所述目标可看到镜片后的任何物体,不影响所述目标视野。In some embodiments, the eye tracking unit device further includes a near-infrared total reflection mirror, the near-infrared total reflection mirror is arranged on the front and outside of the target eye, the ultra-micro camera and the near-infrared light source are arranged Out of the target field of view, toward the near-infrared total reflection mirror. The near-infrared total reflection mirror can transmit visible light, and the target can see any object behind the lens without affecting the target's field of view.
优选地,所述近红外全反射镜与所述目标眼轴和所述超微摄像头光轴均成45°,对准所述目标眼部,该结构能使所述摄像头间接对准所述目标眼部,并最大限度保证近红外光反射强度,提升最终图像的对比度,减小后期图像处理的难度。。相应地,根据小鼠眼部位置,所述近红外反射镜最终设置为镜面与小鼠身体中轴夹角75°,与水平面夹角为25°。Preferably, the near-infrared total reflection mirror is 45° to the target eye axis and the optical axis of the ultra-micro camera, and is aimed at the target eye, and this structure enables the camera to be indirectly aimed at the target Eyes, and maximize the reflection intensity of near-infrared light, improve the contrast of the final image, and reduce the difficulty of post-image processing. . Correspondingly, according to the position of the mouse's eyes, the near-infrared mirror is finally set so that the angle between the mirror surface and the central axis of the mouse body is 75°, and the angle between the mirror surface and the horizontal plane is 25°.
优选地,所述近红外光源设置在所述超微摄像头旁侧,与所述目标眼部和所述超微摄像头成10-20°夹角,解决了现有技术中因光源导致的图像质量欠佳问题,提升了所获取的眼睛图像的质量。Preferably, the near-infrared light source is arranged beside the ultra-micro camera, forming an angle of 10-20° with the target eye and the ultra-micro camera, which solves the problem of image quality caused by the light source in the prior art. The suboptimal problem improves the quality of the acquired eye image.
优选地,所述眼动单元装置还包括近红外带通滤光镜,所述近红外带通滤光镜设置在所述超微摄像头镜头前方,可滤除环境杂光,防止实验中可见光 对眼动图像的干扰,否则所获图像为眼部图像和反射镜后环境图像的叠加。Preferably, the eye tracking unit device further includes a near-infrared band-pass filter, which is arranged in front of the ultra-micro camera lens, and can filter out ambient stray light and prevent visible light from affecting the experiment. The interference of the eye movement image, otherwise the obtained image is the superposition of the eye image and the image of the environment behind the mirror.
同时,本发明还提供一种眼动追踪方法。Meanwhile, the present invention also provides an eye tracking method.
将眼动单元装置固定在目标头部,将解码模块设置在所述眼动单元装置外的外围电路板上;所述外围电路板通过有线或者无线的方式连接所述眼动单元装置,所述外围电路板不设置在所述目标头部。所述目标仅负载所述眼动单元装置部分,减轻所述目标的负重。Fix the eye-tracking unit device on the target head, and set the decoding module on a peripheral circuit board outside the eye-tracking unit device; the peripheral circuit board is connected to the eye-tracking unit device in a wired or wireless manner, and the Peripheral circuit boards are not provided on the target header. The target only carries the part of the eye-tracking unit device, reducing the weight of the target.
使用包括插针底座和插针的所述头部固定器固定所述眼动单元装置,所述插针设置在所述插针底座上;using the head holder including a pin base and a pin to fix the eye tracking unit device, the pin being arranged on the pin base;
将所述插针底座固定在所述目标头部,将所述眼动单元装置的安装部安装到所述插针上。所述眼动单元装置可方便快捷地安装、拆卸,所述眼动追踪装置除头部固定器以外的部分可以仅在实验时段安装,从而提高设备使用率并避免设备在实验外损坏。The pin base is fixed on the target head, and the mounting part of the eye tracking unit device is mounted on the pin. The eye-tracking unit device can be easily and quickly installed and disassembled, and the part of the eye-tracking device other than the head immobilizer can be installed only during the experimental period, thereby improving the utilization rate of the equipment and preventing the equipment from being damaged outside the experiment.
所述头部固定器具有两个所述插针底座,将两个所述插针底座以一定间隔固定在所述目标头部,所述插针从所述插针底座向目标头部的两侧伸出,空出所述目标头顶的位置,便于在神经科学实验中协同其它神经技术使用。The head holder has two pin bases, and the two pin bases are fixed to the target head at a certain interval, and the pins extend from the pin base to the two pins of the target head. It is extended laterally to vacate the position on the top of the target's head, which is convenient to be used in conjunction with other neurological technologies in neuroscience experiments.
使用导电滑环连接所述外围电路板,使得在所述目标自由转圈时信号线也可自由旋转,避免打结。A conductive slip ring is used to connect the peripheral circuit board, so that the signal line can also rotate freely when the target is free to rotate, so as to avoid knotting.
综上所述,本发明的眼动追踪装置及方法中,两部分电路板负载不同功能的设计使得眼动追踪装置在安装使用时目标仅需负重眼动单元装置,减轻了目标的负重。改变了装置的安装方法使得装置可灵活固定拆卸,眼动追踪装置除头部固定器以外的部分可以仅在实验时段安装,从而提高设备使用率并避免设备在实验外损坏。头部固定器安装在目标头部两侧,便于在神经科学实验中协同其它神经技术使用;眼动单元装置在头部固定器上可改变固定的具体位置,可以确保将目标眼部全部纳入拍摄范围。将现有技术中围绕摄像头的光源改到摄像头旁侧的优化设计提升了所获取的眼睛图像的质量。To sum up, in the eye tracking device and method of the present invention, the two parts of the circuit board are designed to load different functions, so that the target only needs to bear the weight of the eye tracking unit when the eye tracking device is installed and used, which reduces the weight of the target. The installation method of the device has been changed so that the device can be flexibly fixed and disassembled, and the parts of the eye tracking device except the head holder can be installed only during the experimental period, thereby improving the utilization rate of the equipment and preventing the equipment from being damaged outside the experiment. The head immobilizer is installed on both sides of the target's head, which is convenient to use in conjunction with other neurological technologies in neuroscience experiments; the eye tracking unit device can change the specific position of the fixation on the head immobilizer, which can ensure that all the target eyes are included in the shooting scope. The optimized design of changing the light source surrounding the camera to the side of the camera in the prior art improves the quality of the acquired eye image.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1为本发明眼动追踪装置结构框架示意图;1 is a schematic diagram of a structural framework of an eye tracking device according to the present invention;
图2为本发明眼动追踪装置的安装状态示意图2 is a schematic diagram of the installation state of the eye tracking device of the present invention
图3为本发明眼动追踪装置的眼动单元装置内部设计方案示意图;3 is a schematic diagram of the internal design scheme of the eye movement unit device of the eye movement tracking device of the present invention;
图4为本发明眼动追踪装置的眼动单元装置内部设计的另一方案示意图;4 is another schematic diagram of the internal design of the eye movement unit device of the eye tracking device of the present invention;
图5(a)为现有技术中环绕镜头的环状光源示意图;Figure 5 (a) is a schematic diagram of a ring-shaped light source surrounding a lens in the prior art;
图5(b)为本发明中镜头旁侧设置近红外光源的示意图;Fig. 5 (b) is the schematic diagram that the near-infrared light source is arranged on the side of the lens in the present invention;
图6为本发明眼动追踪装置眼动单元的固定示意图。FIG. 6 is a schematic view of fixing the eye movement unit of the eye tracking device of the present invention.
附图标记:Reference number:
1-眼动单元装置;11-超微摄像头;12-近红外光源;13-近红外全反射镜;14-近红外带通滤光镜;2-头部固定器;21-插针;3-外围电路板;4-导电滑环。1-eye tracking unit device; 11-supermicro camera; 12-near infrared light source; 13-near-infrared total reflection mirror; 14-near-infrared bandpass filter; 2-head holder; 21-pin; 3 - Peripheral circuit board; 4 - Conductive slip ring.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本发明提供了一种眼动追踪装置,用于在小动物(后文以小鼠作为实施例的追踪对象,如果本装置在小鼠可用,其它实验哺乳动物体积均比小鼠大,修改固定器后均可用)自由活动状态下连续精确地追踪检测眼球运动。参见说明书附图1所示,眼动追踪装置主要包括眼动单元装置1、头部固定器2、外围电路板3和计算机。在一些情况下,还可以包括导电滑环4,此部分内容 参见后文所述。具体地,眼动单元装置1包括超微摄像头11、近红外光源12、眼动单元电路板、外壳和安装部。眼动单元装置1用于拍摄小动物眼球运动,并将获取的数据通过信号线传输到所连接的外围电路板3。眼动单元装置1通过在小动物头部手术埋置的头部固定器2进行固定和拆卸。头部固定器2包括两部分,分别设置在小动物头部两侧。根据实验需要可以选择只在单侧的头部固定器2上安装眼动单元装置1观察单侧眼动,或者,在两侧的头部固定器2上都安装眼动单元装置1。本发明提供的眼动追踪装置的设计包括了两部分的电路板:设置在眼动单元装置1上的眼动单元电路板和外围电路板3,必须靠近小动物的电路设置在眼动单元地电路板,如成像模块和编码模块;其它电路如解码模块等全部设置在外围电路板3。因此,两部分电路板分别承载了不同的功能,例如,眼动单元电路板能够将拍摄的眼部运动图像编码,外围电路板3具有解码功能,关于电路板的具体内容后文详述。因此本发明中的眼动追踪装置在安装使用时,小鼠仅需负重眼动单元装置1部分,参见说明书附图2,外围电路板3不会承载在小鼠头部,也就是说部分功能所对应的硬件,其重量不会加载在小鼠身上。The present invention provides an eye-tracking device, which is used in small animals (hereafter, mice are used as the tracking object in the embodiment. If the device is available in mice, the volume of other experimental mammals is larger than that of mice. It can be used after the device) to continuously and accurately track and detect eye movements in a free movement state. Referring to Fig. 1 of the description, the eye tracking device mainly includes an eye tracking unit device 1, a head holder 2, a peripheral circuit board 3 and a computer. In some cases, a conductive slip ring 4 may also be included, which will be described later. Specifically, the eye-tracking unit device 1 includes an ultra-micro camera 11, a near-infrared light source 12, an eye-tracking unit circuit board, a housing and a mounting portion. The eye movement unit device 1 is used for photographing eye movements of small animals, and transmits the acquired data to the connected peripheral circuit board 3 through signal lines. The eye tracking unit device 1 is fixed and removed by a head holder 2 surgically embedded in the head of the small animal. The head holder 2 includes two parts, which are respectively arranged on both sides of the head of the small animal. According to the experimental needs, you can choose to install the eye tracking unit device 1 only on the head holder 2 on one side to observe the unilateral eye movement, or install the eye movement unit device 1 on the head holder 2 on both sides. The design of the eye-tracking device provided by the present invention includes two parts of circuit boards: the eye-tracking unit circuit board and the peripheral circuit board 3 arranged on the eye-tracking unit device 1. The circuit that must be close to the small animal is arranged on the ground of the eye-tracking unit. The circuit boards, such as the imaging module and the encoding module; other circuits such as the decoding module, etc., are all arranged on the peripheral circuit board 3 . Therefore, the two parts of the circuit boards respectively carry different functions. For example, the eye tracking unit circuit board can encode the captured eye motion image, and the peripheral circuit board 3 has a decoding function. The specific content of the circuit boards will be described in detail later. Therefore, when the eye-tracking device in the present invention is installed and used, the mouse only needs part 1 of the weight-bearing eye-tracking unit, see FIG. The corresponding hardware, the weight of which is not loaded on the mouse.
在一些实施例中,为了使小动物所负载的重量最小,眼动单元装置1上的眼动单元电路板仅具有成像模块和编码模块,使眼动单元电路板上仅具有必须要靠近小动物的电路部分,将眼动单元装置1的重量减至最小。In some embodiments, in order to minimize the weight of the small animal, the eye-tracking unit circuit board on the eye-tracking unit device 1 only has an imaging module and an encoding module, so that the eye-tracking unit circuit board only has to be close to the small animal. The circuit part of the eye tracking unit device 1 is minimized.
进一步,眼动单元装置1拍摄小动物的眼球运动,将拍摄的图像转化为数字信号传输,这样就可以传输任意长距离而无噪点,眼动单元电路板将所获取的图像编码后传送到外围电路板3,在外围电路板3部分进行解码。因为图像采集过程中电路板发热较强,电路板产生的热量会对小动物产生干扰,而电路板中最主要的发热部分是图像解码部分,所以将图像解码部分设计在外围电路板3,使其远离小动物,不会使小动物感到不适,也就降低了热量对小动物行为的影响。在一些实施例中,外围电路板3与眼动单元装置1之间通过信号线连接,眼动单元装置1将所拍摄的眼球运动图像转化为数字信号,图像编码后经长约50cm的信号线传输到外围电路板3进行解码,转换为USB 信号,然后传输到计算机。可替换地,眼动单元装置1编码后的数字信号传输还可以采用无线传输的方式传输到外围电路板3。Further, the eye movement unit device 1 captures the eye movement of the small animal, and converts the captured image into digital signal transmission, so that any long distance can be transmitted without noise, and the eye movement unit circuit board encodes the acquired image and transmits it to the periphery. Circuit board 3, decode in the peripheral circuit board 3 part. Because the circuit board generates strong heat during the image acquisition process, the heat generated by the circuit board will interfere with small animals, and the most important heating part in the circuit board is the image decoding part, so the image decoding part is designed on the peripheral circuit board 3, so that the It is far away from small animals, does not make small animals feel uncomfortable, and reduces the influence of heat on the behavior of small animals. In some embodiments, the peripheral circuit board 3 and the eye movement unit device 1 are connected through a signal line, and the eye movement unit device 1 converts the captured eye movement image into a digital signal, and the image is encoded through a signal line with a length of about 50 cm It is transmitted to the peripheral circuit board 3 for decoding, converted into a USB signal, and then transmitted to the computer. Alternatively, the digital signal transmission encoded by the eye tracking unit device 1 may also be transmitted to the peripheral circuit board 3 by means of wireless transmission.
眼动单元装置1中超微摄像头11和近红外光源12固定在外壳内部的固定位置上,外壳为可透过近红外光线的材质,或者,外壳在近红外光源12和超微摄像头11所形成的光路位置上做窗口设计,以保障近红外光线的顺利传输。由于实现部分功能的硬件不必装载在眼动单元装置1中,因此眼动单元电路板的尺寸可以大幅缩小,可以做到仅为现有技术中装置电路板大小的1/7,一对眼动单元装置1加头部固定器2的总长可以仅为28mm,从而大大减小了小动物所需负载的体积和重量。In the eye tracking unit device 1, the ultra-micro camera 11 and the near-infrared light source 12 are fixed on a fixed position inside the casing, and the casing is made of a material that can transmit near-infrared light, or the casing is formed by the near-infrared light source 12 and the ultra-micro camera 11. The window design is made on the position of the optical path to ensure the smooth transmission of near-infrared light. Since the hardware for realizing some functions does not need to be loaded in the eye tracking unit device 1, the size of the eye tracking unit circuit board can be greatly reduced, and it can be only 1/7 of the size of the circuit board of the device in the prior art, and a pair of eye tracking The total length of the unit device 1 and the head holder 2 can be only 28mm, thereby greatly reducing the volume and weight of the load required by the small animal.
眼动单元装置1的内部结构可以根据实验的具体需要做部分改变,参见说明书附图3,在本实施例中,设计了方案一,眼动单元装置1由外壳、超微摄像头11、近红外光源12和眼动单元电路板组成,一对眼动单元装置重量仅为0.8g。超微摄像头11设置在小鼠眼部外侧,直接对准小鼠眼部,本实施例提供的较佳方案为采用1280*720像素的3.8mm内窥镜摄像头约在12mm距离直接对准小鼠眼部。进一步,关于现有技术中因光源影响会造成所获取的眼睛图像质量欠佳的问题,例如,光源的设置会使图像产生光斑等问题,影响后期对眼动信息的准确处理,为解决这些问题,进一步优化光源的布局。参见说明书附图5(a)为现有技术中采用的环状围绕摄像头的光源,因瞳孔的通光特点,这种布局的环状光源设置会造成眼球转到某些方向时黑色瞳孔变成白色瞳孔,影响后期图像处理。因此,在本实施例中,参见说明书附图5(b),将近红外光源12改到超微摄像头11的旁侧,例如,两个近红外光源12并排设置在11旁边,直接对准小鼠眼部进行照明。优选地,为两个940nm近红外LED在摄像头旁侧5mm处照明,与小鼠眼部和摄像头成10-20°夹角,既不会造成白瞳孔,也不会在眼球周围形成过多阴影影响黑色瞳孔提取。为了进一步提升成像效果,可选地,还可以在超微摄像头11的镜头前方设置近红外带通滤光镜14,用于透射近红外光,阻止可见光,防止环境干扰眼动记录的成像,否则所获图像为眼部和环境图像的叠加。这与普通摄像机的近红 外截止滤光片作用相反,普通摄像机前的近红外截止滤光片透过可见光成像,滤掉近红外以调节色平衡,防止图像发红。神经科学研究中追踪眼部运动所获得的图像需要清晰、精细,本方案中摄像头的拍摄范围宽度为9mm,可计算分辨率为9mm/1280像素=0.007mm/像素;对比同类装置采用的640*480像素摄像头,拍摄范围宽度10mm,可算得的分辨率为10mm/640像素=0.016mm/像素,分辨率提高一倍,获得的图像清晰并且更为精细。摄像头越对准瞳孔,所获得的数据越精准,但是也遮挡了小鼠视野的中心区域,因而本方案适用于在对视野和注意力要求不高的研究中使用。The internal structure of the eye-tracking unit device 1 can be partially changed according to the specific needs of the experiment, see Figure 3 in the description, in this embodiment, a scheme 1 is designed. The light source 12 is composed of an eye-tracking unit circuit board, and a pair of eye-tracking unit devices weighs only 0.8g. The ultra-micro camera 11 is set on the outside of the mouse's eye and is directly aimed at the mouse's eye. The preferred solution provided in this embodiment is to use a 1280*720 pixel 3.8mm endoscope camera to directly aim at the mouse at a distance of about 12mm eye. Further, regarding the problems in the prior art that the quality of the obtained eye image may be poor due to the influence of the light source, for example, the setting of the light source will cause problems such as light spots in the image, which will affect the accurate processing of the eye movement information in the later stage. In order to solve these problems , to further optimize the layout of the light source. Referring to Figure 5 (a) of the description, it is a ring-shaped light source that surrounds the camera used in the prior art. Due to the light-passing characteristics of the pupil, the ring-shaped light source setting of this layout will cause the black pupil to turn into a black pupil when the eyeball is turned to certain directions. White pupils affect post-image processing. Therefore, in this embodiment, referring to Fig. 5(b) of the description, the near-infrared light source 12 is changed to the side of the ultra-micro camera 11, for example, two near-infrared light sources 12 are arranged side by side beside 11, and are directly aimed at the mouse Eye lighting. Preferably, two 940nm near-infrared LEDs are illuminated at 5mm beside the camera, forming an angle of 10-20° with the mouse's eyes and the camera, which will neither cause white pupils nor excessive shadows around the eyeballs Affects black pupil extraction. In order to further improve the imaging effect, optionally, a near-infrared bandpass filter 14 can be set in front of the lens of the ultra-micro camera 11 to transmit near-infrared light, block visible light, and prevent the environment from interfering with the imaging of eye movement recording, otherwise The acquired image is a superposition of the eye and environment images. This is the opposite of the near-infrared cut-off filter of ordinary cameras. The near-infrared cut-off filter in front of ordinary cameras transmits the image of visible light, filters out the near-infrared to adjust the color balance and prevent the image from turning red. The images obtained by tracking eye movements in neuroscience research need to be clear and precise. In this solution, the width of the camera's shooting range is 9mm, and the calculated resolution is 9mm/1280 pixels = 0.007mm/pixel; compared with the 640* The 480-pixel camera has a shooting range of 10mm wide, and the calculated resolution is 10mm/640 pixels = 0.016mm/pixel, the resolution is doubled, and the obtained images are clearer and more detailed. The more the camera is aimed at the pupil, the more accurate the data obtained, but it also blocks the central area of the mouse's field of vision, so this solution is suitable for use in studies that do not require high field of vision and attention.
在进行某些关于视觉、注意等研究时,要求视野中无遮挡物,但是上述方案由于摄像头对准瞳孔,所以遮挡了小鼠视野。为了进一步适应对于视觉、注意等研究的高要求,设计了参见说明书附图4所示的方案二,方案二中眼动单元装置1内部还可以包括近红外全反射镜13。近红外全反射镜13设置在小鼠眼部前外侧,近红外全反射镜13的作用在于透射可见光,小鼠可看到镜片后的任何物体,不影响小鼠视野,同时,近红外全反射镜13可以反射近红外光,这样近红外光源12发出的近红外光经近红外全反射镜13反射到小鼠眼睛进行照明,小鼠眼部图像经近红外全反射镜13反射到超微摄像头11成像。近红外反射镜采用45°全反射镜,即光的入射和出射角为45°时,反射最强,最终图像的对比度和清晰度最好,后继的图像处理较容易。所以眼睛和摄像头均朝向近红外反射镜,眼睛-反射镜和摄像头-反射镜两条连线与镜面均成45°夹角。而使用目标小鼠为侧眼动物,眼睛位于头部两侧,朝向左右斜上方,其方向为小鼠身体中轴向外侧转60°,再向上转25°。所以根据全反射镜和小鼠眼睛的特点,最终近红外全反射镜的最佳设置是:位置正对眼睛,方向与小鼠身体中轴的夹角为180°-60°-45°=75°,与水平面夹角25°。偏离这个角度,则反射能力逐渐下降,图像对比度变低,画面模糊,后继图像处理提取数据时噪音大错误多。超微摄像头11与近红外光源12可以设置在小鼠头部的后部两侧,朝向近红外全反射镜13,近红外带通滤光镜14在超微摄像头11的镜头前方。因此,除近红外全反射镜13以外的部分都 处于小鼠的视野之外,不再遮挡小鼠的视线,减少了对小鼠活动的影响。为了保证图片质量,近红外全反射镜13采用了石英材质,这使得近红外全反射镜13占据了本方案中眼部单元装置1的大部分重量,即便如此,此时包括近红外全反射镜13和近红外带通滤光镜14在内,一对眼动单元装置1的重量也仅为2g。虽然小鼠可以承受,但是与方案一相比,方案二的眼动单元装置1的重量还是重了2.5倍。因此,在当同时应用其它脑研究技术的研究中,需要头部固定其它负重物体时更适合于使用方案一。When conducting some research on vision and attention, it is required that there is no obstruction in the field of view, but the above scheme blocks the mouse field of view because the camera is aimed at the pupil. In order to further meet the high requirements for research on vision, attention, etc., scheme 2 shown in FIG. 4 of the specification is designed. In scheme 2, the eye movement unit device 1 may also include a near-infrared total reflection mirror 13 inside. The near-infrared total reflection mirror 13 is arranged on the front and outside of the mouse's eye. The function of the near-infrared total reflection mirror 13 is to transmit visible light, and the mouse can see any object behind the lens without affecting the mouse's field of vision. At the same time, the near-infrared total reflection mirror 13 The mirror 13 can reflect near-infrared light, so that the near-infrared light emitted by the near-infrared light source 12 is reflected to the mouse eye through the near-infrared total reflection mirror 13 for illumination, and the mouse eye image is reflected to the ultra-micro camera through the near-infrared total reflection mirror 13 11 Imaging. The near-infrared mirror adopts a 45° total reflection mirror, that is, when the incident and exit angles of light are 45°, the reflection is the strongest, the contrast and clarity of the final image are the best, and subsequent image processing is easier. Therefore, both the eye and the camera face toward the near-infrared reflector, and the two lines connecting the eye-reflector and the camera-reflector form an included angle of 45° with the mirror surface. The target mice were lateral-eyed animals, and the eyes were located on both sides of the head, facing obliquely upward and left, and the direction of the mouse body was 60° to the outside of the axis, and then 25° upward. Therefore, according to the characteristics of the total reflection mirror and mouse eyes, the final optimal setting of the near-infrared total reflection mirror is: the position is facing the eyes, and the angle between the direction and the central axis of the mouse body is 180°-60°-45°=75° °, the angle with the horizontal plane is 25°. Deviating from this angle, the reflection ability will gradually decrease, the image contrast will become lower, the picture will be blurred, and the subsequent image processing will make more noise and errors when extracting data. The ultra-micro camera 11 and the near-infrared light source 12 can be arranged on both sides of the rear of the mouse head, facing the near-infrared total reflection mirror 13 , and the near-infrared bandpass filter 14 is in front of the lens of the ultra-micro camera 11 . Therefore, the parts other than the near-infrared total reflection mirror 13 are all outside the mouse's field of vision, and the mouse's sight is no longer blocked, thereby reducing the influence on the mouse's activity. In order to ensure the picture quality, the near-infrared total reflection mirror 13 is made of quartz material, which makes the near-infrared total reflection mirror 13 occupy most of the weight of the eye unit device 1 in this solution. Even so, the near-infrared total reflection mirror is included at this time. Including the 13 and the near-infrared bandpass filter 14, the weight of the pair of eye tracking unit devices 1 is only 2g. Although the mice can bear it, the weight of the eye tracking unit device 1 of the second solution is still 2.5 times heavier than that of the first solution. Therefore, in studies where other brain research techniques are simultaneously applied and other weight-bearing objects need to be immobilized on the head, option 1 is more suitable.
固定眼动单元装置1的为头部固定器2,头部固定器2植入小动物头部,与设计在眼动单元装置1上的安装部配合使用以实现眼动单元装置1快捷地安装、拆卸。该衔接部分可设计为螺纹连接、卡扣连接等任何微型轻便牢固的结构。参见说明书附图6,优选地,采用插针连接,头部固定器2为设有多排平行插针21的插针底座,插针底座底部中空,置入到小鼠头部后露出了头顶的位置,以便于小鼠头部植入神经电极、光纤、微透镜等其它设备。插针21从插针底座上向小鼠身体外侧方向伸出。优选地,多排插针中,相邻两排插针21之间的间距相同。相对应地,眼动单元装置1上设置的安装部为平行设置的插孔,内有簧片或硅胶或空心针套管等防止插针21摇摆滑脱,相邻两排插孔之间的间距与插针21的间距相对应。安装时通过将插针21插入安装部的插孔中实现对眼动单元装置1的固定。The eye-tracking unit device 1 is fixed by the head holder 2. The head holder 2 is implanted in the head of the small animal and used in conjunction with the mounting part designed on the eye-tracking unit device 1 to realize the quick installation of the eye-tracking unit device 1. , dismantling. The connecting part can be designed as any miniature, lightweight and firm structure such as screw connection, snap connection, etc. Referring to Fig. 6 of the description, preferably, a pin connection is used, and the head holder 2 is a pin base provided with multiple rows of parallel pins 21. The bottom of the pin base is hollow, and the top of the head is exposed after being inserted into the mouse head. position to facilitate the implantation of nerve electrodes, optical fibers, microlenses and other devices in the mouse head. The pin 21 protrudes from the pin base toward the outside of the mouse body. Preferably, in the multiple rows of pins, the distance between two adjacent rows of pins 21 is the same. Correspondingly, the mounting part provided on the eye tracking unit device 1 is a parallel socket, and there are reeds, silica gel or hollow needle cannula inside to prevent the pin 21 from swinging and slipping, and the distance between the adjacent two rows of sockets is Corresponding to the pitch of the pins 21 . During installation, the eye tracking unit device 1 is fixed by inserting the pins 21 into the sockets of the installation part.
在实验前,头部固定器2经手术植入小动物颅骨,在本实施例中,头部固定器2的插针连接设计使得眼动单元装置1固定和拆卸时可以直接插拔,操作方便快捷。因此,眼动追踪装置1仅有头部固定器2部分需要长时间固定在小动物头部,其余部分可以分时在多只小动物实验时段使用,提高设备利用率,并避免实验外因小动物争斗损坏设备。在一些实施例中,头部固定器2提供了平行的三排插针21,眼动单元装置1实际上仅需两排插针21就可以实现固定,因此在插针底座有三根或者更多根插针的情况下,当任意插针之间的间距都相等时,可以任选两根插针进行固定,从而可方便地前后调整眼动单元装置1的位置,解决因不同实验者的手术习惯、实验脑区不同,植 入头部固定器2的位置有一定差异,而导致小鼠眼部超出眼动装置成像范围的问题,进一步保障将小鼠眼部全部纳入拍摄范围。而且,如果需要将装置应用于大鼠等动物,只需要调整头部固定器2以及眼动单元装置1上的安装部的尺寸即可使用。Before the experiment, the head immobilizer 2 was surgically implanted into the skull of the small animal. In this embodiment, the pin connection design of the head immobilizer 2 enables the eye tracking unit device 1 to be directly inserted and removed when it is fixed and disassembled, which is convenient to operate. fast. Therefore, only the head holder 2 of the eye-tracking device 1 needs to be fixed on the head of the small animal for a long time, and the rest of the eye tracking device can be used in the experimental period of multiple small animals in time-sharing, so as to improve the utilization rate of the equipment and avoid small animals due to external factors. Battle damage equipment. In some embodiments, the head holder 2 provides three parallel rows of pins 21, and the eye tracking unit device 1 actually only needs two rows of pins 21 to achieve fixation, so there are three or more pins at the pin base In the case of one pin, when the spacing between any pins is equal, two pins can be selected for fixation, so that the position of the eye tracking unit device 1 can be easily adjusted back and forth, which can solve the problems caused by the surgical habits of different experimenters. The experimental brain regions are different, and the position of the implanted head immobilizer 2 is different to a certain extent, which leads to the problem that the mouse's eyes are beyond the imaging range of the eye-tracking device, which further ensures that all the mouse's eyes are included in the shooting range. Furthermore, if the device needs to be applied to animals such as rats, it is only necessary to adjust the dimensions of the head immobilizer 2 and the mounting portion on the eye tracking unit device 1 .
此外,当眼动单元装置1的信号有线传输到计算机时,为了解决小动物在自由运动时容易使信号线缠绕、打结的问题,可在信号传导线路上连接导电滑环4,导电滑环4使得在小动物自由转圈时信号线也可自由旋转,避免打结,同时图像信号可以经过导电滑环4稳定地继续传输。导电滑环的阻力随导电通道数增加而迅速增加,所以导电通道数越少越好。眼动单元装置1与外围电路板3之间由8线传输信号,外围电路板3到计算机USB接口只有4条线,所以导电滑环4设置在外围电路板3和计算机之间。In addition, when the signal of the eye-tracking unit device 1 is transmitted to the computer by wire, in order to solve the problem that the signal wire is easily entangled and knotted when the small animal moves freely, a conductive slip ring 4 can be connected to the signal conduction line. 4. The signal line can also rotate freely when the small animal is free to rotate, avoiding knots, and at the same time, the image signal can continue to be transmitted stably through the conductive slip ring 4. The resistance of the slip ring increases rapidly with the number of conductive channels, so the fewer the number of conductive channels, the better. The eye tracking unit device 1 and the peripheral circuit board 3 transmit signals through 8 lines, and there are only 4 lines between the peripheral circuit board 3 and the computer USB interface, so the conductive slip ring 4 is arranged between the peripheral circuit board 3 and the computer.
综上所述,本发明提供了一种体积小重量轻的眼动追踪装置及方法,眼动追踪装置设计中的电路板包括了眼动单元电路板和外围电路板两部分承载,眼动追踪装置安装时,小鼠仅需负重眼动单元装置部分,减轻了小动物的负重。眼动单元装置通过实验前手术埋置在小动物头部的头部固定器可快捷地安装固定,使得眼动追踪装置只有头部固定器部分需要长时间固定在小动物头部,其它部分可以只在实验时使用,提高了装置的利用率,还避免了在实验外因动物争斗而损坏设备。眼动单元装置在头部固定器上可改变固定的具体位置,可以确保将小动物眼部全部纳入拍摄范围。头部固定器中部中空的设计便于眼动追踪装置在神经科学实验中协同其他神经技术探测小动物大脑。将现有技术中围绕摄像头的光源改到摄像头旁侧的优化设计提升了所获取的眼睛图像的质量。In summary, the present invention provides an eye-tracking device and method with a small size and light weight. The circuit board in the design of the eye-tracking device includes two parts of the eye-tracking unit circuit board and the peripheral circuit board. When the device is installed, the mouse only needs the part of the weight-bearing eye-tracking unit, which reduces the weight of small animals. The eye-tracking unit device can be quickly installed and fixed by the head holder embedded in the head of the small animal before the experiment, so that only the head holder part of the eye-tracking device needs to be fixed on the head of the small animal for a long time, and the other parts can be fixed on the head of the small animal for a long time. It is only used during the experiment, which improves the utilization rate of the device and avoids damage to the device due to animal fighting outside the experiment. The specific position of the eye tracking unit device can be changed on the head holder, which can ensure that the eyes of small animals are all included in the shooting range. The hollow design in the middle of the head holder facilitates the eye-tracking device to cooperate with other neurotechnologies to detect small animal brains in neuroscience experiments. The optimized design of changing the light source surrounding the camera to the side of the camera in the prior art improves the quality of the acquired eye image.
以上所述仅为本发明的较佳实施例,并不用以限制本发明,除了以上实施例以外,还可以具有不同的变形例,以上实施例的技术特征可以相互组合,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. In addition to the above embodiments, different modifications are also possible. The technical features of the above embodiments can be combined with each other. Within the scope of the present invention, any modifications, equivalent replacements, improvements, etc. made should be included within the protection scope of the present invention.

Claims (12)

  1. 一种安装在动物头部的眼动追踪装置,包括眼动单元装置和计算机,眼动单元装置中固定设置有超微摄像头和近红外光源,其特征在于,An eye-tracking device installed on the head of an animal, comprising an eye-tracking unit device and a computer, wherein an ultra-micro camera and a near-infrared light source are fixedly arranged in the eye-tracking unit device, characterized in that:
    整个所述眼动追踪装置的电路板分为眼动单元电路板和外围电路板两部分,所述眼动单元装置中还设置有所述眼动单元电路板和安装部,所述眼动单元电路板包括成像模块和编码模块;与所述编码模块对应的解码模块设置在所述外围电路板,所述外围电路板设置在所述眼动单元装置外,与所述计算机连接;所述外围电路板通过有线或者无线的方式连接所述眼动单元装置;The entire circuit board of the eye tracking device is divided into two parts: an eye tracking unit circuit board and a peripheral circuit board. The eye tracking unit device is also provided with the eye tracking unit circuit board and a mounting part. The circuit board includes an imaging module and an encoding module; a decoding module corresponding to the encoding module is arranged on the peripheral circuit board, and the peripheral circuit board is arranged outside the eye-tracking unit device and is connected to the computer; the peripheral The circuit board is connected to the eye tracking unit device in a wired or wireless manner;
    目标头部固定设置有头部固定器,所述眼动单元装置通过所述安装部可拆卸地安装在所述头部固定器上。The target head is fixedly provided with a head holder, and the eye tracking unit device is detachably mounted on the head holder through the mounting portion.
  2. 根据权利要求1所述的眼动追踪装置,其特征在于,所述头部固定器包括插针底座以及设置在所述插针底座上的插针。The eye tracking device according to claim 1, wherein the head holder comprises a pin base and a pin set on the pin base.
  3. 根据权利要求1所述的眼动追踪装置,其特征在于,所述头部固定器设置有两个具有一定间距的所述插针底座,所述插针从所述插针底座向所述目标头部两侧伸出。The eye tracking device according to claim 1, wherein the head holder is provided with two pin bases with a certain distance, and the pins are directed from the pin bases to the target. The sides of the head stick out.
  4. 根据权利要求1所述的眼动追踪装置,其特征在于,所述眼动单元装置和所述外围电路板通过信号线连接,所述外围电路板与所述计算机之间连接有导电滑环。The eye tracking device according to claim 1, wherein the eye tracking unit device and the peripheral circuit board are connected by a signal line, and a conductive slip ring is connected between the peripheral circuit board and the computer.
  5. 根据权利要求1所述的眼动追踪装置,其特征在于,所述超微摄像头和所述近红外光光源设置在所述目标眼部外侧,朝向所述目标眼部;The eye tracking device according to claim 1, wherein the ultra-micro camera and the near-infrared light source are arranged outside the target eye, facing the target eye;
    或者,所述眼动单元装置还包括近红外全反射镜,所述近红外全反射镜设置在所述目标眼部前外侧,所述超微摄像头和所述近红外光光源设置在动物视野之外,朝向所述近红外全反射镜。Or, the eye tracking unit device further includes a near-infrared total reflection mirror, the near-infrared total reflection mirror is arranged on the front and outside of the target eye, and the ultra-micro camera and the near-infrared light source are arranged between the animal's field of vision. outside, toward the near-infrared total reflection mirror.
  6. 根据权利要求5所述的眼动追踪装置,其特征在于,所述摄像头和所述光源设置在所述目标视轴上,对准所述目标眼部;The eye tracking device according to claim 5, wherein the camera and the light source are arranged on the target visual axis, aiming at the target eye;
    或者,所述近红外全反射镜与所述目标眼轴和所述超微摄像头光轴均成45°,对准所述目标眼部。Alternatively, the near-infrared total reflection mirror and the target eye axis and the optical axis of the ultra-micro camera are both at 45°, and are aimed at the target eye.
  7. 根据权利要求5所述的眼动追踪装置,其特征在于,所述近红外光源设置在所述超微摄像头旁侧,与所述目标眼部和摄像头成10-20°夹角。The eye tracking device according to claim 5, wherein the near-infrared light source is arranged beside the ultra-micro camera, and forms an angle of 10-20° with the target eye and the camera.
  8. 根据权利要求5所述的眼动追踪装置,其特征在于,所述眼动单元装置还包括近红外带通滤光镜,所述近红外带通滤光镜设置在所述超微摄像头镜头前方,滤除环境图像。The eye tracking device according to claim 5, wherein the eye tracking unit device further comprises a near-infrared bandpass filter, and the near-infrared bandpass filter is arranged in front of the ultra-micro camera lens , to filter out ambient images.
  9. 一种目标自由活动下的眼动追踪方法,使用固定在眼动单元装置内的超微摄像头获取所述目标眼睛图像,其特征在于,An eye-tracking method under the free movement of a target, using an ultra-micro camera fixed in an eye-moving unit device to obtain the target eye image, characterized in that,
    将所述眼动单元装置固定在所述目标头部,将解码模块设置在所述眼动单元装置外的外围电路板上;所述外围电路板通过有线或者无线的方式连接所述眼动单元装置,所述外围电路板不设置在所述目标头部。Fixing the eye-tracking unit device on the target head, and setting the decoding module on a peripheral circuit board outside the eye-tracking unit device; the peripheral circuit board is connected to the eye-tracking unit in a wired or wireless manner device, the peripheral circuit board is not arranged on the target header.
  10. 根据权利要求9所述的眼动追踪方法,其特征在于,The eye tracking method according to claim 9, wherein,
    使用包括插针底座和插针的所述头部固定器固定所述眼动单元装置,所述插针设置在所述插针底座上;using the head holder including a pin base and a pin to fix the eye tracking unit device, the pin being arranged on the pin base;
    将所述插针底座固定在所述目标头部,将所述眼动单元装置的安装部安装到所述插针上。The pin base is fixed on the target head, and the mounting part of the eye tracking unit device is mounted on the pin.
  11. 根据权利要求9所述的眼动追踪方法,其特征在于,The eye tracking method according to claim 9, wherein,
    所述头部固定器具有两个所述插针底座,将两个所述插针底座以一定间隔固定在所述目标头部,所述插针从所述插针底座向所述目标头部的两侧伸出。The head holder has two pin bases, and the two pin bases are fixed to the target head at a certain interval, and the pins go from the pin base to the target head protruding from both sides.
  12. 根据权利要求9所述的眼动追踪方法,其特征在于,The eye tracking method according to claim 9, wherein,
    使用导电滑环连接所述外围电路板与计算机。Use a conductive slip ring to connect the peripheral circuit board and the computer.
PCT/CN2020/131432 2020-11-25 2020-11-25 Eye movement tracking apparatus and method WO2022109858A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/131432 WO2022109858A1 (en) 2020-11-25 2020-11-25 Eye movement tracking apparatus and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/131432 WO2022109858A1 (en) 2020-11-25 2020-11-25 Eye movement tracking apparatus and method

Publications (1)

Publication Number Publication Date
WO2022109858A1 true WO2022109858A1 (en) 2022-06-02

Family

ID=81754998

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/131432 WO2022109858A1 (en) 2020-11-25 2020-11-25 Eye movement tracking apparatus and method

Country Status (1)

Country Link
WO (1) WO2022109858A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1960670A (en) * 2004-04-01 2007-05-09 威廉·C·托奇 Biosensors, communicators, and controllers for monitoring eye movement and methods for using them
US20140111632A1 (en) * 2012-10-23 2014-04-24 Pixart Imaging Inc. Pupil detection device
CN205594581U (en) * 2016-04-06 2016-09-21 北京七鑫易维信息技术有限公司 Module is tracked to eyeball of video glasses
CN206178658U (en) * 2016-08-10 2017-05-17 北京七鑫易维信息技术有限公司 Module is tracked to eyeball of video glasses
CN108205374A (en) * 2018-01-02 2018-06-26 京东方科技集团股份有限公司 Eyeball tracking module and its method, the video glass of a kind of video glass

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1960670A (en) * 2004-04-01 2007-05-09 威廉·C·托奇 Biosensors, communicators, and controllers for monitoring eye movement and methods for using them
US20140111632A1 (en) * 2012-10-23 2014-04-24 Pixart Imaging Inc. Pupil detection device
CN205594581U (en) * 2016-04-06 2016-09-21 北京七鑫易维信息技术有限公司 Module is tracked to eyeball of video glasses
CN206178658U (en) * 2016-08-10 2017-05-17 北京七鑫易维信息技术有限公司 Module is tracked to eyeball of video glasses
CN108205374A (en) * 2018-01-02 2018-06-26 京东方科技集团股份有限公司 Eyeball tracking module and its method, the video glass of a kind of video glass

Similar Documents

Publication Publication Date Title
Creel Visually evoked potentials
CA2887535C (en) Configuration and spatial placement of frontal electrode sensors to detect physiological signals
Smith et al. Stream-dependent development of higher visual cortical areas
JP5308305B2 (en) Retinal potential measuring device
US20230137387A1 (en) System and method for visualization of ocular anatomy
WO2018218048A1 (en) Oculometric neurological examination (one) appliance
CN106491074B (en) Turnover type eye vibration graph instrument
CN112716445A (en) Eye movement tracking device and method
EP2853937B1 (en) Goggle-like mobile apparatus and method for recording images of a pupil of a person
Händel et al. The brain during free movement–What can we learn from the animal model
Rector et al. A miniature CCD video camera for high-sensitivity light measurements in freely behaving animals
WO2022109858A1 (en) Eye movement tracking apparatus and method
ES2943064T3 (en) Virtual reality viewer for visual neurorehabilitation
WO2019052246A1 (en) Portable visual electrophysiological detection system
KR102646182B1 (en) EEG detection and nerve stimulation system including a wearable EEG headset and 3D glasses wearing a patient
Harris Contrast sensitivity and acuity of a conscious cat measured by the occipital evoked potential
CN110680275A (en) Binocular multispectral pupil light reflex quantitative measuring instrument
CN201104873Y (en) Nystagmus tester
CN111818839B (en) Device for determining visual system
RU113941U1 (en) DEVICE FOR STUDYING THE FIELD OF VISION
TWI580396B (en) Head-mounted system for visual physology
CN213489785U (en) Turnover type eye cover
CN215937322U (en) Visual inspection equipment
Tanaka et al. Chronically mountable goggles for persistent exposure to single orientation
CN211460224U (en) Eye patch for collecting eyeball movement and head movement in real time

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20962749

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20962749

Country of ref document: EP

Kind code of ref document: A1