LU502006B1 - Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children - Google Patents

Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children Download PDF

Info

Publication number
LU502006B1
LU502006B1 LU502006A LU502006A LU502006B1 LU 502006 B1 LU502006 B1 LU 502006B1 LU 502006 A LU502006 A LU 502006A LU 502006 A LU502006 A LU 502006A LU 502006 B1 LU502006 B1 LU 502006B1
Authority
LU
Luxembourg
Prior art keywords
wavelength led
spectacle frame
light source
pupil
modules
Prior art date
Application number
LU502006A
Other languages
German (de)
Inventor
Huixuan Liu
Qinghua Li
Zhen Huang
Bing Xu
Dongyu Li
Xiao Jin
Zhenghe Zhang
Jianhong Zheng
Tingting Zhang
Minglang Huang
Haijing Ruan
Original Assignee
Univ Lingnan Normal
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Lingnan Normal filed Critical Univ Lingnan Normal
Priority to LU502006A priority Critical patent/LU502006B1/en
Application granted granted Critical
Publication of LU502006B1 publication Critical patent/LU502006B1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Ophthalmology & Optometry (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The present disclosure discloses an optical nondestructive detector based on a multi- wavelength LED for exceptional children. The detector comprises a spectacle frame, a multi- wavelength LED light source arranged on the spectacle frame, a multi-wavelength LED light source control module, image acquisition modules arranged on the spectacle frame and having view finding directions facing the eye side, an infrared light supplementing modules arranged on the spectacle frame and having light supplementing directions facing the eye side, an image data storage module arranged on the spectacle frame and used for storing image data acquired by the image acquisition module, a main control module arranged on the spectacle frame and connected with the light source control module, the image acquisition module, the infrared light supplementing module and the image data storage module, and a wireless communication module arranged on the spectacle frame and connected with the main control module.

Description

OPTICAL NONDESTRUCTIVE DETECTOR AND DETECTION METHOD BASED 11502006
ON MULTI-WAVELENGTH LED FOR EXCEPTIONAL CHILDREN
TECHNICAL FIELD
[01] The present disclosure belongs to the technical field of eye movement detection, and particularly relates to an optical nondestructive detector a detection method based on a multi- wavelength LED for exceptional children.
BACKGROUND ART
[02] Most of existing eye movers adopt a recognition technology based on pupil-cornea reflection light spots, its characteristic of unchanging in the eye movement process indicates a
Purkinje spot on the outer surface of the eyeball cornea, namely a bright light spot on the eyeball cornea, the bright light spot is generated by reflecting light entering the pupil on the outer surface of the cornea.
[03] Due to the fact that the position of the eye tracker (including camera) is fixed, the position of the light source is also fixed, the center position of the eyeball is unchanged (it is assumed that the eyeball is spherical and the head is fixed), and the absolute position of the
Purkinje spots does not change along with rotation of the eyeball. The positions of the Purkinje spots relative to pupils and the eyeball change continuously, for example, when a user stares at the camera, the Purkinje spots are located between the pupils of the user; when the eyeball of the user raises, the Purkinje spots are located below the pupils of the user. The sight direction of the user can be estimated through a geometric model as long as the positions of the pupils and the Purkinje spots on the eye image are positioned in real time and the reflection vector of the cornea is calculated.
[04] According to eye tracker detection equipment in the related technology, its light source is generally arranged independently, the structure is complex, the size is large, carrying is inconvenient, and detection cannot be conducted anytime and anywhere; light of the light source generates glare and hurts the eyes; due to the fact that the distance between the light source and the eyes is large during detection, the light source is prone to being interfered by external light, and the requirement for the use environment is high; and the wavelength of irradiation light waves is single, different tested subjects have different response sensitivities to the pupils with different wavelengths, and test fatigue of the subjects is prone to being caused.
SUMMARY
[05] The technical solution of the disclosure is as follow:
[06] An optical nondestructive detector based on a multi-wavelength LED for exceptional children comprises:
[07] a head-mounted spectacle frame, wherein an outer edge support extending forwards is arranged at the upper part of the spectacle frame;
[08] a multi-wavelength LED light source, wherein the multi-wavelength LED light source is arranged at the front end of the outer edge support, and the light emitting direction of the multi-wavelength LED light source faces the eye side; 1
[09] a multi-wavelength LED light source control module which is arranged on the outer edge support and connected with the multi-wavelength LED light source; LU502006
[10] two image acquisition modules, wherein the two image acquisition modules are arranged on the left side and the right side of the lower part of the spectacle frame respectively, and the view finding directions of the image acquisition modules face the eye side of the spectacle frame;
[11] two infrared light supplementing modules, wherein the two infrared light supplementing modules are arranged on the left side and the right side of the lower part of the spectacle frame respectively, and the light supplementing directions of the infrared light supplementing modules face the eye side of the spectacle frame;
[12] an image data storage module which is arranged on the spectacle frame and used for storing image data acquired by the image acquisition modules;
[13] a main control module which is arranged on the spectacle frame and connected with the multi-wavelength LED light source control module, the image acquisition modules, the infrared light supplementing modules and the image data storage module;
[14] a wireless communication module which is arranged on the spectacle frame, connected with the main control module and used for receiving an external control instruction and outputting the image data; and
[15] a power supply module which is arranged on the spectacle frame and in power supply connection with the multi-wavelength LED light source, the multi-wavelength LED light source control module, the image acquisition modules, the infrared light supplementing modules, the image data storage module, the main control module and the wireless communication module.
[16] As a further improvement, the left side and the right side of the lower portion of the spectacle frame are each provided with a flexible adjustable support, and each flexible adjustable support is provided with one image acquisition module and one infrared light supplementing module.
[17] As a further improvement, the multi-wavelength LED light source comprises an LED with the center light-emitting wavelength being 405nm, an LED with the center light-emitting wavelength being 550nm, an LED with the center light-emitting wavelength being 650nm, and an LED which emits white light and has the light-emitting wavelength range being 405nm- 650nm.
[18] As a further improvement, the multi-wavelength LED light source control module controls the multi-wavelength LED light source 3 to emit light rays with different illuminance by controlling the current of the multi-wavelength LED light source 3, and/or the multi- wavelength LED light source control module emits light rays with different wavelengths by controlling on-off of all the LEDs in the multi-wavelength LED light source 3.
[19] As a further improvement, the wireless communication module is a Bluetooth wireless communication module.
[20] As a further improvement, the power supply module comprises a storage battery and a 2 charging interface which is arranged on the spectacle frame and connected with the storage battery. LU502006
[21] According to the optical nondestructive detector based on the multi-wavelength LED for the exceptional children, the light source is arranged on the outer edge support of the spectacle frame; the image acquisition module and the infrared light supplementing module are arranged on the spectacle frame and integrated to form a spectacle type structure, thus the size is small, and wearing is easy and convenient. Due to the fact that the light source is arranged on the spectacle frame, the light source is close to the eyes during detection and is not prone to being interfered by external light, the requirement for the use environment is low, and the use environment is friendly. In addition, due to irradiation of the abundant multi-wavelength light source, the test fatigue of a tested object is relieved, the response sensitivity of different tested objects to pupils with different wavelengths is improved, the PLR detection convenience of the exceptional children is improved, and the detection efficiency is improved.
[22] Furthermore, the present disclosure provides a detection method adopting the above optical nondestructive detector based on the multi-wavelength LED for exceptional children.
The method comprises the following steps:
[23] S1, wearing the spectacle frame on the head of a detected person;
[24] S2, enabling the view finding directions of two image acquisition modules to face the left eye pupil and the right eye pupil respectively so that clear pupil images can be acquired, and enabling the light supplementing directions of two infrared light supplementing modules to face the left eye pupil and the right eye pupil respectively so that infrared light supplementing can be conducted on the left eye pupil and the right eye pupil respectively;
[25] S3, emitting near-infrared light rays through the infrared light supplementing modules to continuously illuminate the pupils, controlling the current and on-off of the multi-wavelength
LED light source through the multi-wavelength LED light source control module, and enabling the multi-wavelength LED light source to emit light rays with different colors and illuminance to arouse pupil light stimulation reflection responses;
[26] S4, acquiring pupil multi-frame continuous images of the light stimulation reflection responses through the image acquisition modules; and
[27] SS, processing the pupil multi-frame continuous images, obtaining a pupil reflection curve by extracting pupil image dynamic parameters.
[28] As a further improvement, in the step S3, the near-infrared light rays with the wavelength of 940nm emitted by the infrared light supplementing modules continuously illuminate pupils, and flash light rays with different wavelengths which can be automatically adjusted within the range of 0-1000ms are randomly selected and emitted through the multi- wavelength LED light source to stimulate the pupils.
[29] As a further improvement, the step S4 includes pupil image acquisition and pupil light stimulation reflection image acquisition. According the pupil image acquisition, the base line pupil image is obtained for 1 second, then the multi-wavelength LED light source emits automatically-adjustable flashing light within the range of 0-1000ms, and then pupil image obtaining is continuously carried out for 2 seconds so as to capture the whole pupil reduction and recovery process. According to the pupil light stimulation reflection image acquisition, the 3 positions of pupils and Purkinje spots on the eye image are positioned, the cornea reflection vector and pupil change size data are calculated, and the sight line change direction of the user LU502006 is estimated through light and back-end analysis.
[30] Asa further improvement, in the step S5, in detection of 4 seconds each time, the image acquisition rate of 200Hz is obtained from each eye, the image size is 192 pixels x 192 pixels, and the resolution is 12 bits.
[31] The detection method on the basis of the optical nondestructive detector based on the multi-wavelength LED for exceptional children should have the same or corresponding beneficial effects of the detector, and therefore unnecessary details are not needed any more.
BRIEF DESCRIPTION OF THE DRAWINGS
[32] FIG. lisa front structure schematic diagram of an optical nondestructive detector based on a multi-wavelength LED for exceptional children.
[33] FIG. 2 is a left view diagram of FIG. 1.
[34] FIG. 3 is a right view diagram of FIG. 1.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[35] As shown in FIG. 1, FIG. 2 and FIG. 3, the embodiment of the present disclosure provides an optical nondestructive detector based on a multi-wavelength LED for exceptional children. The optical nondestructive detector based on the multi-wavelength LED for exceptional children comprises:
[36] a head-mounted spectacle frame 1, wherein the spectacle frame 1 is a semi-frame spectacle frame and is free of lenses, and an outer edge support 3 extending forwards is arranged at the position of the middle nose bridge of the upper portion of the spectacle frame 1;
[37] a multi-wavelength LED light source 2, wherein the multi-wavelength LED light source 2 is arranged at the front end of the outer edge support 3, the light emitting direction of the multi-wavelength LED light source 2 faces the eye side, and the light emitting direction of the multi-wavelength LED light source 2 faces the left eye and the right eye respectively;
[38] a multi-wavelength LED light source control module 4, wherein the multi-wavelength
LED light source control module 4 is arranged on the outer edge support 3 and connected with the multi-wavelength LED light source 2, and the multi-wavelength LED light source control module 4 can control the multi-wavelength LED light source 3 to emit light rays with different illuminance or different wavelengths;
[39] two image acquisition modules 5, wherein the two image acquisition modules 5 are arranged on the left side and the right side of the lower portion of the spectacle frame 1 respectively, the view finding direction of the image acquisition modules 5 faces the eye side of the spectacle frame 1, the image acquisition modules 5 are high-frame high-sampling-rate cameras, and the two image acquisition modules 5 are used for carrying out image acquisition on the left eye and the right eye respectively; 4
[40] two infrared light supplementing modules 12, wherein the two infrared light supplementing modules 12 are arranged on the left side and the right side of the lower portion LU502006 of a spectacle frame 1 respectively, the light supplementing directions of the infrared light supplementing modules 12 face the eye side of the spectacle frame 1, and the two infrared light supplementing modules 12 conduct infrared light supplementing on the left eye and the right eye respectively;
[41] an image data storage module 6, wherein the image data storage module 6 is arranged on the spectacle frame 1 and used for storing image data acquired by the image acquisition modules 5, and particularly, the image data storage module 6 can be embedded in the spectacle frame 1;
[42] a main control module 7, wherein the main control module 7 is arranged on the spectacle frame 1 and is connected with the multi-wavelength LED light source control module 4, the image acquisition modules 5, the infrared light supplementing modules 12 and the image data storage module 6, the main control module 7 can be embedded in the spectacle frame 1, the main control module 7 outputs a light source control instruction to the multi-wavelength
LED light source control module 4 so as to control the multi-wavelength LED light source 2 to emit light rays with different colors and illumination, the main control module 7 outputs an image acquisition instruction to the image acquisition module 5 so as to control the image acquisition module 5 to acquire images, the main control module 7 outputs an image storage and reading instruction to the image data storage module 6 so as to respectively control the image acquisition module 5 to store image data and read the image data from the image acquisition module 5;
[43] a wireless communication module 8, wherein the wireless communication module 8 is arranged on the spectacle frame 1, connected with the main control module 7 and used for receiving an external control instruction and outputting image data, the main control module 7 and the wireless communication module 8 can adopt Bluetooth modules based on STM32, can collect pupil image data, store pupil images in the image data storage module 6 and transmit the pupil images through Bluetooth; and
[44] a power supply module 9, wherein the power supply module 9 is arranged on the spectacle frame 1 and is in power supply connection with the multi-wavelength LED light source 2, the multi-wavelength LED light source control module 4, the image acquisition modules 5, the infrared light supplementing modules 12, the image data storage module 6, the main control module 7 and the wireless communication module 8, and the power supply module is responsible for supplying power to all the modules.
[45] As a further preferable implementation mode, the left side and the right side of the lower portion of a spectacle frame 1 are each provided with a flexible adjustable support 11, and each flexible adjustable support 11 is provided with one image acquisition module 5 and one infrared light supplementing module 12. In this way, the view finding directions of the image acquisition modules 5 and the light supplementing directions of the infrared light supplementing modules 12 can be adjusted by bending the flexible adjustable supports 11 so as to better adapt to a detected person.
[46] The embodiment of the present disclosure also provides a detection method adopting the above optical nondestructive detector based on the multi-wavelength LED for exceptional children. The method comprises the following steps:
[47] S1, wearing a spectacle frame 1 on the head of a detected person;
LU502006
[48] S2, enabling the view finding directions of two image acquisition modules 5 to face the left eye pupil and the right eye pupil respectively so that clear pupil images can be acquired, and enabling the light supplementing directions of two infrared light supplementing modules 12 to face the left eye pupil and the right eye pupil respectively so that infrared light supplementing can be conducted on the left eye pupil and the right eye pupil respectively;
[49] S3, emitting near-infrared light rays through the infrared light supplementing modules 12 to continuously illuminate the pupils, controlling the current and on-off of the multi- wavelength LED light source 2 through the multi-wavelength LED light source control module 4, and enabling the multi-wavelength LED light source to emit light rays with different colors and illuminance to arouse pupil light stimulation reflection responses, wherein near-infrared light rays with the wavelength of 940nm emitted by the infrared light supplementing module 12 continuously illuminate pupils, and flash light rays with different wavelengths which can be automatically adjusted within the range of 0-1000ms are randomly selected and emitted through the multi-wavelength LED light source 2 to stimulate the pupils.
[50] S4, acquiring pupil multi-frame continuous images of the light stimulation reflection responses through the image acquisition modules 5, wherein image acquisition includes pupil image acquisition and pupil light stimulation reflection image acquisition; according to the pupil image acquisition, a base line pupil image is obtained for 1 second, then the multi- wavelength LED light source emits automatically-adjustable flashing light within the range of 0-1000ms, such as a 75ms flashlight, and then pupil image obtaining is continuously carried out for 2 seconds so as to capture the whole pupil reduction and recovery process; and according to pupil light stimulation reflection image acquisition, the positions of pupils and Purkinje spots on an eye image are positioned, the cornea reflection vector and pupil change size data are calculated, and the sight line change direction of a user is estimated through light and back-end analysis. [S1] S5, in detection of 4 seconds each time, obtaining the image acquisition rate of 200Hz from each eye, wherein the image size is 192 pixels x 192 pixels, and the resolution is 12 bit; processing the pupil multi-frame continuous images; and obtaining a pupil reflection curve by extracting pupil image dynamic parameters. 6

Claims (2)

WHAT IS CLAIMED IS: LU502006
1. An optical nondestructive detector based on a multi-wavelength LED for exceptional children, comprising: a head-mounted spectacle frame, wherein an outer edge support extending forwards is arranged at the upper part of the spectacle frame; a multi-wavelength LED light source, wherein the multi-wavelength LED light source is arranged at the front end of the outer edge support, and the light emitting direction of the multi- wavelength LED light source faces the eye side; a multi-wavelength LED light source control module which is arranged on the outer edge support and connected with the multi-wavelength LED light source; two image acquisition modules, wherein the two image acquisition modules are arranged on the left side and the right side of the lower part of the spectacle frame respectively, and the view finding directions of the image acquisition modules face the eye side of the spectacle frame; two infrared light supplementing modules, wherein the two infrared light supplementing modules are arranged on the left side and the right side of the lower part of the spectacle frame respectively, and the light supplementing directions of the infrared light supplementing modules face the eye side of the spectacle frame; an image data storage module which is arranged on the spectacle frame and used for storing image data acquired by the image acquisition modules; a main control module which is arranged on the spectacle frame and connected with the multi-wavelength LED light source control module, the image acquisition modules, the infrared light supplementing modules and the image data storage module; a wireless communication module which is arranged on the spectacle frame, connected with the main control module and used for receiving an external control instruction and outputting the image data; and a power supply module which is arranged on the spectacle frame and in power supply connection with the multi-wavelength LED light source, the multi-wavelength LED light source control module, the image acquisition modules, the infrared light supplementing modules, the image data storage module, the main control module and the wireless communication module.
2. A detection method adopting the optical nondestructive detector based on the multi- wavelength LED for exceptional children according to claim 1, comprising the following steps: S1, wearing the spectacle frame on the head of a detected person; S2, enabling the view finding directions of two image acquisition modules to face the left eye pupil and the right eye pupil respectively so that clear pupil images can be acquired, and 7 enabling the light supplementing directions of two infrared light supplementing modules to face the left eye pupil and the right eye pupil respectively so that infrared light supplementing can LU502006 be conducted on the left eye pupil and the right eye pupil respectively;
S3, emitting near-infrared light rays through the infrared light supplementing modules to continuously illuminate the pupils, controlling the current and on-off of the multi-wavelength LED light source through the multi-wavelength LED light source control module, and enabling the multi-wavelength LED light source to emit light rays with different colors and illuminance to arouse pupil light stimulation reflection responses;
S4, acquiring pupil multi-frame continuous images of the light stimulation reflection responses through the image acquisition modules; and
SS, processing the pupil multi-frame continuous images, obtaining a pupil reflection curve by extracting pupil image dynamic parameters.
8
LU502006A 2022-05-05 2022-05-05 Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children LU502006B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
LU502006A LU502006B1 (en) 2022-05-05 2022-05-05 Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
LU502006A LU502006B1 (en) 2022-05-05 2022-05-05 Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children

Publications (1)

Publication Number Publication Date
LU502006B1 true LU502006B1 (en) 2023-11-06

Family

ID=88651454

Family Applications (1)

Application Number Title Priority Date Filing Date
LU502006A LU502006B1 (en) 2022-05-05 2022-05-05 Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children

Country Status (1)

Country Link
LU (1) LU502006B1 (en)

Similar Documents

Publication Publication Date Title
JP6159263B2 (en) Optical measurement apparatus and method for adjusting illumination characteristics and capturing at least one parameter in at least one eye
US10997794B2 (en) Optical measuring and scanning system and methods of use
US8077914B1 (en) Optical tracking apparatus using six degrees of freedom
CN104094197B (en) Watch tracking attentively using projecting apparatus
CN110502100B (en) Virtual reality interaction method and device based on eye movement tracking
US11442542B2 (en) Systems and methods for eye tracking
US20190101984A1 (en) Heartrate monitor for ar wearables
CN105900141A (en) Mapping glints to light sources
JPH0782539B2 (en) Pupil imager
CN109254420A (en) A kind of adaptive device of head-wearing device
CN111714081A (en) Optical nondestructive special child detector based on multi-wavelength LED and detection method
JP6957048B2 (en) Eye image processing device
CN114099984B (en) Vision training device and vision training instrument
LU502006B1 (en) Optical nondestructive detector and detection method based on multi-wavelength led for exceptional children
CN115591131A (en) Myopia prevention and control device and control method thereof
CN111772575A (en) LED (light emitting diode) -based optical nondestructive special children detector and detection method
JP7228885B2 (en) Pupil detector
JP6687195B2 (en) Eye image processing device
CN217447758U (en) Pupil light reflection data acquisition system based on single camera
CN208861101U (en) A kind of adaptive device of head-wearing device
CN114748035A (en) Pupil light reflection data acquisition system based on single camera
CN202198573U (en) Eye imaging device
WO2021125992A1 (en) Device for determining gaze direction
US20230393654A1 (en) Optical tracking including imaging-based angle sensitive detectors
RU219079U1 (en) Device for determining the direction of gaze

Legal Events

Date Code Title Description
FG Patent granted

Effective date: 20231106