CN116803333A - Pupil diameter change measuring method and measuring system for light reflection - Google Patents

Abstract

The invention provides a pupil diameter change measuring method and a measuring system for light reflection, which are characterized in that light sources with different wavelengths are given to a single-side pupil in a darkroom environment to light and stimulate, images of the pupil diameter change of opposite-side pupils are measured, the images of the opposite-side pupils are continuously acquired and acquired by an infrared camera under the darkroom condition with good stability, the images of the opposite-side pupils are continuously acquired and acquired before and after the pupil on the same side of the light and stimulated for a certain period of time, pupil identification is carried out through an image data processing means to acquire pupil diameter continuous change data, a data scatter diagram with the pupil diameter change along with time is generated, curve fitting is carried out for index researches such as subsequent pupil dilation shrinkage, change speed and the like, pupil measurement is carried out on different subjects, and the acquired data can provide reference for relevant clinical disease research.

Description

Pupil diameter change measuring method and measuring system for light reflection

Technical Field

The invention relates to the field of pupil behavior data measurement, in particular to a pupil diameter change measuring method and a pupil diameter change measuring system for light reflection.

Background

The human body pupil is stimulated by light, and the behavior of the human body can be studied by causing the change of the pupil. A set of test system is designed to give a certain light source to the pupil of the subject to light up the stimulus, and meanwhile, the pupil image of the subject is collected, so that the pupil image of the subject is processed and analyzed to obtain the influence of the light source stimulus on the change of the pupil diameter.

However, in the existing test system, when the light source stimulates the pupil of the subject by the light source, the pupil image of the subject is shot, and the light source is easily influenced by external illumination and illumination; meanwhile, the conventional stimulus light source is single in wavelength and color, and cannot study the influence on the pupil size under different stimulus environments.

Disclosure of Invention

The invention provides a pupil diameter change measuring method and a pupil diameter change measuring system for light reflection aiming at the technical problems in the prior art.

According to a first aspect of the present invention, there is provided a pupil diameter variation measuring method of light reflection, comprising:

providing lighting stimulus of different wavelength light sources to a single pupil of a subject in a darkroom environment;

collecting an image of the pupil on the opposite side of the subject by using an infrared camera, wherein the shooting area of the infrared camera is supplemented with light based on an infrared light source, and the light feeding area of the pupil on the single side of the subject and the shooting area of the pupil on the opposite side of the subject are separated;

identifying the pupil area of the subject according to the image of the pupil on the opposite side of the subject, and extracting pupil diameter data of the subject;

based on pupil diameter data at different times, a data scatter plot of pupil diameter changes over time is generated and curve fitting is performed.

According to a second aspect of the present invention, there is provided a pupil diameter variation measuring system for light reflection, including a plurality of LED light sources, an infrared light source, an infrared camera and a processing module;

the LED light sources are used for giving lighting stimulus of different wavelength light sources to the pupils of the single side of the subject in a darkroom environment;

an infrared camera for acquiring images of the contralateral pupil of the subject;

the infrared light source is used for supplementing light to a shooting area of the infrared camera, wherein the light supply area of the pupil at one side of the subject and the shooting area of the pupil at the opposite side of the subject are isolated by the partition plate;

the processing module is used for identifying the pupil area of the subject according to the image of the pupil on the opposite side of the subject and extracting pupil diameter data of the subject; and generating a data scatter diagram changing with time and pupil diameter based on pupil diameter data at different times, and performing curve fitting.

According to the pupil diameter change measuring method and system for light reflection, different wavelength light sources are given to a single-side pupil in a darkroom environment to light and stimulate, images of pupil diameter change of opposite-side pupils are measured, the images of the opposite-side pupils are continuously acquired and acquired by using an infrared camera under the darkroom condition with good stability, the images of the opposite-side pupils are continuously acquired and acquired before and after the same-side pupils are continuously lighted and stimulated for a certain period of time by using a certain power LED light source, pupil identification is carried out through an image data processing means to acquire pupil diameter continuous change data, a data scatter diagram with pupil diameter change along with time is generated, curve fitting is carried out, subsequent index researches such as pupil dilation shrinkage and change speed are carried out, pupil measurement is carried out on different subjects, and the acquired data can provide reference for related clinical disease research.

Drawings

FIG. 1 is a flow chart of a method for measuring pupil diameter variation of light reflection provided by the invention;

fig. 2 is a schematic diagram of a pupil image capturing process;

FIG. 3 is a schematic diagram of a pupil diameter variation measuring system for light reflection according to the present invention;

FIG. 4 is a software operational control, data processing flow diagram;

FIG. 5 is a schematic diagram of the distribution of the main functions of the software;

FIG. 6 is a schematic diagram of a software operation acquisition main interface;

FIG. 7 is a schematic diagram of a light source parameter setting interface;

FIG. 8 is a schematic diagram of an infrared camera position adjustment interface;

FIG. 9 is a schematic diagram of a pupil image batch processing interface;

FIG. 10 is a diagram showing the progress of pupil image browsing;

FIG. 11 is a schematic diagram of a pupil identification procedure;

FIG. 12 is a schematic diagram of a pupil image recognition process;

FIG. 13 is a graph showing the results of a piecewise fit to pupil diameter data;

FIG. 14 is a diagram of pupil index definitions;

fig. 15 is a schematic view of pupil diameter variation astigmatism;

fig. 16 is a graph of pupil diameter variation.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention. In addition, the technical features of each embodiment or the single embodiment provided by the invention can be combined with each other at will to form a feasible technical scheme, and the combination is not limited by the sequence of steps and/or the structural composition mode, but is necessarily based on the fact that a person of ordinary skill in the art can realize the combination, and when the technical scheme is contradictory or can not realize, the combination of the technical scheme is not considered to exist and is not within the protection scope of the invention claimed.

Fig. 1 is a flowchart of a method for measuring pupil diameter variation of light reflection, which is provided by the invention, as shown in fig. 1, and the method comprises the following steps:

s1, giving lighting stimulus of different wavelength light sources to a pupil of a single side of a subject in a darkroom environment.

As an embodiment, the illuminating stimulus for giving different wavelength light sources to the pupil of the single side of the subject comprises: giving lighting stimulus to a single-side pupil of a subject based on a plurality of LED light sources, wherein the plurality of LED light sources provide light sources with different wavelengths; and adjusting the brightness and the lighting stimulation time of each LED light source.

It can be understood that, in the embodiment of the present invention, in order to avoid the influence of external illumination, different wavelength light sources are given to the pupil on one side of the subject for a period of illumination stimulus in the darkroom environment, and a pupil image reflected by the pupil on the other side is captured.

Different researches show that the influence of light sources with different wavelengths on pupil reflection is different, and the main trend is to compound white light, monochromatic red light and blue light, so that the control of multiple paths of light sources can be realized to meet the research and test requirements. In the embodiment of the invention, the light sources with different wavelengths are provided by the multi-path LED light sources to perform light source stimulation on the pupil at one side of the subject, so that the brightness adjustment and the lighting stimulation time adjustment can be performed on each path of LED light source.

S2, acquiring an image of the pupil on the opposite side of the subject by using an infrared camera, wherein the shooting area of the infrared camera is supplemented with light based on an infrared light source, and the light feeding area of the pupil on the single side of the subject and the shooting area of the pupil on the opposite side of the subject are separated.

As an embodiment, the acquiring the subject's contralateral pupil image with the infrared camera includes: and (3) carrying out light filling on the shooting area based on the infrared light source, adjusting the position of the infrared light source and the image acquisition frame rate of the infrared camera, and adjusting the position of the infrared camera, so that the pupil of the subject is in the shooting view field of the infrared camera and the pupil of the subject is in the working distance position of the infrared camera.

It can be appreciated that, while the pupil is stimulated by light, the infrared camera capturing the pupil image may reduce the pupil image quality due to the effect of the visible light. The device structure is utilized to separate a light-feeding area of one pupil from a photographing area of an infrared camera of the other pupil, monocular light reflection measurement is carried out, the light source stimulates the pupil on the same side, and the infrared camera collects an indirect light reflection diameter change image of the pupil on the opposite side. The infrared light source is added to appropriately supplement light to the infrared camera image acquisition environment, and the contrast of pupil images shot by the infrared camera is increased, so that the pupil identification accuracy is improved.

The pupil images of different subjects are difficult to collect completely due to different areas of the pupils in the field of view of the infrared camera, meanwhile, the working distance of the pupils from the camera is difficult to keep consistent, and the accuracy of the pupil diameter is influenced due to different definition of the collected pupil images. In order to ensure that the tested pupil is complete in the field of view of the infrared camera and on the working distance of the infrared camera, the infrared camera is arranged on an electric sliding table device with adjustable upper, lower, front and rear positions, and the upper and lower positions of the infrared camera are adjusted by controlling the electric sliding table device, so that the tested pupil is in the shooting field of view of the infrared camera, and the front and rear positions of the infrared camera are adjusted, so that the pupil image is clear at the working distance of the infrared camera, and the accuracy of the subsequent pupil identification is improved.

In the measuring process, the self-development operation software performs parameters such as LED light source brightness adjustment control, LED light source lighting time setting, infrared camera position adjustment control, infrared camera image acquisition frame rate and the like, and realizes batch acquisition of pupil images.

And S3, identifying the pupil part of the subject according to the image of the pupil at the opposite side of the subject, and extracting pupil diameter data of the subject.

As an embodiment, identifying a pupil location of the subject from the subject's contralateral pupil image and extracting pupil diameter data of the subject includes: smoothing each subject's contralateral pupil image based on Gaussian blur to remove interference noise in the subject's contralateral pupil image; dividing an exit pupil region from the processed subject contralateral pupil image based on an automatic threshold segmentation method; pupil positions are extracted through a pupil region circumcircle extraction algorithm, and pupil diameter data are obtained.

It can be understood that the LED light sources are used for carrying out light source stimulation on pupils on one side of different subjects, and shooting images of pupils on the other side of the subjects, so as to obtain pupil images of a plurality of subjects.

And processing the acquired pupil images to acquire pupil diameter data in each pupil image. Specifically, the software image processing can perform operation processing such as real-time browsing, batch contrast adjustment, pupil identification conversion calculation, pupil diameter change curve generation, and storage of generated results on continuously acquired pupil images.

As an embodiment, the generating a data scatter diagram of pupil diameter variation with time based on pupil diameter data at different times, and performing curve fitting includes: correcting pupil diameter data of the closed eyes of the subjects based on pupil diameter data extracted from the side pupil images of each subject; based on the lighting stimulation time of the LED light source, the pupil diameter data extracted from the side pupil images of each subject are subjected to novel segmentation fitting, and a fitting curve graph of the pupil diameter change along with the time change is obtained.

And S4, generating a data scatter diagram changing with time and pupil diameter based on pupil diameter data at different times, and performing curve fitting.

The pupil image acquisition processing flow acquired by the infrared camera is shown in the following figure 2, pupil identification is performed on pupil images acquired by the infrared camera in batches, pupil diameter data of each image are obtained through algorithm processing, a scatter diagram is automatically drawn, curve fitting is performed, a curve chart of pupil diameter change is obtained, and a tester performs subsequent data analysis according to requirements.

Referring to fig. 3, a pupil diameter variation measurement system of light reflection of the present invention is provided, comprising a multi-channel LED light source, an infrared camera, and a processing module.

The LED light sources are used for giving lighting stimulation of different wavelength light sources to the pupils of the single side of the subject in a darkroom environment; an infrared camera for acquiring images of the contralateral pupil of the subject; the infrared light source is used for supplementing light to a shooting area of the infrared camera, wherein the light supply area of the pupil at one side of the subject and the shooting area of the pupil at the opposite side of the subject are isolated by the partition plate; the processing module is used for identifying the pupil part of the subject according to the image of the pupil on the opposite side of the subject and extracting pupil diameter data of the subject; and generating a data scatter diagram changing with time and pupil diameter based on pupil diameter data at different times, and performing curve fitting.

It will be appreciated that the basic frame diagram of the pupil diameter variation measuring system for light reflection can be seen in fig. 3, and mainly includes a plurality of LED light sources, an infrared light source, an infrared camera, a processing module, a light source controller power supply, a light source controller, an infrared light source power supply, a drive controller power supply and a drive controller.

The external commercial power is connected through the power connection wire, and working power is respectively provided for the light source controller, the infrared light source power supply and the driving controller power supply. The power output of the light source controller is connected with the light source controller through a power connection line, the computer port (the computer can be understood as a processing module) realizes communication control with the light source controller through a serial port communication control line, the output of the light source controller is connected with an LED light source (1-4 paths of LED light sources can be configured according to test requirements), and the power of the LED light source and the lighting stimulation time are controlled and set through computer software operation. The infrared light source power output is connected with an infrared light source through a power connection line to generate infrared light, the infrared light divergence direction can be adjusted through an infrared light source universal bracket, the image contrast of a camera is improved, and the pupil identification accuracy is improved. The output of the power module of the driving controller supplies power to the driving controller through a power connection wire, the driving controller is connected with the electric sliding table device through a motor wire and is connected with a computer through a serial port communication control wire to realize parameter setting and movement control of the electric sliding table device, and therefore the infrared camera is driven to carry out position adjustment. The infrared camera is connected with the computer through a special data line matched with the camera, and the computer upper computer software can control the image acquisition frame rate parameter and the continuous acquisition time of the infrared camera.

In the measuring process, the lighting stimulus of different wavelength light sources for a period of time is given to the pupil on one side of the subject, and pupil images of the light reflex of the pupil on the other side are shot. In the embodiment of the invention, the light sources with different wavelengths are provided by the multi-path LED light sources to perform light source stimulation on the pupil at one side of the subject, so that the brightness adjustment and the lighting stimulation time adjustment can be performed on each path of LED light source.

The light-feeding area of one pupil and the photographing area of the infrared camera of the other pupil are divided by the partition plate, so that the quality of pupil images is improved, the pupil on the same side is stimulated by the light source, and the infrared camera collects the indirect light reflection diameter change images of the pupil on the opposite side. The infrared light source is added to appropriately supplement light to the infrared camera image acquisition environment, and the contrast of pupil images shot by the infrared camera is increased, so that the pupil identification accuracy is improved.

In order to ensure that the tested pupil is complete in the field of view of the infrared camera and on the working distance of the infrared camera, the infrared camera is arranged on an electric sliding table device with adjustable upper, lower, front and rear positions, the upper and lower positions of the infrared camera are adjusted by controlling the electric sliding table device, so that the tested pupil is in the shooting field of view of the infrared camera, and the front and rear positions of the infrared camera are adjusted, so that the pupil image is ensured to be clear at the working distance position of the infrared camera, and the accuracy of the subsequent pupil identification is improved.

In the measuring process, the self-development operation software performs parameters such as LED light source brightness adjustment control, LED light source lighting time setting, infrared camera position adjustment control, infrared camera image acquisition frame rate and the like, and realizes batch acquisition of pupil images.

The pupil image collected by the infrared camera can only obtain pupil diameter pixel data according to the camera characteristics, and the infrared camera calibration processing is performed before the operation test to obtain a conversion coefficient converted from a length unit and the camera image pixels, so that the pupil diameter data is converted. The calibration process uses an infrared camera to collect pixel sizes of known standard length units, conversion factor = standard length mm/standard length pixel size pixels. The conversion coefficient is unchanged in the infrared camera lens focal length adjustment locking state, and calibration operation is required to be carried out again to determine the conversion coefficient if the lens focal length is adjusted, so that the data accuracy is ensured.

The software development process mainly comprises an image data acquisition part and an image data processing part, wherein the image data acquisition part comprises the steps of adjusting an infrared camera to enable a shot image to be clear, positioning pupils of a subject, setting the grouping number of the subject, giving light source stimulation to pupils on one side of the subject, and shooting the pupil image on the other side of the subject, as shown in the following figure 4.

The image data processing part comprises loading each pupil image, extracting pupil parts and pupil diameter data, generating a speckle data graph changing along with time and pupil diameter based on the pupil diameter data of each pupil image, and fitting the speckle data graph into a graph.

The software main functions are distributed as shown in fig. 5 below, and the measurement software mainly includes an image acquisition section and an image batch processing section, similar to fig. 4. The image acquisition part can acquire a single Zhang Tongkong image, acquire a plurality of pupil images, acquire pupil images in groups, control the position of the infrared camera, display the pupil positioning of a subject in real time and the like. After the pupil image is acquired, the pupil image is analyzed and processed, and a change curve chart of the pupil diameter along with time is drawn.

The following describes a software development environment of an embodiment of the present invention:

operating system: windows

IDE: vs2008, vs2017 (Camera control)

Development tool: qt4.8.6, qt5.12 (camera control)

The software operation collection main interface is shown in the following figure 6, the left side of the main interface comprises settings of various parameters, function control, file storage and the like, and the right side of the main interface is an infrared camera image display area.

The software operation functions are described as follows:

1. displaying in real time and positioning pupils.

Because the QT main thread is gui thread, the camera live is realized by adopting multithreading, namely, the operations of acquiring, converting and storing the image of a more complex slave camera are moved to the sub-threads, and each result image is transmitted into the main interface for refreshing and displaying, so that the gui main interface is prevented from being blocked and not refreshed.

Because the camera gets the graph through the callback function binding the handle, the main thread transfers the camera handle pointer to the sub-thread for sharing in order to avoid the sub-thread from separately re-creating the handle.

When the callback function of the camera is a static member function, the callback function cannot be directly communicated with the main thread, so that the callback function is changed into a non-member function, and the member function is executed in the function body; or by acquiring the this pointer, the member function is called inside the static member function to transfer the signal slot.

The obtained graph of the camera is 16-bit Mat, and is converted into 8-bit Mat, pupil identification is carried out, pupil circles are drawn, and then the pupil circles are transmitted to gui for multithreading to be displayed.

And operating the 'real-time preview' at the upper left side of the main interface, displaying the image in the current infrared camera view field on the right side of the main interface in real time, operating and controlling the electric sliding table device to enable the pupil of the subject to be displayed completely and clearly, and clicking the 'stop' operation to perform subsequent image acquisition operation.

2. A single pupil image is acquired.

Based on real-time display, when clicking the 'acquire single image', the save mark is set as true, and after the main thread receives the image slot function to save the single image according to the save mark, the save mark is reset as false.

3. A plurality of pupil images are acquired.

The save count is added to the main thread received image slot function of the relative acquisition order Zhang Zai, and the save mark is reset to false after the count is reached, wherein the bottom interfaces for acquiring the pictures are all calling the camera sdk and related functions, such as tl_camera_isure_software_trigger_trigger.

An image storage path is set, all pupil images tested by different subjects are stored by taking names as independent task file names, and subtask grading can be carried out on the same subject after multiple test tasks are carried out on the same subject.

And reading and inquiring parameters such as the exposure time, the frame rate and the like of the infrared camera, and setting parameters according to test requirements.

4. And setting parameters of the light source.

The time and the light source power of each set of each stage are respectively recorded to the container, and the camera and the light source are operated according to the time axes respectively set through the combination of the traversing of the container and the timer.

And all Mats are stored in a class member variable container, namely a memory, and then stored as files one by one after the collection is finished, so that the mutual interference of collection and storage is avoided.

The interface of the light source control parameter setting is shown in fig. 7, the port number of the communication connection between the light source controller and the computer is selected, and the light source controller is connected and communicated with the computer by clicking on ". Setting the brightness value of the LED light source, clicking the LED light source which is turned on for 1s, and then turning off. The operation of turning on the lamp can be used for confirming whether the LED light source is normally controllable or not in the first use, and the effectiveness of the subsequent operation is ensured.

A set of acquisition time parameters is set as follows: the acquisition time of the environment image of the dark initial darkroom; the "bright" LED light source lighting time; the time for acquiring images in the darkroom environment after the dark LED light source is extinguished; the second period of interval time is the buffer time after the image acquisition of the darkroom environment is completed, and the infrared camera does not acquire the image in the period of time; the dark adaptation time is the buffering adaptation time before the image acquisition is started for the first time, and the infrared camera does not acquire the image in the time period. The time parameters are all in seconds, and clicking the 'increase' leads the setting parameters into the acquisition flow. Clicking the lower left part of the main interface to start testing, continuously acquiring pupil images by the infrared camera according to the time set by the process, running the LED light source according to the set brightness, the lighting time and the lighting time, and finishing the acquisition process after the interval time is finished.

If the acquisition operation is performed by multiple groups, setting multiple groups of acquisition parameters according to requirements, and sequentially increasing the multiple groups of processes. And after the last group of interval time is finished, the next group of acquisition is carried out, and the acquisition process is finished sequentially until the last group of process interval time is finished.

5. The camera position is controlled.

And (3) adopting an independent exe, and sending a command to control the reciprocating motion of the stepping motor in a serial port debugging assistant mode. Clicking the 'camera position' at the lower left corner of the main interface in fig. 6 pops up the interface shown in fig. 8 below to control the movement of the electric sliding table device so as to realize the position adjustment of pupils in the image.

The method comprises the steps of selecting a corresponding port to carry out communication connection of an electric sliding table device, and controlling an infrared camera to be far away from and close to a tested pupil in an interface respectively by 'far away' and 'near away' so that the tested pupil is at the clearest distinguishable position in a visual field of the infrared camera. The upward movement and the downward movement are respectively adjusted and controlled to move up and down along with the electric sliding table device, so that the pupil to be tested is complete in the field of view of the camera and has a proper position, and the later pupil identification processing is facilitated.

Clicking the "batch processing" at the lower left side of the main interface to perform operations such as pupil identification, data processing and the like on the collected pupil images in the batch processing interface, as shown in fig. 9 below, and introducing a batch processing function:

1. and (3) loading data: selecting an image storage path, clicking "loading" loads the image which needs pupil identification processing into processing software.

A) Loading an image: the loading speed is improved by adopting 10 sub-threads, all pictures transmitted to the main thread are still ordered according to a strict sequence, a method of grouping according to the last digit is adopted, and all Mat are stored in a class member variable container, namely a memory, so that subsequent continuous image viewing and traversing processing are facilitated.

B) Loading txt: the pupil diameter data is directly loaded from txt to meet the requirement of partial use scenes, and the storage space is reduced.

2. Browsing data:

A. continuous multi-view browsing:

and the current sequence number Mat is transmitted to the QGraphics View by adopting the spinbox-slider linkage, so that the display is refreshed in time, and multiple pictures can be conveniently and continuously seen. As shown in fig. 10 below, the progress block is dragged or the image sequence number is adjusted up and down to continuously view the pupil identification image.

B. Contrast ratio

Basic histogram equalization is employed.

3. Pupil recognition algorithm:

3.1, technical principle: based on the traditional image algorithm, pupil positioning identification is carried out on the eyeballs of the patient in darkroom environment and continuous illumination time, quantitative and qualitative analysis is carried out on the diameter change of the pupil contraction and expansion process under illumination, and qualitative analysis is carried out on the pupil contraction rule of the patient by calculating the quantitative values of a plurality of pupil indexes, so that the symptom difference of different patients is judged.

3.2, pupil identification technology implementation process mainly includes three parts of pupil identification, pupil curve fitting and pupil index calculation, and a technology implementation flow frame is shown in the following figure 11.

3.3, pupil identification:

the pupil recognition technology mainly utilizes an automatic threshold segmentation method to realize the recognition process. As shown in fig. 12, the basic steps are as follows:

1) Firstly, smoothing an eyeball image by utilizing Gaussian blur to achieve the effect of removing interference noise in the image;

2) And secondly, dividing the pupil area by adopting an automatic threshold dividing method, wherein the dividing threshold is automatically searched based on an image gray histogram method. Because the eyeball image mainly comprises three parts of eye white, eyelashes and pupils, and the gray level distribution of the three parts has certain difference, the gray level of the image can be automatically classified by using a gray level histogram, and the pupils can be accurately positioned;

3) And then, extracting the pupil through a pupil circumscribed circle extraction algorithm, and simultaneously obtaining the diameter of the pupil.

3.4 Curve fitting

And (3) performing curve fitting based on the pupil diameters calculated in the pupil identification process in step 3.3. Firstly, because the eye of a person may be closed during the optical stimulus process, the closed eye may cause fitting errors for subsequent pupil fitting operations, and therefore, the closed eye detection needs to be performed on pupil data before curve fitting, and correction processing needs to be performed on the detected closed eye data. Secondly, due to the fact that the pupil change degree after implication and illumination is different, the phenomenon that a darkroom pupil fitting curve has jitter and pupil constriction inflection point has deviation after the pupil diameter is linearly fitted can occur. In order to solve the interference problems, the pupil diameters in the pupil contraction and dilation process can be fit closely by adopting a piecewise fitting technology, so that the calculation of the subsequent pupil indexes is more accurate. The effect of the pupil diameter segmentation fit is shown in fig. 13 below.

3.5, pupil index quantification:

in order to accurately analyze the pupil constriction law of a patient, 16 pupil indexes are quantified based on a pupil fitting curve, and the quantified values of the indexes are observed to analyze the basic characteristics of the patient. The basic definition and calculation formula of pupil index are shown in Table 1:

table 1 pupil index definition and calculation description

A partial pupil index definition is shown in fig. 14 in conjunction with the pupil image acquisition flow.

4. And (3) data processing:

A. calculating a result concurrent diagram: the multi-threading is adopted to improve the storage speed and avoid interface blocking, as shown in fig. 15.

B. Drawing a broken line: the two drawing modes are adopted to realize the interface drawing based on the Qt rewriting paintEvent function and the Mat drawing based on opencv, as shown in figure 16.

C. Generating statistical parameters:

and (3) re-calculating based on the preliminary result, generating and storing pupil index result parameters obtained in one measurement flow in a document.

According to the pupil diameter change measuring method and system for light reflection, provided by the embodiment of the invention, different wavelength light sources are given to a single-side pupil in a darkroom environment to light and stimulate, an image of the pupil diameter change of opposite-side pupil indirect light reflection is measured, an infrared camera is used for continuously acquiring and obtaining an image of the opposite-side pupil in a certain period of time before and after the same-side pupil is lighted and stimulated for a certain period of time under a darkroom condition with good stability, and pupil diameter continuous change data is obtained by performing pupil identification through an image data processing means, so that the method has the following beneficial effects:

(1) The method comprises the steps of performing light source lighting stimulation on one pupil of a subject, shooting an image of the pupil on the other side, and avoiding the influence on shooting the pupil image on the same side caused by lighting the light source;

(2) The pupil light-giving area and the infrared camera photographing area of the subject are divided by the partition board, the infrared light source is added to appropriately supplement light for the infrared camera image acquisition environment, and the contrast of pupil images shot by the infrared camera is increased, so that the pupil identification accuracy is improved;

(3) And analyzing and processing the photographed pupil images, generating a data scatter diagram changing with the pupil diameter along with time change, performing curve fitting for subsequent index researches such as pupil dilation and shrinkage, change speed and the like, performing pupil measurement on different subjects, and providing reference for related clinical disease researches by the acquired data.

In the foregoing embodiments, the descriptions of the embodiments are focused on, and for those portions of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.

It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (10)

1. A method for measuring a change in pupil diameter due to light reflection, comprising:

lighting stimulus of different wavelength light sources is given to a single pupil of a subject in a darkroom environment;

collecting an image of the pupil on the opposite side of the subject by using an infrared camera, wherein the shooting area of the infrared camera is supplemented with light based on an infrared light source, and the light feeding area of the pupil on the single side of the subject and the shooting area of the pupil on the opposite side of the subject are separated;

identifying the pupil area of the subject according to the image of the pupil on the opposite side of the subject, and extracting pupil diameter data of the subject;

based on pupil diameter data at different times, a data scatter plot of pupil diameter changes over time is generated and curve fitting is performed.

2. The method of measuring pupil diameter variation according to claim 1, wherein the step of applying the illumination stimulus of the light source having different wavelengths to the pupil of the single side of the subject comprises:

giving lighting stimulus to a single-side pupil of a subject based on a plurality of LED light sources, wherein the plurality of LED light sources provide light sources with different wavelengths;

and adjusting the brightness and the lighting stimulation time of each LED light source.

3. The pupil diameter variation determination method of claim 1 or 2, wherein the capturing of the subject's contralateral pupil image with the infrared camera comprises:

and (3) carrying out light filling on the shooting area based on the infrared light source, adjusting the position of the infrared light source and the image acquisition frame rate of the infrared camera, and adjusting the position of the infrared camera, so that the pupil of the subject is in the shooting view field of the infrared camera and the pupil of the subject is in the working distance position of the infrared camera.

4. The method of claim 1, wherein identifying a pupil region of the subject from the subject's contralateral pupil image and extracting pupil diameter data of the subject comprises:

smoothing each subject's contralateral pupil image based on Gaussian blur to remove interference noise in the subject's contralateral pupil image;

dividing an exit pupil region from the processed subject contralateral pupil image based on an automatic threshold segmentation method;

pupil positions are extracted through a pupil region circumcircle extraction algorithm, and pupil diameter data are obtained.

5. The pupil diameter variation measuring method as claimed in claim 4, wherein generating a data scatter plot of pupil diameter variation over time based on pupil diameter data at different times, and performing curve fitting, comprises:

correcting pupil diameter data of the closed eyes of the subjects based on pupil diameter data extracted from the side pupil images of each subject;

based on the lighting stimulation time of the LED light source, piecewise linear fitting is carried out on pupil diameter data extracted from the side pupil images of each subject, so that a fitting curve graph of the pupil diameter change along with the time change is obtained.

6. The pupil diameter change measuring system for light reflection is characterized by comprising a plurality of LED light sources, an infrared light source, an infrared camera and a processing module;

the LED light sources are used for giving lighting stimulus of different wavelength light sources to the pupils of the single side of the subject in a darkroom environment;

an infrared camera for acquiring images of the contralateral pupil of the subject;

the infrared light source is used for supplementing light to a shooting area of the infrared camera, wherein the light supply area of the pupil at one side of the subject and the shooting area of the pupil at the opposite side of the subject are isolated by the partition plate;

the processing module is used for identifying the pupil part of the subject according to the image of the pupil on the opposite side of the subject and extracting pupil diameter data of the subject; and generating a data scatter diagram changing with time and pupil diameter based on pupil diameter data at different times, and performing curve fitting.

7. The pupil diameter variation measurement system of claim 6, further comprising a light source controller power source, a light source controller, an infrared light source power source, a drive controller power source, and a drive controller;

the processing module is connected with the light source controller through a serial port communication control line to realize communication control, and the output of the light source controller is connected with each LED light source;

the light source controller controls and sets the power and the lighting stimulation time of each path of LED light source according to the instruction of the processing module, and the power output of the infrared light source is connected with the infrared light source through a power supply connecting wire to generate infrared light so as to supplement light to the shooting area of the pupil of the opposite side of the subject;

the power output of the driving controller supplies power to the driving controller through a power connection line, the driving controller is connected with the electric sliding table device through a motor line, and the infrared camera is driven to carry out position adjustment through movement of the electric sliding table device.

8. The pupil diameter variation measurement system according to claim 7, wherein the driving controller is connected to the processor through a serial communication control line, and is configured to perform parameter setting and movement control on the electric sliding table device, and drive the infrared camera to perform position adjustment, so that a pupil of the subject is in a shooting field of view of the infrared camera, and a pupil of the subject is in a working distance position of the infrared camera.

9. The pupil diameter variation measuring system according to claim 6, wherein the infrared camera has a specification model CS135MUN, a frame rate of 165.5fps at maximum, a resolution of 1280 x 1024, a lens of the infrared camera is a VM3520MP5 lens with an adjustable aperture focal length of 35mm, and the infrared light source is a laser lattice infrared light source with a power of < 12W and an exit angle of 90 °.

10. The pupil diameter variation testing system of claim 6, wherein the processing module for identifying a pupil location of the subject from the subject's contralateral pupil image and extracting pupil diameter data of the subject comprises:

smoothing each subject's contralateral pupil image based on Gaussian blur to remove interference noise in the subject's contralateral pupil image;

dividing an exit pupil region from the processed subject contralateral pupil image based on an automatic threshold segmentation method;

extracting pupil positions through a pupil region circumcircle extraction algorithm to obtain pupil diameter data;

correspondingly, generating a data scatter diagram changing with time and pupil diameter based on pupil diameter data of different times, and performing curve fitting, wherein the method comprises the following steps:

correcting pupil diameter data of the closed eyes of the subjects based on pupil diameter data extracted from the side pupil images of each subject;

based on the lighting stimulation time of the LED light source, the pupil diameter data extracted from the side pupil images of each subject are subjected to novel segmentation fitting, and a fitting curve graph of the pupil diameter change along with the time change is obtained.