CN114343566B - Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system - Google Patents

Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system Download PDF

Info

Publication number
CN114343566B
CN114343566B CN202111451885.3A CN202111451885A CN114343566B CN 114343566 B CN114343566 B CN 114343566B CN 202111451885 A CN202111451885 A CN 202111451885A CN 114343566 B CN114343566 B CN 114343566B
Authority
CN
China
Prior art keywords
fundus
image
state
nth
current
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111451885.3A
Other languages
Chinese (zh)
Other versions
CN114343566A (en
Inventor
杨志
汪霄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tupai Beijing Medical Technology Co ltd
Original Assignee
Tupai Beijing Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tupai Beijing Medical Technology Co ltd filed Critical Tupai Beijing Medical Technology Co ltd
Priority to CN202111451885.3A priority Critical patent/CN114343566B/en
Publication of CN114343566A publication Critical patent/CN114343566A/en
Priority to PCT/CN2022/120754 priority patent/WO2023098249A1/en
Application granted granted Critical
Publication of CN114343566B publication Critical patent/CN114343566B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016—Operational features thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016—Operational features thereof
    • A61B3/0025—Operational features thereof characterised by electronic signal processing, e.g. eye models
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/102—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for optical coherence tomography [OCT]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography

Abstract

The application relates to a method, a PC terminal, a storage medium and a system for assisting OCT scanning, which belong to the technical field of OCT scanning and comprise the steps of acquiring an nth fundus image and a reference image corresponding to the nth fundus image; wherein, L parts of fundus images form a complete frame of fundus image; judging whether the current fundus state is offset; if not, executing a receiving step, wherein the receiving step is to receive a new fundus image, and n = n +1 until the current fundus state is in an offset state; if yes, determining a reference image of the nth fundus image from the n fundus images based on the nth fundus image and the reference image corresponding to the nth fundus image; obtaining a shift coefficient of the nth fundus image based on the nth fundus image, a reference image of the nth fundus image, and a reference image of the reference image. The method has the effect of assisting the OCT equipment to adjust the scanning position.

Description

Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system
Technical Field
The present application relates to the field of OCT scanning technologies, and in particular, to a method, a PC terminal, a storage medium, and a system for assisting OCT in scanning.
Background
OCT (Optical Coherence Tomography, or Optical Coherence Tomography) is a high-sensitivity, high-resolution, high-speed, non-invasive imaging method, and has been widely used in diagnosis of fundus diseases, and has great significance in detection and treatment of ophthalmic diseases.
For clinical ophthalmology posterior segment OCT system, its main function is to observe the faulted lesion feature of the posterior segment of the eye. With the increasing OCT scanning speed, the OCT scanning method is also being upgraded, and the scanning method changes from the earlier single-line scanning, radial line scanning, raster scanning, and other interval scanning methods to the 3D scanning, 3DOCTA scanning, and other full-area scanning methods.
However, in the full-area scanning method, since the actual scanning area is shifted due to the influence of the eye movement of the examinee in the slow scanning direction, which results in imaging failure, it is an essential process in the OCT scanning to adjust the scanning position by detecting the eye movement with the SLO.
Compared with the published fundus tracking technology, vienola K V, braaf B, sheehy C K, et al, real-time eye movement compensation for OCT imaging with tracking SLO [ J ]. Biomedical optics expressure, 2012,3 (11): 2950-2963, have a good corrective effect on eliminating the effects of eye movement, but have the following problems: 1. the scanning speed to the eyeground is high; 2. the requirement on algorithm identification equipment is high; 3. there is a risk of misjudgment for the longitudinal large displacement motion detection.
Disclosure of Invention
In order to assist the OCT equipment in adjusting the scanning position, the application provides a method, a PC terminal, a storage medium and a system for assisting OCT in scanning.
In a first aspect, the present application provides a method for assisting OCT to perform scanning, which adopts the following technical solutions:
a method of assisting OCT in scanning, comprising:
acquiring an nth part of fundus image and a reference image corresponding to the nth part of fundus image; wherein, L parts of fundus images form a complete frame of fundus image;
judging whether the current fundus state is offset;
if not, executing a receiving step, wherein the receiving step is to receive a new fundus image, and n = n +1 till the current fundus state is in an offset state;
if yes, determining a reference image of the nth fundus image from the n fundus images based on the nth fundus image and the reference image corresponding to the nth fundus image;
and obtaining the shift coefficient of the nth fundus image based on the nth fundus image, the reference image of the nth fundus image and the reference image of the reference image.
By adopting the technical scheme, based on the fundus tracking technology, the OCT is assisted by low-speed SLO imaging for acquisition and positioning, the PC terminal receives fundus images sent by the SLO equipment, determines the current fundus state, obtains a shift coefficient through the nth fundus image, the reference image of the nth fundus image and the reference image of the reference image under the condition that the current fundus state is shifted, and sends the obtained shift coefficient to the OCT equipment so that the OCT equipment can adjust the scanning position according to the shift coefficient; the method has low requirements on the fundus collection speed and the algorithm identification equipment, the accuracy of the obtained offset coefficient is high, and the OCT equipment can be effectively assisted to scan.
Preferably, the acquiring the nth fundus image and the reference image corresponding thereto includes:
taking the fundus image which is obtained before, is identical to the id and is closest to the obtaining time as a reference image of the nth fundus image; where id represents the corresponding position of the fundus image in the entire frame fundus image.
Preferably, the judging whether the current fundus state is a shift includes:
judging whether n is not more than 1;
if yes, judging that the current fundus state is static;
if not, judging whether n is larger than 1 and not larger than L;
if yes, judging that the current fundus collection state is normal;
if not, judging whether the current fundus collection state is normal or not based on the nth fundus image and the reference image corresponding to the nth fundus image;
if yes, judging whether the fundus collection states corresponding to the (n-1) th to (n-M + 1) th fundus images are normal or not; wherein M > L;
if so, acquiring a prior fundus state, and judging whether the prior fundus state is moving; wherein the prior fundus state is the fundus state corresponding to the (n-1) th fundus image;
if yes, the current fundus state is determined to be offset.
Preferably, the determining whether the current fundus collection state is normal based on the nth fundus image and the reference image corresponding thereto includes:
determining a current blink state based on the nth fundus image;
determining a current eye movement state based on the nth fundus image and the reference image of the nth fundus image;
judging whether the current blinking state is non-blinking and the current eye movement state is non-eye movement;
if so, judging that the current fundus collection state is normal;
if not, judging that the current fundus collection state is abnormal.
Preferably, the judging whether the fundus collection states corresponding to the (n-1) th to (n-M + 1) th fundus images are all normal includes:
if not, acquiring a previous fundus state, judging whether the current fundus state is static or moving based on the previous fundus state, and returning to the receiving step.
Preferably, the determining whether the current fundus state is stationary or moving based on the previous fundus state includes:
judging whether the prior fundus state is moving;
if yes, judging that the current fundus state is motion;
if not, the current fundus state is judged to be static.
Preferably, the reference image for determining the nth fundus image among the n fundus images is acquired by:
the fundus image which was previously acquired, which is identical to id, whose fundus state is still and whose acquisition time is closest is taken as a reference image of the nth fundus image.
In a second aspect, the present application provides a PC terminal, which adopts the following technical solution:
a PC terminal comprising a memory and a processor, the memory having stored thereon a computer program that can be loaded by the processor and execute the method of assisting OCT scanning according to any of the first aspects.
By adopting the technical scheme, based on the fundus tracking technology, the acquisition and positioning are carried out by using the low-speed SLO imaging to assist the OCT, the PC terminal receives fundus images sent by the SLO equipment, determines the current fundus state, obtains a deviation coefficient through the nth fundus image, the reference image of the nth fundus image and the reference image of the reference image under the condition that the current fundus state is deviated, and sends the obtained deviation coefficient to the OCT equipment so that the OCT equipment can adjust the scanning position according to the deviation coefficient; the method has low requirements on the fundus collection speed and the algorithm identification equipment, the accuracy of the obtained offset coefficient is high, and the OCT equipment can be effectively assisted to scan.
In a third aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions:
a computer readable storage medium storing a computer program that can be loaded by a processor and executing the method of assisted OCT scanning of any of the first aspects.
By adopting the technical scheme, based on the fundus tracking technology, the OCT is assisted by low-speed SLO imaging for acquisition and positioning, the PC terminal receives fundus images sent by the SLO equipment, determines the current fundus state, obtains a shift coefficient through the nth fundus image, the reference image of the nth fundus image and the reference image of the reference image under the condition that the current fundus state is shifted, and sends the obtained shift coefficient to the OCT equipment so that the OCT equipment can adjust the scanning position according to the shift coefficient; the method has low requirements on the fundus collection speed and the algorithm identification equipment, the accuracy of the obtained offset coefficient is high, and the OCT equipment can be effectively assisted to scan.
In a fourth aspect, the present application provides a system for assisting OCT to perform scanning, which adopts the following technical solutions:
a system for assisting OCT to scan comprises a PC terminal, an OCT device and an SLO device;
after acquiring a trigger command, the PC terminal sends an eye fundus image acquisition command and an acquisition mode to the SLO equipment according to a preset acquisition mode;
after receiving the acquisition command and the acquisition mode, the SLO equipment divides the whole acquisition area according to the acquisition mode to obtain a plurality of actual acquisition areas; acquiring fundus images according to the actual acquisition area, and sequentially sending the acquired fundus images to the PC terminal; the number of the actual acquisition regions is L;
the PC terminal acquires a shift coefficient after receiving the fundus image, and uploads the shift coefficient to the OCT apparatus.
By adopting the technical scheme, based on the fundus tracking technology, the acquisition and positioning are carried out by using the low-speed SLO imaging to assist the OCT, the PC terminal receives fundus images sent by the SLO equipment, determines the current fundus state, obtains a deviation coefficient through the nth fundus image, the reference image of the nth fundus image and the reference image of the reference image under the condition that the current fundus state is deviated, and sends the obtained deviation coefficient to the OCT equipment so that the OCT equipment can adjust the scanning position according to the deviation coefficient; the method has low requirements on the fundus collection speed and the algorithm identification equipment, the accuracy of the obtained offset coefficient is high, and the OCT equipment can be effectively assisted to scan.
Drawings
Fig. 1 is a schematic flowchart of a method for scanning with OCT assistance according to an embodiment of the present disclosure.
Fig. 2 is a schematic diagram of an entire-frame fundus image provided in an embodiment of the present application.
Fig. 3 is another schematic flow chart of a method for scanning with OCT assistance provided in an embodiment of the present application.
Fig. 4 is a schematic structural diagram of a PC terminal according to an embodiment of the present application.
Fig. 5 is a block diagram of a system for scanning with OCT assistance according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The present embodiment provides a method for scanning with assisted OCT, which is applied to a system for scanning with assisted OCT, and as shown in fig. 1, the main flow of the method is described as follows (steps S101 to S105):
step S101: acquiring an nth fundus image and a reference image corresponding to the nth fundus image; wherein, L parts of fundus images form a complete frame of fundus image.
In the embodiment, a trigger command is obtained; wherein the trigger command can be obtained by pressing a button by a worker.
After the trigger command is acquired, sending a data acquisition command and acquisition position data to the OCT equipment according to a preset acquisition mode, and scanning by the OCT equipment according to the data acquisition command and the acquisition position data; simultaneously, the fundus image acquisition command and the acquisition mode are transmitted to the SLO apparatus.
After receiving an acquisition command and an acquisition mode, the SLO equipment divides the whole acquisition area according to the acquisition mode to obtain a plurality of actual acquisition areas; collecting a plurality of fundus images according to the actual collecting area, and sequentially sending the collected fundus images to a PC terminal; wherein the number of the actual acquisition regions is L.
Sequentially receiving n fundus images transmitted by the SLO equipment, and taking a fundus image which is acquired previously, is identical to the id image and is closest to the acquisition time as a reference image of the nth fundus image; where id denotes the corresponding position of the fundus image in the entire frame fundus image. Referring to fig. 2, fig. 2 shows 3 whole-frame fundus images acquired successively, each L fundus images form a complete one-frame fundus image, id in the image indicates the corresponding position of the fundus image in the whole-frame fundus image, the reference image of the fundus image is the same as the id of the fundus image, and it can be seen that the tracking time of the nth fundus image and the tracking time of the (n-1) th fundus image correspond to different positions of the whole-frame fundus image. Assuming that the fundus image whose id is equal to L in fig. 2 (3) is the nth fundus image, the fundus image whose id is equal to L in fig. 2 (2) is a reference image of the nth fundus image.
Step S102: judging whether the current fundus state is offset; if yes, go to step S103; if not, go to step S105.
Specifically, referring to the specific steps (steps S1 to S10) in fig. 3:
step S1: judging whether n is not more than 1; if yes, executing step S2; if not, step S3 is executed.
Step S2: it is determined that the current fundus state is still, and step S105 is executed.
And step S3: judging whether n is greater than 1 and not greater than L; if yes, executing step S4; if not, step S5 is executed.
And step S4: it is determined that the current fundus oculi collection state is normal, step S8 is executed.
Step S5: judging whether the current fundus collection state is normal or not based on the nth fundus image and the reference image corresponding to the nth fundus image; if not, executing the step S6; if yes, go to step S7.
In step S5, a current blink state is determined based on the nth fundus image; the current eye movement state is determined based on the nth fundus image and the reference image of the nth fundus image.
The specific method for determining the current blink state is as follows:
extracting gradient parameters of the nth fundus image, wherein the specific formula is as follows:
gxn＝In(x，y)-In(x-1，y)；
gyn＝In(x，y)-In(x，y-1)；
wherein, In(x, y) denotes the nth fundus image, gxnRepresents the gradient parameter, gy, of the nth fundus image on the abscissanGradient parameters of the nth fundus image on the ordinate are shown.
Obtaining the blink parameter through the gradient parameter, wherein the specific formula is as follows:
Figure BDA0003385471130000051
wherein flag0 represents the blink parameter.
Judging whether the blink parameter is larger than a blink threshold value or not; if so, judging that the current blinking state is blinking; if not, the current blink state is judged to be non-blink.
The specific method for determining the current eye movement state is as follows:
acquiring an initial offset coefficient of the nth fundus image, wherein the initial offset coefficient is an offset coefficient between the nth fundus image and a reference image of the nth fundus image, and a specific formula is as follows:
Figure BDA0003385471130000052
wherein dx (n) represents a first parameter, dy (n) represents a second parameter, [ dx (n), dy (n)]Denotes an initial shift coefficient, g (I), of the nth fundus imagen，Rn) Expressing a shift coefficient between the nth fundus image and a reference image of the nth fundus image, RnAnd Rn(x, y) each represent a reference image of the nth fundus image.
To In(x + dx (n), y + dy (n)) first order Taylor expansion gives:
In(x+dx(n)，y+dy(n))≈In(x，y)+dx(n)*gxn+dy(n)*gyn；
it is thus possible to obtain:
[dx(n)，dy(n)]≈pinv([gxn，gyn])*(R(x，y)-In(x，y))；
here, pinv (·) represents a matrix generalized inverse operation. In order to improve the algorithm real-time performance, the image can be down-sampled.
Judging whether the first parameter is larger than an eye movement threshold value or not, and judging whether the second parameter is larger than the eye movement threshold value or not; if yes, judging that the current eye movement state is eye movement; if not, the current eye movement state is judged to be non-eye movement.
Judging whether the current blinking state is non-blinking and the current eye movement state is non-eye movement; if yes, judging that the current fundus collection state is normal; if not, the current fundus collection state is judged to be abnormal.
Step S6: it is determined that the current fundus state is motion, step S105 is executed.
Step S7: judging whether the fundus collection states corresponding to the (n-1) th to (n-M + 1) th fundus images are all normal; if not, executing the step S8; if yes, executing step S9; wherein M > L.
Step S8: acquiring a previous fundus state, and judging whether the previous fundus state is moving; if yes, returning to the step S6; if not, the procedure returns to step S2.
The former fundus state is a state corresponding to the (n-1) th fundus image, and means a state of the fundus when the (n-1) th fundus image is imaged.
At this time, it has been known that the current fundus collection state is normal. Judging whether the previous fundus state is motion; if yes, judging that the current fundus state is motion; if not, the current fundus state is determined to be static.
After determining whether the current fundus state is still or moving, step S105 is executed.
Step S9: acquiring a previous fundus state, and judging whether the previous fundus state is moving; if not, returning to the step S2; if yes, go to step S10.
Step S10: the current fundus state is determined to be offset.
Step S103: a base image of the nth fundus image is determined among the n fundus images based on the nth fundus image and a reference image corresponding thereto.
In the present embodiment, a fundus image which was previously acquired, which is identical in id, is still in fundus state and is closest in acquisition time is taken as a reference image of the nth fundus image. Assuming that the fundus image with id equal to L in fig. 2 (3) is the nth fundus image, the fundus state corresponding to the fundus image with id equal to L in fig. 2 (2) is not still, and the fundus state corresponding to the fundus image with id equal to L in fig. 2 (1) is still, the fundus image with id equal to L in fig. 2 (1) is the reference image of the nth fundus image.
Step S104: the shift coefficient of the nth fundus image is obtained based on the nth fundus image, the base image of the nth fundus image, and the reference image of the base image, and step S105 is performed.
In this embodiment, the shift coefficient between the nth fundus image and the reference image thereof is acquired as [ dx1 (n), dy1 (n)]，[dx1(n)，dy1(n)]＝g(In，Bn)，g(In，Bn) The calculation principle of (2) and g (I) in the aboven，Rn) The calculation principle is consistent, and the details are not repeated herein. It is composed ofIn (I)nShows the nth fundus image, BnA reference image representing the nth fundus image.
An initial shift coefficient of the base image of the nth fundus image is acquired, the initial shift coefficient being a shift coefficient between the base image of the nth fundus image and the reference image of the base image of the nth fundus image. The initial offset coefficient is [ dxB，dyB]，[dxB，dyB]The calculation principle of (2) and g (I) in the aboven，Rn) The calculation principle is consistent, and the details are not repeated herein. Note that the reference image of the nth fundus image is acquired before the nth fundus image, and therefore, the initial shift coefficient of the reference image of the nth fundus image has already been acquired when the eye movement state of the reference image of the nth fundus image is determined.
Next, the shift coefficient of the nth fundus image is acquired, and the specific calculation formula thereof is as follows:
[dxn，dyn]＝[dxB，dyB]+[dx1(n)，dy1(n)]；
wherein [ dxn，dyn]The shift coefficient of the nth fundus image is expressed.
In summary, the current fundus state can be judged by the following formula:
Figure BDA0003385471130000071
wherein H (n) represents a current fundus acquisition state; f (n) represents the current fundus state; h (n) & H (n-1) &. ·. & H (n-M + 1) & (n ≧ L) =1 means H (n) =1,H (n-1) =1,H (n-2) =1,H (n-3) =1,H (n-4) =1, and n ≧ L; h (n) & H (n-1) &. &.. Once & H (n-M + 1) & (n ≧ L) =0 indicates that, among the consecutive L fundus images, the current fundus acquisition state corresponding to at least one fundus image is stationary.
Note that when n is not more than 1, the reference image of the nth fundus image is the nth fundus image itself.
Step S105: a new fundus image is received, n = n +1, and the process returns to step S101.
In order to better execute the program of the method, the embodiment of the present application further provides a PC terminal, as shown in fig. 4, the PC terminal 200 includes a memory 201 and a processor 202.
The PC terminal 200 may be implemented in various forms including devices such as a mobile phone, a tablet computer, a palmtop computer, a notebook computer, and a desktop computer.
The memory 201 may be used to store, among other things, instructions, programs, code sets, or instruction sets. The memory 201 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as receiving a new fundus image and acquiring a reference image of an nth fundus image, etc.), instructions for implementing the method for assisting OCT to scan provided by the above-described embodiments, and the like; the data storage area can store data and the like involved in the scanning method for assisting the OCT provided by the embodiment.
Processor 202 may include one or more processing cores. The processor 202 invokes data stored in the memory 201 by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 201 to perform the various functions of the present application and to process the data. The Processor 202 may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic devices for implementing the functions of the processor 202 may be other devices, and the embodiments of the present application are not limited in particular.
An embodiment of the present application provides a computer-readable storage medium, including: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk. The computer readable storage medium stores a computer program that can be loaded by a processor and executes the method for scanning with OCT assistance of the above-described embodiments.
The specific embodiments are merely illustrative and not restrictive, and various modifications that do not materially contribute to the embodiments may be made by those skilled in the art after reading this specification as required, but are protected by patent laws within the scope of the claims of this application.
In order to better implement the method, the embodiment of the application also provides a system for assisting the OCT to scan.
Fig. 5 is a block diagram of a system for assisting OCT to perform scanning according to an embodiment of the present disclosure, and as shown in fig. 5, the apparatus mainly includes a PC terminal 301, an OCT device 302, and an SLO device 303.
The PC terminal 301 acquires a trigger command; wherein the trigger command can be obtained by pressing a button by a worker.
The PC terminal 301, after acquiring the trigger command, transmits a data acquisition command and acquisition position data to the OCT apparatus 302 according to a preset acquisition mode, and transmits a fundus image acquisition command and acquisition mode to the SLO apparatus 303.
The preset acquisition mode can be a line acquisition mode or a block acquisition mode.
After receiving the acquisition command and the acquisition mode, the SLO device 303 divides the entire acquisition area according to the acquisition mode to obtain a plurality of actual acquisition areas; collecting a plurality of fundus images according to the actual collecting area, and sequentially sending the collected fundus images to the PC terminal 301; the number of the actual acquisition regions is L, and L acquired fundus images form a complete frame of fundus image.
Referring to fig. 2, shown in fig. 2 is a fundus image in the line acquisition mode, where id in the image indicates the corresponding position of the fundus image in the entire frame fundus image, and the reference image of the fundus image is the same as id of the fundus image. Different acquisition modes can be adopted, for example, a reciprocating acquisition mode is adopted, namely the id is acquired in the sequence of 1,2, … …, L, L-1, … …,1,1 and … … from top to bottom, then from bottom to top, then from top to bottom and then from bottom to top; the acquisition mode of acquiring according to the sequence from top to bottom is adopted, and the obtained id sequence is 1,2, … …, L,1,2, … …, L,1, … ….
The time taken for the SLO apparatus 303 to directly acquire the entire frame fundus image is long, and this time is defined as t. In order to increase the detection rate, the SLO apparatus 303 transmits the fundus image to the PC terminal 301 every time it acquires 1/L frame of fundus image, and the PC terminal 301 performs tracking detection on the 1/L frame of fundus image in turn, and the tracking rate is increased from the original 1/t to L/t.
The principle of the line acquisition mode is to split the whole frame of fundus image in the transverse direction or the longitudinal direction, the principle of the block acquisition mode is to split the whole frame of fundus image in the transverse direction and the longitudinal direction, and the acquisition mode of the block acquisition mode is consistent with the principle of the acquisition mode in the line acquisition mode, which is not described herein again.
Assuming that a line acquisition mode is employed and acquisition of fundus images in the order from top to bottom is employed, the received nth-L fundus images are taken as reference images for the nth fundus image. Similarly, the reference image for determining the nth fundus image among the n fundus images is acquired as follows:
judging whether the (n-a x L) th fundus image is in a static state; wherein a is a positive integer, and the initial value of a is 1; if yes, the (n-a x L) th fundus image is used as a reference image of the nth fundus image; if not, a = a +1, and the process returns to the step of determining whether or not the (n-a × L) th fundus image is in a stationary state.
When in line acquisition mode and acquired only 1 time, the acquisition position data comprises (x)0,y0),(x1,y0),……,(xL,y0) (ii) a When in block acquisition mode and acquired only 1 time, the acquisition location data includes (x)0,y0),(x1,y0),……,(xL,y0)；(x0,y1),(x1,y1),……,(xL,y1)；……,(x0,yL),(x1,yL),……,(xL,yL)。
After receiving the data acquisition command and the acquisition position data, the OCT apparatus 302 performs fundus data acquisition in accordance with the acquisition position data, that is, performs scanning in accordance with the acquisition position data, transmits the scanned OCT image to the PC terminal 301, and the PC terminal 301 displays the OCT image.
The PC terminal 301 acquires the shift coefficient after receiving the fundus image, and uploads the acquired shift coefficient to the OCT apparatus 302.
However, when the PC terminal 301 determines that the current fundus state is motion, because the current fundus state is motion, it indicates that there is eye movement or blinking at present, which may cause the OCT apparatus 302 to acquire abnormal data, so the PC terminal 301 sends a data acquisition suspending command to the OCT apparatus 302, and after receiving the data acquisition suspending command, the OCT apparatus 302 temporarily acquires fundus data, that is, suspends scanning, and continues scanning after the eye is stabilized, thereby avoiding an erroneous shift operation in a large displacement scene, and solving a risk of erroneous determination of longitudinal large displacement motion detection.
Various changes and specific examples in the method provided by the above embodiment are also applicable to the PC terminal of the present embodiment, and through the foregoing detailed description of the method for scanning with assisted OCT, those skilled in the art can clearly know the implementation method of the PC terminal in the present embodiment, and for the brevity of the description, detailed descriptions are omitted here.

Claims (9)

1. A method for assisting OCT in scanning, comprising:
acquiring an nth fundus image and a reference image corresponding to the nth fundus image;
wherein, the acquiring the nth part of fundus image and the reference image corresponding to the nth part of fundus image comprises the following steps:
taking a fundus image which is identical to the nth fundus image in id and is closest to the acquisition time in the previously acquired fundus images as a reference image of the nth fundus image; wherein id represents the corresponding position of the fundus image in the whole frame fundus image; wherein, L parts of fundus images form a complete frame of fundus image;
judging whether the current fundus state is offset;
if not, executing a receiving step, wherein the receiving step is to receive a new fundus image, and n = n +1 till the current fundus state is in an offset state;
if yes, determining a reference image of the nth fundus image from the n fundus images based on the nth fundus image and the reference image corresponding to the nth fundus image;
obtaining a shift coefficient of the nth fundus image based on the nth fundus image, a reference image of the nth fundus image, and a reference image of the reference image.
2. The method according to claim 1, wherein the determining whether the current fundus state is an offset includes:
judging whether n is not more than 1;
if n is not more than 1, judging that the current fundus state is static;
if n is larger than 1, judging whether n is not larger than L;
if n is not greater than L, judging that the current fundus collection state is normal;
if n is larger than L, judging whether the current fundus collection state is normal or not based on the nth fundus image and the reference image corresponding to the nth fundus image;
if the current fundus collection state is normal, judging whether the fundus collection states corresponding to the (n-1) th to (n-M + 1) th fundus images are normal or not; wherein M > L;
if the current fundus state is normal, acquiring a previous fundus state, and judging whether the previous fundus state is moving; wherein the prior fundus state is the fundus state corresponding to the (n-1) th fundus image;
if the previous fundus state is motion, it is determined that the current fundus state is offset.
3. The method according to claim 2, wherein said determining whether the current fundus acquisition state is normal based on the nth fundus image and a reference image corresponding thereto comprises:
determining a current blink state based on the nth fundus image;
determining a current eye movement state based on the nth fundus image and the reference image of the nth fundus image;
judging whether the current blinking state is non-blinking and the current eye movement state is non-eye movement;
if so, judging that the current fundus collection state is normal;
if not, judging that the current fundus collection state is abnormal.
4. The method according to claim 2 or 3, wherein the judging whether the fundus collection states corresponding to the n-1 st to n-M +1 th fundus images are all normal includes:
if not, acquiring a previous fundus state, judging whether the current fundus state is static or moving based on the previous fundus state, and returning to the receiving step.
5. The method according to claim 4, wherein said determining whether the current fundus state is stationary or in motion based on the prior fundus state comprises:
judging whether the prior fundus state is moving;
if yes, judging that the current fundus state is motion;
if not, the current fundus state is judged to be static.
6. The method according to claim 5, characterized in that the determination of the reference image of the nth fundus image among the n fundus images is obtained by:
the fundus image which is the same id as the nth fundus image, is in a still fundus state, and is closest in acquisition time among the previously acquired fundus images is taken as a reference image of the nth fundus image.
7. A PC terminal comprising a memory and a processor, the memory having stored thereon a computer program that can be loaded by the processor and that executes the method according to any of claims 1 to 6.
8. A computer-readable storage medium, in which a computer program is stored which can be loaded by a processor and which executes the method of any one of claims 1 to 6.
9. A system for assisting OCT for scanning, comprising an OCT apparatus, an SLO apparatus, and the PC terminal of claim 7;
after acquiring a trigger command, the PC terminal sends an eye fundus image acquisition command and an acquisition mode to the SLO equipment according to a preset acquisition mode;
after receiving the acquisition command and the acquisition mode, the SLO equipment divides the whole acquisition area according to the acquisition mode to obtain a plurality of actual acquisition areas; acquiring fundus images according to the actual acquisition area, and sequentially sending the acquired fundus images to the PC terminal; the number of the actual acquisition regions is L;
the PC terminal acquires a shift coefficient after receiving the fundus image, and uploads the shift coefficient to the OCT apparatus.
CN202111451885.3A 2021-11-30 2021-11-30 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system Active CN114343566B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202111451885.3A CN114343566B (en) 2021-11-30 2021-11-30 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system
PCT/CN2022/120754 WO2023098249A1 (en) 2021-11-30 2022-09-23 Method for assisting oct in scanning, and pc terminal, storage medium and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111451885.3A CN114343566B (en) 2021-11-30 2021-11-30 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system

Publications (2)

Publication Number Publication Date
CN114343566A CN114343566A (en) 2022-04-15
CN114343566B true CN114343566B (en) 2022-11-01

Family

ID=81096461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111451885.3A Active CN114343566B (en) 2021-11-30 2021-11-30 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system

Country Status (2)

Country Link
CN (1) CN114343566B (en)
WO (1) WO2023098249A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114343566B (en) * 2021-11-30 2022-11-01 图湃(北京)医疗科技有限公司 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7805009B2 (en) * 2005-04-06 2010-09-28 Carl Zeiss Meditec, Inc. Method and apparatus for measuring motion of a subject using a series of partial images from an imaging system
JP5340693B2 (en) * 2008-11-05 2013-11-13 株式会社ニデック Ophthalmic imaging equipment
JP5199031B2 (en) * 2008-11-05 2013-05-15 株式会社ニデック Ophthalmic imaging equipment
CN103096785B (en) * 2010-03-12 2015-09-30 佳能株式会社 Ophthalmologic apparatus and control method thereof
JP5635898B2 (en) * 2010-12-17 2014-12-03 キヤノン株式会社 Fundus imaging apparatus and control method thereof
JP5917004B2 (en) * 2011-03-10 2016-05-11 キヤノン株式会社 IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
EP2865323B1 (en) * 2013-10-23 2022-02-16 Canon Kabushiki Kaisha Retinal movement tracking in optical coherence tomography
CN105982638B (en) * 2015-02-03 2019-05-31 广东福地新视野光电技术有限公司 Multi-functional OCT system image scanning range localization method
JP6866167B2 (en) * 2017-01-18 2021-04-28 キヤノン株式会社 Information processing equipment, information processing methods and programs
JP7123626B2 (en) * 2018-05-24 2022-08-23 キヤノン株式会社 Fundus imaging device and its control method
CN114343566B (en) * 2021-11-30 2022-11-01 图湃(北京)医疗科技有限公司 Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system

Also Published As

Publication number Publication date
CN114343566A (en) 2022-04-15
WO2023098249A1 (en) 2023-06-08

Similar Documents

Publication Publication Date Title
EP2453790B1 (en) Image processing apparatus, image processing method, and program
EP2749204B1 (en) Image processing apparatus and image processing method
JPH10229979A (en) Method for determining epicardial boundary of myocardium and system therefor
JP7143862B2 (en) Diagnosis support device, learning device, diagnosis support method, learning method and program
JP2015032127A (en) Image processing device, image processing method and program
CN114343566B (en) Method for assisting OCT (optical coherence tomography) in scanning, PC (personal computer) terminal, storage medium and system
CN109615634A (en) Optics eye fundus image dividing method, device, computer equipment and storage medium
US9420951B2 (en) Image processing apparatus and method of controlling same
WO2008010305A1 (en) Image analyzer and image analysis program
CN113793345B (en) Medical image segmentation method and device based on improved attention module
CN114419181A (en) CTA image reconstruction method and device, display method and device
JP2014018251A (en) Ophthalmological photographing apparatus and ophthalmological photographing program
JP6147001B2 (en) Image processing apparatus and image processing method
JP2006280682A (en) Method of supporting diagnostic image provided with noise detection function
JP2014128448A5 (en)
KR102257295B1 (en) Diagnostic system for diagnosing vulnerable atheromatous plaque through ultrasound image-based machine learning and the diagnostic method thereof
CN110097966B (en) Information reminding method and device and terminal equipment
JP6419249B2 (en) Image processing apparatus, image processing method, and image processing program
JP6410498B2 (en) Ophthalmic apparatus and control method thereof
JP4057021B2 (en) Method for determining the state of bone tissue, image processing apparatus, and image processing method
US20230210500A1 (en) Ultrasonography apparatus, ultrasonography method, and ultrasonography program
US10098532B2 (en) Systems, methods and apparatus for tracking changes in an ocular scene
CN114098629A (en) Method for removing OCTA motion artifact
CN117058184A (en) Motion detection method and system in magnetic resonance imaging
JP2018202237A (en) Image processing device and method for controlling the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant