CN116548910B - Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner - Google Patents
Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner Download PDFInfo
- Publication number
- CN116548910B CN116548910B CN202310573876.4A CN202310573876A CN116548910B CN 116548910 B CN116548910 B CN 116548910B CN 202310573876 A CN202310573876 A CN 202310573876A CN 116548910 B CN116548910 B CN 116548910B
- Authority
- CN
- China
- Prior art keywords
- image
- scanning
- resolution
- coherence tomography
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003325 tomography Methods 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000004927 fusion Effects 0.000 claims description 94
- 230000009466 transformation Effects 0.000 claims description 13
- 238000007499 fusion processing Methods 0.000 claims description 9
- 238000013507 mapping Methods 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 9
- 230000003044 adaptive effect Effects 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 3
- 238000003708 edge detection Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 12
- 238000012014 optical coherence tomography Methods 0.000 description 9
- 238000003384 imaging method Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004621 scanning probe microscopy Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/102—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for optical coherence tomography [OCT]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Radiology & Medical Imaging (AREA)
- Biophysics (AREA)
- Ophthalmology & Optometry (AREA)
- Engineering & Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Eye Examination Apparatus (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a resolution self-adaptive adjusting method and a resolution self-adaptive adjusting system of an ophthalmic coherence tomography scanner, wherein the method comprises the following steps: determining angle information of an ophthalmic coherence tomography scanner and a human eye to be scanned; adjusting the current angle resolution according to the angle information, and judging whether the current angle resolution is consistent with the preset angle resolution or not; when the current angle resolution is determined to be consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area; and respectively scanning the first target scanning area and the second target scanning area, and obtaining a third scanning image according to the first scanning image and the second scanning image. The resolution ratio of the ophthalmic coherence tomography scanner can be adaptively adjusted, the adjustment is actually carried out according to the user requirement, the contour recognition capability of the ophthalmic coherence tomography scanner for human eyes to be scanned is improved, the identification is distinguished according to the specific scanned scene, and more accurate scanned images can be conveniently obtained.
Description
Technical Field
The invention relates to the technical field of OCT (optical coherence tomography), in particular to a resolution self-adaptive adjustment method and a resolution self-adaptive adjustment system for an ophthalmic coherence tomography scanner.
Background
Optical coherence tomography (Optical Coherence Tomography, OCT) combines a low coherence interferometer with confocal scanning microscopy to enable high resolution, non-contact, high sensitivity longitudinal tomography. Has been widely used in the field of biomedical imaging, especially in the field of ophthalmic living imaging. The proposal of sweep OCT is an important innovation in the OCT technical field, and compared with the traditional time domain OCT, the sweep OCT has the advantages of high imaging speed, high signal-to-noise ratio, simplified system structure and the like. In scanning based on an ophthalmic coherence tomography scanner, the human eye to be scanned needs to be detected. The angular resolution cannot be adjusted in the prior art, and the size of the angular resolution determines the detection resolution capability of the ophthalmic coherence tomography scanner on space and the contour recognition capability of the human eye to be scanned. Therefore, the user experience is affected because the adjustment cannot be performed according to the requirements of the user. In the scanning process, based on the scanning from top to bottom or from left to right based on the same speed, the distinguishing and identification according to the specific scene of the scanning are not realized, and the scanning image with more details and more accuracy is not beneficial to obtaining.
Disclosure of Invention
The present invention aims to solve, at least to some extent, one of the technical problems in the above-described technology. Therefore, a first object of the present invention is to provide a resolution adaptive adjustment method for an ophthalmic coherence tomography scanner, which can adaptively adjust the resolution of the ophthalmic coherence tomography scanner, and actually adjust the resolution according to the user's requirements, so as to improve the contour recognition capability of the ophthalmic coherence tomography scanner for the human eye to be scanned, and distinguish and identify the eye according to the scanned specific scene, so as to obtain more detailed and more accurate scanned images.
A second object of the present invention is to propose a resolution adaptive adjustment system for an ophthalmic coherence tomography scanner.
To achieve the above object, an embodiment of a first aspect of the present invention provides a method for adaptively adjusting resolution of an ophthalmic coherence tomography scanner, including:
determining angle information of an ophthalmic coherence tomography scanner and a human eye to be scanned;
adjusting the current angle resolution according to the angle information, and judging whether the current angle resolution is consistent with the preset angle resolution or not;
when the current angle resolution is determined to be consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area;
determining a first scanning path according to a first target scanning area, and executing the first scanning path at a first scanning speed to obtain a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
and obtaining a third scanning image according to the first scanning image and the second scanning image.
According to some embodiments of the invention, determining angular information of an ophthalmic coherence tomography scanner with a human eye to be scanned comprises:
the ophthalmic coherence tomography scanner rotates a certain angle to change the propagation direction of the laser beam, so that the laser light path passes through the human eye to be scanned, and the rotating angle is used as angle information of the ophthalmic coherence tomography scanner and the human eye to be scanned.
According to some embodiments of the invention, adjusting the current angular resolution according to the angle information comprises:
wherein α is the current angular resolution; m is an integer, M < beta/alpha 0 ，α 0 Is the divergence angle of the laser beam; w (W) a Angle information of an ophthalmic coherence tomography scanner and human eyes to be scanned; w (W) b A maximum angle at which the ophthalmic coherence tomography scanner can rotate; beta is the initial angular resolution of the ophthalmic coherence tomography scanner.
According to some embodiments of the invention, identifying an initial image, determining a first target scan area and a second target scan area, includes:
preprocessing an initial image;
performing edge detection on the preprocessed initial image, and determining a binary image comprising edges;
determining a pixel point with a characteristic value of 0 in the binary image, and describing boundaries based on a straight line or a curve to obtain a plurality of first characteristic areas; taking a plurality of first characteristic areas as first target scanning areas;
determining pixel points with characteristic values of 1 in the binary image, and describing boundaries based on straight lines or curves to obtain a plurality of second characteristic areas; and taking the plurality of second characteristic areas as second target scanning areas.
According to some embodiments of the invention, determining a first scan path from a first target scan region includes:
determining the position relation among the first characteristic areas included in the first target scanning area;
optionally a first feature region as an initial first feature region;
establishing a mapping relation between image pixel coordinates corresponding to the initial first characteristic region and real coordinates, inquiring a preset data table based on the mapping relation, and determining a scanning angle of the real coordinates corresponding to each pixel of the initial first characteristic region relative to an ophthalmic coherence tomography scanner;
starting from the initial first feature region, a first scan path is determined based on the positional relationship and the angle of the ophthalmic coherence tomography scanner to each first feature region.
According to some embodiments of the invention, the preprocessing includes high pass filtering.
According to some embodiments of the invention, the preprocessing includes color adjustment processing;
a color adjustment process comprising:
inputting the initial image into a pre-trained color recognition model, and determining a color feature map of the initial image;
calculating the matching degree of the color feature map and the standard color feature map, and stacking the color feature map and the standard color feature map when the matching degree is smaller than the preset matching degree;
obtaining characteristic information of a standard color characteristic map, and dividing according to the characteristic information to obtain a plurality of sub-standard color characteristic maps and a plurality of sub-color characteristic maps corresponding to the sub-standard color characteristic maps;
the corresponding sub-standard color feature map and the sub-color feature map are used as matching pairs;
and establishing a color adjustment relation between the sub-standard color feature map and corresponding pixel points in the sub-color feature map in the matching pair, and adjusting the sub-color feature map according to the color adjustment relation to obtain an initial image after color adjustment processing.
According to some embodiments of the invention, obtaining a third scan image from the first scan image and the second scan image includes: and carrying out image fusion processing on the first scanning image and the second scanning image, and obtaining a third scanning image according to a fusion result.
According to some embodiments of the present invention, performing image fusion processing on the first scan image and the second scan image, and obtaining a third scan image according to a fusion result, including:
determining a first scanning image to perform wavelet transformation based on Haar wavelet to obtain a first low-frequency image and a first high-frequency image;
determining a second scanning image to perform wavelet transformation based on Haar wavelet to obtain a second low-frequency image and a second high-frequency image;
the first low-frequency image and the second low-frequency image are fused to obtain a first fusion result;
the first high-frequency image and the second high-frequency image are fused to obtain a second fusion result;
performing wavelet inverse transformation according to the first fusion result and the second fusion result to obtain an initial fusion image, calculating a fusion characteristic value of the initial fusion image, and judging whether the fusion characteristic value is smaller than a preset threshold value or not;
when the fusion characteristic value is determined to be smaller than a preset threshold value, the image fusion quality is poor, and the image fusion needs to be re-fused;
and when the fusion characteristic value is determined to be more than or equal to a preset threshold value, the image fusion quality is good, and the initial fusion image is used as a third scanning image.
To achieve the above object, an embodiment of a second aspect of the present invention provides an adaptive adjustment system for resolution of an ophthalmic coherence tomography scanner, including:
the first determining module is used for determining angle information of the ophthalmic coherence tomography scanner and human eyes to be scanned;
the judging module is used for adjusting the current angle resolution according to the angle information and judging whether the current angle resolution is consistent with the preset angle resolution or not;
the second determining module is used for shooting an initial image when the judging module determines that the current angular resolution is consistent with the preset angular resolution, identifying the initial image and determining a first target scanning area and a second target scanning area;
the scanning module is used for determining a first scanning path according to the first target scanning area, executing the first scanning path at a first scanning speed and obtaining a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
and the fusion module is used for obtaining a third scanning image according to the first scanning image and the second scanning image.
The invention provides a resolution self-adaptive adjustment method and a resolution self-adaptive adjustment system for an ophthalmic coherence tomography scanner, which can carry out self-adaptive adjustment on the resolution of the ophthalmic coherence tomography scanner, actually adjust according to the requirement of a user, improve the contour recognition capability of the ophthalmic coherence tomography scanner to the human eye to be scanned, distinguish and identify according to the specific scanned scene, and pay more attention to the comprehensiveness and the accuracy of scanning when scanning a first target scanning area. When the second target scanning area is scanned, the rapidness of scanning is paid more attention to, the first scanning image and the second scanning image are further obtained, and the image fusion processing is carried out, so that a third scanning image with more details and more accuracy is obtained.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a flow chart of a method of adaptively adjusting the resolution of an ophthalmic coherence tomography scanner according to one embodiment of the present invention;
FIG. 2 is a flow chart of a method of determining a first target scan area and a second target scan area according to one embodiment of the invention;
fig. 3 is a block diagram of a resolution adaptive adjustment system for an ophthalmic coherence tomography scanner in accordance with one embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
As shown in fig. 1, an embodiment of the first aspect of the present invention proposes a resolution adaptive adjustment method of an ophthalmic coherence tomography scanner, which includes steps S1 to S5:
s1, determining angle information of an ophthalmic coherence tomography scanner and human eyes to be scanned;
s2, adjusting the current angle resolution according to the angle information, and judging whether the current angle resolution is consistent with the preset angle resolution or not;
s3, when the current angle resolution is determined to be consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area;
s4, determining a first scanning path according to the first target scanning area, and executing the first scanning path at a first scanning speed to obtain a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
s5, obtaining a third scanning image according to the first scanning image and the second scanning image.
The working principle of the technical scheme is as follows: determining angle information of an ophthalmic coherence tomography scanner and a human eye to be scanned; adjusting the current angle resolution according to the angle information, and judging whether the current angle resolution is consistent with the preset angle resolution or not; the preset resolution is obtained based on user demand analysis. When the current angle resolution is determined to be consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area; the first target scanning area is a main solid area, and the second target scanning area is a secondary communication area. Determining a first scanning path according to a first target scanning area, and executing the first scanning path at a first scanning speed to obtain a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed; during the first scanning, the first target scanning area is scanned based on a slower speed, so that more detailed information in the first target scanning area can be acquired conveniently. During the second scanning, the second target scanning area is scanned based on a higher speed, so that the scanning is conveniently and rapidly realized due to the fact that the content of the second target scanning area is not too much, and the scanning efficiency is improved. And obtaining a third scanning image according to the first scanning image and the second scanning image.
The beneficial effects of the technical scheme are that: the resolution ratio of the ophthalmic coherence tomography scanner can be adaptively adjusted, the adjustment is actually carried out according to the user requirement, the contour recognition capability of the ophthalmic coherence tomography scanner to the human eye to be scanned is improved, the distinguishing and recognition are carried out according to the specific scanned scene, and the comprehensiveness and the accuracy of scanning are more focused when the first target scanning area is scanned. When the second target scanning area is scanned, the rapidness of scanning is paid more attention to, the first scanning image and the second scanning image are further obtained, and the image fusion processing is carried out, so that a third scanning image with more details and more accuracy is obtained.
According to some embodiments of the invention, determining angular information of an ophthalmic coherence tomography scanner with a human eye to be scanned comprises:
the ophthalmic coherence tomography scanner rotates a certain angle to change the propagation direction of the laser beam, so that the laser light path passes through the human eye to be scanned, and the rotating angle is used as angle information of the ophthalmic coherence tomography scanner and the human eye to be scanned.
The beneficial effects of the technical scheme are that: the method is convenient for accurately determining the angle information of the ophthalmic coherence tomography scanner and the human eyes to be scanned.
According to some embodiments of the invention, adjusting the current angular resolution according to the angle information comprises:
wherein α is the current angular resolution; m is an integer, M < beta/alpha 0 ，α 0 Is the divergence angle of the laser beam; w (W) a Angle information of an ophthalmic coherence tomography scanner and human eyes to be scanned; w (W) b A maximum angle at which the ophthalmic coherence tomography scanner can rotate; beta is the initial angular resolution of the ophthalmic coherence tomography scanner.
The technical scheme has the working principle and beneficial effects that: and accurately calculating the current angular resolution based on the formula, and correspondingly adjusting to ensure that the current angular resolution is consistent with the preset angular resolution. The implementation of an ophthalmic coherence tomography scanner can perform detection scanning for different scenes and different requirements.
As shown in fig. 2, according to some embodiments of the present invention, the initial image is identified, and a first target scan area and a second target scan area are determined, including steps S31-S34:
s31, preprocessing an initial image;
s32, performing edge detection on the preprocessed initial image, and determining a binary image comprising edges;
s33, determining a pixel point with a characteristic value of 0 in the binary image, and describing boundaries based on straight lines or curves to obtain a plurality of first characteristic areas; taking a plurality of first characteristic areas as first target scanning areas;
s34, determining pixel points with characteristic values of 1 in the binary image, and describing boundaries based on straight lines or curves to obtain a plurality of second characteristic areas; and taking the plurality of second characteristic areas as second target scanning areas.
The technical scheme has the working principle and beneficial effects that: and determining a pixel point with a characteristic value of 0 in the binary image, namely a black pixel point, determining a pixel point with a characteristic value of 1 in the binary image, namely a white pixel point, and taking a black region as a first characteristic region and a white region as a second characteristic region. And further accurately determining the first target scanning area and the second target scanning area.
According to some embodiments of the invention, determining a first scan path from a first target scan region includes:
determining the position relation among the first characteristic areas included in the first target scanning area;
optionally a first feature region as an initial first feature region;
establishing a mapping relation between image pixel coordinates corresponding to the initial first characteristic region and real coordinates, inquiring a preset data table based on the mapping relation, and determining a scanning angle of the real coordinates corresponding to each pixel of the initial first characteristic region relative to an ophthalmic coherence tomography scanner;
starting from the initial first feature region, a first scan path is determined based on the positional relationship and the angle of the ophthalmic coherence tomography scanner to each first feature region.
The technical scheme has the working principle and beneficial effects that: determining the position relation among the first characteristic areas included in the first target scanning area; optionally a first feature region as an initial first feature region; establishing a mapping relation between image pixel coordinates corresponding to the initial first characteristic region and real coordinates, inquiring a preset data table based on the mapping relation, and determining a scanning angle of the real coordinates corresponding to each pixel of the initial first characteristic region relative to an ophthalmic coherence tomography scanner; the preset data table is a mapping relation-scanning angle determination rule data table. Starting from the initial first feature region, a first scan path is determined based on the positional relationship and the angle of the ophthalmic coherence tomography scanner to each first feature region. Facilitating accurate determination of the first scan path.
In an embodiment, determining the second scan path is consistent with a method of determining the first scan path.
According to some embodiments of the invention, the preprocessing includes high pass filtering.
The beneficial effects of the technical scheme are that: noise in the initial image is conveniently removed, and accuracy of the initial image is improved.
According to some embodiments of the invention, the preprocessing includes color adjustment processing;
a color adjustment process comprising:
inputting the initial image into a pre-trained color recognition model, and determining a color feature map of the initial image;
calculating the matching degree of the color feature map and the standard color feature map, and stacking the color feature map and the standard color feature map when the matching degree is smaller than the preset matching degree;
obtaining characteristic information of a standard color characteristic map, and dividing according to the characteristic information to obtain a plurality of sub-standard color characteristic maps and a plurality of sub-color characteristic maps corresponding to the sub-standard color characteristic maps;
the corresponding sub-standard color feature map and the sub-color feature map are used as matching pairs;
and establishing a color adjustment relation between the sub-standard color feature map and corresponding pixel points in the sub-color feature map in the matching pair, and adjusting the sub-color feature map according to the color adjustment relation to obtain an initial image after color adjustment processing.
The technical scheme has the working principle and beneficial effects that: a color adjustment process comprising: inputting the initial image into a pre-trained color recognition model, and determining a color feature map of the initial image; calculating the matching degree of the color feature map and the standard color feature map, and stacking the color feature map and the standard color feature map when the matching degree is smaller than the preset matching degree; the standard color feature map is a preset standard parameter. Obtaining characteristic information of a standard color characteristic map, and dividing according to the characteristic information to obtain a plurality of sub-standard color characteristic maps and a plurality of sub-color characteristic maps corresponding to the sub-standard color characteristic maps; the self-adaptive adjustment is convenient to carry out according to different characteristic information, and the accuracy of adjustment is improved. The corresponding sub-standard color feature map and the sub-color feature map are used as matching pairs; and establishing a color adjustment relation between the sub-standard color feature map and corresponding pixel points in the sub-color feature map in the matching pair, and adjusting the sub-color feature map according to the color adjustment relation to obtain an initial image after color adjustment processing. The accuracy of color conversion is improved, and the accuracy of identifying the initial image is further facilitated.
According to some embodiments of the invention, obtaining a third scan image from the first scan image and the second scan image includes: and carrying out image fusion processing on the first scanning image and the second scanning image, and obtaining a third scanning image according to a fusion result.
The beneficial effects of the technical scheme are that: and respectively scanning different areas, and fusing scanning results to obtain a third scanning image, so that the comprehensiveness of the scanning image is ensured.
According to some embodiments of the present invention, performing image fusion processing on the first scan image and the second scan image, and obtaining a third scan image according to a fusion result, including:
determining a first scanning image to perform wavelet transformation based on Haar wavelet to obtain a first low-frequency image and a first high-frequency image;
determining a second scanning image to perform wavelet transformation based on Haar wavelet to obtain a second low-frequency image and a second high-frequency image;
the first low-frequency image and the second low-frequency image are fused to obtain a first fusion result;
the first high-frequency image and the second high-frequency image are fused to obtain a second fusion result;
performing wavelet inverse transformation according to the first fusion result and the second fusion result to obtain an initial fusion image, calculating a fusion characteristic value of the initial fusion image, and judging whether the fusion characteristic value is smaller than a preset threshold value or not;
when the fusion characteristic value is determined to be smaller than a preset threshold value, the image fusion quality is poor, and the image fusion needs to be re-fused;
and when the fusion characteristic value is determined to be more than or equal to a preset threshold value, the image fusion quality is good, and the initial fusion image is used as a third scanning image.
The working principle of the technical scheme is as follows: determining a first scanning image to perform wavelet transformation based on Haar wavelet to obtain a first low-frequency image and a first high-frequency image; determining a second scanning image to perform wavelet transformation based on Haar wavelet to obtain a second low-frequency image and a second high-frequency image; the first low-frequency image and the second low-frequency image are fused to obtain a first fusion result; the first high-frequency image and the second high-frequency image are fused to obtain a second fusion result; performing wavelet inverse transformation according to the first fusion result and the second fusion result to obtain an initial fusion image, calculating a fusion characteristic value of the initial fusion image, and judging whether the fusion characteristic value is smaller than a preset threshold value or not; when the fusion characteristic value is determined to be smaller than a preset threshold value, the image fusion quality is poor, and the image fusion needs to be re-fused; and when the fusion characteristic value is determined to be more than or equal to a preset threshold value, the image fusion quality is good, and the initial fusion image is used as a third scanning image. The preset threshold is obtained through multiple tests.
The beneficial effects of the technical scheme are that: the low-frequency vector and the high-frequency vector in the first scanning image and the low-frequency vector and the high-frequency vector in the second scanning image are respectively fused, so that detail features in the first scanning image and the second scanning image are conveniently reserved, fusion is more convenient, fusion efficiency is ensured, and fusion accuracy is improved. Performing wavelet inverse transformation according to the first fusion result and the second fusion result to obtain an initial fusion image, calculating a fusion characteristic value of the initial fusion image, and judging whether the fusion characteristic value is smaller than a preset threshold value or not; when the fusion characteristic value is determined to be smaller than a preset threshold value, the image fusion quality is poor, and the image fusion needs to be re-fused; and when the fusion characteristic value is determined to be more than or equal to a preset threshold value, the image fusion quality is good, and the initial fusion image is used as a third scanning image. And detecting the final fusion result, judging the fusion quality, and facilitating obtaining an accurate third scanning image.
In one embodiment, calculating the fusion characteristic value of the initial fusion image includes:
s is a fusion characteristic value; m is the number of pixel points of the initial fusion image in the transverse direction; n is the number of pixels of the initial fusion image in the longitudinal direction; f (i+1, j) is the gray value of the initial fused image at (i+1, j); f (i, j) gray values of the initial fused image at (i, j); f (i, j+1) is the gray value of the initial fused image at (i, j+1).
The technical scheme has the working principle and beneficial effects that: the fusion characteristic value is sensitive to the micro detail contrast of the initial fusion image, can reflect the definition degree of the initial fusion image, and the larger the value is, the clearer the image is. Based on the formula, the fusion characteristic value of the initial fusion image is accurately calculated, and the accuracy of judging the fusion characteristic value and the preset threshold value is improved.
As shown in fig. 3, an embodiment of the second aspect of the present invention proposes a resolution adaptive adjustment system of an ophthalmic coherence tomography scanner, comprising:
the first determining module is used for determining angle information of the ophthalmic coherence tomography scanner and human eyes to be scanned;
the judging module is used for adjusting the current angle resolution according to the angle information and judging whether the current angle resolution is consistent with the preset angle resolution or not;
the second determining module is used for shooting an initial image when the judging module determines that the current angular resolution is consistent with the preset angular resolution, identifying the initial image and determining a first target scanning area and a second target scanning area;
the scanning module is used for determining a first scanning path according to the first target scanning area, executing the first scanning path at a first scanning speed and obtaining a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
and the fusion module is used for obtaining a third scanning image according to the first scanning image and the second scanning image.
The working principle of the technical scheme is as follows: the first determining module determines angle information of the ophthalmic coherence tomography scanner and human eyes to be scanned; the judging module adjusts the current angular resolution according to the angle information and judges whether the current angular resolution is consistent with the preset angular resolution or not; the preset resolution is obtained based on user demand analysis. When the second determining module determines that the current angle resolution is consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area; the first target scanning area is a main solid area, and the second target scanning area is a secondary communication area. The scanning module determines a first scanning path according to a first target scanning area, and executes the first scanning path at a first scanning speed to obtain a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed; during the first scanning, the first target scanning area is scanned based on a slower speed, so that more detailed information in the first target scanning area can be acquired conveniently. During the second scanning, the second target scanning area is scanned based on a higher speed, so that the scanning is conveniently and rapidly realized due to the fact that the content of the second target scanning area is not too much, and the scanning efficiency is improved. And the fusion module obtains a third scanning image according to the first scanning image and the second scanning image.
The beneficial effects of the technical scheme are that: the resolution ratio of the ophthalmic coherence tomography scanner can be adaptively adjusted, the adjustment is actually carried out according to the user requirement, the contour recognition capability of the ophthalmic coherence tomography scanner to the human eye to be scanned is improved, the distinguishing and recognition are carried out according to the specific scanned scene, and the comprehensiveness and the accuracy of scanning are more focused when the first target scanning area is scanned. When the second target scanning area is scanned, the rapidness of scanning is paid more attention to, the first scanning image and the second scanning image are further obtained, and the image fusion processing is carried out, so that a third scanning image with more details and more accuracy is obtained.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (9)
1. A method for adaptively adjusting the resolution of an ophthalmic coherence tomography scanner, comprising:
determining angle information of an ophthalmic coherence tomography scanner and a human eye to be scanned;
adjusting the current angle resolution according to the angle information, and judging whether the current angle resolution is consistent with the preset angle resolution or not;
when the current angle resolution is determined to be consistent with the preset angle resolution, shooting an initial image, identifying the initial image, and determining a first target scanning area and a second target scanning area;
determining a first scanning path according to a first target scanning area, and executing the first scanning path at a first scanning speed to obtain a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
obtaining a third scanning image according to the first scanning image and the second scanning image;
adjusting the current angular resolution according to the angle information, including:
wherein α is the current angular resolution; m is an integer, M < beta/alpha 0 ，α 0 Is the divergence angle of the laser beam; w (W) a Angle information of an ophthalmic coherence tomography scanner and human eyes to be scanned; w (W) b A maximum angle at which the ophthalmic coherence tomography scanner can rotate; beta is the initial angular resolution of the ophthalmic coherence tomography scanner.
2. The method of adaptively adjusting the resolution of an ophthalmic coherence tomography scanner of claim 1, wherein determining the angular information of the ophthalmic coherence tomography scanner and the human eye to be scanned comprises:
the ophthalmic coherence tomography scanner rotates a certain angle to change the propagation direction of the laser beam, so that the laser light path passes through the human eye to be scanned, and the rotating angle is used as angle information of the ophthalmic coherence tomography scanner and the human eye to be scanned.
3. The method of adaptively adjusting a resolution of an ophthalmic coherence tomography scanner of claim 1, wherein identifying an initial image to determine a first target scan region and a second target scan region comprises:
preprocessing an initial image;
performing edge detection on the preprocessed initial image, and determining a binary image comprising edges;
determining a pixel point with a characteristic value of 0 in the binary image, and describing boundaries based on a straight line or a curve to obtain a plurality of first characteristic areas; taking a plurality of first characteristic areas as first target scanning areas;
determining pixel points with characteristic values of 1 in the binary image, and describing boundaries based on straight lines or curves to obtain a plurality of second characteristic areas; and taking the plurality of second characteristic areas as second target scanning areas.
4. A method of adaptively adjusting the resolution of an ophthalmic coherence tomography scanner as in claim 3, wherein determining a first scan path based on a first target scan region comprises:
determining the position relation among the first characteristic areas included in the first target scanning area;
optionally a first feature region as an initial first feature region;
establishing a mapping relation between image pixel coordinates corresponding to the initial first characteristic region and real coordinates, inquiring a preset data table based on the mapping relation, and determining a scanning angle of the real coordinates corresponding to each pixel of the initial first characteristic region relative to an ophthalmic coherence tomography scanner;
starting from the initial first feature region, a first scan path is determined based on the positional relationship and the angle of the ophthalmic coherence tomography scanner to each first feature region.
5. A method of adaptively adjusting the resolution of an ophthalmic coherence tomography scanner as in claim 3, wherein said preprocessing comprises high pass filtering.
6. A method of adaptively adjusting the resolution of an ophthalmic coherence tomography scanner as in claim 3, wherein said preprocessing comprises a color adjustment process;
a color adjustment process comprising:
inputting the initial image into a pre-trained color recognition model, and determining a color feature map of the initial image;
calculating the matching degree of the color feature map and the standard color feature map, and stacking the color feature map and the standard color feature map when the matching degree is smaller than the preset matching degree;
obtaining characteristic information of a standard color characteristic map, and dividing according to the characteristic information to obtain a plurality of sub-standard color characteristic maps and a plurality of sub-color characteristic maps corresponding to the sub-standard color characteristic maps;
the corresponding sub-standard color feature map and the sub-color feature map are used as matching pairs;
and establishing a color adjustment relation between the sub-standard color feature map and corresponding pixel points in the sub-color feature map in the matching pair, and adjusting the sub-color feature map according to the color adjustment relation to obtain an initial image after color adjustment processing.
7. The method of adaptively adjusting a resolution of an ophthalmic coherence tomography scanner of claim 1, wherein obtaining a third scan image from the first scan image and the second scan image comprises: and carrying out image fusion processing on the first scanning image and the second scanning image, and obtaining a third scanning image according to a fusion result.
8. The method for adaptively adjusting the resolution of an ophthalmic coherence tomography scanner according to claim 7, wherein performing an image fusion process on the first scan image and the second scan image, and obtaining a third scan image according to the fusion result, comprises:
determining a first scanning image to perform wavelet transformation based on Haar wavelet to obtain a first low-frequency image and a first high-frequency image;
determining a second scanning image to perform wavelet transformation based on Haar wavelet to obtain a second low-frequency image and a second high-frequency image;
the first low-frequency image and the second low-frequency image are fused to obtain a first fusion result;
the first high-frequency image and the second high-frequency image are fused to obtain a second fusion result;
performing wavelet inverse transformation according to the first fusion result and the second fusion result to obtain an initial fusion image, calculating a fusion characteristic value of the initial fusion image, and judging whether the fusion characteristic value is smaller than a preset threshold value or not;
when the fusion characteristic value is determined to be smaller than a preset threshold value, the image fusion quality is poor, and the image fusion needs to be re-fused;
and when the fusion characteristic value is determined to be more than or equal to a preset threshold value, the image fusion quality is good, and the initial fusion image is used as a third scanning image.
9. An adaptive adjustment system for resolution of an ophthalmic coherence tomography scanner, comprising:
the first determining module is used for determining angle information of the ophthalmic coherence tomography scanner and human eyes to be scanned;
the judging module is used for adjusting the current angle resolution according to the angle information and judging whether the current angle resolution is consistent with the preset angle resolution or not;
the second determining module is used for shooting an initial image when the judging module determines that the current angular resolution is consistent with the preset angular resolution, identifying the initial image and determining a first target scanning area and a second target scanning area;
the scanning module is used for determining a first scanning path according to the first target scanning area, executing the first scanning path at a first scanning speed and obtaining a first scanning image; determining a second scanning path according to a second target scanning area, and executing the second scanning path at a second scanning speed to obtain a second scanning image; the first scanning speed is smaller than the second scanning speed;
the fusion module is used for obtaining a third scanning image according to the first scanning image and the second scanning image;
adjusting the current angular resolution according to the angle information, including:
wherein α is the current angular resolution; m is an integer, M < beta/alpha 0 ，α 0 Is the divergence angle of the laser beam; w (W) a Angle information of an ophthalmic coherence tomography scanner and human eyes to be scanned; w (W) b A maximum angle at which the ophthalmic coherence tomography scanner can rotate; beta is the initial angular resolution of the ophthalmic coherence tomography scanner.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310573876.4A CN116548910B (en) | 2023-05-19 | 2023-05-19 | Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310573876.4A CN116548910B (en) | 2023-05-19 | 2023-05-19 | Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116548910A CN116548910A (en) | 2023-08-08 |
| CN116548910B true CN116548910B (en) | 2023-12-08 |
Family
ID=87503268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310573876.4A Active CN116548910B (en) | 2023-05-19 | 2023-05-19 | Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116548910B (en) |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101862178A (en) * | 2010-06-02 | 2010-10-20 | 中国科学院光电技术研究所 | Reflection-type confocal scanning retina imaging system based on adaptive optics |
| CN102333477A (en) * | 2009-01-23 | 2012-01-25 | 佳能株式会社 | Optical tomographic imaging method and optical tomographic imaging apparatus |
| CN102599882A (en) * | 2011-01-20 | 2012-07-25 | 佳能株式会社 | Optical coherence tomographic imaging method and apparatus |
| CN102753087A (en) * | 2010-02-10 | 2012-10-24 | 佳能株式会社 | Image acquisition apparatus |
| CN103070665A (en) * | 2012-10-12 | 2013-05-01 | 中国科学院光电技术研究所 | Self-adapted sweep frequency optical coherence tomography imaging system based on double wave-front correctors |
| CN104334072A (en) * | 2012-04-05 | 2015-02-04 | 拜奥普蒂根公司 | Surgical microscopes using optical coherence tomography and related systems and methods |
| CN104545811A (en) * | 2014-12-26 | 2015-04-29 | 深圳先进技术研究院 | Intravascular imaging system and method |
| JP2017086807A (en) * | 2015-11-17 | 2017-05-25 | キヤノン株式会社 | Image acquisition device and driving method of the same, and program |
| CN110176297A (en) * | 2019-05-24 | 2019-08-27 | 南京博视医疗科技有限公司 | A kind of Brilliant Eyes bottom laser surgey assistant diagnosis system and its method |
| WO2019172062A1 (en) * | 2018-03-06 | 2019-09-12 | 株式会社ニデック | Ocular fundus imaging device |
| CN110327013A (en) * | 2019-05-21 | 2019-10-15 | 北京至真互联网技术有限公司 | Eye fundus image detection method, device and equipment and storage medium |
| CN110906869A (en) * | 2019-11-22 | 2020-03-24 | 深圳市太赫兹科技创新研究院有限公司 | OCT probe adjusting device |
| JP6748932B1 (en) * | 2020-03-21 | 2020-09-02 | のりこ 安間 | Endoscope device |
| CN112168136A (en) * | 2020-09-27 | 2021-01-05 | 中国科学院光电技术研究所 | Scanning-free three-dimensional optical coherence tomography angiography and tissue structure imaging system and method |
| CN112957012A (en) * | 2021-02-01 | 2021-06-15 | 浙江省医疗器械检验研究院 | Axial resolution measuring device and method for optical interference tomography system |
| CN113229836A (en) * | 2021-06-18 | 2021-08-10 | 上海联影医疗科技股份有限公司 | Medical scanning method and system |
| CN114903426A (en) * | 2022-05-27 | 2022-08-16 | 视微影像(河南)科技有限公司 | Comprehensive ophthalmologic image system based on swept source OCT and acquisition method thereof |
| CN115096204A (en) * | 2016-03-25 | 2022-09-23 | 统雷有限公司 | MEMS tunable VCSEL driven swept source OCT for 3D measurement applications |
| CN115407361A (en) * | 2022-10-11 | 2022-11-29 | 北京格镭信息科技有限公司 | Eccentric double-rotating-shaft laser scanner |
| WO2023022183A1 (en) * | 2021-08-18 | 2023-02-23 | 株式会社ニコン | Ophthalmic device, control method, and program |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080252901A1 (en) * | 2003-09-26 | 2008-10-16 | School Jiridical Person Kitasato Gakuen | Wavelength-Tunable Light Source And Optical Coherence Tomography |
| WO2014063106A1 (en) * | 2012-10-18 | 2014-04-24 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Multi-resolution foveated endoscope/laparoscope |
| US9241626B2 (en) * | 2013-03-14 | 2016-01-26 | Carl Zeiss Meditec, Inc. | Systems and methods for improved acquisition of ophthalmic optical coherence tomography data |
| JP6217185B2 (en) * | 2013-07-02 | 2017-10-25 | 株式会社ニデック | Ophthalmic photographing apparatus and ophthalmic image processing program |
| US9339178B2 (en) * | 2013-12-23 | 2016-05-17 | Novartis Ag | Forward scanning optical probes and associated devices, systems, and methods |
| JP2017158836A (en) * | 2016-03-10 | 2017-09-14 | キヤノン株式会社 | Ophthalmologic apparatus and imaging method |
| US10502546B2 (en) * | 2017-11-07 | 2019-12-10 | Santec Corporation | Systems and methods for variable-range fourier domain imaging |
| US20220326495A1 (en) * | 2021-04-08 | 2022-10-13 | LighTopTech Corp. | Dual-mode optical coherence tomography and optical coherence microscopy imaging systems and methods |
-
2023
- 2023-05-19 CN CN202310573876.4A patent/CN116548910B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102333477A (en) * | 2009-01-23 | 2012-01-25 | 佳能株式会社 | Optical tomographic imaging method and optical tomographic imaging apparatus |
| CN102753087A (en) * | 2010-02-10 | 2012-10-24 | 佳能株式会社 | Image acquisition apparatus |
| CN101862178A (en) * | 2010-06-02 | 2010-10-20 | 中国科学院光电技术研究所 | Reflection-type confocal scanning retina imaging system based on adaptive optics |
| CN102599882A (en) * | 2011-01-20 | 2012-07-25 | 佳能株式会社 | Optical coherence tomographic imaging method and apparatus |
| CN104334072A (en) * | 2012-04-05 | 2015-02-04 | 拜奥普蒂根公司 | Surgical microscopes using optical coherence tomography and related systems and methods |
| CN103070665A (en) * | 2012-10-12 | 2013-05-01 | 中国科学院光电技术研究所 | Self-adapted sweep frequency optical coherence tomography imaging system based on double wave-front correctors |
| CN104545811A (en) * | 2014-12-26 | 2015-04-29 | 深圳先进技术研究院 | Intravascular imaging system and method |
| JP2017086807A (en) * | 2015-11-17 | 2017-05-25 | キヤノン株式会社 | Image acquisition device and driving method of the same, and program |
| CN115096204A (en) * | 2016-03-25 | 2022-09-23 | 统雷有限公司 | MEMS tunable VCSEL driven swept source OCT for 3D measurement applications |
| WO2019172062A1 (en) * | 2018-03-06 | 2019-09-12 | 株式会社ニデック | Ocular fundus imaging device |
| CN110327013A (en) * | 2019-05-21 | 2019-10-15 | 北京至真互联网技术有限公司 | Eye fundus image detection method, device and equipment and storage medium |
| CN110176297A (en) * | 2019-05-24 | 2019-08-27 | 南京博视医疗科技有限公司 | A kind of Brilliant Eyes bottom laser surgey assistant diagnosis system and its method |
| CN110906869A (en) * | 2019-11-22 | 2020-03-24 | 深圳市太赫兹科技创新研究院有限公司 | OCT probe adjusting device |
| JP6748932B1 (en) * | 2020-03-21 | 2020-09-02 | のりこ 安間 | Endoscope device |
| CN112168136A (en) * | 2020-09-27 | 2021-01-05 | 中国科学院光电技术研究所 | Scanning-free three-dimensional optical coherence tomography angiography and tissue structure imaging system and method |
| CN112957012A (en) * | 2021-02-01 | 2021-06-15 | 浙江省医疗器械检验研究院 | Axial resolution measuring device and method for optical interference tomography system |
| CN113229836A (en) * | 2021-06-18 | 2021-08-10 | 上海联影医疗科技股份有限公司 | Medical scanning method and system |
| WO2023022183A1 (en) * | 2021-08-18 | 2023-02-23 | 株式会社ニコン | Ophthalmic device, control method, and program |
| CN114903426A (en) * | 2022-05-27 | 2022-08-16 | 视微影像(河南)科技有限公司 | Comprehensive ophthalmologic image system based on swept source OCT and acquisition method thereof |
| CN115407361A (en) * | 2022-10-11 | 2022-11-29 | 北京格镭信息科技有限公司 | Eccentric double-rotating-shaft laser scanner |
Non-Patent Citations (2)
| Title |
|---|
| Sparse-Based Domain Adaptation Network for OCTA Image Super-Resolution Reconstruction;Hao, HY等;IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS;第26卷(第9期);4402-4413 * |
| 自适应光学的眼科学应用;张雨东等;中国科学(G辑:物理学 力学 天文学);第S1卷;68-74 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116548910A (en) | 2023-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110738142B (en) | Method, system and storage medium for adaptively improving face image acquisition | |
| CN102831392B (en) | Device for remote iris tracking and acquisition, and method thereof | |
| Fuhl et al. | Fast camera focus estimation for gaze-based focus control | |
| KR100617390B1 (en) | Face identification apparatus, face identification method, and medium for recording face identification program | |
| CN101615292B (en) | Accurate positioning method for human eye on the basis of gray gradation information | |
| CN105956578A (en) | Face verification method based on identity document information | |
| EP1510973A2 (en) | Method and apparatus for image-based photorealistic 3D face modeling | |
| CN110060259A (en) | A kind of fish eye lens effective coverage extracting method based on Hough transformation | |
| CN112116576A (en) | Defect detection method based on polarization structure light imaging and improved Mask R-CNN | |
| CN107800965B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| JP3926507B2 (en) | Eye position and face position detection device | |
| CN109086675A (en) | A kind of recognition of face and attack detection method and its device based on optical field imaging technology | |
| WO2007046477A1 (en) | Face center position detecting device, face center position detecting method, and program | |
| CN109001902B (en) | Microscope focusing method based on image fusion | |
| CN109840484A (en) | A kind of pupil detection method based on edge filter, oval evaluation and pupil verifying | |
| CN108665436A (en) | A kind of multi-focus image fusing method and system based on gray average reference | |
| JP4203279B2 (en) | Attention determination device | |
| CN111738241B (en) | Pupil detection method and device based on double cameras | |
| CN116548910B (en) | Resolution self-adaptive adjusting method and system of ophthalmic coherence tomography scanner | |
| CN112001920B (en) | Fundus image recognition method, device and equipment | |
| JP2003271932A (en) | Sight line direction detector | |
| CN114677454A (en) | Image generation method and device | |
| CN107403448B (en) | Cost function generation method and cost function generation device | |
| WO2010133099A1 (en) | Target detecting method and system and stereovision system | |
| CN112833821A (en) | Differential geometric three-dimensional micro-vision detection system and method for high-density IC welding spots |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |