WO2021048954A1 - 画像処理装置、画像処理方法、及び画像処理プログラム - Google Patents

画像処理装置、画像処理方法、及び画像処理プログラム Download PDF

Info

Publication number
WO2021048954A1
WO2021048954A1 PCT/JP2019/035727 JP2019035727W WO2021048954A1 WO 2021048954 A1 WO2021048954 A1 WO 2021048954A1 JP 2019035727 W JP2019035727 W JP 2019035727W WO 2021048954 A1 WO2021048954 A1 WO 2021048954A1
Authority
WO
WIPO (PCT)
Prior art keywords
wavelength
image
fundus
image processing
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/035727
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
古谷　俊輔
朋春 藤原
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nikon Corp
Original Assignee
Nikon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nikon Corp filed Critical Nikon Corp
Priority to JP2021545035A priority Critical patent/JPWO2021048954A1/ja
Priority to PCT/JP2019/035727 priority patent/WO2021048954A1/ja
Publication of WO2021048954A1 publication Critical patent/WO2021048954A1/ja
Anticipated expiration legal-status Critical
Priority to JP2023214958A priority patent/JP2024041773A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes

Definitions

  • the present invention relates to an image processing apparatus, an image processing method, and an image processing program.
  • U.S. Pat. No. 10,136,812 discloses an optical interference tomography device that selectively visualizes the choroidal vascular network and an image processing program thereof, which obtains image data of the choroidal vascular network existing in the layer of the choroid. A suitable image processing method for selective extraction is desired.
  • the image processing apparatus is in a predetermined wavelength range showing a first fundus image captured by the first light of the first wavelength and a hue close to the hue indicated by the first wavelength.
  • the image processing method of the second aspect of the technique of the present disclosure is to set the first fundus image taken by the first light of the first wavelength and a predetermined wavelength range showing a hue close to the hue indicated by the first wavelength.
  • An image processing program is a predetermined image processing program in which a computer exhibits a first fundus image taken with the first light of the first wavelength and a hue close to the hue indicated by the first wavelength.
  • the ophthalmology system 100 includes an ophthalmology device 110, a server device (hereinafter referred to as “server”) 140, and a display device (hereinafter referred to as “viewer”) 150.
  • the ophthalmic apparatus 110 acquires a fundus image.
  • the server 140 stores a plurality of fundus images and axial lengths obtained by photographing the fundus of a plurality of patients by the ophthalmologic apparatus 110, corresponding to the IDs of the patients.
  • the viewer 150 displays the fundus image and the analysis result acquired by the server 140.
  • the ophthalmic apparatus 110, the server 140, and the viewer 150 are connected to each other via the network 130.
  • the viewer 150 is a client in a client-server system, and a plurality of viewers 150 are connected via a network. Further, a plurality of servers 140 may be connected via a network in order to ensure system redundancy.
  • the ophthalmic apparatus 110 has an image processing function and an image viewing function of the viewer 150, the ophthalmologic apparatus 110 can acquire a fundus image, perform image processing, and view an image in a stand-alone state.
  • the server 140 is provided with the image viewing function of the viewer 150, the ophthalmic apparatus 110 and the server 140 can be configured to acquire a fundus image, perform image processing, and view an image.
  • a diagnostic support device that performs image analysis using other ophthalmic devices (inspection devices such as visual field measurement and intraocular pressure measurement) and AI (Artificial Intelligence) is connected to the ophthalmic device 110, the server 140, and the viewer via the network 130. It may be connected to 150.
  • ophthalmic devices inspection devices such as visual field measurement and intraocular pressure measurement
  • AI Artificial Intelligence
  • the ophthalmic apparatus 110 includes a control unit 20, a display / operation unit 30, and an SLO unit 40A.
  • the posterior eye portion (fundus) of the eye to be inspected 12 is photographed.
  • an OCT unit (not shown) for acquiring OCT data of the fundus may be provided.
  • SLO scanning laser ophthalmoscope.
  • OCT optical coherence tomography.
  • the control unit 20 includes a computer having a CPU 22, a memory 24, a communication interface (I / F) 26, and the like.
  • the display / operation unit 30 is a graphic user interface for displaying an image obtained by being photographed and receiving various instructions including an instruction for photographing, and includes a display 32 and an input / instruction device 34.
  • the SLO controller unit 180 (including the SLO light source control unit 1804 and the scanner control unit 1806), the image processing unit 182, the display control unit 184, and the output.
  • the CPU 22 functions as a unit 186.
  • the image processing may be performed on the server 140 or the viewer 150.
  • the CPU of the server 140 or the viewer 150 does not have the SLO control unit 180 shown in FIG. 3, but includes an image processing unit 182, a display control unit 184, and an output unit 186.
  • the image processing unit 182 corresponds to the "image processing unit" of the technique of the present disclosure.
  • the memory 24 stores a photographing processing program and an image processing program for photographing the fundus of the eye to be examined 12, which will be described later.
  • the photographing processing program and the image processing program correspond to the "image processing program" of the technique of the present disclosure.
  • the SLO unit 40A includes a light source 42 for G light (green light: wavelength 532 nm), a light source 44A for first R light (red light: wavelength 575 nm to 800 nm), and second R light (red light: wavelength 575 nm) having a wavelength different from that of the first R light. It is provided with a light source 44B (from 800 nm) and a light source 46 of IR light (infrared (near infrared light): wavelength 802 nm or more).
  • the light sources 42, 44A, 44B, and 46 are commanded by the control unit 20 to emit each light.
  • an LED light source or a laser light source can be used as the light sources 42, 44A, 44B, and 46. An example using a laser light source will be described below.
  • the on / off of the light sources 42, 44A, 44B, and 46 is controlled by the SLO light source control unit 1804 of the SLO control unit 180 of the CPU 22.
  • the SLO unit 40A includes optical systems 50, 52A, 52B, 54, 56 that reflect or transmit light from light sources 42, 44A, 44B, 46 and guide them to one optical path.
  • the optical systems 50 and 56 are mirrors.
  • the optical systems 52A, 52B, and 54 are beam splitters, specifically, dichroic mirrors, half mirrors, and the like whose reflectance and transmittance are adjusted according to the wavelength of the light source.
  • the G light is reflected by the optical system 50 and then transmitted through the optical system 52A and further reflected by the optical system 54.
  • the first R light is reflected by the optical system 52A and then reflected by the optical system 54 and is reflected by the second R.
  • the light passes through the optical systems 52B and 54, and the IR light is reflected by the optical systems 52B and 56 and guided to one optical path, respectively.
  • the SLO unit 40A includes a wide-angle optical system 80 that scans the light from the light sources 42, 44A, 44B, and 46 over the posterior eye portion (fundus) of the eye 12 to be examined in a two-dimensional manner.
  • the SLO unit 40A includes a beam splitter 58 that reflects G light and transmits other than G light among the light from the rear eye portion (fundus) of the eye 12 to be inspected.
  • the SLO unit 40A includes a beam splitter 60A that reflects the first R light and transmits other than the first R light among the light transmitted through the beam splitter 58.
  • the SLO unit 40A includes a beam splitter 60B that reflects the second R light and transmits other than the second R light among the light transmitted through the beam splitter 60A.
  • the SLO unit 40A includes a beam splitter 62 that reflects IR light among the light transmitted through the beam splitter 60B.
  • a beam splitter 62 that reflects IR light among the light transmitted through the beam splitter 60B.
  • a dichroic mirror, a half mirror, or the like can be used as the beam splitters 58, 60A, 60B, 62.
  • the two-dimensional scanning by the wide-angle optical system 80 is controlled by the scanner control unit 1806 of the SLO control unit 180 of the CPU 22.
  • the SLO unit 40A receives the G light detection element 72 that detects the G light reflected by the beam splitter 58, the R1 light detection element 74A that detects the first R light reflected by the beam splitter 60A, and the second R light reflected by the beam splitter 60B. It includes an R2 light detection element 74B for detection and an IR light detection element 76 for detecting IR light reflected by the beam splitter 62.
  • Examples of the photodetector elements 72, 74A, 74B, 76 include PD (photodiode) and APD (avalanche photodiode).
  • the photodetector elements 72, 74A, 74B, 76 correspond to the "acquisition unit" of the technique of the present disclosure.
  • the light reflected (scattered) by the fundus of the eye, which is an object, and returned reaches the photodetector through the X-direction scanning device 82 and the Y-direction scanning device 84, which will be described later, so that the light is always at the same position, that is, It returns to the position where the photodetector elements 72, 74A, 74B, 76 exist. Therefore, it is not necessary to configure the photodetector in a planar shape (two-dimensional) like an area sensor, and a point-shaped (0-dimensional) detector such as PD or APD is optimal in this embodiment. However, not limited to PD or APD, it is also possible to use a line sensor (one-dimensional) or an area sensor (two-dimensional).
  • the wide-angle optical system 80 includes an X-direction scanning device 82 composed of polygon mirrors that scan light from light sources 42, 44A, 44B, and 46 in the X direction, and Y-direction scanning composed of a galvano mirror that scans in the Y direction.
  • the device 84 includes a concave mirror such as an elliptical mirror capable of irradiating scanned light at an ultra-wide angle (UWF: Ultra WideField), and an optical system 86 composed of a lens system composed of a plurality of lenses.
  • Each scanning device of the X-direction scanning device 82 and the Y-direction scanning device 84 may use a MEMS (Micro Electro Mechanical System) mirror.
  • MEMS Micro Electro Mechanical System
  • two-dimensional scanning may be performed by one MEMS mirror without providing a scanner in each of the X direction and the Y direction.
  • the horizontal direction is the "X direction”
  • the vertical direction with respect to the horizontal plane is the "Y direction", connecting the center of the pupil of the anterior segment of the eye 12 to the center of the eyeball.
  • the direction is "Z direction”. Therefore, the X, Y, and Z directions are perpendicular to each other.
  • the viewing angle (FOV: Field of View) of the fundus is set to an ultra-wide angle, and the range of the fundus with an internal irradiation angle of 200 degrees can be photographed starting from the center of the eyeball. That is, it is possible to photograph a region beyond the equator from the posterior pole of the fundus of the eye 12 to be inspected.
  • FIG. 4 is an explanatory diagram illustrating the depth of penetration of light for each wavelength of the fundus structure.
  • the blue wavelength ⁇ 1A having a wavelength of 488 nm is scattered or reflected in the upper part of the retina
  • the green wavelength ⁇ 2A having a wavelength of 532 nm is scattered or reflected in the lower part of the retina within 0.2 mm from the surface of the retina.
  • the red two-wavelength ⁇ 2B having a wavelength of 670 nm is scattered or reflected by the choroidal membrane existing in the range of 0.2 mm to 0.8 mm starting from the surface of the retinal.
  • the blood vessels of the choroid remarkably scatter / reflect red light due to hemoglobin contained in blood. Therefore, red light is suitable for observing choroidal blood vessels.
  • melanin which has a high first reflectance of red light, is present in the choroid. Since melanin is contained in the entire choroid including blood vessels, it may be difficult to distinguish the vascular portion of the choroid from the interstitial portion other than the blood vessels when observing the fundus with red light.
  • FIG. 5 is an explanatory diagram illustrating the relative reflection characteristic ratios of blood (hemoglobin) and melanin for each wavelength.
  • the relative reflection characteristic ratio of melanin increases monotonically as the wavelength becomes longer, but the relative reflection characteristic ratio of blood increases as the wavelength becomes longer as a general tendency, although the relative reflection characteristic ratio increases slightly.
  • the relative reflection characteristic ratio of blood increases sharply, but the relative reflection characteristic ratio of melanin does not increase as much as the relative reflection characteristic ratio of blood. Therefore, when the images of the fundus taken at each of the two different wavelengths included in the first wavelength region Z1A are compared, it can be determined from FIG. 5 that the brightness values of the blood-derived portion, that is, the pixels related to the blood vessels are different.
  • the part derived from melanin that is, the part of the choroid other than the blood vessel (interstitium) is a pixel showing the part derived from melanin when comparing the images of the fundus taken at each of the two different wavelengths included in the first wavelength region Z1A.
  • the brightness values of melanin are different, it can be judged from FIG. 5 that the change is not as remarkable as in the case of blood.
  • the first and second wavelengths can be selected from any of 589 nm, 633 nm, 638 nm, 650 nm, 658 nm, 670 nm, 685 nm, 690 nm, 705 nm, 730 nm, 780 nm and 785 nm.
  • the products having the above wavelengths may be selected as the light source.
  • a wideband wavelength light source capable of emitting a laser having a wavelength of 680 ⁇ 10 nm can also be selected.
  • the second wavelength image taken by the second R light and the second wavelength image are acquired respectively.
  • the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image is subtracted from the brightness value of each pixel of the first wavelength image to obtain the blood vessels of the choroid (hereinafter abbreviated as "corrosion blood vessels").
  • corrosion blood vessels hereinafter abbreviated as "corrosion blood vessels"
  • the first wavelength and the second wavelength may be selected from the second wavelength region Z2A having a wavelength of 650 nm to 800 nm.
  • the relative reflection characteristic ratio of melanin increases monotonically, but the relative reflection characteristic ratio of blood is almost flat. Therefore, when comparing the images of the fundus taken at each of the different first wavelengths and the second wavelengths included in the second wavelength region Z2A, the pixels related to the melanin-derived portion, that is, the choroidal membrane portion (interstitium) other than the blood vessels. It can be determined from FIG. 5 that the brightness values of the above are different.
  • the blood-derived part that is, the choroidal blood vessel part, almost changes to the brightness value of the pixel showing the choroidal blood vessel when comparing the images of the fundus taken at each of the first wavelength and the second wavelength included in the second wavelength region Z2A. It can be determined from FIG. 5 that there is no such thing.
  • FIG. 6 is a flowchart showing image processing in the ophthalmic apparatus 110 according to the present embodiment.
  • the processing shown in FIG. 6 is performed by the control unit of the ophthalmic apparatus 110, for example, based on the imaging processing program and the image processing program stored in the memory 24.
  • the sole of the eye is irradiated with the first R light indicating the first wavelength from the light source 44A and the second R light indicating the second wavelength from the light source 44B under the control of the SLO light source control unit 1804 and the scanner control unit 1806.
  • the first wavelength image and the second wavelength image are acquired. If the SLO unit 40A has the configuration shown in FIG.
  • the first R light is emitted from the light source 44A and the second R light is emitted from the light source 44B at the same time, and the first wavelength image is obtained by the R1 photodetector 74A.
  • a second wavelength image can be acquired by the R2 photodetector element 74B.
  • FIG. 7A shows a second wavelength image
  • FIG. 7B shows a first wavelength image
  • the first wavelength is approximately 575 nm, which is the lower limit of the first wavelength region Z1A
  • the second wavelength is approximately 650 nm, which is the upper limit of the first wavelength region Z1A
  • the pixel showing the bifurcation point VBU2 of the retinal blood vessel is darker than the other parts in the first wavelength image.
  • the pixels showing the vortex veins 12V1A, 12V2A, 12V3A, 12V4A and the bifurcation point VBU1 of the retinal blood vessels are brighter in the second wavelength image than the other parts as shown in FIG. 7A.
  • the optic nerve heads ONHU1 and ONHU2 are photographed with high brightness (white in the drawing), but the optic nerve heads ONHU1 and ONHU2 are relative in the first wavelength region Z1A. Since the reflection characteristic ratio is high, it is bright in both cases of FIGS. 7A and 7B.
  • the pixels showing the choroidal blood vessels are different from those in FIGS. 7A and 7B, and the first wavelength image and the second wavelength image There is almost no change in brightness.
  • the relative reflection characteristic ratio of blood hemoglobin
  • the relative reflection characteristic ratio of melanin increases monotonically, so that the first wavelength is approximately 650 nm, which is the lower limit of the second wavelength region Z2A, and the second wavelength is the second wavelength.
  • the upper limit of the two-wavelength region Z2A is approximately 800 nm, the pixels showing the stromal portion other than the choroidal blood vessel containing a large amount of melanin become dark in the first wavelength image and bright in the second wavelength image.
  • step 202 the image processing unit 182 aligns the first wavelength image with the second wavelength image.
  • the procedure of step 202 is not always necessary, but the first wavelength image and the second wavelength image are acquired at different timings. In that case, alignment is required.
  • the alignment of the first wavelength image and the second wavelength image is multiple from the bifurcation points of the choroidal blood vessels and retinal blood vessels shown in FIGS. 7A and 7B, the characteristic vascular structure, or the structure of the fundus of the eye such as the optic nerve head.
  • a plurality of characteristic patterns of the above are extracted as feature points, and the first wavelength image and the second wavelength image are aligned so that the pixels of the extracted feature points match.
  • step 204 the image processing unit 182 subtracts the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image to create a difference image.
  • This difference image is also a choroidal blood vessel-enhanced image in which the choroidal blood vessel is emphasized.
  • FIG. 8 is an explanatory diagram showing the concept of creating a difference image between the first wavelength image and the second wavelength image. As shown in FIG. 8, a difference image is generated by subtracting the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image.
  • the result of subtracting the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image may be negative, but in such a case, it may be negative.
  • the absolute value of the result is taken as the brightness value of the difference image.
  • the first wavelength image and the second wavelength image are derived from blood. That is, the brightness values of the pixels related to the blood vessels (vortex veins 12V1A, 12V1B, 12V2A, 12V2B, 12V3A, 12V3B, 12V4A, 12V4B and the bifurcation points of the retinal blood vessels VBU1, VBU2) are different.
  • the difference in brightness of the pixels related to the blood vessels between the first wavelength image and the second wavelength image becomes large, and in the difference image, the pixels related to the vortex veins 12V1C, 12V2C, 12V3C, 12V4C and the bifurcation point VBU3 of the retinal blood vessels are bright. It is expressed (whitish).
  • the optic nerve papilla ONHU1 and ONHU2 are in the first wavelength image and the second wavelength image, respectively. It appears white, and the brightness values of the pixels related to the optic nerve papilla ONHU1 and ONHU2 in each of the first wavelength image and the second wavelength image are substantially the same, so that the brightness values of the pixels related to the optic nerve papilla ONHU3 in the difference image are approximately 0. .. Therefore, in the difference image, the pixels related to the optic disc ONHU3 are black as shown in FIG.
  • the blood-derived portion that is, the pixel related to the blood vessel.
  • the brightness value does not change much.
  • the difference in brightness between the pixels related to the blood vessels between the first wavelength image and the second wavelength image becomes small, and the pixels related to the blood vessels are expressed dark (blackish) in the difference image.
  • the first wavelength image and the second wavelength image show a part of the choroid other than the blood vessel containing a large amount of melanin (interstitium).
  • the brightness value of the pixel indicating) changes.
  • the difference in brightness between the first wavelength image and the second wavelength image of the pixels related to the choroidal part other than the blood vessels becomes large, and the pixels related to the choroidal part (interstitium) other than the blood vessels become brighter in the difference image (the difference image). It is expressed (whitish).
  • the image processing unit 182 generates a choroidal blood vessel image by binarizing the difference image.
  • the pixels showing the choroidal blood vessels have different luminance values from the pixels showing the portion (interstitium) other than the choroidal blood vessels. Therefore, a choroidal blood vessel image can be generated by binarizing the difference image with an appropriate threshold value.
  • the difference image since the choroidal blood vessel can be clearly distinguished from other parts in the difference image created in step 204, the difference image may be used as a choroidal blood vessel image.
  • step 208 the choroidal blood vessel image is output and the process is completed.
  • the display control unit 184 sets the choroidal blood vessel image and the patient attribute information (patient name, age, information from the right or left eye for each fundus image, axial length, visual acuity, and imaging date and time) corresponding to the patient ID. Etc.) is reflected in the display screen 500 described later. Then, the display screen 500 is displayed on the display 32 of the ophthalmic apparatus 110.
  • the output unit 186 outputs the display screen 500 to the 100 million device of the server 140.
  • the display screen 500 is stored in the billionaire device of the server 140.
  • the display screen 500 stored in the memory device of the server 140 is transmitted to the viewer 150 in response to an operation from the viewer 150, and is output to the display unit of the viewer 150 in a viewable state.
  • the process shown in FIG. 6 may be executed by the CPU included in the server 140.
  • the display image 500 is displayed on the display of the server 140, and the display image 500 is stored in the storage device of the server 140.
  • the process shown in FIG. 6 may be executed by the CPU included in the viewer 150.
  • the display image 500 is displayed on the display of the viewer 150, and the display image 500 is stored in the storage device of the viewer 150 and the storage device of the server 140, respectively.
  • FIG. 9 is a schematic view showing a display screen 500 displayed on the display 32 of the ophthalmic device 110.
  • the display screen 500 has an information display area 502 and an image display area 504.
  • the information display area 502 includes a patient ID display area 512, a patient name display area 514, an age display area 516, a right eye / left eye display area 518, an axial length display area 520, a visual acuity display area 522, and an imaging date / time display area. It has 524.
  • the viewer 150 displays each information from the patient ID display area 512 to each display area of the imaging date / time display area 524 based on the received information.
  • the information display area 502 is provided with an image selection icon 530 and a display switching icon 640.
  • the image display area 504 has a choroidal blood vessel image display area 550 and a related image display area 560.
  • a choroidal blood vessel image is displayed in the choroidal blood vessel image display area 550.
  • the choroidal blood vessel image display area 550 is provided with a slide bar 580 that changes the contrast of the image below the displayed choroidal blood vessel image. By operating the slide bar 580 left and right, the clarity of the pixels of the choroidal blood vessels can be arbitrarily adjusted.
  • the pull-down menu 570 is displayed.
  • the pull-down menu 570 displayed with the image selection icon 530 turned on has a menu for selecting a related image to be displayed in the related image display area 560.
  • the pseudo-color (RGB3 color) image, RG color image, blue monochromatic image, green monochromatic image, red (first R light) monochromatic image, and red (first R light) monochromatic image of the fundus of the eye 12 to be inspected have already been acquired.
  • Second R light A monochromatic image, a difference image which is a choroidal blood vessel image, and the like are displayed.
  • FIG. 9 shows how a pseudo-color image is displayed in the related image display area 560.
  • a difference image which is a choroidal blood vessel image
  • the choroidal blood vessel image is displayed in the choroidal blood vessel image display area 550 and the related image display area 560, respectively.
  • the left-right positional relationship between the choroidal blood vessel image display area 550 and the related image display area 560 is reversed.
  • the choroidal blood vessel image display area 550 is displayed on the left side of the image display area 504, and the related image display area 560 is displayed on the right side of the image display area 504.
  • the choroidal blood vessel image display area 550 is displayed on the right side of the area 504, and the related image display area 560 is displayed on the left side of the image display area 504.
  • the brightness value of each pixel of the first wavelength image captured by the first R light of the first wavelength is photographed by the second R light of the second wavelength different from the first wavelength. It is possible to obtain a difference image in which the choroidal blood vessels are emphasized by subtracting the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image. By further binarizing this difference image, a choroidal blood vessel image existing in the layer of the choroid can be generated. By processing the choroidal blood vessel image, it is possible to obtain data on the choroidal vascular network consisting of the thickness and length of the choroidal blood vessel, and to perform image processing such as identifying the position of the vortex vein existing in the choroid. become.
  • the choroid contains melanin, which has a relative reflex characteristic rate similar to that of hemoglobin derived from blood, images taken with light of a single wavelength contain noise due to melanin.
  • attention is paid to the difference in the relative reflection characteristic ratios of blood (hemoglobin) and melanin for two lights having different wavelengths in the wavelength range showing red, and the fundus image taken with the two lights.
  • choroidal blood vessel congestion thickening of the choroidal blood vessel when congested
  • asymmetry of the position of the vortex vein which are considered to be a sign of fundus disease
  • the image data of the macula is selectively extracted from the fundus structures.
  • FIG. 10 is a schematic view showing an ophthalmic apparatus 610 according to the present embodiment. Since the ophthalmic apparatus 610 according to the present embodiment is the same as the ophthalmic apparatus 110 according to the first embodiment except for the above-described configuration, the ophthalmic apparatus has the same configuration as the ophthalmic apparatus 110 according to the first embodiment. The same reference numerals as 110 are given, and detailed description thereof will be omitted.
  • the SLO unit 40B of the ophthalmic apparatus 610 has a light source 42A of the first G light (green light: wavelength 440 nm to 560 nm) and a second G light (green light: wavelength 440 nm to 560 nm) having a wavelength different from that of the first G light. 42B, a light source 44 for R light (red light: wavelength 650 nm), and a light source 46 for IR light (infrared light (near infrared light): wavelength 800 nm).
  • the on / off of the light sources 42A, 42B, 44, and 46 is controlled by the SLO light source control unit 1804 of the SLO control unit 180 of the CPU 22.
  • the SLO unit 40B of the ophthalmic apparatus 610 reflects or transmits light from the light sources 42A, 42B, 44, 46 and guides the light to one optical path 50A, 50B, 52, 54, It has 56.
  • the optical systems 50A and 56 are mirrors.
  • the optical systems 50B, 52, and 54 are beam splitters, specifically, dichroic mirrors, half mirrors, and the like whose reflectance and transmittance are adjusted according to the wavelength of the light source.
  • the first G light is reflected by the optical system 50A and then transmitted through the optical system 50B and further reflected by the optical system 54, and the second G light is reflected by the optical system 50B and then reflected by the optical system 54.
  • the light passes through the optical systems 52 and 54, and the IR light is reflected by the optical systems 52 and 56 and guided to one optical path, respectively.
  • the SLO unit 40B includes a beam splitter 58A that reflects the first G light and transmits other than the first G light among the light from the rear eye portion (fundus) of the eye 12 to be inspected.
  • the SLO unit 40B includes a beam splitter 58B that reflects the second G light and transmits other than the second G light among the light transmitted through the beam splitter 58A.
  • the SLO unit 40B includes a beam splitter 60 that reflects R light and transmits other than R light among the light transmitted through the beam splitter 58B.
  • the SLO unit 40B includes a beam splitter 62 that reflects IR light among the light transmitted through the beam splitter 60.
  • a dichroic mirror, a half mirror, or the like can be used as the beam splitters 58A, 58B, 60, 62.
  • the SLO unit 40B receives the G1 light detection element 72A that detects the first G light reflected by the beam splitter 58A, the G2 light detection element 72B that detects the second G light reflected by the beam splitter 58B, and the R light reflected by the beam splitter 60.
  • the R light detecting element 74 for detecting and the IR light detecting element 76 for detecting the IR light reflected by the beam splitter 62 are provided.
  • Examples of the photodetector elements 72A, 72B, 74, 76 include APD.
  • the photodetector elements 72A, 72B, 74, 76 correspond to the "acquisition unit" of the technique of the present disclosure.
  • FIG. 11 is an explanatory diagram illustrating the absorption spectra of chlorophyll a, chlorophyll b, ⁇ -carotene, and lutein for each wavelength. Since the macula, which is a fundus structure, mainly contains lutein, in the present embodiment, two wavelengths that cause a difference in the absorption spectrum of lutein are selected. As shown in FIG. 11, lutein shows a remarkable absorption spectrum in the first wavelength region Z1B having a wavelength of 440 nm to 520 nm, and a change in the absorption spectrum is particularly remarkable in a wavelength of 450 nm to 488 nm. The absorption spectrum of lutein is substantially 0 in the second wavelength region Z2B having a wavelength of 520 nm to 560 nm.
  • the first wavelength is selected from the first wavelength region Z1B corresponding to green visible light having a wavelength of 440 nm to 520 nm
  • the second wavelength corresponding to green visible light is selected from the second wavelength region Z2B corresponding to wavelength 520 nm to 560 nm.
  • the fundus structure contains blood-derived hemoglobin pigments, it is necessary to select a wavelength at which these pigments do not interfere with the detection of lutein.
  • the present embodiment also has a second wavelength different from the first wavelength based on the brightness value of each pixel of the first wavelength image captured by the first G light of the first wavelength.
  • hemoglobin becomes an inhibitory factor, so it is necessary to be able to cancel when the difference between the first wavelength image and the second wavelength image is generated. For example, if the brightness values of the pixels related to hemoglobin are the same in the first wavelength image and the second wavelength image, the difference image generated from the first wavelength image and the second wavelength image of the pixels related to hemoglobin. The brightness value is 0.
  • the first wavelength and the second wavelength may be selected from the wavelength range of 450 nm to 488 nm in which the change in the absorption spectrum of lutein with respect to the wavelength is remarkable.
  • FIG. 12 is a flowchart showing image processing in the ophthalmic apparatus 610 according to the present embodiment.
  • the processing shown in FIG. 12 is performed by the control unit of the ophthalmic apparatus 110 based on the photographing processing program and the image processing program stored in the memory 24.
  • step 300 the sole of the eye is irradiated with the first G light indicating the first wavelength from the light source 42A and the second G light indicating the second wavelength from the light source 42B under the control of the SLO light source control unit 1804 and the scanner control unit 1806.
  • the first wavelength image and the second wavelength image are acquired. If the SLO unit 40B has the configuration shown in FIG.
  • the first G light is emitted from the light source 42A and the second G light is emitted from the light source 42B at the same time, and the first wavelength image is obtained by the G1 photodetector 72A.
  • a second wavelength image can be acquired by the G2 photodetector 72B.
  • the image processing unit 182 aligns the first wavelength image with the second wavelength image.
  • the procedure of step 302 is not always necessary, but the first wavelength image and the second wavelength image are acquired at different timings. In some cases, alignment may be required.
  • the alignment of the first wavelength image and the second wavelength image is performed by extracting a plurality of feature points such as the bifurcation point VBU of the retinal blood vessel and the optic nerve head shown in each of FIG. 13, so that the extracted feature points match.
  • the first wavelength image and the second wavelength image are aligned with each other.
  • step 304 the image processing unit 182 subtracts the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image to create a difference image.
  • FIG. 13 is an explanatory diagram showing the concept of creating a difference image between the first wavelength image and the second wavelength image. As shown in FIG. 13, a difference image is generated by subtracting the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image.
  • the result of subtracting the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image from the brightness value of each pixel of the first wavelength image may be negative, but in such a case, it may be negative.
  • the absolute value of the result is taken as the brightness value of the difference image.
  • the relative reflection characteristic ratio of hemoglobin does not change so much with respect to the wavelength.
  • Both the first wavelength image and the second wavelength image are captured with the same brightness. Since the optic discs ONHU4 and ONHU5 reflect blue light and green light well, they are photographed with bright and high brightness in both the first wavelength image and the second wavelength image.
  • the absorption spectrum of the macula MAC1 changes in the wavelength range of 440 nm to 560 nm. Therefore, when the first wavelength image and the second wavelength image are compared, the brightness values of the pixels showing the macula MAC1 are different. .. Therefore, in the difference image between the first wavelength image and the second wavelength image, the brightness values of the pixels related to the bifurcation points VBU4, VBU5 of the retinal blood vessels, the optic disc ONHU4, ONHU5, etc. are smaller, but the brightness of the pixels related to the macula MAC1. The value becomes large, and the macula MAC2 is remarkably brightly depicted in the difference image.
  • the image processing unit 182 generates a macula image in which the macula is emphasized by binarizing the difference image. Further, in the difference image, the pixel showing the macula MAC2 has a different luminance value from the pixel showing the portion other than the macula MAC2. Therefore, the image data of the macula MAC2 (image data of a predetermined region including the macula MAC2) can be extracted by a process such as extracting the contour of the macula MAC2 based on the brightness difference.
  • the difference image may be extracted as a macula image-enhanced image.
  • the position data of the macula (coordinates on the image, etc.) may be detected from the difference image or the macula-enhanced image.
  • the macula portion may be extracted from the difference image, and an image superimposed on the macula position of the first wavelength image or the second wavelength image may be generated as the macula image.
  • step 308 the macula-enhanced image (or including the partial image of the macula region and the position data of the macula) is output to end the process.
  • the display control unit 184 generates a display screen 600, which will be described later, that reflects the patient attribute information corresponding to the patient ID together with the macula-enhanced image. Then, the display screen 600 is displayed on the display 32 of the ophthalmic apparatus 610.
  • the output unit 186 outputs the display screen 600 to the 100 million device of the server 140.
  • the display image 600 is stored in the storage device of the server.
  • the display screen 600 stored in the memory device of the server 140 is transmitted to the viewer 150 in response to an operation from the viewer 150, and is output to the display unit of the viewer 150 in a viewable state.
  • the process shown in FIG. 12 may be executed by the CPU included in the server 140.
  • the display image 600 is displayed on the display of the server 140, and the display image 600 is stored in the storage device of the server 140.
  • the process shown in FIG. 12 may be executed by the CPU included in the viewer 150.
  • the display image 600 is displayed on the display of the viewer 150, and the display image 600 is stored in the storage device of the viewer 150 and the storage device of the server 140, respectively.
  • FIG. 14 is a schematic view illustrating a display screen 600 displayed on the display unit of the viewer 150.
  • the display screen 600 has an information display area 602 and an image display area 604.
  • the information display area 602 includes a patient ID display area 612, a patient name display area 614, an age display area 616, a right eye / left eye display area 618, an axial length display area 620, a visual acuity display area 622, and an imaging date / time display area. It has 624.
  • the viewer 150 displays each information from the patient ID display area 612 to each display area of the imaging date / time display area 624 based on the received information.
  • the information display area 602 is provided with an image selection icon 630 and a display switching icon 640.
  • the image display area 604 has a macula image display area 650 and a related image display area 660.
  • a macula-enhanced image is displayed in the macula image display area 650.
  • the macula-enhanced image may be the above-mentioned difference image, but in the difference image, the fundus structure other than the macula is depicted in black and it is difficult to distinguish each of them.
  • An image superimposed on the macula position of the two-wave image may be displayed.
  • a pull-down menu or the like for selecting a related image to be displayed in the related image display area 660 is displayed.
  • the pseudo-color (RGB3 color) image, RG color image, blue monochromatic image, green (1st G light) monochromatic image, and green (2nd G light) of the fundus of the eye to be inspected 12 that have already been acquired are displayed.
  • OCTA optical interference tomographic angiography
  • macula-enhanced image or difference image, the macula part was extracted from the difference image and superimposed on the macula position of the first wavelength image or the second wavelength image.
  • FIG. 14 shows how the foveal avascular field (FAZ) by OCTA is displayed in the related image display area 660.
  • FAZ foveal avascular field
  • the display switching icon 640 When the display switching icon 640 is turned on, for example, the left-right positional relationship between the macula image display area 650 and the related image display area 660 is reversed. In the default display, the macula image display area 650 is displayed on the left side of the image display area 604, and the related image display area 660 is displayed on the right side of the image display area 604. When the display switching icon 640 is turned on, the image display area is displayed. The macula image display area 650 is displayed on the right side of the 604, and the related image display area 660 is displayed on the left side of the image display area 604.
  • the brightness value of each pixel of the first wavelength image captured by the first G light of the first wavelength is photographed by the second G light of the second wavelength different from the first wavelength.
  • the image data of the yellow spot MAC2 existing in the fundus is selectively extracted. can do.
  • the position data of the macula can be accurately detected from the macula-enhanced image.
  • hemoglobin which is an inhibitory factor in detecting macula MAC2
  • hemoglobin which is an inhibitory factor in detecting macula MAC2
  • the image data of the macula MAC2 is generated by generating a difference image in which the difference in the brightness value of each pixel of the fundus image taken with the two lights is used as the brightness value of each pixel. Is selectively extracted.
  • the ophthalmologist can estimate the fundus disease from the state of macular MAC2.
  • the ophthalmic apparatus according to the present embodiment is the same as the ophthalmic apparatus 110 according to the first embodiment, the first wavelength image captured by the first R light of the first wavelength and the second wavelength different from the first wavelength.
  • the second wavelength image taken by the second R light of the above and the second wavelength image are acquired. Therefore, since the ophthalmic apparatus according to the present embodiment has the same configuration as the ophthalmic apparatus according to the first embodiment, each configuration is designated by the same reference numeral as that of the first embodiment, and detailed description thereof will be given. Omit.
  • FIG. 15 is an explanatory diagram showing common logarithmic values of the absorption spectra of oxygenated hemoglobin (HbO 2) and deoxygenated hemoglobin (Hb) for each wavelength.
  • HbO 2 oxygenated hemoglobin
  • Hb deoxygenated hemoglobin
  • FIG. 15 in the wavelength range of 635 nm to 802 nm, the absorption spectrum of oxygenated hemoglobin changes remarkably (from about 2.5 on the scale of the vertical axis of the logarithm on the left side of the graph to about 2.0, which is the minimum value, and then. Has changed to about 2.5), but the absorption spectrum of deoxygenated hemoglobin has gradually decreased (changed from about 3.3 to about 2.5 on the scale on the vertical axis on the right side of the graph).
  • the second wavelength image taken by the second R light of two wavelengths and the second wavelength image are acquired respectively.
  • the first wavelength image and the second wavelength image are as in the first embodiment and the second embodiment. Since the difference image is generated, the difference between the first wavelength image and the second wavelength image due to the difference from the absorption spectrum of oxygenated hemoglobin cannot be visualized.
  • a quotient obtained by dividing the brightness value of each pixel of the first wavelength image by the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image is commonly used. A divided image is created in which the logarithmic value is the brightness value of each pixel.
  • FIG. 16 is a flowchart illustrating image processing in the ophthalmic apparatus 110 according to the present embodiment.
  • the processing shown in FIG. 16 is performed by the control unit of the ophthalmic apparatus 110, for example, based on the imaging processing program and the image processing program stored in the memory 24.
  • the sole of the eye is irradiated with the first R light indicating the first wavelength from the light source 44A and the second R light indicating the second wavelength from the light source 44B under the control of the SLO light source control unit 1804 and the scanner control unit 1806.
  • the first wavelength image and the second wavelength image are acquired.
  • the first wavelength and the second wavelength are different from each other and are selected from the wavelength range of 635 nm to 802 nm.
  • the SLO unit 40A has the configuration shown in FIG. 2, the first R light is emitted from the light source 44A and the second R light is emitted from the light source 44B at the same time, and the first wavelength image is obtained by the R1 photodetector 74A.
  • a second wavelength image can be acquired by the R2 photodetector element 74B.
  • the image processing unit 182 aligns the first wavelength image and the second wavelength image.
  • the procedure of step 402 is not always necessary, but the first wavelength image and the second wavelength image are acquired at different timings. In some cases, alignment may be required.
  • a plurality of branches of the choroidal blood vessels shown in each of FIG. 17 are extracted as feature points, and the first wavelength is aligned so that the extracted feature points match. Align the image with the second wavelength image.
  • step 404 the image processing unit 182 divides the brightness value of each pixel of the first wavelength image by the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image. Create a divided image with the numerical value as the brightness value of each pixel.
  • FIG. 17 is an explanatory diagram showing the concept of creating a division image of the first wavelength image and the second wavelength image. As shown in FIG. 17, the common logarithm of the quotient obtained by dividing the brightness value of each pixel of the first wavelength image by the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image is calculated. By doing so, a divided image is generated. In step 404, the calculated common logarithmic value may be negative, but in such a case, the absolute value of the result is used as the brightness value of the divided image.
  • the absorption spectrum of deoxygenated hemoglobin is relative to the absorption spectrum of oxygenated hemoglobin. It doesn't change much. Therefore, choroidal vascular veins with high concentrations of deoxidized hemoglobin, vortex veins 12V1D, 12V1E, 12V2D, 12V2E, 12V3D, 12V3E, 12V4D, 12V4E, and retinal vascular branching located at the confluence of multiple choroidal vascular veins.
  • the quotient of the pixels of the first wavelength image related to the veins of the points VBU7 and VBU8 and the pixels of the second wavelength image corresponding to the first wavelength image is a value close to 1. Since the common logarithmic value close to 1 is close to 0, in the divided image, the veins of choroidal vessels with high concentration of deoxidized hemoglobin, vortex veins 12V1F, 12V2F, 12V3F, 12V4F, and fundus structures of veins of retinal vessels.
  • the branch point VBU9 is depicted with a lower brightness value (blackish) than the background.
  • the absorption spectrum of oxygenated hemoglobin changes remarkably in the wavelength range of 635 nm to 802 nm. Therefore, the pixels of the first wavelength image relating to the arterial portion of the arteries 12A1D, 12A2D and the bifurcation point VBU7 of the retinal blood vessels having a high concentration of oxygenated hemoglobin, and the arteries 12A1E, 12A2E and the bifurcation of the retinal blood vessels corresponding to the first wavelength image.
  • the quotient with the pixel of the second wavelength image relating to the arterial portion of the point VBU8 and the like does not become a value close to 1.
  • fundus structures such as arteries 12A1F and 12A2F having a high concentration of oxygenated hemoglobin and the arterial portion of the bifurcation point VBU9 of the retinal blood vessel are depicted with high brightness values (whitish).
  • the background area does not change (because there is no hemoglobin)
  • the arteries change in the positive direction where the brightness value increases
  • the veins change in the minus direction where the brightness value decreases. Change in direction.
  • pixel values In the blood vessel image, when the background pixel value is neutral and the relative brightness value is 0, the relative value of the brightness of the arterial portion is positive and the relative value of the brightness of the vein portion is negative.
  • the image processing unit 182 generates an arterial blood vessel image or a venous blood vessel image as arterial / venous data.
  • the brightness values of the pixels related to the arteries 12A1F and 12A2F of the choroidal blood vessels and the arteries of the retinal blood vessels and the pixels related to the veins of the choroidal blood vessels, the vortex veins 12V1F, 12V2F, 12V3F, 12V4F, etc. different. Therefore, by applying the first threshold value (the pixel value larger than the background pixel value is set as the first threshold value) to the brightness value of the divided image, an arterial blood vessel image consisting of arteries 12A1F, 12A2F, etc.
  • a second threshold value (a key pixel value smaller than the background pixel value is set as the second threshold value)
  • choroidal vascular veins, vortex veins 12V1F, 12V2F, 12V3F, 12V4F It is possible to generate a venous vascular image consisting of veins of retinal blood vessels and the like. That is, veins and arteries can be separated from the fundus image.
  • the pixels related to the arteries 12A1F, 12A2F, etc. have higher brightness values than the pixels related to the veins, vortex veins 12V1F, 12V2F, 12V3F, 12V4F, etc. Is extracted, and an arterial image is created by filling an image area other than the extracted pixels with pixels having a lower brightness value than the extracted pixels.
  • the pixels related to veins, vortex veins 12V1F, 12V2F, 12V3F, 12V4F, etc. have lower brightness values than the pixels related to arteries 12A1F, 12A2F, etc., so that the brightness value is less than the second threshold value.
  • a vein image is created by extracting the pixels of the above and filling the image area other than the extracted pixels with pixels having a higher brightness value than the extracted pixels.
  • the first threshold value and the second threshold value may be the same value or different values from each other.
  • the threshold value for extracting the artery / vein data is determined based on the brightness values of the pixels related to the arteries 12A1F, 12A2F, etc. in the divided image and the brightness values of the pixels related to the vortex veins 12V1F, 12V2F, 12V3F, 12V4F, etc. You may. For example, the intermediate value between the brightness value of the pixel related to the artery 12A1F, 12A2F, etc. and the brightness value of the pixel related to the vortex vein 12V1F, 12V2F, 12V3F, 12V4F, etc. may be set as the threshold value.
  • the image processing unit 182 detects the positions of the vortex veins 12V1H, 12V2H, 12V3H, and 12V4H by image processing the venous blood vessel image.
  • the venous blood vessel image visualizes the venous blood vessels of the choroidal blood vessels.
  • the vortex vein is where multiple venous vessels in the choroid meet. Since the vortex vein is a blood vessel corresponding to the outlet where the blood perfused with the choroid flows out of the eyeball, it is also the part where the most oxygen-consumed blood is concentrated.
  • the concentration of deoxygenated hemoglobin (Hb) is higher than that of other venous blood vessels, and the pixel value of the vortex vein position in the venous blood vessel image is darker than the pixel value of other venous blood vessels. Therefore, the darkest pixel value or the darker pixel value than the average pixel value of the venous blood vessel can be estimated as the vortex vein position.
  • the position of the vortex vein may be detected in consideration of the fact that a plurality of venous blood vessels of the choroid are confluent. In this way, the positions of the vortex veins 12V1H, 12V2H, 12V3H, and 12V4H can be detected.
  • step 410 the choroidal blood vessel image including the division image, the arterial blood vessel image, and the venous blood vessel image and the vortex vein position data are output to end the process.
  • the display control unit 184 generates a display screen 700, which will be described later, which reflects the patient attribute information corresponding to the patient ID together with the choroidal blood vessel image and the like. Then, the display screen 700 is displayed on the display 32 of the ophthalmic apparatus 110.
  • the output unit 186 outputs the display screen 700 to the 100 million device of the server 140.
  • the display screen 700 is stored in the memory device of the server 140.
  • the display screen 700 stored in the memory device of the server 140 is transmitted to the viewer 150 in response to an operation from the viewer 150, and is output to the display unit of the viewer 150 in a viewable state.
  • the process shown in FIG. 16 may be executed by the CPU included in the server 140.
  • the display image 700 is displayed on the display of the server 140, and the display image 700 is stored in the storage device of the server 140.
  • the process shown in FIG. 16 may be executed by the CPU included in the viewer 150.
  • the display image 700 is displayed on the display of the viewer 150, and the display image 700 is stored in the storage device of the viewer 150 and the storage device of the server 140, respectively.
  • FIG. 18 is a schematic view illustrating a display screen 700 displayed on the display unit of the viewer 150.
  • the display screen 700 has an information display area 702 and an image display area 704.
  • the information display area 702 includes a patient ID display area 712, a patient name display area 714, an age display area 716, a right eye / left eye display area 718, an axial length display area 720, a visual acuity display area 722, and an imaging date / time display area. It has 724.
  • the viewer 150 displays each information from the patient ID display area 712 to each display area of the imaging date / time display area 724 based on the received information.
  • the information display area 702 is provided with an image selection icon 730 and a display switching icon 740.
  • the image display area 704 has a related image display area 750, an arterial image display area 760, and a vein image display area 770.
  • An arterial image is displayed in the arterial image display area 760.
  • a vein image is displayed in the vein image display area 770.
  • the arterial image shows the arterial portion of the arteries 12A1G, 12A2G and the branch point VBU10 of the retinal blood vessel
  • the vein image shows the vortex vein 12V1H, 12V2H, 12V3H, 12V4H, and the branch point VBU11 of the retinal blood vessel.
  • the vein part and the like of are displayed respectively.
  • the arterial image shows the optic disc ONHU10
  • the vein image shows the optic disc ONHU11.
  • a pull-down menu or the like for selecting a related image to be displayed in the related image display area 750 is displayed.
  • the pseudo-color (RGB3 color) image, RG color image, blue monochromatic image, green monochromatic image, red (first R light) monochromatic image, and red of the fundus of the eye to be inspected 12 that have already been acquired are displayed.
  • (2nd R light) A monochromatic image, a division image, etc. are displayed.
  • the red (first R light) monochromatic image and the red (second R light) monochromatic image are the original images used when generating the division image.
  • FIG. 18 shows how a red (first R light) monochromatic image, which is the original image, is displayed in the related image display area 750.
  • the display switching icon 640 When the display switching icon 640 is turned on, for example, the left-right positional relationship between the related image display area 750, the arterial image display area 760, and the vein image display area 770 changes.
  • the related image display area 750 is displayed on the left side of the image display area 704
  • the arterial image display area 760 is displayed in the center of the image display area 704
  • the vein image display area 770 is displayed on the right side of the image display area 704.
  • the display switching icon 740 When the display switching icon 740 is turned on, for example, the arterial image display area 760 is on the left side of the image display area 704, the vein image display area 770 is in the center of the image display area 704, and the related image is on the right side of the image display area 704.
  • Each display area 750 is displayed.
  • the brightness value of each pixel of the first wavelength image captured by the first R light of the first wavelength is photographed by the second R light of the second wavelength different from the first wavelength.
  • a divided image is created in which the common logarithmic value of the quotient obtained by dividing by the brightness value of each pixel corresponding to the first wavelength image of the second wavelength image is the brightness value of each pixel, and exists in the fundus of the eye.
  • the absorption spectrum of oxygenated hemoglobin changes remarkably, but the absorption spectrum of deoxidized hemoglobin does not change so much.
  • the arterial and vein can be clearly distinguished by the divided image in which the common logarithmic value of the quotient obtained by dividing by the brightness value of each pixel corresponding to the first wavelength image of is used as the brightness value of each pixel. ..
  • FIG. 19 is a block diagram of the SLO unit 40C of the ophthalmic apparatus of this modified example.
  • the SLO unit 40C has a light source unit 160 having a multi-wavelength light source 162, a first wavelength light detection element 164A that receives light of the first wavelength, and a second wavelength light that detects light of the second wavelength.
  • the ophthalmic apparatus 110 according to the first embodiment, the ophthalmic apparatus 610 according to the second embodiment, and the ophthalmic apparatus 110 according to the third embodiment are provided with a light receiving unit 164 having a light detection element 164B. It's different.
  • the multi-wavelength light source 162 is a light emitting device such as an SLD (Super Luminescent Diode) capable of emitting a laser having a wavelength of 440 nm to 802 nm.
  • SLD Super Luminescent Diode
  • the SLO unit 40C includes optical systems 170, 172, 174, 176, and 178 that reflect or transmit light from the multi-wavelength light source 162 and guide it to an optical path.
  • the optical systems 172 and 176 are scanners, specifically mirrors, dichroic mirrors, half mirrors and the like.
  • the optical system 170 is a beam splitter, specifically, a dichroic mirror, a half mirror, or the like.
  • the optical systems 174 and 178 are lenses.
  • the light from the multi-wavelength light source 162 passes through the optical system 170, is reflected by the optical system 172, is condensed by the optical system 174, is reflected by the optical system 176, and is reflected by the optical system 178. Guided to the fundus).
  • Each of the optical system 172 and the optical system 176 is movable by an actuator or the like so as to guide the light from the multi-wavelength light source 162 to the fundus of the eye 12 to be inspected.
  • the light reflected by the fundus of the eye 12 to be inspected passes through the optical system 178, is reflected by the optical system 176, is reflected by the optical system 172, is reflected by the optical system 170, and is guided to the light receiving unit 164.
  • the light guided to the light receiving unit 164 is separated into light of the first wavelength and light of the second wavelength by the beam splitter 164C, and the light of the first wavelength is received by the light detection element 164A for the first wavelength and is second. The light of the wavelength is received by the light detection element 164B for the second wavelength.
  • the optical system of the SLO unit 40C can be simplified and the ophthalmic apparatus can be made compact. ..
  • image processing by a software configuration using a computer is assumed, but the technique of the present disclosure is not limited to this.
  • the image processing may be executed only by a hardware configuration such as FPGA (Field-Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). Some of the image processing may be performed by the software configuration and the rest may be performed by the hardware configuration.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)
PCT/JP2019/035727 2019-09-11 2019-09-11 画像処理装置、画像処理方法、及び画像処理プログラム Ceased WO2021048954A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2021545035A JPWO2021048954A1 (https=) 2019-09-11 2019-09-11
PCT/JP2019/035727 WO2021048954A1 (ja) 2019-09-11 2019-09-11 画像処理装置、画像処理方法、及び画像処理プログラム
JP2023214958A JP2024041773A (ja) 2019-09-11 2023-12-20 画像処理装置、眼科装置、画像処理方法、及び画像処理プログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/035727 WO2021048954A1 (ja) 2019-09-11 2019-09-11 画像処理装置、画像処理方法、及び画像処理プログラム

Publications (1)

Publication Number Publication Date
WO2021048954A1 true WO2021048954A1 (ja) 2021-03-18

Family

ID=74866261

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/035727 Ceased WO2021048954A1 (ja) 2019-09-11 2019-09-11 画像処理装置、画像処理方法、及び画像処理プログラム

Country Status (2)

Country Link
JP (2) JPWO2021048954A1 (https=)
WO (1) WO2021048954A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023143591A (ja) * 2022-03-23 2023-10-06 國立中正大學 眼底画像における動脈及び静脈を識別する方法
JP2024041773A (ja) * 2019-09-11 2024-03-27 株式会社ニコン 画像処理装置、眼科装置、画像処理方法、及び画像処理プログラム

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63238843A (ja) * 1987-03-27 1988-10-04 興和株式会社 眼科診断方法及び装置
JPH02295539A (ja) * 1989-05-08 1990-12-06 Kowa Co 眼底血管識別方法及び装置
JPH0871045A (ja) * 1994-09-02 1996-03-19 Canon Inc 眼底検査装置
US20060134004A1 (en) * 2004-12-21 2006-06-22 The University Of Utah Methods and apparatus for detection of carotenoids in macular tissue
JP2007330558A (ja) * 2006-06-15 2007-12-27 Topcon Corp 分光眼底測定装置及びその測定方法
JP2008142297A (ja) * 2006-12-11 2008-06-26 Kyushu Univ 異方性ノイズを除去するためのプログラムと異方性ノイズ除去方法
JP2010172615A (ja) * 2009-01-30 2010-08-12 Topcon Corp 機能イメージング眼科装置
JP2010233916A (ja) * 2009-03-31 2010-10-21 Chiba Univ 眼底画像処理装置及び眼底画像処理プログラム並びに眼底画像処理方法
JP2014504938A (ja) * 2011-02-09 2014-02-27 テル ハショマー メディカル リサーチ インフラストラクチャー アンド サーヴィシーズ リミテッド 血液を含む組織の画像形成方法と装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021048954A1 (ja) * 2019-09-11 2021-03-18 株式会社ニコン 画像処理装置、画像処理方法、及び画像処理プログラム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63238843A (ja) * 1987-03-27 1988-10-04 興和株式会社 眼科診断方法及び装置
JPH02295539A (ja) * 1989-05-08 1990-12-06 Kowa Co 眼底血管識別方法及び装置
JPH0871045A (ja) * 1994-09-02 1996-03-19 Canon Inc 眼底検査装置
US20060134004A1 (en) * 2004-12-21 2006-06-22 The University Of Utah Methods and apparatus for detection of carotenoids in macular tissue
JP2007330558A (ja) * 2006-06-15 2007-12-27 Topcon Corp 分光眼底測定装置及びその測定方法
JP2008142297A (ja) * 2006-12-11 2008-06-26 Kyushu Univ 異方性ノイズを除去するためのプログラムと異方性ノイズ除去方法
JP2010172615A (ja) * 2009-01-30 2010-08-12 Topcon Corp 機能イメージング眼科装置
JP2010233916A (ja) * 2009-03-31 2010-10-21 Chiba Univ 眼底画像処理装置及び眼底画像処理プログラム並びに眼底画像処理方法
JP2014504938A (ja) * 2011-02-09 2014-02-27 テル ハショマー メディカル リサーチ インフラストラクチャー アンド サーヴィシーズ リミテッド 血液を含む組織の画像形成方法と装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024041773A (ja) * 2019-09-11 2024-03-27 株式会社ニコン 画像処理装置、眼科装置、画像処理方法、及び画像処理プログラム
JP2023143591A (ja) * 2022-03-23 2023-10-06 國立中正大學 眼底画像における動脈及び静脈を識別する方法
JP7436066B2 (ja) 2022-03-23 2024-02-21 國立中正大學 眼底画像における動脈及び静脈を識別する方法

Also Published As

Publication number Publication date
JPWO2021048954A1 (https=) 2021-03-18
JP2024041773A (ja) 2024-03-27

Similar Documents

Publication Publication Date Title
JP6321430B2 (ja) 眼科装置
JP6080128B2 (ja) 眼科撮影装置およびこれに装着可能な光学ユニット
US20250371674A1 (en) Image processing method, image processing device, and image processing program
US11871991B2 (en) Image processing method, program, and image processing device
JP2024041773A (ja) 画像処理装置、眼科装置、画像処理方法、及び画像処理プログラム
JP6585897B2 (ja) 眼科撮影装置
WO2017069019A1 (ja) 血流計測装置
WO2018135175A1 (ja) 眼科装置
JP7314020B2 (ja) 撮影装置、撮影装置の制御方法、及びプログラム
JP7181135B2 (ja) 眼科装置
JP7096116B2 (ja) 血流計測装置
JP2019054994A (ja) 眼科撮影装置、眼科情報処理装置、プログラム、及び記録媒体
WO2021074960A1 (ja) 画像処理方法、画像処理装置、及び画像処理プログラム
JP7715186B2 (ja) 画像処理方法、画像処理装置、及びプログラム
WO2019150862A1 (ja) 血流計測装置
JP7419946B2 (ja) 画像処理方法、画像処理装置、及び画像処理プログラム
JP2017202369A (ja) 眼科画像処理装置
JP2019058493A (ja) レーザ治療装置、眼科情報処理装置、及び眼科システム
JP6761519B2 (ja) 眼科撮影装置
JP2020049112A (ja) 血管解析装置
JP7221628B2 (ja) 血流計測装置、情報処理装置、情報処理方法、及びプログラム
US12051197B2 (en) Image processing method, image display method, image processing device, image display device, image processing program, and image display program
JP7281906B2 (ja) 眼科装置、その制御方法、プログラム、及び記録媒体
JP2019154987A (ja) 眼科装置、その制御方法、プログラム、及び記録媒体
JP2019054990A (ja) 眼科撮影装置、その制御方法、プログラム、及び記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19945101

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021545035

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19945101

Country of ref document: EP

Kind code of ref document: A1