WO2017104949A1 - Microscope confocal et procédé de traitement d'images utilisant un tel microscope - Google Patents

Microscope confocal et procédé de traitement d'images utilisant un tel microscope Download PDF

Info

Publication number
WO2017104949A1
WO2017104949A1 PCT/KR2016/010818 KR2016010818W WO2017104949A1 WO 2017104949 A1 WO2017104949 A1 WO 2017104949A1 KR 2016010818 W KR2016010818 W KR 2016010818W WO 2017104949 A1 WO2017104949 A1 WO 2017104949A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
lens
confocal microscope
photographing
image
Prior art date
Application number
PCT/KR2016/010818
Other languages
English (en)
Korean (ko)
Inventor
김필한
안진효
Original Assignee
한국과학기술원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국과학기술원 filed Critical 한국과학기술원
Publication of WO2017104949A1 publication Critical patent/WO2017104949A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes

Definitions

  • the present invention relates to a confocal microscope and an image processing method using the same.
  • a confocal microscope is a microscope having a resolution in the depth direction, and is widely used in various industries and bio fields because it can obtain three-dimensional information of a specimen.
  • Confocal microscopes are known to have about 40% better resolution than conventional microscopes, and their utility is superior in that they can acquire three-dimensional images without the need for physical sections.
  • an endoscopic microscope method is used to transmit a light source transmitted through an objective lens of a confocal microscope into a tissue through a small lens. It is difficult and there is a problem that the loss of the light source and the detection signal may occur in the process of transferring the light source from the objective lens to the small lens has been studied to improve this.
  • the technical problem to be achieved by the present invention is to provide a confocal microscope and an image processing method using the same that can be photographed and imaged finely inside the biological tissue.
  • the confocal microscope outputs at least two laser light sources having different wavelengths to a photographing site, and acquires a two-dimensional image by scanning light reflected from the photographing site in a confocal manner.
  • an optical probe which invades the photographing part transmits the light output from the photographing part to the photographing part, and transmits the light reflected from the photographing part to the photographing part, and combines the lens of the photographing part and the optical probe.
  • a coupling for controlling movement of the optical probe is provided to the optical probe.
  • the optical probe may include a needle tip invading into the living body, and a lens unit positioned inside the needle tip.
  • the lens unit may include a coupling lens positioned on the photographing unit side, an image lens positioned on the photographing part side, and a relay lens positioned between the coupling lens and the image lens.
  • the coupling lens, the image lens and the relay lens may be formed of a gradient-index (GRIN) lens.
  • GRIN gradient-index
  • the optical probe may further include a mirror unit positioned at an end of the lens unit and reflecting the light to change a traveling direction of the light.
  • the coupling part may include an x and y axis moving part for controlling the movement of the optical probe in the x and y axis directions, and a z axis moving part for controlling the movement of the optical probe in the z axis direction.
  • the needle tip may include a tubular body, and one end of the body may include an opening that exposes at least a portion of the lens unit.
  • the front end portion of the main body may have an incline in cross section.
  • the inclination angle of the tip portion may be 1 to 20 degrees.
  • a protective layer surrounding the needle tip may be further included.
  • the protective layer may be made of an optical adhesive film.
  • the photographing unit may include a light source unit for outputting at least two laser light sources having different wavelengths, an objective lens adjusted to focus the laser light source at the photographing site, and reading an image observed from the photographing site in a two-dimensional array form. It may include a scanning unit for generating a scanning image, and an image acquisition unit for passing the scanning image to a slit portion installed in a confocal plane to generate an image excited by the laser light source.
  • An image processing method using a confocal microscope comprises the steps of invading the optical probe to the in vivo imaging area through the skin, irradiating a laser light source to the imaging area, and the light reflected from the imaging site And receiving the received image.
  • the inside of the living tissue may be finely approached and photographed to image it.
  • the loss of the light source and the detection signal can be reduced.
  • FIG. 1 is a view showing a schematic configuration of a confocal microscope according to an embodiment of the present invention.
  • FIG. 2 is a view showing a detailed configuration of the confocal microscope according to an embodiment of the present invention.
  • FIG 3 is a view showing the structure of a confocal microscope optical probe according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a confocal microscope optical probe according to an embodiment of the present invention.
  • FIG. 5 is an exploded cross-sectional view of a structure of a confocal microscope optical probe according to one embodiment of the present invention.
  • FIG. 6 is a view showing the structure of the confocal microscope coupling portion according to an embodiment of the present invention.
  • FIG. 7 is a view showing the flow of an image processing method using a confocal microscope according to an embodiment of the present invention.
  • FIGS. 8 to 10 are diagrams showing photographing results obtained by using a confocal microscope according to an embodiment of the present invention.
  • FIG. 1 is a view showing a schematic configuration of a confocal microscope according to an embodiment of the present invention
  • Figure 2 is a view showing a detailed configuration of a confocal microscope according to an embodiment of the present invention.
  • the confocal microscope 1 includes a photographing unit 10, an optical probe 20, a coupling unit 30, and a computing unit 40.
  • the photographing unit 10 includes a light source unit 110, beam splitters 120a, 120b, 120c and 120d, a scan unit 130, an objective lens 140, and an image acquisition unit 150. It may include.
  • the light source unit 110 is an excitation light source of the image capturing unit 10 and irradiates light to excite the image capturing portion.
  • the light source unit 110 includes two or more light sources having different wavelengths in order to photograph the observation targets labeled with different fluorescent samples.
  • the light source unit 110 may include four laser light sources having a visible light band, and the laser light sources may have wavelength bands of 405 nm, 488 nm, 561 nm, and 640 nm, respectively.
  • the present invention is not limited thereto, and the number and wavelength of the light sources may vary.
  • the light irradiated from the light source unit 110 passes through the scan unit 130 through at least one or more beam splitters 120a, 120b, 120c, and 120d, and then passes through the objective lens 140 and the optical probe 20. Investigate the internal filming site.
  • the optical probe 20 invades the inside of the living tissue through the skin of the living tissue, transfers the light irradiated from the light source unit 110 to the imaging area inside the living tissue, and retransmits the reflected light from the inside of the living tissue 10. To pass).
  • the shape of the optical probe 20 may vary, but in the present invention, a needle-shaped optical probe that is easy to invade will be described as an example.
  • the coupling unit 30 serves to couple the optical probe 20 to the imaging unit 10 to be fixed, and the detailed configuration of the optical probe 20 and the coupling unit 30 will be described in more detail below. Do it.
  • the light reflected from inside the biological tissue is returned to the imaging unit 10 through the optical probe 20.
  • the reflected light passes through the objective lens 140 and the scan unit 130 in order, and is transmitted to the image acquisition unit 150.
  • the objective lens 140 is a lens into which the light of the fluorescent material excited by the light source unit 110 enters, and outputs an image signal in which an image of a photographing part labeled with the fluorescent material is formed to the scanning unit 130.
  • the objective lens 140 may be set to have a field of view of 250 ⁇ 250um 2 using a 40x objective lens or to have a field of view of 500 ⁇ 500um 2 using a 20x objective lens.
  • the present invention is not limited thereto and may be set to have various fields of view by setting a lens having an appropriate magnification.
  • the scan unit 130 reads an image signal incident through the objective lens 140 and configures the pixel in a 2D array form.
  • the scan unit 130 may include a polygonal rotation mirror and a galvanometer mirror. The rotating polygon mirror scans the X-line, and the galvano mirror scans the Y-line.
  • the image acquisition unit 150 passes the scanning image signal generated by the scan unit 130 to at least one beam splitter 151a, 151b, or 151c and separates each wavelength band.
  • the separated scanning image signal passes through a band pass filter (BPF) 152 and a condensing lens 153 to a slit portion 154 installed in a confocal plane and is a photomultiplier pipe. tube, PMT) (155).
  • BPF band pass filter
  • PMT photomultiplier pipe. tube
  • the beam splitters 151a, 151b, and 151c separate and arrange the scanning images generated from the scan unit 130, and may be formed of a dichroic beam splitter (DBS).
  • DBS dichroic beam splitter
  • the bandpass filter unit 152 is positioned in a path of light split from the beam splitters 151a, 151b, and 151c, acquires the separated light, and passes the light in the spectral region of the designated visible light region.
  • the photomultiplier tube 155 is positioned in the path of the light passed from the bandpass filter unit 152, detects the fluorescent signal passing through the bandpass filter unit 152, generates an electric signal, and generates the computing signal 40. )
  • the computing unit 40 acquires an image signal photographed by the photographing unit 10. In this case, the computing unit 40 may correct the photographing result in order to obtain a physically meaningful result.
  • the confocal microscope 1 including the optical probe 20 can directly invade the internal organ tissue through the skin of the living body, and can access internal organ tissues. Shooting can be freely controlled and the inside of the photographed tissue can be imaged. In addition, the confocal microscope 1 including the optical probe 20 can invade the exact position and reduce the loss of light source and detection signal that can occur due to the use of the optical fiber.
  • optical probe 20 will be described in detail with reference to FIGS. 3 to 5.
  • FIG. 3 is an exploded cross-sectional view of a structure of a confocal microscope optical probe according to an embodiment of the present invention
  • FIG. 4 is a view showing an example of a confocal microscope optical probe according to an embodiment of the present invention
  • 5 is a view showing the structure of a confocal microscope optical probe according to an embodiment of the present invention.
  • the optical probe 20 includes a needle tip 210 and a lens unit 220.
  • the needle tip 210 has a tubular body 211 having a circular or elliptical cross section in which the needle tip 210 is infiltrated to the imaging part, that is, the core of the biological tissue, and the inside thereof may be hollow because the hollow is formed.
  • the lens unit 220 is positioned inside the main body 211.
  • the tip 212 of the needle tip 210 main body 211 may be formed to have a predetermined slope as shown in FIG. 3 to facilitate invasion into the living body.
  • the inclination angle may be 1 degree to 20 degrees.
  • One end of the body 211 may include an opening 213 exposing at least a portion of the lens unit 220.
  • the opening portion 213 may be formed by removing one side of the side portion of the main body 211 so that its cross section has a semi-circular shape in order to capture the image closer to the photographing portion inside the biological tissue.
  • the needle tip 210 may have a diameter of 0.5 mm to 1.0 mm and may be invasive to the inside of the living body, and its length may be 10 mm to 30 mm.
  • the protective layer may be composed of an optical adhesive film.
  • the lens unit 220 transmits the light irradiated from the light source unit 110 to the image capturing site inside the biological tissue, and transmits the light reflected from the image capturing site located inside the biological tissue to the image capturing unit 10.
  • the lens unit 220 may have three lens structures having the same diameter as shown in FIG. 5, and the lens unit 220 according to the present exemplary embodiment is a coupling lens positioned near the photographing unit 10. And a relay lens 223 positioned between the coupling lens 221 and the image lens 222.
  • Each lens may be formed of a gradient-index (GRIN) lens, and the NA (Numerical Aperture) of the coupling lens 221 and the image lens 222 is 0.45 to 0.55, and the NA of the relay lens 223 is 0.15 to 0.25.
  • GRIN gradient-index
  • NA Numerical Aperture
  • the optical probe 20 may further include a mirror 230 attached to the distal end of the image lens 222.
  • the mirror unit 230 reflects light to change a path of light.
  • the mirror unit 230 may be coated with aluminum, and the laser light source passing through the lens unit 220 is irradiated to the photographing site.
  • the mirror unit 230 is disposed at an angle of 45 degrees to the longitudinal direction of the lens unit 220 to change the traveling direction of the laser light source in a second direction perpendicular to the first direction through which the laser light source passes through the lens unit 220.
  • the present invention is not limited thereto, and the mirror unit 230 may be disposed in various directions to change a traveling direction of the laser light source.
  • the confocal microscope 1 irradiates a laser light source to a photographing site in various directions as well as a depth direction in which the needle tip 210 invades living tissue, and transmits light reflected therefrom. Receive the image.
  • FIG. 6 is a view showing the structure of the coupling portion of the confocal microscope according to the present embodiment.
  • the coupling part 30 may include a main body part, an x and y axis moving part 320, including a plate 311, a rod part 312, and an adapter 313. It includes a z-axis moving unit 330, and the probe holder 340.
  • the x, y-axis moving part 320 controls the movement of the planar direction (x, y-axis) of the optical probe 20, and the z-axis moving part 330 is a depth (height) direction (of the optical probe 20) ( z-axis) control. Accordingly, the confocal microscope 1 according to the present embodiment finely and accurately controls the movement in the three-axis direction of the optical probe 20, so that the body tissue of the desired site can be photographed.
  • the probe holder 340 fixes the position of the optical probe 20 to the photographing unit 10, and may prevent the movement of the optical probe 20 while imaging the photographed portion.
  • FIG. 7 is a view showing the flow of an image processing method using a confocal microscope according to an embodiment of the present invention.
  • the confocal microscope invades the optical probe 20 to the in vivo photographing site through the skin (S100).
  • the optical probe 20 may include a needle tip 210 having an inclined tip portion 212 to facilitate penetration into the living body.
  • the needle tip 210 may include an opening 213 formed by removing one side of the side part such that its cross section has a semi-circle shape in order to obtain an image in close contact with a photographed part of the living body.
  • the needle tip 210 may further include a protective layer surrounding the outer surface of the needle tip to prevent foreign substances from infiltrating into the biological tissue.
  • the laser light source is irradiated to the imaging area inside the biological tissue (S200).
  • the laser light source is irradiated from the light source unit 110 of the imaging unit 10, and may have a wavelength band of 405nm, 488nm, 561nm, and 640nm, respectively.
  • the laser light source may be transmitted to the imaging area inside the biological tissue through the lens unit 200 of the optical probe 20.
  • the light is received from the photographed portion receives the image (S300).
  • the light reflected from inside the biological tissue is returned to the imaging unit 10 through the optical probe 20.
  • the reflected light passes through the objective lens 140 and the scan unit 130 in order to be transferred to the image acquisition unit 150, whereby the confocal microscope can acquire an image of the photographed portion.
  • the image processing method using confocal by directly invading through the skin of the living body and imaging it, it is possible to obtain an image of directly photographing internal organ tissues, which may occur due to the use of optical fibers.
  • the loss of the light source and the detection signal can be reduced.
  • FIGS. 8 to 10 are diagrams showing photographing results obtained by using a confocal microscope according to an embodiment of the present invention.
  • FIG. 8 is a view illustrating imaging results obtained by continuously photographing somatic cells and blood vessels existing in the epidermis and dermis of the skin while inserting the needle tip 210 in the depth direction from the surface of the skin. At this time, somatic cells were labeled with a green fluorescent signal, and blood vessels were labeled with a red fluorescent signal.
  • the skin is composed of the epidermis, the basement, the dermis, and the subcutaneous tissue, which are epithelial cells of the outermost layer. Referring to FIG. You can see that the image.
  • FIG. 9 is a diagram illustrating a photographing result obtained by photographing and imaging an inside of a cancer tissue located in a deep tissue part of a living body.
  • cancer cells, blood vessels inside the cancer tissue, and low oxygen regions were labeled with different fluorescent signals.
  • the confocal microscope according to the present embodiment is a simple transmission image of skin only.
  • the image signal can be obtained by penetrating the deep tissue of the living body.
  • FIG. 10 is a diagram showing the results of continuous imaging while penetrating the inside of cancer tissue located in the deep tissue part of the living body in the depth (z-axis) direction. Referring to FIG. 10, it can be seen that an image up to 6.8 mm deep of a living tissue is obtained.
  • the confocal microscope according to the present embodiment can confirm that imaging of a transmission depth that cannot be taken by a general confocal microscope is possible. have.

Abstract

La présente invention concerne un microscope confocal et un procédé de traitement d'images utilisant un tel microscope. Dans un mode de réalisation, le microscope confocal selon la présente invention comporte: une unité de prises de vue pour émettre au moins deux sources de lumière laser ayant différentes longueurs d'onde vers une zone de prises de vue, balayer une lumière réfléchie par la zone de prises de vue de manière confocale, et ensuite obtenir une image bidimensionnelle; une sonde optique qui est insérée dans la zone de prises de vue pour transférer une lumière émise par l'unité de prise de vues vers la zone de prise de vues et transférer la lumière réfléchie depuis la zone de prises de vue vers l'unité de prises de vue; et une unité de couplage pour coupler une lentille de l'unité de prises de vue et la sonde optique et commander un déplacement de la sonde optique.
PCT/KR2016/010818 2015-08-04 2016-09-27 Microscope confocal et procédé de traitement d'images utilisant un tel microscope WO2017104949A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20150109841 2015-08-04
KR1020150179848A KR101898220B1 (ko) 2015-08-04 2015-12-16 공초점 현미경 및 이를 이용한 영상 처리 방법
KR10-2015-0179848 2015-12-16

Publications (1)

Publication Number Publication Date
WO2017104949A1 true WO2017104949A1 (fr) 2017-06-22

Family

ID=58121124

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/010818 WO2017104949A1 (fr) 2015-08-04 2016-09-27 Microscope confocal et procédé de traitement d'images utilisant un tel microscope

Country Status (2)

Country Link
KR (1) KR101898220B1 (fr)
WO (1) WO2017104949A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109965987A (zh) * 2019-02-20 2019-07-05 广州乔铁医疗科技有限公司 一种具有共聚焦激光扫描功能的机器人外视镜
CN113242715A (zh) * 2018-10-17 2021-08-10 韩国科学技术院 体内深层组织的显微图像采集系统及显微图像提供方法

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102355866B1 (ko) 2018-08-30 2022-01-25 성균관대학교산학협력단 초소형 내시경 프로브 및 이를 포함하는 다광자 내시경
KR102258893B1 (ko) * 2019-11-28 2021-05-31 재단법인대구경북과학기술원 내시현미경의 수직 분해능 최적화 장치, 최적화 광학 시스템 및 최적화 방법
KR20210100253A (ko) 2020-02-05 2021-08-17 삼성디스플레이 주식회사 광학 검사 장치
KR20230059228A (ko) 2021-10-26 2023-05-03 포항공과대학교 산학협력단 목시플록사신을 이용한 생체조직표면 세포 영상검사장치 및 목시플록사신을 이용한 생체조직표면 세포 영상검사방법
KR102579826B1 (ko) * 2022-12-09 2023-09-18 (주) 브이픽스메디칼 인공지능 기반 진단 보조 정보 제공 방법, 장치 및 시스템
KR102643066B1 (ko) * 2022-12-09 2024-03-04 (주) 브이픽스메디칼 인공지능 기반 의사 컬러링을 활용한 진단 보조 정보 제공 방법, 장치 및 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004317437A (ja) * 2003-04-18 2004-11-11 Olympus Corp 光イメージング装置
JP2010503884A (ja) * 2006-09-14 2010-02-04 パーキンエルマー・シンガポール・プライベート・リミテッド 走査型共焦点顕微鏡検査の改善、およびその関連技術
US20120184842A1 (en) * 2009-09-17 2012-07-19 Mauna Kea Technologies Method, an optical probe and a confocal microscopy system for inspecting a solid organ
US20120268578A1 (en) * 2009-08-26 2012-10-25 Tomophase Corporation Optical tissue imaging based on optical frequency domain imaging
JP5552050B2 (ja) * 2008-06-27 2014-07-16 テルモ株式会社 留置針

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7872759B2 (en) * 2005-09-29 2011-01-18 The General Hospital Corporation Arrangements and methods for providing multimodality microscopic imaging of one or more biological structures
JP2014202550A (ja) * 2013-04-03 2014-10-27 オリンパス株式会社 複数の波長帯域に於ける単一発光粒子検出を用いた光分析装置及び光分析方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004317437A (ja) * 2003-04-18 2004-11-11 Olympus Corp 光イメージング装置
JP2010503884A (ja) * 2006-09-14 2010-02-04 パーキンエルマー・シンガポール・プライベート・リミテッド 走査型共焦点顕微鏡検査の改善、およびその関連技術
JP5552050B2 (ja) * 2008-06-27 2014-07-16 テルモ株式会社 留置針
US20120268578A1 (en) * 2009-08-26 2012-10-25 Tomophase Corporation Optical tissue imaging based on optical frequency domain imaging
US20120184842A1 (en) * 2009-09-17 2012-07-19 Mauna Kea Technologies Method, an optical probe and a confocal microscopy system for inspecting a solid organ

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113242715A (zh) * 2018-10-17 2021-08-10 韩国科学技术院 体内深层组织的显微图像采集系统及显微图像提供方法
CN109965987A (zh) * 2019-02-20 2019-07-05 广州乔铁医疗科技有限公司 一种具有共聚焦激光扫描功能的机器人外视镜

Also Published As

Publication number Publication date
KR101898220B1 (ko) 2018-09-12
KR20170016773A (ko) 2017-02-14

Similar Documents

Publication Publication Date Title
WO2017104949A1 (fr) Microscope confocal et procédé de traitement d'images utilisant un tel microscope
CN101909509B (zh) 多路径、多放大率、非共焦荧光发射内窥镜装置和方法
Yin et al. Miniature in vivo MEMS-based line-scanned dual-axis confocal microscope for point-of-care pathology
JP7109031B2 (ja) テーパー導波路からの軸方向に分解された光収集のためのシステム
US8705184B2 (en) Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods
US20200367735A1 (en) Imaging system and method using multicore fiber
US20130324858A1 (en) Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods
Lane et al. Confocal fluorescence microendoscopy of bronchial epithelium
CN112834410B (zh) 基于双芯光纤光操控的片状光显微成像方法及装置
WO2013036049A2 (fr) Microscope confocal à fluorescence
US20210231942A1 (en) System for in vivo microscopic imaging of deep tissue, and microscopic imaging method
Koucky et al. Axial response of high-resolution microendoscopy in scattering media
CN112816449B (zh) 一种双波长双尺度纳米药物活体成像系统及时序控制方法
Thapa et al. Field portable grin-lens based micro-endoscopic system with oblique-illumination for cancer screening
WO2018021717A1 (fr) Module de couplage endomicroscopique
JP3255373B2 (ja) 生体内計測装置
WO2020080721A1 (fr) Système d'acquisition d'image microscopique de tissu profond in vivo et procédé de fourniture d'image microscopique associé
Cha et al. Gene transfection efficacy assessment of human cervical cancer cells using dual-mode fluorescence microendoscopy
EP2140292A2 (fr) Dispositif de biopsie optique
CN113390844A (zh) 多尺度光纤荧光显微成像系统
CN113533277A (zh) 基于四芯光纤主动光操控的光片荧光显微成像方法及装置
CN109758098B (zh) 可变焦式腔体内窥镜探测装置及激光扫描腔体内窥镜
Shi et al. Fast confocal endomicroscopy based on multi-fiber parallel scanning
Gmitro et al. Optical biopsy with confocal microendoscopy
EP3773163B1 (fr) Endoscope à fibre

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16875891

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16875891

Country of ref document: EP

Kind code of ref document: A1