KR20190045570A - Apparatus and method for optical image based on convergence of multiple optical images - Google Patents

Abstract

The present invention relates to an apparatus and method for generating an optical image based on multiple optical fusion images. According to an embodiment of the present invention, an apparatus for generating an optical image comprises: a sample mount on which a specimen is to be mounted; a first optical source which irradiates a first optical signal for obtaining first image information of a first region in a specimen; a second optical source which irradiates, to the inside of the first region of the specimen, a second optical signal for obtaining second image information of a second region having the size smaller than the first region; a dichroic mirror which is arranged to reflect the first optical signal toward the first region of the specimen and to transmit the second optical signal toward the second region of the specimen; a scanning unit which is configured to scan the second optical signal in a predetermined direction in the first region of the specimen; and a control unit which controls the scanning unit and generates an optical image of the first region of the specimen based on the first and second optical signals.

Description

Technical Field [0001] The present invention relates to a multi-optical fused image-based optical image generation apparatus and a method for generating the same,

The present invention relates to a multi-optical fused image-based optical image generation apparatus and a generation method thereof.

Optical technologies used in conventional simple microscopes have developed into new technologies such as fluorescence, multi-photon microscopy, photoacoustics, and optical interference tomography, and have been used to develop new medical systems such as biomedical imaging, analysis, , And its role is rapidly expanding. As a representative example, there are retina and optic nerve examination using optical coherence tomography.

Various types of optical images applied to biomedical technology can be divided into a method using an array detector and a method of raster scanning according to a measurement method. A method using an array detector can be easily understood by a method of photographing a general photograph, and a raster scanning method is a method of acquiring an image by scanning a measurement object at a high speed by one point. The optical interference tomography And the like.

Optical images using a raster scanning method have various spatial resolutions and field-of-views depending on the frequency and measurement method of the optical source, and optical images having different spatial resolutions and observation fields It is very difficult to measure images simultaneously.

Combining two or more different optical images that measure one specimen has the advantage of being able to acquire a wide variety of information and to solve problems that are difficult to overcome by a single conventional technique.

Conventionally, a method of measuring a sample with a plurality of optical sources and then combining them into a single image through signal processing is adopted. Further, additional image processing and processing are required to easily couple the two images.

Therefore, if two image signals that are mapped with good image quality can be acquired at the same time through one sample measurement, there will be a great advantage in optical image fusion.

An object of the present invention is to provide a multi-optical fused image-based optical image generating apparatus and method capable of simultaneously acquiring two or more types of optical images through one measurement.

According to an aspect of the present invention, there is provided a sample mount for placing a specimen therein; A first optical source for irradiating a first optical signal for acquiring first image information of a first region in a specimen; A second optical source for irradiating a second optical signal for acquiring second image information of a second region that is smaller in size than the first region in the first region of the specimen; A dichroic mirror arranged to reflect the first optical signal to the first region side of the specimen and transmit the second optical signal to the second region side of the specimen; A scanning unit for scanning a second optical signal in a first direction within a first region of the specimen; And a control unit for controlling the scanning unit and generating an optical image of the first region of the sample based on the first and second optical signals.

According to still another aspect of the present invention, there is provided a sample mount, comprising: a sample mount on which a sample is placed and movable in a biaxial direction; A plurality of optical sources for generating image information based on optical signals, the optical sources having different observation fields; A dichroic mirror arranged to totally reflect an optical signal of an optical source having a large observation field to the specimen side and transmit an optical signal of an optical source having a small observation field of view to the specimen side; And a scanning unit for scanning an optical signal having a small observation field in a biaxial direction in an optical signal having a large observation field.

According to another aspect of the present invention, there is also provided a sample mount for placing a specimen therein; A first optical source for irradiating a first optical signal for acquiring first image information of a first region in a specimen; A second optical source for irradiating a second optical signal for acquiring second image information of a second region that is smaller in size than the first region in the first region of the specimen; A first dichroic mirror arranged to reflect the first optical signal to the side of the first region of the specimen and transmit the second optical signal to the side of the second region of the specimen; A third optical source for irradiating a third optical signal for acquiring third image information of a third region that is smaller in size than the first region in the first region of the specimen; A scanning unit for scanning a second optical signal in a first direction within a first region of the specimen; A second dichroic mirror arranged to transmit the second optical signal to the scanning unit and to totally reflect the third optical signal to the scanning unit; And a control unit for controlling the scanning unit and generating an optical image of the first region of the specimen matched with the first to third optical signals.

According to still another aspect of the present invention, there is provided a method of analyzing a sample, comprising: irradiating a first optical signal for acquiring first image information of a first region in a specimen; Irradiating a second optical signal for acquiring second image information of a second region smaller in size than the first region in the first region of the specimen; And scanning the second optical signal in a predetermined direction within the first region of the specimen.

As described above, the multi-optical fused image-based optical image generating apparatus and method according to an embodiment of the present invention has the following effects.

The apparatus and method for simultaneously scanning two or more types of optical images having different resolutions according to the present invention can simultaneously obtain signals of two optical images having different optical fields and spatial resolution through one measurement.

Since the image data is automatically mapped in comparison with the method of obtaining the respective image data in the conventional manner, the image processing work for combining and displaying the matched two images can be very simple or omitted.

In addition, by combining two optical images, various information can be obtained at the same time in the bio sample measurement, which can solve the problems that have not been solved in the past, and the precision of the biopsy and analysis can be enhanced.

1 is a conceptual diagram for explaining an optical image generating method according to an embodiment of the present invention.
2 is a configuration diagram of an optical image generating apparatus according to an embodiment of the present invention.
3 is a diagram for explaining an operation state of the optical image generating apparatus.
4 is a configuration diagram of an optical image generating apparatus according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a multi-optical fused image-based optical image generating apparatus and a generating method according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

In addition, the same or corresponding reference numerals are given to the same or corresponding reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. For convenience of explanation, the size and shape of each constituent member shown in the drawings are exaggerated or reduced .

FIG. 1 is a conceptual diagram for explaining an optical image generating method according to an embodiment of the present invention, and FIG. 2 is a configuration diagram of an optical image generating apparatus 100 according to an embodiment of the present invention.

3 is a diagram for explaining one operation state of the optical image generating apparatus.

An optical image generating apparatus 100 according to an embodiment of the present invention includes a sample mount 110, a first optical source 120, a second optical source 130, a dichroic mirror 140, A scanning unit 150 and a control unit 160. [

In order to simultaneously scan and acquire two or more kinds of optical images having different resolutions, the optical image generating apparatus 100 may include two or more optical sources 120 and 130, an optical detector for detecting optical signals of an optical source, A dichroic mirror 140 capable of transmitting or reflecting light, a scanning unit 160 capable of scanning light irradiated from any one of the optical elements, and a sample mount 110 capable of moving in two axial directions do.

Specifically, the optical image generating apparatus 100 includes a sample mount 110 for mounting the sample 10 and a first optical signal for acquiring first image information of the first region 11 in the sample 10, And a first optical source 120 for irradiating the light source 121 with a predetermined wavelength. In addition, the optical image generating apparatus 100 may include one or more lenses disposed on the path of the first optical signal 121.

In addition, the sample mount 110 is movable in two directions. The sample mount 110 is connected to a driving unit such as a motor, and the driving unit can be controlled by the control unit 160.

The optical image generating apparatus 100 may further include a second optical signal generator for acquiring second image information of the second region 12 that is smaller in size than the first region in the first region 11 of the specimen 10 And a second optical signal 131 for reflecting the first optical signal 121 to the first region 11 of the specimen 10 and reflecting the second optical signal 131 to the specimen 10 And a dichroic mirror 140 arranged to transmit light to the second region 12.

The dichroic mirror 140 totally reflects the first optical signal 121 to the first region 11 of the specimen 10 and the second optical signal 131 to the second region 12 of the specimen 10 (ITO) glass which is transparent to light.

The optical image generating apparatus 100 further includes a scanning unit 150 and a scanning unit 150 for scanning the second optical signal 131 in a predetermined direction within the first region 11 of the specimen 10 And a controller 160 for generating an optical image of the first region 11 of the specimen 10 based on the first and second optical signals 121 and 131.

The first optical source 120 is arranged to irradiate an optical signal having a larger spatial resolution and larger observation field than the second optical source 130. [

For example, the first optical source 120 may be arranged to illuminate a terahertz signal. The terahertz signal is an electromagnetic wave in the form of a pulse wave or a continuous wave in the frequency band of 0.05 to 30 THz.

Further, the second optical source may be arranged to irradiate an optical coherence tomography (OCT) signal, a Raman signal or a fluorescence signal. The OCT signal is a signal of a wavelength of 600 to 1400 nm generated by a broadband wavelength light source for optical coherence tomography. In addition, the Raman signal is a signal of a wavelength of 200 to 1400 nm generated by a broadband wavelength light source for Raman spectroscopy and imaging. Also, the fluorescence signal is a signal generated based on the contrast agent.

The terahertz signal is totally reflected by the ITO glass, and the OCT signal, the Raman signal or the fluorescence signal can be transmitted by the ITO glass.

Also, the first image information is an image generated based on the terahertz signal, and the second image information is an image generated based on the OCT signal, the Raman signal, or the fluorescence signal.

Terahertz (THz) waves are used to detect counterfeit bills, drugs, explosives, biochemical weapons as well as basic science such as physics, chemistry, biology, and medicine, , Especially water and lipid content, is being actively used in biomedical applications.

Optical coherence tomography is an imaging technology that provides high resolution and structural information. It is widely applied to biomedical applications because it provides tomographic information of living tissue about 2 ~ 3mm deep. Especially, It is a technology that has already been commercialized and used.

Raman spectroscopy and imaging techniques can distinguish the molecular structure of fat, protein, and DNA (deoxyribonucleic acid) by detecting differences in scattering of incident light due to inherent frequencies of living tissue Recently, it is a technology that is actively used in biomedical applications.

For example, using THz waves, optical coherence tomography, and Raman spectroscopy and fluorescence techniques, real-time brain tumor boundary detection and imaging becomes possible.

The optical source and the optical detector may include a terahertz wave generator / terahertz detector for generating and detecting a terahertz signal, an OCT generator / OCT for generating and detecting an optical coherence tomography (OCT) signal for optical coherence tomography, A Raman generator / Raman detector for generating and detecting a Raman signal for Raman spectroscopy and imaging, and a fluorescence generator / fluorescence detector for generating a fluorescence signal based on a contrast agent.

The scanning unit 150 may be implemented for scanning to generate an image. For example, the scanning unit 120 may be an optical device such as a galvanometer used to combine signals based on a raster scan to generate an image. The galvanometer is located between the optical path-dichroic mirror 140 of the second optical signal 131 and the second optical source 130.

In addition, the scanning unit 150 may perform scanning for generating a two-dimensional image and / or a three-dimensional image based on various signals (terahertz signal, OCT signal, Raman signal, Can be performed.

In this document, the first optical signal 121 is fixed to the first region 11 of the specimen 10, and the second optical signal 131 is reflected in the first region 11 by a galvanometer 150). ≪ / RTI >

The ITO glass 140 totally reflects a THz signal and the ITO glass 140 transmits a signal of a wavelength corresponding to the Raman signal, the OCT signal and the fluorescence signal passed through the galvanometer 150 , A terahertz signal, a Raman signal, an OCT signal, and a fluorescence signal.

On the other hand, the terahertz wave generator / terahertz detector can be implemented to generate and detect terahertz signals. The terahertz signal generated and detected in the terahertz wave generator / terahertz detector can be an electromagnetic file in the frequency band of 0.05 to 30 THz. The terahertz signal can also be a terahertz file in the form of a pulse wave or a continuous wave. The terahertz generator / terahertz detector may include an optical fiber.

Also, an OCT (optical coherence tomography) generator / OCT detector may be implemented to generate and detect an OCT signal. The OCT signal may be a signal generated by a broadband wavelength light source that generates a signal of 600 nm to 1400 nm. For example, the broadband wavelength light source may be a swept-source laser, a super-continuum laser, or a super-continuum. The OCT detector may be implemented to interfere with an optical signal returned from a sample arm and a reference arm using an interferometry to detect the interference signal. The OCT detecting unit may include an optical fiber.

Further, the Raman generator / Raman detector may be implemented to generate and detect a Raman signal. The Raman signal may be a signal generated by a broadband wavelength light source producing a signal of 200 nm to 1400 nm. For example, the broadband wavelength light source may be a swept-source laser, a super-continuum laser, or a super-continuum. The Raman detection unit may include a Raman scattering spectrometer capable of measuring a scattered Raman signal due to incident light, a CCD camera, a photodetector, and the like.

Also, the fluorescence generating unit / fluorescence detecting unit can be implemented based on all the light sources including the fluorescence emitting wavelength of a contrast agent such as a laser, a laser diode, and a light-emitting diode (LED). The fluorescence detector capable of detecting fluorescence that can be expressed through the contrast agent may include a CCD camera, a photodetector, and the like. The fluorescence detection unit may include a light filter and a beam splitter for separating the wavelength of the fluorescence emitted from the light of other wavelengths to detect only the wavelength of the emitted fluorescence.

At this time, the optical image (also referred to as the third image information) of the first region 11 generated by the controller 160 may be obtained by matching the first image information and the second image information with each coordinate of the first region 11 And the image is fused.

In addition, the controller 160 may acquire a plurality of second image information in the first area 11 by scanning the second optical signal in the two-axis direction within the first area 11, respectively. In addition, the controller 160 may match a plurality of second image information in the first image information with respect to the corresponding coordinates in the first area 11. [

The control unit 160 may move the sample mount 11 in any one of the biaxial directions when the acquisition of the plurality of second image information is completed in the first region 11. [ In this way, the control unit 160 can control to generate the image information for the entire area of the specimen 10.

In summary, the optical image generating apparatus 100 includes a sample mount 110 on which a specimen 10 is mounted and which is movable in two axial directions, a light source for generating image information based on an optical signal, A plurality of optical sources 120 and 130 having a plurality of optical sources 120 and 130 arranged on the sample 10 to totally reflect an optical signal of an optical source having a large observation field to the specimen 10 side and transmit an optical signal of an optical source having a small observation field- And a scanning unit 150 for scanning an optical signal having a small observation field in a predetermined direction (any one of the biaxial directions) within an optical signal having a large observation field.

The optical image generating method using the optical image generating apparatus having the above structure includes the step of irradiating the first optical signal 121 for acquiring the first image information of the first region 11 in the specimen 10 . The optical image generating method further includes the step of generating a second optical signal for acquiring the second image information of the second region 12 smaller in size than the first region 11 in the first region 11 of the specimen 10 . The optical image generating method includes the steps of fixing the first optical signal of the specimen 10 and scanning the second optical signal 131 in a predetermined direction (any one of the biaxial directions) in the first region 11 .

As described above, the first optical signal 121 can be reflected toward the first region of the specimen 10, and the second optical signal 131 can be transmitted through the second region of the specimen.

At this time, the second optical signal 131 may have a smaller focus and spatial resolution than the first optical signal 121. The optical image generating method includes the steps of matching a plurality of second image information obtained by the second optical signal 131 in the first image information obtained by the first optical signal 121, May be further included.

Specifically, the first and second optical sources 120 and 130 having different spatial resolutions and optical fields are moved to the dichroic mirror 140 so that the optical path of the first optical signal and the optical path of the second optical signal coincide with each other, And enters the sample mount 110.

The first light emitted from the first optical source 120 has a greater optical focus and spatial resolution and the second light emitted from the second optical source 130 has a smaller focus and spatial resolution.

A single-axis or dual-axis scanning unit may be disposed in the optical path of the second light and scanned using the scanning unit 150 in the second optical path as much as the optical focal length of the first light, as shown in FIG.

In order to obtain the actual image, the second light is rapidly scanned for a time period during which the two-axis sample mount 110 is initially positioned and a signal of the first light is obtained, and the light is scanned in the focus area (first area) And a plurality of signals (a plurality of second regions) of the corresponding second light are obtained. After performing the above operation, the two-axis sample mount 110 may be moved in one direction by the focal size of the first light, and the above procedure may be repeated to acquire the signal. After obtaining the signals of the two optical images for the entire target area of the target sample, a well-matched optical image can be obtained through data processing.

Although an embodiment has been described heretofore in which a first optical source is used to illuminate a terahertz signal and a second optical source is used to illuminate an OCT signal, a Raman signal, or a fluorescence signal, the present invention is not limited thereto.

4 is a configuration diagram of an optical image generating apparatus 200 according to another embodiment of the present invention.

For example, it may be configured to illuminate a terahertz signal using a first optical source, illuminate an OCT signal with a second optical source, and illuminate a Raman signal or a fluorescence signal using a third optical source.

Alternatively, as shown in FIG. 4, a terahertz signal may be illuminated using a first optical source, an OCT signal may be illuminated using a second optical source, a Raman signal may be illuminated using a third optical source, And may be configured to illuminate the fluorescence signal using an optical source.

Specifically, the optical image generating apparatus 200 includes a sample mount 210 for placing the sample 10, a first optical signal 221 for obtaining first image information of the first region in the sample 10 (E. G., A terahertz signal). ≪ / RTI > On the other hand, reference numeral 222 denotes a lens.

The optical image generating apparatus 200 further includes a second optical signal 231 for obtaining second image information of a second region that is smaller in size than the first region in the first region of the specimen 10 (for example, OCT signal) from the second optical source 230-1.

The optical image generating apparatus 200 further includes a first dichroic mirror 231 that reflects the first optical signal 221 toward the first region of the specimen and transmits the second optical signal 231 toward the second region of the specimen, And a Roehm mirror 240.

The optical image generating apparatus 200 further includes a third optical signal 232 (for example, a Raman signal) for acquiring third image information of a third region smaller than the first region in the first region of the specimen, And a third optical source 230-2 for irradiating the second optical source 230-2.

The optical image generating apparatus 200 further includes a fourth optical signal 233 (for example, a fluorescence signal) for acquiring fourth image information of a fourth region that is smaller in size than the first region in the first region of the specimen, And a fourth optical source 230-3 for irradiating the second optical source 230-2.

The optical image generating apparatus 200 also includes a scanning unit 250 for scanning the second to fourth optical signals in a predetermined direction within a first region of the specimen.

In addition, the optical image generating apparatus 200 may include a plurality of dichroic mirrors for matching the optical paths of the second optical signal, the third optical signal, and the fourth optical signal to the scanning unit 250 .

For example, the optical image generating apparatus 200 may be configured to transmit the second optical signal 231 to the scanning unit 250 and to reflect the third optical signal 232 to the scanning unit 250, The dichroic mirror 241 and the third optical signal 232 to the second dichroic mirror 241 and the fourth optical signal 232 to the second dichroic mirror 241 And a fourth dichroic mirror 243 for totally reflecting the fourth optical signal 232 to the third dichroic mirror 241. The third dichroic mirror 243 includes a third dichroic mirror 241 and a fourth dichroic mirror 243.

The optical image generating apparatus also includes a control unit for controlling the scanning unit 250 and generating an optical image of the first region of the specimen matched with the first to third optical signals.

The foregoing description of the preferred embodiments of the present invention has been presented for purposes of illustration and various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention, And additions should be considered as falling within the scope of the following claims.

100, 200: optical image generating device
110: Sample Mount
120: first optical source
130: second optical source
140: Dichroic Mirror
150: Scanning section

Claims (16)

A sample mount for placing the specimen;
A first optical source for irradiating a first optical signal for acquiring first image information of a first region in a specimen;
A second optical source for irradiating a second optical signal for acquiring second image information of a second region that is smaller in size than the first region in the first region of the specimen;
A dichroic mirror arranged to reflect the first optical signal to the first region side of the specimen and transmit the second optical signal to the second region side of the specimen;
A scanning unit for scanning a second optical signal in a first direction within a first region of the specimen; And
And a control unit for controlling the scanning unit and generating an optical image of the first region of the sample based on the first and second optical signals. The method according to claim 1,
Wherein the first optical source irradiates an optical signal having a spatial resolution and a larger observation field than the second optical source. The method according to claim 1,
Wherein the first optical source irradiates a terahertz signal. The method according to claim 1,
And the second optical source irradiates an optical coherence tomography (OCT) signal, a Raman signal or a fluorescence signal. The method according to claim 1,
Wherein the dichroic mirror includes ITO (Indium Tim Oxide) glass. The method according to claim 1,
Wherein the scanning unit includes a galvanometer disposed between the optical path-shaped dichroic mirror of the second optical signal and the second optical source. The method according to claim 1,
And the sample mount is provided so as to be movable in two directions. 8. The method of claim 7,
And the control unit scans the second optical signal in the biaxial direction to acquire a plurality of second image information in the first region. 9. The method of claim 8,
And the controller matches the plurality of second image information within the first image information. 9. The method of claim 8,
The control unit moves the sample mount in any one of the biaxial directions when acquisition of the plurality of second image information is completed. A sample mount on which a specimen is mounted and movable in two axial directions;
A plurality of optical sources for generating image information based on optical signals, the optical sources having different observation fields;
A dichroic mirror arranged to totally reflect an optical signal of an optical source having a large observation field to the specimen side and transmit an optical signal of an optical source having a small observation field of view to the specimen side; And
And a scanning unit for scanning an optical signal having a small observation field in a biaxial direction in an optical signal having a large observation field. A sample mount for placing the specimen;
A first optical source for irradiating a first optical signal for acquiring first image information of a first region in a specimen;
A second optical source for irradiating a second optical signal for acquiring second image information of a second region that is smaller in size than the first region in the first region of the specimen;
A first dichroic mirror arranged to reflect the first optical signal to the side of the first region of the specimen and transmit the second optical signal to the side of the second region of the specimen;
A third optical source for irradiating a third optical signal for acquiring third image information of a third region that is smaller in size than the first region in the first region of the specimen;
A scanning unit for scanning a second optical signal in a first direction within a first region of the specimen;
A second dichroic mirror arranged to transmit the second optical signal to the scanning unit and to totally reflect the third optical signal to the scanning unit; And
And a control unit for controlling the scanning unit and generating an optical image of the first area of the specimen matched with the first to third optical signals. Irradiating a first optical signal for acquiring first image information of a first region in a specimen;
Irradiating a second optical signal for acquiring second image information of a second region smaller in size than the first region in the first region of the specimen; And
And scanning the second optical signal in a predetermined direction within the first region of the specimen. 14. The method of claim 13,
The first optical signal is reflected to the side of the first region of the specimen, and the second optical signal is transmitted to the side of the second region of the specimen to be irradiated. 14. The method of claim 13,
And the second optical signal has a smaller focus and spatial resolution than the first optical signal. 14. The method of claim 13,
Further comprising the step of generating an optical image of the first region by matching a plurality of second image information obtained by the second optical signal in the first image information obtained by the first optical signal.

Images