WO2018101623A1

WO2018101623A1 - Method and device for correcting defocused photoacoustic image distortion using optical coherence tomography image

Info

Publication number: WO2018101623A1
Application number: PCT/KR2017/012442
Authority: WO
Inventors: 김철홍; 이동현; 이창호
Original assignee: 포항공과대학교 산학협력단
Priority date: 2016-12-01
Filing date: 2017-11-03
Publication date: 2018-06-07
Also published as: KR101848235B1

Abstract

According to a method and a device for correcting defocused photoacoustic image distortion using an optical coherence tomography image provided in the present invention, a photoacoustic image distortion, which is generated due to the distance between the location of an ultrasonic transducer of a photoacoustic microscope imaging device and the acquisition location of a photoacoustic signal changed by means of sample scanning, can be corrected on the basis of an optical coherence tomography image. Therefore, photoacoustic image distortion in the depth direction generated in an existing photoacoustic microscope imaging device can effectively be corrected, and a more accurate photoacoustic tomography image can be obtained.

Description

Non-focal photoacoustic image distortion correction method and apparatus using optical tomography image

The present invention relates to a method and apparatus for correcting an out of focus optoacoustic image distortion using an optical tomography image. More specifically, the present invention relates to a fixed ultrasonic transducer and a light scanning apparatus for beam scanning using a galvano scanner. Non-focus using optical tomography to correct the distortion of the optoacoustic image based on the image obtained from the optical coherence tomography apparatus based on the image distortion generated by the distance between the irradiated sample and the ultrasonic transducer. The present invention relates to a photoacoustic image distortion correction method and apparatus.

In general, the photoacoustic imaging technology is a technique that can measure the thermal ultrasonic signals generated by the light source to non-invasively image the microstructure of the inside of the biological tissue. to be. The photoacoustic imaging technique is widely used in clinical and preclinical studies because it can obtain functional information such as structural information and oxygen saturation in the living body. In other words, the photoacoustic imaging technique uses a non-focus transducer to detect an accurate position in the photoacoustic depth direction of the dust region due to the difference between the speed of light and the speed of the photoacoustic signal. There was a problem being issued.

The optical scanning method using focusing of the light source of the conventional photoacoustic microscope imaging apparatus includes a method of moving a light and an ultrasonic transducer using a step motor, a method of moving a sample using a step motor, and a galvanometer The method of moving the beam by using is mainly used. Among the various optical scanning methods, the beam is moved by using a galvanometer, because the beam is moved while the signal acquisition area of the ultrasonic transducer is fixed, so that the farther region is the signal distortion due to the speed difference between the light and the optoacoustic signal. Will be. In detail, the time taken for the photoacoustic signal generated by the laser irradiated sample to reach the ultrasonic transducer is changed, which causes distortion of the image. On the other hand, the optical coherence tomography device is a device capable of real-time imaging of the inside of the biological tissue by combining the interference phenomenon of the laser light source and the principle of confocal microscope, the optical coherence tomography device is reflected and scattered by irradiating light Since high-resolution tomography is obtained by detecting light signals, distortion of the image does not occur even if optical scanning is performed using a galvanometer.

Therefore, the present applicant proposes a method for correcting a distortion phenomenon of an optoacoustic image generated when acquiring an optoacoustic signal by using a fixed nonfocus ultrasound transducer in the process of acquiring an optoacoustic image in an optoacoustic microscope imaging apparatus. I would like to.

The present invention has been proposed to solve the above problems of the conventionally proposed methods, which is caused by the distance between the position of the ultrasonic transducer of the optoacoustic microscope imaging device and the acquisition position of the optoacoustic signal which is changed by sample scanning. By configuring the photoacoustic image distortion to correct the distortion of the optoacoustic image based on the optical coherence tomography image, it is possible to effectively correct the distortion of the optoacoustic image in the depth direction generated by the conventional photoacoustic microscope imaging apparatus. An object of the present invention is to provide a method and apparatus for correcting a non-focal photoacoustic image distortion using an optical tomography image, which enables a more accurate image acquisition of an optical acoustic tomography.

In addition, the present invention is a distortion phenomenon of the optoacoustic image by correcting the optoacoustic image based on the obtained optical coherence tomography image obtained by using the photoacoustic microscope imaging device and the optical interference tomography apparatus at the same time Another object of the present invention is to provide a method and apparatus for correcting a non-focused optoacoustic image distortion using an optical tomography image, so as to continuously correct the PSA.

Non-focal photoacoustic image distortion correction method using an optical tomography image according to the characteristics of the present invention for achieving the above object,

Non-focal photoacoustic image distortion correction method using optical tomography image,

(1) acquiring the photoacoustic original image and the optical interference original image of the biological tissue sample by using the photoacoustic imaging unit and the optical interference tomography unit;

(2) receiving the photoacoustic original image and the optical interference original image obtained in step (1) by the photoacoustic image distortion correction unit; And

And (3) correcting the distortion of the photoacoustic original image based on the optical interference original image received by the photoacoustic image distortion correcting unit.

Preferably, in step (1),

The photoacoustic image capturing unit and the optical coherence tomography unit combine lasers in the same optical path and scan the same area of the same biological tissue sample to acquire the photoacoustic original image and the optical interference original image.

Preferably, the photoacoustic image pickup unit,

It may be configured as a photoacoustic microscope imaging device for measuring the thermal ultrasonic signal generated by the light source irradiated to the biological tissue sample to non-invasive to image the microstructure inside the biological tissue sample.

More preferably, the photoacoustic image pickup unit,

The biological tissue sample may be photographed and imaged to a depth of 10 cm at the resolution of the micro area.

More preferably, the photoacoustic image pickup unit,

It can be configured to include a fixed ultrasound transducer and a galvano scanner.

More preferably, the photoacoustic original image,

It may include structural information and oxygen saturation in the biological tissue sample.

Preferably, in step (3),

(3-1) detecting, by the optoacoustic image distortion correction unit, edges of the received photoacoustic original image and the optical interference original image;

(3-2) detecting a slope of a straight line in each image image of which edges are detected through step (3-1);

(3-3) calculating the slope of the optical interference image and the slope of the optoacoustic image detected through the step (3-2); And

And (3-4) correcting the distortion of the optoacoustic image by using the difference between the inclination of the optical interference image and the inclination of the optoacoustic image calculated through the step (3-3).

More preferably, in the step (3-1),

Edges of the photoacoustic original image and the optical interference original image are detected by applying an edge detection algorithm to the photoacoustic original image and the optical interference original image provided from the photoacoustic image capturing unit and the optical interference tomography unit. Processing can be performed.

More preferably, in the step (3-2),

In step (3-1), the inclination of the straight line may be detected in each image image of which the edge is detected, and the process of detecting and obtaining the inclination of the straight line using Hough transform may be performed.

More preferably, in the step (3-3),

The inclination of the optical interference image and the inclination of the optoacoustic image detected in step (3-2) may be calculated, and the inclination difference between the inclination of the optical interference image and the inclination of the optoacoustic image may be obtained.

More preferably, in step (3-4),

The distortion of the photoacoustic image is corrected by using the difference between the slope of the optical interference image and the slope of the photoacoustic image calculated through the step (3-3), but the photoacoustic image is warped by the difference of the slope. The distortion of the image may be corrected.

Non-focal photoacoustic image distortion correction method using an optical tomography image according to another aspect of the present invention for achieving the above object,

(11) combining the lasers of the optoacoustic imaging unit and the optical coherence tomography unit in the same optical path and scanning the same to image regions of the same biological tissue sample to obtain an optoacoustic original image and an optical interference original image;

(12) receiving the photoacoustic original image and the optical interference original image obtained in the step (11) by the photoacoustic image distortion correction unit;

(13) the optoacoustic image distortion correcting unit detects edges of the photoacoustic original image and the optical interference original image provided from the photoacoustic image capturing unit and the optical interference tomography unit through step (12). Applying an algorithm to detect edges of the photoacoustic original image and the optical interference original image;

(14) detecting a slope of a straight line using a Hough transform in each image image of which edges are detected through step (13);

(15) calculating a slope of the optical interference image and a slope of the photoacoustic image detected through the step (14), and obtaining a difference between the slope of the optical interference image and the slope of the photoacoustic image; And

(16) a step of correcting the distortion of the optoacoustic image by warping the optoacoustic image by a difference between the inclination of the photointerference image and the inclination of the optoacoustic image calculated through the step (15). It is done.

A non-focused optoacoustic image distortion correction apparatus using an optical tomography image according to the characteristics of the present invention for achieving the above object,

A non-focused optoacoustic image distortion correction apparatus using optical tomography image,

An optoacoustic imaging unit for acquiring and outputting an optoacoustic original image of a biological tissue sample;

An optical coherence tomography unit for obtaining and outputting an optical interference original image of the biological tissue sample; And

Photoacoustic image receiving the photoacoustic original image and the optical interference original image obtained from the photoacoustic image pickup unit and the optical interference tomography unit to correct the distortion of the photoacoustic original image based on the optical interference original image Including the distortion correction unit is characterized by its configuration.

Preferably, the non-focus photoacoustic image distortion correction device,

The photoacoustic image capturing unit and the optical interference tomography unit combine the lasers in the same optical path and scan the same area of the same tissue sample at the same time to control driving to obtain the photoacoustic original image and the optical interference original image. .

Preferably, the photoacoustic image pickup unit,

More preferably, the photoacoustic image pickup unit,

Still more preferably, the optoacoustic imaging unit,

As beam scanning is performed by using the fixed ultrasound transducer and the galvano scanner, image distortion may be generated in the optoacoustic image obtained by the distance between the sample to which the light is irradiated and the distance from the ultrasound transducer.

Even more preferably, the photoacoustic original image,

Preferably, the optical coherence tomography unit,

An optical coherence tomography apparatus combining the principle of the confocal microscope and the interference phenomenon of the laser light source for imaging the inside of the biological tissue sample in real time.

Preferably, the non-focus photoacoustic image distortion correction device,

The optoacoustic image capturing unit, the optical coherence tomography unit, and the optoacoustic image distortion correction unit may be configured as a single device, or may be electrically connected and connected to a separate photoacoustic microscope imaging apparatus, an optical coherence tomography apparatus, and image processing control. It can be configured as a device.

According to the non-focal photoacoustic image distortion correction method and apparatus using the optical tomography image proposed by the present invention, the distance between the position of the ultrasonic transducer of the photoacoustic microscope imaging device and the acquisition position of the photoacoustic signal changed by sample scanning The photoacoustic image distortion caused by the photoacoustic tomography can be corrected based on the optical coherence tomography to effectively correct the distortion of the photoacoustic image in the depth direction generated by the conventional photoacoustic microscopy imager. It can be calibrated and can make it possible to acquire an image of a more accurate optoacoustic tomography.

Further, according to the present invention, the photoacoustic image is corrected by correcting the photoacoustic image based on the obtained optical coherence tomography image obtained by capturing the same position simultaneously using the photoacoustic microscope imaging device and the optical interference tomography apparatus. It is possible to continuously correct the phenomenon.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing the configuration of an apparatus for correcting a non-focused optoacoustic image distortion using an optical tomography image according to an embodiment of the present invention.

2 is a diagram schematically illustrating a configuration of an optoacoustic image capturing unit of an apparatus for correcting a non-focused optoacoustic image distortion using an optical tomography image according to an exemplary embodiment of the present invention.

3 is a flowchart illustrating an operation of a non-focused photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention.

4 is a view illustrating an operation flow of a distortion correction step of an optoacoustic original image in a non-focal photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention.

5 is a flowchart illustrating another example of a non-focal photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating an optoacoustic signal acquisition process and an acquired optoacoustic and photointerference original image of a non-focused optoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention. FIG.

FIG. 7 is a diagram illustrating an image changed for each process of the distortion correction step of the photoacoustic original image in the non-focused photoacoustic image distortion correction method using the optical tomography image according to an embodiment of the present invention.

100: non-focal photoacoustic image distortion correction apparatus according to an embodiment of the present invention

110: photoacoustic image recording unit

111: ultrasonic transducer

112: galvano scanner

120: optical coherence tomography

130: photoacoustic image distortion correction unit

S110: acquiring the photoacoustic original image and the optical interference original image

S120: providing a photoacoustic and optical interference original image

S130: correcting distortion of the optoacoustic original image

S131: detecting edges of the optoacoustic and optical interference original image

S132: detecting a slope of a straight line in each image image

S133: calculating the slope of the optical interference and the optoacoustic

S134: correcting distortion of the optoacoustic image by using the difference of the slopes

S210: Acquiring the photoacoustic original image and the optical interference original image

S220: transmitting the photoacoustic and optical interference original image

S230: detecting edges by applying an edge detection algorithm to each photoacoustic and optical interference original image

S240: Detecting the slope of the straight line using the Hough transform in each image image

S250: calculating the slope of the optical interference and the optoacoustic image, and obtaining the slope difference

S260: step of correcting the distortion of the optoacoustic image by warping the optoacoustic image by the difference of the slope

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. However, in describing the preferred embodiment of the present invention in detail, if it is determined that the detailed description of the related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and functions.

In addition, in the specification, when a part is 'connected' to another part, it is not only 'directly connected' but also 'indirectly connected' with another element in between. Include. In addition, the term "comprising" a certain component means that the component may further include other components, except for the case where there is no contrary description.

1 is a block diagram showing the configuration of a non-focused optoacoustic image distortion correction apparatus using an optical tomography image according to an embodiment of the present invention, Figure 2 is a optical tomographic image according to an embodiment of the present invention FIG. 10 is a diagram schematically illustrating a configuration of an optoacoustic image capturing unit of a non-focused optoacoustic image distortion correction apparatus. As shown in FIGS. 1 and 2, the non-focused optoacoustic image distortion correction apparatus 100 using the optical tomographic image according to an embodiment of the present invention includes an optoacoustic image capturing unit 110 and an optical interference tomography. The photographing unit 120 and the photoacoustic image distortion correction unit 130 may be configured.

The photoacoustic image capturing unit 110 is configured to acquire and output a photoacoustic original image of a biological tissue sample. The photoacoustic image capturing unit 110 may be configured as an optoacoustic microscope imaging apparatus that measures a thermal ultrasonic signal generated by a light source irradiated onto a biological tissue sample to non-invasively image the microstructure inside the biological tissue sample. . The photoacoustic image capturing unit 110 may include a fixed ultrasonic transducer 111 and a galvano scanner 112.

In addition, the photoacoustic image capturing unit 110 performs beam scanning using the fixed ultrasonic transducer 111 and the galvano scanner 112, and thus the position of the sample to which light is irradiated and the ultrasonic transducer 111 Image distortion may occur in the optoacoustic image obtained due to the distance difference. In this case, the photoacoustic original image includes structural information and oxygen saturation in the biological tissue sample.

The optical coherence tomography unit 120 is configured to acquire and output the optical interference original image of the biological tissue sample. The optical coherence tomography unit 120 may be configured as an optical coherence tomography apparatus combining the principle of the confocal microscope and the interference phenomenon of the laser light source for imaging the inside of the biological tissue sample in real time. Here, the non-focal photoacoustic image distortion correction apparatus 100 combines the lasers of the photoacoustic image capturing unit 110 and the optical coherence tomography unit 120 in the same optical path and scans the same area of the same biological tissue sample at the same time. By imaging, the driving control is performed such that the photoacoustic original image and the optical interference original image are obtained.

The optoacoustic image distortion correction unit 130 receives the photoacoustic original image and the optical interference original image obtained from the optoacoustic image capturing unit 110 and the optical interference tomography unit 120, based on the optical interference original image. It is the configuration to correct the distortion of the photoacoustic original image. The photoacoustic image distortion correction unit 130 detects edges by applying an edge detection algorithm to each of the photoacoustic and optical interference original images, and detects the slope of a straight line using a Hough transform in each image image. The slope difference between the interference and the optoacoustic image is calculated, and the distortion of the optoacoustic image is corrected by warping the optoacoustic image by the difference of the inclination.

In addition, the non-focal photoacoustic image distortion correction apparatus 100 includes the photoacoustic image capturing unit 110, the optical coherence tomography unit 120, and the photoacoustic image distortion correcting unit 130 as a single device, Or a separate optoacoustic microscope imaging device, an optical coherence tomography device, and an image processing control device that are electrically connected and connected.

3 is a view illustrating an operation flow of a non-focal photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention, and FIG. 4 is a view using an optical tomography image according to an embodiment of the present invention. In the focus optoacoustic image distortion correction method, the operation flow of the distortion correction step of the photoacoustic original image is shown. As shown in FIGS. 3 and 4, the non-focal photoacoustic image distortion correction method using the optical tomography image according to an embodiment of the present invention includes: acquiring the photoacoustic original image and the optical interference original image (S110). ), Providing a photoacoustic and optical interference original image (S120), and correcting the distortion of the photoacoustic original image (S130).

In operation S110, the photoacoustic original image and the optical interference original image of the biological tissue sample may be obtained using the photoacoustic image capturing unit 110 and the optical interference tomography unit 120. In step S110, the lasers of the photoacoustic imaging unit 110 and the optical coherence tomography unit 120 are combined and scanned in the same optical path to simultaneously image regions of the same biological tissue sample as shown in FIG. Photoacoustic original image and optical interference original image can be obtained. Here, the photoacoustic image capturing unit 110 may be configured as a photoacoustic microscope imaging device that measures the thermal ultrasonic signal generated by the light source irradiated onto the biological tissue sample to non-invasively image the microstructure inside the biological tissue sample. have. In addition, the photoacoustic imaging unit 110 may photograph and image a biological tissue at a depth of 10 cm at a resolution of a micro area, and includes a fixed ultrasonic transducer 111 and a galvano scanner 112. Can be configured. Here, the photoacoustic original image includes structural information and oxygen saturation in a biological tissue sample.

In step S120, the photoacoustic original image and the optical interference original image obtained in step S110 are transmitted to be received by the photoacoustic image distortion correction unit 130.

In operation S130, the distortion of the photoacoustic original image is corrected based on the optical interference original image received by the photoacoustic image distortion correcting unit 130. In this step S130, as shown in Figure 4, the photoacoustic image distortion correction unit 130, the step of detecting the edge of the received photoacoustic original image and the optical interference original image (S131), and the edge through the step S131 Detecting an inclination of a straight line in each detected image image (S132), calculating an inclination of the optical interference image detected in step S132 and an inclination of the optoacoustic image (S133), and in step S133 Compensating for the distortion of the optoacoustic image by using the calculated difference between the inclination of the optical interference image and the inclination of the photoacoustic image (S134).

In step S131, an edge for each of the photoacoustic original image PAM and the optical interference original image OCT shown in FIGS. 7A and 7 provided from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120 is provided. The detection algorithm is applied to detect edges of the photoacoustic original image and the optical interference original image, such as c and d of FIG. 7. Further, in step S132, a slope of a straight line as shown in e and f of FIG. 7 is detected from each image image of which edges are detected through step S131, but a process of detecting and obtaining the slope of the straight line using a Hough transform is performed. . Subsequently, in step S133, the inclination of the optical interference image and the inclination of the optoacoustic image detected through step S132 are calculated, and as shown in g of FIG. 7, the inclination difference between the inclination of the optical interference image and the inclination of the optoacoustic image is obtained. Next, in step S134, the distortion of the optoacoustic image is corrected by using the difference between the inclination of the optical interference image and the inclination of the optoacoustic image calculated in step S133, and the photoacoustic image is warped by the difference of the inclinations. As in h, distortion of the photoacoustic image is corrected.

FIG. 5 is a diagram illustrating another example of a non-focused optoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention. As shown in FIG. 5, the non-focal photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention includes obtaining an optoacoustic original image and an optical interference original image (S210), and Transmitting an acoustic and optical interference original image (S220), detecting an edge by applying an edge detection algorithm to each photoacoustic and optical interference original image (S230), and using Hough transform in each image image. Detecting an inclination of the straight line (S240), calculating an inclination of the optical interference and the optoacoustic image, obtaining an inclination difference (S250), and warping the optoacoustic image by the difference of the inclinations of the optoacoustic image. It may be implemented including the step of correcting the distortion (S260).

In step S210, the lasers of the photoacoustic imaging unit 110 and the optical coherence tomography unit 120 are combined in the same optical path and then scanned to simultaneously image the regions of the same biological tissue sample, and thus the photoacoustic original image and the optical interference original. Acquire an image. In this step S210, the photoacoustic original image PAM and the optical interference original image OCT are obtained. FIG. 6B illustrates the acquired photoacoustic original image PAM and optical interference original image OCT.

In step S220, the photoacoustic original image and the optical interference original image obtained in step S210 are transmitted to be received by the photoacoustic image distortion correction unit.

In step S230, the photoacoustic image distortion correction unit 130 is applied to the photoacoustic original image and the optical interference original image provided from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120 through step S220. The edge detection algorithm is applied to detect the edges of the photoacoustic original image and the optical interference original image. 7 a and b show an optical interference original image (OCT) and an optoacoustic original image (PAM), and c and d of FIG. 7 indicate edge detection of an optical interference original image (OCT) and an optoacoustic original image (PAM). Display the image.

In step S240, the slope of the straight line is detected using the Hough transform in each image image of which the edge is detected in step S230. 7E and 7E show an image of a straight line inclination, that is, a line detected from an edge detection image of an optical interference original image OCT and an optoacoustic original image PAM.

In operation S250, the inclination of the optical interference image and the inclination of the optoacoustic image detected through step S240 are calculated, and the inclination difference between the inclination of the optical interference image and the inclination of the optoacoustic image is calculated. 7g illustrates the difference between the inclinations of the optical interference image OCT and the optoacoustic image PAM.

In step S260, the distortion of the optoacoustic image is corrected by warping the optoacoustic image by a difference between the inclination of the photointerference image and the inclination of the optoacoustic image calculated in step S250. 7H illustrates the image distortion correction result of the photoacoustic image (PAM) using the derived slope.

FIG. 6 is a diagram illustrating an optoacoustic signal acquisition process and an acquired optoacoustic and coherent original image of the non-focal photoacoustic image distortion correction method using an optical tomography image according to an embodiment of the present invention. 6 (a) shows the process of acquiring the photoacoustic signal, and when the laser beam is scanned while the laser beam moves in the directions (1), (2) and (3), the laser beam is irradiated at the position of (1). At this time, the irradiation position of the ultrasonic transducer 111 and the laser beam is closer to when the laser is irradiated to (2) and (3). Therefore, the photoacoustic signal generated due to the short distance from the position where the sound wave is generated to the ultrasonic transducer 111 arrives more quickly at (2) and (3). 6B is an image of a needle placed horizontally using the photoacoustic imaging unit 110 and the optical interference tomography unit 120. That is, although the optical interference original image (OCT) under FIG. 6 (b) shows the horizontal position of the needle well, the photoacoustic original image (PAM) above FIG. 6 (b) shows the transmission distance of the ultrasonic signal. This causes distortion in the image and shows an image in which the needle is inclined.

FIG. 7 is a diagram illustrating an image changed for each process of the distortion correction step of the photoacoustic original image in the non-focused photoacoustic image distortion correction method using the optical tomography image according to an embodiment of the present invention. 7A and 7B show an optical interference image OCT and an optoacoustic image before correction of distortion, and c and d of FIG. 7 represent an image using an edge detection algorithm for the optical interference image and the photoacoustic image. . As such, the slope of the needle may be derived using the Hough transform in the edge-detected image. Fig. 7 e and f show the derived inclination of the needle in the original image. Fig. 7 g shows the difference between the inclination obtained from the optical interference image and the inclination obtained from the optoacoustic image, and warps the optoacoustic image to correct distortion. do. The corrected result may be represented as shown in h of FIG. 7. That is, FIG. 7 illustrates a process of correcting distortion of an optoacoustic image based on an optical coherence tomography image, and a and b represent original optical coherence tomography (OCT) and photoacoustic (PAM) original images, and c and d Edge detection images of OCT and PAM are shown, e and f represent slope derived images using Hough transform, g represents slope calculation of OCT and PAM, and h represents PAM image distortion correction result using derived slope. .

As described above, the non-focal photoacoustic image distortion correction method and apparatus using the optical tomography image according to an embodiment of the present invention, the photoacoustic signal that is changed by the ultrasonic transducer position and sample scanning of the photoacoustic microscope imaging device The photoacoustic image distortion generated by the distance between the acquisition positions of the photoacoustic images can be corrected based on the optical coherence tomography to correct the distortion of the photoacoustic image. It is possible to effectively correct the distortion of the acoustic image, and to enable more accurate image acquisition of the photoacoustic tomography. In addition, the photoacoustic image is corrected based on the optical coherence tomography image obtained by capturing the same position using an optoacoustic microscope imaging device and an optical coherence tomography device at the same time, and continuously correcting the distortion of the photoacoustic image. You can do it.

In particular, non-focal photoacoustic image distortion correction method and apparatus using the optical tomography image of the present invention will be applied as a key technology for correcting the image distortion of the optoacoustic imaging technology and surgical photoacoustic imaging device that is currently actively researched It is expected to be applied to the research and development of photoacoustic imaging technology and surgical photoacoustic microscope which is currently in the spotlight, and can be applied to the general development of ophthalmic photoacoustic imaging device. That is, the present invention corrects the image distortion generated when using the fixed ultrasonic transducer and galvanometer optical scanning in the optoacoustic microscope imaging apparatus based on the image of the optical coherence tomography apparatus, thereby positioning the ultrasonic transducer. In addition, it is possible to effectively correct an optoacoustic image whose image distortion is changed according to a tilt, based on an optical interference imaging apparatus that simultaneously images the same region.

The present invention described above may be variously modified or applied by those skilled in the art, and the scope of the technical idea according to the present invention should be defined by the following claims.

Claims

Non-focal photoacoustic image distortion correction method using optical tomography image,

(1) acquiring the photoacoustic original image and the optical interference original image of the biological tissue sample using the photoacoustic image capturing unit 110 and the optical interference tomography unit 120;

(2) receiving the photoacoustic original image and the optical interference original image obtained in step (1) by the photoacoustic image distortion correction unit 130; And

(3) correcting the distortion of the photoacoustic original image based on the optical interference original image received by the photoacoustic image distortion correcting unit 130,

The photoacoustic image capturing unit 110,

It is a photoacoustic microscope imaging device for measuring the thermal ultrasonic signals generated by the light source irradiated to the biological tissue sample to non-invasive to image the microstructure inside the biological tissue sample,

In the step (3),

(3-1) detecting, by the photoacoustic image distortion correcting unit, edges of the received photoacoustic original image and the optical interference original image;

(3-2) detecting a slope of a straight line in each image image of which edges are detected through step (3-1);

(3-3) calculating the slope of the optical interference image and the slope of the optoacoustic image detected through the step (3-2); And

(3-4) correcting the distortion of the optoacoustic image by using the difference between the inclination of the optical interference image and the inclination of the optoacoustic image calculated in step (3-3),

In the step (3-1),

The photoacoustic original image and the optical interference are applied to each of the photoacoustic original image and the optical interference original image provided from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120. Performs a process of detecting an edge of the original image,

In the step (3-2),

In step (3-1), the slope of the straight line is detected in each image image of which the edge is detected, and a process of detecting and obtaining the slope of the straight line using a half transform is performed.

In the step (3-3),

Calculating the inclination of the optical interference image and the inclination of the optoacoustic image detected through the step (3-2), obtaining the difference between the inclination of the optical interference image and the inclination of the optoacoustic image,

In the step (3-4),

The distortion of the photoacoustic image is corrected by using the difference between the slope of the optical interference image and the slope of the photoacoustic image calculated through the step (3-3), but the photoacoustic image is warped by the difference of the slope. Non-focused photoacoustic image distortion correction method using a tomography image, characterized in that the distortion of the image to be corrected, so that it is possible to continuously correct the distortion phenomenon of the photoacoustic image.
The method of claim 1, wherein in step (1),

The photoacoustic image capturing unit 110 and the optical interference tomography unit 120 combine the lasers in the same optical path and scan the same area of the same tissue sample to simultaneously scan the photoacoustic original image and the optical interference original image. A non-focused optoacoustic image distortion correction method using an optical tomography image, characterized in that obtaining.
According to claim 1, The photoacoustic image pickup unit 110,

Non-focused optoacoustic image distortion correction method using a tomography image, characterized in that the imaging and imaging the biological tissue sample to a depth of 10 cm at the resolution of the micro area.
According to claim 1, The photoacoustic image pickup unit 110,

Non-focal photoacoustic image distortion correction method using a tomography image, characterized in that it comprises a fixed ultrasonic transducer 111 and galvano scanner (112).
The method of claim 1, wherein the photoacoustic original image,

Non-focal photoacoustic image distortion correction method using a tomography image, characterized in that it comprises the structural information and the oxygen saturation in the biological tissue sample.
Non-focal photoacoustic image distortion correction method using optical tomography image,

(11) combining the lasers of the photoacoustic image capturing unit 110 and the optical coherence tomography unit 120 into the same optical path, and then scanning them to simultaneously image the areas of the same biological tissue sample, and thus the photoacoustic original image and the optical interference original image. Obtaining a;

(12) receiving the photoacoustic original image and the optical interference original image obtained in the step (11) in the photoacoustic image distortion correction unit (130);

(13) the photoacoustic image distortion correction unit 130 and the photoacoustic original image received from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120 through step (12); Detecting an edge of the photoacoustic original image and the optical interference original image by applying an edge detection algorithm to each of the optical interference original images;

(14) detecting a slope of a straight line using a Hough transform in each image image of which edges are detected through step (13);

(15) calculating a slope of the optical interference image and a slope of the photoacoustic image detected through the step (14), and obtaining a difference between the slope of the optical interference image and the slope of the photoacoustic image; And

(16) correcting the distortion of the optoacoustic image by warping the optoacoustic image by a difference between the inclination of the optical interference image and the inclination of the optoacoustic image calculated through the step (15),

The photoacoustic image capturing unit 110,

Non-focal light using an optical tomography image, characterized in that the optical acoustic microscope imaging device for measuring the thermal ultrasonic signals generated by the light source irradiated on the biological tissue sample to non-invasive to image the microstructure inside the biological tissue sample Acoustic image distortion correction method.
A non-focused optoacoustic image distortion correction apparatus 100 using an optical tomography image,

An optoacoustic imaging unit 110 for acquiring and outputting an optoacoustic original image of the biological tissue sample;

An optical coherence tomography unit 120 for obtaining and outputting an optical interference original image of the biological tissue sample; And

The photoacoustic original image and the optical interference original image obtained from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120 are provided to correct distortion of the photoacoustic original image based on the optical interference original image. Including a photoacoustic image distortion correction unit 130 for the correction process,

The photoacoustic image capturing unit 110,

It is a photoacoustic microscope imaging device for measuring the thermal ultrasonic signals generated by the light source irradiated to the biological tissue sample to non-invasive to image the microstructure inside the biological tissue sample,

The photoacoustic image distortion correction unit 130 detects edges of the photoacoustic original image and the optical interference original image provided from the photoacoustic image capturing unit 110 and the optical interference tomography unit 120. Applying an algorithm to detect edges of the photoacoustic original image and the optical interference original image,

A slope of a straight line is detected by using a half transform in each image image of which the edge is detected,

Calculating the slope of the detected optical interference image and the slope of the photoacoustic image, obtaining the difference between the slope of the optical interference image and the slope of the photoacoustic image,

Non-focal photoacoustic image distortion correction apparatus using the optical tomography image, characterized in that the distortion of the optoacoustic image by warping the photoacoustic image by the difference between the calculated inclination of the optical interference image and the inclination of the photoacoustic image .
The apparatus of claim 7, wherein the non-focused optoacoustic image distortion correcting apparatus 100 comprises:

The photoacoustic image pickup unit 110 and the optical interference tomography unit 120 combine the lasers in the same optical path and scan the same area of the same tissue sample to simultaneously scan the photoacoustic original image and the optical interference original image. And non-focused optoacoustic image distortion correction apparatus using optical tomography image, characterized in that the drive control to obtain.
The method of claim 7, wherein the photoacoustic image pickup unit 110,

Non-focused optoacoustic image distortion correction device, characterized in that it comprises a fixed ultrasonic transducer 111 and galvano scanner (112).
The method of claim 9, wherein the photoacoustic image pickup unit 110,

As the beam scanning is performed by using the fixed ultrasound transducer 111 and the galvano scanner 112, the image is obtained from the photoacoustic image obtained by the distance between the sample to which the light is irradiated and the distance between the ultrasound transducer 111. A non-focused optoacoustic image distortion correction apparatus using a tomography image, characterized in that distortion is generated.
The method of claim 9, wherein the photoacoustic original image,

Non-focal photoacoustic image distortion correction apparatus using a tomography image, characterized in that it comprises structural information and oxygen saturation in the biological tissue sample.
The method of claim 7, wherein the optical coherence tomography unit 120,

Non-focal optoacoustic image distortion correction apparatus comprising an optical coherence tomography apparatus combining the principle of the confocal microscope and the interference phenomenon of the laser light source for imaging the inside of the biological tissue sample in real time .
The apparatus of claim 7, wherein the non-focused optoacoustic image distortion correcting apparatus 100 comprises:

The optoacoustic image capturing unit 110, the optical coherence tomography unit 120, and the optoacoustic image distortion correcting unit 130 are configured as a single device or are electrically connected and connected to a separate photoacoustic microscope imaging apparatus. And an optical coherence tomography device and an image processing control device.